2024-02-07T12:05:19.795 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-07T12:05:19.795 DEBUG:teuthology.run:Teuthology command: teuthology --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --verbose --name gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi --archive /home/teuthworker/archive/gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi/7548724 --owner scheduled_gabrioux@teuthology -- /home/teuthworker/archive/gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi/7548724/orig.config.yaml 2024-02-07T12:05:19.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T12:05:19.933 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi/7548724 branch: wip-guits-testing-4-2024-02-05-1854 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: gabrioux@ibm.com first_in_suite: false job_id: '7548724' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-testing-4-2024-02-05-1854 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 44458ccedb18241cc2e17f10cdab3d1385399261 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 44458ccedb18241cc2e17f10cdab3d1385399261 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-guits-testing-4-2024-02-05-1854 sha1: 44458ccedb18241cc2e17f10cdab3d1385399261 owner: scheduled_gabrioux@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 1701 sha1: 44458ccedb18241cc2e17f10cdab3d1385399261 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-testing-4-2024-02-05-1854 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_44458ccedb18241cc2e17f10cdab3d1385399261/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 44458ccedb18241cc2e17f10cdab3d1385399261 targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKSJaGul6GuhQZI5QqCjvHDEttfIJE0hRAVHaIjrXzVF0/FJUUwi2S1tEB0H9Df88z/O9Xx7AD0prbWKr2cSFv4= smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMq9V85Bw7ZwMtyqlQtPlTOXKfP2ZYfY0TqT+9JPuAftF13+B1jjDz6vvzHiis/ZPPwyn2r4awGLJq6EsHWJR3I= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/gabrioux/src/git.ceph.com_ceph-c_wip-guits-testing-4-2024-02-05-1854/qa/suites/orch/cephadm/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: d9fdb2209e15b39d9f061fd85399f352ce0f0894 timestamp: 2024-02-06_08:19:47 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-07T12:05:19.933 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_44458ccedb18241cc2e17f10cdab3d1385399261/qa; will attempt to use it 2024-02-07T12:05:19.934 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_44458ccedb18241cc2e17f10cdab3d1385399261/qa/tasks 2024-02-07T12:05:19.934 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-07T12:05:19.936 INFO:teuthology.task.internal:Checking packages... 2024-02-07T12:05:19.960 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '44458ccedb18241cc2e17f10cdab3d1385399261' 2024-02-07T12:05:19.960 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-07T12:05:19.960 INFO:teuthology.packaging:ref: None 2024-02-07T12:05:19.960 INFO:teuthology.packaging:tag: None 2024-02-07T12:05:19.960 INFO:teuthology.packaging:branch: wip-guits-testing-4-2024-02-05-1854 2024-02-07T12:05:19.960 INFO:teuthology.packaging:sha1: 44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:05:19.961 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-testing-4-2024-02-05-1854 2024-02-07T12:05:20.101 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1252.g44458cce 2024-02-07T12:05:20.102 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-07T12:05:20.109 INFO:teuthology.task.internal:no buildpackages task found 2024-02-07T12:05:20.109 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-07T12:05:20.126 INFO:teuthology.task.internal:Saving configuration 2024-02-07T12:05:20.145 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-07T12:05:20.151 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-07T12:05:20.177 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi/7548724', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-07 12:00:11.725736', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKSJaGul6GuhQZI5QqCjvHDEttfIJE0hRAVHaIjrXzVF0/FJUUwi2S1tEB0H9Df88z/O9Xx7AD0prbWKr2cSFv4='} 2024-02-07T12:05:20.200 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi/7548724', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-07 12:00:11.724309', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMq9V85Bw7ZwMtyqlQtPlTOXKfP2ZYfY0TqT+9JPuAftF13+B1jjDz6vvzHiis/ZPPwyn2r4awGLJq6EsHWJR3I='} 2024-02-07T12:05:20.201 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-07T12:05:20.207 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-07T12:05:20.207 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-07T12:05:20.207 INFO:teuthology.run_tasks:Running task console_log... 2024-02-07T12:05:20.286 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4012b030d0>, signals=[15]) 2024-02-07T12:05:20.287 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-07T12:05:20.294 INFO:teuthology.task.internal:Opening connections... 2024-02-07T12:05:20.294 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:05:20.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T12:05:20.406 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-02-07T12:05:20.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T12:05:20.497 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-07T12:05:20.504 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-02-07T12:05:20.521 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-02-07T12:05:20.522 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-02-07T12:05:20.579 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-02-07T12:05:20.579 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-02-07T12:05:20.579 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-02-07T12:05:20.579 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-02-07T12:05:20.579 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-02-07T12:05:20.579 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-02-07T12:05:20.579 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-07T12:05:20.579 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-02-07T12:05:20.579 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-02-07T12:05:20.580 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-07T12:05:20.580 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-02-07T12:05:20.580 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T12:05:20.580 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-07T12:05:20.580 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T12:05:20.580 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-02-07T12:05:20.601 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-02-07T12:05:20.618 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-02-07T12:05:20.619 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-02-07T12:05:20.674 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-02-07T12:05:20.674 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-02-07T12:05:20.674 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-02-07T12:05:20.674 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-02-07T12:05:20.674 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-02-07T12:05:20.674 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-02-07T12:05:20.674 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-07T12:05:20.675 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-02-07T12:05:20.675 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-02-07T12:05:20.675 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-07T12:05:20.675 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-02-07T12:05:20.675 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T12:05:20.675 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-07T12:05:20.675 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T12:05:20.675 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-02-07T12:05:20.693 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-07T12:05:20.703 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-07T12:05:20.710 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-07T12:05:20.710 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-02-07T12:05:20.713 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-02-07T12:05:20.730 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-07T12:05:20.739 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-07T12:05:20.739 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-02-07T12:05:20.771 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-02-07T12:05:20.863 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-07T12:05:20.920 INFO:teuthology.run_tasks:Running task kernel... 2024-02-07T12:05:20.935 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-07T12:05:20.936 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-07T12:05:20.936 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-07T12:05:20.936 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-07T12:05:20.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-07T12:05:20.953 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-02-07T12:05:20.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-07T12:05:20.954 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-02-07T12:05:21.010 INFO:teuthology.orchestra.run.smithi138.stdout:5.14.0-361.el9.x86_64 2024-02-07T12:05:21.010 INFO:teuthology.task.kernel:Running kernel on smithi138: 5.14.0-361.el9.x86_64 2024-02-07T12:05:21.010 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum install -y kernel 2024-02-07T12:05:21.013 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-361.el9.x86_64 2024-02-07T12:05:21.013 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.14.0-361.el9.x86_64 2024-02-07T12:05:21.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y kernel 2024-02-07T12:05:23.159 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-02-07T12:05:23.259 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-9 - AppStream 17 MB/s | 6.7 MB 00:00 2024-02-07T12:05:24.584 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - BaseOS 7.5 MB/s | 2.0 MB 00:00 2024-02-07T12:05:24.851 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-9 - BaseOS 4.5 MB/s | 2.0 MB 00:00 2024-02-07T12:05:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-02-07T12:05:26.860 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.0 MB 00:01 2024-02-07T12:05:28.984 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 19 MB 00:02 2024-02-07T12:05:29.670 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-02-07T12:05:33.378 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 5.9 MB 00:00 2024-02-07T12:05:33.743 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 5.9 MB 00:00 2024-02-07T12:05:34.793 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 15 kB 00:00 2024-02-07T12:05:36.060 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 15 kB 00:01 2024-02-07T12:05:36.811 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2024-02-07T12:05:37.581 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2024-02-07T12:05:41.862 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-02-07T12:05:42.478 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-02-07T12:05:44.177 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-07T12:05:44.177 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-07T12:05:44.277 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:05:44.285 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:05:44.286 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-02-07T12:05:44.286 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:05:44.286 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:05:44.286 INFO:teuthology.orchestra.run.smithi047.stdout: kernel x86_64 5.14.0-418.el9 CentOS-BaseOS 6.0 M 2024-02-07T12:05:44.286 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-02-07T12:05:44.286 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core x86_64 5.14.0-418.el9 CentOS-BaseOS 21 M 2024-02-07T12:05:44.286 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules x86_64 5.14.0-418.el9 CentOS-BaseOS 39 M 2024-02-07T12:05:44.286 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core x86_64 5.14.0-418.el9 CentOS-BaseOS 33 M 2024-02-07T12:05:44.286 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:05:44.286 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:05:44.286 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:05:44.286 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-02-07T12:05:44.287 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:05:44.287 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 99 M 2024-02-07T12:05:44.287 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 122 M 2024-02-07T12:05:44.287 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:05:44.613 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): kernel-5.14.0-418.el9.x86_64.rpm 18 MB/s | 6.0 MB 00:00 2024-02-07T12:05:44.652 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-07T12:05:44.652 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-07T12:05:44.756 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:05:44.766 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:05:44.767 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-07T12:05:44.767 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:05:44.767 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:05:44.767 INFO:teuthology.orchestra.run.smithi138.stdout: kernel x86_64 5.14.0-418.el9 CentOS-BaseOS 6.0 M 2024-02-07T12:05:44.767 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-07T12:05:44.767 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-core x86_64 5.14.0-418.el9 CentOS-BaseOS 21 M 2024-02-07T12:05:44.767 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules x86_64 5.14.0-418.el9 CentOS-BaseOS 39 M 2024-02-07T12:05:44.767 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-core x86_64 5.14.0-418.el9 CentOS-BaseOS 33 M 2024-02-07T12:05:44.767 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:05:44.767 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:05:44.767 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:05:44.767 INFO:teuthology.orchestra.run.smithi138.stdout:Install 4 Packages 2024-02-07T12:05:44.767 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:05:44.768 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 99 M 2024-02-07T12:05:44.768 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 122 M 2024-02-07T12:05:44.768 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:05:45.138 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): kernel-core-5.14.0-418.el9.x86_64.rpm 24 MB/s | 21 MB 00:00 2024-02-07T12:05:45.263 INFO:teuthology.orchestra.run.smithi138.stdout:(1/4): kernel-5.14.0-418.el9.x86_64.rpm 12 MB/s | 6.0 MB 00:00 2024-02-07T12:05:46.021 INFO:teuthology.orchestra.run.smithi138.stdout:(2/4): kernel-core-5.14.0-418.el9.x86_64.rpm 17 MB/s | 21 MB 00:01 2024-02-07T12:05:46.255 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): kernel-modules-5.14.0-418.el9.x86_64.rpm 20 MB/s | 39 MB 00:01 2024-02-07T12:05:46.555 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): kernel-modules-core-5.14.0-418.el9.x86_6 17 MB/s | 33 MB 00:01 2024-02-07T12:05:46.559 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:05:46.559 INFO:teuthology.orchestra.run.smithi047.stdout:Total 44 MB/s | 99 MB 00:02 2024-02-07T12:05:46.559 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:05:46.630 INFO:teuthology.orchestra.run.smithi138.stdout:(3/4): kernel-modules-core-5.14.0-418.el9.x86_6 24 MB/s | 33 MB 00:01 2024-02-07T12:05:47.018 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:05:47.018 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:05:47.105 INFO:teuthology.orchestra.run.smithi138.stdout:(4/4): kernel-modules-5.14.0-418.el9.x86_64.rpm 17 MB/s | 39 MB 00:02 2024-02-07T12:05:47.108 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:05:47.108 INFO:teuthology.orchestra.run.smithi138.stdout:Total 42 MB/s | 99 MB 00:02 2024-02-07T12:05:47.109 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:05:47.481 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:05:47.481 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:05:48.071 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:05:48.072 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:05:48.512 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:05:48.512 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:05:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:05:50.905 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:05:51.300 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-core-5.14.0-418.el9.x86_64 1/4 2024-02-07T12:05:51.440 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-core-5.14.0-418.el9.x86_64 2/4 2024-02-07T12:05:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-modules-core-5.14.0-418.el9.x86_64 1/4 2024-02-07T12:05:51.708 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-core-5.14.0-418.el9.x86_64 2/4 2024-02-07T12:05:54.348 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-418.el9.x86_64 2/4 2024-02-07T12:05:54.474 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-core-5.14.0-418.el9.x86_64 2/4 2024-02-07T12:05:54.525 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-5.14.0-418.el9.x86_64 3/4 2024-02-07T12:05:54.686 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-modules-5.14.0-418.el9.x86_64 3/4 2024-02-07T12:05:59.360 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-5.14.0-418.el9.x86_64 3/4 2024-02-07T12:05:59.613 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-418.el9.x86_64 3/4 2024-02-07T12:05:59.615 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-5.14.0-418.el9.x86_64 4/4 2024-02-07T12:05:59.889 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-5.14.0-418.el9.x86_64 4/4 2024-02-07T12:06:04.340 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-core-5.14.0-418.el9.x86_64 4/4 2024-02-07T12:06:05.004 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-core-5.14.0-418.el9.x86_64 4/4 2024-02-07T12:06:33.758 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-core-5.14.0-418.el9.x86_64 4/4 2024-02-07T12:06:33.758 INFO:teuthology.orchestra.run.smithi138.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-07T12:06:33.758 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:06:33.828 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-5.14.0-418.el9.x86_64 4/4 2024-02-07T12:06:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-5.14.0-418.el9.x86_64 4/4 2024-02-07T12:06:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-5.14.0-418.el9.x86_64 1/4 2024-02-07T12:06:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-core-5.14.0-418.el9.x86_64 2/4 2024-02-07T12:06:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-modules-5.14.0-418.el9.x86_64 3/4 2024-02-07T12:06:34.705 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-modules-core-5.14.0-418.el9.x86_64 4/4 2024-02-07T12:06:34.705 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:06:34.706 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:06:34.706 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-5.14.0-418.el9.x86_64 2024-02-07T12:06:34.706 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-core-5.14.0-418.el9.x86_64 2024-02-07T12:06:34.706 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-5.14.0-418.el9.x86_64 2024-02-07T12:06:34.706 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-core-5.14.0-418.el9.x86_64 2024-02-07T12:06:34.706 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:06:34.706 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:06:35.249 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q kernel | sort -rV | head -n 1 2024-02-07T12:06:35.392 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-5.14.0-418.el9.x86_64 2024-02-07T12:06:35.393 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-418.el9.x86_64 2024-02-07T12:06:35.393 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-418.el9.x86_64 2024-02-07T12:06:35.393 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-07T12:06:35.393 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-07T12:06:35.393 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-02-07T12:06:35.393 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2024-02-07T12:06:35.394 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q kernel | sort -rV | head -n 1 2024-02-07T12:06:35.501 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-5.14.0-418.el9.x86_64 2024-02-07T12:06:35.501 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-418.el9.x86_64 2024-02-07T12:06:35.501 DEBUG:teuthology.orchestra.run.smithi138:> sudo rpm -qi grub2-tools 2024-02-07T12:06:35.535 INFO:teuthology.orchestra.run.smithi138.stdout:Name : grub2-tools 2024-02-07T12:06:35.536 INFO:teuthology.orchestra.run.smithi138.stdout:Epoch : 1 2024-02-07T12:06:35.536 INFO:teuthology.orchestra.run.smithi138.stdout:Version : 2.06 2024-02-07T12:06:35.536 INFO:teuthology.orchestra.run.smithi138.stdout:Release : 68.el9 2024-02-07T12:06:35.536 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: x86_64 2024-02-07T12:06:35.536 INFO:teuthology.orchestra.run.smithi138.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-07T12:06:35.536 INFO:teuthology.orchestra.run.smithi138.stdout:Group : Unspecified 2024-02-07T12:06:35.536 INFO:teuthology.orchestra.run.smithi138.stdout:Size : 8264254 2024-02-07T12:06:35.536 INFO:teuthology.orchestra.run.smithi138.stdout:License : GPLv3+ 2024-02-07T12:06:35.536 INFO:teuthology.orchestra.run.smithi138.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-07T12:06:35.537 INFO:teuthology.orchestra.run.smithi138.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-07T12:06:35.537 INFO:teuthology.orchestra.run.smithi138.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-07T12:06:35.537 INFO:teuthology.orchestra.run.smithi138.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-07T12:06:35.537 INFO:teuthology.orchestra.run.smithi138.stdout:Packager : builder@centos.org 2024-02-07T12:06:35.537 INFO:teuthology.orchestra.run.smithi138.stdout:Vendor : CentOS 2024-02-07T12:06:35.537 INFO:teuthology.orchestra.run.smithi138.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-07T12:06:35.537 INFO:teuthology.orchestra.run.smithi138.stdout:Summary : Support tools for GRUB. 2024-02-07T12:06:35.537 INFO:teuthology.orchestra.run.smithi138.stdout:Description : 2024-02-07T12:06:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:06:35.537 INFO:teuthology.orchestra.run.smithi138.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-07T12:06:35.537 INFO:teuthology.orchestra.run.smithi138.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-07T12:06:35.537 INFO:teuthology.orchestra.run.smithi138.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-07T12:06:35.537 INFO:teuthology.orchestra.run.smithi138.stdout:hardware devices. 2024-02-07T12:06:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:06:35.538 INFO:teuthology.orchestra.run.smithi138.stdout:This subpackage provides tools for support of all platforms. 2024-02-07T12:06:35.538 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-07T12:06:35.539 INFO:teuthology.task.kernel:Updating grub on smithi138 to boot 5.14.0-418.el9.x86_64 2024-02-07T12:06:35.539 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-07T12:06:35.637 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-418.el9.x86_64 4/4 2024-02-07T12:06:35.637 INFO:teuthology.orchestra.run.smithi047.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-07T12:06:35.637 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:06:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-418.el9.x86_64 4/4 2024-02-07T12:06:36.135 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-5.14.0-418.el9.x86_64 4/4 2024-02-07T12:06:36.136 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-5.14.0-418.el9.x86_64 1/4 2024-02-07T12:06:36.136 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-core-5.14.0-418.el9.x86_64 2/4 2024-02-07T12:06:36.136 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-5.14.0-418.el9.x86_64 3/4 2024-02-07T12:06:36.149 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-02-07T12:06:36.586 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-core-5.14.0-418.el9.x86_64 4/4 2024-02-07T12:06:36.587 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:06:36.587 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:06:36.587 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-5.14.0-418.el9.x86_64 2024-02-07T12:06:36.587 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core-5.14.0-418.el9.x86_64 2024-02-07T12:06:36.587 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-5.14.0-418.el9.x86_64 2024-02-07T12:06:36.587 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core-5.14.0-418.el9.x86_64 2024-02-07T12:06:36.587 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:06:36.587 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:06:37.065 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-02-07T12:06:37.220 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-418.el9.x86_64 2024-02-07T12:06:37.220 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-418.el9.x86_64 2024-02-07T12:06:37.220 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-418.el9.x86_64 2024-02-07T12:06:37.221 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-07T12:06:37.221 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-07T12:06:37.221 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-02-07T12:06:37.221 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-02-07T12:06:37.221 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-02-07T12:06:37.334 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-418.el9.x86_64 2024-02-07T12:06:37.334 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-418.el9.x86_64 2024-02-07T12:06:37.334 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-02-07T12:06:37.372 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-02-07T12:06:37.372 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-02-07T12:06:37.372 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 68.el9 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8264254 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-02-07T12:06:37.373 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-02-07T12:06:37.374 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:06:37.374 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-07T12:06:37.374 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-07T12:06:37.374 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-07T12:06:37.374 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-02-07T12:06:37.374 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:06:37.374 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-02-07T12:06:37.375 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-07T12:06:37.375 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 5.14.0-418.el9.x86_64 2024-02-07T12:06:37.375 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-07T12:06:37.608 INFO:teuthology.orchestra.run.smithi138.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-07T12:06:37.648 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-02-07T12:06:37.651 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-02-07T12:06:37.666 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.7ms5UeZtrd 2024-02-07T12:06:37.667 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7ms5UeZtrd 2024-02-07T12:06:37.735 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.7ms5UeZtrd 2024-02-07T12:06:37.878 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.7ms5UeZtrd is 6KB 2024-02-07T12:06:37.926 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.7ms5UeZtrd 2024-02-07T12:06:37.941 DEBUG:teuthology.orchestra.run.smithi138:> sudo /bin/ls /boot/loader/entries || true 2024-02-07T12:06:38.005 INFO:teuthology.orchestra.run.smithi138.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-07T12:06:38.005 INFO:teuthology.orchestra.run.smithi138.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-07T12:06:38.005 INFO:teuthology.orchestra.run.smithi138.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-07T12:06:38.005 INFO:teuthology.orchestra.run.smithi138.stdout:15949e3c88704300882482eddfd7baae-5.14.0-418.el9.x86_64.conf 2024-02-07T12:06:38.006 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-418.el9.x86_64 2024-02-07T12:06:38.016 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-02-07T12:06:38.161 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2024-02-07T12:06:39.416 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-07T12:06:39.454 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-02-07T12:06:39.456 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-02-07T12:06:39.472 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.5J7W8eBPXl 2024-02-07T12:06:39.472 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5J7W8eBPXl 2024-02-07T12:06:39.555 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.5J7W8eBPXl 2024-02-07T12:06:39.696 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.5J7W8eBPXl is 6KB 2024-02-07T12:06:39.745 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.5J7W8eBPXl 2024-02-07T12:06:39.759 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-02-07T12:06:39.828 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-07T12:06:39.828 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-07T12:06:39.828 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-07T12:06:39.828 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-5.14.0-418.el9.x86_64.conf 2024-02-07T12:06:39.829 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-418.el9.x86_64 2024-02-07T12:06:39.989 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-02-07T12:07:08.191 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-07T12:07:08.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-07T12:07:08.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T12:07:09.992 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-07T12:07:09.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-02-07T12:07:09.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T12:07:26.524 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-02-07T12:07:28.316 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-02-07T12:07:35.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-07T12:07:35.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T12:07:37.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-02-07T12:07:37.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T12:07:38.592 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-02-07T12:07:40.384 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-02-07T12:07:50.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-07T12:07:50.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T12:07:52.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-02-07T12:07:52.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T12:08:09.020 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-02-07T12:08:24.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-07T12:08:24.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T12:08:24.256 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-02-07T12:08:24.447 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-02-07T12:08:24.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-02-07T12:08:24.795 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-418.el9.x86_64"... 2024-02-07T12:08:24.795 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-02-07T12:08:24.812 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-418.el9.x86_64 2024-02-07T12:08:24.812 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-418.el9.x86_64 vs 5.14.0-418.el9.x86_64 2024-02-07T12:08:24.813 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-07T12:08:24.813 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-07T12:08:24.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-07T12:08:24.865 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-418.el9.x86_64"... 2024-02-07T12:08:24.865 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-02-07T12:08:24.879 INFO:teuthology.orchestra.run.smithi138.stdout:5.14.0-418.el9.x86_64 2024-02-07T12:08:24.880 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-418.el9.x86_64 vs 5.14.0-418.el9.x86_64 2024-02-07T12:08:24.880 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-07T12:08:24.880 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-07T12:08:25.813 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-07T12:08:25.813 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-07T12:08:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-02-07T12:08:25.881 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-07T12:08:25.881 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-07T12:08:25.909 DEBUG:teuthology.parallel:result is None 2024-02-07T12:08:25.939 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2024-02-07T12:08:25.983 DEBUG:teuthology.parallel:result is None 2024-02-07T12:08:25.984 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-07T12:08:25.991 INFO:teuthology.task.internal:Creating test directory... 2024-02-07T12:08:25.991 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-07T12:08:25.994 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-07T12:08:26.008 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-07T12:08:26.015 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-07T12:08:26.021 INFO:teuthology.task.internal:Creating archive directory... 2024-02-07T12:08:26.021 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-07T12:08:26.048 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-07T12:08:26.077 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-07T12:08:26.083 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-07T12:08:26.083 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-07T12:08:26.113 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-07T12:08:26.141 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-07T12:08:26.141 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-07T12:08:26.154 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-07T12:08:26.154 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-07T12:08:26.156 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-07T12:08:26.163 INFO:teuthology.task.internal:Configuring sudo... 2024-02-07T12:08:26.164 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-07T12:08:26.198 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-07T12:08:26.225 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-07T12:08:26.234 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-07T12:08:26.234 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-07T12:08:26.265 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-07T12:08:26.279 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-07T12:08:26.362 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-07T12:08:26.420 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-07T12:08:26.462 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-07T12:08:26.502 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:08:26.503 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-07T12:08:26.570 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-07T12:08:26.611 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-07T12:08:26.660 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-07T12:08:26.741 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-07T12:08:26.783 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:08:26.784 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-07T12:08:26.851 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-02-07T12:08:26.853 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-02-07T12:08:26.900 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-07T12:08:27.030 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-07T12:08:27.465 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-07T12:08:27.472 INFO:teuthology.task.internal:Starting timer... 2024-02-07T12:08:27.472 INFO:teuthology.run_tasks:Running task pcp... 2024-02-07T12:08:27.482 INFO:teuthology.run_tasks:Running task selinux... 2024-02-07T12:08:27.490 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-07T12:08:27.491 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-02-07T12:08:27.541 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-02-07T12:08:27.543 DEBUG:teuthology.orchestra.run.smithi138:> sudo service auditd rotate 2024-02-07T12:08:27.625 INFO:teuthology.orchestra.run.smithi138.stdout:Rotating logs: 2024-02-07T12:08:27.630 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-07T12:08:27.630 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-02-07T12:08:27.655 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-02-07T12:08:27.656 DEBUG:teuthology.orchestra.run.smithi138:> /usr/sbin/getenforce 2024-02-07T12:08:27.687 INFO:teuthology.orchestra.run.smithi138.stdout:Permissive 2024-02-07T12:08:27.687 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi138.front.sepia.ceph.com': 'permissive'} 2024-02-07T12:08:27.687 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-07T12:08:27.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-07T12:08:27.726 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-07T12:08:27.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-07T12:08:27.787 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-07T12:08:27.787 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-02-07T12:08:27.824 DEBUG:teuthology.orchestra.run.smithi138:> sudo /usr/sbin/setenforce permissive 2024-02-07T12:08:27.880 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-07T12:08:27.890 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-07T12:08:27.895 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-07T12:08:28.015 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-07T12:08:28.029 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-07T12:08:28.031 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-07T12:12:37.383 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2024-02-07T12:12:37.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-02-07T12:12:37.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T12:12:37.492 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-02-07T12:12:37.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-02-07T12:12:37.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-07T12:12:37.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T12:12:37.662 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-02-07T12:12:37.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-07T12:12:37.749 INFO:teuthology.run_tasks:Running task clock... 2024-02-07T12:12:37.764 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-07T12:12:37.764 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-07T12:12:37.764 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-07T12:12:37.767 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-07T12:12:37.767 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-07T12:12:37.800 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-07T12:12:37.818 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-07T12:12:37.822 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-07T12:12:37.839 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-07T12:12:37.850 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-02-07T12:12:37.864 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-02-07T12:12:37.869 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: ntpd: command not found 2024-02-07T12:12:37.881 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-07T12:12:37.883 INFO:teuthology.orchestra.run.smithi138.stdout:506 Cannot talk to daemon 2024-02-07T12:12:37.898 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-07T12:12:37.900 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-07T12:12:37.916 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-07T12:12:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-02-07T12:12:37.952 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-07T12:12:37.952 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-02-07T12:12:37.952 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-07T12:12:37.952 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-07T12:12:37.952 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-07T12:12:37.952 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-07T12:12:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-02-07T12:12:37.981 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-07T12:12:37.982 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-02-07T12:12:37.982 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-07T12:12:37.982 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-07T12:12:37.982 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-07T12:12:37.982 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-07T12:12:37.983 INFO:teuthology.run_tasks:Running task install... 2024-02-07T12:12:37.991 DEBUG:teuthology.task.install:project ceph 2024-02-07T12:12:37.992 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '44458ccedb18241cc2e17f10cdab3d1385399261'}} 2024-02-07T12:12:37.992 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '44458ccedb18241cc2e17f10cdab3d1385399261'} 2024-02-07T12:12:37.992 INFO:teuthology.task.install:Using flavor: default 2024-02-07T12:12:37.998 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-07T12:12:37.998 INFO:teuthology.task.install:extra packages: [] 2024-02-07T12:12:37.998 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '44458ccedb18241cc2e17f10cdab3d1385399261', 'tag': None, 'wait_for_package': False} 2024-02-07T12:12:37.999 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-07T12:12:37.999 INFO:teuthology.packaging:ref: None 2024-02-07T12:12:37.999 INFO:teuthology.packaging:tag: None 2024-02-07T12:12:37.999 INFO:teuthology.packaging:branch: quincy 2024-02-07T12:12:37.999 INFO:teuthology.packaging:sha1: 44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:12:37.999 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-07T12:12:38.002 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '44458ccedb18241cc2e17f10cdab3d1385399261', 'tag': None, 'wait_for_package': False} 2024-02-07T12:12:38.002 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-07T12:12:38.002 INFO:teuthology.packaging:ref: None 2024-02-07T12:12:38.002 INFO:teuthology.packaging:tag: None 2024-02-07T12:12:38.002 INFO:teuthology.packaging:branch: quincy 2024-02-07T12:12:38.002 INFO:teuthology.packaging:sha1: 44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:12:38.002 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-07T12:12:38.239 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/f246262574ca5be9ad8a5df4a03f9915c136ce44/centos/9/flavors/default/ 2024-02-07T12:12:38.239 INFO:teuthology.task.install.rpm:Package version is 17.2.7-491.gf2462625 2024-02-07T12:12:38.333 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/f246262574ca5be9ad8a5df4a03f9915c136ce44/centos/9/flavors/default/ 2024-02-07T12:12:38.333 INFO:teuthology.task.install.rpm:Package version is 17.2.7-491.gf2462625 2024-02-07T12:12:38.357 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/f246262574ca5be9ad8a5df4a03f9915c136ce44/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/f246262574ca5be9ad8a5df4a03f9915c136ce44/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/f246262574ca5be9ad8a5df4a03f9915c136ce44/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-07T12:12:38.358 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:12:38.358 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-07T12:12:38.386 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-07T12:12:38.386 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-07T12:12:38.387 INFO:teuthology.packaging:ref: None 2024-02-07T12:12:38.387 INFO:teuthology.packaging:tag: None 2024-02-07T12:12:38.387 INFO:teuthology.packaging:branch: quincy 2024-02-07T12:12:38.387 INFO:teuthology.packaging:sha1: 44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:12:38.387 DEBUG:teuthology.orchestra.run.smithi138:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-07T12:12:38.456 DEBUG:teuthology.orchestra.run.smithi138:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-07T12:12:38.523 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/f246262574ca5be9ad8a5df4a03f9915c136ce44/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/f246262574ca5be9ad8a5df4a03f9915c136ce44/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/f246262574ca5be9ad8a5df4a03f9915c136ce44/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-07T12:12:38.523 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:12:38.523 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-07T12:12:38.536 DEBUG:teuthology.orchestra.run.smithi138:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-07T12:12:38.553 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-07T12:12:38.553 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-07T12:12:38.553 INFO:teuthology.packaging:ref: None 2024-02-07T12:12:38.553 INFO:teuthology.packaging:tag: None 2024-02-07T12:12:38.553 INFO:teuthology.packaging:branch: quincy 2024-02-07T12:12:38.553 INFO:teuthology.packaging:sha1: 44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:12:38.553 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-07T12:12:38.603 INFO:teuthology.orchestra.run.smithi138.stdout:check_obsoletes = 1 2024-02-07T12:12:38.605 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum clean all 2024-02-07T12:12:38.623 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-07T12:12:38.705 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-07T12:12:38.772 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-02-07T12:12:38.774 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-02-07T12:12:38.847 INFO:teuthology.orchestra.run.smithi138.stdout:74 files removed 2024-02-07T12:12:38.874 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-radosgw 2024-02-07T12:12:39.031 INFO:teuthology.orchestra.run.smithi047.stdout:74 files removed 2024-02-07T12:12:39.058 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw 2024-02-07T12:12:39.667 INFO:teuthology.orchestra.run.smithi138.stdout:ceph packages for x86_64 162 kB/s | 77 kB 00:00 2024-02-07T12:12:39.733 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 220 kB/s | 77 kB 00:00 2024-02-07T12:12:40.026 INFO:teuthology.orchestra.run.smithi138.stdout:ceph noarch packages 29 kB/s | 9.1 kB 00:00 2024-02-07T12:12:40.075 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 31 kB/s | 9.1 kB 00:00 2024-02-07T12:12:40.360 INFO:teuthology.orchestra.run.smithi138.stdout:ceph source packages 6.0 kB/s | 1.8 kB 00:00 2024-02-07T12:12:40.451 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 5.3 kB/s | 1.8 kB 00:00 2024-02-07T12:12:40.903 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-02-07T12:12:41.045 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-9 - AppStream 10 MB/s | 6.7 MB 00:00 2024-02-07T12:12:42.347 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2024-02-07T12:12:42.456 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-9 - BaseOS 6.8 MB/s | 2.0 MB 00:00 2024-02-07T12:12:43.580 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.0 MB 00:00 2024-02-07T12:12:44.595 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.0 MB 00:01 2024-02-07T12:12:45.737 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-02-07T12:12:47.490 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 10 MB/s | 19 MB 00:01 2024-02-07T12:12:51.305 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 5.9 MB 00:01 2024-02-07T12:12:52.121 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 5.9 MB 00:01 2024-02-07T12:12:52.797 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 15 kB 00:00 2024-02-07T12:12:53.455 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 15 kB 00:00 2024-02-07T12:12:54.309 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2024-02-07T12:12:54.807 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2024-02-07T12:12:59.357 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-02-07T12:12:59.690 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-02-07T12:13:01.990 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:13:01.993 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:01.993 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-02-07T12:13:01.993 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:01.993 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:13:01.993 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:17.2.7-491.gf2462625.el9 ceph 14 M 2024-02-07T12:13:01.993 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-02-07T12:13:01.993 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:17.2.7-491.gf2462625.el9 ceph 3.1 M 2024-02-07T12:13:01.993 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:17.2.7-491.gf2462625.el9 ceph 2.9 M 2024-02-07T12:13:01.993 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-02-07T12:13:01.993 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:17.2.7-491.gf2462625.el9 ceph 5.0 M 2024-02-07T12:13:01.993 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:17.2.7-491.gf2462625.el9 ceph 23 M 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:17.2.7-491.gf2462625.el9 ceph 25 k 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:17.2.7-491.gf2462625.el9 ceph 635 k 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:17.2.7-491.gf2462625.el9 ceph 457 k 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:17.2.7-491.gf2462625.el9 ceph 4.9 M 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:17.2.7-491.gf2462625.el9 ceph 45 k 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:17.2.7-491.gf2462625.el9 ceph 116 k 2024-02-07T12:13:01.994 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:17.2.7-491.gf2462625.el9 ceph 156 k 2024-02-07T12:13:01.995 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-07T12:13:01.995 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:17.2.7-491.gf2462625.el9 ceph 320 k 2024-02-07T12:13:01.995 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:17.2.7-491.gf2462625.el9 ceph 293 k 2024-02-07T12:13:01.995 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:17.2.7-491.gf2462625.el9 ceph 99 k 2024-02-07T12:13:01.995 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-07T12:13:01.995 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:01.995 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:13:01.995 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:01.995 INFO:teuthology.orchestra.run.smithi047.stdout:Install 22 Packages 2024-02-07T12:13:01.995 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 2 Packages 2024-02-07T12:13:01.995 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:01.996 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 58 M 2024-02-07T12:13:01.996 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:13:02.229 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:13:02.247 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw x86_64 2:17.2.7-491.gf2462625.el9 ceph 14 M 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrading: 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: librados2 x86_64 2:17.2.7-491.gf2462625.el9 ceph 3.1 M 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1 x86_64 2:17.2.7-491.gf2462625.el9 ceph 2.9 M 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base x86_64 2:17.2.7-491.gf2462625.el9 ceph 5.0 M 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common x86_64 2:17.2.7-491.gf2462625.el9 ceph 23 M 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux x86_64 2:17.2.7-491.gf2462625.el9 ceph 25 k 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2 x86_64 2:17.2.7-491.gf2462625.el9 ceph 635 k 2024-02-07T12:13:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 x86_64 2:17.2.7-491.gf2462625.el9 ceph 457 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2 x86_64 2:17.2.7-491.gf2462625.el9 ceph 4.9 M 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse x86_64 2:17.2.7-491.gf2462625.el9 ceph 45 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common x86_64 2:17.2.7-491.gf2462625.el9 ceph 116 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs x86_64 2:17.2.7-491.gf2462625.el9 ceph 156 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados x86_64 2:17.2.7-491.gf2462625.el9 ceph 320 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd x86_64 2:17.2.7-491.gf2462625.el9 ceph 293 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw x86_64 2:17.2.7-491.gf2462625.el9 ceph 99 k 2024-02-07T12:13:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-07T12:13:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:02.250 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:13:02.250 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:13:02.250 INFO:teuthology.orchestra.run.smithi138.stdout:Install 22 Packages 2024-02-07T12:13:02.250 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrade 2 Packages 2024-02-07T12:13:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:02.250 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 58 M 2024-02-07T12:13:02.250 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:13:03.816 INFO:teuthology.orchestra.run.smithi047.stdout:(1/24): ceph-radosgw-17.2.7-491.gf2462625.el9.x 8.1 MB/s | 14 MB 00:01 2024-02-07T12:13:03.891 INFO:teuthology.orchestra.run.smithi047.stdout:(2/24): ceph-selinux-17.2.7-491.gf2462625.el9.x 336 kB/s | 25 kB 00:00 2024-02-07T12:13:04.058 INFO:teuthology.orchestra.run.smithi138.stdout:(1/24): ceph-base-17.2.7-491.gf2462625.el9.x86_ 2.9 MB/s | 5.0 MB 00:01 2024-02-07T12:13:04.058 INFO:teuthology.orchestra.run.smithi047.stdout:(3/24): libcephfs2-17.2.7-491.gf2462625.el9.x86 3.7 MB/s | 635 kB 00:00 2024-02-07T12:13:04.141 INFO:teuthology.orchestra.run.smithi138.stdout:(2/24): ceph-selinux-17.2.7-491.gf2462625.el9.x 302 kB/s | 25 kB 00:00 2024-02-07T12:13:04.150 INFO:teuthology.orchestra.run.smithi047.stdout:(4/24): ceph-base-17.2.7-491.gf2462625.el9.x86_ 2.4 MB/s | 5.0 MB 00:02 2024-02-07T12:13:04.175 INFO:teuthology.orchestra.run.smithi047.stdout:(5/24): libradosstriper1-17.2.7-491.gf2462625.e 3.8 MB/s | 457 kB 00:00 2024-02-07T12:13:04.259 INFO:teuthology.orchestra.run.smithi047.stdout:(6/24): python3-ceph-argparse-17.2.7-491.gf2462 541 kB/s | 45 kB 00:00 2024-02-07T12:13:04.334 INFO:teuthology.orchestra.run.smithi047.stdout:(7/24): python3-ceph-common-17.2.7-491.gf246262 1.5 MB/s | 116 kB 00:00 2024-02-07T12:13:04.366 INFO:teuthology.orchestra.run.smithi138.stdout:(3/24): libcephfs2-17.2.7-491.gf2462625.el9.x86 2.8 MB/s | 635 kB 00:00 2024-02-07T12:13:04.483 INFO:teuthology.orchestra.run.smithi138.stdout:(4/24): libradosstriper1-17.2.7-491.gf2462625.e 3.8 MB/s | 457 kB 00:00 2024-02-07T12:13:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:(8/24): ceph-common-17.2.7-491.gf2462625.el9.x8 9.1 MB/s | 23 MB 00:02 2024-02-07T12:13:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:(9/24): python3-cephfs-17.2.7-491.gf2462625.el9 668 kB/s | 156 kB 00:00 2024-02-07T12:13:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:(10/24): python3-rados-17.2.7-491.gf2462625.el9 3.7 MB/s | 320 kB 00:00 2024-02-07T12:13:04.660 INFO:teuthology.orchestra.run.smithi047.stdout:(11/24): python3-rbd-17.2.7-491.gf2462625.el9.x 3.1 MB/s | 293 kB 00:00 2024-02-07T12:13:04.727 INFO:teuthology.orchestra.run.smithi047.stdout:(12/24): python3-rgw-17.2.7-491.gf2462625.el9.x 994 kB/s | 99 kB 00:00 2024-02-07T12:13:04.836 INFO:teuthology.orchestra.run.smithi047.stdout:(13/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 906 kB/s | 159 kB 00:00 2024-02-07T12:13:04.861 INFO:teuthology.orchestra.run.smithi047.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 333 kB/s | 44 kB 00:00 2024-02-07T12:13:04.903 INFO:teuthology.orchestra.run.smithi047.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2024-02-07T12:13:04.928 INFO:teuthology.orchestra.run.smithi047.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2024-02-07T12:13:04.954 INFO:teuthology.orchestra.run.smithi047.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 826 kB/s | 41 kB 00:00 2024-02-07T12:13:05.020 INFO:teuthology.orchestra.run.smithi047.stdout:(18/24): librgw2-17.2.7-491.gf2462625.el9.x86_6 5.6 MB/s | 4.9 MB 00:00 2024-02-07T12:13:05.184 INFO:teuthology.orchestra.run.smithi138.stdout:(5/24): ceph-radosgw-17.2.7-491.gf2462625.el9.x 4.9 MB/s | 14 MB 00:02 2024-02-07T12:13:05.229 INFO:teuthology.orchestra.run.smithi047.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 176 kB/s | 49 kB 00:00 2024-02-07T12:13:05.234 INFO:teuthology.orchestra.run.smithi138.stdout:(6/24): python3-ceph-argparse-17.2.7-491.gf2462 911 kB/s | 45 kB 00:00 2024-02-07T12:13:05.255 INFO:teuthology.orchestra.run.smithi047.stdout:(20/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 948 kB/s | 309 kB 00:00 2024-02-07T12:13:05.279 INFO:teuthology.orchestra.run.smithi047.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 323 kB/s | 67 kB 00:00 2024-02-07T12:13:05.292 INFO:teuthology.orchestra.run.smithi138.stdout:(7/24): python3-ceph-common-17.2.7-491.gf246262 1.9 MB/s | 116 kB 00:00 2024-02-07T12:13:05.351 INFO:teuthology.orchestra.run.smithi138.stdout:(8/24): python3-cephfs-17.2.7-491.gf2462625.el9 2.6 MB/s | 156 kB 00:00 2024-02-07T12:13:05.443 INFO:teuthology.orchestra.run.smithi138.stdout:(9/24): python3-rados-17.2.7-491.gf2462625.el9. 3.4 MB/s | 320 kB 00:00 2024-02-07T12:13:05.488 INFO:teuthology.orchestra.run.smithi047.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-02-07T12:13:05.551 INFO:teuthology.orchestra.run.smithi138.stdout:(10/24): librgw2-17.2.7-491.gf2462625.el9.x86_6 4.6 MB/s | 4.9 MB 00:01 2024-02-07T12:13:05.577 INFO:teuthology.orchestra.run.smithi138.stdout:(11/24): python3-rbd-17.2.7-491.gf2462625.el9.x 2.1 MB/s | 293 kB 00:00 2024-02-07T12:13:05.636 INFO:teuthology.orchestra.run.smithi138.stdout:(12/24): python3-rgw-17.2.7-491.gf2462625.el9.x 1.2 MB/s | 99 kB 00:00 2024-02-07T12:13:05.638 INFO:teuthology.orchestra.run.smithi047.stdout:(23/24): librbd1-17.2.7-491.gf2462625.el9.x86_6 8.2 MB/s | 2.9 MB 00:00 2024-02-07T12:13:05.702 INFO:teuthology.orchestra.run.smithi138.stdout:(13/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 159 kB 00:00 2024-02-07T12:13:05.728 INFO:teuthology.orchestra.run.smithi138.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 486 kB/s | 44 kB 00:00 2024-02-07T12:13:05.738 INFO:teuthology.orchestra.run.smithi047.stdout:(24/24): librados2-17.2.7-491.gf2462625.el9.x86 6.7 MB/s | 3.1 MB 00:00 2024-02-07T12:13:05.744 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:13:05.744 INFO:teuthology.orchestra.run.smithi047.stdout:Total 15 MB/s | 58 MB 00:03 2024-02-07T12:13:05.744 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:13:05.761 INFO:teuthology.orchestra.run.smithi138.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-02-07T12:13:05.776 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:13:05.776 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:13:05.787 INFO:teuthology.orchestra.run.smithi138.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-02-07T12:13:05.812 INFO:teuthology.orchestra.run.smithi138.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 827 kB/s | 41 kB 00:00 2024-02-07T12:13:05.896 INFO:teuthology.orchestra.run.smithi138.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 582 kB/s | 49 kB 00:00 2024-02-07T12:13:05.954 INFO:teuthology.orchestra.run.smithi138.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.8 MB/s | 309 kB 00:00 2024-02-07T12:13:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 805 kB/s | 67 kB 00:00 2024-02-07T12:13:06.055 INFO:teuthology.orchestra.run.smithi138.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-02-07T12:13:06.259 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:13:06.259 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:13:06.480 INFO:teuthology.orchestra.run.smithi138.stdout:(22/24): librbd1-17.2.7-491.gf2462625.el9.x86_6 6.9 MB/s | 2.9 MB 00:00 2024-02-07T12:13:06.714 INFO:teuthology.orchestra.run.smithi138.stdout:(23/24): ceph-common-17.2.7-491.gf2462625.el9.x 5.1 MB/s | 23 MB 00:04 2024-02-07T12:13:06.772 INFO:teuthology.orchestra.run.smithi138.stdout:(24/24): librados2-17.2.7-491.gf2462625.el9.x86 3.9 MB/s | 3.1 MB 00:00 2024-02-07T12:13:06.775 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:13:06.775 INFO:teuthology.orchestra.run.smithi138.stdout:Total 13 MB/s | 58 MB 00:04 2024-02-07T12:13:06.776 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:13:06.805 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:13:06.806 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:13:07.291 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:13:07.292 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:13:07.539 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:13:07.893 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-02-07T12:13:07.957 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:17.2.7-491.gf2462625.el9.x86_64 2/26 2024-02-07T12:13:08.056 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:17.2.7-491.gf2462625.el9.x86_64 2/26 2024-02-07T12:13:08.146 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:17.2.7-491.gf2462625.el9.x86_64 3/26 2024-02-07T12:13:08.175 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:17.2.7-491.gf2462625.el9.x86_64 4/26 2024-02-07T12:13:08.263 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:17.2.7-491.gf2462625.el9.x86_64 4/26 2024-02-07T12:13:08.314 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-02-07T12:13:08.347 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-02-07T12:13:08.550 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:13:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-02-07T12:13:08.828 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:17.2.7-491.gf2462625.el9.x86_64 8/26 2024-02-07T12:13:08.873 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:17.2.7-491.gf2462625.el9.x86_64 8/26 2024-02-07T12:13:08.889 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-02-07T12:13:08.903 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-02-07T12:13:08.943 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librados2-2:17.2.7-491.gf2462625.el9.x86_64 2/26 2024-02-07T12:13:08.946 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:17.2.7-491.gf2462625.el9.x 10/26 2024-02-07T12:13:08.983 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:17.2.7-491.gf2462625.el9.x86_64 11/26 2024-02-07T12:13:09.023 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:17.2.7-491.gf2462625.el9.x86_64 2/26 2024-02-07T12:13:09.046 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:17.2.7-491.gf2462625.el9.x86_64 12/26 2024-02-07T12:13:09.072 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:17.2.7-491.gf2462625.el9.x86_64 13/26 2024-02-07T12:13:09.102 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rados-2:17.2.7-491.gf2462625.el9.x86_64 3/26 2024-02-07T12:13:09.138 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:17.2.7-491.gf2462625.el9.x86_64 13/26 2024-02-07T12:13:09.151 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs2-2:17.2.7-491.gf2462625.el9.x86_64 4/26 2024-02-07T12:13:09.177 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-02-07T12:13:09.222 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-02-07T12:13:09.239 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs2-2:17.2.7-491.gf2462625.el9.x86_64 4/26 2024-02-07T12:13:09.255 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-02-07T12:13:09.285 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-02-07T12:13:09.314 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-02-07T12:13:09.564 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-02-07T12:13:09.593 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:17.2.7-491.gf2462625.el9.x86_64 18/26 2024-02-07T12:13:09.666 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:17.2.7-491.gf2462625.el9.x86_64 18/26 2024-02-07T12:13:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:17.2.7-491.gf2462625.el9.x86_64 19/26 2024-02-07T12:13:09.748 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-02-07T12:13:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:17.2.7-491.gf2462625.el9.x86 20/26 2024-02-07T12:13:09.788 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librgw2-2:17.2.7-491.gf2462625.el9.x86_64 8/26 2024-02-07T12:13:09.849 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librgw2-2:17.2.7-491.gf2462625.el9.x86_64 8/26 2024-02-07T12:13:09.878 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-02-07T12:13:09.921 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-argparse-2:17.2.7-491.gf2462625.el9.x 10/26 2024-02-07T12:13:09.958 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cephfs-2:17.2.7-491.gf2462625.el9.x86_64 11/26 2024-02-07T12:13:10.019 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rgw-2:17.2.7-491.gf2462625.el9.x86_64 12/26 2024-02-07T12:13:10.048 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libradosstriper1-2:17.2.7-491.gf2462625.el9.x86_64 13/26 2024-02-07T12:13:10.096 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libradosstriper1-2:17.2.7-491.gf2462625.el9.x86_64 13/26 2024-02-07T12:13:10.136 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-02-07T12:13:10.164 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-02-07T12:13:10.197 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-02-07T12:13:10.493 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-02-07T12:13:10.526 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librbd1-2:17.2.7-491.gf2462625.el9.x86_64 18/26 2024-02-07T12:13:10.616 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:17.2.7-491.gf2462625.el9.x86_64 18/26 2024-02-07T12:13:10.680 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rbd-2:17.2.7-491.gf2462625.el9.x86_64 19/26 2024-02-07T12:13:10.704 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-common-2:17.2.7-491.gf2462625.el9.x86 20/26 2024-02-07T12:13:12.260 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:17.2.7-491.gf2462625.el9.x86_64 21/26 2024-02-07T12:13:12.300 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:17.2.7-491.gf2462625.el9.x86_64 21/26 2024-02-07T12:13:12.854 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:17.2.7-491.gf2462625.el9.x86_64 21/26 2024-02-07T12:13:12.903 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:17.2.7-491.gf2462625.el9.x86_64 22/26 2024-02-07T12:13:12.986 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:17.2.7-491.gf2462625.el9.x86_64 22/26 2024-02-07T12:13:12.986 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-07T12:13:12.986 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-07T12:13:12.986 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:13.012 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:17.2.7-491.gf2462625.el9.x86_64 23/26 2024-02-07T12:13:13.189 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:17.2.7-491.gf2462625.el9.x86_64 21/26 2024-02-07T12:13:13.234 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-common-2:17.2.7-491.gf2462625.el9.x86_64 21/26 2024-02-07T12:13:13.776 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:17.2.7-491.gf2462625.el9.x86_64 21/26 2024-02-07T12:13:13.828 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-base-2:17.2.7-491.gf2462625.el9.x86_64 22/26 2024-02-07T12:13:13.902 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-base-2:17.2.7-491.gf2462625.el9.x86_64 22/26 2024-02-07T12:13:13.903 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-07T12:13:13.903 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-07T12:13:13.903 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:13.946 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-selinux-2:17.2.7-491.gf2462625.el9.x86_64 23/26 2024-02-07T12:13:22.706 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:17.2.7-491.gf2462625.el9.x86_64 23/26 2024-02-07T12:13:22.706 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-02-07T12:13:22.707 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-02-07T12:13:22.707 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-02-07T12:13:22.707 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-02-07T12:13:22.707 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-02-07T12:13:22.707 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-02-07T12:13:22.707 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-02-07T12:13:22.707 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:23.732 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-selinux-2:17.2.7-491.gf2462625.el9.x86_64 23/26 2024-02-07T12:13:23.733 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /sys 2024-02-07T12:13:23.733 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /proc 2024-02-07T12:13:23.733 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /mnt 2024-02-07T12:13:23.733 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /var/tmp 2024-02-07T12:13:23.733 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /home 2024-02-07T12:13:23.733 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /root 2024-02-07T12:13:23.733 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /tmp 2024-02-07T12:13:23.733 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:24.020 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:17.2.7-491.gf2462625.el9.x86_64 24/26 2024-02-07T12:13:24.081 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-491.gf2462625.el9.x86_64 24/26 2024-02-07T12:13:24.081 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:13:24.081 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-07T12:13:24.081 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-07T12:13:24.081 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-07T12:13:24.082 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:24.083 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-07T12:13:24.173 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-07T12:13:24.173 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-07T12:13:24.985 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-radosgw-2:17.2.7-491.gf2462625.el9.x86_64 24/26 2024-02-07T12:13:25.049 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-491.gf2462625.el9.x86_64 24/26 2024-02-07T12:13:25.049 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:13:25.049 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-07T12:13:25.049 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-07T12:13:25.049 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-07T12:13:25.049 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:25.051 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-07T12:13:25.139 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-07T12:13:25.139 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-07T12:13:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-07T12:13:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:17.2.7-491.gf2462625.el9.x86_64 1/26 2024-02-07T12:13:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:17.2.7-491.gf2462625.el9.x86_64 2/26 2024-02-07T12:13:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:17.2.7-491.gf2462625.el9.x86_64 3/26 2024-02-07T12:13:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:17.2.7-491.gf2462625.el9.x86_64 4/26 2024-02-07T12:13:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:17.2.7-491.gf2462625.el9.x86_64 5/26 2024-02-07T12:13:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:17.2.7-491.gf2462625.el9.x86_64 6/26 2024-02-07T12:13:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:17.2.7-491.gf2462625.el9.x86_64 7/26 2024-02-07T12:13:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:17.2.7-491.gf2462625.el9.x 8/26 2024-02-07T12:13:25.396 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:17.2.7-491.gf2462625.el9.x86 9/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:17.2.7-491.gf2462625.el9.x86_64 10/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:17.2.7-491.gf2462625.el9.x86_64 11/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:17.2.7-491.gf2462625.el9.x86_64 12/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:17.2.7-491.gf2462625.el9.x86_64 13/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:17.2.7-491.gf2462625.el9.x86_64 23/26 2024-02-07T12:13:25.397 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-02-07T12:13:25.398 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:17.2.7-491.gf2462625.el9.x86_64 25/26 2024-02-07T12:13:26.391 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-02-07T12:13:26.391 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:26.391 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-02-07T12:13:26.391 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.391 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.391 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:13:26.392 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.392 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.392 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.392 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.392 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-07T12:13:26.392 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.392 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-07T12:13:26.392 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-07T12:13:26.392 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-07T12:13:26.392 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.392 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-07T12:13:26.392 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.393 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-07T12:13:26.393 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-07T12:13:26.393 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.393 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.393 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.393 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-07T12:13:26.393 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.393 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.393 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:26.393 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-07T12:13:26.393 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:26.393 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:13:26.487 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-07T12:13:26.487 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-base-2:17.2.7-491.gf2462625.el9.x86_64 1/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-common-2:17.2.7-491.gf2462625.el9.x86_64 2/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-radosgw-2:17.2.7-491.gf2462625.el9.x86_64 3/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-selinux-2:17.2.7-491.gf2462625.el9.x86_64 4/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs2-2:17.2.7-491.gf2462625.el9.x86_64 5/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libradosstriper1-2:17.2.7-491.gf2462625.el9.x86_64 6/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librgw2-2:17.2.7-491.gf2462625.el9.x86_64 7/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-argparse-2:17.2.7-491.gf2462625.el9.x 8/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-common-2:17.2.7-491.gf2462625.el9.x86 9/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cephfs-2:17.2.7-491.gf2462625.el9.x86_64 10/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rados-2:17.2.7-491.gf2462625.el9.x86_64 11/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rbd-2:17.2.7-491.gf2462625.el9.x86_64 12/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rgw-2:17.2.7-491.gf2462625.el9.x86_64 13/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-02-07T12:13:26.488 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-02-07T12:13:26.489 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-02-07T12:13:26.489 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-02-07T12:13:26.489 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-02-07T12:13:26.489 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-02-07T12:13:26.489 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-02-07T12:13:26.489 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-02-07T12:13:26.489 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-02-07T12:13:26.489 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:17.2.7-491.gf2462625.el9.x86_64 23/26 2024-02-07T12:13:26.489 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-02-07T12:13:26.489 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:17.2.7-491.gf2462625.el9.x86_64 25/26 2024-02-07T12:13:26.745 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-test 2024-02-07T12:13:27.319 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:28 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:13:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-02-07T12:13:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:27.478 INFO:teuthology.orchestra.run.smithi138.stdout:Upgraded: 2024-02-07T12:13:27.478 INFO:teuthology.orchestra.run.smithi138.stdout: librados2-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-07T12:13:27.479 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-07T12:13:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-07T12:13:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-07T12:13:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-07T12:13:27.480 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:27.480 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:13:27.486 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:13:27.487 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-02-07T12:13:27.487 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:27.487 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:13:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:17.2.7-491.gf2462625.el9 ceph 48 M 2024-02-07T12:13:27.488 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-02-07T12:13:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-07T12:13:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:17.2.7-491.gf2462625.el9 ceph 162 k 2024-02-07T12:13:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-07T12:13:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-07T12:13:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-07T12:13:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:27.488 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:13:27.488 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:27.488 INFO:teuthology.orchestra.run.smithi047.stdout:Install 6 Packages 2024-02-07T12:13:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:27.489 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 49 M 2024-02-07T12:13:27.489 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 196 M 2024-02-07T12:13:27.489 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:13:27.701 INFO:teuthology.orchestra.run.smithi047.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 300 kB 00:00 2024-02-07T12:13:27.734 INFO:teuthology.orchestra.run.smithi047.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-02-07T12:13:27.759 INFO:teuthology.orchestra.run.smithi047.stdout:(3/6): libcephsqlite-17.2.7-491.gf2462625.el9.x 602 kB/s | 162 kB 00:00 2024-02-07T12:13:27.785 INFO:teuthology.orchestra.run.smithi047.stdout:(4/6): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-02-07T12:13:27.810 INFO:teuthology.orchestra.run.smithi047.stdout:(5/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-02-07T12:13:27.833 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-test 2024-02-07T12:13:28.403 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:29 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:13:28.561 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:13:28.562 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:13:28.562 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-07T12:13:28.562 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:13:28.562 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:13:28.563 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test x86_64 2:17.2.7-491.gf2462625.el9 ceph 48 M 2024-02-07T12:13:28.563 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-07T12:13:28.563 INFO:teuthology.orchestra.run.smithi138.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-07T12:13:28.563 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite x86_64 2:17.2.7-491.gf2462625.el9 ceph 162 k 2024-02-07T12:13:28.563 INFO:teuthology.orchestra.run.smithi138.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-07T12:13:28.563 INFO:teuthology.orchestra.run.smithi138.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-07T12:13:28.563 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-07T12:13:28.563 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:28.563 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:13:28.563 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:13:28.563 INFO:teuthology.orchestra.run.smithi138.stdout:Install 6 Packages 2024-02-07T12:13:28.563 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:28.564 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 49 M 2024-02-07T12:13:28.564 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 196 M 2024-02-07T12:13:28.564 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:13:28.727 INFO:teuthology.orchestra.run.smithi138.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.8 MB/s | 300 kB 00:00 2024-02-07T12:13:28.769 INFO:teuthology.orchestra.run.smithi138.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-02-07T12:13:28.819 INFO:teuthology.orchestra.run.smithi138.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-02-07T12:13:28.878 INFO:teuthology.orchestra.run.smithi138.stdout:(4/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 217 kB 00:00 2024-02-07T12:13:28.911 INFO:teuthology.orchestra.run.smithi138.stdout:(5/6): libcephsqlite-17.2.7-491.gf2462625.el9.x 468 kB/s | 162 kB 00:00 2024-02-07T12:13:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:(6/6): ceph-test-17.2.7-491.gf2462625.el9.x86_6 18 MB/s | 48 MB 00:02 2024-02-07T12:13:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:13:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:Total 18 MB/s | 49 MB 00:02 2024-02-07T12:13:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:13:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:13:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:13:30.626 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:13:30.626 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:13:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:13:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-07T12:13:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-07T12:13:31.363 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-07T12:13:31.402 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-07T12:13:31.430 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:17.2.7-491.gf2462625.el9.x86_64 5/6 2024-02-07T12:13:36.104 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:17.2.7-491.gf2462625.el9.x86_64 5/6 2024-02-07T12:13:36.191 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:17.2.7-491.gf2462625.el9.x86_64 6/6 2024-02-07T12:13:38.456 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-test-2:17.2.7-491.gf2462625.el9.x86_64 6/6 2024-02-07T12:13:38.456 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:17.2.7-491.gf2462625.el9.x86_64 1/6 2024-02-07T12:13:38.456 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:17.2.7-491.gf2462625.el9.x86_64 2/6 2024-02-07T12:13:38.456 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-07T12:13:38.456 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-07T12:13:38.457 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-07T12:13:38.850 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-07T12:13:38.850 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:38.850 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:13:38.850 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:38.850 INFO:teuthology.orchestra.run.smithi047.stdout: jq-1.6-16.el9.x86_64 2024-02-07T12:13:38.850 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-07T12:13:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-07T12:13:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-07T12:13:38.851 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:38.851 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:13:39.128 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph 2024-02-07T12:13:39.708 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:40 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:13:39.889 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:13:39.891 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================== 2024-02-07T12:13:39.891 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-02-07T12:13:39.891 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================== 2024-02-07T12:13:39.891 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:13:39.891 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:17.2.7-491.gf2462625.el9 ceph 6.5 k 2024-02-07T12:13:39.891 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-02-07T12:13:39.891 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:17.2.7-491.gf2462625.el9 ceph 2.1 M 2024-02-07T12:13:39.891 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:17.2.7-491.gf2462625.el9 ceph 1.4 M 2024-02-07T12:13:39.892 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 239 k 2024-02-07T12:13:39.892 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:17.2.7-491.gf2462625.el9 ceph 3.7 M 2024-02-07T12:13:39.892 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:17.2.7-491.gf2462625.el9 ceph 15 M 2024-02-07T12:13:39.892 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-07T12:13:39.892 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-07T12:13:39.892 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-07T12:13:39.892 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-07T12:13:39.892 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-07T12:13:39.892 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-07T12:13:39.892 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-07T12:13:39.892 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-07T12:13:39.892 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-07T12:13:39.892 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-07T12:13:39.893 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-07T12:13:39.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-07T12:13:39.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-07T12:13:39.894 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-07T12:13:39.894 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:39.894 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:13:39.894 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================== 2024-02-07T12:13:39.894 INFO:teuthology.orchestra.run.smithi047.stdout:Install 33 Packages 2024-02-07T12:13:39.894 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:39.894 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 27 M 2024-02-07T12:13:39.895 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 99 M 2024-02-07T12:13:39.895 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:13:40.297 INFO:teuthology.orchestra.run.smithi047.stdout:(1/33): ceph-17.2.7-491.gf2462625.el9.x86_64.rp 30 kB/s | 6.5 kB 00:00 2024-02-07T12:13:40.422 INFO:teuthology.orchestra.run.smithi047.stdout:(2/33): ceph-mgr-17.2.7-491.gf2462625.el9.x86_6 4.1 MB/s | 1.4 MB 00:00 2024-02-07T12:13:40.506 INFO:teuthology.orchestra.run.smithi138.stdout:(6/6): ceph-test-17.2.7-491.gf2462625.el9.x86_6 4.0 MB/s | 48 MB 00:11 2024-02-07T12:13:40.508 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:13:40.509 INFO:teuthology.orchestra.run.smithi138.stdout:Total 4.1 MB/s | 49 MB 00:11 2024-02-07T12:13:40.509 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:13:40.526 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:13:40.527 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:13:40.904 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:13:40.905 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:13:40.997 INFO:teuthology.orchestra.run.smithi047.stdout:(3/33): ceph-mds-17.2.7-491.gf2462625.el9.x86_6 2.3 MB/s | 2.1 MB 00:00 2024-02-07T12:13:41.224 INFO:teuthology.orchestra.run.smithi047.stdout:(4/33): ceph-osd-17.2.7-491.gf2462625.el9.x86_6 19 MB/s | 15 MB 00:00 2024-02-07T12:13:41.250 INFO:teuthology.orchestra.run.smithi047.stdout:(5/33): ceph-mgr-modules-core-17.2.7-491.gf2462 946 kB/s | 239 kB 00:00 2024-02-07T12:13:41.367 INFO:teuthology.orchestra.run.smithi047.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 343 kB/s | 32 kB 00:00 2024-02-07T12:13:41.392 INFO:teuthology.orchestra.run.smithi047.stdout:(7/33): python3-mako-1.1.4-6.el9.noarch.rpm 864 kB/s | 144 kB 00:00 2024-02-07T12:13:41.417 INFO:teuthology.orchestra.run.smithi047.stdout:(8/33): python3-pytz-2021.1-5.el9.noarch.rpm 944 kB/s | 47 kB 00:00 2024-02-07T12:13:41.442 INFO:teuthology.orchestra.run.smithi047.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 769 kB/s | 39 kB 00:00 2024-02-07T12:13:41.476 INFO:teuthology.orchestra.run.smithi047.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-02-07T12:13:41.484 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:13:41.535 INFO:teuthology.orchestra.run.smithi047.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 12 MB/s | 1.1 MB 00:00 2024-02-07T12:13:41.560 INFO:teuthology.orchestra.run.smithi047.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-02-07T12:13:41.579 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-07T12:13:41.594 INFO:teuthology.orchestra.run.smithi047.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 2.1 MB/s | 124 kB 00:00 2024-02-07T12:13:41.613 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-07T12:13:41.619 INFO:teuthology.orchestra.run.smithi047.stdout:(14/33): python3-requests-2.25.1-8.el9.noarch.r 1.9 MB/s | 113 kB 00:00 2024-02-07T12:13:41.644 INFO:teuthology.orchestra.run.smithi047.stdout:(15/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2024-02-07T12:13:41.658 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-07T12:13:41.698 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-07T12:13:41.734 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephsqlite-2:17.2.7-491.gf2462625.el9.x86_64 5/6 2024-02-07T12:13:41.811 INFO:teuthology.orchestra.run.smithi047.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 227 kB/s | 43 kB 00:00 2024-02-07T12:13:41.870 INFO:teuthology.orchestra.run.smithi047.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 762 kB/s | 172 kB 00:00 2024-02-07T12:13:41.928 INFO:teuthology.orchestra.run.smithi047.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 183 kB/s | 11 kB 00:00 2024-02-07T12:13:41.979 INFO:teuthology.orchestra.run.smithi047.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-02-07T12:13:42.046 INFO:teuthology.orchestra.run.smithi047.stdout:(20/33): ceph-mon-17.2.7-491.gf2462625.el9.x86_ 2.1 MB/s | 3.7 MB 00:01 2024-02-07T12:13:42.071 INFO:teuthology.orchestra.run.smithi047.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 251 kB/s | 23 kB 00:00 2024-02-07T12:13:42.096 INFO:teuthology.orchestra.run.smithi047.stdout:(22/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-02-07T12:13:42.121 INFO:teuthology.orchestra.run.smithi047.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-02-07T12:13:42.147 INFO:teuthology.orchestra.run.smithi047.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 920 kB/s | 46 kB 00:00 2024-02-07T12:13:42.205 INFO:teuthology.orchestra.run.smithi047.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 941 kB/s | 79 kB 00:00 2024-02-07T12:13:42.222 INFO:teuthology.orchestra.run.smithi047.stdout:(26/33): python3-jaraco-functools-3.5.0-2.el9.n 110 kB/s | 19 kB 00:00 2024-02-07T12:13:42.247 INFO:teuthology.orchestra.run.smithi047.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-02-07T12:13:42.264 INFO:teuthology.orchestra.run.smithi047.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 279 kB/s | 16 kB 00:00 2024-02-07T12:13:42.306 INFO:teuthology.orchestra.run.smithi047.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 608 kB/s | 36 kB 00:00 2024-02-07T12:13:42.348 INFO:teuthology.orchestra.run.smithi047.stdout:(30/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-02-07T12:13:42.382 INFO:teuthology.orchestra.run.smithi047.stdout:(31/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 562 kB/s | 90 kB 00:00 2024-02-07T12:13:42.407 INFO:teuthology.orchestra.run.smithi047.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-02-07T12:13:42.424 INFO:teuthology.orchestra.run.smithi047.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 264 kB/s | 20 kB 00:00 2024-02-07T12:13:42.428 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:13:42.428 INFO:teuthology.orchestra.run.smithi047.stdout:Total 11 MB/s | 27 MB 00:02 2024-02-07T12:13:42.429 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:13:42.469 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:13:42.469 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:13:42.822 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:13:42.822 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:13:44.090 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:13:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-07T12:13:44.193 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-07T12:13:44.226 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-07T12:13:44.321 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-07T12:13:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-07T12:13:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-07T12:13:44.521 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-07T12:13:44.581 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-07T12:13:44.618 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-07T12:13:44.669 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-07T12:13:44.732 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-07T12:13:44.925 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-07T12:13:44.972 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-07T12:13:45.019 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-07T12:13:45.062 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-07T12:13:45.092 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-07T12:13:45.172 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-07T12:13:45.202 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-07T12:13:45.235 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-07T12:13:45.276 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-07T12:13:45.320 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-07T12:13:45.354 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-07T12:13:45.447 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-07T12:13:45.492 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-07T12:13:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-07T12:13:45.719 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-07T12:13:45.851 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-07T12:13:46.028 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-491.gf2462625.el9.n 28/33 2024-02-07T12:13:46.056 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:17.2.7-491.gf2462625.el9.x86_64 29/33 2024-02-07T12:13:46.084 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:17.2.7-491.gf2462625.el9.x86_64 29/33 2024-02-07T12:13:46.084 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:13:46.084 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-07T12:13:46.084 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-07T12:13:46.084 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-07T12:13:46.084 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephsqlite-2:17.2.7-491.gf2462625.el9.x86_64 5/6 2024-02-07T12:13:46.265 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-test-2:17.2.7-491.gf2462625.el9.x86_64 6/6 2024-02-07T12:13:47.507 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:17.2.7-491.gf2462625.el9.x86_64 30/33 2024-02-07T12:13:47.533 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:17.2.7-491.gf2462625.el9.x86_64 30/33 2024-02-07T12:13:47.533 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:13:47.533 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-07T12:13:47.533 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-07T12:13:47.533 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-07T12:13:47.533 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:47.925 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:17.2.7-491.gf2462625.el9.x86_64 31/33 2024-02-07T12:13:47.947 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:17.2.7-491.gf2462625.el9.x86_64 31/33 2024-02-07T12:13:47.947 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:13:47.947 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-07T12:13:47.947 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-07T12:13:47.948 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-07T12:13:47.948 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:48.150 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:17.2.7-491.gf2462625.el9.x86_64 32/33 2024-02-07T12:13:48.173 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:17.2.7-491.gf2462625.el9.x86_64 32/33 2024-02-07T12:13:48.173 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:13:48.173 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-07T12:13:48.173 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-07T12:13:48.173 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-07T12:13:48.173 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:48.234 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:17.2.7-491.gf2462625.el9.x86_64 33/33 2024-02-07T12:13:48.769 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-test-2:17.2.7-491.gf2462625.el9.x86_64 6/6 2024-02-07T12:13:48.770 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-test-2:17.2.7-491.gf2462625.el9.x86_64 1/6 2024-02-07T12:13:48.770 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephsqlite-2:17.2.7-491.gf2462625.el9.x86_64 2/6 2024-02-07T12:13:48.770 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-07T12:13:48.770 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-07T12:13:48.770 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-07T12:13:49.178 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-07T12:13:49.178 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:49.178 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:13:49.178 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:49.178 INFO:teuthology.orchestra.run.smithi138.stdout: jq-1.6-16.el9.x86_64 2024-02-07T12:13:49.178 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:49.178 INFO:teuthology.orchestra.run.smithi138.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-07T12:13:49.178 INFO:teuthology.orchestra.run.smithi138.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-07T12:13:49.178 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-07T12:13:49.178 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:49.179 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:13:49.486 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph 2024-02-07T12:13:49.864 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-2:17.2.7-491.gf2462625.el9.x86_64 33/33 2024-02-07T12:13:49.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:17.2.7-491.gf2462625.el9.x86_64 1/33 2024-02-07T12:13:49.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:17.2.7-491.gf2462625.el9.x86_64 2/33 2024-02-07T12:13:49.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:17.2.7-491.gf2462625.el9.x86_64 3/33 2024-02-07T12:13:49.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:17.2.7-491.gf2462625.el9.x86_64 4/33 2024-02-07T12:13:49.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:17.2.7-491.gf2462625.el9.x86_64 5/33 2024-02-07T12:13:49.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-491.gf2462625.el9.n 6/33 2024-02-07T12:13:49.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-07T12:13:49.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-07T12:13:49.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-07T12:13:49.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-07T12:13:49.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-07T12:13:49.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-07T12:13:49.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-07T12:13:49.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-07T12:13:49.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-07T12:13:49.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-07T12:13:49.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-07T12:13:49.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-07T12:13:49.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-07T12:13:49.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-07T12:13:49.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-07T12:13:49.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-07T12:13:49.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-07T12:13:49.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-07T12:13:49.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-07T12:13:49.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-07T12:13:49.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-07T12:13:49.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-07T12:13:49.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-07T12:13:49.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-07T12:13:49.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-07T12:13:49.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-07T12:13:50.064 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:51 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:13:50.222 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:13:50.224 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================== 2024-02-07T12:13:50.225 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-07T12:13:50.225 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================== 2024-02-07T12:13:50.225 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:13:50.225 INFO:teuthology.orchestra.run.smithi138.stdout: ceph x86_64 2:17.2.7-491.gf2462625.el9 ceph 6.5 k 2024-02-07T12:13:50.225 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-07T12:13:50.225 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds x86_64 2:17.2.7-491.gf2462625.el9 ceph 2.1 M 2024-02-07T12:13:50.225 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr x86_64 2:17.2.7-491.gf2462625.el9 ceph 1.4 M 2024-02-07T12:13:50.225 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 239 k 2024-02-07T12:13:50.225 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon x86_64 2:17.2.7-491.gf2462625.el9 ceph 3.7 M 2024-02-07T12:13:50.225 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd x86_64 2:17.2.7-491.gf2462625.el9 ceph 15 M 2024-02-07T12:13:50.225 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-07T12:13:50.225 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-07T12:13:50.225 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-07T12:13:50.226 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-07T12:13:50.226 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-07T12:13:50.226 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-07T12:13:50.226 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-07T12:13:50.226 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-07T12:13:50.226 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-07T12:13:50.226 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-07T12:13:50.226 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-07T12:13:50.226 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-07T12:13:50.226 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-07T12:13:50.226 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-07T12:13:50.226 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-07T12:13:50.226 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================== 2024-02-07T12:13:50.227 INFO:teuthology.orchestra.run.smithi138.stdout:Install 33 Packages 2024-02-07T12:13:50.228 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:50.228 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 27 M 2024-02-07T12:13:50.228 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 99 M 2024-02-07T12:13:50.228 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:13:50.445 INFO:teuthology.orchestra.run.smithi138.stdout:(1/33): ceph-17.2.7-491.gf2462625.el9.x86_64.rp 38 kB/s | 6.5 kB 00:00 2024-02-07T12:13:50.752 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-07T12:13:50.752 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:50.752 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:13:50.752 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:50.752 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-07T12:13:50.753 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-07T12:13:50.754 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-07T12:13:50.755 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-07T12:13:50.755 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-07T12:13:50.755 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:50.755 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:13:50.820 INFO:teuthology.orchestra.run.smithi138.stdout:(2/33): ceph-mon-17.2.7-491.gf2462625.el9.x86_6 9.9 MB/s | 3.7 MB 00:00 2024-02-07T12:13:51.072 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-base 2024-02-07T12:13:51.137 INFO:teuthology.orchestra.run.smithi138.stdout:(3/33): ceph-mgr-17.2.7-491.gf2462625.el9.x86_6 1.6 MB/s | 1.4 MB 00:00 2024-02-07T12:13:51.221 INFO:teuthology.orchestra.run.smithi138.stdout:(4/33): ceph-mds-17.2.7-491.gf2462625.el9.x86_6 2.2 MB/s | 2.1 MB 00:00 2024-02-07T12:13:51.280 INFO:teuthology.orchestra.run.smithi138.stdout:(5/33): ceph-mgr-modules-core-17.2.7-491.gf2462 1.6 MB/s | 239 kB 00:00 2024-02-07T12:13:51.330 INFO:teuthology.orchestra.run.smithi138.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 645 kB/s | 32 kB 00:00 2024-02-07T12:13:51.355 INFO:teuthology.orchestra.run.smithi138.stdout:(7/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 144 kB 00:00 2024-02-07T12:13:51.381 INFO:teuthology.orchestra.run.smithi138.stdout:(8/33): python3-pytz-2021.1-5.el9.noarch.rpm 943 kB/s | 47 kB 00:00 2024-02-07T12:13:51.406 INFO:teuthology.orchestra.run.smithi138.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 765 kB/s | 39 kB 00:00 2024-02-07T12:13:51.432 INFO:teuthology.orchestra.run.smithi138.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-02-07T12:13:51.482 INFO:teuthology.orchestra.run.smithi138.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 15 MB/s | 1.1 MB 00:00 2024-02-07T12:13:51.507 INFO:teuthology.orchestra.run.smithi138.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2024-02-07T12:13:51.533 INFO:teuthology.orchestra.run.smithi138.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-02-07T12:13:51.558 INFO:teuthology.orchestra.run.smithi138.stdout:(14/33): python3-requests-2.25.1-8.el9.noarch.r 2.2 MB/s | 113 kB 00:00 2024-02-07T12:13:51.583 INFO:teuthology.orchestra.run.smithi138.stdout:(15/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2024-02-07T12:13:51.653 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:52 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:13:51.734 INFO:teuthology.orchestra.run.smithi138.stdout:(16/33): ceph-osd-17.2.7-491.gf2462625.el9.x86_ 17 MB/s | 15 MB 00:00 2024-02-07T12:13:51.763 INFO:teuthology.orchestra.run.smithi047.stdout:Package ceph-base-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:13:51.801 INFO:teuthology.orchestra.run.smithi138.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 179 kB/s | 43 kB 00:00 2024-02-07T12:13:51.820 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:13:51.821 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-02-07T12:13:51.821 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:13:51.834 INFO:teuthology.orchestra.run.smithi138.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 685 kB/s | 172 kB 00:00 2024-02-07T12:13:51.852 INFO:teuthology.orchestra.run.smithi138.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 212 kB/s | 11 kB 00:00 2024-02-07T12:13:51.868 INFO:teuthology.orchestra.run.smithi138.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 527 kB/s | 18 kB 00:00 2024-02-07T12:13:51.882 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install cephadm 2024-02-07T12:13:51.894 INFO:teuthology.orchestra.run.smithi138.stdout:(21/33): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2024-02-07T12:13:51.911 INFO:teuthology.orchestra.run.smithi138.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 392 kB/s | 23 kB 00:00 2024-02-07T12:13:51.927 INFO:teuthology.orchestra.run.smithi138.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 330 kB/s | 19 kB 00:00 2024-02-07T12:13:51.945 INFO:teuthology.orchestra.run.smithi138.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 389 kB/s | 20 kB 00:00 2024-02-07T12:13:51.987 INFO:teuthology.orchestra.run.smithi138.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-02-07T12:13:52.012 INFO:teuthology.orchestra.run.smithi138.stdout:(26/33): python3-logutils-0.3.5-21.el9.noarch.r 551 kB/s | 46 kB 00:00 2024-02-07T12:13:52.038 INFO:teuthology.orchestra.run.smithi138.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-02-07T12:13:52.054 INFO:teuthology.orchestra.run.smithi138.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 244 kB/s | 16 kB 00:00 2024-02-07T12:13:52.080 INFO:teuthology.orchestra.run.smithi138.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-02-07T12:13:52.097 INFO:teuthology.orchestra.run.smithi138.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 607 kB/s | 36 kB 00:00 2024-02-07T12:13:52.130 INFO:teuthology.orchestra.run.smithi138.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-02-07T12:13:52.156 INFO:teuthology.orchestra.run.smithi138.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 339 kB/s | 20 kB 00:00 2024-02-07T12:13:52.198 INFO:teuthology.orchestra.run.smithi138.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.5 MB/s | 427 kB 00:00 2024-02-07T12:13:52.201 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:13:52.202 INFO:teuthology.orchestra.run.smithi138.stdout:Total 14 MB/s | 27 MB 00:01 2024-02-07T12:13:52.202 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:13:52.241 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:13:52.241 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:13:52.458 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:53 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:13:52.581 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:13:52.581 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:13:52.623 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:13:52.624 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:52.624 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-02-07T12:13:52.624 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:52.624 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:13:52.624 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 80 k 2024-02-07T12:13:52.624 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:52.624 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:13:52.625 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:52.625 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-02-07T12:13:52.625 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:52.625 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 80 k 2024-02-07T12:13:52.625 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 364 k 2024-02-07T12:13:52.625 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:13:52.831 INFO:teuthology.orchestra.run.smithi047.stdout:cephadm-17.2.7-491.gf2462625.el9.noarch.rpm 390 kB/s | 80 kB 00:00 2024-02-07T12:13:52.832 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:13:52.832 INFO:teuthology.orchestra.run.smithi047.stdout:Total 388 kB/s | 80 kB 00:00 2024-02-07T12:13:52.832 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:13:52.838 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:13:52.838 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:13:52.839 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:13:52.840 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:13:52.917 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:13:53.404 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:17.2.7-491.gf2462625.el9.noarch 1/1 2024-02-07T12:13:53.480 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:17.2.7-491.gf2462625.el9.noarch 1/1 2024-02-07T12:13:53.796 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:13:53.876 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-07T12:13:53.885 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:17.2.7-491.gf2462625.el9.noarch 1/1 2024-02-07T12:13:53.909 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-07T12:13:53.942 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-07T12:13:54.035 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-07T12:13:54.113 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-07T12:13:54.154 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-07T12:13:54.175 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:17.2.7-491.gf2462625.el9.noarch 1/1 2024-02-07T12:13:54.175 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:54.175 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:13:54.176 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:13:54.176 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:54.176 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:13:54.235 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-07T12:13:54.288 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-07T12:13:54.326 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-07T12:13:54.361 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-immutable-object-cache 2024-02-07T12:13:54.384 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-07T12:13:54.440 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-07T12:13:54.634 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-07T12:13:54.682 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-07T12:13:54.729 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-07T12:13:54.764 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-07T12:13:54.794 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-07T12:13:54.862 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-07T12:13:54.905 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-07T12:13:54.938 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-07T12:13:54.939 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:55 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:13:54.979 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-07T12:13:55.014 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-07T12:13:55.048 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-07T12:13:55.104 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:13:55.104 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-02-07T12:13:55.105 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:55.105 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:13:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-491.gf2462625.el9 ceph 137 k 2024-02-07T12:13:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:55.105 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:13:55.105 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:55.105 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-02-07T12:13:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:55.106 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 137 k 2024-02-07T12:13:55.106 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 379 k 2024-02-07T12:13:55.106 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:13:55.138 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-07T12:13:55.194 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-07T12:13:55.270 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-07T12:13:55.329 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-immutable-object-cache-17.2.7-491.gf246262 614 kB/s | 137 kB 00:00 2024-02-07T12:13:55.330 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:13:55.330 INFO:teuthology.orchestra.run.smithi047.stdout:Total 610 kB/s | 137 kB 00:00 2024-02-07T12:13:55.330 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:13:55.338 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:13:55.338 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:13:55.391 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:13:55.391 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:13:55.406 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-07T12:13:55.534 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-07T12:13:55.534 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:13:55.605 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-491.gf2462625.e 1/1 2024-02-07T12:13:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-491.gf2462625.e 1/1 2024-02-07T12:13:55.628 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:13:55.628 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-07T12:13:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:55.688 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-491.gf2462625.el9.n 28/33 2024-02-07T12:13:55.720 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-2:17.2.7-491.gf2462625.el9.x86_64 29/33 2024-02-07T12:13:55.745 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-2:17.2.7-491.gf2462625.el9.x86_64 29/33 2024-02-07T12:13:55.745 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:13:55.745 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-07T12:13:55.746 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-07T12:13:55.746 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-07T12:13:55.746 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:56.707 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-491.gf2462625.e 1/1 2024-02-07T12:13:56.708 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:56.708 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:13:56.708 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:13:56.708 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:56.708 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:13:56.915 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr 2024-02-07T12:13:57.079 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-osd-2:17.2.7-491.gf2462625.el9.x86_64 30/33 2024-02-07T12:13:57.105 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-osd-2:17.2.7-491.gf2462625.el9.x86_64 30/33 2024-02-07T12:13:57.106 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:13:57.106 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-07T12:13:57.106 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-07T12:13:57.106 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-07T12:13:57.106 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mon-2:17.2.7-491.gf2462625.el9.x86_64 31/33 2024-02-07T12:13:57.496 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:58 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:13:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mon-2:17.2.7-491.gf2462625.el9.x86_64 31/33 2024-02-07T12:13:57.512 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:13:57.512 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-07T12:13:57.512 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-07T12:13:57.513 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-07T12:13:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:57.604 INFO:teuthology.orchestra.run.smithi047.stdout:Package ceph-mgr-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:13:57.657 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:13:57.658 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-02-07T12:13:57.658 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:13:57.711 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-dashboard 2024-02-07T12:13:57.714 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mds-2:17.2.7-491.gf2462625.el9.x86_64 32/33 2024-02-07T12:13:57.737 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mds-2:17.2.7-491.gf2462625.el9.x86_64 32/33 2024-02-07T12:13:57.737 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:13:57.738 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-07T12:13:57.738 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-07T12:13:57.738 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-07T12:13:57.738 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:13:57.804 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-2:17.2.7-491.gf2462625.el9.x86_64 33/33 2024-02-07T12:13:58.287 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:59 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:13:58.452 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:13:58.453 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:58.453 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-02-07T12:13:58.453 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:58.453 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:13:58.453 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 1.7 M 2024-02-07T12:13:58.453 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-02-07T12:13:58.454 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 23 k 2024-02-07T12:13:58.454 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 15 k 2024-02-07T12:13:58.454 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-07T12:13:58.454 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-07T12:13:58.454 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-07T12:13:58.454 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-02-07T12:13:58.454 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-07T12:13:58.454 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:58.454 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:13:58.454 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:13:58.454 INFO:teuthology.orchestra.run.smithi047.stdout:Install 7 Packages 2024-02-07T12:13:58.454 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:13:58.455 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 2.0 M 2024-02-07T12:13:58.455 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 8.1 M 2024-02-07T12:13:58.455 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:13:58.733 INFO:teuthology.orchestra.run.smithi047.stdout:(1/7): ceph-grafana-dashboards-17.2.7-491.gf246 112 kB/s | 23 kB 00:00 2024-02-07T12:13:58.883 INFO:teuthology.orchestra.run.smithi047.stdout:(2/7): ceph-prometheus-alerts-17.2.7-491.gf2462 41 kB/s | 15 kB 00:00 2024-02-07T12:13:58.991 INFO:teuthology.orchestra.run.smithi047.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 35 kB/s | 9.0 kB 00:00 2024-02-07T12:13:59.150 INFO:teuthology.orchestra.run.smithi047.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 194 kB/s | 31 kB 00:00 2024-02-07T12:13:59.192 INFO:teuthology.orchestra.run.smithi047.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 132 kB/s | 41 kB 00:00 2024-02-07T12:13:59.359 INFO:teuthology.orchestra.run.smithi047.stdout:(6/7): ceph-mgr-dashboard-17.2.7-491.gf2462625. 2.0 MB/s | 1.7 MB 00:00 2024-02-07T12:13:59.442 INFO:teuthology.orchestra.run.smithi047.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 645 kB/s | 188 kB 00:00 2024-02-07T12:13:59.446 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:13:59.446 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.0 MB/s | 2.0 MB 00:00 2024-02-07T12:13:59.446 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:13:59.454 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:13:59.454 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:13:59.520 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:13:59.553 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:13:59.700 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-2:17.2.7-491.gf2462625.el9.x86_64 33/33 2024-02-07T12:13:59.700 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-2:17.2.7-491.gf2462625.el9.x86_64 1/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mds-2:17.2.7-491.gf2462625.el9.x86_64 2/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-2:17.2.7-491.gf2462625.el9.x86_64 3/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mon-2:17.2.7-491.gf2462625.el9.x86_64 4/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-osd-2:17.2.7-491.gf2462625.el9.x86_64 5/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-491.gf2462625.el9.n 6/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-07T12:13:59.701 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-07T12:13:59.702 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-07T12:13:59.702 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-07T12:13:59.702 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-07T12:13:59.702 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-07T12:13:59.702 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-07T12:13:59.702 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-07T12:13:59.702 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-07T12:13:59.702 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-07T12:13:59.702 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-07T12:13:59.702 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-07T12:13:59.703 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-07T12:13:59.703 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-07T12:13:59.703 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-07T12:13:59.703 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-07T12:13:59.703 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-07T12:13:59.704 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-07T12:13:59.704 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-07T12:13:59.948 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:14:00.010 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-07T12:14:00.045 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-07T12:14:00.091 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-07T12:14:00.131 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-07T12:14:00.160 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-491.gf2462625.el9.no 5/7 2024-02-07T12:14:00.399 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-491.gf2462625.el9.n 6/7 2024-02-07T12:14:00.429 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-491.gf2462625.el9.noarch 7/7 2024-02-07T12:14:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-07T12:14:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:00.619 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:14:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:00.619 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-07T12:14:00.620 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply-3.11-14.el9.noarch 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-07T12:14:00.621 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-07T12:14:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-07T12:14:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-07T12:14:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:00.622 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:00.977 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-491.gf2462625.el9.noarch 7/7 2024-02-07T12:14:00.977 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-491.gf2462625.el9.n 1/7 2024-02-07T12:14:00.977 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-491.gf2462625.el9.noarch 2/7 2024-02-07T12:14:00.977 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-491.gf2462625.el9.no 3/7 2024-02-07T12:14:00.977 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-07T12:14:00.977 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-07T12:14:00.978 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-07T12:14:01.000 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-base 2024-02-07T12:14:01.308 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-07T12:14:01.308 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:01.308 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:14:01.308 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:01.308 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:01.308 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:01.308 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-07T12:14:01.309 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-07T12:14:01.309 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-07T12:14:01.309 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-07T12:14:01.309 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:01.309 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:01.522 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-07T12:14:01.575 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:02 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:01.682 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-base-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:01.734 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:01.735 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-07T12:14:01.735 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:01.791 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install cephadm 2024-02-07T12:14:02.098 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:03 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:02.265 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:02.266 INFO:teuthology.orchestra.run.smithi047.stdout:=========================================================================================== 2024-02-07T12:14:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-02-07T12:14:02.266 INFO:teuthology.orchestra.run.smithi047.stdout:=========================================================================================== 2024-02-07T12:14:02.266 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:14:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 7.4 M 2024-02-07T12:14:02.266 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-02-07T12:14:02.266 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-07T12:14:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-07T12:14:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-07T12:14:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-07T12:14:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-07T12:14:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-07T12:14:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-07T12:14:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-07T12:14:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-07T12:14:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-07T12:14:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-07T12:14:02.267 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:02.267 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:14:02.267 INFO:teuthology.orchestra.run.smithi047.stdout:=========================================================================================== 2024-02-07T12:14:02.268 INFO:teuthology.orchestra.run.smithi047.stdout:Install 12 Packages 2024-02-07T12:14:02.268 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:02.268 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 37 M 2024-02-07T12:14:02.268 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 209 M 2024-02-07T12:14:02.268 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:14:02.353 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:03 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:02.511 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:02.512 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:02.512 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-07T12:14:02.512 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:02.512 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:14:02.513 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 80 k 2024-02-07T12:14:02.513 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:02.513 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:14:02.513 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:02.513 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-07T12:14:02.513 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:02.513 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 80 k 2024-02-07T12:14:02.513 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 364 k 2024-02-07T12:14:02.513 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:14:02.701 INFO:teuthology.orchestra.run.smithi047.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 222 kB/s | 32 kB 00:00 2024-02-07T12:14:02.734 INFO:teuthology.orchestra.run.smithi047.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 537 kB/s | 17 kB 00:00 2024-02-07T12:14:02.776 INFO:teuthology.orchestra.run.smithi047.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 855 kB/s | 34 kB 00:00 2024-02-07T12:14:02.834 INFO:teuthology.orchestra.run.smithi138.stdout:cephadm-17.2.7-491.gf2462625.el9.noarch.rpm 251 kB/s | 80 kB 00:00 2024-02-07T12:14:02.835 INFO:teuthology.orchestra.run.smithi047.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-02-07T12:14:02.835 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:02.835 INFO:teuthology.orchestra.run.smithi138.stdout:Total 250 kB/s | 80 kB 00:00 2024-02-07T12:14:02.835 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:14:02.840 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:14:02.840 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:14:02.843 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:14:02.843 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:14:02.916 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:14:03.010 INFO:teuthology.orchestra.run.smithi047.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2024-02-07T12:14:03.069 INFO:teuthology.orchestra.run.smithi047.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 4.8 MB 00:00 2024-02-07T12:14:03.094 INFO:teuthology.orchestra.run.smithi047.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.6 MB/s | 217 kB 00:00 2024-02-07T12:14:03.270 INFO:teuthology.orchestra.run.smithi047.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 802 kB 00:00 2024-02-07T12:14:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:17.2.7-491.gf2462625.el9.noarch 1/1 2024-02-07T12:14:03.407 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephadm-2:17.2.7-491.gf2462625.el9.noarch 1/1 2024-02-07T12:14:03.419 INFO:teuthology.orchestra.run.smithi047.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-02-07T12:14:03.445 INFO:teuthology.orchestra.run.smithi047.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 194 kB 00:00 2024-02-07T12:14:03.686 INFO:teuthology.orchestra.run.smithi047.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 921 kB/s | 245 kB 00:00 2024-02-07T12:14:03.811 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:17.2.7-491.gf2462625.el9.noarch 1/1 2024-02-07T12:14:04.153 INFO:teuthology.orchestra.run.smithi047.stdout:(12/12): ceph-mgr-diskprediction-local-17.2.7-4 4.6 MB/s | 7.4 MB 00:01 2024-02-07T12:14:04.157 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:04.157 INFO:teuthology.orchestra.run.smithi047.stdout:Total 20 MB/s | 37 MB 00:01 2024-02-07T12:14:04.162 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephadm-2:17.2.7-491.gf2462625.el9.noarch 1/1 2024-02-07T12:14:04.163 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:04.163 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:14:04.163 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:04.163 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:04.163 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:04.174 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:14:04.200 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:14:04.200 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:14:04.361 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-immutable-object-cache 2024-02-07T12:14:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:14:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:14:04.931 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:05 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:05.092 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:05.093 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:05.093 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-02-07T12:14:05.093 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:05.093 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:14:05.093 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-491.gf2462625.el9 ceph 137 k 2024-02-07T12:14:05.093 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:05.093 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:14:05.093 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:05.094 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-07T12:14:05.094 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:05.094 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 137 k 2024-02-07T12:14:05.094 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 379 k 2024-02-07T12:14:05.094 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:14:05.368 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:14:05.445 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-immutable-object-cache-17.2.7-491.gf246262 390 kB/s | 137 kB 00:00 2024-02-07T12:14:05.445 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:05.446 INFO:teuthology.orchestra.run.smithi138.stdout:Total 389 kB/s | 137 kB 00:00 2024-02-07T12:14:05.446 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:14:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-07T12:14:05.453 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:14:05.453 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:14:05.474 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-07T12:14:05.505 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:14:05.505 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:14:05.571 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-07T12:14:05.611 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-07T12:14:05.641 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:14:05.712 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-491.gf2462625.e 1/1 2024-02-07T12:14:05.737 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-491.gf2462625.e 1/1 2024-02-07T12:14:05.737 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:14:05.737 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-07T12:14:05.738 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:05.794 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-07T12:14:05.826 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-07T12:14:05.905 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-07T12:14:06.609 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-07T12:14:06.725 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-07T12:14:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-491.gf2462625.e 1/1 2024-02-07T12:14:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:06.766 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:14:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:06.766 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:06.766 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:07.017 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr 2024-02-07T12:14:07.600 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:08 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:07.708 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-mgr-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:07.759 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:07.760 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-07T12:14:07.760 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:07.827 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-dashboard 2024-02-07T12:14:08.046 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-07T12:14:08.390 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:09 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:08.548 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:08.549 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:08.549 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-07T12:14:08.549 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:08.549 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:14:08.549 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 1.7 M 2024-02-07T12:14:08.549 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-07T12:14:08.549 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 23 k 2024-02-07T12:14:08.549 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 15 k 2024-02-07T12:14:08.549 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-07T12:14:08.550 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-07T12:14:08.550 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-07T12:14:08.550 INFO:teuthology.orchestra.run.smithi138.stdout:Installing weak dependencies: 2024-02-07T12:14:08.550 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-07T12:14:08.550 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:08.550 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:14:08.550 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:08.550 INFO:teuthology.orchestra.run.smithi138.stdout:Install 7 Packages 2024-02-07T12:14:08.550 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:08.551 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 2.0 M 2024-02-07T12:14:08.551 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 8.1 M 2024-02-07T12:14:08.551 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:14:08.793 INFO:teuthology.orchestra.run.smithi138.stdout:(1/7): ceph-prometheus-alerts-17.2.7-491.gf2462 74 kB/s | 15 kB 00:00 2024-02-07T12:14:09.002 INFO:teuthology.orchestra.run.smithi138.stdout:(2/7): ceph-grafana-dashboards-17.2.7-491.gf246 57 kB/s | 23 kB 00:00 2024-02-07T12:14:09.044 INFO:teuthology.orchestra.run.smithi138.stdout:(3/7): ceph-mgr-dashboard-17.2.7-491.gf2462625. 3.8 MB/s | 1.7 MB 00:00 2024-02-07T12:14:09.121 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-07T12:14:09.151 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-491.gf24626 12/12 2024-02-07T12:14:09.203 INFO:teuthology.orchestra.run.smithi138.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 22 kB/s | 9.0 kB 00:00 2024-02-07T12:14:09.445 INFO:teuthology.orchestra.run.smithi138.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 92 kB/s | 41 kB 00:00 2024-02-07T12:14:09.470 INFO:teuthology.orchestra.run.smithi138.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 72 kB/s | 31 kB 00:00 2024-02-07T12:14:09.603 INFO:teuthology.orchestra.run.smithi138.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 472 kB/s | 188 kB 00:00 2024-02-07T12:14:09.607 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:09.608 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.9 MB/s | 2.0 MB 00:01 2024-02-07T12:14:09.608 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:14:09.615 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:14:09.615 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:14:09.685 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:14:09.685 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:14:09.991 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:14:10.055 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-07T12:14:10.089 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-07T12:14:10.135 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-07T12:14:10.176 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-07T12:14:10.204 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-491.gf2462625.el9.no 5/7 2024-02-07T12:14:10.423 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-491.gf2462625.el9.n 6/7 2024-02-07T12:14:10.458 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-491.gf2462625.el9.noarch 7/7 2024-02-07T12:14:11.013 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-491.gf2462625.el9.noarch 7/7 2024-02-07T12:14:11.013 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-491.gf2462625.el9.n 1/7 2024-02-07T12:14:11.013 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-491.gf2462625.el9.noarch 2/7 2024-02-07T12:14:11.014 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-491.gf2462625.el9.no 3/7 2024-02-07T12:14:11.014 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-07T12:14:11.014 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-07T12:14:11.014 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-07T12:14:11.322 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-07T12:14:11.322 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:11.322 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:14:11.322 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:11.323 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:11.323 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:11.323 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-07T12:14:11.323 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-07T12:14:11.323 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-07T12:14:11.323 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-07T12:14:11.323 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:11.323 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-491.gf24626 12/12 2024-02-07T12:14:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-491.gf24626 1/12 2024-02-07T12:14:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-07T12:14:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-07T12:14:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-07T12:14:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-07T12:14:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-07T12:14:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-07T12:14:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-07T12:14:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-07T12:14:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-07T12:14:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-07T12:14:11.556 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-07T12:14:12.037 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-07T12:14:12.037 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:12.037 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:14:12.037 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:12.037 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-07T12:14:12.037 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-07T12:14:12.037 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-07T12:14:12.037 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-07T12:14:12.037 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-07T12:14:12.037 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-07T12:14:12.037 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-07T12:14:12.037 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-07T12:14:12.038 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-07T12:14:12.038 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-07T12:14:12.038 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-07T12:14:12.038 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:12.038 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:12.120 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:13 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:12.280 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:12.281 INFO:teuthology.orchestra.run.smithi138.stdout:=========================================================================================== 2024-02-07T12:14:12.281 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-07T12:14:12.281 INFO:teuthology.orchestra.run.smithi138.stdout:=========================================================================================== 2024-02-07T12:14:12.281 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:14:12.281 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 7.4 M 2024-02-07T12:14:12.281 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-07T12:14:12.281 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-07T12:14:12.281 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-07T12:14:12.281 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-07T12:14:12.282 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-07T12:14:12.282 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-07T12:14:12.282 INFO:teuthology.orchestra.run.smithi138.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-07T12:14:12.282 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-07T12:14:12.282 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-07T12:14:12.282 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-07T12:14:12.282 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-07T12:14:12.282 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-07T12:14:12.282 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:12.282 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:14:12.282 INFO:teuthology.orchestra.run.smithi138.stdout:=========================================================================================== 2024-02-07T12:14:12.282 INFO:teuthology.orchestra.run.smithi138.stdout:Install 12 Packages 2024-02-07T12:14:12.282 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:12.283 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 37 M 2024-02-07T12:14:12.283 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 209 M 2024-02-07T12:14:12.283 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:14:12.387 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-rook 2024-02-07T12:14:12.504 INFO:teuthology.orchestra.run.smithi138.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 195 kB/s | 32 kB 00:00 2024-02-07T12:14:12.571 INFO:teuthology.orchestra.run.smithi138.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 261 kB/s | 17 kB 00:00 2024-02-07T12:14:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 512 kB/s | 34 kB 00:00 2024-02-07T12:14:12.930 INFO:teuthology.orchestra.run.smithi138.stdout:(4/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2024-02-07T12:14:12.976 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:13 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:13.139 INFO:teuthology.orchestra.run.smithi138.stdout:(5/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2024-02-07T12:14:13.147 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:13.148 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-02-07T12:14:13.148 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-02-07T12:14:13.148 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-02-07T12:14:13.148 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:14:13.148 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 47 k 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:13.149 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:14:13.150 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-02-07T12:14:13.150 INFO:teuthology.orchestra.run.smithi047.stdout:Install 13 Packages 2024-02-07T12:14:13.150 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:13.150 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 2.0 M 2024-02-07T12:14:13.150 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 26 M 2024-02-07T12:14:13.150 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:14:13.214 INFO:teuthology.orchestra.run.smithi138.stdout:(6/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.8 MB/s | 217 kB 00:00 2024-02-07T12:14:13.635 INFO:teuthology.orchestra.run.smithi047.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 114 kB/s | 24 kB 00:00 2024-02-07T12:14:13.660 INFO:teuthology.orchestra.run.smithi047.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 75 kB/s | 18 kB 00:00 2024-02-07T12:14:13.836 INFO:teuthology.orchestra.run.smithi047.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 877 kB/s | 174 kB 00:00 2024-02-07T12:14:13.861 INFO:teuthology.orchestra.run.smithi047.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 660 kB/s | 132 kB 00:00 2024-02-07T12:14:13.911 INFO:teuthology.orchestra.run.smithi047.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 211 kB 00:00 2024-02-07T12:14:13.936 INFO:teuthology.orchestra.run.smithi047.stdout:(6/13): ceph-mgr-rook-17.2.7-491.gf2462625.el9. 92 kB/s | 47 kB 00:00 2024-02-07T12:14:13.962 INFO:teuthology.orchestra.run.smithi047.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 425 kB/s | 43 kB 00:00 2024-02-07T12:14:13.964 INFO:teuthology.orchestra.run.smithi138.stdout:(7/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-02-07T12:14:14.031 INFO:teuthology.orchestra.run.smithi138.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 12 MB/s | 802 kB 00:00 2024-02-07T12:14:14.073 INFO:teuthology.orchestra.run.smithi138.stdout:(9/12): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 194 kB 00:00 2024-02-07T12:14:14.212 INFO:teuthology.orchestra.run.smithi047.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 60 kB/s | 15 kB 00:00 2024-02-07T12:14:14.215 INFO:teuthology.orchestra.run.smithi138.stdout:(10/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 1.6 MB/s | 3.0 MB 00:01 2024-02-07T12:14:14.239 INFO:teuthology.orchestra.run.smithi047.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 98 kB/s | 32 kB 00:00 2024-02-07T12:14:14.299 INFO:teuthology.orchestra.run.smithi138.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-02-07T12:14:14.462 INFO:teuthology.orchestra.run.smithi047.stdout:(10/13): python3-google-auth-2.27.0-1.el9.noarc 405 kB/s | 203 kB 00:00 2024-02-07T12:14:14.488 INFO:teuthology.orchestra.run.smithi047.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 238 kB/s | 59 kB 00:00 2024-02-07T12:14:14.638 INFO:teuthology.orchestra.run.smithi047.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 512 kB/s | 90 kB 00:00 2024-02-07T12:14:15.196 INFO:teuthology.orchestra.run.smithi047.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.0 MB/s | 1.0 MB 00:00 2024-02-07T12:14:15.198 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:15.199 INFO:teuthology.orchestra.run.smithi047.stdout:Total 1.0 MB/s | 2.0 MB 00:02 2024-02-07T12:14:15.199 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:14:15.215 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:14:15.215 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:14:15.327 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:14:15.328 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:14:15.440 INFO:teuthology.orchestra.run.smithi138.stdout:(12/12): ceph-mgr-diskprediction-local-17.2.7-4 2.4 MB/s | 7.4 MB 00:03 2024-02-07T12:14:15.444 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:15.444 INFO:teuthology.orchestra.run.smithi138.stdout:Total 12 MB/s | 37 MB 00:03 2024-02-07T12:14:15.464 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:14:15.491 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:14:15.491 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:14:15.877 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:14:15.903 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:14:15.904 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:14:16.060 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-07T12:14:16.124 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-07T12:14:16.180 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-07T12:14:16.216 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-07T12:14:16.258 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-07T12:14:16.354 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-07T12:14:16.464 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-07T12:14:16.517 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-07T12:14:16.644 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:14:16.730 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-07T12:14:16.762 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-07T12:14:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-07T12:14:16.891 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-07T12:14:17.069 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-07T12:14:17.115 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-07T12:14:17.193 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-07T12:14:17.272 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-07T12:14:17.322 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-07T12:14:17.348 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-07T12:14:17.395 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-07T12:14:17.417 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:17.2.7-491.gf2462625.el9.noarch 13/13 2024-02-07T12:14:17.856 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-07T12:14:17.971 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-07T12:14:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-491.gf2462625.el9.noarch 13/13 2024-02-07T12:14:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:17.2.7-491.gf2462625.el9.noarch 1/13 2024-02-07T12:14:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-07T12:14:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-07T12:14:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-07T12:14:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-07T12:14:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-07T12:14:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-07T12:14:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-07T12:14:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-07T12:14:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-07T12:14:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-07T12:14:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-07T12:14:18.615 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-07T12:14:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:18.616 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:14:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-07T12:14:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-07T12:14:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-07T12:14:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-07T12:14:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-07T12:14:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-07T12:14:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-07T12:14:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-07T12:14:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-07T12:14:18.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-07T12:14:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-07T12:14:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-07T12:14:18.617 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:18.617 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:18.831 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-cephadm 2024-02-07T12:14:19.220 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-07T12:14:19.408 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:20 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:19.575 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:19.575 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-02-07T12:14:19.575 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-02-07T12:14:19.575 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-02-07T12:14:19.576 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:14:19.576 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 121 k 2024-02-07T12:14:19.576 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-02-07T12:14:19.576 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-07T12:14:19.576 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-07T12:14:19.576 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-07T12:14:19.576 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-07T12:14:19.576 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-07T12:14:19.576 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:19.576 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:14:19.576 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-02-07T12:14:19.576 INFO:teuthology.orchestra.run.smithi047.stdout:Install 6 Packages 2024-02-07T12:14:19.576 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:19.577 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 6.8 M 2024-02-07T12:14:19.577 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 33 M 2024-02-07T12:14:19.577 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:14:19.781 INFO:teuthology.orchestra.run.smithi047.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.4 MB/s | 227 kB 00:00 2024-02-07T12:14:19.873 INFO:teuthology.orchestra.run.smithi047.stdout:(2/6): ceph-mgr-cephadm-17.2.7-491.gf2462625.el 481 kB/s | 121 kB 00:00 2024-02-07T12:14:19.940 INFO:teuthology.orchestra.run.smithi047.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2024-02-07T12:14:20.115 INFO:teuthology.orchestra.run.smithi047.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 241 kB/s | 58 kB 00:00 2024-02-07T12:14:20.174 INFO:teuthology.orchestra.run.smithi047.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 244 kB/s | 51 kB 00:00 2024-02-07T12:14:20.246 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-07T12:14:20.269 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-491.gf24626 12/12 2024-02-07T12:14:20.949 INFO:teuthology.orchestra.run.smithi047.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 469 kB/s | 548 kB 00:01 2024-02-07T12:14:20.954 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:20.955 INFO:teuthology.orchestra.run.smithi047.stdout:Total 4.9 MB/s | 6.8 MB 00:01 2024-02-07T12:14:20.955 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:14:20.966 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:14:20.966 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:14:21.064 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:14:21.065 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:14:21.364 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:14:21.538 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-07T12:14:21.594 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-07T12:14:22.140 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-07T12:14:22.223 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-07T12:14:22.285 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-07T12:14:22.313 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-491.gf2462625.el9.noarch 6/6 2024-02-07T12:14:23.014 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-491.gf24626 12/12 2024-02-07T12:14:23.014 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-491.gf24626 1/12 2024-02-07T12:14:23.014 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-07T12:14:23.015 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-07T12:14:23.015 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-07T12:14:23.015 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-07T12:14:23.015 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-07T12:14:23.015 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-07T12:14:23.015 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-07T12:14:23.015 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-07T12:14:23.015 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-07T12:14:23.015 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-07T12:14:23.137 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-491.gf2462625.el9.noarch 6/6 2024-02-07T12:14:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-491.gf2462625.el9.noarch 1/6 2024-02-07T12:14:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-07T12:14:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-07T12:14:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-07T12:14:23.138 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-07T12:14:23.456 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-07T12:14:23.456 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:23.456 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:14:23.456 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:23.456 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-07T12:14:23.457 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-07T12:14:23.457 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-07T12:14:23.457 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-07T12:14:23.457 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-07T12:14:23.457 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-07T12:14:23.457 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-07T12:14:23.457 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-07T12:14:23.457 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-07T12:14:23.457 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-07T12:14:23.457 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-07T12:14:23.457 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:23.457 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:23.472 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-07T12:14:23.473 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:23.473 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:14:23.473 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:23.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-07T12:14:23.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-07T12:14:23.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-07T12:14:23.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-07T12:14:23.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-07T12:14:23.473 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:23.473 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:23.696 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-fuse 2024-02-07T12:14:23.861 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-rook 2024-02-07T12:14:24.281 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:25 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:24.440 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:25 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:24.446 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:24.447 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:24.447 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-02-07T12:14:24.447 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:24.447 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:14:24.447 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:17.2.7-491.gf2462625.el9 ceph 812 k 2024-02-07T12:14:24.447 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-02-07T12:14:24.447 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-07T12:14:24.447 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:24.448 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:14:24.448 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:24.448 INFO:teuthology.orchestra.run.smithi047.stdout:Install 2 Packages 2024-02-07T12:14:24.448 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:24.448 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 891 k 2024-02-07T12:14:24.448 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 2.6 M 2024-02-07T12:14:24.449 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:14:24.576 INFO:teuthology.orchestra.run.smithi047.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 618 kB/s | 79 kB 00:00 2024-02-07T12:14:24.604 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:24.604 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-02-07T12:14:24.604 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-07T12:14:24.604 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-02-07T12:14:24.604 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:14:24.604 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 47 k 2024-02-07T12:14:24.604 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-07T12:14:24.604 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-07T12:14:24.604 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-07T12:14:24.604 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-07T12:14:24.604 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-07T12:14:24.604 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-07T12:14:24.605 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-07T12:14:24.605 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-07T12:14:24.605 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-07T12:14:24.605 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-07T12:14:24.605 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-07T12:14:24.605 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-07T12:14:24.605 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-07T12:14:24.605 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:24.605 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:14:24.605 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-02-07T12:14:24.605 INFO:teuthology.orchestra.run.smithi138.stdout:Install 13 Packages 2024-02-07T12:14:24.605 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:24.606 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 2.0 M 2024-02-07T12:14:24.606 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 26 M 2024-02-07T12:14:24.606 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:14:24.776 INFO:teuthology.orchestra.run.smithi138.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 142 kB/s | 18 kB 00:00 2024-02-07T12:14:24.792 INFO:teuthology.orchestra.run.smithi138.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 170 kB/s | 24 kB 00:00 2024-02-07T12:14:24.843 INFO:teuthology.orchestra.run.smithi138.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2024-02-07T12:14:24.868 INFO:teuthology.orchestra.run.smithi138.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-02-07T12:14:24.894 INFO:teuthology.orchestra.run.smithi138.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-02-07T12:14:24.919 INFO:teuthology.orchestra.run.smithi138.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 854 kB/s | 43 kB 00:00 2024-02-07T12:14:24.944 INFO:teuthology.orchestra.run.smithi138.stdout:(7/13): ceph-mgr-rook-17.2.7-491.gf2462625.el9. 161 kB/s | 47 kB 00:00 2024-02-07T12:14:25.002 INFO:teuthology.orchestra.run.smithi047.stdout:(2/2): ceph-fuse-17.2.7-491.gf2462625.el9.x86_6 1.4 MB/s | 812 kB 00:00 2024-02-07T12:14:25.003 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:25.003 INFO:teuthology.orchestra.run.smithi047.stdout:Total 1.6 MB/s | 891 kB 00:00 2024-02-07T12:14:25.003 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:14:25.024 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:14:25.025 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:14:25.101 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:14:25.102 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:14:25.203 INFO:teuthology.orchestra.run.smithi138.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 53 kB/s | 15 kB 00:00 2024-02-07T12:14:25.291 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:14:25.328 INFO:teuthology.orchestra.run.smithi138.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 74 kB/s | 32 kB 00:00 2024-02-07T12:14:25.450 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-07T12:14:25.495 INFO:teuthology.orchestra.run.smithi138.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 354 kB/s | 59 kB 00:00 2024-02-07T12:14:25.520 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:17.2.7-491.gf2462625.el9.x86_64 2/2 2024-02-07T12:14:25.520 INFO:teuthology.orchestra.run.smithi138.stdout:(11/13): python3-google-auth-2.27.0-1.el9.noarc 352 kB/s | 203 kB 00:00 2024-02-07T12:14:25.662 INFO:teuthology.orchestra.run.smithi138.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 537 kB/s | 90 kB 00:00 2024-02-07T12:14:25.729 INFO:teuthology.orchestra.run.smithi138.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.9 MB/s | 1.0 MB 00:00 2024-02-07T12:14:25.733 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:25.734 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2024-02-07T12:14:25.734 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:14:25.748 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:14:25.748 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:14:25.850 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:14:25.850 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:14:26.251 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-fuse-2:17.2.7-491.gf2462625.el9.x86_64 2/2 2024-02-07T12:14:26.251 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:17.2.7-491.gf2462625.el9.x86_64 1/2 2024-02-07T12:14:26.398 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:14:26.555 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-07T12:14:26.555 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:26.555 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:14:26.555 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:17.2.7-491.gf2462625.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-07T12:14:26.555 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:26.555 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:26.566 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-07T12:14:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-07T12:14:26.678 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-07T12:14:26.716 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-07T12:14:26.765 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librados-devel 2024-02-07T12:14:26.766 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-07T12:14:26.859 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-07T12:14:26.960 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-07T12:14:27.009 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-07T12:14:27.346 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:28 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:27.510 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:27.511 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-02-07T12:14:27.511 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:27.511 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:14:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:17.2.7-491.gf2462625.el9 ceph 126 k 2024-02-07T12:14:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:27.511 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:14:27.511 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:27.512 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-02-07T12:14:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:27.512 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 126 k 2024-02-07T12:14:27.512 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 448 k 2024-02-07T12:14:27.512 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:14:27.724 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-07T12:14:27.782 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-07T12:14:27.816 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-07T12:14:27.855 INFO:teuthology.orchestra.run.smithi047.stdout:librados-devel-17.2.7-491.gf2462625.el9.x86_64. 368 kB/s | 126 kB 00:00 2024-02-07T12:14:27.855 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:27.855 INFO:teuthology.orchestra.run.smithi047.stdout:Total 367 kB/s | 126 kB 00:00 2024-02-07T12:14:27.856 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:14:27.861 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:14:27.861 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:14:27.862 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-07T12:14:27.886 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-rook-2:17.2.7-491.gf2462625.el9.noarch 13/13 2024-02-07T12:14:27.919 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:14:27.920 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:14:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:14:28.180 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:28.595 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados-devel-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:28.685 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-491.gf2462625.el9.noarch 13/13 2024-02-07T12:14:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-rook-2:17.2.7-491.gf2462625.el9.noarch 1/13 2024-02-07T12:14:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-07T12:14:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-07T12:14:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-07T12:14:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-07T12:14:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-07T12:14:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-07T12:14:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-07T12:14:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-07T12:14:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-07T12:14:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-07T12:14:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-07T12:14:28.878 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:28.879 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:28.879 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:14:28.879 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:28.879 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:28.879 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:29.056 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-07T12:14:29.056 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:29.056 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:14:29.056 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:29.056 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-07T12:14:29.056 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-07T12:14:29.056 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-07T12:14:29.056 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-07T12:14:29.057 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-07T12:14:29.057 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-07T12:14:29.057 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-07T12:14:29.057 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-07T12:14:29.057 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-07T12:14:29.057 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-07T12:14:29.057 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-07T12:14:29.057 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-07T12:14:29.057 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:29.057 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:29.127 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install libcephfs2 2024-02-07T12:14:29.333 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-cephadm 2024-02-07T12:14:29.710 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:30 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:29.820 INFO:teuthology.orchestra.run.smithi047.stdout:Package libcephfs2-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:29.876 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:29.877 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-02-07T12:14:29.877 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:29.902 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:30 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:29.947 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install libcephfs-devel 2024-02-07T12:14:30.065 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:30.066 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-02-07T12:14:30.066 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-07T12:14:30.066 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-02-07T12:14:30.066 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:14:30.066 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm noarch 2:17.2.7-491.gf2462625.el9 ceph-noarch 121 k 2024-02-07T12:14:30.066 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-07T12:14:30.066 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-07T12:14:30.066 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-07T12:14:30.067 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-07T12:14:30.067 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-07T12:14:30.067 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-07T12:14:30.067 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:30.067 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:14:30.067 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-02-07T12:14:30.067 INFO:teuthology.orchestra.run.smithi138.stdout:Install 6 Packages 2024-02-07T12:14:30.067 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:30.068 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 6.8 M 2024-02-07T12:14:30.068 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 33 M 2024-02-07T12:14:30.068 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:14:30.285 INFO:teuthology.orchestra.run.smithi138.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.3 MB/s | 227 kB 00:00 2024-02-07T12:14:30.343 INFO:teuthology.orchestra.run.smithi138.stdout:(2/6): ceph-mgr-cephadm-17.2.7-491.gf2462625.el 525 kB/s | 121 kB 00:00 2024-02-07T12:14:30.469 INFO:teuthology.orchestra.run.smithi138.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 5.8 MB 00:00 2024-02-07T12:14:30.526 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:31 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:30.636 INFO:teuthology.orchestra.run.smithi138.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 199 kB/s | 58 kB 00:00 2024-02-07T12:14:30.678 INFO:teuthology.orchestra.run.smithi138.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 245 kB/s | 51 kB 00:00 2024-02-07T12:14:30.691 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:30.692 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-02-07T12:14:30.692 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:30.692 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:14:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:17.2.7-491.gf2462625.el9 ceph 25 k 2024-02-07T12:14:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:30.692 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:14:30.692 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:30.692 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-02-07T12:14:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:30.692 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 25 k 2024-02-07T12:14:30.692 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 110 k 2024-02-07T12:14:30.692 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:14:30.712 INFO:teuthology.orchestra.run.smithi138.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.3 MB/s | 548 kB 00:00 2024-02-07T12:14:30.713 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:30.714 INFO:teuthology.orchestra.run.smithi138.stdout:Total 10 MB/s | 6.8 MB 00:00 2024-02-07T12:14:30.714 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:14:30.723 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:14:30.723 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:14:30.812 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:14:30.813 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:14:30.944 INFO:teuthology.orchestra.run.smithi047.stdout:libcephfs-devel-17.2.7-491.gf2462625.el9.x86_64 99 kB/s | 25 kB 00:00 2024-02-07T12:14:30.944 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:30.944 INFO:teuthology.orchestra.run.smithi047.stdout:Total 99 kB/s | 25 kB 00:00 2024-02-07T12:14:30.945 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:14:30.948 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:14:30.948 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:14:30.950 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:14:30.950 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:14:31.038 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:14:31.110 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:14:31.152 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:31.279 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-07T12:14:31.330 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-07T12:14:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:31.811 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:14:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:31.811 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:31.854 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-07T12:14:31.933 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-07T12:14:31.970 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librados2 2024-02-07T12:14:31.997 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-07T12:14:32.027 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-491.gf2462625.el9.noarch 6/6 2024-02-07T12:14:32.547 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:33 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:32.657 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:32.714 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:32.715 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-02-07T12:14:32.715 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:32.776 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librbd1 2024-02-07T12:14:32.781 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-491.gf2462625.el9.noarch 6/6 2024-02-07T12:14:32.782 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-491.gf2462625.el9.noarch 1/6 2024-02-07T12:14:32.782 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-07T12:14:32.782 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-07T12:14:32.782 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-07T12:14:32.782 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-07T12:14:33.113 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-07T12:14:33.113 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:33.113 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:14:33.114 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm-2:17.2.7-491.gf2462625.el9.noarch 2024-02-07T12:14:33.114 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-07T12:14:33.114 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-07T12:14:33.114 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-07T12:14:33.114 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-07T12:14:33.114 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-07T12:14:33.114 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:33.114 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:33.354 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:34 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:33.398 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-fuse 2024-02-07T12:14:33.464 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:33.520 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:33.521 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-02-07T12:14:33.521 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:33.588 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rados 2024-02-07T12:14:33.965 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:34 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:34.124 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:34.124 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:34.125 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-07T12:14:34.125 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:34.125 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:14:34.125 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse x86_64 2:17.2.7-491.gf2462625.el9 ceph 812 k 2024-02-07T12:14:34.125 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-07T12:14:34.125 INFO:teuthology.orchestra.run.smithi138.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-07T12:14:34.125 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:34.125 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:14:34.125 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:34.125 INFO:teuthology.orchestra.run.smithi138.stdout:Install 2 Packages 2024-02-07T12:14:34.125 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:34.126 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 891 k 2024-02-07T12:14:34.126 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 2.6 M 2024-02-07T12:14:34.126 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:14:34.163 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:35 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:34.241 INFO:teuthology.orchestra.run.smithi138.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 686 kB/s | 79 kB 00:00 2024-02-07T12:14:34.274 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rados-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:34.329 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:34.330 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-02-07T12:14:34.330 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:34.395 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rgw 2024-02-07T12:14:34.476 INFO:teuthology.orchestra.run.smithi138.stdout:(2/2): ceph-fuse-17.2.7-491.gf2462625.el9.x86_6 2.3 MB/s | 812 kB 00:00 2024-02-07T12:14:34.477 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:34.478 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.5 MB/s | 891 kB 00:00 2024-02-07T12:14:34.478 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:14:34.498 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:14:34.498 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:14:34.572 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:14:34.573 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:14:34.759 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:14:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-07T12:14:34.959 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-fuse-2:17.2.7-491.gf2462625.el9.x86_64 2/2 2024-02-07T12:14:34.969 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:35 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:35.079 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rgw-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:35.134 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:35.135 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-02-07T12:14:35.135 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:35.192 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-cephfs 2024-02-07T12:14:35.664 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-fuse-2:17.2.7-491.gf2462625.el9.x86_64 2/2 2024-02-07T12:14:35.664 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-fuse-2:17.2.7-491.gf2462625.el9.x86_64 1/2 2024-02-07T12:14:35.771 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:36 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:35.883 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-cephfs-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:35.935 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:35.937 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-02-07T12:14:35.937 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-07T12:14:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:35.979 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:14:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse-2:17.2.7-491.gf2462625.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-07T12:14:35.979 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:35.979 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:36.004 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rbd 2024-02-07T12:14:36.284 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librados-devel 2024-02-07T12:14:36.582 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:37 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:36.691 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rbd-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:36.746 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:36.747 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-02-07T12:14:36.748 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:36.812 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-fuse 2024-02-07T12:14:36.870 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:37 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:37.028 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:37.029 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:37.030 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-02-07T12:14:37.030 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:37.030 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:14:37.030 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel x86_64 2:17.2.7-491.gf2462625.el9 ceph 126 k 2024-02-07T12:14:37.030 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:37.030 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:14:37.030 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:37.030 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-07T12:14:37.031 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:37.031 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 126 k 2024-02-07T12:14:37.031 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 448 k 2024-02-07T12:14:37.031 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:14:37.251 INFO:teuthology.orchestra.run.smithi138.stdout:librados-devel-17.2.7-491.gf2462625.el9.x86_64. 572 kB/s | 126 kB 00:00 2024-02-07T12:14:37.252 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:37.252 INFO:teuthology.orchestra.run.smithi138.stdout:Total 569 kB/s | 126 kB 00:00 2024-02-07T12:14:37.252 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:14:37.257 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:14:37.257 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:14:37.316 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:14:37.316 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:14:37.393 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:38 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:37.457 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:14:37.558 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:37.558 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-02-07T12:14:37.559 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:37.559 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:14:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:17.2.7-491.gf2462625.el9 ceph 81 k 2024-02-07T12:14:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:37.559 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:14:37.559 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:37.559 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-02-07T12:14:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:37.559 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 81 k 2024-02-07T12:14:37.559 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 222 k 2024-02-07T12:14:37.559 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:14:37.583 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librados-devel-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:37.880 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-fuse-17.2.7-491.gf2462625.el9.x86_64.rpm 254 kB/s | 81 kB 00:00 2024-02-07T12:14:37.881 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:37.881 INFO:teuthology.orchestra.run.smithi047.stdout:Total 253 kB/s | 81 kB 00:00 2024-02-07T12:14:37.881 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:14:37.888 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:14:37.888 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:14:37.946 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:14:37.946 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:14:38.063 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados-devel-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:38.089 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:14:38.181 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:38.342 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados-devel-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:38.342 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:38.343 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:14:38.343 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:38.343 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:38.343 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:38.592 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-fuse-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:38.606 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs2 2024-02-07T12:14:38.919 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:38.919 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:38.919 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:14:38.919 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:38.919 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:38.919 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:39.132 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-mirror 2024-02-07T12:14:39.185 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:40 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:39.297 INFO:teuthology.orchestra.run.smithi138.stdout:Package libcephfs2-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:39.350 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:39.351 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-07T12:14:39.351 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:39.422 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs-devel 2024-02-07T12:14:39.712 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:40 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:39.880 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:39.880 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:39.881 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-02-07T12:14:39.881 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:39.881 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:14:39.881 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:17.2.7-491.gf2462625.el9 ceph 2.9 M 2024-02-07T12:14:39.881 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:39.881 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:14:39.881 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:39.881 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-02-07T12:14:39.881 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:39.881 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 2.9 M 2024-02-07T12:14:39.881 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 12 M 2024-02-07T12:14:39.882 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:14:39.993 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:40 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:40.151 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:40.152 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-02-07T12:14:40.152 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:40.152 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:14:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel x86_64 2:17.2.7-491.gf2462625.el9 ceph 25 k 2024-02-07T12:14:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:40.153 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:14:40.153 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:40.153 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-07T12:14:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:40.153 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 25 k 2024-02-07T12:14:40.153 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 110 k 2024-02-07T12:14:40.153 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:14:40.316 INFO:teuthology.orchestra.run.smithi138.stdout:libcephfs-devel-17.2.7-491.gf2462625.el9.x86_64 153 kB/s | 25 kB 00:00 2024-02-07T12:14:40.317 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:40.317 INFO:teuthology.orchestra.run.smithi138.stdout:Total 152 kB/s | 25 kB 00:00 2024-02-07T12:14:40.317 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:14:40.320 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:14:40.320 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:14:40.322 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:14:40.322 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:14:40.400 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:14:40.466 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-mirror-17.2.7-491.gf2462625.el9.x86_64.rpm 5.0 MB/s | 2.9 MB 00:00 2024-02-07T12:14:40.503 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:40.503 INFO:teuthology.orchestra.run.smithi047.stdout:Total 5.0 MB/s | 2.9 MB 00:00 2024-02-07T12:14:40.503 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:14:40.503 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:14:40.503 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:14:40.514 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs-devel-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:40.553 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:14:40.553 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:14:40.951 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:14:41.042 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:41.065 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:41.065 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:14:41.066 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-07T12:14:41.066 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-07T12:14:41.066 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-07T12:14:41.066 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:41.224 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs-devel-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:41.224 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:41.224 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:14:41.224 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:41.225 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:41.225 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:41.408 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librados2 2024-02-07T12:14:41.976 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:42 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:42.082 INFO:teuthology.orchestra.run.smithi138.stdout:Package librados2-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:42.134 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:42.135 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-07T12:14:42.135 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:42.202 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librbd1 2024-02-07T12:14:42.375 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:42.376 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:42.376 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:14:42.376 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:42.376 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:42.376 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:42.595 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-nbd 2024-02-07T12:14:42.772 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:43 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:42.880 INFO:teuthology.orchestra.run.smithi138.stdout:Package librbd1-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:42.932 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:42.933 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-07T12:14:42.933 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:43.003 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rados 2024-02-07T12:14:43.184 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:44 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:43.351 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-02-07T12:14:43.352 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:43.353 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-02-07T12:14:43.353 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:43.353 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-02-07T12:14:43.353 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:17.2.7-491.gf2462625.el9 ceph 164 k 2024-02-07T12:14:43.353 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:43.353 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-02-07T12:14:43.353 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-02-07T12:14:43.353 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-02-07T12:14:43.353 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:43.353 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 164 k 2024-02-07T12:14:43.354 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 477 k 2024-02-07T12:14:43.354 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-02-07T12:14:43.575 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:44 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:43.578 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-nbd-17.2.7-491.gf2462625.el9.x86_64.rpm 730 kB/s | 164 kB 00:00 2024-02-07T12:14:43.580 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:43.580 INFO:teuthology.orchestra.run.smithi047.stdout:Total 725 kB/s | 164 kB 00:00 2024-02-07T12:14:43.580 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-02-07T12:14:43.588 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-02-07T12:14:43.588 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-02-07T12:14:43.651 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-02-07T12:14:43.651 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-02-07T12:14:43.682 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rados-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:43.734 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:43.735 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-07T12:14:43.735 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:43.806 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rgw 2024-02-07T12:14:43.810 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-02-07T12:14:43.905 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:44.366 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-nbd-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:44.374 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:45 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:44.482 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rgw-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:44.533 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:44.534 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-07T12:14:44.534 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:44.606 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-cephfs 2024-02-07T12:14:44.660 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:44.660 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:44.660 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-02-07T12:14:44.660 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:44.660 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:14:44.660 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-02-07T12:14:44.903 DEBUG:teuthology.parallel:result is None 2024-02-07T12:14:45.174 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:46 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:45.282 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-cephfs-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:45.334 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:45.335 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-07T12:14:45.335 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:45.404 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rbd 2024-02-07T12:14:45.973 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:46 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:46.080 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rbd-2:17.2.7-491.gf2462625.el9.x86_64 is already installed. 2024-02-07T12:14:46.132 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:46.133 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-07T12:14:46.133 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:46.210 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-fuse 2024-02-07T12:14:46.781 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:47 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:46.940 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:46.943 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:46.944 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-02-07T12:14:46.944 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:46.944 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:14:46.944 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse x86_64 2:17.2.7-491.gf2462625.el9 ceph 81 k 2024-02-07T12:14:46.944 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:46.944 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:14:46.944 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:46.944 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-07T12:14:46.944 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:46.944 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 81 k 2024-02-07T12:14:46.944 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 222 k 2024-02-07T12:14:46.944 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:14:47.162 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-fuse-17.2.7-491.gf2462625.el9.x86_64.rpm 371 kB/s | 81 kB 00:00 2024-02-07T12:14:47.162 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:47.163 INFO:teuthology.orchestra.run.smithi138.stdout:Total 369 kB/s | 81 kB 00:00 2024-02-07T12:14:47.163 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:14:47.169 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:14:47.169 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:14:47.223 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:14:47.224 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:14:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:14:47.453 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-fuse-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:47.901 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-fuse-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-fuse-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:48.232 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:14:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:48.232 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:48.474 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-mirror 2024-02-07T12:14:49.053 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:50 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:49.214 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:49.215 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:49.215 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-02-07T12:14:49.215 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:49.215 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:14:49.216 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror x86_64 2:17.2.7-491.gf2462625.el9 ceph 2.9 M 2024-02-07T12:14:49.216 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:49.216 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:14:49.216 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:49.216 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-07T12:14:49.216 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:49.216 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 2.9 M 2024-02-07T12:14:49.216 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 12 M 2024-02-07T12:14:49.216 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:14:50.102 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-mirror-17.2.7-491.gf2462625.el9.x86_64.rpm 3.3 MB/s | 2.9 MB 00:00 2024-02-07T12:14:50.102 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:50.102 INFO:teuthology.orchestra.run.smithi138.stdout:Total 3.3 MB/s | 2.9 MB 00:00 2024-02-07T12:14:50.102 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:14:50.111 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:14:50.112 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:14:50.184 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:14:50.184 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:14:50.591 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:14:50.652 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-mirror-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:50.676 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-mirror-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:50.676 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-07T12:14:50.676 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-07T12:14:50.676 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-07T12:14:50.677 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-07T12:14:50.677 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:51.889 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-mirror-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:51.889 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:51.889 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:14:51.890 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:51.890 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:51.890 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:52.169 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-nbd 2024-02-07T12:14:52.779 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:53 ago on Wed 07 Feb 2024 12:12:59 PM UTC. 2024-02-07T12:14:52.946 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-07T12:14:52.947 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:52.947 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-02-07T12:14:52.947 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:52.947 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-07T12:14:52.947 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd x86_64 2:17.2.7-491.gf2462625.el9 ceph 164 k 2024-02-07T12:14:52.947 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:52.948 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-07T12:14:52.948 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-07T12:14:52.948 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-07T12:14:52.948 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:52.948 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 164 k 2024-02-07T12:14:52.948 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 477 k 2024-02-07T12:14:52.948 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-07T12:14:53.192 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-nbd-17.2.7-491.gf2462625.el9.x86_64.rpm 674 kB/s | 164 kB 00:00 2024-02-07T12:14:53.193 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:14:53.193 INFO:teuthology.orchestra.run.smithi138.stdout:Total 670 kB/s | 164 kB 00:00 2024-02-07T12:14:53.193 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-07T12:14:53.201 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-07T12:14:53.202 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-07T12:14:53.263 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-07T12:14:53.264 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-07T12:14:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-07T12:14:53.540 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-nbd-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:54.033 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-nbd-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:54.304 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-nbd-2:17.2.7-491.gf2462625.el9.x86_64 1/1 2024-02-07T12:14:54.304 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:54.304 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-07T12:14:54.304 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd-2:17.2.7-491.gf2462625.el9.x86_64 2024-02-07T12:14:54.305 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:14:54.305 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-07T12:14:54.546 DEBUG:teuthology.parallel:result is None 2024-02-07T12:14:54.547 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-07T12:14:54.547 INFO:teuthology.packaging:ref: None 2024-02-07T12:14:54.547 INFO:teuthology.packaging:tag: None 2024-02-07T12:14:54.547 INFO:teuthology.packaging:branch: quincy 2024-02-07T12:14:54.547 INFO:teuthology.packaging:sha1: 44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:14:54.548 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-07T12:14:55.025 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-07T12:14:55.050 INFO:teuthology.orchestra.run.smithi047.stdout:17.2.7-491.gf2462625.el9 2024-02-07T12:14:55.050 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-491.gf2462625.el9 2024-02-07T12:14:55.050 INFO:teuthology.task.install:The correct ceph version 17.2.7-491.gf2462625 is installed. 2024-02-07T12:14:55.052 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-07T12:14:55.052 INFO:teuthology.packaging:ref: None 2024-02-07T12:14:55.052 INFO:teuthology.packaging:tag: None 2024-02-07T12:14:55.052 INFO:teuthology.packaging:branch: quincy 2024-02-07T12:14:55.052 INFO:teuthology.packaging:sha1: 44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:14:55.053 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-07T12:14:55.461 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-07T12:14:55.485 INFO:teuthology.orchestra.run.smithi138.stdout:17.2.7-491.gf2462625.el9 2024-02-07T12:14:55.485 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-491.gf2462625.el9 2024-02-07T12:14:55.485 INFO:teuthology.task.install:The correct ceph version 17.2.7-491.gf2462625 is installed. 2024-02-07T12:14:55.487 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-07T12:14:55.487 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:14:55.487 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-07T12:14:55.520 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:14:55.520 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-07T12:14:55.555 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-07T12:14:55.555 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:14:55.555 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-02-07T12:14:55.589 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-07T12:14:55.659 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:14:55.659 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-02-07T12:14:55.688 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-07T12:14:55.756 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-07T12:14:55.756 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:14:55.757 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-07T12:14:55.787 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-07T12:14:55.857 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:14:55.857 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-07T12:14:55.885 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-07T12:14:55.952 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-07T12:14:55.952 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:14:55.952 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-02-07T12:14:55.982 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-07T12:14:56.051 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:14:56.051 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-02-07T12:14:56.078 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-07T12:14:56.144 INFO:teuthology.run_tasks:Running task print... 2024-02-07T12:14:56.156 INFO:teuthology.task.print:**** done install task... 2024-02-07T12:14:56.156 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-07T12:14:56.257 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '44458ccedb18241cc2e17f10cdab3d1385399261'} 2024-02-07T12:14:56.257 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-02-07T12:14:56.258 INFO:tasks.cephadm:Cluster fsid is 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:14:56.258 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-07T12:14:56.258 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-07T12:14:56.258 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi047': '172.21.15.47', 'mon.smithi138': '172.21.15.138'} 2024-02-07T12:14:56.258 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-07T12:14:56.259 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname $(hostname -s) 2024-02-07T12:14:56.289 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname $(hostname -s) 2024-02-07T12:14:56.317 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-02-07T12:14:56.317 DEBUG:teuthology.orchestra.run.smithi047:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-07T12:14:56.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Feb 7 12:14 /home/ubuntu/cephtest/cephadm 2024-02-07T12:14:56.579 DEBUG:teuthology.orchestra.run.smithi138:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-07T12:14:56.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Feb 7 12:14 /home/ubuntu/cephtest/cephadm 2024-02-07T12:14:56.839 DEBUG:teuthology.orchestra.run.smithi047:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-07T12:14:56.857 DEBUG:teuthology.orchestra.run.smithi138:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-07T12:14:56.904 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-02-07T12:14:56.905 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-02-07T12:14:56.907 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-02-07T12:14:57.739 INFO:teuthology.orchestra.run.smithi047.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-07T12:14:57.774 INFO:teuthology.orchestra.run.smithi138.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-07T12:15:38.034 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:15:38.035 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)", 2024-02-07T12:15:38.035 INFO:teuthology.orchestra.run.smithi047.stdout: "image_id": "4ad3622d1b31cc9bcaa8023b70bab1260c9e94eb8a2a8350e337502ec38c7de2", 2024-02-07T12:15:38.035 INFO:teuthology.orchestra.run.smithi047.stdout: "repo_digests": [ 2024-02-07T12:15:38.035 INFO:teuthology.orchestra.run.smithi047.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255" 2024-02-07T12:15:38.035 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-02-07T12:15:38.035 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:15:44.118 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-07T12:15:44.118 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_version": "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)", 2024-02-07T12:15:44.118 INFO:teuthology.orchestra.run.smithi138.stdout: "image_id": "4ad3622d1b31cc9bcaa8023b70bab1260c9e94eb8a2a8350e337502ec38c7de2", 2024-02-07T12:15:44.118 INFO:teuthology.orchestra.run.smithi138.stdout: "repo_digests": [ 2024-02-07T12:15:44.118 INFO:teuthology.orchestra.run.smithi138.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255" 2024-02-07T12:15:44.118 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-02-07T12:15:44.118 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-07T12:15:44.139 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph 2024-02-07T12:15:44.175 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph 2024-02-07T12:15:44.206 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /etc/ceph 2024-02-07T12:15:44.246 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /etc/ceph 2024-02-07T12:15:44.274 INFO:tasks.cephadm:Writing seed config... 2024-02-07T12:15:44.275 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-02-07T12:15:44.275 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-02-07T12:15:44.275 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-07T12:15:44.275 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-07T12:15:44.275 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-07T12:15:44.275 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-07T12:15:44.275 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-07T12:15:44.275 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-07T12:15:44.276 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-07T12:15:44.276 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-07T12:15:44.276 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-07T12:15:44.276 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-07T12:15:44.276 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-07T12:15:44.276 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-07T12:15:44.276 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-07T12:15:44.276 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-07T12:15:44.276 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-07T12:15:44.276 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-07T12:15:44.276 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-07T12:15:44.277 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-07T12:15:44.278 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-07T12:15:44.278 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-07T12:15:44.278 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-07T12:15:44.278 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-07T12:15:44.278 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-07T12:15:44.278 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-07T12:15:44.278 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-07T12:15:44.279 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:15:44.280 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-07T12:15:44.302 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 818049ec-c5b2-11ee-95b6-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-07T12:15:44.303 DEBUG:teuthology.orchestra.run.smithi047:mon.smithi047> sudo journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi047.service 2024-02-07T12:15:44.345 INFO:tasks.cephadm:Bootstrapping... 2024-02-07T12:15:44.346 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.47 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-07T12:15:44.557 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-02-07T12:15:44.557 INFO:teuthology.orchestra.run.smithi047.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '818049ec-c5b2-11ee-95b6-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.47', '--skip-admin-label'] 2024-02-07T12:15:44.582 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-07T12:15:44.583 INFO:teuthology.orchestra.run.smithi047.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-07T12:15:44.583 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying podman|docker is present... 2024-02-07T12:15:44.606 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-07T12:15:44.606 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying lvm2 is present... 2024-02-07T12:15:44.606 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying time synchronization is in place... 2024-02-07T12:15:44.614 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-07T12:15:44.614 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-07T12:15:44.620 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-07T12:15:44.620 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-02-07T12:15:44.626 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-02-07T12:15:44.633 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-02-07T12:15:44.633 INFO:teuthology.orchestra.run.smithi047.stdout:Unit chronyd.service is enabled and running 2024-02-07T12:15:44.633 INFO:teuthology.orchestra.run.smithi047.stdout:Repeating the final host check... 2024-02-07T12:15:44.656 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-07T12:15:44.656 INFO:teuthology.orchestra.run.smithi047.stdout:podman (/bin/podman) version 4.9.3 is present 2024-02-07T12:15:44.656 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl is present 2024-02-07T12:15:44.656 INFO:teuthology.orchestra.run.smithi047.stdout:lvcreate is present 2024-02-07T12:15:44.662 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-07T12:15:44.662 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-07T12:15:44.668 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-07T12:15:44.669 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-02-07T12:15:44.675 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-02-07T12:15:44.681 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-02-07T12:15:44.681 INFO:teuthology.orchestra.run.smithi047.stdout:Unit chronyd.service is enabled and running 2024-02-07T12:15:44.681 INFO:teuthology.orchestra.run.smithi047.stdout:Host looks OK 2024-02-07T12:15:44.682 INFO:teuthology.orchestra.run.smithi047.stdout:Cluster fsid: 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:15:44.682 INFO:teuthology.orchestra.run.smithi047.stdout:Acquiring lock 140335255419392 on /run/cephadm/818049ec-c5b2-11ee-95b6-87774f69a715.lock 2024-02-07T12:15:44.682 INFO:teuthology.orchestra.run.smithi047.stdout:Lock 140335255419392 acquired on /run/cephadm/818049ec-c5b2-11ee-95b6-87774f69a715.lock 2024-02-07T12:15:44.682 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 3300 ... 2024-02-07T12:15:44.682 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 6789 ... 2024-02-07T12:15:44.682 INFO:teuthology.orchestra.run.smithi047.stdout:Base mon IP(s) is [172.21.15.47:3300, 172.21.15.47:6789], mon addrv is [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-02-07T12:15:44.686 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.47 metric 100 2024-02-07T12:15:44.686 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.47 metric 100 2024-02-07T12:15:44.688 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-07T12:15:44.688 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-02-07T12:15:44.689 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-02-07T12:15:44.691 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-07T12:15:44.691 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-07T12:15:44.691 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-07T12:15:44.691 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-02-07T12:15:44.691 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-02-07T12:15:44.692 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-07T12:15:44.692 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-02-07T12:15:44.692 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-02-07T12:15:44.693 INFO:teuthology.orchestra.run.smithi047.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-07T12:15:44.693 INFO:teuthology.orchestra.run.smithi047.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-07T12:15:44.693 INFO:teuthology.orchestra.run.smithi047.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-07T12:15:45.184 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 4ad3622d1b31cc9bcaa8023b70bab1260c9e94eb8a2a8350e337502ec38c7de2 2024-02-07T12:15:45.184 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-07T12:15:45.185 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Getting image source signatures 2024-02-07T12:15:45.185 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying blob sha256:7986c8dfa54a54c820b52ab07ff4d9bee4d15a07ae87f16eac3d2de58da2a00a 2024-02-07T12:15:45.185 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying blob sha256:58df4e03ba066accf3a7e07426bab5f1c867e27a139801c642bdafb42b9a2d9a 2024-02-07T12:15:45.185 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying config sha256:4ad3622d1b31cc9bcaa8023b70bab1260c9e94eb8a2a8350e337502ec38c7de2 2024-02-07T12:15:45.185 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Writing manifest to image destination 2024-02-07T12:15:54.099 INFO:teuthology.orchestra.run.smithi047.stdout:ceph: stdout ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable) 2024-02-07T12:15:54.099 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph version: ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable) 2024-02-07T12:15:54.099 INFO:teuthology.orchestra.run.smithi047.stdout:Extracting ceph user uid/gid from container image... 2024-02-07T12:15:56.392 INFO:teuthology.orchestra.run.smithi047.stdout:stat: stdout 167 167 2024-02-07T12:15:56.392 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial keys... 2024-02-07T12:15:57.397 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQB8dMNlXaqBKRAAikUiSVdPPLVEHrrhFdceWA== 2024-02-07T12:15:58.320 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQB9dMNlArVsKhAAQjtBtS4B7sGHZ65f9/19zA== 2024-02-07T12:15:59.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQB+dMNlKybJJRAAO3CXw1lWWzKpXSz9SgC1QQ== 2024-02-07T12:15:59.293 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial monmap... 2024-02-07T12:16:00.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-07T12:16:00.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-02-07T12:16:00.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:16:00.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-07T12:16:00.308 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool for smithi047 [v2:172.21.15.47:3300,v1:172.21.15.47:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-07T12:16:00.308 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = octopus 2024-02-07T12:16:00.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: set fsid to 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:16:00.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-07T12:16:00.308 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:16:00.308 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mon... 2024-02-07T12:16:02.280 INFO:teuthology.orchestra.run.smithi047.stdout:create mon.smithi047 on 2024-02-07T12:16:02.509 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-02-07T12:16:02.653 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-07T12:16:02.806 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-818049ec-c5b2-11ee-95b6-87774f69a715.target → /etc/systemd/system/ceph-818049ec-c5b2-11ee-95b6-87774f69a715.target. 2024-02-07T12:16:02.806 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-818049ec-c5b2-11ee-95b6-87774f69a715.target → /etc/systemd/system/ceph-818049ec-c5b2-11ee-95b6-87774f69a715.target. 2024-02-07T12:16:02.978 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi047 2024-02-07T12:16:02.978 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi047.service: Unit ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi047.service not loaded. 2024-02-07T12:16:03.151 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-818049ec-c5b2-11ee-95b6-87774f69a715.target.wants/ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi047.service → /etc/systemd/system/ceph-818049ec-c5b2-11ee-95b6-87774f69a715@.service. 2024-02-07T12:16:03.744 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-07T12:16:03.745 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-02-07T12:16:03.752 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-07T12:16:03.752 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-02-07T12:16:03.752 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-02-07T12:16:03.752 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-02-07T12:16:03.752 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon to start... 2024-02-07T12:16:03.752 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon... 2024-02-07T12:16:04.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:04 smithi047 ceph-mon[28600]: from='client.? 172.21.15.47:0/643557869' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-07T12:16:05.989 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout cluster: 2024-02-07T12:16:05.989 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout id: 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:16:05.989 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-07T12:16:05.989 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-02-07T12:16:05.989 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout services: 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi047 (age 0.56862s) 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout data: 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pgs: 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.170+0000 7ff01f7b8700 1 Processor -- start 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.170+0000 7ff01f7b8700 1 -- start start 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.170+0000 7ff01f7b8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 0x7ff018101a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:05.990 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.170+0000 7ff01f7b8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff018101f60 con 0x7ff018101610 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.170+0000 7ff01d554700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 0x7ff018101a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.171+0000 7ff01d554700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 0x7ff018101a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37404/0 (socket says 172.21.15.47:37404) 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.171+0000 7ff01d554700 1 -- 172.21.15.47:0/3939784925 learned_addr learned my addr 172.21.15.47:0/3939784925 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.171+0000 7ff01d554700 1 -- 172.21.15.47:0/3939784925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0181020a0 con 0x7ff018101610 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.171+0000 7ff01d554700 1 --2- 172.21.15.47:0/3939784925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 0x7ff018101a20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff0140098e0 tx=0x7ff014009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ccf4dfb08e7239 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.171+0000 7ff00ffff700 1 -- 172.21.15.47:0/3939784925 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff01400b860 con 0x7ff018101610 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.171+0000 7ff00ffff700 1 -- 172.21.15.47:0/3939784925 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01400b9c0 con 0x7ff018101610 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.171+0000 7ff00ffff700 1 -- 172.21.15.47:0/3939784925 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff01400bc90 con 0x7ff018101610 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.172+0000 7ff01f7b8700 1 -- 172.21.15.47:0/3939784925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 msgr2=0x7ff018101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.172+0000 7ff01f7b8700 1 --2- 172.21.15.47:0/3939784925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 0x7ff018101a20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff0140098e0 tx=0x7ff014009250 comp rx=0 tx=0).stop 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.172+0000 7ff01f7b8700 1 -- 172.21.15.47:0/3939784925 shutdown_connections 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.172+0000 7ff01f7b8700 1 --2- 172.21.15.47:0/3939784925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 0x7ff018101a20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.172+0000 7ff01f7b8700 1 -- 172.21.15.47:0/3939784925 >> 172.21.15.47:0/3939784925 conn(0x7ff0180fcd90 msgr2=0x7ff0180ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:05.991 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.172+0000 7ff01f7b8700 1 -- 172.21.15.47:0/3939784925 shutdown_connections 2024-02-07T12:16:05.992 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.172+0000 7ff01f7b8700 1 -- 172.21.15.47:0/3939784925 wait complete. 2024-02-07T12:16:05.992 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.172+0000 7ff01f7b8700 1 Processor -- start 2024-02-07T12:16:05.992 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.172+0000 7ff01f7b8700 1 -- start start 2024-02-07T12:16:05.992 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.173+0000 7ff01f7b8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 0x7ff018110d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:05.992 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.173+0000 7ff01f7b8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff018111280 con 0x7ff018101610 2024-02-07T12:16:05.992 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.173+0000 7ff01d554700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 0x7ff018110d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:05.992 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.173+0000 7ff01d554700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 0x7ff018110d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37418/0 (socket says 172.21.15.47:37418) 2024-02-07T12:16:05.992 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.173+0000 7ff01d554700 1 -- 172.21.15.47:0/643557869 learned_addr learned my addr 172.21.15.47:0/643557869 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:05.992 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.173+0000 7ff01d554700 1 -- 172.21.15.47:0/643557869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0140094f0 con 0x7ff018101610 2024-02-07T12:16:05.992 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.173+0000 7ff01d554700 1 --2- 172.21.15.47:0/643557869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 0x7ff018110d40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff014003080 tx=0x7ff014016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.173+0000 7ff00dffb700 1 -- 172.21.15.47:0/643557869 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff01401c5c0 con 0x7ff018101610 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.173+0000 7ff00dffb700 1 -- 172.21.15.47:0/643557869 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01401c720 con 0x7ff018101610 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.173+0000 7ff01f7b8700 1 -- 172.21.15.47:0/643557869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff018111480 con 0x7ff018101610 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.173+0000 7ff00dffb700 1 -- 172.21.15.47:0/643557869 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff01401ca30 con 0x7ff018101610 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.174+0000 7ff01f7b8700 1 -- 172.21.15.47:0/643557869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff018111fe0 con 0x7ff018101610 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.174+0000 7ff00dffb700 1 -- 172.21.15.47:0/643557869 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff01401a450 con 0x7ff018101610 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.174+0000 7ff00dffb700 1 -- 172.21.15.47:0/643557869 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff01402e790 con 0x7ff018101610 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.175+0000 7ff01f7b8700 1 -- 172.21.15.47:0/643557869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01805f5c0 con 0x7ff018101610 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.177+0000 7ff00dffb700 1 -- 172.21.15.47:0/643557869 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff01401a890 con 0x7ff018101610 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.249+0000 7ff01f7b8700 1 -- 172.21.15.47:0/643557869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ff018112a90 con 0x7ff018101610 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.249+0000 7ff00dffb700 1 -- 172.21.15.47:0/643557869 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+324 (secure 0 0 0) 0x7ff01401aa30 con 0x7ff018101610 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.249+0000 7ff01f7b8700 1 -- 172.21.15.47:0/643557869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 msgr2=0x7ff018110d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.249+0000 7ff01f7b8700 1 --2- 172.21.15.47:0/643557869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 0x7ff018110d40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff014003080 tx=0x7ff014016000 comp rx=0 tx=0).stop 2024-02-07T12:16:05.993 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.250+0000 7ff01f7b8700 1 -- 172.21.15.47:0/643557869 shutdown_connections 2024-02-07T12:16:05.994 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.250+0000 7ff01f7b8700 1 --2- 172.21.15.47:0/643557869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff018101610 0x7ff018110d40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:05.994 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.250+0000 7ff01f7b8700 1 -- 172.21.15.47:0/643557869 >> 172.21.15.47:0/643557869 conn(0x7ff0180fcd90 msgr2=0x7ff0180767f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:05.994 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.250+0000 7ff01f7b8700 1 -- 172.21.15.47:0/643557869 shutdown_connections 2024-02-07T12:16:05.994 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:04.250+0000 7ff01f7b8700 1 -- 172.21.15.47:0/643557869 wait complete. 2024-02-07T12:16:05.994 INFO:teuthology.orchestra.run.smithi047.stdout:mon is available 2024-02-07T12:16:05.994 INFO:teuthology.orchestra.run.smithi047.stdout:Assimilating anything we can from ceph.conf... 2024-02-07T12:16:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:06 smithi047 ceph-mon[28600]: from='client.? 172.21.15.47:0/3957421125' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-07T12:16:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:06 smithi047 ceph-mon[28600]: from='client.? 172.21.15.47:0/3957421125' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-07T12:16:07.054 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-02-07T12:16:07.054 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-02-07T12:16:07.054 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:16:07.054 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-07T12:16:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.389+0000 7f761011a700 1 Processor -- start 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.389+0000 7f761011a700 1 -- start start 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.390+0000 7f761011a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 0x7f7608102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.390+0000 7f761011a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76081030c0 con 0x7f7608102770 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.390+0000 7f760deb6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 0x7f7608102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.390+0000 7f760deb6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 0x7f7608102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37430/0 (socket says 172.21.15.47:37430) 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.390+0000 7f760deb6700 1 -- 172.21.15.47:0/765791859 learned_addr learned my addr 172.21.15.47:0/765791859 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.390+0000 7f760deb6700 1 -- 172.21.15.47:0/765791859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7608103200 con 0x7f7608102770 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.390+0000 7f760deb6700 1 --2- 172.21.15.47:0/765791859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 0x7f7608102b80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0098e0 tx=0x7f75fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67cdb26cc3c4cb95 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.391+0000 7f760ceb4700 1 -- 172.21.15.47:0/765791859 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75fc00b860 con 0x7f7608102770 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.391+0000 7f760ceb4700 1 -- 172.21.15.47:0/765791859 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc00b9c0 con 0x7f7608102770 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.391+0000 7f760ceb4700 1 -- 172.21.15.47:0/765791859 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75fc00bc90 con 0x7f7608102770 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.391+0000 7f761011a700 1 -- 172.21.15.47:0/765791859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 msgr2=0x7f7608102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:07.056 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.391+0000 7f761011a700 1 --2- 172.21.15.47:0/765791859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 0x7f7608102b80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0098e0 tx=0x7f75fc009250 comp rx=0 tx=0).stop 2024-02-07T12:16:07.057 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.391+0000 7f761011a700 1 -- 172.21.15.47:0/765791859 shutdown_connections 2024-02-07T12:16:07.057 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.391+0000 7f761011a700 1 --2- 172.21.15.47:0/765791859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 0x7f7608102b80 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:07.057 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.391+0000 7f761011a700 1 -- 172.21.15.47:0/765791859 >> 172.21.15.47:0/765791859 conn(0x7f76080fded0 msgr2=0x7f7608100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:07.057 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.391+0000 7f761011a700 1 -- 172.21.15.47:0/765791859 shutdown_connections 2024-02-07T12:16:07.057 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.391+0000 7f761011a700 1 -- 172.21.15.47:0/765791859 wait complete. 2024-02-07T12:16:07.057 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.392+0000 7f761011a700 1 Processor -- start 2024-02-07T12:16:07.057 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.392+0000 7f761011a700 1 -- start start 2024-02-07T12:16:07.057 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.392+0000 7f761011a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 0x7f7608078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:07.057 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.392+0000 7f761011a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7608077190 con 0x7f7608102770 2024-02-07T12:16:07.057 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.392+0000 7f760deb6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 0x7f7608078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:07.057 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.392+0000 7f760deb6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 0x7f7608078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37446/0 (socket says 172.21.15.47:37446) 2024-02-07T12:16:07.057 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.392+0000 7f760deb6700 1 -- 172.21.15.47:0/3957421125 learned_addr learned my addr 172.21.15.47:0/3957421125 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:07.057 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.392+0000 7f760deb6700 1 -- 172.21.15.47:0/3957421125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0094f0 con 0x7f7608102770 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.392+0000 7f760deb6700 1 --2- 172.21.15.47:0/3957421125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 0x7f7608078d10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f75fc003080 tx=0x7f75fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.393+0000 7f75fa7fc700 1 -- 172.21.15.47:0/3957421125 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75fc01c5c0 con 0x7f7608102770 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.393+0000 7f75fa7fc700 1 -- 172.21.15.47:0/3957421125 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc01c720 con 0x7f7608102770 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.393+0000 7f761011a700 1 -- 172.21.15.47:0/3957421125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7608077390 con 0x7f7608102770 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.393+0000 7f75fa7fc700 1 -- 172.21.15.47:0/3957421125 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75fc01ca30 con 0x7f7608102770 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.393+0000 7f761011a700 1 -- 172.21.15.47:0/3957421125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7608077820 con 0x7f7608102770 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.393+0000 7f75fa7fc700 1 -- 172.21.15.47:0/3957421125 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f75fc01a450 con 0x7f7608102770 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.393+0000 7f75fa7fc700 1 -- 172.21.15.47:0/3957421125 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f75fc02e790 con 0x7f7608102770 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.394+0000 7f761011a700 1 -- 172.21.15.47:0/3957421125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760810a640 con 0x7f7608102770 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.396+0000 7f75fa7fc700 1 -- 172.21.15.47:0/3957421125 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f75fc01a890 con 0x7f7608102770 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.465+0000 7f761011a700 1 -- 172.21.15.47:0/3957421125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f7608103b10 con 0x7f7608102770 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.468+0000 7f75fa7fc700 1 -- 172.21.15.47:0/3957421125 <== mon.0 v2:172.21.15.47:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f75fc01aa30 con 0x7f7608102770 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.468+0000 7f75fa7fc700 1 -- 172.21.15.47:0/3957421125 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f75fc024e30 con 0x7f7608102770 2024-02-07T12:16:07.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.469+0000 7f761011a700 1 -- 172.21.15.47:0/3957421125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 msgr2=0x7f7608078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:07.059 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.469+0000 7f761011a700 1 --2- 172.21.15.47:0/3957421125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 0x7f7608078d10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f75fc003080 tx=0x7f75fc016000 comp rx=0 tx=0).stop 2024-02-07T12:16:07.059 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.469+0000 7f761011a700 1 -- 172.21.15.47:0/3957421125 shutdown_connections 2024-02-07T12:16:07.059 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.469+0000 7f761011a700 1 --2- 172.21.15.47:0/3957421125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7608102770 0x7f7608078d10 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:07.059 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.469+0000 7f761011a700 1 -- 172.21.15.47:0/3957421125 >> 172.21.15.47:0/3957421125 conn(0x7f76080fded0 msgr2=0x7f76081054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:07.059 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.469+0000 7f761011a700 1 -- 172.21.15.47:0/3957421125 shutdown_connections 2024-02-07T12:16:07.059 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:06.469+0000 7f761011a700 1 -- 172.21.15.47:0/3957421125 wait complete. 2024-02-07T12:16:07.059 INFO:teuthology.orchestra.run.smithi047.stdout:Generating new minimal ceph.conf... 2024-02-07T12:16:08.189 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:07 smithi047 ceph-mon[28600]: from='client.? 172.21.15.47:0/3289708269' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:16:08.394 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.789+0000 7f2a80408700 1 Processor -- start 2024-02-07T12:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.789+0000 7f2a80408700 1 -- start start 2024-02-07T12:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.789+0000 7f2a80408700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 0x7f2a78102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.789+0000 7f2a80408700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a781030c0 con 0x7f2a78102770 2024-02-07T12:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.789+0000 7f2a7e1a4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 0x7f2a78102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.789+0000 7f2a7e1a4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 0x7f2a78102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37458/0 (socket says 172.21.15.47:37458) 2024-02-07T12:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.789+0000 7f2a7e1a4700 1 -- 172.21.15.47:0/2175447818 learned_addr learned my addr 172.21.15.47:0/2175447818 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:08.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.790+0000 7f2a7e1a4700 1 -- 172.21.15.47:0/2175447818 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a78103200 con 0x7f2a78102770 2024-02-07T12:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.790+0000 7f2a7e1a4700 1 --2- 172.21.15.47:0/2175447818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 0x7f2a78102b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2a700098e0 tx=0x7f2a70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241a4913e2fec277 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.790+0000 7f2a7d1a2700 1 -- 172.21.15.47:0/2175447818 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a7000b860 con 0x7f2a78102770 2024-02-07T12:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.790+0000 7f2a7d1a2700 1 -- 172.21.15.47:0/2175447818 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2a7000be50 con 0x7f2a78102770 2024-02-07T12:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.790+0000 7f2a7d1a2700 1 -- 172.21.15.47:0/2175447818 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a70010380 con 0x7f2a78102770 2024-02-07T12:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.791+0000 7f2a80408700 1 -- 172.21.15.47:0/2175447818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 msgr2=0x7f2a78102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.791+0000 7f2a80408700 1 --2- 172.21.15.47:0/2175447818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 0x7f2a78102b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2a700098e0 tx=0x7f2a70009250 comp rx=0 tx=0).stop 2024-02-07T12:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.791+0000 7f2a80408700 1 -- 172.21.15.47:0/2175447818 shutdown_connections 2024-02-07T12:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.791+0000 7f2a80408700 1 --2- 172.21.15.47:0/2175447818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 0x7f2a78102b80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.791+0000 7f2a80408700 1 -- 172.21.15.47:0/2175447818 >> 172.21.15.47:0/2175447818 conn(0x7f2a780fded0 msgr2=0x7f2a78100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.791+0000 7f2a80408700 1 -- 172.21.15.47:0/2175447818 shutdown_connections 2024-02-07T12:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.791+0000 7f2a80408700 1 -- 172.21.15.47:0/2175447818 wait complete. 2024-02-07T12:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.791+0000 7f2a80408700 1 Processor -- start 2024-02-07T12:16:08.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.791+0000 7f2a80408700 1 -- start start 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.792+0000 7f2a80408700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 0x7f2a78078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.792+0000 7f2a80408700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78077190 con 0x7f2a78102770 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.792+0000 7f2a7e1a4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 0x7f2a78078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.792+0000 7f2a7e1a4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 0x7f2a78078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37466/0 (socket says 172.21.15.47:37466) 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.792+0000 7f2a7e1a4700 1 -- 172.21.15.47:0/3289708269 learned_addr learned my addr 172.21.15.47:0/3289708269 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.792+0000 7f2a7e1a4700 1 -- 172.21.15.47:0/3289708269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a700094f0 con 0x7f2a78102770 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.792+0000 7f2a7e1a4700 1 --2- 172.21.15.47:0/3289708269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 0x7f2a78078d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000b440 tx=0x7f2a70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.792+0000 7f2a76ffd700 1 -- 172.21.15.47:0/3289708269 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a70010760 con 0x7f2a78102770 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.792+0000 7f2a76ffd700 1 -- 172.21.15.47:0/3289708269 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2a70010d50 con 0x7f2a78102770 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.792+0000 7f2a80408700 1 -- 172.21.15.47:0/3289708269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a78077390 con 0x7f2a78102770 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.792+0000 7f2a76ffd700 1 -- 172.21.15.47:0/3289708269 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a7001ae20 con 0x7f2a78102770 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.792+0000 7f2a80408700 1 -- 172.21.15.47:0/3289708269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a78077820 con 0x7f2a78102770 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.793+0000 7f2a76ffd700 1 -- 172.21.15.47:0/3289708269 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2a7002e6c0 con 0x7f2a78102770 2024-02-07T12:16:08.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.793+0000 7f2a76ffd700 1 -- 172.21.15.47:0/3289708269 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2a70024950 con 0x7f2a78102770 2024-02-07T12:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.793+0000 7f2a80408700 1 -- 172.21.15.47:0/3289708269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7804bed0 con 0x7f2a78102770 2024-02-07T12:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.795+0000 7f2a76ffd700 1 -- 172.21.15.47:0/3289708269 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2a70029070 con 0x7f2a78102770 2024-02-07T12:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.864+0000 7f2a80408700 1 -- 172.21.15.47:0/3289708269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f2a781045e0 con 0x7f2a78102770 2024-02-07T12:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.864+0000 7f2a76ffd700 1 -- 172.21.15.47:0/3289708269 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f2a7001a6a0 con 0x7f2a78102770 2024-02-07T12:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.865+0000 7f2a80408700 1 -- 172.21.15.47:0/3289708269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 msgr2=0x7f2a78078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.865+0000 7f2a80408700 1 --2- 172.21.15.47:0/3289708269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 0x7f2a78078d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000b440 tx=0x7f2a70009250 comp rx=0 tx=0).stop 2024-02-07T12:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.865+0000 7f2a80408700 1 -- 172.21.15.47:0/3289708269 shutdown_connections 2024-02-07T12:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.865+0000 7f2a80408700 1 --2- 172.21.15.47:0/3289708269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a78102770 0x7f2a78078d10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.865+0000 7f2a80408700 1 -- 172.21.15.47:0/3289708269 >> 172.21.15.47:0/3289708269 conn(0x7f2a780fded0 msgr2=0x7f2a780ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.865+0000 7f2a80408700 1 -- 172.21.15.47:0/3289708269 shutdown_connections 2024-02-07T12:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:07.865+0000 7f2a80408700 1 -- 172.21.15.47:0/3289708269 wait complete. 2024-02-07T12:16:08.403 INFO:teuthology.orchestra.run.smithi047.stdout:Restarting the monitor... 2024-02-07T12:16:08.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:08 smithi047 systemd[1]: Stopping Ceph mon.smithi047 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:16:09.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:08 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047[28596]: 2024-02-07T12:16:08.642+0000 7f78934ea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi047 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:16:09.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:08 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047[28596]: 2024-02-07T12:16:08.642+0000 7f78934ea700 -1 mon.smithi047@0(leader) e1 *** Got Signal Terminated *** 2024-02-07T12:16:09.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:08 smithi047 podman[28845]: 2024-02-07 12:16:08.786879855 +0000 UTC m=+0.228223564 container died 7a27168f1878ca7c7d6102796daedf2c3dc98d508cd10401be725508e673c917 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, RELEASE=quincy-f246262, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:16:09.296 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 podman[28845]: 2024-02-07 12:16:09.118579017 +0000 UTC m=+0.559922735 container cleanup 7a27168f1878ca7c7d6102796daedf2c3dc98d508cd10401be725508e673c917 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, RELEASE=quincy-f246262, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=) 2024-02-07T12:16:09.296 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 bash[28845]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047 2024-02-07T12:16:09.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 podman[28859]: 2024-02-07 12:16:09.294442078 +0000 UTC m=+0.512019592 container remove 7a27168f1878ca7c7d6102796daedf2c3dc98d508cd10401be725508e673c917 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=quincy-f246262, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:16:09.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi047.service: Deactivated successfully. 2024-02-07T12:16:09.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 systemd[1]: Stopped Ceph mon.smithi047 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:16:09.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 systemd[1]: Starting Ceph mon.smithi047 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:16:10.016 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 podman[28953]: 2024-02-07 12:16:09.74537091 +0000 UTC m=+0.113165064 container create 105826d9ef9abb56f3079127276e2cbc7b3c9b9c2f5d6e58fb991ee05937acea (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240131, RELEASE=quincy-f246262, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-07T12:16:10.016 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 podman[28953]: 2024-02-07 12:16:09.651028935 +0000 UTC m=+0.018823048 image pull 4ad3622d1b31cc9bcaa8023b70bab1260c9e94eb8a2a8350e337502ec38c7de2 quay.ceph.io/ceph-ci/ceph:quincy 2024-02-07T12:16:10.016 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 podman[28953]: 2024-02-07 12:16:09.939404832 +0000 UTC m=+0.307198937 container init 105826d9ef9abb56f3079127276e2cbc7b3c9b9c2f5d6e58fb991ee05937acea (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, RELEASE=quincy-f246262) 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 podman[28953]: 2024-02-07 12:16:09.942230363 +0000 UTC m=+0.310024468 container start 105826d9ef9abb56f3079127276e2cbc7b3c9b9c2f5d6e58fb991ee05937acea (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=quincy-f246262, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: set uid:gid to 167:167 (ceph:ceph) 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable), process ceph-mon, pid 2 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: pidfile_write: ignore empty --pid-file 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: load: jerasure load: lrc 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: RocksDB version: 6.15.5 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Compile date Feb 4 2024 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: DB SUMMARY 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: DB Session ID: CH1JDGPEVSTL9L2UOKS1 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: CURRENT file: CURRENT 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: IDENTITY file: IDENTITY 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi047/store.db dir, Total Num: 1, files: 000008.sst 2024-02-07T12:16:10.017 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi047/store.db: 000010.log size: 97276 ; 2024-02-07T12:16:10.018 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.error_if_exists: 0 2024-02-07T12:16:10.018 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.create_if_missing: 0 2024-02-07T12:16:10.018 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.paranoid_checks: 1 2024-02-07T12:16:10.018 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-07T12:16:10.018 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.env: 0x55de3ab26a80 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.fs: Posix File System 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.info_log: 0x55de3bb11cc0 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_file_opening_threads: 16 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.statistics: (nil) 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.use_fsync: 0 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_log_file_size: 0 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.keep_log_file_num: 1000 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.recycle_log_file_num: 0 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.allow_fallocate: 1 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.allow_mmap_reads: 0 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.allow_mmap_writes: 0 2024-02-07T12:16:10.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.use_direct_reads: 0 2024-02-07T12:16:10.020 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-07T12:16:10.020 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.create_missing_column_families: 0 2024-02-07T12:16:10.020 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.db_log_dir: 2024-02-07T12:16:10.020 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi047/store.db 2024-02-07T12:16:10.020 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-07T12:16:10.020 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-07T12:16:10.020 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-07T12:16:10.020 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-07T12:16:10.020 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-07T12:16:10.020 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-07T12:16:10.020 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.advise_random_on_open: 1 2024-02-07T12:16:10.020 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.db_write_buffer_size: 0 2024-02-07T12:16:10.020 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.write_buffer_manager: 0x55de3c886b40 2024-02-07T12:16:10.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-07T12:16:10.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-07T12:16:10.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-07T12:16:10.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-07T12:16:10.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.rate_limiter: (nil) 2024-02-07T12:16:10.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-07T12:16:10.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.wal_recovery_mode: 2 2024-02-07T12:16:10.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.enable_thread_tracking: 0 2024-02-07T12:16:10.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.enable_pipelined_write: 0 2024-02-07T12:16:10.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.unordered_write: 0 2024-02-07T12:16:10.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-07T12:16:10.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-07T12:16:10.021 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.row_cache: None 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.wal_filter: None 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.allow_ingest_behind: 0 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.preserve_deletes: 0 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.two_write_queues: 0 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.manual_wal_flush: 0 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.atomic_flush: 0 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.log_readahead_size: 0 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-07T12:16:10.022 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.best_efforts_recovery: 0 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.allow_data_in_errors: 0 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.db_host_id: __hostname__ 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_background_jobs: 2 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_background_compactions: -1 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_subcompactions: 1 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_total_wal_size: 0 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-07T12:16:10.023 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_open_files: -1 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.bytes_per_sync: 0 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compaction_readahead_size: 0 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_background_flushes: -1 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Compression algorithms supported: 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: kZSTD supported: 0 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: kXpressCompression supported: 0 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: kLZ4HCCompression supported: 1 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: kZlibCompression supported: 1 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: kSnappyCompression supported: 1 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: kLZ4Compression supported: 1 2024-02-07T12:16:10.024 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: kBZip2Compression supported: 0 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi047/store.db/MANIFEST-000009 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.merge_operator: 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compaction_filter: None 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compaction_filter_factory: None 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.sst_partitioner_factory: None 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55de3bb66f58) 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: cache_index_and_filter_blocks: 1 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-07T12:16:10.025 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: pin_top_level_index_and_filter: 1 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: index_type: 0 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: data_block_index_type: 0 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: index_shortening: 1 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: hash_index_allow_collision: 1 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: checksum: 1 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: no_block_cache: 0 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache: 0x55de3bb99090 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache_name: BinnedLRUCache 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache_options: 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: capacity : 536870912 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: num_shard_bits : 4 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: strict_capacity_limit : 0 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: high_pri_pool_ratio: 0.000 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache_compressed: (nil) 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: persistent_cache: (nil) 2024-02-07T12:16:10.026 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_size: 4096 2024-02-07T12:16:10.027 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_size_deviation: 10 2024-02-07T12:16:10.027 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_restart_interval: 16 2024-02-07T12:16:10.027 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: index_block_restart_interval: 1 2024-02-07T12:16:10.027 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: metadata_block_size: 4096 2024-02-07T12:16:10.027 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: partition_filters: 0 2024-02-07T12:16:10.027 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: use_delta_encoding: 1 2024-02-07T12:16:10.027 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-07T12:16:10.027 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: whole_key_filtering: 1 2024-02-07T12:16:10.027 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: verify_compression: 0 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: read_amp_bytes_per_bit: 0 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: format_version: 4 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: enable_index_compression: 1 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_align: 0 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.write_buffer_size: 33554432 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_write_buffer_number: 2 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compression: NoCompression 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.bottommost_compression: Disabled 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.prefix_extractor: nullptr 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.num_levels: 7 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-07T12:16:10.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compression_opts.level: 32767 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compression_opts.strategy: 0 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compression_opts.enabled: false 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-07T12:16:10.029 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-07T12:16:10.030 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.target_file_size_base: 67108864 2024-02-07T12:16:10.030 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-07T12:16:10.030 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-07T12:16:10.030 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-07T12:16:10.030 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-07T12:16:10.030 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-07T12:16:10.030 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-07T12:16:10.030 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-07T12:16:10.030 INFO:teuthology.orchestra.run.smithi047.stdout:Setting mon public_network to 172.21.0.0/20 2024-02-07T12:16:10.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-07T12:16:10.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-07T12:16:10.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-07T12:16:10.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-07T12:16:10.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-07T12:16:10.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-07T12:16:10.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.arena_block_size: 4194304 2024-02-07T12:16:10.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.disable_auto_compactions: 0 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.table_properties_collectors: 2024-02-07T12:16:10.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.inplace_update_support: 0 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.bloom_locality: 0 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.max_successive_merges: 0 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.paranoid_file_checks: 0 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.force_consistency_checks: 1 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.report_bg_io_stats: 0 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.ttl: 2592000 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.enable_blob_files: false 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.min_blob_size: 0 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.blob_file_size: 268435456 2024-02-07T12:16:10.033 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi047/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707308169967591, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707308169968366, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 92548, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 90643, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13356, "raw_average_key_size": 49, "raw_value_size": 83358, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 269, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1707308169, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "510a5f04-ded8-4e49-88be-c04557364a05", "db_session_id": "CH1JDGPEVSTL9L2UOKS1"}} 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707308169968710, "job": 1, "event": "recovery_finished"} 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi047/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55de3bb2d180 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: DB pointer 0x55de3bc02000 2024-02-07T12:16:10.034 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** DB Stats ** 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** Compaction Stats [default] ** 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: L0 2/0 92.18 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 171.0 0.00 0.00 1 0.001 0 0 2024-02-07T12:16:10.035 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Sum 2/0 92.18 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 171.0 0.00 0.00 1 0.001 0 0 2024-02-07T12:16:10.036 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 171.0 0.00 0.00 1 0.001 0 0 2024-02-07T12:16:10.036 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:16:10.036 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** Compaction Stats [default] ** 2024-02-07T12:16:10.036 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-07T12:16:10.036 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-07T12:16:10.036 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 171.0 0.00 0.00 1 0.001 0 0 2024-02-07T12:16:10.036 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-07T12:16:10.036 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-07T12:16:10.036 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-07T12:16:10.036 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-07T12:16:10.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-07T12:16:10.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-07T12:16:10.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative compaction: 0.00 GB write, 30.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-07T12:16:10.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval compaction: 0.00 GB write, 30.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-07T12:16:10.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-07T12:16:10.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:16:10.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-07T12:16:10.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:16:10.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** Compaction Stats [default] ** 2024-02-07T12:16:10.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-07T12:16:10.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-07T12:16:10.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: L0 2/0 92.18 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 171.0 0.00 0.00 1 0.001 0 0 2024-02-07T12:16:10.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Sum 2/0 92.18 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 171.0 0.00 0.00 1 0.001 0 0 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** Compaction Stats [default] ** 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 171.0 0.00 0.00 1 0.001 0 0 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative compaction: 0.00 GB write, 29.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-07T12:16:10.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: starting mon.smithi047 rank 0 at public addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] at bind addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi047 fsid 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: mon.smithi047@-1(???) e1 preinit fsid 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: mon.smithi047@-1(???).mds e1 new map 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: mon.smithi047@-1(???).mds e1 print_map 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: e1 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: legacy client fscid: -1 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: No filesystems configured 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: mon.smithi047@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: mon.smithi047@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: mon.smithi047@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-07T12:16:10.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: mon.smithi047@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-07T12:16:10.040 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:09 smithi047 ceph-mon[28972]: mon.smithi047@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-07T12:16:10.040 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:10 smithi047 bash[28953]: 105826d9ef9abb56f3079127276e2cbc7b3c9b9c2f5d6e58fb991ee05937acea 2024-02-07T12:16:10.040 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:10 smithi047 systemd[1]: Started Ceph mon.smithi047 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:16:10.286 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:10 smithi047 ceph-mon[28972]: mon.smithi047 is new leader, mons smithi047 in quorum (ranks 0) 2024-02-07T12:16:10.286 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:10 smithi047 ceph-mon[28972]: monmap e1: 1 mons at {smithi047=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-07T12:16:10.286 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:10 smithi047 ceph-mon[28972]: fsmap 2024-02-07T12:16:10.286 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:10 smithi047 ceph-mon[28972]: osdmap e1: 0 total, 0 up, 0 in 2024-02-07T12:16:10.286 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:10 smithi047 ceph-mon[28972]: mgrmap e1: no daemons active 2024-02-07T12:16:11.087 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.383+0000 7f01ebddf700 1 Processor -- start 2024-02-07T12:16:11.087 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.383+0000 7f01ebddf700 1 -- start start 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.383+0000 7f01ebddf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 0x7f01e41077a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.383+0000 7f01ebddf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e4103190 con 0x7f01e4076c00 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.384+0000 7f01e9b7b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 0x7f01e41077a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.384+0000 7f01e9b7b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 0x7f01e41077a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57188/0 (socket says 172.21.15.47:57188) 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.384+0000 7f01e9b7b700 1 -- 172.21.15.47:0/8947002 learned_addr learned my addr 172.21.15.47:0/8947002 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.384+0000 7f01e9b7b700 1 -- 172.21.15.47:0/8947002 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4107ce0 con 0x7f01e4076c00 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.384+0000 7f01e9b7b700 1 --2- 172.21.15.47:0/8947002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 0x7f01e41077a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f01e00098e0 tx=0x7f01e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3121523643430e server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.384+0000 7f01e8b79700 1 -- 172.21.15.47:0/8947002 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01e000b860 con 0x7f01e4076c00 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.385+0000 7f01e8b79700 1 -- 172.21.15.47:0/8947002 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f01e000be50 con 0x7f01e4076c00 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.385+0000 7f01e8b79700 1 -- 172.21.15.47:0/8947002 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01e0010380 con 0x7f01e4076c00 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.385+0000 7f01ebddf700 1 -- 172.21.15.47:0/8947002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 msgr2=0x7f01e41077a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.385+0000 7f01ebddf700 1 --2- 172.21.15.47:0/8947002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 0x7f01e41077a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f01e00098e0 tx=0x7f01e0009250 comp rx=0 tx=0).stop 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.385+0000 7f01ebddf700 1 -- 172.21.15.47:0/8947002 shutdown_connections 2024-02-07T12:16:11.088 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.385+0000 7f01ebddf700 1 --2- 172.21.15.47:0/8947002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 0x7f01e41077a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.385+0000 7f01ebddf700 1 -- 172.21.15.47:0/8947002 >> 172.21.15.47:0/8947002 conn(0x7f01e40fcdd0 msgr2=0x7f01e40ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.385+0000 7f01ebddf700 1 -- 172.21.15.47:0/8947002 shutdown_connections 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.385+0000 7f01ebddf700 1 -- 172.21.15.47:0/8947002 wait complete. 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.386+0000 7f01ebddf700 1 Processor -- start 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.386+0000 7f01ebddf700 1 -- start start 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.386+0000 7f01ebddf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 0x7f01e4113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.386+0000 7f01ebddf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e4113f90 con 0x7f01e4076c00 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.386+0000 7f01e9b7b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 0x7f01e4113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.386+0000 7f01e9b7b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 0x7f01e4113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57198/0 (socket says 172.21.15.47:57198) 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.386+0000 7f01e9b7b700 1 -- 172.21.15.47:0/3855286511 learned_addr learned my addr 172.21.15.47:0/3855286511 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.386+0000 7f01e9b7b700 1 -- 172.21.15.47:0/3855286511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e00094f0 con 0x7f01e4076c00 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.386+0000 7f01e9b7b700 1 --2- 172.21.15.47:0/3855286511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 0x7f01e4113a50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f01e0006d40 tx=0x7f01e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.387+0000 7f01da7fc700 1 -- 172.21.15.47:0/3855286511 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01e0010760 con 0x7f01e4076c00 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.387+0000 7f01ebddf700 1 -- 172.21.15.47:0/3855286511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e4114190 con 0x7f01e4076c00 2024-02-07T12:16:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.387+0000 7f01da7fc700 1 -- 172.21.15.47:0/3855286511 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f01e0010d50 con 0x7f01e4076c00 2024-02-07T12:16:11.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.387+0000 7f01da7fc700 1 -- 172.21.15.47:0/3855286511 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01e0024d20 con 0x7f01e4076c00 2024-02-07T12:16:11.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.387+0000 7f01ebddf700 1 -- 172.21.15.47:0/3855286511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e4114e30 con 0x7f01e4076c00 2024-02-07T12:16:11.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.387+0000 7f01da7fc700 1 -- 172.21.15.47:0/3855286511 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f01e002e6c0 con 0x7f01e4076c00 2024-02-07T12:16:11.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.387+0000 7f01da7fc700 1 -- 172.21.15.47:0/3855286511 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f01e001a940 con 0x7f01e4076c00 2024-02-07T12:16:11.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.388+0000 7f01ebddf700 1 -- 172.21.15.47:0/3855286511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e405f5c0 con 0x7f01e4076c00 2024-02-07T12:16:11.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.390+0000 7f01da7fc700 1 -- 172.21.15.47:0/3855286511 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f01e0029070 con 0x7f01e4076c00 2024-02-07T12:16:11.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.459+0000 7f01ebddf700 1 -- 172.21.15.47:0/3855286511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f01e404bed0 con 0x7f01e4076c00 2024-02-07T12:16:11.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.461+0000 7f01da7fc700 1 -- 172.21.15.47:0/3855286511 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f01e00108c0 con 0x7f01e4076c00 2024-02-07T12:16:11.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.462+0000 7f01ebddf700 1 -- 172.21.15.47:0/3855286511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 msgr2=0x7f01e4113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:11.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.462+0000 7f01ebddf700 1 --2- 172.21.15.47:0/3855286511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 0x7f01e4113a50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f01e0006d40 tx=0x7f01e0009250 comp rx=0 tx=0).stop 2024-02-07T12:16:11.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.462+0000 7f01ebddf700 1 -- 172.21.15.47:0/3855286511 shutdown_connections 2024-02-07T12:16:11.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.462+0000 7f01ebddf700 1 --2- 172.21.15.47:0/3855286511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e4076c00 0x7f01e4113a50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:11.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.462+0000 7f01ebddf700 1 -- 172.21.15.47:0/3855286511 >> 172.21.15.47:0/3855286511 conn(0x7f01e40fcdd0 msgr2=0x7f01e40fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:11.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.462+0000 7f01ebddf700 1 -- 172.21.15.47:0/3855286511 shutdown_connections 2024-02-07T12:16:11.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:10.462+0000 7f01ebddf700 1 -- 172.21.15.47:0/3855286511 wait complete. 2024-02-07T12:16:11.091 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-07T12:16:11.091 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-07T12:16:11.091 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mgr... 2024-02-07T12:16:11.091 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying port 9283 ... 2024-02-07T12:16:11.272 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mgr.smithi047.zhgnrm 2024-02-07T12:16:11.273 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mgr.smithi047.zhgnrm.service: Unit ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mgr.smithi047.zhgnrm.service not loaded. 2024-02-07T12:16:11.426 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-818049ec-c5b2-11ee-95b6-87774f69a715.target.wants/ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mgr.smithi047.zhgnrm.service → /etc/systemd/system/ceph-818049ec-c5b2-11ee-95b6-87774f69a715@.service. 2024-02-07T12:16:11.719 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:11 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3855286511' entity='client.admin' 2024-02-07T12:16:11.913 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-07T12:16:11.914 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-02-07T12:16:11.921 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-07T12:16:11.921 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-02-07T12:16:11.921 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-02-07T12:16:11.921 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-02-07T12:16:11.930 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-07T12:16:11.930 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-02-07T12:16:11.937 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-07T12:16:11.938 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-02-07T12:16:11.938 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-02-07T12:16:11.938 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-07T12:16:11.938 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr to start... 2024-02-07T12:16:11.938 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr... 2024-02-07T12:16:12.740 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:12 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3737002484' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-07T12:16:13.018 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-02-07T12:16:13.021 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-02-07T12:16:13.021 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "818049ec-c5b2-11ee-95b6-87774f69a715", 2024-02-07T12:16:13.021 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-02-07T12:16:13.021 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-07T12:16:13.021 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-07T12:16:13.021 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-07T12:16:13.021 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:13.021 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-07T12:16:13.021 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-07T12:16:13.021 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-02-07T12:16:13.021 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-02-07T12:16:13.021 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-07T12:16:13.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "smithi047" 2024-02-07T12:16:13.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-02-07T12:16:13.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-02-07T12:16:13.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-07T12:16:13.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:13.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-07T12:16:13.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-07T12:16:13.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:13.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-07T12:16:13.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:13.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-07T12:16:13.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-07T12:16:13.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-07T12:16:13.030 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-07T12:16:13.030 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-07T12:16:13.030 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-07T12:16:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:13.032 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-02-07T12:16:03.682634+0000", 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.332+0000 7f69f92cf700 1 Processor -- start 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.332+0000 7f69f92cf700 1 -- start start 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.333+0000 7f69f92cf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 0x7f69f4102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.333+0000 7f69f92cf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f41030c0 con 0x7f69f4102770 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.333+0000 7f69f2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 0x7f69f4102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.333+0000 7f69f2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 0x7f69f4102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57216/0 (socket says 172.21.15.47:57216) 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.333+0000 7f69f2ffd700 1 -- 172.21.15.47:0/3422486947 learned_addr learned my addr 172.21.15.47:0/3422486947 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.333+0000 7f69f2ffd700 1 -- 172.21.15.47:0/3422486947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4103200 con 0x7f69f4102770 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.333+0000 7f69f2ffd700 1 --2- 172.21.15.47:0/3422486947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 0x7f69f4102b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f69e40098e0 tx=0x7f69e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635790d4866e4912 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.334+0000 7f69f1ffb700 1 -- 172.21.15.47:0/3422486947 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69e400b860 con 0x7f69f4102770 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.334+0000 7f69f1ffb700 1 -- 172.21.15.47:0/3422486947 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f69e400be50 con 0x7f69f4102770 2024-02-07T12:16:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.334+0000 7f69f1ffb700 1 -- 172.21.15.47:0/3422486947 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69e4010380 con 0x7f69f4102770 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.334+0000 7f69f92cf700 1 -- 172.21.15.47:0/3422486947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 msgr2=0x7f69f4102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.334+0000 7f69f92cf700 1 --2- 172.21.15.47:0/3422486947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 0x7f69f4102b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f69e40098e0 tx=0x7f69e4009250 comp rx=0 tx=0).stop 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.334+0000 7f69f92cf700 1 -- 172.21.15.47:0/3422486947 shutdown_connections 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.334+0000 7f69f92cf700 1 --2- 172.21.15.47:0/3422486947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 0x7f69f4102b80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.334+0000 7f69f92cf700 1 -- 172.21.15.47:0/3422486947 >> 172.21.15.47:0/3422486947 conn(0x7f69f40fded0 msgr2=0x7f69f4100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.334+0000 7f69f92cf700 1 -- 172.21.15.47:0/3422486947 shutdown_connections 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.334+0000 7f69f92cf700 1 -- 172.21.15.47:0/3422486947 wait complete. 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.335+0000 7f69f92cf700 1 Processor -- start 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.335+0000 7f69f92cf700 1 -- start start 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.335+0000 7f69f92cf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 0x7f69f4111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.335+0000 7f69f92cf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f4111aa0 con 0x7f69f4102770 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.335+0000 7f69f2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 0x7f69f4111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.336+0000 7f69f2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 0x7f69f4111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57232/0 (socket says 172.21.15.47:57232) 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.336+0000 7f69f2ffd700 1 -- 172.21.15.47:0/3737002484 learned_addr learned my addr 172.21.15.47:0/3737002484 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:13.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.336+0000 7f69f2ffd700 1 -- 172.21.15.47:0/3737002484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e40094f0 con 0x7f69f4102770 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.336+0000 7f69f2ffd700 1 --2- 172.21.15.47:0/3737002484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 0x7f69f4111560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f69e4000c00 tx=0x7f69e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.336+0000 7f69db7fe700 1 -- 172.21.15.47:0/3737002484 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69e40107c0 con 0x7f69f4102770 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.336+0000 7f69db7fe700 1 -- 172.21.15.47:0/3737002484 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f69e4010db0 con 0x7f69f4102770 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.336+0000 7f69f92cf700 1 -- 172.21.15.47:0/3737002484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f4111ca0 con 0x7f69f4102770 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.336+0000 7f69db7fe700 1 -- 172.21.15.47:0/3737002484 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69e401ad00 con 0x7f69f4102770 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.336+0000 7f69f92cf700 1 -- 172.21.15.47:0/3737002484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f4112940 con 0x7f69f4102770 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.336+0000 7f69db7fe700 1 -- 172.21.15.47:0/3737002484 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f69e4024440 con 0x7f69f4102770 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.336+0000 7f69db7fe700 1 -- 172.21.15.47:0/3737002484 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f69e4019710 con 0x7f69f4102770 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.337+0000 7f69f92cf700 1 -- 172.21.15.47:0/3737002484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f405f5c0 con 0x7f69f4102770 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.339+0000 7f69db7fe700 1 -- 172.21.15.47:0/3737002484 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f69e40426d0 con 0x7f69f4102770 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.412+0000 7f69f92cf700 1 -- 172.21.15.47:0/3737002484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f69f41045e0 con 0x7f69f4102770 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.413+0000 7f69db7fe700 1 -- 172.21.15.47:0/3737002484 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f69e4031020 con 0x7f69f4102770 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.414+0000 7f69f92cf700 1 -- 172.21.15.47:0/3737002484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 msgr2=0x7f69f4111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.414+0000 7f69f92cf700 1 --2- 172.21.15.47:0/3737002484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 0x7f69f4111560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f69e4000c00 tx=0x7f69e4009250 comp rx=0 tx=0).stop 2024-02-07T12:16:13.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.414+0000 7f69f92cf700 1 -- 172.21.15.47:0/3737002484 shutdown_connections 2024-02-07T12:16:13.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.414+0000 7f69f92cf700 1 --2- 172.21.15.47:0/3737002484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f4102770 0x7f69f4111560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:13.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.414+0000 7f69f92cf700 1 -- 172.21.15.47:0/3737002484 >> 172.21.15.47:0/3737002484 conn(0x7f69f40fded0 msgr2=0x7f69f40ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:13.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.414+0000 7f69f92cf700 1 -- 172.21.15.47:0/3737002484 shutdown_connections 2024-02-07T12:16:13.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:12.414+0000 7f69f92cf700 1 -- 172.21.15.47:0/3737002484 wait complete. 2024-02-07T12:16:13.036 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (1/15)... 2024-02-07T12:16:16.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:15 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3311486101' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-07T12:16:16.168 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-02-07T12:16:16.168 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-02-07T12:16:16.168 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "818049ec-c5b2-11ee-95b6-87774f69a715", 2024-02-07T12:16:16.168 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-02-07T12:16:16.168 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-07T12:16:16.168 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "smithi047" 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-07T12:16:16.169 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:16.170 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-07T12:16:16.170 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:16.170 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-07T12:16:16.170 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-07T12:16:16.170 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-07T12:16:16.177 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-07T12:16:16.178 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:16.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-02-07T12:16:03.682634+0000", 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.472+0000 7f89332b0700 1 Processor -- start 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.473+0000 7f89332b0700 1 -- start start 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.473+0000 7f89332b0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 0x7f892c077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.473+0000 7f89332b0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892c079110 con 0x7f892c078d00 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.473+0000 7f893104c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 0x7f892c077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.473+0000 7f893104c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 0x7f892c077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57238/0 (socket says 172.21.15.47:57238) 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.473+0000 7f893104c700 1 -- 172.21.15.47:0/295375619 learned_addr learned my addr 172.21.15.47:0/295375619 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.473+0000 7f893104c700 1 -- 172.21.15.47:0/295375619 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c077750 con 0x7f892c078d00 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.474+0000 7f893104c700 1 --2- 172.21.15.47:0/295375619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 0x7f892c077210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f89280098e0 tx=0x7f8928009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc23f51c090138a server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:16.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.474+0000 7f8923fff700 1 -- 172.21.15.47:0/295375619 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f892800b860 con 0x7f892c078d00 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.474+0000 7f8923fff700 1 -- 172.21.15.47:0/295375619 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f892800be50 con 0x7f892c078d00 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.474+0000 7f8923fff700 1 -- 172.21.15.47:0/295375619 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8928010380 con 0x7f892c078d00 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.474+0000 7f89332b0700 1 -- 172.21.15.47:0/295375619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 msgr2=0x7f892c077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.474+0000 7f89332b0700 1 --2- 172.21.15.47:0/295375619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 0x7f892c077210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f89280098e0 tx=0x7f8928009250 comp rx=0 tx=0).stop 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.474+0000 7f89332b0700 1 -- 172.21.15.47:0/295375619 shutdown_connections 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.474+0000 7f89332b0700 1 --2- 172.21.15.47:0/295375619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 0x7f892c077210 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.474+0000 7f89332b0700 1 -- 172.21.15.47:0/295375619 >> 172.21.15.47:0/295375619 conn(0x7f892c0fded0 msgr2=0x7f892c100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.475+0000 7f89332b0700 1 -- 172.21.15.47:0/295375619 shutdown_connections 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.475+0000 7f89332b0700 1 -- 172.21.15.47:0/295375619 wait complete. 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.475+0000 7f89332b0700 1 Processor -- start 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.475+0000 7f89332b0700 1 -- start start 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.475+0000 7f89332b0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 0x7f892c113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.475+0000 7f89332b0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892c113c80 con 0x7f892c078d00 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.475+0000 7f893104c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 0x7f892c113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.475+0000 7f893104c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 0x7f892c113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57248/0 (socket says 172.21.15.47:57248) 2024-02-07T12:16:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.475+0000 7f893104c700 1 -- 172.21.15.47:0/3311486101 learned_addr learned my addr 172.21.15.47:0/3311486101 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.476+0000 7f893104c700 1 -- 172.21.15.47:0/3311486101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280094f0 con 0x7f892c078d00 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.476+0000 7f893104c700 1 --2- 172.21.15.47:0/3311486101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 0x7f892c113740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8928006d40 tx=0x7f8928009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.476+0000 7f8921ffb700 1 -- 172.21.15.47:0/3311486101 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8928010760 con 0x7f892c078d00 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.476+0000 7f8921ffb700 1 -- 172.21.15.47:0/3311486101 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f8928010d50 con 0x7f892c078d00 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.476+0000 7f89332b0700 1 -- 172.21.15.47:0/3311486101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f892c113e80 con 0x7f892c078d00 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.476+0000 7f8921ffb700 1 -- 172.21.15.47:0/3311486101 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8928024d20 con 0x7f892c078d00 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.476+0000 7f89332b0700 1 -- 172.21.15.47:0/3311486101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892c114b20 con 0x7f892c078d00 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.476+0000 7f8921ffb700 1 -- 172.21.15.47:0/3311486101 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f892802e6c0 con 0x7f892c078d00 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.477+0000 7f8921ffb700 1 -- 172.21.15.47:0/3311486101 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f892801a8f0 con 0x7f892c078d00 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.477+0000 7f89332b0700 1 -- 172.21.15.47:0/3311486101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f892c05f5c0 con 0x7f892c078d00 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.481+0000 7f8921ffb700 1 -- 172.21.15.47:0/3311486101 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8928029070 con 0x7f892c078d00 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.555+0000 7f89332b0700 1 -- 172.21.15.47:0/3311486101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f892c108a70 con 0x7f892c078d00 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.555+0000 7f8921ffb700 1 -- 172.21.15.47:0/3311486101 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f89280108c0 con 0x7f892c078d00 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.556+0000 7f89332b0700 1 -- 172.21.15.47:0/3311486101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 msgr2=0x7f892c113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:16.182 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.556+0000 7f89332b0700 1 --2- 172.21.15.47:0/3311486101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 0x7f892c113740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8928006d40 tx=0x7f8928009250 comp rx=0 tx=0).stop 2024-02-07T12:16:16.183 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.557+0000 7f89332b0700 1 -- 172.21.15.47:0/3311486101 shutdown_connections 2024-02-07T12:16:16.183 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.557+0000 7f89332b0700 1 --2- 172.21.15.47:0/3311486101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f892c078d00 0x7f892c113740 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:16.183 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.557+0000 7f89332b0700 1 -- 172.21.15.47:0/3311486101 >> 172.21.15.47:0/3311486101 conn(0x7f892c0fded0 msgr2=0x7f892c0ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:16.183 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.557+0000 7f89332b0700 1 -- 172.21.15.47:0/3311486101 shutdown_connections 2024-02-07T12:16:16.183 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:15.557+0000 7f89332b0700 1 -- 172.21.15.47:0/3311486101 wait complete. 2024-02-07T12:16:16.183 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (2/15)... 2024-02-07T12:16:18.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:18 smithi047 ceph-mon[28972]: Activating manager daemon smithi047.zhgnrm 2024-02-07T12:16:18.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:18 smithi047 ceph-mon[28972]: mgrmap e2: smithi047.zhgnrm(active, starting, since 0.00271135s) 2024-02-07T12:16:18.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:18 smithi047 ceph-mon[28972]: from='mgr.14100 172.21.15.47:0/1880116774' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-07T12:16:18.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:18 smithi047 ceph-mon[28972]: from='mgr.14100 172.21.15.47:0/1880116774' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-07T12:16:18.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:18 smithi047 ceph-mon[28972]: from='mgr.14100 172.21.15.47:0/1880116774' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-07T12:16:18.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:18 smithi047 ceph-mon[28972]: from='mgr.14100 172.21.15.47:0/1880116774' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:16:18.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:18 smithi047 ceph-mon[28972]: from='mgr.14100 172.21.15.47:0/1880116774' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi047.zhgnrm", "id": "smithi047.zhgnrm"}]: dispatch 2024-02-07T12:16:18.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:18 smithi047 ceph-mon[28972]: Manager daemon smithi047.zhgnrm is now available 2024-02-07T12:16:18.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:18 smithi047 ceph-mon[28972]: from='mgr.14100 172.21.15.47:0/1880116774' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/mirror_snapshot_schedule"}]: dispatch 2024-02-07T12:16:18.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:18 smithi047 ceph-mon[28972]: from='mgr.14100 172.21.15.47:0/1880116774' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:18.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:18 smithi047 ceph-mon[28972]: from='mgr.14100 172.21.15.47:0/1880116774' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/trash_purge_schedule"}]: dispatch 2024-02-07T12:16:18.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:18 smithi047 ceph-mon[28972]: from='mgr.14100 172.21.15.47:0/1880116774' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:18.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:18 smithi047 ceph-mon[28972]: from='mgr.14100 172.21.15.47:0/1880116774' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:19.216 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-02-07T12:16:19.216 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-02-07T12:16:19.216 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "818049ec-c5b2-11ee-95b6-87774f69a715", 2024-02-07T12:16:19.216 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-02-07T12:16:19.216 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-07T12:16:19.216 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-07T12:16:19.216 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-07T12:16:19.216 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:19.216 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-07T12:16:19.216 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-07T12:16:19.216 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "smithi047" 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-07T12:16:19.217 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-07T12:16:19.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-07T12:16:19.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-07T12:16:19.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-07T12:16:19.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:19.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-07T12:16:19.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-07T12:16:19.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-07T12:16:19.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-07T12:16:19.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-07T12:16:19.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-02-07T12:16:03.682634+0000", 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.582+0000 7f7aff577700 1 Processor -- start 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.582+0000 7f7aff577700 1 -- start start 2024-02-07T12:16:19.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.582+0000 7f7aff577700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 0x7f7af8102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.582+0000 7f7aff577700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af81030c0 con 0x7f7af8102770 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.582+0000 7f7afd313700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 0x7f7af8102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.582+0000 7f7afd313700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 0x7f7af8102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57314/0 (socket says 172.21.15.47:57314) 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.582+0000 7f7afd313700 1 -- 172.21.15.47:0/1804517488 learned_addr learned my addr 172.21.15.47:0/1804517488 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.583+0000 7f7afd313700 1 -- 172.21.15.47:0/1804517488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af8103200 con 0x7f7af8102770 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.583+0000 7f7afd313700 1 --2- 172.21.15.47:0/1804517488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 0x7f7af8102b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7af40098e0 tx=0x7f7af4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6aa194bb830975 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.583+0000 7f7aeffff700 1 -- 172.21.15.47:0/1804517488 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7af400b860 con 0x7f7af8102770 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.584+0000 7f7aeffff700 1 -- 172.21.15.47:0/1804517488 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7af400be50 con 0x7f7af8102770 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.584+0000 7f7aeffff700 1 -- 172.21.15.47:0/1804517488 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7af4010380 con 0x7f7af8102770 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.584+0000 7f7aff577700 1 -- 172.21.15.47:0/1804517488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 msgr2=0x7f7af8102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.584+0000 7f7aff577700 1 --2- 172.21.15.47:0/1804517488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 0x7f7af8102b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7af40098e0 tx=0x7f7af4009250 comp rx=0 tx=0).stop 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.584+0000 7f7aff577700 1 -- 172.21.15.47:0/1804517488 shutdown_connections 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.584+0000 7f7aff577700 1 --2- 172.21.15.47:0/1804517488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 0x7f7af8102b80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.584+0000 7f7aff577700 1 -- 172.21.15.47:0/1804517488 >> 172.21.15.47:0/1804517488 conn(0x7f7af80fded0 msgr2=0x7f7af8100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:19.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.584+0000 7f7aff577700 1 -- 172.21.15.47:0/1804517488 shutdown_connections 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.584+0000 7f7aff577700 1 -- 172.21.15.47:0/1804517488 wait complete. 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.585+0000 7f7aff577700 1 Processor -- start 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.585+0000 7f7aff577700 1 -- start start 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.585+0000 7f7aff577700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 0x7f7af8111500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.585+0000 7f7aff577700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af8111a40 con 0x7f7af8102770 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.585+0000 7f7afd313700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 0x7f7af8111500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.585+0000 7f7afd313700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 0x7f7af8111500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57330/0 (socket says 172.21.15.47:57330) 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.585+0000 7f7afd313700 1 -- 172.21.15.47:0/748049074 learned_addr learned my addr 172.21.15.47:0/748049074 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.585+0000 7f7afd313700 1 -- 172.21.15.47:0/748049074 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af40094f0 con 0x7f7af8102770 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.586+0000 7f7afd313700 1 --2- 172.21.15.47:0/748049074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 0x7f7af8111500 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7af400b440 tx=0x7f7af4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.586+0000 7f7aedffb700 1 -- 172.21.15.47:0/748049074 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7af4010760 con 0x7f7af8102770 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.586+0000 7f7aff577700 1 -- 172.21.15.47:0/748049074 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af8111c40 con 0x7f7af8102770 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.586+0000 7f7aedffb700 1 -- 172.21.15.47:0/748049074 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7af4010d50 con 0x7f7af8102770 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.586+0000 7f7aedffb700 1 -- 172.21.15.47:0/748049074 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7af4024d80 con 0x7f7af8102770 2024-02-07T12:16:19.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.586+0000 7f7aff577700 1 -- 172.21.15.47:0/748049074 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af81128e0 con 0x7f7af8102770 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.587+0000 7f7aedffb700 1 -- 172.21.15.47:0/748049074 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 2) v1 ==== 43037+0+0 (secure 0 0 0) 0x7f7af401a450 con 0x7f7af8102770 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.587+0000 7f7aff577700 1 -- 172.21.15.47:0/748049074 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af805f5c0 con 0x7f7af8102770 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.587+0000 7f7aedffb700 1 -- 172.21.15.47:0/748049074 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7af404a030 con 0x7f7af8102770 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.589+0000 7f7aedffb700 1 -- 172.21.15.47:0/748049074 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7af401a700 con 0x7f7af8102770 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.661+0000 7f7aff577700 1 -- 172.21.15.47:0/748049074 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7af804bed0 con 0x7f7af8102770 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.661+0000 7f7aedffb700 1 -- 172.21.15.47:0/748049074 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f7af402c3a0 con 0x7f7af8102770 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.662+0000 7f7aff577700 1 -- 172.21.15.47:0/748049074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 msgr2=0x7f7af8111500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.662+0000 7f7aff577700 1 --2- 172.21.15.47:0/748049074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 0x7f7af8111500 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7af400b440 tx=0x7f7af4009250 comp rx=0 tx=0).stop 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.662+0000 7f7aff577700 1 -- 172.21.15.47:0/748049074 shutdown_connections 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.662+0000 7f7aff577700 1 --2- 172.21.15.47:0/748049074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7af8102770 0x7f7af8111500 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.662+0000 7f7aff577700 1 -- 172.21.15.47:0/748049074 >> 172.21.15.47:0/748049074 conn(0x7f7af80fded0 msgr2=0x7f7af80fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.663+0000 7f7aff577700 1 -- 172.21.15.47:0/748049074 shutdown_connections 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:18.663+0000 7f7aff577700 1 -- 172.21.15.47:0/748049074 wait complete. 2024-02-07T12:16:19.231 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (3/15)... 2024-02-07T12:16:20.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:19 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/748049074' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-07T12:16:20.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:19 smithi047 ceph-mon[28972]: mgrmap e3: smithi047.zhgnrm(active, since 1.0071s) 2024-02-07T12:16:22.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:21 smithi047 ceph-mon[28972]: mgrmap e4: smithi047.zhgnrm(active, since 2s) 2024-02-07T12:16:22.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:21 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1334170046' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-07T12:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-02-07T12:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-02-07T12:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "818049ec-c5b2-11ee-95b6-87774f69a715", 2024-02-07T12:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-02-07T12:16:22.456 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "smithi047" 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-07T12:16:22.457 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-07T12:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-07T12:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-07T12:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-07T12:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-07T12:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-07T12:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-07T12:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-07T12:16:22.458 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-07T12:16:22.459 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-02-07T12:16:03.682634+0000", 2024-02-07T12:16:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.600+0000 7f9e0e821700 1 Processor -- start 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.600+0000 7f9e0e821700 1 -- start start 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.600+0000 7f9e0e821700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 0x7f9e08102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.600+0000 7f9e0e821700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e081030d0 con 0x7f9e08102780 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.600+0000 7f9e07fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 0x7f9e08102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.600+0000 7f9e07fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 0x7f9e08102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36874/0 (socket says 172.21.15.47:36874) 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.600+0000 7f9e07fff700 1 -- 172.21.15.47:0/221433020 learned_addr learned my addr 172.21.15.47:0/221433020 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.600+0000 7f9e07fff700 1 -- 172.21.15.47:0/221433020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e08103210 con 0x7f9e08102780 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.601+0000 7f9e07fff700 1 --2- 172.21.15.47:0/221433020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 0x7f9e08102b90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9df80098e0 tx=0x7f9df8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f51c4d9456091ed server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.601+0000 7f9e06ffd700 1 -- 172.21.15.47:0/221433020 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df800b860 con 0x7f9e08102780 2024-02-07T12:16:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.601+0000 7f9e06ffd700 1 -- 172.21.15.47:0/221433020 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9df800be50 con 0x7f9e08102780 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.601+0000 7f9e06ffd700 1 -- 172.21.15.47:0/221433020 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df8010380 con 0x7f9e08102780 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.601+0000 7f9e0e821700 1 -- 172.21.15.47:0/221433020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 msgr2=0x7f9e08102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.601+0000 7f9e0e821700 1 --2- 172.21.15.47:0/221433020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 0x7f9e08102b90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9df80098e0 tx=0x7f9df8009250 comp rx=0 tx=0).stop 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.601+0000 7f9e0e821700 1 -- 172.21.15.47:0/221433020 shutdown_connections 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.601+0000 7f9e0e821700 1 --2- 172.21.15.47:0/221433020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 0x7f9e08102b90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.601+0000 7f9e0e821700 1 -- 172.21.15.47:0/221433020 >> 172.21.15.47:0/221433020 conn(0x7f9e080fdf00 msgr2=0x7f9e08100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.601+0000 7f9e0e821700 1 -- 172.21.15.47:0/221433020 shutdown_connections 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.602+0000 7f9e0e821700 1 -- 172.21.15.47:0/221433020 wait complete. 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.602+0000 7f9e0e821700 1 Processor -- start 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.602+0000 7f9e0e821700 1 -- start start 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.602+0000 7f9e0e821700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 0x7f9e08111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.602+0000 7f9e0e821700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e08111aa0 con 0x7f9e08102780 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.603+0000 7f9e07fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 0x7f9e08111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:22.462 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.603+0000 7f9e07fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 0x7f9e08111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36878/0 (socket says 172.21.15.47:36878) 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.603+0000 7f9e07fff700 1 -- 172.21.15.47:0/1334170046 learned_addr learned my addr 172.21.15.47:0/1334170046 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.603+0000 7f9e07fff700 1 -- 172.21.15.47:0/1334170046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80094f0 con 0x7f9e08102780 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.603+0000 7f9e07fff700 1 --2- 172.21.15.47:0/1334170046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 0x7f9e08111560 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9df800b440 tx=0x7f9df8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.603+0000 7f9e04ff9700 1 -- 172.21.15.47:0/1334170046 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df8010760 con 0x7f9e08102780 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.603+0000 7f9e0e821700 1 -- 172.21.15.47:0/1334170046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e08111ca0 con 0x7f9e08102780 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.603+0000 7f9e04ff9700 1 -- 172.21.15.47:0/1334170046 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9df8010d50 con 0x7f9e08102780 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.603+0000 7f9e04ff9700 1 -- 172.21.15.47:0/1334170046 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df801ae20 con 0x7f9e08102780 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.603+0000 7f9e0e821700 1 -- 172.21.15.47:0/1334170046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e08112940 con 0x7f9e08102780 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.604+0000 7f9e04ff9700 1 -- 172.21.15.47:0/1334170046 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f9df802e440 con 0x7f9e08102780 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.604+0000 7f9e04ff9700 1 --2- 172.21.15.47:0/1334170046 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f9df0036580 0x7f9df0038a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.604+0000 7f9e04ff9700 1 -- 172.21.15.47:0/1334170046 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9df804a4d0 con 0x7f9e08102780 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.604+0000 7f9e0e821700 1 -- 172.21.15.47:0/1334170046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0805f5c0 con 0x7f9e08102780 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.604+0000 7f9e077fe700 1 --2- 172.21.15.47:0/1334170046 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f9df0036580 0x7f9df0038a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:22.463 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.605+0000 7f9e077fe700 1 --2- 172.21.15.47:0/1334170046 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f9df0036580 0x7f9df0038a30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009990 tx=0x7f9dfc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.609+0000 7f9e04ff9700 1 -- 172.21.15.47:0/1334170046 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9df8018940 con 0x7f9e08102780 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.878+0000 7f9e0e821700 1 -- 172.21.15.47:0/1334170046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9e08112b80 con 0x7f9e08102780 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.878+0000 7f9e04ff9700 1 -- 172.21.15.47:0/1334170046 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f9df8018350 con 0x7f9e08102780 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.880+0000 7f9e0e821700 1 -- 172.21.15.47:0/1334170046 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f9df0036580 msgr2=0x7f9df0038a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.880+0000 7f9e0e821700 1 --2- 172.21.15.47:0/1334170046 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f9df0036580 0x7f9df0038a30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009990 tx=0x7f9dfc006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.880+0000 7f9e0e821700 1 -- 172.21.15.47:0/1334170046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 msgr2=0x7f9e08111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.880+0000 7f9e0e821700 1 --2- 172.21.15.47:0/1334170046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 0x7f9e08111560 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9df800b440 tx=0x7f9df8009250 comp rx=0 tx=0).stop 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.880+0000 7f9e0e821700 1 -- 172.21.15.47:0/1334170046 shutdown_connections 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.880+0000 7f9e0e821700 1 --2- 172.21.15.47:0/1334170046 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f9df0036580 0x7f9df0038a30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.880+0000 7f9e0e821700 1 --2- 172.21.15.47:0/1334170046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e08102780 0x7f9e08111560 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.880+0000 7f9e0e821700 1 -- 172.21.15.47:0/1334170046 >> 172.21.15.47:0/1334170046 conn(0x7f9e080fdf00 msgr2=0x7f9e080fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.880+0000 7f9e0e821700 1 -- 172.21.15.47:0/1334170046 shutdown_connections 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:21.880+0000 7f9e0e821700 1 -- 172.21.15.47:0/1334170046 wait complete. 2024-02-07T12:16:22.464 INFO:teuthology.orchestra.run.smithi047.stdout:mgr is available 2024-02-07T12:16:23.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:23 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2155796968' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-07T12:16:23.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-02-07T12:16:23.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-02-07T12:16:23.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:16:23.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-07T12:16:23.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-07T12:16:23.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-07T12:16:23.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-07T12:16:23.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-02-07T12:16:23.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-07T12:16:23.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-07T12:16:23.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-02-07T12:16:23.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.825+0000 7fdf33de0700 1 Processor -- start 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.825+0000 7fdf33de0700 1 -- start start 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.825+0000 7fdf33de0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 0x7fdf2c102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.825+0000 7fdf33de0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c1030c0 con 0x7fdf2c102770 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.825+0000 7fdf31b7c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 0x7fdf2c102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.825+0000 7fdf31b7c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 0x7fdf2c102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36888/0 (socket says 172.21.15.47:36888) 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.825+0000 7fdf31b7c700 1 -- 172.21.15.47:0/3392198857 learned_addr learned my addr 172.21.15.47:0/3392198857 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.825+0000 7fdf31b7c700 1 -- 172.21.15.47:0/3392198857 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c103200 con 0x7fdf2c102770 2024-02-07T12:16:23.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.826+0000 7fdf31b7c700 1 --2- 172.21.15.47:0/3392198857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 0x7fdf2c102b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdf280098e0 tx=0x7fdf28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e6d40adf3b423f server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.826+0000 7fdf30b7a700 1 -- 172.21.15.47:0/3392198857 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf2800b860 con 0x7fdf2c102770 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.826+0000 7fdf30b7a700 1 -- 172.21.15.47:0/3392198857 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdf2800be50 con 0x7fdf2c102770 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.826+0000 7fdf30b7a700 1 -- 172.21.15.47:0/3392198857 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf28010380 con 0x7fdf2c102770 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.826+0000 7fdf33de0700 1 -- 172.21.15.47:0/3392198857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 msgr2=0x7fdf2c102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.826+0000 7fdf33de0700 1 --2- 172.21.15.47:0/3392198857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 0x7fdf2c102b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdf280098e0 tx=0x7fdf28009250 comp rx=0 tx=0).stop 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.826+0000 7fdf33de0700 1 -- 172.21.15.47:0/3392198857 shutdown_connections 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.826+0000 7fdf33de0700 1 --2- 172.21.15.47:0/3392198857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 0x7fdf2c102b80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.826+0000 7fdf33de0700 1 -- 172.21.15.47:0/3392198857 >> 172.21.15.47:0/3392198857 conn(0x7fdf2c0fded0 msgr2=0x7fdf2c100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.826+0000 7fdf33de0700 1 -- 172.21.15.47:0/3392198857 shutdown_connections 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.827+0000 7fdf33de0700 1 -- 172.21.15.47:0/3392198857 wait complete. 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.827+0000 7fdf33de0700 1 Processor -- start 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.827+0000 7fdf33de0700 1 -- start start 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.827+0000 7fdf33de0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 0x7fdf2c111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.827+0000 7fdf33de0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c111aa0 con 0x7fdf2c102770 2024-02-07T12:16:23.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.827+0000 7fdf31b7c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 0x7fdf2c111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.827+0000 7fdf31b7c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 0x7fdf2c111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36900/0 (socket says 172.21.15.47:36900) 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.827+0000 7fdf31b7c700 1 -- 172.21.15.47:0/2155796968 learned_addr learned my addr 172.21.15.47:0/2155796968 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.827+0000 7fdf31b7c700 1 -- 172.21.15.47:0/2155796968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf280094f0 con 0x7fdf2c102770 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.828+0000 7fdf31b7c700 1 --2- 172.21.15.47:0/2155796968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 0x7fdf2c111560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf28000c00 tx=0x7fdf28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.828+0000 7fdf227fc700 1 -- 172.21.15.47:0/2155796968 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf280107c0 con 0x7fdf2c102770 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.828+0000 7fdf227fc700 1 -- 172.21.15.47:0/2155796968 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdf28010db0 con 0x7fdf2c102770 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.828+0000 7fdf33de0700 1 -- 172.21.15.47:0/2155796968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c111ca0 con 0x7fdf2c102770 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.828+0000 7fdf227fc700 1 -- 172.21.15.47:0/2155796968 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf2801ad00 con 0x7fdf2c102770 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.828+0000 7fdf33de0700 1 -- 172.21.15.47:0/2155796968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c112940 con 0x7fdf2c102770 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.829+0000 7fdf227fc700 1 -- 172.21.15.47:0/2155796968 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fdf280193c0 con 0x7fdf2c102770 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.829+0000 7fdf33de0700 1 -- 172.21.15.47:0/2155796968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2c05f5c0 con 0x7fdf2c102770 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.829+0000 7fdf227fc700 1 --2- 172.21.15.47:0/2155796968 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7fdf180365f0 0x7fdf18038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.829+0000 7fdf227fc700 1 -- 172.21.15.47:0/2155796968 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdf2804a3d0 con 0x7fdf2c102770 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.829+0000 7fdf3137b700 1 --2- 172.21.15.47:0/2155796968 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7fdf180365f0 0x7fdf18038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.829+0000 7fdf3137b700 1 --2- 172.21.15.47:0/2155796968 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7fdf180365f0 0x7fdf18038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009990 tx=0x7fdf1c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:22.834+0000 7fdf227fc700 1 -- 172.21.15.47:0/2155796968 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdf2802c3a0 con 0x7fdf2c102770 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:23.022+0000 7fdf33de0700 1 -- 172.21.15.47:0/2155796968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fdf2c04bed0 con 0x7fdf2c102770 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:23.023+0000 7fdf227fc700 1 -- 172.21.15.47:0/2155796968 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fdf28018c70 con 0x7fdf2c102770 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:23.025+0000 7fdf33de0700 1 -- 172.21.15.47:0/2155796968 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7fdf180365f0 msgr2=0x7fdf18038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:23.025+0000 7fdf33de0700 1 --2- 172.21.15.47:0/2155796968 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7fdf180365f0 0x7fdf18038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009990 tx=0x7fdf1c006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:23.025+0000 7fdf33de0700 1 -- 172.21.15.47:0/2155796968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 msgr2=0x7fdf2c111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:23.025+0000 7fdf33de0700 1 --2- 172.21.15.47:0/2155796968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 0x7fdf2c111560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf28000c00 tx=0x7fdf28009250 comp rx=0 tx=0).stop 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:23.025+0000 7fdf33de0700 1 -- 172.21.15.47:0/2155796968 shutdown_connections 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:23.025+0000 7fdf33de0700 1 --2- 172.21.15.47:0/2155796968 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7fdf180365f0 0x7fdf18038aa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:23.025+0000 7fdf33de0700 1 --2- 172.21.15.47:0/2155796968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2c102770 0x7fdf2c111560 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:23.025+0000 7fdf33de0700 1 -- 172.21.15.47:0/2155796968 >> 172.21.15.47:0/2155796968 conn(0x7fdf2c0fded0 msgr2=0x7fdf2c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:23.025+0000 7fdf33de0700 1 -- 172.21.15.47:0/2155796968 shutdown_connections 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:23.025+0000 7fdf33de0700 1 -- 172.21.15.47:0/2155796968 wait complete. 2024-02-07T12:16:23.620 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling cephadm module... 2024-02-07T12:16:24.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:24 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2013292547' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-07T12:16:24.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.025+0000 7fbcc4c6d700 1 Processor -- start 2024-02-07T12:16:24.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.025+0000 7fbcc4c6d700 1 -- start start 2024-02-07T12:16:24.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.025+0000 7fbcc4c6d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 0x7fbcc0103180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:24.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.025+0000 7fbcc4c6d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc01036c0 con 0x7fbcc0102d70 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.025+0000 7fbcbe59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 0x7fbcc0103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.026+0000 7fbcbe59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 0x7fbcc0103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36912/0 (socket says 172.21.15.47:36912) 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.026+0000 7fbcbe59c700 1 -- 172.21.15.47:0/3277016841 learned_addr learned my addr 172.21.15.47:0/3277016841 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.026+0000 7fbcbe59c700 1 -- 172.21.15.47:0/3277016841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc0103800 con 0x7fbcc0102d70 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.026+0000 7fbcbe59c700 1 --2- 172.21.15.47:0/3277016841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 0x7fbcc0103180 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80098e0 tx=0x7fbcb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bdf8b89d3461c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.026+0000 7fbcbd59a700 1 -- 172.21.15.47:0/3277016841 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbcb800b8f0 con 0x7fbcc0102d70 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.026+0000 7fbcbd59a700 1 -- 172.21.15.47:0/3277016841 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbcb8011420 con 0x7fbcc0102d70 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.026+0000 7fbcbd59a700 1 -- 172.21.15.47:0/3277016841 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbcb8010540 con 0x7fbcc0102d70 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.027+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/3277016841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 msgr2=0x7fbcc0103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.027+0000 7fbcc4c6d700 1 --2- 172.21.15.47:0/3277016841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 0x7fbcc0103180 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80098e0 tx=0x7fbcb8009250 comp rx=0 tx=0).stop 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.027+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/3277016841 shutdown_connections 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.027+0000 7fbcc4c6d700 1 --2- 172.21.15.47:0/3277016841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 0x7fbcc0103180 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.027+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/3277016841 >> 172.21.15.47:0/3277016841 conn(0x7fbcc00fc580 msgr2=0x7fbcc00fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.027+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/3277016841 shutdown_connections 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.027+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/3277016841 wait complete. 2024-02-07T12:16:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.027+0000 7fbcc4c6d700 1 Processor -- start 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.028+0000 7fbcc4c6d700 1 -- start start 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.028+0000 7fbcc4c6d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 0x7fbcc0113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.028+0000 7fbcc4c6d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc0113ff0 con 0x7fbcc0102d70 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.028+0000 7fbcbe59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 0x7fbcc0113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.028+0000 7fbcbe59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 0x7fbcc0113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36924/0 (socket says 172.21.15.47:36924) 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.028+0000 7fbcbe59c700 1 -- 172.21.15.47:0/2013292547 learned_addr learned my addr 172.21.15.47:0/2013292547 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.028+0000 7fbcbe59c700 1 -- 172.21.15.47:0/2013292547 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb80094f0 con 0x7fbcc0102d70 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.028+0000 7fbcbe59c700 1 --2- 172.21.15.47:0/2013292547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 0x7fbcc0113ab0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8006b00 tx=0x7fbcb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.028+0000 7fbcb6ffd700 1 -- 172.21.15.47:0/2013292547 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbcb80107b0 con 0x7fbcc0102d70 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.028+0000 7fbcb6ffd700 1 -- 172.21.15.47:0/2013292547 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbcb8010da0 con 0x7fbcc0102d70 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.028+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/2013292547 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc01141f0 con 0x7fbcc0102d70 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.028+0000 7fbcb6ffd700 1 -- 172.21.15.47:0/2013292547 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbcb801aea0 con 0x7fbcc0102d70 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.029+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/2013292547 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc0114e90 con 0x7fbcc0102d70 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.029+0000 7fbcb6ffd700 1 -- 172.21.15.47:0/2013292547 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fbcb8010910 con 0x7fbcc0102d70 2024-02-07T12:16:24.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.030+0000 7fbcb6ffd700 1 --2- 172.21.15.47:0/2013292547 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7fbcac0365f0 0x7fbcac038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.030+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/2013292547 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc005f5c0 con 0x7fbcc0102d70 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.030+0000 7fbcb6ffd700 1 -- 172.21.15.47:0/2013292547 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbcb804a9d0 con 0x7fbcc0102d70 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.030+0000 7fbcbdd9b700 1 --2- 172.21.15.47:0/2013292547 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7fbcac0365f0 0x7fbcac038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.030+0000 7fbcbdd9b700 1 --2- 172.21.15.47:0/2013292547 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7fbcac0365f0 0x7fbcac038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009990 tx=0x7fbca8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.035+0000 7fbcb6ffd700 1 -- 172.21.15.47:0/2013292547 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbcb802d3e0 con 0x7fbcc0102d70 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.278+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/2013292547 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fbcc004bed0 con 0x7fbcc0102d70 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.331+0000 7fbcb6ffd700 1 -- 172.21.15.47:0/2013292547 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fbcb802ece0 con 0x7fbcc0102d70 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.332+0000 7fbcb6ffd700 1 -- 172.21.15.47:0/2013292547 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fbcb8018350 con 0x7fbcc0102d70 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.334+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/2013292547 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7fbcac0365f0 msgr2=0x7fbcac038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.334+0000 7fbcc4c6d700 1 --2- 172.21.15.47:0/2013292547 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7fbcac0365f0 0x7fbcac038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009990 tx=0x7fbca8006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.334+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/2013292547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 msgr2=0x7fbcc0113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.334+0000 7fbcc4c6d700 1 --2- 172.21.15.47:0/2013292547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 0x7fbcc0113ab0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8006b00 tx=0x7fbcb8009250 comp rx=0 tx=0).stop 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.334+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/2013292547 shutdown_connections 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.334+0000 7fbcc4c6d700 1 --2- 172.21.15.47:0/2013292547 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7fbcac0365f0 0x7fbcac038aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.334+0000 7fbcc4c6d700 1 --2- 172.21.15.47:0/2013292547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcc0102d70 0x7fbcc0113ab0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:24.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.334+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/2013292547 >> 172.21.15.47:0/2013292547 conn(0x7fbcc00fc580 msgr2=0x7fbcc00fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:24.916 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.334+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/2013292547 shutdown_connections 2024-02-07T12:16:24.916 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:24.335+0000 7fbcc4c6d700 1 -- 172.21.15.47:0/2013292547 wait complete. 2024-02-07T12:16:25.567 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:25 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2013292547' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-07T12:16:25.567 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:25 smithi047 ceph-mon[28972]: mgrmap e5: smithi047.zhgnrm(active, since 5s) 2024-02-07T12:16:26.395 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-02-07T12:16:26.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-07T12:16:26.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-07T12:16:26.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "smithi047.zhgnrm", 2024-02-07T12:16:26.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-07T12:16:26.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-02-07T12:16:26.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.360+0000 7f11331ae700 1 Processor -- start 2024-02-07T12:16:26.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.360+0000 7f11331ae700 1 -- start start 2024-02-07T12:16:26.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.360+0000 7f11331ae700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 0x7f112c105340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:26.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.360+0000 7f11331ae700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c105880 con 0x7f112c0714c0 2024-02-07T12:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.360+0000 7f1130f4a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 0x7f112c105340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.360+0000 7f1130f4a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 0x7f112c105340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36944/0 (socket says 172.21.15.47:36944) 2024-02-07T12:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.360+0000 7f1130f4a700 1 -- 172.21.15.47:0/4209680447 learned_addr learned my addr 172.21.15.47:0/4209680447 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.360+0000 7f1130f4a700 1 -- 172.21.15.47:0/4209680447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c1059c0 con 0x7f112c0714c0 2024-02-07T12:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.361+0000 7f1130f4a700 1 --2- 172.21.15.47:0/4209680447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 0x7f112c105340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f11200098e0 tx=0x7f1120009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0bc2ad3607272d server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.361+0000 7f112b7fe700 1 -- 172.21.15.47:0/4209680447 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f112000b860 con 0x7f112c0714c0 2024-02-07T12:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.361+0000 7f112b7fe700 1 -- 172.21.15.47:0/4209680447 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f112000be50 con 0x7f112c0714c0 2024-02-07T12:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.361+0000 7f112b7fe700 1 -- 172.21.15.47:0/4209680447 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1120010380 con 0x7f112c0714c0 2024-02-07T12:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.361+0000 7f11331ae700 1 -- 172.21.15.47:0/4209680447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 msgr2=0x7f112c105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.361+0000 7f11331ae700 1 --2- 172.21.15.47:0/4209680447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 0x7f112c105340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f11200098e0 tx=0x7f1120009250 comp rx=0 tx=0).stop 2024-02-07T12:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.361+0000 7f11331ae700 1 -- 172.21.15.47:0/4209680447 shutdown_connections 2024-02-07T12:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.361+0000 7f11331ae700 1 --2- 172.21.15.47:0/4209680447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 0x7f112c105340 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:26.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.361+0000 7f11331ae700 1 -- 172.21.15.47:0/4209680447 >> 172.21.15.47:0/4209680447 conn(0x7f112c0fcdd0 msgr2=0x7f112c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:26.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.362+0000 7f11331ae700 1 -- 172.21.15.47:0/4209680447 shutdown_connections 2024-02-07T12:16:26.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.362+0000 7f11331ae700 1 -- 172.21.15.47:0/4209680447 wait complete. 2024-02-07T12:16:26.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.362+0000 7f11331ae700 1 Processor -- start 2024-02-07T12:16:26.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.362+0000 7f11331ae700 1 -- start start 2024-02-07T12:16:26.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.362+0000 7f11331ae700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 0x7f112c111580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:26.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.362+0000 7f11331ae700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c111ac0 con 0x7f112c0714c0 2024-02-07T12:16:26.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.363+0000 7f1130f4a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 0x7f112c111580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:26.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.363+0000 7f1130f4a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 0x7f112c111580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36958/0 (socket says 172.21.15.47:36958) 2024-02-07T12:16:26.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.363+0000 7f1130f4a700 1 -- 172.21.15.47:0/2538128017 learned_addr learned my addr 172.21.15.47:0/2538128017 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:26.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.363+0000 7f1130f4a700 1 -- 172.21.15.47:0/2538128017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11200094f0 con 0x7f112c0714c0 2024-02-07T12:16:26.400 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.363+0000 7f1130f4a700 1 --2- 172.21.15.47:0/2538128017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 0x7f112c111580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1120006b00 tx=0x7f1120009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.363+0000 7f11297fa700 1 -- 172.21.15.47:0/2538128017 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11200107c0 con 0x7f112c0714c0 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.363+0000 7f11297fa700 1 -- 172.21.15.47:0/2538128017 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f1120010db0 con 0x7f112c0714c0 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.363+0000 7f11331ae700 1 -- 172.21.15.47:0/2538128017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112c111cc0 con 0x7f112c0714c0 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.363+0000 7f11297fa700 1 -- 172.21.15.47:0/2538128017 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f112001acf0 con 0x7f112c0714c0 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.363+0000 7f11331ae700 1 -- 172.21.15.47:0/2538128017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112c112960 con 0x7f112c0714c0 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.364+0000 7f11297fa700 1 -- 172.21.15.47:0/2538128017 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f11200193c0 con 0x7f112c0714c0 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.364+0000 7f11297fa700 1 --2- 172.21.15.47:0/2538128017 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f111c0365f0 0x7f111c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.364+0000 7f11297fa700 1 -- 172.21.15.47:0/2538128017 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f112004a440 con 0x7f112c0714c0 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.364+0000 7f112bfff700 1 -- 172.21.15.47:0/2538128017 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f111c0365f0 msgr2=0x7f111c038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2169341238 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.364+0000 7f11331ae700 1 -- 172.21.15.47:0/2538128017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112c05f5c0 con 0x7f112c0714c0 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.364+0000 7f112bfff700 1 --2- 172.21.15.47:0/2538128017 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f111c0365f0 0x7f111c038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.369+0000 7f11297fa700 1 -- 172.21.15.47:0/2538128017 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f11200196c0 con 0x7f112c0714c0 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.565+0000 7f112bfff700 1 -- 172.21.15.47:0/2538128017 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f111c0365f0 msgr2=0x7f111c038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2169341238 2024-02-07T12:16:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.565+0000 7f112bfff700 1 --2- 172.21.15.47:0/2538128017 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f111c0365f0 0x7f111c038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.616+0000 7f11331ae700 1 -- 172.21.15.47:0/2538128017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f112c113430 con 0x7f112c0714c0 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.616+0000 7f11297fa700 1 -- 172.21.15.47:0/2538128017 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f112002b350 con 0x7f112c0714c0 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.619+0000 7f11331ae700 1 -- 172.21.15.47:0/2538128017 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f111c0365f0 msgr2=0x7f111c038aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.619+0000 7f11331ae700 1 --2- 172.21.15.47:0/2538128017 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f111c0365f0 0x7f111c038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.619+0000 7f11331ae700 1 -- 172.21.15.47:0/2538128017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 msgr2=0x7f112c111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.619+0000 7f11331ae700 1 --2- 172.21.15.47:0/2538128017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 0x7f112c111580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1120006b00 tx=0x7f1120009250 comp rx=0 tx=0).stop 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.619+0000 7f11331ae700 1 -- 172.21.15.47:0/2538128017 shutdown_connections 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.619+0000 7f11331ae700 1 --2- 172.21.15.47:0/2538128017 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f111c0365f0 0x7f111c038aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.619+0000 7f11331ae700 1 --2- 172.21.15.47:0/2538128017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f112c0714c0 0x7f112c111580 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.619+0000 7f11331ae700 1 -- 172.21.15.47:0/2538128017 >> 172.21.15.47:0/2538128017 conn(0x7f112c0fcdd0 msgr2=0x7f112c0fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.619+0000 7f11331ae700 1 -- 172.21.15.47:0/2538128017 shutdown_connections 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:25.619+0000 7f11331ae700 1 -- 172.21.15.47:0/2538128017 wait complete. 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-02-07T12:16:26.402 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 5... 2024-02-07T12:16:26.482 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:26 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2538128017' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-07T12:16:31.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:30 smithi047 ceph-mon[28972]: Active manager daemon smithi047.zhgnrm restarted 2024-02-07T12:16:31.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:30 smithi047 ceph-mon[28972]: Activating manager daemon smithi047.zhgnrm 2024-02-07T12:16:32.292 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: osdmap e2: 0 total, 0 up, 0 in 2024-02-07T12:16:32.292 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: mgrmap e6: smithi047.zhgnrm(active, starting, since 0.00313618s) 2024-02-07T12:16:32.292 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:16:32.293 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi047.zhgnrm", "id": "smithi047.zhgnrm"}]: dispatch 2024-02-07T12:16:32.293 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-07T12:16:32.293 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-07T12:16:32.293 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-07T12:16:32.293 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: Manager daemon smithi047.zhgnrm is now available 2024-02-07T12:16:32.293 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: Found migration_current of "None". Setting to last migration. 2024-02-07T12:16:32.293 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:32.293 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:32.293 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:16:32.293 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:16:32.293 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:16:32.294 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/mirror_snapshot_schedule"}]: dispatch 2024-02-07T12:16:32.294 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:31 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/trash_purge_schedule"}]: dispatch 2024-02-07T12:16:32.569 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-02-07T12:16:32.570 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-07T12:16:32.570 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-07T12:16:32.570 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-02-07T12:16:32.570 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.812+0000 7f3e01b82700 1 Processor -- start 2024-02-07T12:16:32.570 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.812+0000 7f3e01b82700 1 -- start start 2024-02-07T12:16:32.570 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.813+0000 7f3e01b82700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 0x7f3dfc105340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:32.570 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.813+0000 7f3e01b82700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc105880 con 0x7f3dfc0714c0 2024-02-07T12:16:32.570 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.813+0000 7f3dfb7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 0x7f3dfc105340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:32.570 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.813+0000 7f3dfb7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 0x7f3dfc105340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36968/0 (socket says 172.21.15.47:36968) 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.813+0000 7f3dfb7fe700 1 -- 172.21.15.47:0/146259433 learned_addr learned my addr 172.21.15.47:0/146259433 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.813+0000 7f3dfb7fe700 1 -- 172.21.15.47:0/146259433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc1059c0 con 0x7f3dfc0714c0 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.813+0000 7f3dfb7fe700 1 --2- 172.21.15.47:0/146259433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 0x7f3dfc105340 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0098e0 tx=0x7f3dec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a97066bf7f17c25 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.813+0000 7f3dfa7fc700 1 -- 172.21.15.47:0/146259433 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3dec00b860 con 0x7f3dfc0714c0 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.813+0000 7f3dfa7fc700 1 -- 172.21.15.47:0/146259433 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3dec00be50 con 0x7f3dfc0714c0 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.813+0000 7f3dfa7fc700 1 -- 172.21.15.47:0/146259433 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3dec010380 con 0x7f3dfc0714c0 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.814+0000 7f3e01b82700 1 -- 172.21.15.47:0/146259433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 msgr2=0x7f3dfc105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.814+0000 7f3e01b82700 1 --2- 172.21.15.47:0/146259433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 0x7f3dfc105340 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0098e0 tx=0x7f3dec009250 comp rx=0 tx=0).stop 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.814+0000 7f3e01b82700 1 -- 172.21.15.47:0/146259433 shutdown_connections 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.814+0000 7f3e01b82700 1 --2- 172.21.15.47:0/146259433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 0x7f3dfc105340 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.814+0000 7f3e01b82700 1 -- 172.21.15.47:0/146259433 >> 172.21.15.47:0/146259433 conn(0x7f3dfc0fcdd0 msgr2=0x7f3dfc0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.814+0000 7f3e01b82700 1 -- 172.21.15.47:0/146259433 shutdown_connections 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.814+0000 7f3e01b82700 1 -- 172.21.15.47:0/146259433 wait complete. 2024-02-07T12:16:32.571 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.815+0000 7f3e01b82700 1 Processor -- start 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.815+0000 7f3e01b82700 1 -- start start 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.815+0000 7f3e01b82700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 0x7f3dfc111580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.815+0000 7f3e01b82700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc111ac0 con 0x7f3dfc0714c0 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.815+0000 7f3dfb7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 0x7f3dfc111580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.815+0000 7f3dfb7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 0x7f3dfc111580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36970/0 (socket says 172.21.15.47:36970) 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.815+0000 7f3dfb7fe700 1 -- 172.21.15.47:0/371855453 learned_addr learned my addr 172.21.15.47:0/371855453 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.815+0000 7f3dfb7fe700 1 -- 172.21.15.47:0/371855453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0094f0 con 0x7f3dfc0714c0 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.816+0000 7f3dfb7fe700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 0x7f3dfc111580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3dec006b00 tx=0x7f3dec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.816+0000 7f3de3fff700 1 -- 172.21.15.47:0/371855453 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3dec0107c0 con 0x7f3dfc0714c0 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.816+0000 7f3e01b82700 1 -- 172.21.15.47:0/371855453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dfc111cc0 con 0x7f3dfc0714c0 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.816+0000 7f3de3fff700 1 -- 172.21.15.47:0/371855453 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3dec010db0 con 0x7f3dfc0714c0 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.816+0000 7f3de3fff700 1 -- 172.21.15.47:0/371855453 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3dec01acf0 con 0x7f3dfc0714c0 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.816+0000 7f3e01b82700 1 -- 172.21.15.47:0/371855453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc112960 con 0x7f3dfc0714c0 2024-02-07T12:16:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.817+0000 7f3de3fff700 1 -- 172.21.15.47:0/371855453 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f3dec0193c0 con 0x7f3dfc0714c0 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.817+0000 7f3de3fff700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 0x7f3de4038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.817+0000 7f3de3fff700 1 -- 172.21.15.47:0/371855453 --> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3de40391b0 con 0x7f3de40365f0 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.817+0000 7f3de3fff700 1 -- 172.21.15.47:0/371855453 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3dec04a450 con 0x7f3dfc0714c0 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.817+0000 7f3dfaffd700 1 -- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 msgr2=0x7f3de4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2169341238 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:26.817+0000 7f3dfaffd700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 0x7f3de4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:27.018+0000 7f3dfaffd700 1 -- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 msgr2=0x7f3de4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2169341238 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:27.018+0000 7f3dfaffd700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 0x7f3de4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:27.419+0000 7f3dfaffd700 1 -- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 msgr2=0x7f3de4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2169341238 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:27.419+0000 7f3dfaffd700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 0x7f3de4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:28.220+0000 7f3dfaffd700 1 -- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 msgr2=0x7f3de4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2169341238 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:28.220+0000 7f3dfaffd700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 0x7f3de4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:29.821+0000 7f3dfaffd700 1 -- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 msgr2=0x7f3de4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2169341238 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:29.821+0000 7f3dfaffd700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 0x7f3de4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-07T12:16:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:30.974+0000 7f3de3fff700 1 -- 172.21.15.47:0/371855453 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7f3dec02c3a0 con 0x7f3dfc0714c0 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:30.974+0000 7f3de3fff700 1 -- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 msgr2=0x7f3de4038aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:30.974+0000 7f3de3fff700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 0x7f3de4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.981+0000 7f3de3fff700 1 -- 172.21.15.47:0/371855453 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f3dec019c20 con 0x7f3dfc0714c0 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.981+0000 7f3de3fff700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f3de4039f60 0x7f3de403c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.981+0000 7f3de3fff700 1 -- 172.21.15.47:0/371855453 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3de40391b0 con 0x7f3de4039f60 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.981+0000 7f3dfaffd700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f3de4039f60 0x7f3de403c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.982+0000 7f3dfaffd700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f3de4039f60 0x7f3de403c340 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3df00039d0 tx=0x7f3df0009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.982+0000 7f3de3fff700 1 -- 172.21.15.47:0/371855453 <== mgr.14120 v2:172.21.15.47:6800/2175635831 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f3de40391b0 con 0x7f3de4039f60 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.988+0000 7f3e01b82700 1 -- 172.21.15.47:0/371855453 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f3dfc112150 con 0x7f3de4039f60 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.989+0000 7f3de3fff700 1 -- 172.21.15.47:0/371855453 <== mgr.14120 v2:172.21.15.47:6800/2175635831 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f3dfc112150 con 0x7f3de4039f60 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.989+0000 7f3e01b82700 1 -- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f3de4039f60 msgr2=0x7f3de403c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.989+0000 7f3e01b82700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f3de4039f60 0x7f3de403c340 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3df00039d0 tx=0x7f3df0009350 comp rx=0 tx=0).stop 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.989+0000 7f3e01b82700 1 -- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 msgr2=0x7f3dfc111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:32.574 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.989+0000 7f3e01b82700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 0x7f3dfc111580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3dec006b00 tx=0x7f3dec009250 comp rx=0 tx=0).stop 2024-02-07T12:16:32.575 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.989+0000 7f3e01b82700 1 -- 172.21.15.47:0/371855453 shutdown_connections 2024-02-07T12:16:32.575 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.989+0000 7f3e01b82700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f3de4039f60 0x7f3de403c340 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:32.575 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.989+0000 7f3e01b82700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0714c0 0x7f3dfc111580 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:32.575 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.989+0000 7f3e01b82700 1 --2- 172.21.15.47:0/371855453 >> [v2:172.21.15.47:6800/2169341238,v1:172.21.15.47:6801/2169341238] conn(0x7f3de40365f0 0x7f3de4038aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:32.575 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.989+0000 7f3e01b82700 1 -- 172.21.15.47:0/371855453 >> 172.21.15.47:0/371855453 conn(0x7f3dfc0fcdd0 msgr2=0x7f3dfc0fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:32.575 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.989+0000 7f3e01b82700 1 -- 172.21.15.47:0/371855453 shutdown_connections 2024-02-07T12:16:32.575 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:31.989+0000 7f3e01b82700 1 -- 172.21.15.47:0/371855453 wait complete. 2024-02-07T12:16:32.575 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 5 is available 2024-02-07T12:16:32.575 INFO:teuthology.orchestra.run.smithi047.stdout:Setting orchestrator backend to cephadm... 2024-02-07T12:16:33.176 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:32 smithi047 ceph-mon[28972]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-07T12:16:33.177 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:32 smithi047 ceph-mon[28972]: mgrmap e7: smithi047.zhgnrm(active, since 1.01055s) 2024-02-07T12:16:33.177 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:32 smithi047 ceph-mon[28972]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-07T12:16:33.177 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:32 smithi047 ceph-mon[28972]: [07/Feb/2024:12:16:32] ENGINE Bus STARTING 2024-02-07T12:16:33.177 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:32 smithi047 ceph-mon[28972]: [07/Feb/2024:12:16:32] ENGINE Serving on https://172.21.15.47:7150 2024-02-07T12:16:33.177 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:32 smithi047 ceph-mon[28972]: [07/Feb/2024:12:16:32] ENGINE Bus STARTED 2024-02-07T12:16:33.177 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:32 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:33.177 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:32 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:16:33.775 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.961+0000 7f50d99fb700 1 Processor -- start 2024-02-07T12:16:33.775 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.962+0000 7f50d99fb700 1 -- start start 2024-02-07T12:16:33.775 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.962+0000 7f50d99fb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 0x7f50d4104270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:33.775 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.962+0000 7f50d99fb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d41047b0 con 0x7f50d4103e60 2024-02-07T12:16:33.775 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.962+0000 7f50d2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 0x7f50d4104270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:33.775 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.962+0000 7f50d2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 0x7f50d4104270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56678/0 (socket says 172.21.15.47:56678) 2024-02-07T12:16:33.775 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.962+0000 7f50d2ffd700 1 -- 172.21.15.47:0/1251180952 learned_addr learned my addr 172.21.15.47:0/1251180952 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:33.775 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.962+0000 7f50d2ffd700 1 -- 172.21.15.47:0/1251180952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d41048f0 con 0x7f50d4103e60 2024-02-07T12:16:33.775 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.962+0000 7f50d2ffd700 1 --2- 172.21.15.47:0/1251180952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 0x7f50d4104270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0098e0 tx=0x7f50bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6b2f51663311e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:33.775 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.962+0000 7f50d1ffb700 1 -- 172.21.15.47:0/1251180952 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50bc00b860 con 0x7f50d4103e60 2024-02-07T12:16:33.775 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.963+0000 7f50d1ffb700 1 -- 172.21.15.47:0/1251180952 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f50bc00be50 con 0x7f50d4103e60 2024-02-07T12:16:33.776 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.963+0000 7f50d1ffb700 1 -- 172.21.15.47:0/1251180952 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50bc010380 con 0x7f50d4103e60 2024-02-07T12:16:33.776 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.963+0000 7f50d99fb700 1 -- 172.21.15.47:0/1251180952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 msgr2=0x7f50d4104270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:33.776 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.963+0000 7f50d99fb700 1 --2- 172.21.15.47:0/1251180952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 0x7f50d4104270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0098e0 tx=0x7f50bc009250 comp rx=0 tx=0).stop 2024-02-07T12:16:33.776 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.963+0000 7f50d99fb700 1 -- 172.21.15.47:0/1251180952 shutdown_connections 2024-02-07T12:16:33.776 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.963+0000 7f50d99fb700 1 --2- 172.21.15.47:0/1251180952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 0x7f50d4104270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:33.776 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.963+0000 7f50d99fb700 1 -- 172.21.15.47:0/1251180952 >> 172.21.15.47:0/1251180952 conn(0x7f50d40fc580 msgr2=0x7f50d40fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:33.776 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.963+0000 7f50d99fb700 1 -- 172.21.15.47:0/1251180952 shutdown_connections 2024-02-07T12:16:33.776 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.963+0000 7f50d99fb700 1 -- 172.21.15.47:0/1251180952 wait complete. 2024-02-07T12:16:33.776 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.964+0000 7f50d99fb700 1 Processor -- start 2024-02-07T12:16:33.776 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.964+0000 7f50d99fb700 1 -- start start 2024-02-07T12:16:33.776 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.964+0000 7f50d99fb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 0x7f50d4111810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:33.776 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.964+0000 7f50d99fb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d4111d50 con 0x7f50d4103e60 2024-02-07T12:16:33.776 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.964+0000 7f50d2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 0x7f50d4111810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.964+0000 7f50d2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 0x7f50d4111810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56694/0 (socket says 172.21.15.47:56694) 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.964+0000 7f50d2ffd700 1 -- 172.21.15.47:0/3874479653 learned_addr learned my addr 172.21.15.47:0/3874479653 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.964+0000 7f50d2ffd700 1 -- 172.21.15.47:0/3874479653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc0094f0 con 0x7f50d4103e60 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.965+0000 7f50d2ffd700 1 --2- 172.21.15.47:0/3874479653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 0x7f50d4111810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00b440 tx=0x7f50bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.965+0000 7f50cb7fe700 1 -- 172.21.15.47:0/3874479653 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50bc010760 con 0x7f50d4103e60 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.965+0000 7f50cb7fe700 1 -- 172.21.15.47:0/3874479653 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f50bc010d50 con 0x7f50d4103e60 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.965+0000 7f50d99fb700 1 -- 172.21.15.47:0/3874479653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d4111f50 con 0x7f50d4103e60 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.965+0000 7f50cb7fe700 1 -- 172.21.15.47:0/3874479653 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50bc024d80 con 0x7f50d4103e60 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.965+0000 7f50d99fb700 1 -- 172.21.15.47:0/3874479653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d4112bf0 con 0x7f50d4103e60 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.965+0000 7f50cb7fe700 1 -- 172.21.15.47:0/3874479653 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f50bc01a450 con 0x7f50d4103e60 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.966+0000 7f50cb7fe700 1 --2- 172.21.15.47:0/3874479653 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f50c0036470 0x7f50c0038920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.966+0000 7f50d99fb700 1 -- 172.21.15.47:0/3874479653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d405f5c0 con 0x7f50d4103e60 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.966+0000 7f50cb7fe700 1 -- 172.21.15.47:0/3874479653 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f50bc04a280 con 0x7f50d4103e60 2024-02-07T12:16:33.777 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.966+0000 7f50d27fc700 1 --2- 172.21.15.47:0/3874479653 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f50c0036470 0x7f50c0038920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:33.778 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.966+0000 7f50d27fc700 1 --2- 172.21.15.47:0/3874479653 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f50c0036470 0x7f50c0038920 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009990 tx=0x7f50c4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:33.778 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:32.970+0000 7f50cb7fe700 1 -- 172.21.15.47:0/3874479653 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f50bc01a700 con 0x7f50d4103e60 2024-02-07T12:16:33.778 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:33.174+0000 7f50d99fb700 1 -- 172.21.15.47:0/3874479653 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f50d41013e0 con 0x7f50c0036470 2024-02-07T12:16:33.778 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:33.180+0000 7f50cb7fe700 1 -- 172.21.15.47:0/3874479653 <== mgr.14120 v2:172.21.15.47:6800/2175635831 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f50d41013e0 con 0x7f50c0036470 2024-02-07T12:16:33.778 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:33.182+0000 7f50d99fb700 1 -- 172.21.15.47:0/3874479653 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f50c0036470 msgr2=0x7f50c0038920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:33.778 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:33.182+0000 7f50d99fb700 1 --2- 172.21.15.47:0/3874479653 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f50c0036470 0x7f50c0038920 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009990 tx=0x7f50c4006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:33.778 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:33.182+0000 7f50d99fb700 1 -- 172.21.15.47:0/3874479653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 msgr2=0x7f50d4111810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:33.778 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:33.182+0000 7f50d99fb700 1 --2- 172.21.15.47:0/3874479653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 0x7f50d4111810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00b440 tx=0x7f50bc009250 comp rx=0 tx=0).stop 2024-02-07T12:16:33.778 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:33.182+0000 7f50d99fb700 1 -- 172.21.15.47:0/3874479653 shutdown_connections 2024-02-07T12:16:33.778 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:33.182+0000 7f50d99fb700 1 --2- 172.21.15.47:0/3874479653 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f50c0036470 0x7f50c0038920 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:33.778 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:33.182+0000 7f50d99fb700 1 --2- 172.21.15.47:0/3874479653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50d4103e60 0x7f50d4111810 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:33.778 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:33.182+0000 7f50d99fb700 1 -- 172.21.15.47:0/3874479653 >> 172.21.15.47:0/3874479653 conn(0x7f50d40fc580 msgr2=0x7f50d40fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:33.779 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:33.182+0000 7f50d99fb700 1 -- 172.21.15.47:0/3874479653 shutdown_connections 2024-02-07T12:16:33.779 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:33.182+0000 7f50d99fb700 1 -- 172.21.15.47:0/3874479653 wait complete. 2024-02-07T12:16:34.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:34 smithi047 ceph-mon[28972]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:16:34.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:34 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:34.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:34 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:16:34.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:34 smithi047 ceph-mon[28972]: mgrmap e8: smithi047.zhgnrm(active, since 3s) 2024-02-07T12:16:34.921 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.168+0000 7f45416f1700 1 Processor -- start 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.169+0000 7f45416f1700 1 -- start start 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.169+0000 7f45416f1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 0x7f453c102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.169+0000 7f45416f1700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c1030c0 con 0x7f453c102770 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.169+0000 7f453affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 0x7f453c102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.169+0000 7f453affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 0x7f453c102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56704/0 (socket says 172.21.15.47:56704) 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.169+0000 7f453affd700 1 -- 172.21.15.47:0/1163767118 learned_addr learned my addr 172.21.15.47:0/1163767118 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.169+0000 7f453affd700 1 -- 172.21.15.47:0/1163767118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c103200 con 0x7f453c102770 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.169+0000 7f453affd700 1 --2- 172.21.15.47:0/1163767118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 0x7f453c102b80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f452c0098e0 tx=0x7f452c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9064bf73cb1a1330 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.169+0000 7f4539ffb700 1 -- 172.21.15.47:0/1163767118 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f452c00b860 con 0x7f453c102770 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.169+0000 7f4539ffb700 1 -- 172.21.15.47:0/1163767118 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f452c00be50 con 0x7f453c102770 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.169+0000 7f4539ffb700 1 -- 172.21.15.47:0/1163767118 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f452c010380 con 0x7f453c102770 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.170+0000 7f45416f1700 1 -- 172.21.15.47:0/1163767118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 msgr2=0x7f453c102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:34.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.170+0000 7f45416f1700 1 --2- 172.21.15.47:0/1163767118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 0x7f453c102b80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f452c0098e0 tx=0x7f452c009250 comp rx=0 tx=0).stop 2024-02-07T12:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.170+0000 7f45416f1700 1 -- 172.21.15.47:0/1163767118 shutdown_connections 2024-02-07T12:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.170+0000 7f45416f1700 1 --2- 172.21.15.47:0/1163767118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 0x7f453c102b80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.170+0000 7f45416f1700 1 -- 172.21.15.47:0/1163767118 >> 172.21.15.47:0/1163767118 conn(0x7f453c0fded0 msgr2=0x7f453c100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.170+0000 7f45416f1700 1 -- 172.21.15.47:0/1163767118 shutdown_connections 2024-02-07T12:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.170+0000 7f45416f1700 1 -- 172.21.15.47:0/1163767118 wait complete. 2024-02-07T12:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.171+0000 7f45416f1700 1 Processor -- start 2024-02-07T12:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.171+0000 7f45416f1700 1 -- start start 2024-02-07T12:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.171+0000 7f45416f1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 0x7f453c078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:34.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.171+0000 7f45416f1700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c077190 con 0x7f453c102770 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.171+0000 7f453affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 0x7f453c078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.171+0000 7f453affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 0x7f453c078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56708/0 (socket says 172.21.15.47:56708) 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.171+0000 7f453affd700 1 -- 172.21.15.47:0/764348185 learned_addr learned my addr 172.21.15.47:0/764348185 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.171+0000 7f453affd700 1 -- 172.21.15.47:0/764348185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c0094f0 con 0x7f453c102770 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.171+0000 7f453affd700 1 --2- 172.21.15.47:0/764348185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 0x7f453c078d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f452c00b440 tx=0x7f452c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.172+0000 7f45237fe700 1 -- 172.21.15.47:0/764348185 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f452c010760 con 0x7f453c102770 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.172+0000 7f45416f1700 1 -- 172.21.15.47:0/764348185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453c077390 con 0x7f453c102770 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.172+0000 7f45237fe700 1 -- 172.21.15.47:0/764348185 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f452c010d50 con 0x7f453c102770 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.172+0000 7f45237fe700 1 -- 172.21.15.47:0/764348185 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f452c01ae20 con 0x7f453c102770 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.172+0000 7f45416f1700 1 -- 172.21.15.47:0/764348185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c077820 con 0x7f453c102770 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.172+0000 7f45237fe700 1 -- 172.21.15.47:0/764348185 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f452c02e440 con 0x7f453c102770 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.173+0000 7f45237fe700 1 --2- 172.21.15.47:0/764348185 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f45240365d0 0x7f4524038a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.173+0000 7f45237fe700 1 -- 172.21.15.47:0/764348185 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f452c04a420 con 0x7f453c102770 2024-02-07T12:16:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.173+0000 7f45416f1700 1 -- 172.21.15.47:0/764348185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453c04bed0 con 0x7f453c102770 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.173+0000 7f453a7fc700 1 --2- 172.21.15.47:0/764348185 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f45240365d0 0x7f4524038a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.173+0000 7f453a7fc700 1 --2- 172.21.15.47:0/764348185 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f45240365d0 0x7f4524038a80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4530009990 tx=0x7f4530006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.178+0000 7f45237fe700 1 -- 172.21.15.47:0/764348185 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f452c018940 con 0x7f453c102770 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.370+0000 7f45416f1700 1 -- 172.21.15.47:0/764348185 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f453c078060 con 0x7f45240365d0 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.371+0000 7f45237fe700 1 -- 172.21.15.47:0/764348185 <== mgr.14120 v2:172.21.15.47:6800/2175635831 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f453c078060 con 0x7f45240365d0 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.373+0000 7f45416f1700 1 -- 172.21.15.47:0/764348185 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f45240365d0 msgr2=0x7f4524038a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.373+0000 7f45416f1700 1 --2- 172.21.15.47:0/764348185 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f45240365d0 0x7f4524038a80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4530009990 tx=0x7f4530006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.373+0000 7f45416f1700 1 -- 172.21.15.47:0/764348185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 msgr2=0x7f453c078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.373+0000 7f45416f1700 1 --2- 172.21.15.47:0/764348185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 0x7f453c078d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f452c00b440 tx=0x7f452c009250 comp rx=0 tx=0).stop 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.373+0000 7f45416f1700 1 -- 172.21.15.47:0/764348185 shutdown_connections 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.373+0000 7f45416f1700 1 --2- 172.21.15.47:0/764348185 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f45240365d0 0x7f4524038a80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.373+0000 7f45416f1700 1 --2- 172.21.15.47:0/764348185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f453c102770 0x7f453c078d10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.373+0000 7f45416f1700 1 -- 172.21.15.47:0/764348185 >> 172.21.15.47:0/764348185 conn(0x7f453c0fded0 msgr2=0x7f453c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.373+0000 7f45416f1700 1 -- 172.21.15.47:0/764348185 shutdown_connections 2024-02-07T12:16:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:34.373+0000 7f45416f1700 1 -- 172.21.15.47:0/764348185 wait complete. 2024-02-07T12:16:34.926 INFO:teuthology.orchestra.run.smithi047.stdout:Generating ssh key... 2024-02-07T12:16:35.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:35 smithi047 ceph-mon[28972]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:16:36.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.380+0000 7f2b63ece700 1 Processor -- start 2024-02-07T12:16:36.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.381+0000 7f2b63ece700 1 -- start start 2024-02-07T12:16:36.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.381+0000 7f2b63ece700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 0x7f2b5c105340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:36.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.381+0000 7f2b63ece700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c105880 con 0x7f2b5c076c60 2024-02-07T12:16:36.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.381+0000 7f2b61c6a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 0x7f2b5c105340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:36.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.381+0000 7f2b61c6a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 0x7f2b5c105340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56714/0 (socket says 172.21.15.47:56714) 2024-02-07T12:16:36.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.381+0000 7f2b61c6a700 1 -- 172.21.15.47:0/29458148 learned_addr learned my addr 172.21.15.47:0/29458148 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:36.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.381+0000 7f2b61c6a700 1 -- 172.21.15.47:0/29458148 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c1059c0 con 0x7f2b5c076c60 2024-02-07T12:16:36.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.382+0000 7f2b61c6a700 1 --2- 172.21.15.47:0/29458148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 0x7f2b5c105340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0098e0 tx=0x7f2b4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb847e610103b0a server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:36.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.382+0000 7f2b60c68700 1 -- 172.21.15.47:0/29458148 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b4c00b860 con 0x7f2b5c076c60 2024-02-07T12:16:36.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.382+0000 7f2b60c68700 1 -- 172.21.15.47:0/29458148 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2b4c00be50 con 0x7f2b5c076c60 2024-02-07T12:16:36.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.382+0000 7f2b60c68700 1 -- 172.21.15.47:0/29458148 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b4c010380 con 0x7f2b5c076c60 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.382+0000 7f2b63ece700 1 -- 172.21.15.47:0/29458148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 msgr2=0x7f2b5c105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.382+0000 7f2b63ece700 1 --2- 172.21.15.47:0/29458148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 0x7f2b5c105340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0098e0 tx=0x7f2b4c009250 comp rx=0 tx=0).stop 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.382+0000 7f2b63ece700 1 -- 172.21.15.47:0/29458148 shutdown_connections 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.382+0000 7f2b63ece700 1 --2- 172.21.15.47:0/29458148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 0x7f2b5c105340 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.382+0000 7f2b63ece700 1 -- 172.21.15.47:0/29458148 >> 172.21.15.47:0/29458148 conn(0x7f2b5c0fcdd0 msgr2=0x7f2b5c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.383+0000 7f2b63ece700 1 -- 172.21.15.47:0/29458148 shutdown_connections 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.383+0000 7f2b63ece700 1 -- 172.21.15.47:0/29458148 wait complete. 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.383+0000 7f2b63ece700 1 Processor -- start 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.383+0000 7f2b63ece700 1 -- start start 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.383+0000 7f2b63ece700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 0x7f2b5c102dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.383+0000 7f2b63ece700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c101240 con 0x7f2b5c076c60 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.383+0000 7f2b61c6a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 0x7f2b5c102dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.383+0000 7f2b61c6a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 0x7f2b5c102dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56728/0 (socket says 172.21.15.47:56728) 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.383+0000 7f2b61c6a700 1 -- 172.21.15.47:0/1262591085 learned_addr learned my addr 172.21.15.47:0/1262591085 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.384+0000 7f2b61c6a700 1 -- 172.21.15.47:0/1262591085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c0094f0 con 0x7f2b5c076c60 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.384+0000 7f2b61c6a700 1 --2- 172.21.15.47:0/1262591085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 0x7f2b5c102dc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c003050 tx=0x7f2b4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.384+0000 7f2b527fc700 1 -- 172.21.15.47:0/1262591085 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b4c010760 con 0x7f2b5c076c60 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.384+0000 7f2b527fc700 1 -- 172.21.15.47:0/1262591085 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2b4c010d50 con 0x7f2b5c076c60 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.384+0000 7f2b63ece700 1 -- 172.21.15.47:0/1262591085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5c101440 con 0x7f2b5c076c60 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.384+0000 7f2b527fc700 1 -- 172.21.15.47:0/1262591085 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b4c01ae20 con 0x7f2b5c076c60 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.384+0000 7f2b63ece700 1 -- 172.21.15.47:0/1262591085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5c1018d0 con 0x7f2b5c076c60 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.385+0000 7f2b527fc700 1 -- 172.21.15.47:0/1262591085 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f2b4c0108c0 con 0x7f2b5c076c60 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.385+0000 7f2b63ece700 1 -- 172.21.15.47:0/1262591085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5c04bed0 con 0x7f2b5c076c60 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.385+0000 7f2b527fc700 1 --2- 172.21.15.47:0/1262591085 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f2b480365d0 0x7f2b48038a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.385+0000 7f2b527fc700 1 -- 172.21.15.47:0/1262591085 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2b4c04a2f0 con 0x7f2b5c076c60 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.386+0000 7f2b61469700 1 --2- 172.21.15.47:0/1262591085 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f2b480365d0 0x7f2b48038a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.386+0000 7f2b61469700 1 --2- 172.21.15.47:0/1262591085 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f2b480365d0 0x7f2b48038a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009990 tx=0x7f2b58006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.390+0000 7f2b527fc700 1 -- 172.21.15.47:0/1262591085 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2b4c0187c0 con 0x7f2b5c076c60 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:35.582+0000 7f2b63ece700 1 -- 172.21.15.47:0/1262591085 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b5c101e10 con 0x7f2b480365d0 2024-02-07T12:16:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:36.192+0000 7f2b527fc700 1 -- 172.21.15.47:0/1262591085 <== mgr.14120 v2:172.21.15.47:6800/2175635831 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2b5c101e10 con 0x7f2b480365d0 2024-02-07T12:16:36.715 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:36.194+0000 7f2b63ece700 1 -- 172.21.15.47:0/1262591085 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f2b480365d0 msgr2=0x7f2b48038a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:36.715 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:36.194+0000 7f2b63ece700 1 --2- 172.21.15.47:0/1262591085 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f2b480365d0 0x7f2b48038a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009990 tx=0x7f2b58006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:36.715 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:36.194+0000 7f2b63ece700 1 -- 172.21.15.47:0/1262591085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 msgr2=0x7f2b5c102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:36.715 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:36.194+0000 7f2b63ece700 1 --2- 172.21.15.47:0/1262591085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 0x7f2b5c102dc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c003050 tx=0x7f2b4c009250 comp rx=0 tx=0).stop 2024-02-07T12:16:36.715 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:36.194+0000 7f2b63ece700 1 -- 172.21.15.47:0/1262591085 shutdown_connections 2024-02-07T12:16:36.715 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:36.194+0000 7f2b63ece700 1 --2- 172.21.15.47:0/1262591085 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f2b480365d0 0x7f2b48038a80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:36.715 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:36.194+0000 7f2b63ece700 1 --2- 172.21.15.47:0/1262591085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5c076c60 0x7f2b5c102dc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:36.715 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:36.194+0000 7f2b63ece700 1 -- 172.21.15.47:0/1262591085 >> 172.21.15.47:0/1262591085 conn(0x7f2b5c0fcdd0 msgr2=0x7f2b5c0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:36.715 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:36.194+0000 7f2b63ece700 1 -- 172.21.15.47:0/1262591085 shutdown_connections 2024-02-07T12:16:36.715 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:36.194+0000 7f2b63ece700 1 -- 172.21.15.47:0/1262591085 wait complete. 2024-02-07T12:16:37.305 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:37 smithi047 ceph-mon[28972]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:16:37.306 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:37 smithi047 ceph-mon[28972]: Generating ssh key... 2024-02-07T12:16:37.306 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:37 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:37.306 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:37 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:37.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoH64oueXGPNVE/SdfOQrOeRdc96eAVVeIpKQxQqGySHnjIQ5Q5Kzz+yj1Zj1jlGkthTS5xHGPlKiN+d9e6i/t7LXCAGofaLpa/+UysS/vt99Wg/sCLg3V3oTegzeFoiObnM7DzXq5Ti/GSU9Jk1jgYuqZDQbOCKOKK+zAjqpWKC9R84K3BUl4qRNDFUhEcpUqYyTGKfwvHCPTpRhf/ZMkfWGoIcRX4GgPXcmQ363sO5HLCWpXCaF4VFXymrjKsaz3nqRCi3mJfUPTHbEQWpCtDAU7kDEDoOoQ0OI93jrsBL8h5QcrcukqWtvgJB1lDMc9M0CDULPEJ8uFcZBBdWjlRztENx3HdrAmS9JzXwkuRwHi/c2f5GTBi0hWa3St8+aemFrQZN4MlzCfRm1f9vn2zjELKdLtPXxzREl0ni/MbxP0dOUSILfk4JwDGo1rsflV5iQnepfoT0JocJUaYCAEkXKT2y/cO+P8/NfC/znjf+vGLoLT6N2wximG0iYekOs= ceph-818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:16:37.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.102+0000 7f712f9be700 1 Processor -- start 2024-02-07T12:16:37.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.102+0000 7f712f9be700 1 -- start start 2024-02-07T12:16:37.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.102+0000 7f712f9be700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 0x7f7128102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:37.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.102+0000 7f712f9be700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71281030c0 con 0x7f7128102770 2024-02-07T12:16:37.861 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.102+0000 7f712d75a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 0x7f7128102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:37.861 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.102+0000 7f712d75a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 0x7f7128102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56744/0 (socket says 172.21.15.47:56744) 2024-02-07T12:16:37.861 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.102+0000 7f712d75a700 1 -- 172.21.15.47:0/697330690 learned_addr learned my addr 172.21.15.47:0/697330690 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:37.861 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.102+0000 7f712d75a700 1 -- 172.21.15.47:0/697330690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7128103200 con 0x7f7128102770 2024-02-07T12:16:37.861 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.103+0000 7f712d75a700 1 --2- 172.21.15.47:0/697330690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 0x7f7128102b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f71240098e0 tx=0x7f7124009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fbc3771bcdc224 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:37.861 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.103+0000 7f711ffff700 1 -- 172.21.15.47:0/697330690 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f712400b860 con 0x7f7128102770 2024-02-07T12:16:37.861 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.103+0000 7f711ffff700 1 -- 172.21.15.47:0/697330690 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f712400be50 con 0x7f7128102770 2024-02-07T12:16:37.861 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.103+0000 7f711ffff700 1 -- 172.21.15.47:0/697330690 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7124010380 con 0x7f7128102770 2024-02-07T12:16:37.861 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.103+0000 7f712f9be700 1 -- 172.21.15.47:0/697330690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 msgr2=0x7f7128102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:37.861 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.103+0000 7f712f9be700 1 --2- 172.21.15.47:0/697330690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 0x7f7128102b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f71240098e0 tx=0x7f7124009250 comp rx=0 tx=0).stop 2024-02-07T12:16:37.861 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.103+0000 7f712f9be700 1 -- 172.21.15.47:0/697330690 shutdown_connections 2024-02-07T12:16:37.861 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.103+0000 7f712f9be700 1 --2- 172.21.15.47:0/697330690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 0x7f7128102b80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:37.861 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.103+0000 7f712f9be700 1 -- 172.21.15.47:0/697330690 >> 172.21.15.47:0/697330690 conn(0x7f71280fded0 msgr2=0x7f7128100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.104+0000 7f712f9be700 1 -- 172.21.15.47:0/697330690 shutdown_connections 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.104+0000 7f712f9be700 1 -- 172.21.15.47:0/697330690 wait complete. 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.104+0000 7f712f9be700 1 Processor -- start 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.104+0000 7f712f9be700 1 -- start start 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.104+0000 7f712f9be700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 0x7f7128078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.104+0000 7f712f9be700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7128077190 con 0x7f7128102770 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.104+0000 7f712d75a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 0x7f7128078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.104+0000 7f712d75a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 0x7f7128078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56746/0 (socket says 172.21.15.47:56746) 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.104+0000 7f712d75a700 1 -- 172.21.15.47:0/606692520 learned_addr learned my addr 172.21.15.47:0/606692520 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.105+0000 7f712d75a700 1 -- 172.21.15.47:0/606692520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71240094f0 con 0x7f7128102770 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.105+0000 7f712d75a700 1 --2- 172.21.15.47:0/606692520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 0x7f7128078d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f712400b440 tx=0x7f7124009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.105+0000 7f711dffb700 1 -- 172.21.15.47:0/606692520 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7124010760 con 0x7f7128102770 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.105+0000 7f711dffb700 1 -- 172.21.15.47:0/606692520 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7124010d50 con 0x7f7128102770 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.105+0000 7f712f9be700 1 -- 172.21.15.47:0/606692520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7128077390 con 0x7f7128102770 2024-02-07T12:16:37.862 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.105+0000 7f711dffb700 1 -- 172.21.15.47:0/606692520 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f712401ae20 con 0x7f7128102770 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.105+0000 7f712f9be700 1 -- 172.21.15.47:0/606692520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7128077820 con 0x7f7128102770 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.106+0000 7f711dffb700 1 -- 172.21.15.47:0/606692520 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f712402e440 con 0x7f7128102770 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.106+0000 7f712f9be700 1 -- 172.21.15.47:0/606692520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712804bed0 con 0x7f7128102770 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.106+0000 7f711dffb700 1 --2- 172.21.15.47:0/606692520 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f7114036640 0x7f7114038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.106+0000 7f711dffb700 1 -- 172.21.15.47:0/606692520 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f712404a3b0 con 0x7f7128102770 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.106+0000 7f712cf59700 1 --2- 172.21.15.47:0/606692520 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f7114036640 0x7f7114038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.107+0000 7f712cf59700 1 --2- 172.21.15.47:0/606692520 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f7114036640 0x7f7114038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7118009990 tx=0x7f7118006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.111+0000 7f711dffb700 1 -- 172.21.15.47:0/606692520 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7124018940 con 0x7f7128102770 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.303+0000 7f712f9be700 1 -- 172.21.15.47:0/606692520 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f7128078060 con 0x7f7114036640 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.304+0000 7f711dffb700 1 -- 172.21.15.47:0/606692520 <== mgr.14120 v2:172.21.15.47:6800/2175635831 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f7128078060 con 0x7f7114036640 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.305+0000 7f712f9be700 1 -- 172.21.15.47:0/606692520 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f7114036640 msgr2=0x7f7114038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.305+0000 7f712f9be700 1 --2- 172.21.15.47:0/606692520 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f7114036640 0x7f7114038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7118009990 tx=0x7f7118006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.305+0000 7f712f9be700 1 -- 172.21.15.47:0/606692520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 msgr2=0x7f7128078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.305+0000 7f712f9be700 1 --2- 172.21.15.47:0/606692520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 0x7f7128078d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f712400b440 tx=0x7f7124009250 comp rx=0 tx=0).stop 2024-02-07T12:16:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.306+0000 7f712f9be700 1 -- 172.21.15.47:0/606692520 shutdown_connections 2024-02-07T12:16:37.864 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.306+0000 7f712f9be700 1 --2- 172.21.15.47:0/606692520 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f7114036640 0x7f7114038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:37.864 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.306+0000 7f712f9be700 1 --2- 172.21.15.47:0/606692520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7128102770 0x7f7128078d10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:37.864 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.306+0000 7f712f9be700 1 -- 172.21.15.47:0/606692520 >> 172.21.15.47:0/606692520 conn(0x7f71280fded0 msgr2=0x7f71280ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:37.864 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.306+0000 7f712f9be700 1 -- 172.21.15.47:0/606692520 shutdown_connections 2024-02-07T12:16:37.864 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:37.306+0000 7f712f9be700 1 -- 172.21.15.47:0/606692520 wait complete. 2024-02-07T12:16:37.864 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-07T12:16:37.864 INFO:teuthology.orchestra.run.smithi047.stdout:Adding key to root@localhost authorized_keys... 2024-02-07T12:16:37.864 INFO:teuthology.orchestra.run.smithi047.stdout:Adding host smithi047... 2024-02-07T12:16:38.262 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:38 smithi047 ceph-mon[28972]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:16:39.697 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:39 smithi047 ceph-mon[28972]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi047", "addr": "172.21.15.47", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:16:39.697 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:39 smithi047 ceph-mon[28972]: Deploying cephadm binary to smithi047 2024-02-07T12:16:41.209 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Added host 'smithi047' with addr '172.21.15.47' 2024-02-07T12:16:41.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.276+0000 7fa59540f700 1 Processor -- start 2024-02-07T12:16:41.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.276+0000 7fa59540f700 1 -- start start 2024-02-07T12:16:41.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.276+0000 7fa59540f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 0x7fa590102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:41.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.276+0000 7fa59540f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901030c0 con 0x7fa590102770 2024-02-07T12:16:41.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.276+0000 7fa58effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 0x7fa590102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:41.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.276+0000 7fa58effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 0x7fa590102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56760/0 (socket says 172.21.15.47:56760) 2024-02-07T12:16:41.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.276+0000 7fa58effd700 1 -- 172.21.15.47:0/3315597753 learned_addr learned my addr 172.21.15.47:0/3315597753 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:41.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.277+0000 7fa58effd700 1 -- 172.21.15.47:0/3315597753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590103200 con 0x7fa590102770 2024-02-07T12:16:41.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.277+0000 7fa58effd700 1 --2- 172.21.15.47:0/3315597753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 0x7fa590102b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa5800098e0 tx=0x7fa580009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d766aa994cfd4a4f server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:41.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.277+0000 7fa58dffb700 1 -- 172.21.15.47:0/3315597753 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa58000b860 con 0x7fa590102770 2024-02-07T12:16:41.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.277+0000 7fa58dffb700 1 -- 172.21.15.47:0/3315597753 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa58000be50 con 0x7fa590102770 2024-02-07T12:16:41.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.277+0000 7fa58dffb700 1 -- 172.21.15.47:0/3315597753 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa580010380 con 0x7fa590102770 2024-02-07T12:16:41.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.277+0000 7fa59540f700 1 -- 172.21.15.47:0/3315597753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 msgr2=0x7fa590102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:41.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.277+0000 7fa59540f700 1 --2- 172.21.15.47:0/3315597753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 0x7fa590102b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa5800098e0 tx=0x7fa580009250 comp rx=0 tx=0).stop 2024-02-07T12:16:41.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.277+0000 7fa59540f700 1 -- 172.21.15.47:0/3315597753 shutdown_connections 2024-02-07T12:16:41.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.277+0000 7fa59540f700 1 --2- 172.21.15.47:0/3315597753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 0x7fa590102b80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:41.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.277+0000 7fa59540f700 1 -- 172.21.15.47:0/3315597753 >> 172.21.15.47:0/3315597753 conn(0x7fa5900fded0 msgr2=0x7fa590100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:41.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.278+0000 7fa59540f700 1 -- 172.21.15.47:0/3315597753 shutdown_connections 2024-02-07T12:16:41.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.278+0000 7fa59540f700 1 -- 172.21.15.47:0/3315597753 wait complete. 2024-02-07T12:16:41.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.278+0000 7fa59540f700 1 Processor -- start 2024-02-07T12:16:41.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.278+0000 7fa59540f700 1 -- start start 2024-02-07T12:16:41.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.278+0000 7fa59540f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 0x7fa590078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:41.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.278+0000 7fa59540f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa590077190 con 0x7fa590102770 2024-02-07T12:16:41.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.279+0000 7fa58effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 0x7fa590078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:41.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.279+0000 7fa58effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 0x7fa590078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56772/0 (socket says 172.21.15.47:56772) 2024-02-07T12:16:41.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.279+0000 7fa58effd700 1 -- 172.21.15.47:0/3964724450 learned_addr learned my addr 172.21.15.47:0/3964724450 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:41.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.279+0000 7fa58effd700 1 -- 172.21.15.47:0/3964724450 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5800094f0 con 0x7fa590102770 2024-02-07T12:16:41.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.279+0000 7fa58effd700 1 --2- 172.21.15.47:0/3964724450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 0x7fa590078d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa580000c00 tx=0x7fa580009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:41.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.279+0000 7fa5777fe700 1 -- 172.21.15.47:0/3964724450 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5800107c0 con 0x7fa590102770 2024-02-07T12:16:41.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.279+0000 7fa59540f700 1 -- 172.21.15.47:0/3964724450 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa590077390 con 0x7fa590102770 2024-02-07T12:16:41.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.279+0000 7fa5777fe700 1 -- 172.21.15.47:0/3964724450 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa580010db0 con 0x7fa590102770 2024-02-07T12:16:41.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.279+0000 7fa5777fe700 1 -- 172.21.15.47:0/3964724450 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa58001ad00 con 0x7fa590102770 2024-02-07T12:16:41.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.279+0000 7fa59540f700 1 -- 172.21.15.47:0/3964724450 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa590077820 con 0x7fa590102770 2024-02-07T12:16:41.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.280+0000 7fa5777fe700 1 -- 172.21.15.47:0/3964724450 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fa5800193c0 con 0x7fa590102770 2024-02-07T12:16:41.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.280+0000 7fa59540f700 1 -- 172.21.15.47:0/3964724450 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59004bed0 con 0x7fa590102770 2024-02-07T12:16:41.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.280+0000 7fa5777fe700 1 --2- 172.21.15.47:0/3964724450 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fa5780365f0 0x7fa578038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:41.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.280+0000 7fa5777fe700 1 -- 172.21.15.47:0/3964724450 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa58004a490 con 0x7fa590102770 2024-02-07T12:16:41.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.280+0000 7fa58e7fc700 1 --2- 172.21.15.47:0/3964724450 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fa5780365f0 0x7fa578038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:41.213 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.281+0000 7fa58e7fc700 1 --2- 172.21.15.47:0/3964724450 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fa5780365f0 0x7fa578038aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa584009990 tx=0x7fa584006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:41.213 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.285+0000 7fa5777fe700 1 -- 172.21.15.47:0/3964724450 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa580022930 con 0x7fa590102770 2024-02-07T12:16:41.213 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:38.482+0000 7fa59540f700 1 -- 172.21.15.47:0/3964724450 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi047", "addr": "172.21.15.47", "target": ["mon-mgr", ""]}) v1 -- 0x7fa590077fa0 con 0x7fa5780365f0 2024-02-07T12:16:41.213 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:40.613+0000 7fa5777fe700 1 -- 172.21.15.47:0/3964724450 <== mgr.14120 v2:172.21.15.47:6800/2175635831 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fa590077fa0 con 0x7fa5780365f0 2024-02-07T12:16:41.213 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:40.616+0000 7fa59540f700 1 -- 172.21.15.47:0/3964724450 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fa5780365f0 msgr2=0x7fa578038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:41.213 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:40.616+0000 7fa59540f700 1 --2- 172.21.15.47:0/3964724450 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fa5780365f0 0x7fa578038aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa584009990 tx=0x7fa584006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:41.213 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:40.616+0000 7fa59540f700 1 -- 172.21.15.47:0/3964724450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 msgr2=0x7fa590078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:41.213 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:40.616+0000 7fa59540f700 1 --2- 172.21.15.47:0/3964724450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 0x7fa590078d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa580000c00 tx=0x7fa580009250 comp rx=0 tx=0).stop 2024-02-07T12:16:41.213 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:40.616+0000 7fa59540f700 1 -- 172.21.15.47:0/3964724450 shutdown_connections 2024-02-07T12:16:41.213 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:40.616+0000 7fa59540f700 1 --2- 172.21.15.47:0/3964724450 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fa5780365f0 0x7fa578038aa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:41.213 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:40.616+0000 7fa59540f700 1 --2- 172.21.15.47:0/3964724450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102770 0x7fa590078d10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:41.213 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:40.616+0000 7fa59540f700 1 -- 172.21.15.47:0/3964724450 >> 172.21.15.47:0/3964724450 conn(0x7fa5900fded0 msgr2=0x7fa5900ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:41.214 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:40.616+0000 7fa59540f700 1 -- 172.21.15.47:0/3964724450 shutdown_connections 2024-02-07T12:16:41.214 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:40.616+0000 7fa59540f700 1 -- 172.21.15.47:0/3964724450 wait complete. 2024-02-07T12:16:41.214 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying mon service with default placement... 2024-02-07T12:16:41.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:41 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:41.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:41 smithi047 ceph-mon[28972]: Added host smithi047 2024-02-07T12:16:41.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:41 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:16:42.667 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-07T12:16:42.667 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.639+0000 7f9822901700 1 Processor -- start 2024-02-07T12:16:42.667 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.639+0000 7f9822901700 1 -- start start 2024-02-07T12:16:42.667 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.639+0000 7f9822901700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 0x7f981c105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:42.667 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.639+0000 7f9822901700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c1058a0 con 0x7f981c0714a0 2024-02-07T12:16:42.667 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.640+0000 7f981bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 0x7f981c105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:42.667 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.640+0000 7f981bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 0x7f981c105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45188/0 (socket says 172.21.15.47:45188) 2024-02-07T12:16:42.667 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.640+0000 7f981bfff700 1 -- 172.21.15.47:0/274819875 learned_addr learned my addr 172.21.15.47:0/274819875 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:42.667 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.640+0000 7f981bfff700 1 -- 172.21.15.47:0/274819875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c1059e0 con 0x7f981c0714a0 2024-02-07T12:16:42.667 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.640+0000 7f981bfff700 1 --2- 172.21.15.47:0/274819875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 0x7f981c105360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f980c0098e0 tx=0x7f980c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ad52113f190679 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:42.668 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.640+0000 7f981affd700 1 -- 172.21.15.47:0/274819875 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f980c00b860 con 0x7f981c0714a0 2024-02-07T12:16:42.668 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.640+0000 7f981affd700 1 -- 172.21.15.47:0/274819875 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f980c00be50 con 0x7f981c0714a0 2024-02-07T12:16:42.668 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.640+0000 7f981affd700 1 -- 172.21.15.47:0/274819875 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f980c010380 con 0x7f981c0714a0 2024-02-07T12:16:42.668 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.641+0000 7f9822901700 1 -- 172.21.15.47:0/274819875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 msgr2=0x7f981c105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:42.668 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.641+0000 7f9822901700 1 --2- 172.21.15.47:0/274819875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 0x7f981c105360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f980c0098e0 tx=0x7f980c009250 comp rx=0 tx=0).stop 2024-02-07T12:16:42.668 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.641+0000 7f9822901700 1 -- 172.21.15.47:0/274819875 shutdown_connections 2024-02-07T12:16:42.668 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.641+0000 7f9822901700 1 --2- 172.21.15.47:0/274819875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 0x7f981c105360 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:42.668 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.641+0000 7f9822901700 1 -- 172.21.15.47:0/274819875 >> 172.21.15.47:0/274819875 conn(0x7f981c0fcdd0 msgr2=0x7f981c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:42.668 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.641+0000 7f9822901700 1 -- 172.21.15.47:0/274819875 shutdown_connections 2024-02-07T12:16:42.668 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.641+0000 7f9822901700 1 -- 172.21.15.47:0/274819875 wait complete. 2024-02-07T12:16:42.668 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.641+0000 7f9822901700 1 Processor -- start 2024-02-07T12:16:42.668 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.641+0000 7f9822901700 1 -- start start 2024-02-07T12:16:42.668 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.642+0000 7f9822901700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 0x7f981c111580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.642+0000 7f9822901700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c111ac0 con 0x7f981c0714a0 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.642+0000 7f981bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 0x7f981c111580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.642+0000 7f981bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 0x7f981c111580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45194/0 (socket says 172.21.15.47:45194) 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.642+0000 7f981bfff700 1 -- 172.21.15.47:0/3615853766 learned_addr learned my addr 172.21.15.47:0/3615853766 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.642+0000 7f981bfff700 1 -- 172.21.15.47:0/3615853766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c0094f0 con 0x7f981c0714a0 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.642+0000 7f981bfff700 1 --2- 172.21.15.47:0/3615853766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 0x7f981c111580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f980c003050 tx=0x7f980c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.642+0000 7f9818ff9700 1 -- 172.21.15.47:0/3615853766 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f980c010760 con 0x7f981c0714a0 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.642+0000 7f9822901700 1 -- 172.21.15.47:0/3615853766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981c111cc0 con 0x7f981c0714a0 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.642+0000 7f9818ff9700 1 -- 172.21.15.47:0/3615853766 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f980c010d50 con 0x7f981c0714a0 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.642+0000 7f9818ff9700 1 -- 172.21.15.47:0/3615853766 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f980c01ae20 con 0x7f981c0714a0 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.642+0000 7f9822901700 1 -- 172.21.15.47:0/3615853766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981c112960 con 0x7f981c0714a0 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.643+0000 7f9818ff9700 1 -- 172.21.15.47:0/3615853766 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f980c02e440 con 0x7f981c0714a0 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.643+0000 7f9818ff9700 1 --2- 172.21.15.47:0/3615853766 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f98040365d0 0x7f9804038a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.643+0000 7f9818ff9700 1 -- 172.21.15.47:0/3615853766 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f980c04a320 con 0x7f981c0714a0 2024-02-07T12:16:42.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.643+0000 7f9822901700 1 -- 172.21.15.47:0/3615853766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981c05f5c0 con 0x7f981c0714a0 2024-02-07T12:16:42.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.643+0000 7f981b7fe700 1 --2- 172.21.15.47:0/3615853766 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f98040365d0 0x7f9804038a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:42.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.644+0000 7f981b7fe700 1 --2- 172.21.15.47:0/3615853766 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f98040365d0 0x7f9804038a80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9810009990 tx=0x7f9810006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:42.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.648+0000 7f9818ff9700 1 -- 172.21.15.47:0/3615853766 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f980c0243f0 con 0x7f981c0714a0 2024-02-07T12:16:42.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.894+0000 7f9822901700 1 -- 172.21.15.47:0/3615853766 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f981c1133e0 con 0x7f98040365d0 2024-02-07T12:16:42.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.899+0000 7f9818ff9700 1 -- 172.21.15.47:0/3615853766 <== mgr.14120 v2:172.21.15.47:6800/2175635831 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f981c1133e0 con 0x7f98040365d0 2024-02-07T12:16:42.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.901+0000 7f9822901700 1 -- 172.21.15.47:0/3615853766 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f98040365d0 msgr2=0x7f9804038a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:42.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.901+0000 7f9822901700 1 --2- 172.21.15.47:0/3615853766 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f98040365d0 0x7f9804038a80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9810009990 tx=0x7f9810006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:42.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.901+0000 7f9822901700 1 -- 172.21.15.47:0/3615853766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 msgr2=0x7f981c111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:42.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.901+0000 7f9822901700 1 --2- 172.21.15.47:0/3615853766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 0x7f981c111580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f980c003050 tx=0x7f980c009250 comp rx=0 tx=0).stop 2024-02-07T12:16:42.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.901+0000 7f9822901700 1 -- 172.21.15.47:0/3615853766 shutdown_connections 2024-02-07T12:16:42.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.901+0000 7f9822901700 1 --2- 172.21.15.47:0/3615853766 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f98040365d0 0x7f9804038a80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:42.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.901+0000 7f9822901700 1 --2- 172.21.15.47:0/3615853766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f981c0714a0 0x7f981c111580 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:42.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.901+0000 7f9822901700 1 -- 172.21.15.47:0/3615853766 >> 172.21.15.47:0/3615853766 conn(0x7f981c0fcdd0 msgr2=0x7f981c0fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:42.671 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.901+0000 7f9822901700 1 -- 172.21.15.47:0/3615853766 shutdown_connections 2024-02-07T12:16:42.671 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:41.901+0000 7f9822901700 1 -- 172.21.15.47:0/3615853766 wait complete. 2024-02-07T12:16:42.671 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying mgr service with default placement... 2024-02-07T12:16:42.982 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:42 smithi047 ceph-mon[28972]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:16:42.982 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:42 smithi047 ceph-mon[28972]: Saving service mon spec with placement count:5 2024-02-07T12:16:42.982 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:42 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:43.977 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-07T12:16:43.977 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.121+0000 7f7228592700 1 Processor -- start 2024-02-07T12:16:43.977 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.121+0000 7f7228592700 1 -- start start 2024-02-07T12:16:43.977 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.121+0000 7f7228592700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 0x7f72201053e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:43.977 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.121+0000 7f7228592700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7220105920 con 0x7f7220076bc0 2024-02-07T12:16:43.977 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.121+0000 7f722632e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 0x7f72201053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:43.977 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.121+0000 7f722632e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 0x7f72201053e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45198/0 (socket says 172.21.15.47:45198) 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.122+0000 7f722632e700 1 -- 172.21.15.47:0/1982633570 learned_addr learned my addr 172.21.15.47:0/1982633570 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.122+0000 7f722632e700 1 -- 172.21.15.47:0/1982633570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7220105a60 con 0x7f7220076bc0 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.122+0000 7f722632e700 1 --2- 172.21.15.47:0/1982633570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 0x7f72201053e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f721c0098e0 tx=0x7f721c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4362f8d71ff6d60 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.122+0000 7f722532c700 1 -- 172.21.15.47:0/1982633570 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f721c00b860 con 0x7f7220076bc0 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.122+0000 7f722532c700 1 -- 172.21.15.47:0/1982633570 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f721c00be50 con 0x7f7220076bc0 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.122+0000 7f722532c700 1 -- 172.21.15.47:0/1982633570 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f721c010380 con 0x7f7220076bc0 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.123+0000 7f7228592700 1 -- 172.21.15.47:0/1982633570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 msgr2=0x7f72201053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.123+0000 7f7228592700 1 --2- 172.21.15.47:0/1982633570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 0x7f72201053e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f721c0098e0 tx=0x7f721c009250 comp rx=0 tx=0).stop 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.123+0000 7f7228592700 1 -- 172.21.15.47:0/1982633570 shutdown_connections 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.123+0000 7f7228592700 1 --2- 172.21.15.47:0/1982633570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 0x7f72201053e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.123+0000 7f7228592700 1 -- 172.21.15.47:0/1982633570 >> 172.21.15.47:0/1982633570 conn(0x7f72200fcdd0 msgr2=0x7f72200ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.123+0000 7f7228592700 1 -- 172.21.15.47:0/1982633570 shutdown_connections 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.123+0000 7f7228592700 1 -- 172.21.15.47:0/1982633570 wait complete. 2024-02-07T12:16:43.978 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.123+0000 7f7228592700 1 Processor -- start 2024-02-07T12:16:43.979 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.123+0000 7f7228592700 1 -- start start 2024-02-07T12:16:43.979 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.123+0000 7f7228592700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 0x7f7220111830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:43.979 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.124+0000 7f7228592700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7220111d70 con 0x7f7220076bc0 2024-02-07T12:16:43.979 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.124+0000 7f722632e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 0x7f7220111830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:43.979 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.124+0000 7f722632e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 0x7f7220111830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45206/0 (socket says 172.21.15.47:45206) 2024-02-07T12:16:43.979 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.124+0000 7f722632e700 1 -- 172.21.15.47:0/4173265797 learned_addr learned my addr 172.21.15.47:0/4173265797 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:43.979 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.124+0000 7f722632e700 1 -- 172.21.15.47:0/4173265797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c0094f0 con 0x7f7220076bc0 2024-02-07T12:16:43.979 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.124+0000 7f722632e700 1 --2- 172.21.15.47:0/4173265797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 0x7f7220111830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f721c00b440 tx=0x7f721c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:43.979 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.124+0000 7f7216ffd700 1 -- 172.21.15.47:0/4173265797 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f721c0107c0 con 0x7f7220076bc0 2024-02-07T12:16:43.979 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.124+0000 7f7216ffd700 1 -- 172.21.15.47:0/4173265797 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f721c010db0 con 0x7f7220076bc0 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.124+0000 7f7228592700 1 -- 172.21.15.47:0/4173265797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7220111f70 con 0x7f7220076bc0 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.124+0000 7f7216ffd700 1 -- 172.21.15.47:0/4173265797 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f721c01ad30 con 0x7f7220076bc0 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.124+0000 7f7228592700 1 -- 172.21.15.47:0/4173265797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7220112c10 con 0x7f7220076bc0 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.125+0000 7f7216ffd700 1 -- 172.21.15.47:0/4173265797 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f721c010920 con 0x7f7220076bc0 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.125+0000 7f7228592700 1 -- 172.21.15.47:0/4173265797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722005f5c0 con 0x7f7220076bc0 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.125+0000 7f7216ffd700 1 --2- 172.21.15.47:0/4173265797 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f720c036640 0x7f720c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.125+0000 7f7216ffd700 1 -- 172.21.15.47:0/4173265797 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f721c04aa30 con 0x7f7220076bc0 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.125+0000 7f7225b2d700 1 --2- 172.21.15.47:0/4173265797 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f720c036640 0x7f720c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.126+0000 7f7225b2d700 1 --2- 172.21.15.47:0/4173265797 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f720c036640 0x7f720c038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7210009990 tx=0x7f7210006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.130+0000 7f7216ffd700 1 -- 172.21.15.47:0/4173265797 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f721c01a430 con 0x7f7220076bc0 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.334+0000 7f7228592700 1 -- 172.21.15.47:0/4173265797 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f7220106920 con 0x7f720c036640 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.339+0000 7f7216ffd700 1 -- 172.21.15.47:0/4173265797 <== mgr.14120 v2:172.21.15.47:6800/2175635831 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f7220106920 con 0x7f720c036640 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.341+0000 7f7228592700 1 -- 172.21.15.47:0/4173265797 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f720c036640 msgr2=0x7f720c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:43.980 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.341+0000 7f7228592700 1 --2- 172.21.15.47:0/4173265797 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f720c036640 0x7f720c038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7210009990 tx=0x7f7210006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:43.981 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.341+0000 7f7228592700 1 -- 172.21.15.47:0/4173265797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 msgr2=0x7f7220111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:43.981 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.341+0000 7f7228592700 1 --2- 172.21.15.47:0/4173265797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 0x7f7220111830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f721c00b440 tx=0x7f721c009250 comp rx=0 tx=0).stop 2024-02-07T12:16:43.981 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.341+0000 7f7228592700 1 -- 172.21.15.47:0/4173265797 shutdown_connections 2024-02-07T12:16:43.981 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.341+0000 7f7228592700 1 --2- 172.21.15.47:0/4173265797 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f720c036640 0x7f720c038af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:43.981 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.341+0000 7f7228592700 1 --2- 172.21.15.47:0/4173265797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7220076bc0 0x7f7220111830 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:43.981 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.341+0000 7f7228592700 1 -- 172.21.15.47:0/4173265797 >> 172.21.15.47:0/4173265797 conn(0x7f72200fcdd0 msgr2=0x7f72200fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:43.981 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.341+0000 7f7228592700 1 -- 172.21.15.47:0/4173265797 shutdown_connections 2024-02-07T12:16:43.981 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:43.341+0000 7f7228592700 1 -- 172.21.15.47:0/4173265797 wait complete. 2024-02-07T12:16:43.981 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying crash service with default placement... 2024-02-07T12:16:44.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:44 smithi047 ceph-mon[28972]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:16:44.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:44 smithi047 ceph-mon[28972]: Saving service mgr spec with placement count:2 2024-02-07T12:16:44.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:44 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:45.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-02-07T12:16:45.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.065+0000 7fd549c43700 1 Processor -- start 2024-02-07T12:16:45.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.065+0000 7fd549c43700 1 -- start start 2024-02-07T12:16:45.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.065+0000 7fd549c43700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 0x7fd54407cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:45.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.065+0000 7fd549c43700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54407d0f0 con 0x7fd54407c7a0 2024-02-07T12:16:45.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.066+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 0x7fd54407cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:45.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.066+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 0x7fd54407cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45208/0 (socket says 172.21.15.47:45208) 2024-02-07T12:16:45.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.066+0000 7fd5437fe700 1 -- 172.21.15.47:0/3857550053 learned_addr learned my addr 172.21.15.47:0/3857550053 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:45.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.066+0000 7fd5437fe700 1 -- 172.21.15.47:0/3857550053 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54407d230 con 0x7fd54407c7a0 2024-02-07T12:16:45.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.066+0000 7fd5437fe700 1 --2- 172.21.15.47:0/3857550053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 0x7fd54407cbb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5340098e0 tx=0x7fd534009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f7c5fc5bf0791b server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:45.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.066+0000 7fd5427fc700 1 -- 172.21.15.47:0/3857550053 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd53400b860 con 0x7fd54407c7a0 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.066+0000 7fd5427fc700 1 -- 172.21.15.47:0/3857550053 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd53400be90 con 0x7fd54407c7a0 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.066+0000 7fd5427fc700 1 -- 172.21.15.47:0/3857550053 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5340103c0 con 0x7fd54407c7a0 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.067+0000 7fd549c43700 1 -- 172.21.15.47:0/3857550053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 msgr2=0x7fd54407cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.067+0000 7fd549c43700 1 --2- 172.21.15.47:0/3857550053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 0x7fd54407cbb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5340098e0 tx=0x7fd534009250 comp rx=0 tx=0).stop 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.067+0000 7fd549c43700 1 -- 172.21.15.47:0/3857550053 shutdown_connections 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.067+0000 7fd549c43700 1 --2- 172.21.15.47:0/3857550053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 0x7fd54407cbb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.067+0000 7fd549c43700 1 -- 172.21.15.47:0/3857550053 >> 172.21.15.47:0/3857550053 conn(0x7fd544078070 msgr2=0x7fd54407a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.067+0000 7fd549c43700 1 -- 172.21.15.47:0/3857550053 shutdown_connections 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.067+0000 7fd549c43700 1 -- 172.21.15.47:0/3857550053 wait complete. 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.068+0000 7fd549c43700 1 Processor -- start 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.068+0000 7fd549c43700 1 -- start start 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.068+0000 7fd549c43700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 0x7fd544117b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.068+0000 7fd549c43700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5441180a0 con 0x7fd54407c7a0 2024-02-07T12:16:45.896 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.069+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 0x7fd544117b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.069+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 0x7fd544117b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45210/0 (socket says 172.21.15.47:45210) 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.069+0000 7fd5437fe700 1 -- 172.21.15.47:0/400733980 learned_addr learned my addr 172.21.15.47:0/400733980 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.069+0000 7fd5437fe700 1 -- 172.21.15.47:0/400733980 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340094f0 con 0x7fd54407c7a0 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.069+0000 7fd5437fe700 1 --2- 172.21.15.47:0/400733980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 0x7fd544117b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd534003080 tx=0x7fd534009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.069+0000 7fd52bfff700 1 -- 172.21.15.47:0/400733980 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd534011920 con 0x7fd54407c7a0 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.069+0000 7fd549c43700 1 -- 172.21.15.47:0/400733980 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5441182a0 con 0x7fd54407c7a0 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.069+0000 7fd52bfff700 1 -- 172.21.15.47:0/400733980 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd534010d60 con 0x7fd54407c7a0 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.069+0000 7fd52bfff700 1 -- 172.21.15.47:0/400733980 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5340243f0 con 0x7fd54407c7a0 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.069+0000 7fd549c43700 1 -- 172.21.15.47:0/400733980 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd544118f40 con 0x7fd54407c7a0 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.070+0000 7fd52bfff700 1 -- 172.21.15.47:0/400733980 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fd53402d3f0 con 0x7fd54407c7a0 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.070+0000 7fd549c43700 1 -- 172.21.15.47:0/400733980 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54405f5c0 con 0x7fd54407c7a0 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.070+0000 7fd52bfff700 1 --2- 172.21.15.47:0/400733980 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fd52c036640 0x7fd52c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.071+0000 7fd52bfff700 1 -- 172.21.15.47:0/400733980 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd53404a140 con 0x7fd54407c7a0 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.071+0000 7fd542ffd700 1 --2- 172.21.15.47:0/400733980 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fd52c036640 0x7fd52c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:45.897 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.071+0000 7fd542ffd700 1 --2- 172.21.15.47:0/400733980 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fd52c036640 0x7fd52c038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd538009990 tx=0x7fd538006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.075+0000 7fd52bfff700 1 -- 172.21.15.47:0/400733980 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd53402b8e0 con 0x7fd54407c7a0 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.298+0000 7fd549c43700 1 -- 172.21.15.47:0/400733980 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fd54407b360 con 0x7fd52c036640 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.302+0000 7fd52bfff700 1 -- 172.21.15.47:0/400733980 <== mgr.14120 v2:172.21.15.47:6800/2175635831 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fd54407b360 con 0x7fd52c036640 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.305+0000 7fd549c43700 1 -- 172.21.15.47:0/400733980 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fd52c036640 msgr2=0x7fd52c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.305+0000 7fd549c43700 1 --2- 172.21.15.47:0/400733980 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fd52c036640 0x7fd52c038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd538009990 tx=0x7fd538006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.305+0000 7fd549c43700 1 -- 172.21.15.47:0/400733980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 msgr2=0x7fd544117b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.305+0000 7fd549c43700 1 --2- 172.21.15.47:0/400733980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 0x7fd544117b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd534003080 tx=0x7fd534009250 comp rx=0 tx=0).stop 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.306+0000 7fd549c43700 1 -- 172.21.15.47:0/400733980 shutdown_connections 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.306+0000 7fd549c43700 1 --2- 172.21.15.47:0/400733980 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fd52c036640 0x7fd52c038af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.306+0000 7fd549c43700 1 --2- 172.21.15.47:0/400733980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54407c7a0 0x7fd544117b60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.306+0000 7fd549c43700 1 -- 172.21.15.47:0/400733980 >> 172.21.15.47:0/400733980 conn(0x7fd544078070 msgr2=0x7fd54407a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.306+0000 7fd549c43700 1 -- 172.21.15.47:0/400733980 shutdown_connections 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:45.306+0000 7fd549c43700 1 -- 172.21.15.47:0/400733980 wait complete. 2024-02-07T12:16:45.898 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying prometheus service with default placement... 2024-02-07T12:16:46.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:45 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:46.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:45 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:46.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:45 smithi047 ceph-mon[28972]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:16:46.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:45 smithi047 ceph-mon[28972]: Saving service crash spec with placement * 2024-02-07T12:16:46.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:45 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:47.641 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:47 smithi047 ceph-mon[28972]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:16:47.641 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:47 smithi047 ceph-mon[28972]: Saving service prometheus spec with placement count:1 2024-02-07T12:16:47.642 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:47 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:47.642 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:47 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:47.647 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-02-07T12:16:47.647 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.364+0000 7fc84914a700 1 Processor -- start 2024-02-07T12:16:47.647 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.364+0000 7fc84914a700 1 -- start start 2024-02-07T12:16:47.647 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.365+0000 7fc84914a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 0x7fc844102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:47.647 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.365+0000 7fc84914a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8441030c0 con 0x7fc844102770 2024-02-07T12:16:47.647 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.365+0000 7fc842d9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 0x7fc844102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:47.647 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.365+0000 7fc842d9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 0x7fc844102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45218/0 (socket says 172.21.15.47:45218) 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.365+0000 7fc842d9d700 1 -- 172.21.15.47:0/1306921830 learned_addr learned my addr 172.21.15.47:0/1306921830 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.365+0000 7fc842d9d700 1 -- 172.21.15.47:0/1306921830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc844103200 con 0x7fc844102770 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.365+0000 7fc842d9d700 1 --2- 172.21.15.47:0/1306921830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 0x7fc844102b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc8340098e0 tx=0x7fc834009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108e9785c0c1b15f server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.365+0000 7fc841d9b700 1 -- 172.21.15.47:0/1306921830 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc83400b860 con 0x7fc844102770 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.365+0000 7fc841d9b700 1 -- 172.21.15.47:0/1306921830 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc83400be90 con 0x7fc844102770 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.365+0000 7fc841d9b700 1 -- 172.21.15.47:0/1306921830 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8340103c0 con 0x7fc844102770 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.366+0000 7fc84914a700 1 -- 172.21.15.47:0/1306921830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 msgr2=0x7fc844102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.366+0000 7fc84914a700 1 --2- 172.21.15.47:0/1306921830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 0x7fc844102b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc8340098e0 tx=0x7fc834009250 comp rx=0 tx=0).stop 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.366+0000 7fc84914a700 1 -- 172.21.15.47:0/1306921830 shutdown_connections 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.366+0000 7fc84914a700 1 --2- 172.21.15.47:0/1306921830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 0x7fc844102b80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.366+0000 7fc84914a700 1 -- 172.21.15.47:0/1306921830 >> 172.21.15.47:0/1306921830 conn(0x7fc8440fded0 msgr2=0x7fc844100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.366+0000 7fc84914a700 1 -- 172.21.15.47:0/1306921830 shutdown_connections 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.366+0000 7fc84914a700 1 -- 172.21.15.47:0/1306921830 wait complete. 2024-02-07T12:16:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.367+0000 7fc84914a700 1 Processor -- start 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.367+0000 7fc84914a700 1 -- start start 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.367+0000 7fc84914a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 0x7fc844111540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.367+0000 7fc84914a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc844111a80 con 0x7fc844102770 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.367+0000 7fc842d9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 0x7fc844111540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.367+0000 7fc842d9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 0x7fc844111540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45224/0 (socket says 172.21.15.47:45224) 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.367+0000 7fc842d9d700 1 -- 172.21.15.47:0/1423450584 learned_addr learned my addr 172.21.15.47:0/1423450584 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.368+0000 7fc842d9d700 1 -- 172.21.15.47:0/1423450584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340094f0 con 0x7fc844102770 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.368+0000 7fc842d9d700 1 --2- 172.21.15.47:0/1423450584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 0x7fc844111540 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc834006b00 tx=0x7fc834009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.368+0000 7fc83b7fe700 1 -- 172.21.15.47:0/1423450584 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8340109a0 con 0x7fc844102770 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.368+0000 7fc83b7fe700 1 -- 172.21.15.47:0/1423450584 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc83401a430 con 0x7fc844102770 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.368+0000 7fc84914a700 1 -- 172.21.15.47:0/1423450584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc844111c80 con 0x7fc844102770 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.368+0000 7fc83b7fe700 1 -- 172.21.15.47:0/1423450584 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8340245b0 con 0x7fc844102770 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.368+0000 7fc84914a700 1 -- 172.21.15.47:0/1423450584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc844112920 con 0x7fc844102770 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.369+0000 7fc83b7fe700 1 -- 172.21.15.47:0/1423450584 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc834024820 con 0x7fc844102770 2024-02-07T12:16:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.369+0000 7fc83b7fe700 1 --2- 172.21.15.47:0/1423450584 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fc830036640 0x7fc830038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.369+0000 7fc83b7fe700 1 -- 172.21.15.47:0/1423450584 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc83404a480 con 0x7fc844102770 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.369+0000 7fc84259c700 1 --2- 172.21.15.47:0/1423450584 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fc830036640 0x7fc830038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.369+0000 7fc84914a700 1 -- 172.21.15.47:0/1423450584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84405f5c0 con 0x7fc844102770 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.370+0000 7fc84259c700 1 --2- 172.21.15.47:0/1423450584 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fc830036640 0x7fc830038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009990 tx=0x7fc82c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.374+0000 7fc83b7fe700 1 -- 172.21.15.47:0/1423450584 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc83402c340 con 0x7fc844102770 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.611+0000 7fc84914a700 1 -- 172.21.15.47:0/1423450584 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8440ff3a0 con 0x7fc830036640 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.615+0000 7fc83b7fe700 1 -- 172.21.15.47:0/1423450584 <== mgr.14120 v2:172.21.15.47:6800/2175635831 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fc8440ff3a0 con 0x7fc830036640 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.617+0000 7fc84914a700 1 -- 172.21.15.47:0/1423450584 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fc830036640 msgr2=0x7fc830038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.617+0000 7fc84914a700 1 --2- 172.21.15.47:0/1423450584 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fc830036640 0x7fc830038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009990 tx=0x7fc82c006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.617+0000 7fc84914a700 1 -- 172.21.15.47:0/1423450584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 msgr2=0x7fc844111540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.617+0000 7fc84914a700 1 --2- 172.21.15.47:0/1423450584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 0x7fc844111540 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc834006b00 tx=0x7fc834009250 comp rx=0 tx=0).stop 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.617+0000 7fc84914a700 1 -- 172.21.15.47:0/1423450584 shutdown_connections 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.617+0000 7fc84914a700 1 --2- 172.21.15.47:0/1423450584 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fc830036640 0x7fc830038af0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.617+0000 7fc84914a700 1 --2- 172.21.15.47:0/1423450584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc844102770 0x7fc844111540 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:47.650 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.617+0000 7fc84914a700 1 -- 172.21.15.47:0/1423450584 >> 172.21.15.47:0/1423450584 conn(0x7fc8440fded0 msgr2=0x7fc8440fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:47.651 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.617+0000 7fc84914a700 1 -- 172.21.15.47:0/1423450584 shutdown_connections 2024-02-07T12:16:47.651 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:46.617+0000 7fc84914a700 1 -- 172.21.15.47:0/1423450584 wait complete. 2024-02-07T12:16:47.651 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying grafana service with default placement... 2024-02-07T12:16:48.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-02-07T12:16:48.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.072+0000 7f16e5981700 1 Processor -- start 2024-02-07T12:16:48.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.072+0000 7f16e5981700 1 -- start start 2024-02-07T12:16:48.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.072+0000 7f16e5981700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 0x7f16e0105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:48.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.072+0000 7f16e5981700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e01058a0 con 0x7f16e0076c40 2024-02-07T12:16:48.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.072+0000 7f16deffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 0x7f16e0105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.072+0000 7f16deffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 0x7f16e0105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45238/0 (socket says 172.21.15.47:45238) 2024-02-07T12:16:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.072+0000 7f16deffd700 1 -- 172.21.15.47:0/2647298398 learned_addr learned my addr 172.21.15.47:0/2647298398 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.073+0000 7f16deffd700 1 -- 172.21.15.47:0/2647298398 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e01059e0 con 0x7f16e0076c40 2024-02-07T12:16:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.073+0000 7f16deffd700 1 --2- 172.21.15.47:0/2647298398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 0x7f16e0105360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f16d00098e0 tx=0x7f16d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c275223ba663afa7 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.073+0000 7f16ddffb700 1 -- 172.21.15.47:0/2647298398 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16d000b860 con 0x7f16e0076c40 2024-02-07T12:16:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.073+0000 7f16ddffb700 1 -- 172.21.15.47:0/2647298398 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16d000be90 con 0x7f16e0076c40 2024-02-07T12:16:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.073+0000 7f16ddffb700 1 -- 172.21.15.47:0/2647298398 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16d00103c0 con 0x7f16e0076c40 2024-02-07T12:16:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.074+0000 7f16e5981700 1 -- 172.21.15.47:0/2647298398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 msgr2=0x7f16e0105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.074+0000 7f16e5981700 1 --2- 172.21.15.47:0/2647298398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 0x7f16e0105360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f16d00098e0 tx=0x7f16d0009250 comp rx=0 tx=0).stop 2024-02-07T12:16:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.074+0000 7f16e5981700 1 -- 172.21.15.47:0/2647298398 shutdown_connections 2024-02-07T12:16:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.074+0000 7f16e5981700 1 --2- 172.21.15.47:0/2647298398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 0x7f16e0105360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.074+0000 7f16e5981700 1 -- 172.21.15.47:0/2647298398 >> 172.21.15.47:0/2647298398 conn(0x7f16e00fcdd0 msgr2=0x7f16e00ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.074+0000 7f16e5981700 1 -- 172.21.15.47:0/2647298398 shutdown_connections 2024-02-07T12:16:48.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.074+0000 7f16e5981700 1 -- 172.21.15.47:0/2647298398 wait complete. 2024-02-07T12:16:48.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.075+0000 7f16e5981700 1 Processor -- start 2024-02-07T12:16:48.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.075+0000 7f16e5981700 1 -- start start 2024-02-07T12:16:48.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.075+0000 7f16e5981700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 0x7f16e0102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:48.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.075+0000 7f16e5981700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e0101260 con 0x7f16e0076c40 2024-02-07T12:16:48.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.075+0000 7f16deffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 0x7f16e0102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:48.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.075+0000 7f16deffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 0x7f16e0102de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45254/0 (socket says 172.21.15.47:45254) 2024-02-07T12:16:48.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.075+0000 7f16deffd700 1 -- 172.21.15.47:0/1455882355 learned_addr learned my addr 172.21.15.47:0/1455882355 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:48.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.075+0000 7f16deffd700 1 -- 172.21.15.47:0/1455882355 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d00094f0 con 0x7f16e0076c40 2024-02-07T12:16:48.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.076+0000 7f16deffd700 1 --2- 172.21.15.47:0/1455882355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 0x7f16e0102de0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f16d0003080 tx=0x7f16d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:48.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.076+0000 7f16c77fe700 1 -- 172.21.15.47:0/1455882355 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16d0011920 con 0x7f16e0076c40 2024-02-07T12:16:48.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.076+0000 7f16c77fe700 1 -- 172.21.15.47:0/1455882355 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16d0010d60 con 0x7f16e0076c40 2024-02-07T12:16:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.076+0000 7f16e5981700 1 -- 172.21.15.47:0/1455882355 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e0101460 con 0x7f16e0076c40 2024-02-07T12:16:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.076+0000 7f16c77fe700 1 -- 172.21.15.47:0/1455882355 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16d00243f0 con 0x7f16e0076c40 2024-02-07T12:16:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.076+0000 7f16e5981700 1 -- 172.21.15.47:0/1455882355 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e01018f0 con 0x7f16e0076c40 2024-02-07T12:16:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.077+0000 7f16c77fe700 1 -- 172.21.15.47:0/1455882355 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f16d002d3f0 con 0x7f16e0076c40 2024-02-07T12:16:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.077+0000 7f16e5981700 1 -- 172.21.15.47:0/1455882355 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e004bed0 con 0x7f16e0076c40 2024-02-07T12:16:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.077+0000 7f16c77fe700 1 --2- 172.21.15.47:0/1455882355 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f16c80365f0 0x7f16c8038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.077+0000 7f16c77fe700 1 -- 172.21.15.47:0/1455882355 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f16d004a160 con 0x7f16e0076c40 2024-02-07T12:16:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.077+0000 7f16de7fc700 1 --2- 172.21.15.47:0/1455882355 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f16c80365f0 0x7f16c8038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.078+0000 7f16de7fc700 1 --2- 172.21.15.47:0/1455882355 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f16c80365f0 0x7f16c8038aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009990 tx=0x7f16d4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.082+0000 7f16c77fe700 1 -- 172.21.15.47:0/1455882355 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f16d002b8e0 con 0x7f16e0076c40 2024-02-07T12:16:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.287+0000 7f16e5981700 1 -- 172.21.15.47:0/1455882355 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f16e0102130 con 0x7f16c80365f0 2024-02-07T12:16:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.292+0000 7f16c77fe700 1 -- 172.21.15.47:0/1455882355 <== mgr.14120 v2:172.21.15.47:6800/2175635831 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f16e0102130 con 0x7f16c80365f0 2024-02-07T12:16:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.294+0000 7f16e5981700 1 -- 172.21.15.47:0/1455882355 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f16c80365f0 msgr2=0x7f16c8038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:48.926 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.294+0000 7f16e5981700 1 --2- 172.21.15.47:0/1455882355 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f16c80365f0 0x7f16c8038aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009990 tx=0x7f16d4006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:48.926 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.294+0000 7f16e5981700 1 -- 172.21.15.47:0/1455882355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 msgr2=0x7f16e0102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:48.926 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.294+0000 7f16e5981700 1 --2- 172.21.15.47:0/1455882355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 0x7f16e0102de0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f16d0003080 tx=0x7f16d0009250 comp rx=0 tx=0).stop 2024-02-07T12:16:48.926 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.294+0000 7f16e5981700 1 -- 172.21.15.47:0/1455882355 shutdown_connections 2024-02-07T12:16:48.926 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.294+0000 7f16e5981700 1 --2- 172.21.15.47:0/1455882355 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f16c80365f0 0x7f16c8038aa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:48.926 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.294+0000 7f16e5981700 1 --2- 172.21.15.47:0/1455882355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16e0076c40 0x7f16e0102de0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:48.926 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.294+0000 7f16e5981700 1 -- 172.21.15.47:0/1455882355 >> 172.21.15.47:0/1455882355 conn(0x7f16e00fcdd0 msgr2=0x7f16e00fdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:48.926 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.294+0000 7f16e5981700 1 -- 172.21.15.47:0/1455882355 shutdown_connections 2024-02-07T12:16:48.927 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:48.294+0000 7f16e5981700 1 -- 172.21.15.47:0/1455882355 wait complete. 2024-02-07T12:16:48.927 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying node-exporter service with default placement... 2024-02-07T12:16:49.248 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:49 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:49.248 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:49 smithi047 ceph-mon[28972]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:16:49.248 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:49 smithi047 ceph-mon[28972]: Saving service grafana spec with placement count:1 2024-02-07T12:16:49.248 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:49 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:50.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:50 smithi047 ceph-mon[28972]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:16:50.606 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:50 smithi047 ceph-mon[28972]: Saving service node-exporter spec with placement * 2024-02-07T12:16:50.606 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:50 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:50.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-02-07T12:16:50.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.348+0000 7f3239cf7700 1 Processor -- start 2024-02-07T12:16:50.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.348+0000 7f3239cf7700 1 -- start start 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.349+0000 7f3239cf7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 0x7f3234102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.349+0000 7f3239cf7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32341030c0 con 0x7f3234102770 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.349+0000 7f32337fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 0x7f3234102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.349+0000 7f32337fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 0x7f3234102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45258/0 (socket says 172.21.15.47:45258) 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.349+0000 7f32337fe700 1 -- 172.21.15.47:0/2707409097 learned_addr learned my addr 172.21.15.47:0/2707409097 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.349+0000 7f32337fe700 1 -- 172.21.15.47:0/2707409097 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3234103200 con 0x7f3234102770 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.349+0000 7f32337fe700 1 --2- 172.21.15.47:0/2707409097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 0x7f3234102b80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32240098e0 tx=0x7f3224009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0715621dfd8bbf2 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.350+0000 7f32327fc700 1 -- 172.21.15.47:0/2707409097 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f322400b860 con 0x7f3234102770 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.350+0000 7f32327fc700 1 -- 172.21.15.47:0/2707409097 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f322400be90 con 0x7f3234102770 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.350+0000 7f32327fc700 1 -- 172.21.15.47:0/2707409097 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32240103c0 con 0x7f3234102770 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.350+0000 7f3239cf7700 1 -- 172.21.15.47:0/2707409097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 msgr2=0x7f3234102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.350+0000 7f3239cf7700 1 --2- 172.21.15.47:0/2707409097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 0x7f3234102b80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32240098e0 tx=0x7f3224009250 comp rx=0 tx=0).stop 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.350+0000 7f3239cf7700 1 -- 172.21.15.47:0/2707409097 shutdown_connections 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.350+0000 7f3239cf7700 1 --2- 172.21.15.47:0/2707409097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 0x7f3234102b80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:50.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.350+0000 7f3239cf7700 1 -- 172.21.15.47:0/2707409097 >> 172.21.15.47:0/2707409097 conn(0x7f32340fded0 msgr2=0x7f3234100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.350+0000 7f3239cf7700 1 -- 172.21.15.47:0/2707409097 shutdown_connections 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.350+0000 7f3239cf7700 1 -- 172.21.15.47:0/2707409097 wait complete. 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.351+0000 7f3239cf7700 1 Processor -- start 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.351+0000 7f3239cf7700 1 -- start start 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.351+0000 7f3239cf7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 0x7f32341115b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.351+0000 7f3239cf7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3234111af0 con 0x7f3234102770 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.351+0000 7f32337fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 0x7f32341115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.351+0000 7f32337fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 0x7f32341115b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45274/0 (socket says 172.21.15.47:45274) 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.351+0000 7f32337fe700 1 -- 172.21.15.47:0/1114151099 learned_addr learned my addr 172.21.15.47:0/1114151099 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.352+0000 7f32337fe700 1 -- 172.21.15.47:0/1114151099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32240094f0 con 0x7f3234102770 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.352+0000 7f32337fe700 1 --2- 172.21.15.47:0/1114151099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 0x7f32341115b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32240090b0 tx=0x7f3224009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.352+0000 7f321bfff700 1 -- 172.21.15.47:0/1114151099 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3224010840 con 0x7f3234102770 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.352+0000 7f3239cf7700 1 -- 172.21.15.47:0/1114151099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3234111cf0 con 0x7f3234102770 2024-02-07T12:16:50.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.352+0000 7f321bfff700 1 -- 172.21.15.47:0/1114151099 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3224010e70 con 0x7f3234102770 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.352+0000 7f321bfff700 1 -- 172.21.15.47:0/1114151099 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3224024e40 con 0x7f3234102770 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.352+0000 7f3239cf7700 1 -- 172.21.15.47:0/1114151099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3234112990 con 0x7f3234102770 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.353+0000 7f321bfff700 1 -- 172.21.15.47:0/1114151099 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f322401a530 con 0x7f3234102770 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.353+0000 7f321bfff700 1 --2- 172.21.15.47:0/1114151099 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f321c0365a0 0x7f321c038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.353+0000 7f321bfff700 1 -- 172.21.15.47:0/1114151099 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f322404a5f0 con 0x7f3234102770 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.353+0000 7f3239cf7700 1 -- 172.21.15.47:0/1114151099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323405f5c0 con 0x7f3234102770 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.353+0000 7f3232ffd700 1 --2- 172.21.15.47:0/1114151099 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f321c0365a0 0x7f321c038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.353+0000 7f3232ffd700 1 --2- 172.21.15.47:0/1114151099 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f321c0365a0 0x7f321c038a50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3228009990 tx=0x7f3228006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.358+0000 7f321bfff700 1 -- 172.21.15.47:0/1114151099 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3224018940 con 0x7f3234102770 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.592+0000 7f3239cf7700 1 -- 172.21.15.47:0/1114151099 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f32341001b0 con 0x7f321c0365a0 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.596+0000 7f321bfff700 1 -- 172.21.15.47:0/1114151099 <== mgr.14120 v2:172.21.15.47:6800/2175635831 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f32341001b0 con 0x7f321c0365a0 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.598+0000 7f3239cf7700 1 -- 172.21.15.47:0/1114151099 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f321c0365a0 msgr2=0x7f321c038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.598+0000 7f3239cf7700 1 --2- 172.21.15.47:0/1114151099 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f321c0365a0 0x7f321c038a50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3228009990 tx=0x7f3228006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:50.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.598+0000 7f3239cf7700 1 -- 172.21.15.47:0/1114151099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 msgr2=0x7f32341115b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:50.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.598+0000 7f3239cf7700 1 --2- 172.21.15.47:0/1114151099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 0x7f32341115b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32240090b0 tx=0x7f3224009250 comp rx=0 tx=0).stop 2024-02-07T12:16:50.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.598+0000 7f3239cf7700 1 -- 172.21.15.47:0/1114151099 shutdown_connections 2024-02-07T12:16:50.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.598+0000 7f3239cf7700 1 --2- 172.21.15.47:0/1114151099 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f321c0365a0 0x7f321c038a50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:50.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.598+0000 7f3239cf7700 1 --2- 172.21.15.47:0/1114151099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3234102770 0x7f32341115b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:50.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.598+0000 7f3239cf7700 1 -- 172.21.15.47:0/1114151099 >> 172.21.15.47:0/1114151099 conn(0x7f32340fded0 msgr2=0x7f32340ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:50.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.598+0000 7f3239cf7700 1 -- 172.21.15.47:0/1114151099 shutdown_connections 2024-02-07T12:16:50.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:49.598+0000 7f3239cf7700 1 -- 172.21.15.47:0/1114151099 wait complete. 2024-02-07T12:16:50.618 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying alertmanager service with default placement... 2024-02-07T12:16:52.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:51 smithi047 ceph-mon[28972]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:16:52.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:51 smithi047 ceph-mon[28972]: from='mgr.14120 172.21.15.47:0/1908409834' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:16:52.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-02-07T12:16:52.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.369+0000 7f959b7e4700 1 Processor -- start 2024-02-07T12:16:52.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.369+0000 7f959b7e4700 1 -- start start 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.369+0000 7f959b7e4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 0x7f9594102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.369+0000 7f959b7e4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95941030c0 con 0x7f9594102770 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.370+0000 7f9599580700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 0x7f9594102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.370+0000 7f9599580700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 0x7f9594102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52902/0 (socket says 172.21.15.47:52902) 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.370+0000 7f9599580700 1 -- 172.21.15.47:0/4006034633 learned_addr learned my addr 172.21.15.47:0/4006034633 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.370+0000 7f9599580700 1 -- 172.21.15.47:0/4006034633 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9594103200 con 0x7f9594102770 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.370+0000 7f9599580700 1 --2- 172.21.15.47:0/4006034633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 0x7f9594102b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f95880098e0 tx=0x7f9588009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d7341b43e0e59f server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.370+0000 7f9587fff700 1 -- 172.21.15.47:0/4006034633 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f958800b860 con 0x7f9594102770 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.370+0000 7f9587fff700 1 -- 172.21.15.47:0/4006034633 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f958800be90 con 0x7f9594102770 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.370+0000 7f9587fff700 1 -- 172.21.15.47:0/4006034633 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95880103c0 con 0x7f9594102770 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.371+0000 7f959b7e4700 1 -- 172.21.15.47:0/4006034633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 msgr2=0x7f9594102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.371+0000 7f959b7e4700 1 --2- 172.21.15.47:0/4006034633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 0x7f9594102b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f95880098e0 tx=0x7f9588009250 comp rx=0 tx=0).stop 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.371+0000 7f959b7e4700 1 -- 172.21.15.47:0/4006034633 shutdown_connections 2024-02-07T12:16:52.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.371+0000 7f959b7e4700 1 --2- 172.21.15.47:0/4006034633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 0x7f9594102b80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.371+0000 7f959b7e4700 1 -- 172.21.15.47:0/4006034633 >> 172.21.15.47:0/4006034633 conn(0x7f95940fded0 msgr2=0x7f9594100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.371+0000 7f959b7e4700 1 -- 172.21.15.47:0/4006034633 shutdown_connections 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.371+0000 7f959b7e4700 1 -- 172.21.15.47:0/4006034633 wait complete. 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.371+0000 7f959b7e4700 1 Processor -- start 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.372+0000 7f959b7e4700 1 -- start start 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.372+0000 7f959b7e4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 0x7f9594078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.372+0000 7f959b7e4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9594077190 con 0x7f9594102770 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.372+0000 7f9599580700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 0x7f9594078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.372+0000 7f9599580700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 0x7f9594078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52904/0 (socket says 172.21.15.47:52904) 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.372+0000 7f9599580700 1 -- 172.21.15.47:0/2798577999 learned_addr learned my addr 172.21.15.47:0/2798577999 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.372+0000 7f9599580700 1 -- 172.21.15.47:0/2798577999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95880094f0 con 0x7f9594102770 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.372+0000 7f9599580700 1 --2- 172.21.15.47:0/2798577999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 0x7f9594078d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f95880090b0 tx=0x7f9588009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.372+0000 7f9585ffb700 1 -- 172.21.15.47:0/2798577999 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9588010840 con 0x7f9594102770 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.372+0000 7f9585ffb700 1 -- 172.21.15.47:0/2798577999 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9588010e70 con 0x7f9594102770 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.372+0000 7f959b7e4700 1 -- 172.21.15.47:0/2798577999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9594077390 con 0x7f9594102770 2024-02-07T12:16:52.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.372+0000 7f9585ffb700 1 -- 172.21.15.47:0/2798577999 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9588024e40 con 0x7f9594102770 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.373+0000 7f959b7e4700 1 -- 172.21.15.47:0/2798577999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9594077820 con 0x7f9594102770 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.373+0000 7f9585ffb700 1 -- 172.21.15.47:0/2798577999 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f9588024430 con 0x7f9594102770 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.374+0000 7f959b7e4700 1 -- 172.21.15.47:0/2798577999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959404bed0 con 0x7f9594102770 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.374+0000 7f9585ffb700 1 --2- 172.21.15.47:0/2798577999 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f95800365f0 0x7f9580038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.374+0000 7f9585ffb700 1 -- 172.21.15.47:0/2798577999 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f958804a590 con 0x7f9594102770 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.374+0000 7f9598d7f700 1 --2- 172.21.15.47:0/2798577999 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f95800365f0 0x7f9580038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.374+0000 7f9598d7f700 1 --2- 172.21.15.47:0/2798577999 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f95800365f0 0x7f9580038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9590009990 tx=0x7f9590006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.379+0000 7f9585ffb700 1 -- 172.21.15.47:0/2798577999 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f958802c930 con 0x7f9594102770 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.581+0000 7f959b7e4700 1 -- 172.21.15.47:0/2798577999 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f9594077fa0 con 0x7f95800365f0 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.585+0000 7f9585ffb700 1 -- 172.21.15.47:0/2798577999 <== mgr.14120 v2:172.21.15.47:6800/2175635831 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f9594077fa0 con 0x7f95800365f0 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.588+0000 7f959b7e4700 1 -- 172.21.15.47:0/2798577999 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f95800365f0 msgr2=0x7f9580038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.588+0000 7f959b7e4700 1 --2- 172.21.15.47:0/2798577999 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f95800365f0 0x7f9580038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9590009990 tx=0x7f9590006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.588+0000 7f959b7e4700 1 -- 172.21.15.47:0/2798577999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 msgr2=0x7f9594078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.588+0000 7f959b7e4700 1 --2- 172.21.15.47:0/2798577999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 0x7f9594078d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f95880090b0 tx=0x7f9588009250 comp rx=0 tx=0).stop 2024-02-07T12:16:52.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.588+0000 7f959b7e4700 1 -- 172.21.15.47:0/2798577999 shutdown_connections 2024-02-07T12:16:52.283 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.588+0000 7f959b7e4700 1 --2- 172.21.15.47:0/2798577999 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f95800365f0 0x7f9580038aa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:52.283 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.588+0000 7f959b7e4700 1 --2- 172.21.15.47:0/2798577999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9594102770 0x7f9594078d10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:52.283 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.588+0000 7f959b7e4700 1 -- 172.21.15.47:0/2798577999 >> 172.21.15.47:0/2798577999 conn(0x7f95940fded0 msgr2=0x7f95940ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:52.283 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.588+0000 7f959b7e4700 1 -- 172.21.15.47:0/2798577999 shutdown_connections 2024-02-07T12:16:52.283 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:51.588+0000 7f959b7e4700 1 -- 172.21.15.47:0/2798577999 wait complete. 2024-02-07T12:16:53.211 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:52 smithi047 ceph-mon[28972]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:16:53.211 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:52 smithi047 ceph-mon[28972]: Saving service alertmanager spec with placement count:1 2024-02-07T12:16:53.211 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:52 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/911735839' entity='client.admin' 2024-02-07T12:16:53.486 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.702+0000 7fecf8f74700 1 Processor -- start 2024-02-07T12:16:53.487 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.702+0000 7fecf8f74700 1 -- start start 2024-02-07T12:16:53.487 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.703+0000 7fecf8f74700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 0x7fecf4105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:53.487 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.703+0000 7fecf8f74700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf41058a0 con 0x7fecf40714a0 2024-02-07T12:16:53.487 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.703+0000 7fecf259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 0x7fecf4105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:53.487 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.703+0000 7fecf259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 0x7fecf4105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52910/0 (socket says 172.21.15.47:52910) 2024-02-07T12:16:53.487 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.703+0000 7fecf259c700 1 -- 172.21.15.47:0/3773605159 learned_addr learned my addr 172.21.15.47:0/3773605159 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:53.487 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.703+0000 7fecf259c700 1 -- 172.21.15.47:0/3773605159 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf41059e0 con 0x7fecf40714a0 2024-02-07T12:16:53.487 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.703+0000 7fecf259c700 1 --2- 172.21.15.47:0/3773605159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 0x7fecf4105360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fece40098e0 tx=0x7fece4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82bba817d17ee38 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:53.487 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.704+0000 7fecf159a700 1 -- 172.21.15.47:0/3773605159 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fece400b860 con 0x7fecf40714a0 2024-02-07T12:16:53.487 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.704+0000 7fecf159a700 1 -- 172.21.15.47:0/3773605159 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fece400be90 con 0x7fecf40714a0 2024-02-07T12:16:53.487 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.704+0000 7fecf159a700 1 -- 172.21.15.47:0/3773605159 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fece40103c0 con 0x7fecf40714a0 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.704+0000 7fecf8f74700 1 -- 172.21.15.47:0/3773605159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 msgr2=0x7fecf4105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.704+0000 7fecf8f74700 1 --2- 172.21.15.47:0/3773605159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 0x7fecf4105360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fece40098e0 tx=0x7fece4009250 comp rx=0 tx=0).stop 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.704+0000 7fecf8f74700 1 -- 172.21.15.47:0/3773605159 shutdown_connections 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.704+0000 7fecf8f74700 1 --2- 172.21.15.47:0/3773605159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 0x7fecf4105360 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.704+0000 7fecf8f74700 1 -- 172.21.15.47:0/3773605159 >> 172.21.15.47:0/3773605159 conn(0x7fecf40fcdd0 msgr2=0x7fecf40ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.704+0000 7fecf8f74700 1 -- 172.21.15.47:0/3773605159 shutdown_connections 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.704+0000 7fecf8f74700 1 -- 172.21.15.47:0/3773605159 wait complete. 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.705+0000 7fecf8f74700 1 Processor -- start 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.705+0000 7fecf8f74700 1 -- start start 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.705+0000 7fecf8f74700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 0x7fecf41115e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.705+0000 7fecf8f74700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf4111b20 con 0x7fecf40714a0 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.705+0000 7fecf259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 0x7fecf41115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.705+0000 7fecf259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 0x7fecf41115e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52922/0 (socket says 172.21.15.47:52922) 2024-02-07T12:16:53.488 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.705+0000 7fecf259c700 1 -- 172.21.15.47:0/911735839 learned_addr learned my addr 172.21.15.47:0/911735839 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.706+0000 7fecf259c700 1 -- 172.21.15.47:0/911735839 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece40094f0 con 0x7fecf40714a0 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.706+0000 7fecf259c700 1 --2- 172.21.15.47:0/911735839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 0x7fecf41115e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fece40094c0 tx=0x7fece4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.706+0000 7fece2ffd700 1 -- 172.21.15.47:0/911735839 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fece4010890 con 0x7fecf40714a0 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.706+0000 7fecf8f74700 1 -- 172.21.15.47:0/911735839 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf4111d20 con 0x7fecf40714a0 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.706+0000 7fece2ffd700 1 -- 172.21.15.47:0/911735839 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fece4010ec0 con 0x7fecf40714a0 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.706+0000 7fece2ffd700 1 -- 172.21.15.47:0/911735839 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fece40243f0 con 0x7fecf40714a0 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.706+0000 7fecf8f74700 1 -- 172.21.15.47:0/911735839 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf41129c0 con 0x7fecf40714a0 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.707+0000 7fece2ffd700 1 -- 172.21.15.47:0/911735839 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fece40109f0 con 0x7fecf40714a0 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.707+0000 7fecf8f74700 1 -- 172.21.15.47:0/911735839 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf405f5c0 con 0x7fecf40714a0 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.707+0000 7fece2ffd700 1 --2- 172.21.15.47:0/911735839 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fecdc0365f0 0x7fecdc038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.707+0000 7fece2ffd700 1 -- 172.21.15.47:0/911735839 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fece404a0a0 con 0x7fecf40714a0 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.707+0000 7fecf1d9b700 1 --2- 172.21.15.47:0/911735839 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fecdc0365f0 0x7fecdc038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.708+0000 7fecf1d9b700 1 --2- 172.21.15.47:0/911735839 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fecdc0365f0 0x7fecdc038aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fece8009990 tx=0x7fece8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.712+0000 7fece2ffd700 1 -- 172.21.15.47:0/911735839 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fece402b670 con 0x7fecf40714a0 2024-02-07T12:16:53.490 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.904+0000 7fecf8f74700 1 -- 172.21.15.47:0/911735839 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fecf404bed0 con 0x7fecf40714a0 2024-02-07T12:16:53.490 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.908+0000 7fece2ffd700 1 -- 172.21.15.47:0/911735839 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fece402b880 con 0x7fecf40714a0 2024-02-07T12:16:53.490 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.910+0000 7fecf8f74700 1 -- 172.21.15.47:0/911735839 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fecdc0365f0 msgr2=0x7fecdc038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:53.490 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.910+0000 7fecf8f74700 1 --2- 172.21.15.47:0/911735839 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fecdc0365f0 0x7fecdc038aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fece8009990 tx=0x7fece8006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:53.490 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.910+0000 7fecf8f74700 1 -- 172.21.15.47:0/911735839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 msgr2=0x7fecf41115e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:53.490 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.910+0000 7fecf8f74700 1 --2- 172.21.15.47:0/911735839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 0x7fecf41115e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fece40094c0 tx=0x7fece4009250 comp rx=0 tx=0).stop 2024-02-07T12:16:53.490 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.911+0000 7fecf8f74700 1 -- 172.21.15.47:0/911735839 shutdown_connections 2024-02-07T12:16:53.490 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.911+0000 7fecf8f74700 1 --2- 172.21.15.47:0/911735839 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fecdc0365f0 0x7fecdc038aa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:53.490 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.911+0000 7fecf8f74700 1 --2- 172.21.15.47:0/911735839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecf40714a0 0x7fecf41115e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:53.490 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.911+0000 7fecf8f74700 1 -- 172.21.15.47:0/911735839 >> 172.21.15.47:0/911735839 conn(0x7fecf40fcdd0 msgr2=0x7fecf40fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:53.490 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.911+0000 7fecf8f74700 1 -- 172.21.15.47:0/911735839 shutdown_connections 2024-02-07T12:16:53.490 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:52.911+0000 7fecf8f74700 1 -- 172.21.15.47:0/911735839 wait complete. 2024-02-07T12:16:54.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:53 smithi047 ceph-mon[28972]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:16:54.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.885+0000 7fa32bfc0700 1 Processor -- start 2024-02-07T12:16:54.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.885+0000 7fa32bfc0700 1 -- start start 2024-02-07T12:16:54.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.885+0000 7fa32bfc0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 0x7fa324101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:54.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.885+0000 7fa32bfc0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa324101fc0 con 0x7fa324101670 2024-02-07T12:16:54.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.885+0000 7fa329d5c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 0x7fa324101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:54.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.885+0000 7fa329d5c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 0x7fa324101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52928/0 (socket says 172.21.15.47:52928) 2024-02-07T12:16:54.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.885+0000 7fa329d5c700 1 -- 172.21.15.47:0/2607420420 learned_addr learned my addr 172.21.15.47:0/2607420420 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:54.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.886+0000 7fa329d5c700 1 -- 172.21.15.47:0/2607420420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa324102100 con 0x7fa324101670 2024-02-07T12:16:54.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.886+0000 7fa329d5c700 1 --2- 172.21.15.47:0/2607420420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 0x7fa324101a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa3200098e0 tx=0x7fa320009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f7a3d8706f8e88 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:54.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.886+0000 7fa328d5a700 1 -- 172.21.15.47:0/2607420420 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa32000b860 con 0x7fa324101670 2024-02-07T12:16:54.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.886+0000 7fa328d5a700 1 -- 172.21.15.47:0/2607420420 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa32000be90 con 0x7fa324101670 2024-02-07T12:16:54.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.886+0000 7fa328d5a700 1 -- 172.21.15.47:0/2607420420 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3200103c0 con 0x7fa324101670 2024-02-07T12:16:54.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.886+0000 7fa32bfc0700 1 -- 172.21.15.47:0/2607420420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 msgr2=0x7fa324101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:54.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.886+0000 7fa32bfc0700 1 --2- 172.21.15.47:0/2607420420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 0x7fa324101a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa3200098e0 tx=0x7fa320009250 comp rx=0 tx=0).stop 2024-02-07T12:16:54.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.887+0000 7fa32bfc0700 1 -- 172.21.15.47:0/2607420420 shutdown_connections 2024-02-07T12:16:54.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.887+0000 7fa32bfc0700 1 --2- 172.21.15.47:0/2607420420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 0x7fa324101a80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:54.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.887+0000 7fa32bfc0700 1 -- 172.21.15.47:0/2607420420 >> 172.21.15.47:0/2607420420 conn(0x7fa3240fcdd0 msgr2=0x7fa3240ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.887+0000 7fa32bfc0700 1 -- 172.21.15.47:0/2607420420 shutdown_connections 2024-02-07T12:16:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.887+0000 7fa32bfc0700 1 -- 172.21.15.47:0/2607420420 wait complete. 2024-02-07T12:16:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.887+0000 7fa32bfc0700 1 Processor -- start 2024-02-07T12:16:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.887+0000 7fa32bfc0700 1 -- start start 2024-02-07T12:16:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.887+0000 7fa32bfc0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 0x7fa324113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.887+0000 7fa32bfc0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa324113cb0 con 0x7fa324101670 2024-02-07T12:16:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.887+0000 7fa329d5c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 0x7fa324113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.887+0000 7fa329d5c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 0x7fa324113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52934/0 (socket says 172.21.15.47:52934) 2024-02-07T12:16:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.888+0000 7fa329d5c700 1 -- 172.21.15.47:0/1089131309 learned_addr learned my addr 172.21.15.47:0/1089131309 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.888+0000 7fa329d5c700 1 -- 172.21.15.47:0/1089131309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3200094f0 con 0x7fa324101670 2024-02-07T12:16:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.888+0000 7fa329d5c700 1 --2- 172.21.15.47:0/1089131309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 0x7fa324113770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa320011650 tx=0x7fa320009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.888+0000 7fa31a7fc700 1 -- 172.21.15.47:0/1089131309 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa320010890 con 0x7fa324101670 2024-02-07T12:16:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.888+0000 7fa32bfc0700 1 -- 172.21.15.47:0/1089131309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa324113eb0 con 0x7fa324101670 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.888+0000 7fa31a7fc700 1 -- 172.21.15.47:0/1089131309 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa320010ec0 con 0x7fa324101670 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.888+0000 7fa31a7fc700 1 -- 172.21.15.47:0/1089131309 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa32001a430 con 0x7fa324101670 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.888+0000 7fa32bfc0700 1 -- 172.21.15.47:0/1089131309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa324114b50 con 0x7fa324101670 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.889+0000 7fa31a7fc700 1 -- 172.21.15.47:0/1089131309 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fa3200109f0 con 0x7fa324101670 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.889+0000 7fa32bfc0700 1 -- 172.21.15.47:0/1089131309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32405f5c0 con 0x7fa324101670 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.889+0000 7fa31a7fc700 1 --2- 172.21.15.47:0/1089131309 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fa3100365e0 0x7fa310038a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.889+0000 7fa31a7fc700 1 -- 172.21.15.47:0/1089131309 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa32004a2c0 con 0x7fa324101670 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.889+0000 7fa32955b700 1 --2- 172.21.15.47:0/1089131309 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fa3100365e0 0x7fa310038a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.890+0000 7fa32955b700 1 --2- 172.21.15.47:0/1089131309 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fa3100365e0 0x7fa310038a90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa314009990 tx=0x7fa314006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:53.894+0000 7fa31a7fc700 1 -- 172.21.15.47:0/1089131309 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa3200248e0 con 0x7fa324101670 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:54.084+0000 7fa32bfc0700 1 -- 172.21.15.47:0/1089131309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fa32404bed0 con 0x7fa324101670 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:54.087+0000 7fa31a7fc700 1 -- 172.21.15.47:0/1089131309 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fa320022330 con 0x7fa324101670 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:54.089+0000 7fa32bfc0700 1 -- 172.21.15.47:0/1089131309 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fa3100365e0 msgr2=0x7fa310038a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:54.754 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:54.089+0000 7fa32bfc0700 1 --2- 172.21.15.47:0/1089131309 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fa3100365e0 0x7fa310038a90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa314009990 tx=0x7fa314006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:54.755 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:54.089+0000 7fa32bfc0700 1 -- 172.21.15.47:0/1089131309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 msgr2=0x7fa324113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:54.755 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:54.089+0000 7fa32bfc0700 1 --2- 172.21.15.47:0/1089131309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 0x7fa324113770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa320011650 tx=0x7fa320009250 comp rx=0 tx=0).stop 2024-02-07T12:16:54.755 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:54.089+0000 7fa32bfc0700 1 -- 172.21.15.47:0/1089131309 shutdown_connections 2024-02-07T12:16:54.755 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:54.089+0000 7fa32bfc0700 1 --2- 172.21.15.47:0/1089131309 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7fa3100365e0 0x7fa310038a90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:54.755 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:54.089+0000 7fa32bfc0700 1 --2- 172.21.15.47:0/1089131309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa324101670 0x7fa324113770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:54.755 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:54.089+0000 7fa32bfc0700 1 -- 172.21.15.47:0/1089131309 >> 172.21.15.47:0/1089131309 conn(0x7fa3240fcdd0 msgr2=0x7fa3241063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:54.755 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:54.090+0000 7fa32bfc0700 1 -- 172.21.15.47:0/1089131309 shutdown_connections 2024-02-07T12:16:54.755 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:54.090+0000 7fa32bfc0700 1 -- 172.21.15.47:0/1089131309 wait complete. 2024-02-07T12:16:54.755 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling the dashboard module... 2024-02-07T12:16:55.460 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:55 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1089131309' entity='client.admin' 2024-02-07T12:16:56.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:56 smithi047 ceph-mon[28972]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:16:56.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:56 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1275280274' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-07T12:16:56.749 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.202+0000 7f0a2e7e7700 1 Processor -- start 2024-02-07T12:16:56.749 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.202+0000 7f0a2e7e7700 1 -- start start 2024-02-07T12:16:56.749 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.202+0000 7f0a2e7e7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 0x7f0a280771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:56.749 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.202+0000 7f0a2e7e7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280790f0 con 0x7f0a28078ce0 2024-02-07T12:16:56.749 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.202+0000 7f0a27fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 0x7f0a280771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:56.749 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.202+0000 7f0a27fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 0x7f0a280771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52944/0 (socket says 172.21.15.47:52944) 2024-02-07T12:16:56.749 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.202+0000 7f0a27fff700 1 -- 172.21.15.47:0/804993402 learned_addr learned my addr 172.21.15.47:0/804993402 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:56.749 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.203+0000 7f0a27fff700 1 -- 172.21.15.47:0/804993402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a28077730 con 0x7f0a28078ce0 2024-02-07T12:16:56.749 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.203+0000 7f0a27fff700 1 --2- 172.21.15.47:0/804993402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 0x7f0a280771f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a180098e0 tx=0x7f0a18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902dcd3a9d44a1d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:56.749 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.203+0000 7f0a26ffd700 1 -- 172.21.15.47:0/804993402 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a1800b860 con 0x7f0a28078ce0 2024-02-07T12:16:56.749 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.203+0000 7f0a26ffd700 1 -- 172.21.15.47:0/804993402 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a1800be90 con 0x7f0a28078ce0 2024-02-07T12:16:56.749 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.203+0000 7f0a26ffd700 1 -- 172.21.15.47:0/804993402 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a180103c0 con 0x7f0a28078ce0 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.203+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/804993402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 msgr2=0x7f0a280771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.203+0000 7f0a2e7e7700 1 --2- 172.21.15.47:0/804993402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 0x7f0a280771f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a180098e0 tx=0x7f0a18009250 comp rx=0 tx=0).stop 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.204+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/804993402 shutdown_connections 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.204+0000 7f0a2e7e7700 1 --2- 172.21.15.47:0/804993402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 0x7f0a280771f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.204+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/804993402 >> 172.21.15.47:0/804993402 conn(0x7f0a280fdf00 msgr2=0x7f0a28100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.204+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/804993402 shutdown_connections 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.204+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/804993402 wait complete. 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.204+0000 7f0a2e7e7700 1 Processor -- start 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.204+0000 7f0a2e7e7700 1 -- start start 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.205+0000 7f0a2e7e7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 0x7f0a281137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.205+0000 7f0a2e7e7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a28113d30 con 0x7f0a28078ce0 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.205+0000 7f0a27fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 0x7f0a281137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.205+0000 7f0a27fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 0x7f0a281137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52956/0 (socket says 172.21.15.47:52956) 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.205+0000 7f0a27fff700 1 -- 172.21.15.47:0/1275280274 learned_addr learned my addr 172.21.15.47:0/1275280274 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:56.750 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.205+0000 7f0a27fff700 1 -- 172.21.15.47:0/1275280274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a180094f0 con 0x7f0a28078ce0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.205+0000 7f0a27fff700 1 --2- 172.21.15.47:0/1275280274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 0x7f0a281137f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a18003080 tx=0x7f0a18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.205+0000 7f0a24ff9700 1 -- 172.21.15.47:0/1275280274 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a18011920 con 0x7f0a28078ce0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.205+0000 7f0a24ff9700 1 -- 172.21.15.47:0/1275280274 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a18010d10 con 0x7f0a28078ce0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.205+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/1275280274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a28113f30 con 0x7f0a28078ce0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.205+0000 7f0a24ff9700 1 -- 172.21.15.47:0/1275280274 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a1801ae50 con 0x7f0a28078ce0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.205+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/1275280274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a28114bd0 con 0x7f0a28078ce0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.206+0000 7f0a24ff9700 1 -- 172.21.15.47:0/1275280274 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f0a180244c0 con 0x7f0a28078ce0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.206+0000 7f0a24ff9700 1 --2- 172.21.15.47:0/1275280274 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0a100365f0 0x7f0a10038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.206+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/1275280274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2805f5c0 con 0x7f0a28078ce0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.206+0000 7f0a24ff9700 1 -- 172.21.15.47:0/1275280274 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0a1804a570 con 0x7f0a28078ce0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.206+0000 7f0a277fe700 1 --2- 172.21.15.47:0/1275280274 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0a100365f0 0x7f0a10038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.207+0000 7f0a277fe700 1 --2- 172.21.15.47:0/1275280274 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0a100365f0 0x7f0a10038aa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009990 tx=0x7f0a1c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.211+0000 7f0a24ff9700 1 -- 172.21.15.47:0/1275280274 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0a18023ca0 con 0x7f0a28078ce0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:55.456+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/1275280274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f0a2804bed0 con 0x7f0a28078ce0 2024-02-07T12:16:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:56.088+0000 7f0a24ff9700 1 -- 172.21.15.47:0/1275280274 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f0a1801a730 con 0x7f0a28078ce0 2024-02-07T12:16:56.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:56.090+0000 7f0a24ff9700 1 -- 172.21.15.47:0/1275280274 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f0a18018b70 con 0x7f0a28078ce0 2024-02-07T12:16:56.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:56.093+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/1275280274 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0a100365f0 msgr2=0x7f0a10038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:56.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:56.093+0000 7f0a2e7e7700 1 --2- 172.21.15.47:0/1275280274 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0a100365f0 0x7f0a10038aa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009990 tx=0x7f0a1c006e40 comp rx=0 tx=0).stop 2024-02-07T12:16:56.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:56.093+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/1275280274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 msgr2=0x7f0a281137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:56.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:56.093+0000 7f0a2e7e7700 1 --2- 172.21.15.47:0/1275280274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 0x7f0a281137f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a18003080 tx=0x7f0a18009250 comp rx=0 tx=0).stop 2024-02-07T12:16:56.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:56.093+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/1275280274 shutdown_connections 2024-02-07T12:16:56.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:56.093+0000 7f0a2e7e7700 1 --2- 172.21.15.47:0/1275280274 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0a100365f0 0x7f0a10038aa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:56.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:56.093+0000 7f0a2e7e7700 1 --2- 172.21.15.47:0/1275280274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a28078ce0 0x7f0a281137f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:56.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:56.093+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/1275280274 >> 172.21.15.47:0/1275280274 conn(0x7f0a280fdf00 msgr2=0x7f0a280ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:56.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:56.093+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/1275280274 shutdown_connections 2024-02-07T12:16:56.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:56.093+0000 7f0a2e7e7700 1 -- 172.21.15.47:0/1275280274 wait complete. 2024-02-07T12:16:57.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:57 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1275280274' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-07T12:16:57.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:57 smithi047 ceph-mon[28972]: mgrmap e9: smithi047.zhgnrm(active, since 25s) 2024-02-07T12:16:58.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-02-07T12:16:58.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-07T12:16:58.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-07T12:16:58.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "smithi047.zhgnrm", 2024-02-07T12:16:58.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-07T12:16:58.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-02-07T12:16:58.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.180+0000 7f0af870c700 1 Processor -- start 2024-02-07T12:16:58.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.180+0000 7f0af870c700 1 -- start start 2024-02-07T12:16:58.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.181+0000 7f0af870c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 0x7f0af0105340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:58.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.181+0000 7f0af870c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0105880 con 0x7f0af0076c60 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.181+0000 7f0af64a8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 0x7f0af0105340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.181+0000 7f0af64a8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 0x7f0af0105340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52968/0 (socket says 172.21.15.47:52968) 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.181+0000 7f0af64a8700 1 -- 172.21.15.47:0/331189293 learned_addr learned my addr 172.21.15.47:0/331189293 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.181+0000 7f0af64a8700 1 -- 172.21.15.47:0/331189293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af01059c0 con 0x7f0af0076c60 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.181+0000 7f0af64a8700 1 --2- 172.21.15.47:0/331189293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 0x7f0af0105340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40098e0 tx=0x7f0ae4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e161bf4fab2ab4cd server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.182+0000 7f0af54a6700 1 -- 172.21.15.47:0/331189293 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ae400b860 con 0x7f0af0076c60 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.182+0000 7f0af54a6700 1 -- 172.21.15.47:0/331189293 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ae400be90 con 0x7f0af0076c60 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.182+0000 7f0af54a6700 1 -- 172.21.15.47:0/331189293 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ae40103c0 con 0x7f0af0076c60 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.182+0000 7f0af870c700 1 -- 172.21.15.47:0/331189293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 msgr2=0x7f0af0105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.182+0000 7f0af870c700 1 --2- 172.21.15.47:0/331189293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 0x7f0af0105340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40098e0 tx=0x7f0ae4009250 comp rx=0 tx=0).stop 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.182+0000 7f0af870c700 1 -- 172.21.15.47:0/331189293 shutdown_connections 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.182+0000 7f0af870c700 1 --2- 172.21.15.47:0/331189293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 0x7f0af0105340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.182+0000 7f0af870c700 1 -- 172.21.15.47:0/331189293 >> 172.21.15.47:0/331189293 conn(0x7f0af00fcdd0 msgr2=0x7f0af00ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:58.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.182+0000 7f0af870c700 1 -- 172.21.15.47:0/331189293 shutdown_connections 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.182+0000 7f0af870c700 1 -- 172.21.15.47:0/331189293 wait complete. 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.183+0000 7f0af870c700 1 Processor -- start 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.183+0000 7f0af870c700 1 -- start start 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.183+0000 7f0af870c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 0x7f0af0102dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.183+0000 7f0af870c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0101240 con 0x7f0af0076c60 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.183+0000 7f0af64a8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 0x7f0af0102dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.183+0000 7f0af64a8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 0x7f0af0102dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52978/0 (socket says 172.21.15.47:52978) 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.183+0000 7f0af64a8700 1 -- 172.21.15.47:0/3531241299 learned_addr learned my addr 172.21.15.47:0/3531241299 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.183+0000 7f0af64a8700 1 -- 172.21.15.47:0/3531241299 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae40094f0 con 0x7f0af0076c60 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.183+0000 7f0af64a8700 1 --2- 172.21.15.47:0/3531241299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 0x7f0af0102dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40090b0 tx=0x7f0ae4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.184+0000 7f0ae2ffd700 1 -- 172.21.15.47:0/3531241299 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ae40118f0 con 0x7f0af0076c60 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.184+0000 7f0ae2ffd700 1 -- 172.21.15.47:0/3531241299 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ae4010d10 con 0x7f0af0076c60 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.184+0000 7f0af870c700 1 -- 172.21.15.47:0/3531241299 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af0101440 con 0x7f0af0076c60 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.184+0000 7f0ae2ffd700 1 -- 172.21.15.47:0/3531241299 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ae4024e70 con 0x7f0af0076c60 2024-02-07T12:16:58.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.184+0000 7f0af870c700 1 -- 172.21.15.47:0/3531241299 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af01018d0 con 0x7f0af0076c60 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.185+0000 7f0af870c700 1 -- 172.21.15.47:0/3531241299 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af010b680 con 0x7f0af0076c60 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.185+0000 7f0ae2ffd700 1 -- 172.21.15.47:0/3531241299 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f0ae4024440 con 0x7f0af0076c60 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.185+0000 7f0ae2ffd700 1 --2- 172.21.15.47:0/3531241299 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0adc036640 0x7f0adc038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.185+0000 7f0ae2ffd700 1 -- 172.21.15.47:0/3531241299 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0ae404a3e0 con 0x7f0af0076c60 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.185+0000 7f0af5ca7700 1 -- 172.21.15.47:0/3531241299 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0adc036640 msgr2=0x7f0adc038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2175635831 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.185+0000 7f0af5ca7700 1 --2- 172.21.15.47:0/3531241299 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0adc036640 0x7f0adc038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.194+0000 7f0ae2ffd700 1 -- 172.21.15.47:0/3531241299 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0ae4010e80 con 0x7f0af0076c60 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.386+0000 7f0af5ca7700 1 -- 172.21.15.47:0/3531241299 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0adc036640 msgr2=0x7f0adc038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2175635831 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.386+0000 7f0af5ca7700 1 --2- 172.21.15.47:0/3531241299 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0adc036640 0x7f0adc038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.440+0000 7f0af870c700 1 -- 172.21.15.47:0/3531241299 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f0af0064ad0 con 0x7f0af0076c60 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.440+0000 7f0ae2ffd700 1 -- 172.21.15.47:0/3531241299 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f0ae4022340 con 0x7f0af0076c60 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.442+0000 7f0af870c700 1 -- 172.21.15.47:0/3531241299 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0adc036640 msgr2=0x7f0adc038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.442+0000 7f0af870c700 1 --2- 172.21.15.47:0/3531241299 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0adc036640 0x7f0adc038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:58.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.442+0000 7f0af870c700 1 -- 172.21.15.47:0/3531241299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 msgr2=0x7f0af0102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:16:58.137 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.442+0000 7f0af870c700 1 --2- 172.21.15.47:0/3531241299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 0x7f0af0102dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40090b0 tx=0x7f0ae4009250 comp rx=0 tx=0).stop 2024-02-07T12:16:58.137 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.442+0000 7f0af870c700 1 -- 172.21.15.47:0/3531241299 shutdown_connections 2024-02-07T12:16:58.137 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.442+0000 7f0af870c700 1 --2- 172.21.15.47:0/3531241299 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f0adc036640 0x7f0adc038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:58.137 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.442+0000 7f0af870c700 1 --2- 172.21.15.47:0/3531241299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0af0076c60 0x7f0af0102dc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:16:58.137 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.442+0000 7f0af870c700 1 -- 172.21.15.47:0/3531241299 >> 172.21.15.47:0/3531241299 conn(0x7f0af00fcdd0 msgr2=0x7f0af00ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:16:58.137 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.443+0000 7f0af870c700 1 -- 172.21.15.47:0/3531241299 shutdown_connections 2024-02-07T12:16:58.137 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:57.443+0000 7f0af870c700 1 -- 172.21.15.47:0/3531241299 wait complete. 2024-02-07T12:16:58.137 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-02-07T12:16:58.137 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 9... 2024-02-07T12:16:58.273 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:16:58 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3531241299' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-07T12:17:03.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:02 smithi047 ceph-mon[28972]: Active manager daemon smithi047.zhgnrm restarted 2024-02-07T12:17:03.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:02 smithi047 ceph-mon[28972]: Activating manager daemon smithi047.zhgnrm 2024-02-07T12:17:03.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:02 smithi047 ceph-mon[28972]: osdmap e3: 0 total, 0 up, 0 in 2024-02-07T12:17:03.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:02 smithi047 ceph-mon[28972]: mgrmap e10: smithi047.zhgnrm(active, starting, since 0.00326109s) 2024-02-07T12:17:03.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:02 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:17:03.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:02 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi047.zhgnrm", "id": "smithi047.zhgnrm"}]: dispatch 2024-02-07T12:17:03.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:02 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-07T12:17:03.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:02 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-07T12:17:03.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:02 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-07T12:17:03.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:02 smithi047 ceph-mon[28972]: Manager daemon smithi047.zhgnrm is now available 2024-02-07T12:17:03.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:02 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:17:03.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:02 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:17:04.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:03 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/mirror_snapshot_schedule"}]: dispatch 2024-02-07T12:17:04.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:03 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/trash_purge_schedule"}]: dispatch 2024-02-07T12:17:04.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:03 smithi047 ceph-mon[28972]: mgrmap e11: smithi047.zhgnrm(active, since 1.00564s) 2024-02-07T12:17:04.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-02-07T12:17:04.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-07T12:17:04.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-07T12:17:04.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-02-07T12:17:04.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.625+0000 7f49a1654700 1 Processor -- start 2024-02-07T12:17:04.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.625+0000 7f49a1654700 1 -- start start 2024-02-07T12:17:04.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.625+0000 7f49a1654700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 0x7f499c103020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:04.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.625+0000 7f49a1654700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c103560 con 0x7f499c102c10 2024-02-07T12:17:04.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.625+0000 7f499affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 0x7f499c103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:04.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.625+0000 7f499affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 0x7f499c103020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52984/0 (socket says 172.21.15.47:52984) 2024-02-07T12:17:04.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.625+0000 7f499affd700 1 -- 172.21.15.47:0/1076528920 learned_addr learned my addr 172.21.15.47:0/1076528920 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:04.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.626+0000 7f499affd700 1 -- 172.21.15.47:0/1076528920 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c1036a0 con 0x7f499c102c10 2024-02-07T12:17:04.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.626+0000 7f499affd700 1 --2- 172.21.15.47:0/1076528920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 0x7f499c103020 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f498c0098e0 tx=0x7f498c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ffe4e8ce1ed25a server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:04.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.626+0000 7f4999ffb700 1 -- 172.21.15.47:0/1076528920 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f498c00b860 con 0x7f499c102c10 2024-02-07T12:17:04.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.626+0000 7f4999ffb700 1 -- 172.21.15.47:0/1076528920 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f498c00be90 con 0x7f499c102c10 2024-02-07T12:17:04.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.626+0000 7f4999ffb700 1 -- 172.21.15.47:0/1076528920 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f498c0103c0 con 0x7f499c102c10 2024-02-07T12:17:04.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.627+0000 7f49a1654700 1 -- 172.21.15.47:0/1076528920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 msgr2=0x7f499c103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:04.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.627+0000 7f49a1654700 1 --2- 172.21.15.47:0/1076528920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 0x7f499c103020 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f498c0098e0 tx=0x7f498c009250 comp rx=0 tx=0).stop 2024-02-07T12:17:04.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.627+0000 7f49a1654700 1 -- 172.21.15.47:0/1076528920 shutdown_connections 2024-02-07T12:17:04.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.627+0000 7f49a1654700 1 --2- 172.21.15.47:0/1076528920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 0x7f499c103020 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:04.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.627+0000 7f49a1654700 1 -- 172.21.15.47:0/1076528920 >> 172.21.15.47:0/1076528920 conn(0x7f499c0fc580 msgr2=0x7f499c0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:04.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.627+0000 7f49a1654700 1 -- 172.21.15.47:0/1076528920 shutdown_connections 2024-02-07T12:17:04.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.627+0000 7f49a1654700 1 -- 172.21.15.47:0/1076528920 wait complete. 2024-02-07T12:17:04.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.627+0000 7f49a1654700 1 Processor -- start 2024-02-07T12:17:04.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.627+0000 7f49a1654700 1 -- start start 2024-02-07T12:17:04.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.628+0000 7f49a1654700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 0x7f499c10f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:04.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.628+0000 7f49a1654700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c10fbf0 con 0x7f499c102c10 2024-02-07T12:17:04.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.628+0000 7f499affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 0x7f499c10f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:04.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.628+0000 7f499affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 0x7f499c10f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52990/0 (socket says 172.21.15.47:52990) 2024-02-07T12:17:04.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.628+0000 7f499affd700 1 -- 172.21.15.47:0/1965461252 learned_addr learned my addr 172.21.15.47:0/1965461252 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:04.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.628+0000 7f499affd700 1 -- 172.21.15.47:0/1965461252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c0094f0 con 0x7f499c102c10 2024-02-07T12:17:04.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.628+0000 7f499affd700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 0x7f499c10f6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f498c006fd0 tx=0x7f498c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:04.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.628+0000 7f49837fe700 1 -- 172.21.15.47:0/1965461252 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f498c010680 con 0x7f499c102c10 2024-02-07T12:17:04.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.628+0000 7f49a1654700 1 -- 172.21.15.47:0/1965461252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c10fdf0 con 0x7f499c102c10 2024-02-07T12:17:04.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.628+0000 7f49837fe700 1 -- 172.21.15.47:0/1965461252 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f498c010cb0 con 0x7f499c102c10 2024-02-07T12:17:04.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.628+0000 7f49837fe700 1 -- 172.21.15.47:0/1965461252 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f498c01ada0 con 0x7f499c102c10 2024-02-07T12:17:04.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.628+0000 7f49a1654700 1 -- 172.21.15.47:0/1965461252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c110a90 con 0x7f499c102c10 2024-02-07T12:17:04.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.629+0000 7f49837fe700 1 -- 172.21.15.47:0/1965461252 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f498c025400 con 0x7f499c102c10 2024-02-07T12:17:04.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.629+0000 7f49837fe700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 0x7f498403ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:04.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.629+0000 7f49a1654700 1 -- 172.21.15.47:0/1965461252 --> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f499c05f5c0 con 0x7f4984038890 2024-02-07T12:17:04.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.629+0000 7f49837fe700 1 -- 172.21.15.47:0/1965461252 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f498c010e20 con 0x7f499c102c10 2024-02-07T12:17:04.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.629+0000 7f499a7fc700 1 -- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 msgr2=0x7f498403ad40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2175635831 2024-02-07T12:17:04.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.629+0000 7f499a7fc700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 0x7f498403ad40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-07T12:17:04.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.830+0000 7f499a7fc700 1 -- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 msgr2=0x7f498403ad40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2175635831 2024-02-07T12:17:04.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:58.830+0000 7f499a7fc700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 0x7f498403ad40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:59.231+0000 7f499a7fc700 1 -- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 msgr2=0x7f498403ad40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2175635831 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:16:59.231+0000 7f499a7fc700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 0x7f498403ad40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:00.032+0000 7f499a7fc700 1 -- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 msgr2=0x7f498403ad40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2175635831 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:00.032+0000 7f499a7fc700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 0x7f498403ad40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:01.633+0000 7f499a7fc700 1 -- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 msgr2=0x7f498403ad40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2175635831 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:01.633+0000 7f499a7fc700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 0x7f498403ad40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:02.807+0000 7f49837fe700 1 -- 172.21.15.47:0/1965461252 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7f498c018c70 con 0x7f499c102c10 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:02.807+0000 7f49837fe700 1 -- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 msgr2=0x7f498403ad40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:02.807+0000 7f49837fe700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 0x7f498403ad40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.809+0000 7f49837fe700 1 -- 172.21.15.47:0/1965461252 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f498c025b20 con 0x7f499c102c10 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.809+0000 7f49837fe700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f498403bfb0 0x7f498403e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.809+0000 7f49837fe700 1 -- 172.21.15.47:0/1965461252 --> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f499c05f5c0 con 0x7f498403bfb0 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.810+0000 7f499a7fc700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f498403bfb0 0x7f498403e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.811+0000 7f499a7fc700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f498403bfb0 0x7f498403e390 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f49900039d0 tx=0x7f49900092f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.811+0000 7f49837fe700 1 -- 172.21.15.47:0/1965461252 <== mgr.14162 v2:172.21.15.47:6800/3304641630 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f499c05f5c0 con 0x7f498403bfb0 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.817+0000 7f49a1654700 1 -- 172.21.15.47:0/1965461252 --> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f499c110280 con 0x7f498403bfb0 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.817+0000 7f49837fe700 1 -- 172.21.15.47:0/1965461252 <== mgr.14162 v2:172.21.15.47:6800/3304641630 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f499c110280 con 0x7f498403bfb0 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.818+0000 7f49a1654700 1 -- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f498403bfb0 msgr2=0x7f498403e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.818+0000 7f49a1654700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f498403bfb0 0x7f498403e390 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f49900039d0 tx=0x7f49900092f0 comp rx=0 tx=0).stop 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.818+0000 7f49a1654700 1 -- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 msgr2=0x7f499c10f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.818+0000 7f49a1654700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 0x7f499c10f6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f498c006fd0 tx=0x7f498c009250 comp rx=0 tx=0).stop 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.818+0000 7f49a1654700 1 -- 172.21.15.47:0/1965461252 shutdown_connections 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.818+0000 7f49a1654700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f499c102c10 0x7f499c10f6b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.818+0000 7f49a1654700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f498403bfb0 0x7f498403e390 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.818+0000 7f49a1654700 1 --2- 172.21.15.47:0/1965461252 >> [v2:172.21.15.47:6800/2175635831,v1:172.21.15.47:6801/2175635831] conn(0x7f4984038890 0x7f498403ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.818+0000 7f49a1654700 1 -- 172.21.15.47:0/1965461252 >> 172.21.15.47:0/1965461252 conn(0x7f499c0fc580 msgr2=0x7f499c1063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.818+0000 7f49a1654700 1 -- 172.21.15.47:0/1965461252 shutdown_connections 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:03.818+0000 7f49a1654700 1 -- 172.21.15.47:0/1965461252 wait complete. 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 9 is available 2024-02-07T12:17:04.415 INFO:teuthology.orchestra.run.smithi047.stdout:Generating a dashboard self-signed certificate... 2024-02-07T12:17:05.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:04 smithi047 ceph-mon[28972]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-07T12:17:05.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:04 smithi047 ceph-mon[28972]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-07T12:17:05.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:04 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:05.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-07T12:17:05.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.822+0000 7fc8f3aae700 1 Processor -- start 2024-02-07T12:17:05.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.822+0000 7fc8f3aae700 1 -- start start 2024-02-07T12:17:05.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.823+0000 7fc8f3aae700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 0x7fc8ec077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:05.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.823+0000 7fc8f3aae700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec079110 con 0x7fc8ec078d00 2024-02-07T12:17:05.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.823+0000 7fc8f184a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 0x7fc8ec077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:05.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.823+0000 7fc8f184a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 0x7fc8ec077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42444/0 (socket says 172.21.15.47:42444) 2024-02-07T12:17:05.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.823+0000 7fc8f184a700 1 -- 172.21.15.47:0/3453548901 learned_addr learned my addr 172.21.15.47:0/3453548901 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:05.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.823+0000 7fc8f184a700 1 -- 172.21.15.47:0/3453548901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec077750 con 0x7fc8ec078d00 2024-02-07T12:17:05.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.823+0000 7fc8f184a700 1 --2- 172.21.15.47:0/3453548901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 0x7fc8ec077210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80098e0 tx=0x7fc8e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2598d4441305bf8 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.823+0000 7fc8f0848700 1 -- 172.21.15.47:0/3453548901 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8e800b860 con 0x7fc8ec078d00 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.823+0000 7fc8f0848700 1 -- 172.21.15.47:0/3453548901 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8e800be90 con 0x7fc8ec078d00 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.823+0000 7fc8f0848700 1 -- 172.21.15.47:0/3453548901 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8e80103c0 con 0x7fc8ec078d00 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.824+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3453548901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 msgr2=0x7fc8ec077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.824+0000 7fc8f3aae700 1 --2- 172.21.15.47:0/3453548901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 0x7fc8ec077210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80098e0 tx=0x7fc8e8009250 comp rx=0 tx=0).stop 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.824+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3453548901 shutdown_connections 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.824+0000 7fc8f3aae700 1 --2- 172.21.15.47:0/3453548901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 0x7fc8ec077210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.824+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3453548901 >> 172.21.15.47:0/3453548901 conn(0x7fc8ec0fded0 msgr2=0x7fc8ec100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.824+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3453548901 shutdown_connections 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.824+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3453548901 wait complete. 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.825+0000 7fc8f3aae700 1 Processor -- start 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.825+0000 7fc8f3aae700 1 -- start start 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.825+0000 7fc8f3aae700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 0x7fc8ec113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:05.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.825+0000 7fc8f3aae700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec113d40 con 0x7fc8ec078d00 2024-02-07T12:17:05.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.825+0000 7fc8f184a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 0x7fc8ec113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:05.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.825+0000 7fc8f184a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 0x7fc8ec113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42460/0 (socket says 172.21.15.47:42460) 2024-02-07T12:17:05.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.825+0000 7fc8f184a700 1 -- 172.21.15.47:0/3794970095 learned_addr learned my addr 172.21.15.47:0/3794970095 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:05.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.825+0000 7fc8f184a700 1 -- 172.21.15.47:0/3794970095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80094f0 con 0x7fc8ec078d00 2024-02-07T12:17:05.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.825+0000 7fc8f184a700 1 --2- 172.21.15.47:0/3794970095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 0x7fc8ec113800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80094c0 tx=0x7fc8e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:05.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.825+0000 7fc8e27fc700 1 -- 172.21.15.47:0/3794970095 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8e8010890 con 0x7fc8ec078d00 2024-02-07T12:17:05.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.825+0000 7fc8e27fc700 1 -- 172.21.15.47:0/3794970095 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8e8010ec0 con 0x7fc8ec078d00 2024-02-07T12:17:05.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.825+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3794970095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ec113f40 con 0x7fc8ec078d00 2024-02-07T12:17:05.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.825+0000 7fc8e27fc700 1 -- 172.21.15.47:0/3794970095 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8e80243f0 con 0x7fc8ec078d00 2024-02-07T12:17:05.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.826+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3794970095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ec114be0 con 0x7fc8ec078d00 2024-02-07T12:17:05.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.826+0000 7fc8e27fc700 1 -- 172.21.15.47:0/3794970095 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7fc8e80109f0 con 0x7fc8ec078d00 2024-02-07T12:17:05.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.826+0000 7fc8e27fc700 1 --2- 172.21.15.47:0/3794970095 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc8d8036510 0x7fc8d80389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:05.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.826+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3794970095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ec05f5c0 con 0x7fc8ec078d00 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.826+0000 7fc8e27fc700 1 -- 172.21.15.47:0/3794970095 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc8e804a080 con 0x7fc8ec078d00 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.827+0000 7fc8f1049700 1 --2- 172.21.15.47:0/3794970095 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc8d8036510 0x7fc8d80389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.827+0000 7fc8f1049700 1 --2- 172.21.15.47:0/3794970095 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc8d8036510 0x7fc8d80389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009990 tx=0x7fc8dc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:04.831+0000 7fc8e27fc700 1 -- 172.21.15.47:0/3794970095 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc8e802b760 con 0x7fc8ec078d00 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:05.031+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3794970095 --> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8ec100210 con 0x7fc8d8036510 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:05.116+0000 7fc8e27fc700 1 -- 172.21.15.47:0/3794970095 <== mgr.14162 v2:172.21.15.47:6800/3304641630 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fc8ec100210 con 0x7fc8d8036510 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:05.118+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3794970095 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc8d8036510 msgr2=0x7fc8d80389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:05.118+0000 7fc8f3aae700 1 --2- 172.21.15.47:0/3794970095 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc8d8036510 0x7fc8d80389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009990 tx=0x7fc8dc006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:05.118+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3794970095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 msgr2=0x7fc8ec113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:05.118+0000 7fc8f3aae700 1 --2- 172.21.15.47:0/3794970095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 0x7fc8ec113800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80094c0 tx=0x7fc8e8009250 comp rx=0 tx=0).stop 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:05.118+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3794970095 shutdown_connections 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:05.118+0000 7fc8f3aae700 1 --2- 172.21.15.47:0/3794970095 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc8d8036510 0x7fc8d80389c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:05.118+0000 7fc8f3aae700 1 --2- 172.21.15.47:0/3794970095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8ec078d00 0x7fc8ec113800 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:05.118+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3794970095 >> 172.21.15.47:0/3794970095 conn(0x7fc8ec0fded0 msgr2=0x7fc8ec0ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:05.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:05.118+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3794970095 shutdown_connections 2024-02-07T12:17:05.678 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:05.118+0000 7fc8f3aae700 1 -- 172.21.15.47:0/3794970095 wait complete. 2024-02-07T12:17:05.678 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial admin user... 2024-02-07T12:17:06.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:05 smithi047 ceph-mon[28972]: [07/Feb/2024:12:17:04] ENGINE Bus STARTING 2024-02-07T12:17:06.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:05 smithi047 ceph-mon[28972]: [07/Feb/2024:12:17:04] ENGINE Serving on https://172.21.15.47:7150 2024-02-07T12:17:06.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:05 smithi047 ceph-mon[28972]: [07/Feb/2024:12:17:04] ENGINE Bus STARTED 2024-02-07T12:17:06.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:05 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:06.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:05 smithi047 ceph-mon[28972]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:17:06.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:05 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:06.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:05 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:06.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:05 smithi047 ceph-mon[28972]: mgrmap e12: smithi047.zhgnrm(active, since 2s) 2024-02-07T12:17:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:07 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:07 smithi047 ceph-mon[28972]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:17:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:07 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$0T2woasKloMam7nJVXSScO3SQxfExjlb1ka6g1i6KAE.eFSCC9AAK", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1707308226, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-07T12:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.091+0000 7f9f31c68700 1 Processor -- start 2024-02-07T12:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.091+0000 7f9f31c68700 1 -- start start 2024-02-07T12:17:07.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.091+0000 7f9f31c68700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 0x7f9f2c1077a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.091+0000 7f9f31c68700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c103190 con 0x7f9f2c076c00 2024-02-07T12:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.092+0000 7f9f2b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 0x7f9f2c1077a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.092+0000 7f9f2b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 0x7f9f2c1077a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42476/0 (socket says 172.21.15.47:42476) 2024-02-07T12:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.092+0000 7f9f2b7fe700 1 -- 172.21.15.47:0/3529389426 learned_addr learned my addr 172.21.15.47:0/3529389426 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.092+0000 7f9f2b7fe700 1 -- 172.21.15.47:0/3529389426 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c107ce0 con 0x7f9f2c076c00 2024-02-07T12:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.092+0000 7f9f2b7fe700 1 --2- 172.21.15.47:0/3529389426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 0x7f9f2c1077a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f240098e0 tx=0x7f9f24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421aebc962714d81 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.092+0000 7f9f2a7fc700 1 -- 172.21.15.47:0/3529389426 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f2400b860 con 0x7f9f2c076c00 2024-02-07T12:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.092+0000 7f9f2a7fc700 1 -- 172.21.15.47:0/3529389426 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f2400be90 con 0x7f9f2c076c00 2024-02-07T12:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.092+0000 7f9f2a7fc700 1 -- 172.21.15.47:0/3529389426 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f240103c0 con 0x7f9f2c076c00 2024-02-07T12:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.093+0000 7f9f31c68700 1 -- 172.21.15.47:0/3529389426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 msgr2=0x7f9f2c1077a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.093+0000 7f9f31c68700 1 --2- 172.21.15.47:0/3529389426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 0x7f9f2c1077a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f240098e0 tx=0x7f9f24009250 comp rx=0 tx=0).stop 2024-02-07T12:17:07.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.093+0000 7f9f31c68700 1 -- 172.21.15.47:0/3529389426 shutdown_connections 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.093+0000 7f9f31c68700 1 --2- 172.21.15.47:0/3529389426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 0x7f9f2c1077a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.093+0000 7f9f31c68700 1 -- 172.21.15.47:0/3529389426 >> 172.21.15.47:0/3529389426 conn(0x7f9f2c0fcdd0 msgr2=0x7f9f2c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.093+0000 7f9f31c68700 1 -- 172.21.15.47:0/3529389426 shutdown_connections 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.093+0000 7f9f31c68700 1 -- 172.21.15.47:0/3529389426 wait complete. 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.093+0000 7f9f31c68700 1 Processor -- start 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.093+0000 7f9f31c68700 1 -- start start 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.094+0000 7f9f31c68700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 0x7f9f2c1137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.094+0000 7f9f31c68700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c113ce0 con 0x7f9f2c076c00 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.094+0000 7f9f2b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 0x7f9f2c1137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.094+0000 7f9f2b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 0x7f9f2c1137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42482/0 (socket says 172.21.15.47:42482) 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.094+0000 7f9f2b7fe700 1 -- 172.21.15.47:0/1779018753 learned_addr learned my addr 172.21.15.47:0/1779018753 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.094+0000 7f9f2b7fe700 1 -- 172.21.15.47:0/1779018753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f240094f0 con 0x7f9f2c076c00 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.094+0000 7f9f2b7fe700 1 --2- 172.21.15.47:0/1779018753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 0x7f9f2c1137a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f240090b0 tx=0x7f9f24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:07.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.094+0000 7f9f23fff700 1 -- 172.21.15.47:0/1779018753 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f240118f0 con 0x7f9f2c076c00 2024-02-07T12:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.094+0000 7f9f23fff700 1 -- 172.21.15.47:0/1779018753 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f24010d10 con 0x7f9f2c076c00 2024-02-07T12:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.094+0000 7f9f31c68700 1 -- 172.21.15.47:0/1779018753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c113ee0 con 0x7f9f2c076c00 2024-02-07T12:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.094+0000 7f9f23fff700 1 -- 172.21.15.47:0/1779018753 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f24024e70 con 0x7f9f2c076c00 2024-02-07T12:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.094+0000 7f9f31c68700 1 -- 172.21.15.47:0/1779018753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c114b80 con 0x7f9f2c076c00 2024-02-07T12:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.095+0000 7f9f23fff700 1 -- 172.21.15.47:0/1779018753 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f9f2401a500 con 0x7f9f2c076c00 2024-02-07T12:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.095+0000 7f9f23fff700 1 --2- 172.21.15.47:0/1779018753 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f9f18036640 0x7f9f18038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.095+0000 7f9f31c68700 1 -- 172.21.15.47:0/1779018753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2c05f5c0 con 0x7f9f2c076c00 2024-02-07T12:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.095+0000 7f9f23fff700 1 -- 172.21.15.47:0/1779018753 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9f2404a400 con 0x7f9f2c076c00 2024-02-07T12:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.095+0000 7f9f2affd700 1 --2- 172.21.15.47:0/1779018753 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f9f18036640 0x7f9f18038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.096+0000 7f9f2affd700 1 --2- 172.21.15.47:0/1779018753 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f9f18036640 0x7f9f18038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009990 tx=0x7f9f14006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.100+0000 7f9f23fff700 1 -- 172.21.15.47:0/1779018753 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9f2402d3f0 con 0x7f9f2c076c00 2024-02-07T12:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.322+0000 7f9f31c68700 1 -- 172.21.15.47:0/1779018753 --> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f9f2c05f3e0 con 0x7f9f18036640 2024-02-07T12:17:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.570+0000 7f9f23fff700 1 -- 172.21.15.47:0/1779018753 <== mgr.14162 v2:172.21.15.47:6800/3304641630 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f9f2c05f3e0 con 0x7f9f18036640 2024-02-07T12:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.572+0000 7f9f31c68700 1 -- 172.21.15.47:0/1779018753 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f9f18036640 msgr2=0x7f9f18038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.572+0000 7f9f31c68700 1 --2- 172.21.15.47:0/1779018753 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f9f18036640 0x7f9f18038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009990 tx=0x7f9f14006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.572+0000 7f9f31c68700 1 -- 172.21.15.47:0/1779018753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 msgr2=0x7f9f2c1137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.572+0000 7f9f31c68700 1 --2- 172.21.15.47:0/1779018753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 0x7f9f2c1137a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f240090b0 tx=0x7f9f24009250 comp rx=0 tx=0).stop 2024-02-07T12:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.573+0000 7f9f31c68700 1 -- 172.21.15.47:0/1779018753 shutdown_connections 2024-02-07T12:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.573+0000 7f9f31c68700 1 --2- 172.21.15.47:0/1779018753 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f9f18036640 0x7f9f18038af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.573+0000 7f9f31c68700 1 --2- 172.21.15.47:0/1779018753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c076c00 0x7f9f2c1137a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.573+0000 7f9f31c68700 1 -- 172.21.15.47:0/1779018753 >> 172.21.15.47:0/1779018753 conn(0x7f9f2c0fcdd0 msgr2=0x7f9f2c0fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.573+0000 7f9f31c68700 1 -- 172.21.15.47:0/1779018753 shutdown_connections 2024-02-07T12:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:06.573+0000 7f9f31c68700 1 -- 172.21.15.47:0/1779018753 wait complete. 2024-02-07T12:17:07.729 INFO:teuthology.orchestra.run.smithi047.stdout:Fetching dashboard port number... 2024-02-07T12:17:08.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:08 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1425363912' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-07T12:17:09.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 8443 2024-02-07T12:17:09.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.158+0000 7fd55d6ab700 1 Processor -- start 2024-02-07T12:17:09.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.158+0000 7fd55d6ab700 1 -- start start 2024-02-07T12:17:09.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.158+0000 7fd55d6ab700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 0x7fd558102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:09.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.158+0000 7fd55d6ab700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5581030c0 con 0x7fd558102770 2024-02-07T12:17:09.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.158+0000 7fd556ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 0x7fd558102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.158+0000 7fd556ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 0x7fd558102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42486/0 (socket says 172.21.15.47:42486) 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.158+0000 7fd556ffd700 1 -- 172.21.15.47:0/779588682 learned_addr learned my addr 172.21.15.47:0/779588682 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.158+0000 7fd556ffd700 1 -- 172.21.15.47:0/779588682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd558103200 con 0x7fd558102770 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.158+0000 7fd556ffd700 1 --2- 172.21.15.47:0/779588682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 0x7fd558102b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd5480098e0 tx=0x7fd548009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2119789e9a169e91 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.159+0000 7fd555ffb700 1 -- 172.21.15.47:0/779588682 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd54800b860 con 0x7fd558102770 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.159+0000 7fd555ffb700 1 -- 172.21.15.47:0/779588682 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd54800be90 con 0x7fd558102770 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.159+0000 7fd555ffb700 1 -- 172.21.15.47:0/779588682 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5480103c0 con 0x7fd558102770 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.159+0000 7fd55d6ab700 1 -- 172.21.15.47:0/779588682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 msgr2=0x7fd558102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.159+0000 7fd55d6ab700 1 --2- 172.21.15.47:0/779588682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 0x7fd558102b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd5480098e0 tx=0x7fd548009250 comp rx=0 tx=0).stop 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.159+0000 7fd55d6ab700 1 -- 172.21.15.47:0/779588682 shutdown_connections 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.159+0000 7fd55d6ab700 1 --2- 172.21.15.47:0/779588682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 0x7fd558102b80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.159+0000 7fd55d6ab700 1 -- 172.21.15.47:0/779588682 >> 172.21.15.47:0/779588682 conn(0x7fd5580fded0 msgr2=0x7fd558100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.159+0000 7fd55d6ab700 1 -- 172.21.15.47:0/779588682 shutdown_connections 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.159+0000 7fd55d6ab700 1 -- 172.21.15.47:0/779588682 wait complete. 2024-02-07T12:17:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.160+0000 7fd55d6ab700 1 Processor -- start 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.160+0000 7fd55d6ab700 1 -- start start 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.160+0000 7fd55d6ab700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 0x7fd558078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.160+0000 7fd55d6ab700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd558077190 con 0x7fd558102770 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.160+0000 7fd556ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 0x7fd558078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.160+0000 7fd556ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 0x7fd558078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42488/0 (socket says 172.21.15.47:42488) 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.160+0000 7fd556ffd700 1 -- 172.21.15.47:0/1425363912 learned_addr learned my addr 172.21.15.47:0/1425363912 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.160+0000 7fd556ffd700 1 -- 172.21.15.47:0/1425363912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5480094f0 con 0x7fd558102770 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.161+0000 7fd556ffd700 1 --2- 172.21.15.47:0/1425363912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 0x7fd558078d10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5480090b0 tx=0x7fd548009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.161+0000 7fd53f7fe700 1 -- 172.21.15.47:0/1425363912 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd548010840 con 0x7fd558102770 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.161+0000 7fd53f7fe700 1 -- 172.21.15.47:0/1425363912 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd548010e70 con 0x7fd558102770 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.161+0000 7fd55d6ab700 1 -- 172.21.15.47:0/1425363912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd558077390 con 0x7fd558102770 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.161+0000 7fd53f7fe700 1 -- 172.21.15.47:0/1425363912 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd548024e40 con 0x7fd558102770 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.161+0000 7fd55d6ab700 1 -- 172.21.15.47:0/1425363912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd558077820 con 0x7fd558102770 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.162+0000 7fd53f7fe700 1 -- 172.21.15.47:0/1425363912 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fd54801a570 con 0x7fd558102770 2024-02-07T12:17:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.162+0000 7fd53f7fe700 1 --2- 172.21.15.47:0/1425363912 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fd5400365f0 0x7fd540038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.162+0000 7fd55d6ab700 1 -- 172.21.15.47:0/1425363912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55804bed0 con 0x7fd558102770 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.162+0000 7fd53f7fe700 1 -- 172.21.15.47:0/1425363912 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd54804a870 con 0x7fd558102770 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.162+0000 7fd5567fc700 1 --2- 172.21.15.47:0/1425363912 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fd5400365f0 0x7fd540038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.162+0000 7fd5567fc700 1 --2- 172.21.15.47:0/1425363912 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fd5400365f0 0x7fd540038aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009990 tx=0x7fd54c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.166+0000 7fd53f7fe700 1 -- 172.21.15.47:0/1425363912 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd548018710 con 0x7fd558102770 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.360+0000 7fd55d6ab700 1 -- 172.21.15.47:0/1425363912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fd558077ca0 con 0x7fd558102770 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.361+0000 7fd53f7fe700 1 -- 172.21.15.47:0/1425363912 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fd54802d3a0 con 0x7fd558102770 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.363+0000 7fd55d6ab700 1 -- 172.21.15.47:0/1425363912 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fd5400365f0 msgr2=0x7fd540038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.363+0000 7fd55d6ab700 1 --2- 172.21.15.47:0/1425363912 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fd5400365f0 0x7fd540038aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009990 tx=0x7fd54c006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.363+0000 7fd55d6ab700 1 -- 172.21.15.47:0/1425363912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 msgr2=0x7fd558078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.363+0000 7fd55d6ab700 1 --2- 172.21.15.47:0/1425363912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 0x7fd558078d10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5480090b0 tx=0x7fd548009250 comp rx=0 tx=0).stop 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.363+0000 7fd55d6ab700 1 -- 172.21.15.47:0/1425363912 shutdown_connections 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.363+0000 7fd55d6ab700 1 --2- 172.21.15.47:0/1425363912 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fd5400365f0 0x7fd540038aa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.363+0000 7fd55d6ab700 1 --2- 172.21.15.47:0/1425363912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd558102770 0x7fd558078d10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.363+0000 7fd55d6ab700 1 -- 172.21.15.47:0/1425363912 >> 172.21.15.47:0/1425363912 conn(0x7fd5580fded0 msgr2=0x7fd5580ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:09.205 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.363+0000 7fd55d6ab700 1 -- 172.21.15.47:0/1425363912 shutdown_connections 2024-02-07T12:17:09.205 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:08.363+0000 7fd55d6ab700 1 -- 172.21.15.47:0/1425363912 wait complete. 2024-02-07T12:17:09.210 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-07T12:17:09.210 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-02-07T12:17:09.218 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-07T12:17:09.219 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-02-07T12:17:09.219 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-02-07T12:17:09.219 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-07T12:17:09.221 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph Dashboard is now available at: 2024-02-07T12:17:09.221 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:17:09.221 INFO:teuthology.orchestra.run.smithi047.stdout: URL: https://smithi047.front.sepia.ceph.com:8443/ 2024-02-07T12:17:09.221 INFO:teuthology.orchestra.run.smithi047.stdout: User: admin 2024-02-07T12:17:09.221 INFO:teuthology.orchestra.run.smithi047.stdout: Password: i4u5btexgi 2024-02-07T12:17:09.221 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:17:09.222 INFO:teuthology.orchestra.run.smithi047.stdout:Saving cluster configuration to /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config directory 2024-02-07T12:17:09.222 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling autotune for osd_memory_target 2024-02-07T12:17:10.323 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.634+0000 7fa7f5bf8700 1 Processor -- start 2024-02-07T12:17:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.634+0000 7fa7f5bf8700 1 -- start start 2024-02-07T12:17:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.634+0000 7fa7f5bf8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 0x7fa7f0102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.634+0000 7fa7f5bf8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f01030c0 con 0x7fa7f0102770 2024-02-07T12:17:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.634+0000 7fa7ef7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 0x7fa7f0102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.634+0000 7fa7ef7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 0x7fa7f0102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55638/0 (socket says 172.21.15.47:55638) 2024-02-07T12:17:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.634+0000 7fa7ef7fe700 1 -- 172.21.15.47:0/3055628792 learned_addr learned my addr 172.21.15.47:0/3055628792 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.634+0000 7fa7ef7fe700 1 -- 172.21.15.47:0/3055628792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0103200 con 0x7fa7f0102770 2024-02-07T12:17:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.635+0000 7fa7ef7fe700 1 --2- 172.21.15.47:0/3055628792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 0x7fa7f0102b80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00098e0 tx=0x7fa7e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53193db66fe19617 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.635+0000 7fa7ee7fc700 1 -- 172.21.15.47:0/3055628792 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7e000b860 con 0x7fa7f0102770 2024-02-07T12:17:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.635+0000 7fa7ee7fc700 1 -- 172.21.15.47:0/3055628792 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7e000be90 con 0x7fa7f0102770 2024-02-07T12:17:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.635+0000 7fa7ee7fc700 1 -- 172.21.15.47:0/3055628792 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7e00103c0 con 0x7fa7f0102770 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.635+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/3055628792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 msgr2=0x7fa7f0102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.635+0000 7fa7f5bf8700 1 --2- 172.21.15.47:0/3055628792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 0x7fa7f0102b80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00098e0 tx=0x7fa7e0009250 comp rx=0 tx=0).stop 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.635+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/3055628792 shutdown_connections 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.635+0000 7fa7f5bf8700 1 --2- 172.21.15.47:0/3055628792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 0x7fa7f0102b80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.635+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/3055628792 >> 172.21.15.47:0/3055628792 conn(0x7fa7f00fded0 msgr2=0x7fa7f0100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.635+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/3055628792 shutdown_connections 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.635+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/3055628792 wait complete. 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.636+0000 7fa7f5bf8700 1 Processor -- start 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.636+0000 7fa7f5bf8700 1 -- start start 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.636+0000 7fa7f5bf8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 0x7fa7f0111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.636+0000 7fa7f5bf8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0111aa0 con 0x7fa7f0102770 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.636+0000 7fa7ef7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 0x7fa7f0111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.636+0000 7fa7ef7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 0x7fa7f0111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55654/0 (socket says 172.21.15.47:55654) 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.636+0000 7fa7ef7fe700 1 -- 172.21.15.47:0/2318026669 learned_addr learned my addr 172.21.15.47:0/2318026669 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.637+0000 7fa7ef7fe700 1 -- 172.21.15.47:0/2318026669 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e00094f0 con 0x7fa7f0102770 2024-02-07T12:17:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.637+0000 7fa7ef7fe700 1 --2- 172.21.15.47:0/2318026669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 0x7fa7f0111560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0006b00 tx=0x7fa7e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.637+0000 7fa7d7fff700 1 -- 172.21.15.47:0/2318026669 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7e00109a0 con 0x7fa7f0102770 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.637+0000 7fa7d7fff700 1 -- 172.21.15.47:0/2318026669 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7e001a430 con 0x7fa7f0102770 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.637+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/2318026669 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f0111ca0 con 0x7fa7f0102770 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.637+0000 7fa7d7fff700 1 -- 172.21.15.47:0/2318026669 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7e00245b0 con 0x7fa7f0102770 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.637+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/2318026669 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f0112940 con 0x7fa7f0102770 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.638+0000 7fa7d7fff700 1 -- 172.21.15.47:0/2318026669 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fa7e0024830 con 0x7fa7f0102770 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.638+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/2318026669 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f005f5c0 con 0x7fa7f0102770 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.638+0000 7fa7d7fff700 1 --2- 172.21.15.47:0/2318026669 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fa7d80366e0 0x7fa7d8038b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.638+0000 7fa7d7fff700 1 -- 172.21.15.47:0/2318026669 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa7e004a6d0 con 0x7fa7f0102770 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.638+0000 7fa7eeffd700 1 --2- 172.21.15.47:0/2318026669 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fa7d80366e0 0x7fa7d8038b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.639+0000 7fa7eeffd700 1 --2- 172.21.15.47:0/2318026669 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fa7d80366e0 0x7fa7d8038b90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009990 tx=0x7fa7e4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.643+0000 7fa7d7fff700 1 -- 172.21.15.47:0/2318026669 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa7e0018c90 con 0x7fa7f0102770 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.834+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/2318026669 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fa7f004bed0 con 0x7fa7f0102770 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.834+0000 7fa7d7fff700 1 -- 172.21.15.47:0/2318026669 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fa7e0018ab0 con 0x7fa7f0102770 2024-02-07T12:17:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.836+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/2318026669 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fa7d80366e0 msgr2=0x7fa7d8038b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:10.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.836+0000 7fa7f5bf8700 1 --2- 172.21.15.47:0/2318026669 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fa7d80366e0 0x7fa7d8038b90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009990 tx=0x7fa7e4006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:10.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.836+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/2318026669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 msgr2=0x7fa7f0111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:10.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.836+0000 7fa7f5bf8700 1 --2- 172.21.15.47:0/2318026669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 0x7fa7f0111560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0006b00 tx=0x7fa7e0009250 comp rx=0 tx=0).stop 2024-02-07T12:17:10.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.836+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/2318026669 shutdown_connections 2024-02-07T12:17:10.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.836+0000 7fa7f5bf8700 1 --2- 172.21.15.47:0/2318026669 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fa7d80366e0 0x7fa7d8038b90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:10.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.836+0000 7fa7f5bf8700 1 --2- 172.21.15.47:0/2318026669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f0102770 0x7fa7f0111560 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:10.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.836+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/2318026669 >> 172.21.15.47:0/2318026669 conn(0x7fa7f00fded0 msgr2=0x7fa7f00fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:10.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.836+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/2318026669 shutdown_connections 2024-02-07T12:17:10.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:09.836+0000 7fa7f5bf8700 1 -- 172.21.15.47:0/2318026669 wait complete. 2024-02-07T12:17:10.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:10 smithi047 ceph-mon[28972]: mgrmap e13: smithi047.zhgnrm(active, since 6s) 2024-02-07T12:17:11.656 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.777+0000 7f23ccde6700 1 Processor -- start 2024-02-07T12:17:11.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.777+0000 7f23ccde6700 1 -- start start 2024-02-07T12:17:11.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.777+0000 7f23ccde6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 0x7f23c8103180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:11.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.777+0000 7f23ccde6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c81036c0 con 0x7f23c8102d70 2024-02-07T12:17:11.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.777+0000 7f23c659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 0x7f23c8103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:11.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.777+0000 7f23c659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 0x7f23c8103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55658/0 (socket says 172.21.15.47:55658) 2024-02-07T12:17:11.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.777+0000 7f23c659c700 1 -- 172.21.15.47:0/3939263076 learned_addr learned my addr 172.21.15.47:0/3939263076 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:11.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.778+0000 7f23c659c700 1 -- 172.21.15.47:0/3939263076 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8103800 con 0x7f23c8102d70 2024-02-07T12:17:11.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.778+0000 7f23c659c700 1 --2- 172.21.15.47:0/3939263076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 0x7f23c8103180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23b80098e0 tx=0x7f23b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378ee00eabf52da0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:11.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.778+0000 7f23c559a700 1 -- 172.21.15.47:0/3939263076 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23b800b8f0 con 0x7f23c8102d70 2024-02-07T12:17:11.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.778+0000 7f23c559a700 1 -- 172.21.15.47:0/3939263076 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23b8011420 con 0x7f23c8102d70 2024-02-07T12:17:11.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.778+0000 7f23c559a700 1 -- 172.21.15.47:0/3939263076 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23b8010540 con 0x7f23c8102d70 2024-02-07T12:17:11.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.779+0000 7f23ccde6700 1 -- 172.21.15.47:0/3939263076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 msgr2=0x7f23c8103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.779+0000 7f23ccde6700 1 --2- 172.21.15.47:0/3939263076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 0x7f23c8103180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23b80098e0 tx=0x7f23b8009250 comp rx=0 tx=0).stop 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.779+0000 7f23ccde6700 1 -- 172.21.15.47:0/3939263076 shutdown_connections 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.779+0000 7f23ccde6700 1 --2- 172.21.15.47:0/3939263076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 0x7f23c8103180 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.779+0000 7f23ccde6700 1 -- 172.21.15.47:0/3939263076 >> 172.21.15.47:0/3939263076 conn(0x7f23c80fc580 msgr2=0x7f23c80fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.779+0000 7f23ccde6700 1 -- 172.21.15.47:0/3939263076 shutdown_connections 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.779+0000 7f23ccde6700 1 -- 172.21.15.47:0/3939263076 wait complete. 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.779+0000 7f23ccde6700 1 Processor -- start 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.779+0000 7f23ccde6700 1 -- start start 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.779+0000 7f23ccde6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 0x7f23c8113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.780+0000 7f23ccde6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8113fd0 con 0x7f23c8102d70 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.780+0000 7f23c659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 0x7f23c8113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.780+0000 7f23c659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 0x7f23c8113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55662/0 (socket says 172.21.15.47:55662) 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.780+0000 7f23c659c700 1 -- 172.21.15.47:0/1518561045 learned_addr learned my addr 172.21.15.47:0/1518561045 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.780+0000 7f23c659c700 1 -- 172.21.15.47:0/1518561045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b80094f0 con 0x7f23c8102d70 2024-02-07T12:17:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.780+0000 7f23c659c700 1 --2- 172.21.15.47:0/1518561045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 0x7f23c8113a90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23b8011a90 tx=0x7f23b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:11.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.780+0000 7f23b6ffd700 1 -- 172.21.15.47:0/1518561045 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23b80107b0 con 0x7f23c8102d70 2024-02-07T12:17:11.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.780+0000 7f23b6ffd700 1 -- 172.21.15.47:0/1518561045 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23b8010de0 con 0x7f23c8102d70 2024-02-07T12:17:11.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.780+0000 7f23ccde6700 1 -- 172.21.15.47:0/1518561045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c81141d0 con 0x7f23c8102d70 2024-02-07T12:17:11.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.780+0000 7f23b6ffd700 1 -- 172.21.15.47:0/1518561045 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23b801ae40 con 0x7f23c8102d70 2024-02-07T12:17:11.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.780+0000 7f23ccde6700 1 -- 172.21.15.47:0/1518561045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c8114e70 con 0x7f23c8102d70 2024-02-07T12:17:11.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.781+0000 7f23b6ffd700 1 -- 172.21.15.47:0/1518561045 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f23b801a430 con 0x7f23c8102d70 2024-02-07T12:17:11.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.781+0000 7f23b6ffd700 1 --2- 172.21.15.47:0/1518561045 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f23b00367c0 0x7f23b0038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:11.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.781+0000 7f23ccde6700 1 -- 172.21.15.47:0/1518561045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c805f5c0 con 0x7f23c8102d70 2024-02-07T12:17:11.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.781+0000 7f23b6ffd700 1 -- 172.21.15.47:0/1518561045 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f23b804a510 con 0x7f23c8102d70 2024-02-07T12:17:11.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.781+0000 7f23c5d9b700 1 --2- 172.21.15.47:0/1518561045 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f23b00367c0 0x7f23b0038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:11.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.782+0000 7f23c5d9b700 1 --2- 172.21.15.47:0/1518561045 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f23b00367c0 0x7f23b0038c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009990 tx=0x7f23bc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:10.786+0000 7f23b6ffd700 1 -- 172.21.15.47:0/1518561045 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f23b8018710 con 0x7f23c8102d70 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:11.086+0000 7f23ccde6700 1 -- 172.21.15.47:0/1518561045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f23c804bed0 con 0x7f23c8102d70 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:11.088+0000 7f23b6ffd700 1 -- 172.21.15.47:0/1518561045 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f23b8018350 con 0x7f23c8102d70 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:11.090+0000 7f23ccde6700 1 -- 172.21.15.47:0/1518561045 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f23b00367c0 msgr2=0x7f23b0038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:11.090+0000 7f23ccde6700 1 --2- 172.21.15.47:0/1518561045 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f23b00367c0 0x7f23b0038c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009990 tx=0x7f23bc006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:11.090+0000 7f23ccde6700 1 -- 172.21.15.47:0/1518561045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 msgr2=0x7f23c8113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:11.090+0000 7f23ccde6700 1 --2- 172.21.15.47:0/1518561045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 0x7f23c8113a90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23b8011a90 tx=0x7f23b8009250 comp rx=0 tx=0).stop 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:11.090+0000 7f23ccde6700 1 -- 172.21.15.47:0/1518561045 shutdown_connections 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:11.090+0000 7f23ccde6700 1 --2- 172.21.15.47:0/1518561045 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f23b00367c0 0x7f23b0038c70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:11.090+0000 7f23ccde6700 1 --2- 172.21.15.47:0/1518561045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23c8102d70 0x7f23c8113a90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:11.090+0000 7f23ccde6700 1 -- 172.21.15.47:0/1518561045 >> 172.21.15.47:0/1518561045 conn(0x7f23c80fc580 msgr2=0x7f23c80fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:11.090+0000 7f23ccde6700 1 -- 172.21.15.47:0/1518561045 shutdown_connections 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-02-07T12:17:11.090+0000 7f23ccde6700 1 -- 172.21.15.47:0/1518561045 wait complete. 2024-02-07T12:17:11.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout:Or, if you are only running a single cluster on this host: 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: ceph telemetry on 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout:For more information see: 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-02-07T12:17:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:17:11.662 INFO:teuthology.orchestra.run.smithi047.stdout:Bootstrap complete. 2024-02-07T12:17:11.698 INFO:tasks.cephadm:Fetching config... 2024-02-07T12:17:11.698 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:17:11.698 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-07T12:17:11.754 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-07T12:17:11.754 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:17:11.755 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-07T12:17:11.809 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-07T12:17:11.810 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:17:11.810 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/keyring of=/dev/stdout 2024-02-07T12:17:11.878 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-07T12:17:11.878 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:17:11.878 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-07T12:17:11.934 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-07T12:17:11.934 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoH64oueXGPNVE/SdfOQrOeRdc96eAVVeIpKQxQqGySHnjIQ5Q5Kzz+yj1Zj1jlGkthTS5xHGPlKiN+d9e6i/t7LXCAGofaLpa/+UysS/vt99Wg/sCLg3V3oTegzeFoiObnM7DzXq5Ti/GSU9Jk1jgYuqZDQbOCKOKK+zAjqpWKC9R84K3BUl4qRNDFUhEcpUqYyTGKfwvHCPTpRhf/ZMkfWGoIcRX4GgPXcmQ363sO5HLCWpXCaF4VFXymrjKsaz3nqRCi3mJfUPTHbEQWpCtDAU7kDEDoOoQ0OI93jrsBL8h5QcrcukqWtvgJB1lDMc9M0CDULPEJ8uFcZBBdWjlRztENx3HdrAmS9JzXwkuRwHi/c2f5GTBi0hWa3St8+aemFrQZN4MlzCfRm1f9vn2zjELKdLtPXxzREl0ni/MbxP0dOUSILfk4JwDGo1rsflV5iQnepfoT0JocJUaYCAEkXKT2y/cO+P8/NfC/znjf+vGLoLT6N2wximG0iYekOs= ceph-818049ec-c5b2-11ee-95b6-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-07T12:17:12.014 INFO:teuthology.orchestra.run.smithi047.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoH64oueXGPNVE/SdfOQrOeRdc96eAVVeIpKQxQqGySHnjIQ5Q5Kzz+yj1Zj1jlGkthTS5xHGPlKiN+d9e6i/t7LXCAGofaLpa/+UysS/vt99Wg/sCLg3V3oTegzeFoiObnM7DzXq5Ti/GSU9Jk1jgYuqZDQbOCKOKK+zAjqpWKC9R84K3BUl4qRNDFUhEcpUqYyTGKfwvHCPTpRhf/ZMkfWGoIcRX4GgPXcmQ363sO5HLCWpXCaF4VFXymrjKsaz3nqRCi3mJfUPTHbEQWpCtDAU7kDEDoOoQ0OI93jrsBL8h5QcrcukqWtvgJB1lDMc9M0CDULPEJ8uFcZBBdWjlRztENx3HdrAmS9JzXwkuRwHi/c2f5GTBi0hWa3St8+aemFrQZN4MlzCfRm1f9vn2zjELKdLtPXxzREl0ni/MbxP0dOUSILfk4JwDGo1rsflV5iQnepfoT0JocJUaYCAEkXKT2y/cO+P8/NfC/znjf+vGLoLT6N2wximG0iYekOs= ceph-818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:17:12.028 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoH64oueXGPNVE/SdfOQrOeRdc96eAVVeIpKQxQqGySHnjIQ5Q5Kzz+yj1Zj1jlGkthTS5xHGPlKiN+d9e6i/t7LXCAGofaLpa/+UysS/vt99Wg/sCLg3V3oTegzeFoiObnM7DzXq5Ti/GSU9Jk1jgYuqZDQbOCKOKK+zAjqpWKC9R84K3BUl4qRNDFUhEcpUqYyTGKfwvHCPTpRhf/ZMkfWGoIcRX4GgPXcmQ363sO5HLCWpXCaF4VFXymrjKsaz3nqRCi3mJfUPTHbEQWpCtDAU7kDEDoOoQ0OI93jrsBL8h5QcrcukqWtvgJB1lDMc9M0CDULPEJ8uFcZBBdWjlRztENx3HdrAmS9JzXwkuRwHi/c2f5GTBi0hWa3St8+aemFrQZN4MlzCfRm1f9vn2zjELKdLtPXxzREl0ni/MbxP0dOUSILfk4JwDGo1rsflV5iQnepfoT0JocJUaYCAEkXKT2y/cO+P8/NfC/znjf+vGLoLT6N2wximG0iYekOs= ceph-818049ec-c5b2-11ee-95b6-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-07T12:17:12.074 INFO:teuthology.orchestra.run.smithi138.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoH64oueXGPNVE/SdfOQrOeRdc96eAVVeIpKQxQqGySHnjIQ5Q5Kzz+yj1Zj1jlGkthTS5xHGPlKiN+d9e6i/t7LXCAGofaLpa/+UysS/vt99Wg/sCLg3V3oTegzeFoiObnM7DzXq5Ti/GSU9Jk1jgYuqZDQbOCKOKK+zAjqpWKC9R84K3BUl4qRNDFUhEcpUqYyTGKfwvHCPTpRhf/ZMkfWGoIcRX4GgPXcmQ363sO5HLCWpXCaF4VFXymrjKsaz3nqRCi3mJfUPTHbEQWpCtDAU7kDEDoOoQ0OI93jrsBL8h5QcrcukqWtvgJB1lDMc9M0CDULPEJ8uFcZBBdWjlRztENx3HdrAmS9JzXwkuRwHi/c2f5GTBi0hWa3St8+aemFrQZN4MlzCfRm1f9vn2zjELKdLtPXxzREl0ni/MbxP0dOUSILfk4JwDGo1rsflV5iQnepfoT0JocJUaYCAEkXKT2y/cO+P8/NfC/znjf+vGLoLT6N2wximG0iYekOs= ceph-818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:17:12.089 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-07T12:17:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:12 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1518561045' entity='client.admin' 2024-02-07T12:17:12.353 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:17:14.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:14 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:14.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:14 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:14.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:14 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:17:14.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:14 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:14.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:14 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:17:14.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:14 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-07T12:17:14.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:14 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:17:14.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:14 smithi047 ceph-mon[28972]: Deploying daemon crash.smithi047 on smithi047 2024-02-07T12:17:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.068+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1318066289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e00fd710 msgr2=0x7ff1e00ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.068+0000 7ff1e83c5700 1 --2- 172.21.15.47:0/1318066289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e00fd710 0x7ff1e00ffaf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0048c0 tx=0x7ff1dc009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.068+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1318066289 shutdown_connections 2024-02-07T12:17:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.068+0000 7ff1e83c5700 1 --2- 172.21.15.47:0/1318066289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e00fd710 0x7ff1e00ffaf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.068+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1318066289 >> 172.21.15.47:0/1318066289 conn(0x7ff1e00f7190 msgr2=0x7ff1e00f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.068+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1318066289 shutdown_connections 2024-02-07T12:17:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.068+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1318066289 wait complete. 2024-02-07T12:17:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.068+0000 7ff1e83c5700 1 Processor -- start 2024-02-07T12:17:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.068+0000 7ff1e83c5700 1 -- start start 2024-02-07T12:17:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.069+0000 7ff1e83c5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e00fd710 0x7ff1e010cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.069+0000 7ff1e83c5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e010d3e0 con 0x7ff1e00fd710 2024-02-07T12:17:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.069+0000 7ff1e6161700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e00fd710 0x7ff1e010cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.069+0000 7ff1e6161700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e00fd710 0x7ff1e010cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55688/0 (socket says 172.21.15.47:55688) 2024-02-07T12:17:15.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.069+0000 7ff1e6161700 1 -- 172.21.15.47:0/1127710853 learned_addr learned my addr 172.21.15.47:0/1127710853 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:15.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.069+0000 7ff1e6161700 1 -- 172.21.15.47:0/1127710853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc005040 con 0x7ff1e00fd710 2024-02-07T12:17:15.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.069+0000 7ff1e6161700 1 --2- 172.21.15.47:0/1127710853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e00fd710 0x7ff1e010cea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc009680 tx=0x7ff1dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:15.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.069+0000 7ff1d6ffd700 1 -- 172.21.15.47:0/1127710853 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1dc00b5c0 con 0x7ff1e00fd710 2024-02-07T12:17:15.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.069+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1127710853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e010d5e0 con 0x7ff1e00fd710 2024-02-07T12:17:15.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.069+0000 7ff1d6ffd700 1 -- 172.21.15.47:0/1127710853 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff1dc004e60 con 0x7ff1e00fd710 2024-02-07T12:17:15.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.069+0000 7ff1d6ffd700 1 -- 172.21.15.47:0/1127710853 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1dc01c590 con 0x7ff1e00fd710 2024-02-07T12:17:15.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.070+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1127710853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e010e280 con 0x7ff1e00fd710 2024-02-07T12:17:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.070+0000 7ff1d6ffd700 1 -- 172.21.15.47:0/1127710853 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7ff1dc01c810 con 0x7ff1e00fd710 2024-02-07T12:17:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.070+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1127710853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e005f5c0 con 0x7ff1e00fd710 2024-02-07T12:17:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.071+0000 7ff1d6ffd700 1 --2- 172.21.15.47:0/1127710853 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7ff1cc0366d0 0x7ff1cc038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.071+0000 7ff1d6ffd700 1 -- 172.21.15.47:0/1127710853 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff1dc049920 con 0x7ff1e00fd710 2024-02-07T12:17:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.071+0000 7ff1e5960700 1 --2- 172.21.15.47:0/1127710853 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7ff1cc0366d0 0x7ff1cc038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.071+0000 7ff1e5960700 1 --2- 172.21.15.47:0/1127710853 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7ff1cc0366d0 0x7ff1cc038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009990 tx=0x7ff1d0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:15.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.078+0000 7ff1d6ffd700 1 -- 172.21.15.47:0/1127710853 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff1dc023300 con 0x7ff1e00fd710 2024-02-07T12:17:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.308+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1127710853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7ff1e010ee60 con 0x7ff1e00fd710 2024-02-07T12:17:15.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.311+0000 7ff1d6ffd700 1 -- 172.21.15.47:0/1127710853 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7ff1dc011b60 con 0x7ff1e00fd710 2024-02-07T12:17:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.313+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1127710853 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7ff1cc0366d0 msgr2=0x7ff1cc038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.313+0000 7ff1e83c5700 1 --2- 172.21.15.47:0/1127710853 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7ff1cc0366d0 0x7ff1cc038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009990 tx=0x7ff1d0006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.313+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1127710853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e00fd710 msgr2=0x7ff1e010cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.313+0000 7ff1e83c5700 1 --2- 172.21.15.47:0/1127710853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e00fd710 0x7ff1e010cea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc009680 tx=0x7ff1dc009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.313+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1127710853 shutdown_connections 2024-02-07T12:17:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.313+0000 7ff1e83c5700 1 --2- 172.21.15.47:0/1127710853 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7ff1cc0366d0 0x7ff1cc038b80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.313+0000 7ff1e83c5700 1 --2- 172.21.15.47:0/1127710853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e00fd710 0x7ff1e010cea0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.313+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1127710853 >> 172.21.15.47:0/1127710853 conn(0x7ff1e00f7190 msgr2=0x7ff1e00f7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.313+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1127710853 shutdown_connections 2024-02-07T12:17:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:15.313+0000 7ff1e83c5700 1 -- 172.21.15.47:0/1127710853 wait complete. 2024-02-07T12:17:15.914 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-07T12:17:15.915 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-07T12:17:16.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:16 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1127710853' entity='client.admin' 2024-02-07T12:17:17.082 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:17:19.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.119+0000 7fd726191700 1 -- 172.21.15.47:0/1613109569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200fcbd0 msgr2=0x7fd7200fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:19.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.119+0000 7fd726191700 1 --2- 172.21.15.47:0/1613109569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200fcbd0 0x7fd7200fcfe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd710009c60 tx=0x7fd710004d10 comp rx=0 tx=0).stop 2024-02-07T12:17:19.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.119+0000 7fd726191700 1 -- 172.21.15.47:0/1613109569 shutdown_connections 2024-02-07T12:17:19.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.119+0000 7fd726191700 1 --2- 172.21.15.47:0/1613109569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200fcbd0 0x7fd7200fcfe0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:19.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.119+0000 7fd726191700 1 -- 172.21.15.47:0/1613109569 >> 172.21.15.47:0/1613109569 conn(0x7fd7200f8290 msgr2=0x7fd7200fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:19.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.119+0000 7fd726191700 1 -- 172.21.15.47:0/1613109569 shutdown_connections 2024-02-07T12:17:19.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.119+0000 7fd726191700 1 -- 172.21.15.47:0/1613109569 wait complete. 2024-02-07T12:17:19.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.119+0000 7fd726191700 1 Processor -- start 2024-02-07T12:17:19.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.119+0000 7fd726191700 1 -- start start 2024-02-07T12:17:19.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.119+0000 7fd726191700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200fcbd0 0x7fd72010cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:19.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.119+0000 7fd726191700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72010d430 con 0x7fd7200fcbd0 2024-02-07T12:17:19.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.120+0000 7fd71f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200fcbd0 0x7fd72010cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:19.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.120+0000 7fd71f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200fcbd0 0x7fd72010cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55700/0 (socket says 172.21.15.47:55700) 2024-02-07T12:17:19.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.120+0000 7fd71f7fe700 1 -- 172.21.15.47:0/2236951413 learned_addr learned my addr 172.21.15.47:0/2236951413 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:19.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.120+0000 7fd71f7fe700 1 -- 172.21.15.47:0/2236951413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd710009940 con 0x7fd7200fcbd0 2024-02-07T12:17:19.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.120+0000 7fd71f7fe700 1 --2- 172.21.15.47:0/2236951413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200fcbd0 0x7fd72010cef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd7100097d0 tx=0x7fd710004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:19.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.120+0000 7fd707fff700 1 -- 172.21.15.47:0/2236951413 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd71001d440 con 0x7fd7200fcbd0 2024-02-07T12:17:19.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.120+0000 7fd707fff700 1 -- 172.21.15.47:0/2236951413 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd71001da70 con 0x7fd7200fcbd0 2024-02-07T12:17:19.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.120+0000 7fd726191700 1 -- 172.21.15.47:0/2236951413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72010d630 con 0x7fd7200fcbd0 2024-02-07T12:17:19.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.120+0000 7fd707fff700 1 -- 172.21.15.47:0/2236951413 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd710012a10 con 0x7fd7200fcbd0 2024-02-07T12:17:19.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.120+0000 7fd726191700 1 -- 172.21.15.47:0/2236951413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72010e2d0 con 0x7fd7200fcbd0 2024-02-07T12:17:19.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.121+0000 7fd707fff700 1 -- 172.21.15.47:0/2236951413 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fd710019040 con 0x7fd7200fcbd0 2024-02-07T12:17:19.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.121+0000 7fd726191700 1 -- 172.21.15.47:0/2236951413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72005f5c0 con 0x7fd7200fcbd0 2024-02-07T12:17:19.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.121+0000 7fd707fff700 1 --2- 172.21.15.47:0/2236951413 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fd708036720 0x7fd708038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:19.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.121+0000 7fd707fff700 1 -- 172.21.15.47:0/2236951413 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd71004a0d0 con 0x7fd7200fcbd0 2024-02-07T12:17:19.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.121+0000 7fd71effd700 1 --2- 172.21.15.47:0/2236951413 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fd708036720 0x7fd708038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:19.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.122+0000 7fd71effd700 1 --2- 172.21.15.47:0/2236951413 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fd708036720 0x7fd708038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd714009990 tx=0x7fd714006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:19.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.126+0000 7fd707fff700 1 -- 172.21.15.47:0/2236951413 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd710026780 con 0x7fd7200fcbd0 2024-02-07T12:17:19.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.326+0000 7fd726191700 1 -- 172.21.15.47:0/2236951413 --> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fd72010ee30 con 0x7fd708036720 2024-02-07T12:17:19.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.329+0000 7fd707fff700 1 -- 172.21.15.47:0/2236951413 <== mgr.14162 v2:172.21.15.47:6800/3304641630 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd72010ee30 con 0x7fd708036720 2024-02-07T12:17:19.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.331+0000 7fd726191700 1 -- 172.21.15.47:0/2236951413 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fd708036720 msgr2=0x7fd708038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:19.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.331+0000 7fd726191700 1 --2- 172.21.15.47:0/2236951413 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fd708036720 0x7fd708038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd714009990 tx=0x7fd714006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:19.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.331+0000 7fd726191700 1 -- 172.21.15.47:0/2236951413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200fcbd0 msgr2=0x7fd72010cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:19.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.331+0000 7fd726191700 1 --2- 172.21.15.47:0/2236951413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200fcbd0 0x7fd72010cef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd7100097d0 tx=0x7fd710004d10 comp rx=0 tx=0).stop 2024-02-07T12:17:19.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.331+0000 7fd726191700 1 -- 172.21.15.47:0/2236951413 shutdown_connections 2024-02-07T12:17:19.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.331+0000 7fd726191700 1 --2- 172.21.15.47:0/2236951413 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fd708036720 0x7fd708038bd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:19.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.331+0000 7fd726191700 1 --2- 172.21.15.47:0/2236951413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200fcbd0 0x7fd72010cef0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:19.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.331+0000 7fd726191700 1 -- 172.21.15.47:0/2236951413 >> 172.21.15.47:0/2236951413 conn(0x7fd7200f8290 msgr2=0x7fd7200f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:19.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.331+0000 7fd726191700 1 -- 172.21.15.47:0/2236951413 shutdown_connections 2024-02-07T12:17:19.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:19.332+0000 7fd726191700 1 -- 172.21.15.47:0/2236951413 wait complete. 2024-02-07T12:17:19.891 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi138 2024-02-07T12:17:19.891 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:17:19.891 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/etc/ceph/ceph.conf 2024-02-07T12:17:19.909 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:17:19.909 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:17:19.967 INFO:tasks.cephadm:Adding host smithi138 to orchestrator... 2024-02-07T12:17:19.967 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph orch host add smithi138 2024-02-07T12:17:20.245 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:17:20.658 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:20 smithi047 ceph-mon[28972]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:17:20.659 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:20 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:20.659 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:20 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:20.659 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:20 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:20.659 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:20 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:20.659 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:20 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:20.659 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:20 smithi047 ceph-mon[28972]: Deploying daemon node-exporter.smithi047 on smithi047 2024-02-07T12:17:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.744+0000 7f0a18f5f700 1 -- 172.21.15.47:0/3555718656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a140fbac0 msgr2=0x7f0a140fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.744+0000 7f0a18f5f700 1 --2- 172.21.15.47:0/3555718656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a140fbac0 0x7f0a140fbed0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0a040048c0 tx=0x7f0a04009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.744+0000 7f0a18f5f700 1 -- 172.21.15.47:0/3555718656 shutdown_connections 2024-02-07T12:17:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.744+0000 7f0a18f5f700 1 --2- 172.21.15.47:0/3555718656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a140fbac0 0x7f0a140fbed0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.744+0000 7f0a18f5f700 1 -- 172.21.15.47:0/3555718656 >> 172.21.15.47:0/3555718656 conn(0x7f0a140f71a0 msgr2=0x7f0a140f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.744+0000 7f0a18f5f700 1 -- 172.21.15.47:0/3555718656 shutdown_connections 2024-02-07T12:17:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.744+0000 7f0a18f5f700 1 -- 172.21.15.47:0/3555718656 wait complete. 2024-02-07T12:17:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.744+0000 7f0a18f5f700 1 Processor -- start 2024-02-07T12:17:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.744+0000 7f0a18f5f700 1 -- start start 2024-02-07T12:17:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.744+0000 7f0a18f5f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a140fbac0 0x7f0a1410ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.744+0000 7f0a18f5f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1410d3f0 con 0x7f0a140fbac0 2024-02-07T12:17:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.745+0000 7f0a1259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a140fbac0 0x7f0a1410ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.745+0000 7f0a1259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a140fbac0 0x7f0a1410ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37644/0 (socket says 172.21.15.47:37644) 2024-02-07T12:17:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.745+0000 7f0a1259c700 1 -- 172.21.15.47:0/4108758863 learned_addr learned my addr 172.21.15.47:0/4108758863 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.745+0000 7f0a1259c700 1 -- 172.21.15.47:0/4108758863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04005040 con 0x7f0a140fbac0 2024-02-07T12:17:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.745+0000 7f0a1259c700 1 --2- 172.21.15.47:0/4108758863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a140fbac0 0x7f0a1410ceb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009b80 tx=0x7f0a04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.745+0000 7f0a02ffd700 1 -- 172.21.15.47:0/4108758863 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a0400b5c0 con 0x7f0a140fbac0 2024-02-07T12:17:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.745+0000 7f0a02ffd700 1 -- 172.21.15.47:0/4108758863 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a0400be70 con 0x7f0a140fbac0 2024-02-07T12:17:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.745+0000 7f0a18f5f700 1 -- 172.21.15.47:0/4108758863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1410d5f0 con 0x7f0a140fbac0 2024-02-07T12:17:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.745+0000 7f0a02ffd700 1 -- 172.21.15.47:0/4108758863 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a0401c660 con 0x7f0a140fbac0 2024-02-07T12:17:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.745+0000 7f0a18f5f700 1 -- 172.21.15.47:0/4108758863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1410e290 con 0x7f0a140fbac0 2024-02-07T12:17:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.746+0000 7f0a02ffd700 1 -- 172.21.15.47:0/4108758863 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f0a0401c8d0 con 0x7f0a140fbac0 2024-02-07T12:17:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.746+0000 7f0a18f5f700 1 -- 172.21.15.47:0/4108758863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1405f5c0 con 0x7f0a140fbac0 2024-02-07T12:17:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.746+0000 7f0a02ffd700 1 --2- 172.21.15.47:0/4108758863 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f09fc0366d0 0x7f09fc038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.746+0000 7f0a02ffd700 1 -- 172.21.15.47:0/4108758863 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0a04049900 con 0x7f0a140fbac0 2024-02-07T12:17:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.746+0000 7f0a11d9b700 1 --2- 172.21.15.47:0/4108758863 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f09fc0366d0 0x7f09fc038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.747+0000 7f0a11d9b700 1 --2- 172.21.15.47:0/4108758863 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f09fc0366d0 0x7f09fc038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009990 tx=0x7f0a08006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:21.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.751+0000 7f0a02ffd700 1 -- 172.21.15.47:0/4108758863 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0a04011dd0 con 0x7f0a140fbac0 2024-02-07T12:17:21.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:21.945+0000 7f0a18f5f700 1 -- 172.21.15.47:0/4108758863 --> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi138", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a140f8ae0 con 0x7f09fc0366d0 2024-02-07T12:17:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:22 smithi047 ceph-mon[28972]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi138", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:17:24.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:23 smithi047 ceph-mon[28972]: Deploying cephadm binary to smithi138 2024-02-07T12:17:24.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:23 smithi047 ceph-mon[28972]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:24.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:23 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:24.084+0000 7f0a02ffd700 1 -- 172.21.15.47:0/4108758863 <== mgr.14162 v2:172.21.15.47:6800/3304641630 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0a140f8ae0 con 0x7f09fc0366d0 2024-02-07T12:17:24.087 INFO:teuthology.orchestra.run.smithi047.stdout:Added host 'smithi138' with addr '172.21.15.138' 2024-02-07T12:17:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:24.086+0000 7f0a18f5f700 1 -- 172.21.15.47:0/4108758863 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f09fc0366d0 msgr2=0x7f09fc038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:24.086+0000 7f0a18f5f700 1 --2- 172.21.15.47:0/4108758863 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f09fc0366d0 0x7f09fc038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009990 tx=0x7f0a08006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:24.086+0000 7f0a18f5f700 1 -- 172.21.15.47:0/4108758863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a140fbac0 msgr2=0x7f0a1410ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:24.086+0000 7f0a18f5f700 1 --2- 172.21.15.47:0/4108758863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a140fbac0 0x7f0a1410ceb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009b80 tx=0x7f0a04009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:24.086+0000 7f0a18f5f700 1 -- 172.21.15.47:0/4108758863 shutdown_connections 2024-02-07T12:17:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:24.086+0000 7f0a18f5f700 1 --2- 172.21.15.47:0/4108758863 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f09fc0366d0 0x7f09fc038b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:24.087+0000 7f0a18f5f700 1 --2- 172.21.15.47:0/4108758863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a140fbac0 0x7f0a1410ceb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:24.087+0000 7f0a18f5f700 1 -- 172.21.15.47:0/4108758863 >> 172.21.15.47:0/4108758863 conn(0x7f0a140f71a0 msgr2=0x7f0a140f7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:24.087+0000 7f0a18f5f700 1 -- 172.21.15.47:0/4108758863 shutdown_connections 2024-02-07T12:17:24.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:24.087+0000 7f0a18f5f700 1 -- 172.21.15.47:0/4108758863 wait complete. 2024-02-07T12:17:25.155 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:25 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:25.155 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:25 smithi047 ceph-mon[28972]: Added host smithi138 2024-02-07T12:17:25.155 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:25 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:25.155 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:25 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:25.155 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:25 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:25.155 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:25 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:25.182 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph orch host ls --format=json 2024-02-07T12:17:25.459 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:17:26.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:26 smithi047 ceph-mon[28972]: Deploying daemon alertmanager.smithi047 on smithi047 2024-02-07T12:17:26.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:26 smithi047 ceph-mon[28972]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:27.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.545+0000 7f3095617700 1 -- 172.21.15.47:0/1875844019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30900fbad0 msgr2=0x7f30900fbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.545+0000 7f3095617700 1 --2- 172.21.15.47:0/1875844019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30900fbad0 0x7f30900fbee0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f30800048c0 tx=0x7f3080009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.545+0000 7f3095617700 1 -- 172.21.15.47:0/1875844019 shutdown_connections 2024-02-07T12:17:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.545+0000 7f3095617700 1 --2- 172.21.15.47:0/1875844019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30900fbad0 0x7f30900fbee0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.545+0000 7f3095617700 1 -- 172.21.15.47:0/1875844019 >> 172.21.15.47:0/1875844019 conn(0x7f30900f7190 msgr2=0x7f30900f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.545+0000 7f3095617700 1 -- 172.21.15.47:0/1875844019 shutdown_connections 2024-02-07T12:17:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.545+0000 7f3095617700 1 -- 172.21.15.47:0/1875844019 wait complete. 2024-02-07T12:17:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.545+0000 7f3095617700 1 Processor -- start 2024-02-07T12:17:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.546+0000 7f3095617700 1 -- start start 2024-02-07T12:17:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.546+0000 7f3095617700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30900fbad0 0x7f309010fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.546+0000 7f3095617700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3090065d80 con 0x7f30900fbad0 2024-02-07T12:17:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.546+0000 7f308effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30900fbad0 0x7f309010fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.546+0000 7f308effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30900fbad0 0x7f309010fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37658/0 (socket says 172.21.15.47:37658) 2024-02-07T12:17:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.546+0000 7f308effd700 1 -- 172.21.15.47:0/3834646712 learned_addr learned my addr 172.21.15.47:0/3834646712 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:27.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.546+0000 7f308effd700 1 -- 172.21.15.47:0/3834646712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3080005040 con 0x7f30900fbad0 2024-02-07T12:17:27.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.546+0000 7f308effd700 1 --2- 172.21.15.47:0/3834646712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30900fbad0 0x7f309010fbb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3080009b80 tx=0x7f3080009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:27.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.546+0000 7f30777fe700 1 -- 172.21.15.47:0/3834646712 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f308000b5c0 con 0x7f30900fbad0 2024-02-07T12:17:27.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.547+0000 7f3095617700 1 -- 172.21.15.47:0/3834646712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3090065f80 con 0x7f30900fbad0 2024-02-07T12:17:27.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.547+0000 7f3095617700 1 -- 172.21.15.47:0/3834646712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3090110330 con 0x7f30900fbad0 2024-02-07T12:17:27.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.547+0000 7f30777fe700 1 -- 172.21.15.47:0/3834646712 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f308000be70 con 0x7f30900fbad0 2024-02-07T12:17:27.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.547+0000 7f30777fe700 1 -- 172.21.15.47:0/3834646712 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f308001c660 con 0x7f30900fbad0 2024-02-07T12:17:27.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.548+0000 7f3095617700 1 -- 172.21.15.47:0/3834646712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30901058a0 con 0x7f30900fbad0 2024-02-07T12:17:27.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.548+0000 7f30777fe700 1 -- 172.21.15.47:0/3834646712 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f3080013420 con 0x7f30900fbad0 2024-02-07T12:17:27.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.548+0000 7f30777fe700 1 --2- 172.21.15.47:0/3834646712 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f307803ab30 0x7f307803cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:27.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.548+0000 7f30777fe700 1 -- 172.21.15.47:0/3834646712 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f30800497e0 con 0x7f30900fbad0 2024-02-07T12:17:27.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.548+0000 7f308e7fc700 1 --2- 172.21.15.47:0/3834646712 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f307803ab30 0x7f307803cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:27.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.549+0000 7f308e7fc700 1 --2- 172.21.15.47:0/3834646712 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f307803ab30 0x7f307803cfe0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3084009990 tx=0x7f3084006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:27.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.554+0000 7f30777fe700 1 -- 172.21.15.47:0/3834646712 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3080004d30 con 0x7f30900fbad0 2024-02-07T12:17:27.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.758+0000 7f3095617700 1 -- 172.21.15.47:0/3834646712 --> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f309002b4e0 con 0x7f307803ab30 2024-02-07T12:17:27.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.760+0000 7f30777fe700 1 -- 172.21.15.47:0/3834646712 <== mgr.14162 v2:172.21.15.47:6800/3304641630 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f309002b4e0 con 0x7f307803ab30 2024-02-07T12:17:27.762 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:17:27.763 INFO:teuthology.orchestra.run.smithi047.stdout:[{"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}, {"addr": "172.21.15.138", "hostname": "smithi138", "labels": [], "status": ""}] 2024-02-07T12:17:27.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.762+0000 7f3095617700 1 -- 172.21.15.47:0/3834646712 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f307803ab30 msgr2=0x7f307803cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:27.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.762+0000 7f3095617700 1 --2- 172.21.15.47:0/3834646712 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f307803ab30 0x7f307803cfe0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3084009990 tx=0x7f3084006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:27.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.762+0000 7f3095617700 1 -- 172.21.15.47:0/3834646712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30900fbad0 msgr2=0x7f309010fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:27.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.762+0000 7f3095617700 1 --2- 172.21.15.47:0/3834646712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30900fbad0 0x7f309010fbb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3080009b80 tx=0x7f3080009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:27.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.762+0000 7f3095617700 1 -- 172.21.15.47:0/3834646712 shutdown_connections 2024-02-07T12:17:27.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.762+0000 7f3095617700 1 --2- 172.21.15.47:0/3834646712 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f307803ab30 0x7f307803cfe0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:27.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.762+0000 7f3095617700 1 --2- 172.21.15.47:0/3834646712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30900fbad0 0x7f309010fbb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:27.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.762+0000 7f3095617700 1 -- 172.21.15.47:0/3834646712 >> 172.21.15.47:0/3834646712 conn(0x7f30900f7190 msgr2=0x7f30900f7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.762+0000 7f3095617700 1 -- 172.21.15.47:0/3834646712 shutdown_connections 2024-02-07T12:17:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:27.762+0000 7f3095617700 1 -- 172.21.15.47:0/3834646712 wait complete. 2024-02-07T12:17:28.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:28 smithi047 ceph-mon[28972]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:28.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:28 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:29.122 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-07T12:17:29.122 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph osd crush tunables default 2024-02-07T12:17:29.375 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:17:29.497 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:29 smithi047 ceph-mon[28972]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-07T12:17:30.383 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:30 smithi047 ceph-mon[28972]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:32.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:32 smithi047 ceph-mon[28972]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:33.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.711+0000 7f6cd1f75700 1 -- 172.21.15.47:0/1326489157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ccc0fcbb0 msgr2=0x7f6ccc0fcfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:33.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.711+0000 7f6cd1f75700 1 --2- 172.21.15.47:0/1326489157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ccc0fcbb0 0x7f6ccc0fcfc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0048c0 tx=0x7f6cbc009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:33.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.711+0000 7f6cd1f75700 1 -- 172.21.15.47:0/1326489157 shutdown_connections 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.711+0000 7f6cd1f75700 1 --2- 172.21.15.47:0/1326489157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ccc0fcbb0 0x7f6ccc0fcfc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.711+0000 7f6cd1f75700 1 -- 172.21.15.47:0/1326489157 >> 172.21.15.47:0/1326489157 conn(0x7f6ccc0f8330 msgr2=0x7f6ccc0fa740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.711+0000 7f6cd1f75700 1 -- 172.21.15.47:0/1326489157 shutdown_connections 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.711+0000 7f6cd1f75700 1 -- 172.21.15.47:0/1326489157 wait complete. 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.712+0000 7f6cd1f75700 1 Processor -- start 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.712+0000 7f6cd1f75700 1 -- start start 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.712+0000 7f6cd1f75700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ccc0fcbb0 0x7f6ccc071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.712+0000 7f6cd1f75700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0702e0 con 0x7f6ccc0fcbb0 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.712+0000 7f6ccb7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ccc0fcbb0 0x7f6ccc071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.712+0000 7f6ccb7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ccc0fcbb0 0x7f6ccc071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50348/0 (socket says 172.21.15.47:50348) 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.712+0000 7f6ccb7fe700 1 -- 172.21.15.47:0/3380065744 learned_addr learned my addr 172.21.15.47:0/3380065744 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.713+0000 7f6ccb7fe700 1 -- 172.21.15.47:0/3380065744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc005040 con 0x7f6ccc0fcbb0 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.713+0000 7f6ccb7fe700 1 --2- 172.21.15.47:0/3380065744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ccc0fcbb0 0x7f6ccc071e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009680 tx=0x7f6cbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.713+0000 7f6cc3fff700 1 -- 172.21.15.47:0/3380065744 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6cbc00b5c0 con 0x7f6ccc0fcbb0 2024-02-07T12:17:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.713+0000 7f6cc3fff700 1 -- 172.21.15.47:0/3380065744 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cbc004e60 con 0x7f6ccc0fcbb0 2024-02-07T12:17:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.713+0000 7f6cd1f75700 1 -- 172.21.15.47:0/3380065744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc0704e0 con 0x7f6ccc0fcbb0 2024-02-07T12:17:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.713+0000 7f6cc3fff700 1 -- 172.21.15.47:0/3380065744 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6cbc01c590 con 0x7f6ccc0fcbb0 2024-02-07T12:17:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.713+0000 7f6cd1f75700 1 -- 172.21.15.47:0/3380065744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc0709d0 con 0x7f6ccc0fcbb0 2024-02-07T12:17:33.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.714+0000 7f6cc3fff700 1 -- 172.21.15.47:0/3380065744 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f6cbc01c810 con 0x7f6ccc0fcbb0 2024-02-07T12:17:33.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.714+0000 7f6cd1f75700 1 -- 172.21.15.47:0/3380065744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ccc106900 con 0x7f6ccc0fcbb0 2024-02-07T12:17:33.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.714+0000 7f6cc3fff700 1 --2- 172.21.15.47:0/3380065744 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f6cb80366d0 0x7f6cb8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:33.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.714+0000 7f6cc3fff700 1 -- 172.21.15.47:0/3380065744 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6cbc049920 con 0x7f6ccc0fcbb0 2024-02-07T12:17:33.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.714+0000 7f6ccaffd700 1 --2- 172.21.15.47:0/3380065744 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f6cb80366d0 0x7f6cb8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:33.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.715+0000 7f6ccaffd700 1 --2- 172.21.15.47:0/3380065744 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f6cb80366d0 0x7f6cb8038b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4009990 tx=0x7f6cb4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:33.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.719+0000 7f6cc3fff700 1 -- 172.21.15.47:0/3380065744 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6cbc023300 con 0x7f6ccc0fcbb0 2024-02-07T12:17:33.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:33.916+0000 7f6cd1f75700 1 -- 172.21.15.47:0/3380065744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6ccc05f5c0 con 0x7f6ccc0fcbb0 2024-02-07T12:17:34.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:34.093+0000 7f6cc3fff700 1 -- 172.21.15.47:0/3380065744 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6cbc011b60 con 0x7f6ccc0fcbb0 2024-02-07T12:17:34.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:34.095+0000 7f6cd1f75700 1 -- 172.21.15.47:0/3380065744 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f6cb80366d0 msgr2=0x7f6cb8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:34.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:34.095+0000 7f6cd1f75700 1 --2- 172.21.15.47:0/3380065744 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f6cb80366d0 0x7f6cb8038b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4009990 tx=0x7f6cb4006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:34.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:34.095+0000 7f6cd1f75700 1 -- 172.21.15.47:0/3380065744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ccc0fcbb0 msgr2=0x7f6ccc071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:34.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:34.095+0000 7f6cd1f75700 1 --2- 172.21.15.47:0/3380065744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ccc0fcbb0 0x7f6ccc071e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009680 tx=0x7f6cbc009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:34.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:34.095+0000 7f6cd1f75700 1 -- 172.21.15.47:0/3380065744 shutdown_connections 2024-02-07T12:17:34.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:34.095+0000 7f6cd1f75700 1 --2- 172.21.15.47:0/3380065744 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f6cb80366d0 0x7f6cb8038b80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:34.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:34.095+0000 7f6cd1f75700 1 --2- 172.21.15.47:0/3380065744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ccc0fcbb0 0x7f6ccc071e60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:34.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:34.095+0000 7f6cd1f75700 1 -- 172.21.15.47:0/3380065744 >> 172.21.15.47:0/3380065744 conn(0x7f6ccc0f8330 msgr2=0x7f6ccc0f9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:34.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:34.095+0000 7f6cd1f75700 1 -- 172.21.15.47:0/3380065744 shutdown_connections 2024-02-07T12:17:34.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:17:34.095+0000 7f6cd1f75700 1 -- 172.21.15.47:0/3380065744 wait complete. 2024-02-07T12:17:34.098 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-02-07T12:17:34.409 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:34 smithi047 ceph-mon[28972]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:34.409 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:34 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3380065744' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-07T12:17:34.669 INFO:tasks.cephadm:Adding mon.smithi047 on smithi047 2024-02-07T12:17:34.669 INFO:tasks.cephadm:Adding mon.smithi138 on smithi138 2024-02-07T12:17:34.670 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph orch apply mon '2;smithi047:172.21.15.47=smithi047;smithi138:172.21.15.138=smithi138' 2024-02-07T12:17:34.919 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:34.966 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:35.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:35 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3380065744' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-07T12:17:35.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:35 smithi047 ceph-mon[28972]: osdmap e4: 0 total, 0 up, 0 in 2024-02-07T12:17:35.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:35 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:35 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:35 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:35 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:35 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:35 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:35 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-07T12:17:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:35 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:36.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.479+0000 7f4af2a43700 1 -- 172.21.15.138:0/1142662509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aec0fd0c0 msgr2=0x7f4aec0fd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:36.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.479+0000 7f4af2a43700 1 --2- 172.21.15.138:0/1142662509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aec0fd0c0 0x7f4aec0fd4d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0048c0 tx=0x7f4adc009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:36.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.479+0000 7f4af2a43700 1 -- 172.21.15.138:0/1142662509 shutdown_connections 2024-02-07T12:17:36.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.479+0000 7f4af2a43700 1 --2- 172.21.15.138:0/1142662509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aec0fd0c0 0x7f4aec0fd4d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:36.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.479+0000 7f4af2a43700 1 -- 172.21.15.138:0/1142662509 >> 172.21.15.138:0/1142662509 conn(0x7f4aec0f6920 msgr2=0x7f4aec0f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:36.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.479+0000 7f4af2a43700 1 -- 172.21.15.138:0/1142662509 shutdown_connections 2024-02-07T12:17:36.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.479+0000 7f4af2a43700 1 -- 172.21.15.138:0/1142662509 wait complete. 2024-02-07T12:17:36.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.479+0000 7f4af2a43700 1 Processor -- start 2024-02-07T12:17:36.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.480+0000 7f4af2a43700 1 -- start start 2024-02-07T12:17:36.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.480+0000 7f4af2a43700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aec0fd0c0 0x7f4aec10cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:36.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.480+0000 7f4af2a43700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec10d420 con 0x7f4aec0fd0c0 2024-02-07T12:17:36.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.480+0000 7f4aebfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aec0fd0c0 0x7f4aec10cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:36.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.480+0000 7f4aebfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aec0fd0c0 0x7f4aec10cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:33750/0 (socket says 172.21.15.138:33750) 2024-02-07T12:17:36.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.480+0000 7f4aebfff700 1 -- 172.21.15.138:0/2016595009 learned_addr learned my addr 172.21.15.138:0/2016595009 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:17:36.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.480+0000 7f4aebfff700 1 -- 172.21.15.138:0/2016595009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc005040 con 0x7f4aec0fd0c0 2024-02-07T12:17:36.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.480+0000 7f4aebfff700 1 --2- 172.21.15.138:0/2016595009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aec0fd0c0 0x7f4aec10cee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009680 tx=0x7f4adc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:36.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.481+0000 7f4ae8ff9700 1 -- 172.21.15.138:0/2016595009 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4adc00bed0 con 0x7f4aec0fd0c0 2024-02-07T12:17:36.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.481+0000 7f4af2a43700 1 -- 172.21.15.138:0/2016595009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec10d620 con 0x7f4aec0fd0c0 2024-02-07T12:17:36.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.481+0000 7f4ae8ff9700 1 -- 172.21.15.138:0/2016595009 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4adc00b5c0 con 0x7f4aec0fd0c0 2024-02-07T12:17:36.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.481+0000 7f4ae8ff9700 1 -- 172.21.15.138:0/2016595009 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4adc01c5b0 con 0x7f4aec0fd0c0 2024-02-07T12:17:36.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.481+0000 7f4af2a43700 1 -- 172.21.15.138:0/2016595009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec10e2c0 con 0x7f4aec0fd0c0 2024-02-07T12:17:36.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.481+0000 7f4ae8ff9700 1 -- 172.21.15.138:0/2016595009 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f4adc01c820 con 0x7f4aec0fd0c0 2024-02-07T12:17:36.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.482+0000 7f4af2a43700 1 -- 172.21.15.138:0/2016595009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec05f5c0 con 0x7f4aec0fd0c0 2024-02-07T12:17:36.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.482+0000 7f4ae8ff9700 1 --2- 172.21.15.138:0/2016595009 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f4ad40366d0 0x7f4ad4038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:36.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.482+0000 7f4ae8ff9700 1 -- 172.21.15.138:0/2016595009 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4adc049c30 con 0x7f4aec0fd0c0 2024-02-07T12:17:36.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.482+0000 7f4aeb7fe700 1 --2- 172.21.15.138:0/2016595009 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f4ad40366d0 0x7f4ad4038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:36.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.482+0000 7f4aeb7fe700 1 --2- 172.21.15.138:0/2016595009 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f4ad40366d0 0x7f4ad4038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009990 tx=0x7f4ae0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:36.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.488+0000 7f4ae8ff9700 1 -- 172.21.15.138:0/2016595009 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4adc023300 con 0x7f4aec0fd0c0 2024-02-07T12:17:36.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:36 smithi047 ceph-mon[28972]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:36.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:36 smithi047 ceph-mon[28972]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-07T12:17:36.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:36 smithi047 ceph-mon[28972]: Deploying daemon grafana.smithi047 on smithi047 2024-02-07T12:17:36.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.677+0000 7f4af2a43700 1 -- 172.21.15.138:0/2016595009 --> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi047:172.21.15.47=smithi047;smithi138:172.21.15.138=smithi138", "target": ["mon-mgr", ""]}) v1 -- 0x7f4aec10ef30 con 0x7f4ad40366d0 2024-02-07T12:17:36.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.684+0000 7f4ae8ff9700 1 -- 172.21.15.138:0/2016595009 <== mgr.14162 v2:172.21.15.47:6800/3304641630 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4aec10ef30 con 0x7f4ad40366d0 2024-02-07T12:17:36.686 INFO:teuthology.orchestra.run.smithi138.stdout:Scheduled mon update... 2024-02-07T12:17:36.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.685+0000 7f4af2a43700 1 -- 172.21.15.138:0/2016595009 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f4ad40366d0 msgr2=0x7f4ad4038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:36.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.685+0000 7f4af2a43700 1 --2- 172.21.15.138:0/2016595009 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f4ad40366d0 0x7f4ad4038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009990 tx=0x7f4ae0006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:36.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.685+0000 7f4af2a43700 1 -- 172.21.15.138:0/2016595009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aec0fd0c0 msgr2=0x7f4aec10cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:36.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.685+0000 7f4af2a43700 1 --2- 172.21.15.138:0/2016595009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aec0fd0c0 0x7f4aec10cee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009680 tx=0x7f4adc009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:36.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.685+0000 7f4af2a43700 1 -- 172.21.15.138:0/2016595009 shutdown_connections 2024-02-07T12:17:36.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.685+0000 7f4af2a43700 1 --2- 172.21.15.138:0/2016595009 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f4ad40366d0 0x7f4ad4038b80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:36.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.685+0000 7f4af2a43700 1 --2- 172.21.15.138:0/2016595009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aec0fd0c0 0x7f4aec10cee0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:36.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.685+0000 7f4af2a43700 1 -- 172.21.15.138:0/2016595009 >> 172.21.15.138:0/2016595009 conn(0x7f4aec0f6920 msgr2=0x7f4aec0f7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:36.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.685+0000 7f4af2a43700 1 -- 172.21.15.138:0/2016595009 shutdown_connections 2024-02-07T12:17:36.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:36.685+0000 7f4af2a43700 1 -- 172.21.15.138:0/2016595009 wait complete. 2024-02-07T12:17:37.226 DEBUG:teuthology.orchestra.run.smithi138:mon.smithi138> sudo journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi138.service 2024-02-07T12:17:37.229 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:17:37.230 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:17:37.505 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:37.552 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:38.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:37 smithi047 ceph-mon[28972]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi047:172.21.15.47=smithi047;smithi138:172.21.15.138=smithi138", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:17:38.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:37 smithi047 ceph-mon[28972]: Saving service mon spec with placement smithi047:172.21.15.47=smithi047;smithi138:172.21.15.138=smithi138;count:2 2024-02-07T12:17:38.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:37 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:38.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:37 smithi047 ceph-mon[28972]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:38.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.815+0000 7f89d6ee5700 1 -- 172.21.15.138:0/3827149349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89d00fcbd0 msgr2=0x7f89d00fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.815+0000 7f89d6ee5700 1 --2- 172.21.15.138:0/3827149349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89d00fcbd0 0x7f89d00fcfe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f89c40048c0 tx=0x7f89c4009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.815+0000 7f89d6ee5700 1 -- 172.21.15.138:0/3827149349 shutdown_connections 2024-02-07T12:17:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.815+0000 7f89d6ee5700 1 --2- 172.21.15.138:0/3827149349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89d00fcbd0 0x7f89d00fcfe0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.815+0000 7f89d6ee5700 1 -- 172.21.15.138:0/3827149349 >> 172.21.15.138:0/3827149349 conn(0x7f89d00f8290 msgr2=0x7f89d00fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.815+0000 7f89d6ee5700 1 -- 172.21.15.138:0/3827149349 shutdown_connections 2024-02-07T12:17:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.815+0000 7f89d6ee5700 1 -- 172.21.15.138:0/3827149349 wait complete. 2024-02-07T12:17:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.815+0000 7f89d6ee5700 1 Processor -- start 2024-02-07T12:17:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.815+0000 7f89d6ee5700 1 -- start start 2024-02-07T12:17:38.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.816+0000 7f89d6ee5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89d00fcbd0 0x7f89d010cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:38.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.816+0000 7f89d6ee5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d010d400 con 0x7f89d00fcbd0 2024-02-07T12:17:38.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.816+0000 7f89d4c81700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89d00fcbd0 0x7f89d010cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:38.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.816+0000 7f89d4c81700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89d00fcbd0 0x7f89d010cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:33762/0 (socket says 172.21.15.138:33762) 2024-02-07T12:17:38.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.816+0000 7f89d4c81700 1 -- 172.21.15.138:0/1969747988 learned_addr learned my addr 172.21.15.138:0/1969747988 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:17:38.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.816+0000 7f89d4c81700 1 -- 172.21.15.138:0/1969747988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c4005040 con 0x7f89d00fcbd0 2024-02-07T12:17:38.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.816+0000 7f89d4c81700 1 --2- 172.21.15.138:0/1969747988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89d00fcbd0 0x7f89d010cec0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009680 tx=0x7f89c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:38.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.816+0000 7f89cd7fa700 1 -- 172.21.15.138:0/1969747988 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89c400bed0 con 0x7f89d00fcbd0 2024-02-07T12:17:38.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.816+0000 7f89cd7fa700 1 -- 172.21.15.138:0/1969747988 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89c400b5c0 con 0x7f89d00fcbd0 2024-02-07T12:17:38.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.816+0000 7f89cd7fa700 1 -- 172.21.15.138:0/1969747988 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89c401c5b0 con 0x7f89d00fcbd0 2024-02-07T12:17:38.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.816+0000 7f89d6ee5700 1 -- 172.21.15.138:0/1969747988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d010d600 con 0x7f89d00fcbd0 2024-02-07T12:17:38.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.816+0000 7f89d6ee5700 1 -- 172.21.15.138:0/1969747988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d010e2a0 con 0x7f89d00fcbd0 2024-02-07T12:17:38.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.817+0000 7f89cd7fa700 1 -- 172.21.15.138:0/1969747988 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f89c4013420 con 0x7f89d00fcbd0 2024-02-07T12:17:38.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.817+0000 7f89d6ee5700 1 -- 172.21.15.138:0/1969747988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d005f5c0 con 0x7f89d00fcbd0 2024-02-07T12:17:38.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.818+0000 7f89cd7fa700 1 --2- 172.21.15.138:0/1969747988 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f89c00366d0 0x7f89c0038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:38.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.818+0000 7f89cd7fa700 1 -- 172.21.15.138:0/1969747988 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f89c40498a0 con 0x7f89d00fcbd0 2024-02-07T12:17:38.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.818+0000 7f89cffff700 1 --2- 172.21.15.138:0/1969747988 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f89c00366d0 0x7f89c0038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:38.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.818+0000 7f89cffff700 1 --2- 172.21.15.138:0/1969747988 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f89c00366d0 0x7f89c0038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009990 tx=0x7f89bc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:38.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:38.825+0000 7f89cd7fa700 1 -- 172.21.15.138:0/1969747988 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f89c4025400 con 0x7f89d00fcbd0 2024-02-07T12:17:39.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:39.079+0000 7f89d6ee5700 1 -- 172.21.15.138:0/1969747988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f89d010edf0 con 0x7f89d00fcbd0 2024-02-07T12:17:39.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:39.079+0000 7f89cd7fa700 1 -- 172.21.15.138:0/1969747988 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f89c4004d30 con 0x7f89d00fcbd0 2024-02-07T12:17:39.083 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:17:39.083 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:17:39.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:39.082+0000 7f89d6ee5700 1 -- 172.21.15.138:0/1969747988 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f89c00366d0 msgr2=0x7f89c0038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:39.082+0000 7f89d6ee5700 1 --2- 172.21.15.138:0/1969747988 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f89c00366d0 0x7f89c0038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009990 tx=0x7f89bc006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:39.082+0000 7f89d6ee5700 1 -- 172.21.15.138:0/1969747988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89d00fcbd0 msgr2=0x7f89d010cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:39.082+0000 7f89d6ee5700 1 --2- 172.21.15.138:0/1969747988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89d00fcbd0 0x7f89d010cec0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009680 tx=0x7f89c4009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:39.082+0000 7f89d6ee5700 1 -- 172.21.15.138:0/1969747988 shutdown_connections 2024-02-07T12:17:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:39.082+0000 7f89d6ee5700 1 --2- 172.21.15.138:0/1969747988 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f89c00366d0 0x7f89c0038b80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:39.082+0000 7f89d6ee5700 1 --2- 172.21.15.138:0/1969747988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89d00fcbd0 0x7f89d010cec0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:39.082+0000 7f89d6ee5700 1 -- 172.21.15.138:0/1969747988 >> 172.21.15.138:0/1969747988 conn(0x7f89d00f8290 msgr2=0x7f89d00f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:39.082+0000 7f89d6ee5700 1 -- 172.21.15.138:0/1969747988 shutdown_connections 2024-02-07T12:17:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:39.082+0000 7f89d6ee5700 1 -- 172.21.15.138:0/1969747988 wait complete. 2024-02-07T12:17:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:17:39.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:38 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:40.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:39 smithi047 ceph-mon[28972]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:40.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:39 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/1969747988' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:17:40.655 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:17:40.656 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:17:40.902 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:40.948 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:42.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:41 smithi047 ceph-mon[28972]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:42.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.366+0000 7fc05dc29700 1 -- 172.21.15.138:0/3549641691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0580fe200 msgr2=0x7fc0580fe610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:42.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.366+0000 7fc05dc29700 1 --2- 172.21.15.138:0/3549641691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0580fe200 0x7fc0580fe610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc0480048c0 tx=0x7fc048009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:42.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.366+0000 7fc05dc29700 1 -- 172.21.15.138:0/3549641691 shutdown_connections 2024-02-07T12:17:42.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.366+0000 7fc05dc29700 1 --2- 172.21.15.138:0/3549641691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0580fe200 0x7fc0580fe610 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:42.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.366+0000 7fc05dc29700 1 -- 172.21.15.138:0/3549641691 >> 172.21.15.138:0/3549641691 conn(0x7fc0580f69c0 msgr2=0x7fc0580f8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:42.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.366+0000 7fc05dc29700 1 -- 172.21.15.138:0/3549641691 shutdown_connections 2024-02-07T12:17:42.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.366+0000 7fc05dc29700 1 -- 172.21.15.138:0/3549641691 wait complete. 2024-02-07T12:17:42.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.367+0000 7fc05dc29700 1 Processor -- start 2024-02-07T12:17:42.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.367+0000 7fc05dc29700 1 -- start start 2024-02-07T12:17:42.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.367+0000 7fc05dc29700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0580fe200 0x7fc05810cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:42.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.367+0000 7fc05dc29700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05810d460 con 0x7fc0580fe200 2024-02-07T12:17:42.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.367+0000 7fc0577fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0580fe200 0x7fc05810cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:42.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.367+0000 7fc0577fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0580fe200 0x7fc05810cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:49034/0 (socket says 172.21.15.138:49034) 2024-02-07T12:17:42.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.367+0000 7fc0577fe700 1 -- 172.21.15.138:0/2873680189 learned_addr learned my addr 172.21.15.138:0/2873680189 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:17:42.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.368+0000 7fc0577fe700 1 -- 172.21.15.138:0/2873680189 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc048005040 con 0x7fc0580fe200 2024-02-07T12:17:42.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.368+0000 7fc0577fe700 1 --2- 172.21.15.138:0/2873680189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0580fe200 0x7fc05810cf20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc048009300 tx=0x7fc048009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:42.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.368+0000 7fc03ffff700 1 -- 172.21.15.138:0/2873680189 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc048004e60 con 0x7fc0580fe200 2024-02-07T12:17:42.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.368+0000 7fc05dc29700 1 -- 172.21.15.138:0/2873680189 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05810d660 con 0x7fc0580fe200 2024-02-07T12:17:42.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.368+0000 7fc03ffff700 1 -- 172.21.15.138:0/2873680189 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc048009680 con 0x7fc0580fe200 2024-02-07T12:17:42.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.368+0000 7fc03ffff700 1 -- 172.21.15.138:0/2873680189 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc04801c5b0 con 0x7fc0580fe200 2024-02-07T12:17:42.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.368+0000 7fc05dc29700 1 -- 172.21.15.138:0/2873680189 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05810e300 con 0x7fc0580fe200 2024-02-07T12:17:42.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.369+0000 7fc03ffff700 1 -- 172.21.15.138:0/2873680189 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fc04801c870 con 0x7fc0580fe200 2024-02-07T12:17:42.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.369+0000 7fc05dc29700 1 -- 172.21.15.138:0/2873680189 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05805f5c0 con 0x7fc0580fe200 2024-02-07T12:17:42.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.369+0000 7fc03ffff700 1 --2- 172.21.15.138:0/2873680189 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc0400366d0 0x7fc040038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:42.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.369+0000 7fc03ffff700 1 -- 172.21.15.138:0/2873680189 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc048049970 con 0x7fc0580fe200 2024-02-07T12:17:42.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.369+0000 7fc056ffd700 1 --2- 172.21.15.138:0/2873680189 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc0400366d0 0x7fc040038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:42.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.370+0000 7fc056ffd700 1 --2- 172.21.15.138:0/2873680189 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc0400366d0 0x7fc040038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009990 tx=0x7fc04c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:42.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.374+0000 7fc03ffff700 1 -- 172.21.15.138:0/2873680189 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc048023300 con 0x7fc0580fe200 2024-02-07T12:17:42.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.628+0000 7fc05dc29700 1 -- 172.21.15.138:0/2873680189 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc05810ee50 con 0x7fc0580fe200 2024-02-07T12:17:42.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.629+0000 7fc03ffff700 1 -- 172.21.15.138:0/2873680189 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc048011b60 con 0x7fc0580fe200 2024-02-07T12:17:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:17:42.632 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:17:42.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.631+0000 7fc05dc29700 1 -- 172.21.15.138:0/2873680189 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc0400366d0 msgr2=0x7fc040038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:42.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.631+0000 7fc05dc29700 1 --2- 172.21.15.138:0/2873680189 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc0400366d0 0x7fc040038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009990 tx=0x7fc04c006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:42.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.631+0000 7fc05dc29700 1 -- 172.21.15.138:0/2873680189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0580fe200 msgr2=0x7fc05810cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:42.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.631+0000 7fc05dc29700 1 --2- 172.21.15.138:0/2873680189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0580fe200 0x7fc05810cf20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc048009300 tx=0x7fc048009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:42.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.631+0000 7fc05dc29700 1 -- 172.21.15.138:0/2873680189 shutdown_connections 2024-02-07T12:17:42.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.631+0000 7fc05dc29700 1 --2- 172.21.15.138:0/2873680189 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc0400366d0 0x7fc040038b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:42.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.631+0000 7fc05dc29700 1 --2- 172.21.15.138:0/2873680189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0580fe200 0x7fc05810cf20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:42.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.631+0000 7fc05dc29700 1 -- 172.21.15.138:0/2873680189 >> 172.21.15.138:0/2873680189 conn(0x7fc0580f69c0 msgr2=0x7fc0580f7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:42.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.631+0000 7fc05dc29700 1 -- 172.21.15.138:0/2873680189 shutdown_connections 2024-02-07T12:17:42.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:42.631+0000 7fc05dc29700 1 -- 172.21.15.138:0/2873680189 wait complete. 2024-02-07T12:17:42.634 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:17:43.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:42 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/2873680189' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:17:44.233 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:17:44.234 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:17:44.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:43 smithi047 ceph-mon[28972]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:44.477 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:44.522 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:46.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.018+0000 7f5bf73be700 1 -- 172.21.15.138:0/3275140255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf00fcbd0 msgr2=0x7f5bf00fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:46.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.018+0000 7f5bf73be700 1 --2- 172.21.15.138:0/3275140255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf00fcbd0 0x7f5bf00fcfe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5be00048c0 tx=0x7f5be0009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:46.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.018+0000 7f5bf73be700 1 -- 172.21.15.138:0/3275140255 shutdown_connections 2024-02-07T12:17:46.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.018+0000 7f5bf73be700 1 --2- 172.21.15.138:0/3275140255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf00fcbd0 0x7f5bf00fcfe0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:46.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.019+0000 7f5bf73be700 1 -- 172.21.15.138:0/3275140255 >> 172.21.15.138:0/3275140255 conn(0x7f5bf00f8290 msgr2=0x7f5bf00fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:46.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.019+0000 7f5bf73be700 1 -- 172.21.15.138:0/3275140255 shutdown_connections 2024-02-07T12:17:46.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.019+0000 7f5bf73be700 1 -- 172.21.15.138:0/3275140255 wait complete. 2024-02-07T12:17:46.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.019+0000 7f5bf73be700 1 Processor -- start 2024-02-07T12:17:46.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.019+0000 7f5bf73be700 1 -- start start 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.019+0000 7f5bf73be700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf00fcbd0 0x7f5bf010cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.019+0000 7f5bf73be700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf010d400 con 0x7f5bf00fcbd0 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.019+0000 7f5bf515a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf00fcbd0 0x7f5bf010cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.019+0000 7f5bf515a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf00fcbd0 0x7f5bf010cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:49052/0 (socket says 172.21.15.138:49052) 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.019+0000 7f5bf515a700 1 -- 172.21.15.138:0/2746885962 learned_addr learned my addr 172.21.15.138:0/2746885962 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.020+0000 7f5bf515a700 1 -- 172.21.15.138:0/2746885962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be0005040 con 0x7f5bf00fcbd0 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.020+0000 7f5bf515a700 1 --2- 172.21.15.138:0/2746885962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf00fcbd0 0x7f5bf010cec0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009680 tx=0x7f5be0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.020+0000 7f5be5ffb700 1 -- 172.21.15.138:0/2746885962 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5be000bed0 con 0x7f5bf00fcbd0 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.020+0000 7f5be5ffb700 1 -- 172.21.15.138:0/2746885962 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5be000b5c0 con 0x7f5bf00fcbd0 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.020+0000 7f5bf73be700 1 -- 172.21.15.138:0/2746885962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf010d600 con 0x7f5bf00fcbd0 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.020+0000 7f5be5ffb700 1 -- 172.21.15.138:0/2746885962 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5be001c5b0 con 0x7f5bf00fcbd0 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.020+0000 7f5bf73be700 1 -- 172.21.15.138:0/2746885962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf010e2a0 con 0x7f5bf00fcbd0 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.021+0000 7f5be5ffb700 1 -- 172.21.15.138:0/2746885962 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f5be0013420 con 0x7f5bf00fcbd0 2024-02-07T12:17:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.021+0000 7f5bf73be700 1 -- 172.21.15.138:0/2746885962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf005f5c0 con 0x7f5bf00fcbd0 2024-02-07T12:17:46.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.021+0000 7f5be5ffb700 1 --2- 172.21.15.138:0/2746885962 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f5bdc0366d0 0x7f5bdc038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:46.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.021+0000 7f5be5ffb700 1 -- 172.21.15.138:0/2746885962 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5be0049960 con 0x7f5bf00fcbd0 2024-02-07T12:17:46.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.022+0000 7f5bf4959700 1 --2- 172.21.15.138:0/2746885962 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f5bdc0366d0 0x7f5bdc038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:46.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.022+0000 7f5bf4959700 1 --2- 172.21.15.138:0/2746885962 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f5bdc0366d0 0x7f5bdc038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009990 tx=0x7f5bec006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:46.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.026+0000 7f5be5ffb700 1 -- 172.21.15.138:0/2746885962 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5be0025400 con 0x7f5bf00fcbd0 2024-02-07T12:17:46.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.283+0000 7f5bf73be700 1 -- 172.21.15.138:0/2746885962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5bf010edf0 con 0x7f5bf00fcbd0 2024-02-07T12:17:46.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.283+0000 7f5be5ffb700 1 -- 172.21.15.138:0/2746885962 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5be0004d30 con 0x7f5bf00fcbd0 2024-02-07T12:17:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:17:46.286 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:17:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.285+0000 7f5bf73be700 1 -- 172.21.15.138:0/2746885962 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f5bdc0366d0 msgr2=0x7f5bdc038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.285+0000 7f5bf73be700 1 --2- 172.21.15.138:0/2746885962 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f5bdc0366d0 0x7f5bdc038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009990 tx=0x7f5bec006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.285+0000 7f5bf73be700 1 -- 172.21.15.138:0/2746885962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf00fcbd0 msgr2=0x7f5bf010cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.285+0000 7f5bf73be700 1 --2- 172.21.15.138:0/2746885962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf00fcbd0 0x7f5bf010cec0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009680 tx=0x7f5be0009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.285+0000 7f5bf73be700 1 -- 172.21.15.138:0/2746885962 shutdown_connections 2024-02-07T12:17:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.285+0000 7f5bf73be700 1 --2- 172.21.15.138:0/2746885962 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f5bdc0366d0 0x7f5bdc038b80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.285+0000 7f5bf73be700 1 --2- 172.21.15.138:0/2746885962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf00fcbd0 0x7f5bf010cec0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.285+0000 7f5bf73be700 1 -- 172.21.15.138:0/2746885962 >> 172.21.15.138:0/2746885962 conn(0x7f5bf00f8290 msgr2=0x7f5bf00f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:46.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.285+0000 7f5bf73be700 1 -- 172.21.15.138:0/2746885962 shutdown_connections 2024-02-07T12:17:46.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:46.285+0000 7f5bf73be700 1 -- 172.21.15.138:0/2746885962 wait complete. 2024-02-07T12:17:46.289 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:17:46.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:45 smithi047 ceph-mon[28972]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:47.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:46 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/2746885962' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:17:47.928 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:17:47.929 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:17:48.175 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:48.251 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:47 smithi047 ceph-mon[28972]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:49.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:49 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:49.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:49 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:49.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:49 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:49.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:49 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:49.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:49 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:49.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:49 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:49.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:49 smithi047 ceph-mon[28972]: Deploying daemon prometheus.smithi047 on smithi047 2024-02-07T12:17:49.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:49 smithi047 ceph-mon[28972]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:49.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.678+0000 7fb150960700 1 -- 172.21.15.138:0/1125688674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb14c0fbad0 msgr2=0x7fb14c0fbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:49.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.678+0000 7fb150960700 1 --2- 172.21.15.138:0/1125688674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb14c0fbad0 0x7fb14c0fbee0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0048c0 tx=0x7fb13c009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:49.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.678+0000 7fb150960700 1 -- 172.21.15.138:0/1125688674 shutdown_connections 2024-02-07T12:17:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.678+0000 7fb150960700 1 --2- 172.21.15.138:0/1125688674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb14c0fbad0 0x7fb14c0fbee0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.678+0000 7fb150960700 1 -- 172.21.15.138:0/1125688674 >> 172.21.15.138:0/1125688674 conn(0x7fb14c0f7190 msgr2=0x7fb14c0f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.678+0000 7fb150960700 1 -- 172.21.15.138:0/1125688674 shutdown_connections 2024-02-07T12:17:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.678+0000 7fb150960700 1 -- 172.21.15.138:0/1125688674 wait complete. 2024-02-07T12:17:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.678+0000 7fb150960700 1 Processor -- start 2024-02-07T12:17:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.678+0000 7fb150960700 1 -- start start 2024-02-07T12:17:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.678+0000 7fb150960700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb14c0fbad0 0x7fb14c111ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.678+0000 7fb150960700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c10d9e0 con 0x7fb14c0fbad0 2024-02-07T12:17:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.678+0000 7fb14a59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb14c0fbad0 0x7fb14c111ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.679+0000 7fb14a59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb14c0fbad0 0x7fb14c111ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:49080/0 (socket says 172.21.15.138:49080) 2024-02-07T12:17:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.679+0000 7fb14a59c700 1 -- 172.21.15.138:0/880684570 learned_addr learned my addr 172.21.15.138:0/880684570 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:17:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.679+0000 7fb14a59c700 1 -- 172.21.15.138:0/880684570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c005040 con 0x7fb14c0fbad0 2024-02-07T12:17:49.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.679+0000 7fb14a59c700 1 --2- 172.21.15.138:0/880684570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb14c0fbad0 0x7fb14c111ff0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009680 tx=0x7fb13c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:49.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.679+0000 7fb13affd700 1 -- 172.21.15.138:0/880684570 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb13c00bed0 con 0x7fb14c0fbad0 2024-02-07T12:17:49.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.679+0000 7fb13affd700 1 -- 172.21.15.138:0/880684570 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb13c00b5c0 con 0x7fb14c0fbad0 2024-02-07T12:17:49.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.679+0000 7fb13affd700 1 -- 172.21.15.138:0/880684570 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb13c01c5b0 con 0x7fb14c0fbad0 2024-02-07T12:17:49.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.679+0000 7fb150960700 1 -- 172.21.15.138:0/880684570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c066830 con 0x7fb14c0fbad0 2024-02-07T12:17:49.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.679+0000 7fb150960700 1 -- 172.21.15.138:0/880684570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14c112530 con 0x7fb14c0fbad0 2024-02-07T12:17:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.680+0000 7fb13affd700 1 -- 172.21.15.138:0/880684570 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fb13c013420 con 0x7fb14c0fbad0 2024-02-07T12:17:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.680+0000 7fb150960700 1 -- 172.21.15.138:0/880684570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14c1058a0 con 0x7fb14c0fbad0 2024-02-07T12:17:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.680+0000 7fb13affd700 1 --2- 172.21.15.138:0/880684570 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fb134036680 0x7fb134038b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.680+0000 7fb13affd700 1 -- 172.21.15.138:0/880684570 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb13c049930 con 0x7fb14c0fbad0 2024-02-07T12:17:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.680+0000 7fb149d9b700 1 --2- 172.21.15.138:0/880684570 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fb134036680 0x7fb134038b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.681+0000 7fb149d9b700 1 --2- 172.21.15.138:0/880684570 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fb134036680 0x7fb134038b30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb140009990 tx=0x7fb140006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:49.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.685+0000 7fb13affd700 1 -- 172.21.15.138:0/880684570 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb13c013a80 con 0x7fb14c0fbad0 2024-02-07T12:17:49.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.942+0000 7fb150960700 1 -- 172.21.15.138:0/880684570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb14c04bed0 con 0x7fb14c0fbad0 2024-02-07T12:17:49.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.943+0000 7fb13affd700 1 -- 172.21.15.138:0/880684570 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb13c011370 con 0x7fb14c0fbad0 2024-02-07T12:17:49.946 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:17:49.947 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:17:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.945+0000 7fb150960700 1 -- 172.21.15.138:0/880684570 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fb134036680 msgr2=0x7fb134038b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.945+0000 7fb150960700 1 --2- 172.21.15.138:0/880684570 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fb134036680 0x7fb134038b30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb140009990 tx=0x7fb140006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.945+0000 7fb150960700 1 -- 172.21.15.138:0/880684570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb14c0fbad0 msgr2=0x7fb14c111ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.945+0000 7fb150960700 1 --2- 172.21.15.138:0/880684570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb14c0fbad0 0x7fb14c111ff0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009680 tx=0x7fb13c009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.945+0000 7fb150960700 1 -- 172.21.15.138:0/880684570 shutdown_connections 2024-02-07T12:17:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.945+0000 7fb150960700 1 --2- 172.21.15.138:0/880684570 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fb134036680 0x7fb134038b30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.945+0000 7fb150960700 1 --2- 172.21.15.138:0/880684570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb14c0fbad0 0x7fb14c111ff0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.945+0000 7fb150960700 1 -- 172.21.15.138:0/880684570 >> 172.21.15.138:0/880684570 conn(0x7fb14c0f7190 msgr2=0x7fb14c0f7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.945+0000 7fb150960700 1 -- 172.21.15.138:0/880684570 shutdown_connections 2024-02-07T12:17:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:49.945+0000 7fb150960700 1 -- 172.21.15.138:0/880684570 wait complete. 2024-02-07T12:17:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:17:50.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:50 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/880684570' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:17:51.565 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:17:51.565 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:17:51.813 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:51.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:51 smithi047 ceph-mon[28972]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:51.859 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.378+0000 7f4bbac1f700 1 -- 172.21.15.138:0/2396519011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb40fcbd0 msgr2=0x7f4bb40fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.378+0000 7f4bbac1f700 1 --2- 172.21.15.138:0/2396519011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb40fcbd0 0x7f4bb40fcfe0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80048c0 tx=0x7f4ba8009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.378+0000 7f4bbac1f700 1 -- 172.21.15.138:0/2396519011 shutdown_connections 2024-02-07T12:17:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.378+0000 7f4bbac1f700 1 --2- 172.21.15.138:0/2396519011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb40fcbd0 0x7f4bb40fcfe0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.378+0000 7f4bbac1f700 1 -- 172.21.15.138:0/2396519011 >> 172.21.15.138:0/2396519011 conn(0x7f4bb40f8290 msgr2=0x7f4bb40fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.378+0000 7f4bbac1f700 1 -- 172.21.15.138:0/2396519011 shutdown_connections 2024-02-07T12:17:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.378+0000 7f4bbac1f700 1 -- 172.21.15.138:0/2396519011 wait complete. 2024-02-07T12:17:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.378+0000 7f4bbac1f700 1 Processor -- start 2024-02-07T12:17:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.378+0000 7f4bbac1f700 1 -- start start 2024-02-07T12:17:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.379+0000 7f4bbac1f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb40fcbd0 0x7f4bb410cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.379+0000 7f4bbac1f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb410d400 con 0x7f4bb40fcbd0 2024-02-07T12:17:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.379+0000 7f4bb89bb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb40fcbd0 0x7f4bb410cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.379+0000 7f4bb89bb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb40fcbd0 0x7f4bb410cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:36882/0 (socket says 172.21.15.138:36882) 2024-02-07T12:17:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.379+0000 7f4bb89bb700 1 -- 172.21.15.138:0/303909385 learned_addr learned my addr 172.21.15.138:0/303909385 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:17:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.379+0000 7f4bb89bb700 1 -- 172.21.15.138:0/303909385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba8005040 con 0x7f4bb40fcbd0 2024-02-07T12:17:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.379+0000 7f4bb89bb700 1 --2- 172.21.15.138:0/303909385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb40fcbd0 0x7f4bb410cec0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009680 tx=0x7f4ba8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.379+0000 7f4bb17fa700 1 -- 172.21.15.138:0/303909385 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ba800bed0 con 0x7f4bb40fcbd0 2024-02-07T12:17:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.379+0000 7f4bbac1f700 1 -- 172.21.15.138:0/303909385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb410d600 con 0x7f4bb40fcbd0 2024-02-07T12:17:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.379+0000 7f4bb17fa700 1 -- 172.21.15.138:0/303909385 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ba800b5c0 con 0x7f4bb40fcbd0 2024-02-07T12:17:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.379+0000 7f4bb17fa700 1 -- 172.21.15.138:0/303909385 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ba801c5b0 con 0x7f4bb40fcbd0 2024-02-07T12:17:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.380+0000 7f4bbac1f700 1 -- 172.21.15.138:0/303909385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb410e2a0 con 0x7f4bb40fcbd0 2024-02-07T12:17:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.380+0000 7f4bb17fa700 1 -- 172.21.15.138:0/303909385 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f4ba8013a80 con 0x7f4bb40fcbd0 2024-02-07T12:17:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.380+0000 7f4bbac1f700 1 -- 172.21.15.138:0/303909385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb405f5c0 con 0x7f4bb40fcbd0 2024-02-07T12:17:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.381+0000 7f4bb17fa700 1 --2- 172.21.15.138:0/303909385 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f4ba4036680 0x7f4ba4038b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.381+0000 7f4bb17fa700 1 -- 172.21.15.138:0/303909385 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4ba80499b0 con 0x7f4bb40fcbd0 2024-02-07T12:17:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.381+0000 7f4bb3fff700 1 --2- 172.21.15.138:0/303909385 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f4ba4036680 0x7f4ba4038b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.381+0000 7f4bb3fff700 1 --2- 172.21.15.138:0/303909385 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f4ba4036680 0x7f4ba4038b30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009990 tx=0x7f4ba0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.386+0000 7f4bb17fa700 1 -- 172.21.15.138:0/303909385 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4ba8011960 con 0x7f4bb40fcbd0 2024-02-07T12:17:53.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.642+0000 7f4bbac1f700 1 -- 172.21.15.138:0/303909385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4bb410edf0 con 0x7f4bb40fcbd0 2024-02-07T12:17:53.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.643+0000 7f4bb17fa700 1 -- 172.21.15.138:0/303909385 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4ba8011370 con 0x7f4bb40fcbd0 2024-02-07T12:17:53.647 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:17:53.647 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:17:53.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.645+0000 7f4bbac1f700 1 -- 172.21.15.138:0/303909385 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f4ba4036680 msgr2=0x7f4ba4038b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:53.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.645+0000 7f4bbac1f700 1 --2- 172.21.15.138:0/303909385 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f4ba4036680 0x7f4ba4038b30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009990 tx=0x7f4ba0006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:53.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.645+0000 7f4bbac1f700 1 -- 172.21.15.138:0/303909385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb40fcbd0 msgr2=0x7f4bb410cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:53.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.645+0000 7f4bbac1f700 1 --2- 172.21.15.138:0/303909385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb40fcbd0 0x7f4bb410cec0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009680 tx=0x7f4ba8009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:53.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.645+0000 7f4bbac1f700 1 -- 172.21.15.138:0/303909385 shutdown_connections 2024-02-07T12:17:53.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.645+0000 7f4bbac1f700 1 --2- 172.21.15.138:0/303909385 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f4ba4036680 0x7f4ba4038b30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:53.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.645+0000 7f4bbac1f700 1 --2- 172.21.15.138:0/303909385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb40fcbd0 0x7f4bb410cec0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:53.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.645+0000 7f4bbac1f700 1 -- 172.21.15.138:0/303909385 >> 172.21.15.138:0/303909385 conn(0x7f4bb40f8290 msgr2=0x7f4bb40f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:53.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.645+0000 7f4bbac1f700 1 -- 172.21.15.138:0/303909385 shutdown_connections 2024-02-07T12:17:53.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:53.645+0000 7f4bbac1f700 1 -- 172.21.15.138:0/303909385 wait complete. 2024-02-07T12:17:53.649 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:17:54.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:53 smithi047 ceph-mon[28972]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:54.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:53 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:17:54.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:53 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/303909385' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:17:55.259 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:17:55.260 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:17:55.500 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:55.548 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:56.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:55 smithi047 ceph-mon[28972]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:57.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.011+0000 7fc61e58d700 1 -- 172.21.15.138:0/3062448049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6180fbac0 msgr2=0x7fc6180fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:57.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.011+0000 7fc61e58d700 1 --2- 172.21.15.138:0/3062448049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6180fbac0 0x7fc6180fbed0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc6080048c0 tx=0x7fc608009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:57.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.011+0000 7fc61e58d700 1 -- 172.21.15.138:0/3062448049 shutdown_connections 2024-02-07T12:17:57.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.011+0000 7fc61e58d700 1 --2- 172.21.15.138:0/3062448049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6180fbac0 0x7fc6180fbed0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:57.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.011+0000 7fc61e58d700 1 -- 172.21.15.138:0/3062448049 >> 172.21.15.138:0/3062448049 conn(0x7fc6180f71a0 msgr2=0x7fc6180f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:57.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.011+0000 7fc61e58d700 1 -- 172.21.15.138:0/3062448049 shutdown_connections 2024-02-07T12:17:57.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.011+0000 7fc61e58d700 1 -- 172.21.15.138:0/3062448049 wait complete. 2024-02-07T12:17:57.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.011+0000 7fc61e58d700 1 Processor -- start 2024-02-07T12:17:57.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.011+0000 7fc61e58d700 1 -- start start 2024-02-07T12:17:57.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.012+0000 7fc61e58d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6180fbac0 0x7fc61810cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:57.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.012+0000 7fc61e58d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61810d420 con 0x7fc6180fbac0 2024-02-07T12:17:57.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.012+0000 7fc617fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6180fbac0 0x7fc61810cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:57.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.012+0000 7fc617fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6180fbac0 0x7fc61810cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:36908/0 (socket says 172.21.15.138:36908) 2024-02-07T12:17:57.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.012+0000 7fc617fff700 1 -- 172.21.15.138:0/459867910 learned_addr learned my addr 172.21.15.138:0/459867910 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:17:57.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.012+0000 7fc617fff700 1 -- 172.21.15.138:0/459867910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608005040 con 0x7fc6180fbac0 2024-02-07T12:17:57.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.012+0000 7fc617fff700 1 --2- 172.21.15.138:0/459867910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6180fbac0 0x7fc61810cee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc608009680 tx=0x7fc608009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:57.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.012+0000 7fc614ff9700 1 -- 172.21.15.138:0/459867910 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc60800bed0 con 0x7fc6180fbac0 2024-02-07T12:17:57.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.012+0000 7fc61e58d700 1 -- 172.21.15.138:0/459867910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61810d620 con 0x7fc6180fbac0 2024-02-07T12:17:57.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.012+0000 7fc614ff9700 1 -- 172.21.15.138:0/459867910 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc60800b5c0 con 0x7fc6180fbac0 2024-02-07T12:17:57.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.013+0000 7fc614ff9700 1 -- 172.21.15.138:0/459867910 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc608025560 con 0x7fc6180fbac0 2024-02-07T12:17:57.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.013+0000 7fc61e58d700 1 -- 172.21.15.138:0/459867910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61810e2c0 con 0x7fc6180fbac0 2024-02-07T12:17:57.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.013+0000 7fc614ff9700 1 -- 172.21.15.138:0/459867910 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fc608025780 con 0x7fc6180fbac0 2024-02-07T12:17:57.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.013+0000 7fc614ff9700 1 --2- 172.21.15.138:0/459867910 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc600036680 0x7fc600038b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:17:57.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.013+0000 7fc614ff9700 1 -- 172.21.15.138:0/459867910 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc608049970 con 0x7fc6180fbac0 2024-02-07T12:17:57.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.014+0000 7fc61e58d700 1 -- 172.21.15.138:0/459867910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61805f5c0 con 0x7fc6180fbac0 2024-02-07T12:17:57.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.014+0000 7fc6177fe700 1 --2- 172.21.15.138:0/459867910 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc600036680 0x7fc600038b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:17:57.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.014+0000 7fc6177fe700 1 --2- 172.21.15.138:0/459867910 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc600036680 0x7fc600038b30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009990 tx=0x7fc60c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:17:57.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.019+0000 7fc614ff9700 1 -- 172.21.15.138:0/459867910 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc608023300 con 0x7fc6180fbac0 2024-02-07T12:17:57.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.275+0000 7fc61e58d700 1 -- 172.21.15.138:0/459867910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc61810e500 con 0x7fc6180fbac0 2024-02-07T12:17:57.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.276+0000 7fc614ff9700 1 -- 172.21.15.138:0/459867910 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc608011b60 con 0x7fc6180fbac0 2024-02-07T12:17:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:17:57.279 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:17:57.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.278+0000 7fc61e58d700 1 -- 172.21.15.138:0/459867910 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc600036680 msgr2=0x7fc600038b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:57.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.278+0000 7fc61e58d700 1 --2- 172.21.15.138:0/459867910 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc600036680 0x7fc600038b30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009990 tx=0x7fc60c006e40 comp rx=0 tx=0).stop 2024-02-07T12:17:57.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.278+0000 7fc61e58d700 1 -- 172.21.15.138:0/459867910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6180fbac0 msgr2=0x7fc61810cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:17:57.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.278+0000 7fc61e58d700 1 --2- 172.21.15.138:0/459867910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6180fbac0 0x7fc61810cee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc608009680 tx=0x7fc608009e30 comp rx=0 tx=0).stop 2024-02-07T12:17:57.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.278+0000 7fc61e58d700 1 -- 172.21.15.138:0/459867910 shutdown_connections 2024-02-07T12:17:57.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.278+0000 7fc61e58d700 1 --2- 172.21.15.138:0/459867910 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7fc600036680 0x7fc600038b30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:57.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.278+0000 7fc61e58d700 1 --2- 172.21.15.138:0/459867910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6180fbac0 0x7fc61810cee0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:17:57.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.278+0000 7fc61e58d700 1 -- 172.21.15.138:0/459867910 >> 172.21.15.138:0/459867910 conn(0x7fc6180f71a0 msgr2=0x7fc6180f7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:17:57.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.278+0000 7fc61e58d700 1 -- 172.21.15.138:0/459867910 shutdown_connections 2024-02-07T12:17:57.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:17:57.278+0000 7fc61e58d700 1 -- 172.21.15.138:0/459867910 wait complete. 2024-02-07T12:17:57.282 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:17:58.174 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:57 smithi047 ceph-mon[28972]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:17:58.174 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:17:57 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/459867910' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:17:58.847 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:17:58.848 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:17:59.098 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:17:59.145 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:18:00.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:00 smithi047 ceph-mon[28972]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:00.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:00 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:00.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:00 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:00.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:00 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:00.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:00 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-07T12:18:00.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.583+0000 7f8086a37700 1 -- 172.21.15.138:0/568964053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8080066640 msgr2=0x7f80800ff7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:00.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.583+0000 7f8086a37700 1 --2- 172.21.15.138:0/568964053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8080066640 0x7f80800ff7b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f80700048c0 tx=0x7f8070009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:00.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.583+0000 7f8086a37700 1 -- 172.21.15.138:0/568964053 shutdown_connections 2024-02-07T12:18:00.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.583+0000 7f8086a37700 1 --2- 172.21.15.138:0/568964053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8080066640 0x7f80800ff7b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:00.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.583+0000 7f8086a37700 1 -- 172.21.15.138:0/568964053 >> 172.21.15.138:0/568964053 conn(0x7f80800f71a0 msgr2=0x7f80800f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:00.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.583+0000 7f8086a37700 1 -- 172.21.15.138:0/568964053 shutdown_connections 2024-02-07T12:18:00.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.583+0000 7f8086a37700 1 -- 172.21.15.138:0/568964053 wait complete. 2024-02-07T12:18:00.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.584+0000 7f8086a37700 1 Processor -- start 2024-02-07T12:18:00.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.584+0000 7f8086a37700 1 -- start start 2024-02-07T12:18:00.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.584+0000 7f8086a37700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8080066640 0x7f808010ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:00.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.584+0000 7f8086a37700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808010d3c0 con 0x7f8080066640 2024-02-07T12:18:00.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.584+0000 7f807ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8080066640 0x7f808010ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:00.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.584+0000 7f807ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8080066640 0x7f808010ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:36918/0 (socket says 172.21.15.138:36918) 2024-02-07T12:18:00.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.584+0000 7f807ffff700 1 -- 172.21.15.138:0/3782980951 learned_addr learned my addr 172.21.15.138:0/3782980951 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:18:00.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.585+0000 7f807ffff700 1 -- 172.21.15.138:0/3782980951 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8070005040 con 0x7f8080066640 2024-02-07T12:18:00.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.585+0000 7f807ffff700 1 --2- 172.21.15.138:0/3782980951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8080066640 0x7f808010ce80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8070009b80 tx=0x7f8070009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:00.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.585+0000 7f807cff9700 1 -- 172.21.15.138:0/3782980951 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f807000b5c0 con 0x7f8080066640 2024-02-07T12:18:00.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.585+0000 7f8086a37700 1 -- 172.21.15.138:0/3782980951 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808010d5c0 con 0x7f8080066640 2024-02-07T12:18:00.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.585+0000 7f807cff9700 1 -- 172.21.15.138:0/3782980951 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f807000be70 con 0x7f8080066640 2024-02-07T12:18:00.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.585+0000 7f807cff9700 1 -- 172.21.15.138:0/3782980951 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f807001c660 con 0x7f8080066640 2024-02-07T12:18:00.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.585+0000 7f8086a37700 1 -- 172.21.15.138:0/3782980951 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808010e260 con 0x7f8080066640 2024-02-07T12:18:00.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.586+0000 7f807cff9700 1 -- 172.21.15.138:0/3782980951 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f807001c8d0 con 0x7f8080066640 2024-02-07T12:18:00.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.586+0000 7f8086a37700 1 -- 172.21.15.138:0/3782980951 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808005f5c0 con 0x7f8080066640 2024-02-07T12:18:00.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.586+0000 7f807cff9700 1 --2- 172.21.15.138:0/3782980951 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f8068036720 0x7f8068038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:00.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.586+0000 7f807cff9700 1 -- 172.21.15.138:0/3782980951 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8070049950 con 0x7f8080066640 2024-02-07T12:18:00.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.586+0000 7f807f7fe700 1 -- 172.21.15.138:0/3782980951 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f8068036720 msgr2=0x7f8068038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3304641630 2024-02-07T12:18:00.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.586+0000 7f807f7fe700 1 --2- 172.21.15.138:0/3782980951 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f8068036720 0x7f8068038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-07T12:18:00.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.591+0000 7f807cff9700 1 -- 172.21.15.138:0/3782980951 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8070025920 con 0x7f8080066640 2024-02-07T12:18:00.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.787+0000 7f807f7fe700 1 -- 172.21.15.138:0/3782980951 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f8068036720 msgr2=0x7f8068038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3304641630 2024-02-07T12:18:00.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.787+0000 7f807f7fe700 1 --2- 172.21.15.138:0/3782980951 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f8068036720 0x7f8068038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-07T12:18:00.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.847+0000 7f8086a37700 1 -- 172.21.15.138:0/3782980951 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f808010edb0 con 0x7f8080066640 2024-02-07T12:18:00.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.847+0000 7f807cff9700 1 -- 172.21.15.138:0/3782980951 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8070011370 con 0x7f8080066640 2024-02-07T12:18:00.850 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:18:00.850 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:18:00.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.849+0000 7f8086a37700 1 -- 172.21.15.138:0/3782980951 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f8068036720 msgr2=0x7f8068038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-07T12:18:00.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.849+0000 7f8086a37700 1 --2- 172.21.15.138:0/3782980951 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f8068036720 0x7f8068038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:00.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.849+0000 7f8086a37700 1 -- 172.21.15.138:0/3782980951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8080066640 msgr2=0x7f808010ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:00.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.849+0000 7f8086a37700 1 --2- 172.21.15.138:0/3782980951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8080066640 0x7f808010ce80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8070009b80 tx=0x7f8070009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:00.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.849+0000 7f8086a37700 1 -- 172.21.15.138:0/3782980951 shutdown_connections 2024-02-07T12:18:00.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.849+0000 7f8086a37700 1 --2- 172.21.15.138:0/3782980951 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f8068036720 0x7f8068038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:00.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.849+0000 7f8086a37700 1 --2- 172.21.15.138:0/3782980951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8080066640 0x7f808010ce80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:00.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.849+0000 7f8086a37700 1 -- 172.21.15.138:0/3782980951 >> 172.21.15.138:0/3782980951 conn(0x7f80800f71a0 msgr2=0x7f80800f7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:00.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.849+0000 7f8086a37700 1 -- 172.21.15.138:0/3782980951 shutdown_connections 2024-02-07T12:18:00.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:00.849+0000 7f8086a37700 1 -- 172.21.15.138:0/3782980951 wait complete. 2024-02-07T12:18:00.852 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:18:01.462 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:01 smithi047 ceph-mon[28972]: from='mgr.14162 172.21.15.47:0/3724844810' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-07T12:18:01.462 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:01 smithi047 ceph-mon[28972]: mgrmap e14: smithi047.zhgnrm(active, since 57s) 2024-02-07T12:18:01.462 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:01 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/3782980951' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:18:02.435 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:18:02.436 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:18:02.684 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:18:02.731 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:18:04.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.177+0000 7f122b514700 1 -- 172.21.15.138:0/2504071546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12240fcbd0 msgr2=0x7f12240fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:04.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.178+0000 7f122b514700 1 --2- 172.21.15.138:0/2504071546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12240fcbd0 0x7f12240fcfe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12200048c0 tx=0x7f1220009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:04.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.178+0000 7f122b514700 1 -- 172.21.15.138:0/2504071546 shutdown_connections 2024-02-07T12:18:04.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.178+0000 7f122b514700 1 --2- 172.21.15.138:0/2504071546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12240fcbd0 0x7f12240fcfe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:04.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.178+0000 7f122b514700 1 -- 172.21.15.138:0/2504071546 >> 172.21.15.138:0/2504071546 conn(0x7f12240f8290 msgr2=0x7f12240fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:04.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.178+0000 7f122b514700 1 -- 172.21.15.138:0/2504071546 shutdown_connections 2024-02-07T12:18:04.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.178+0000 7f122b514700 1 -- 172.21.15.138:0/2504071546 wait complete. 2024-02-07T12:18:04.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.178+0000 7f122b514700 1 Processor -- start 2024-02-07T12:18:04.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.178+0000 7f122b514700 1 -- start start 2024-02-07T12:18:04.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.178+0000 7f122b514700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12240fcbd0 0x7f122410cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:04.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.178+0000 7f122b514700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122410d400 con 0x7f12240fcbd0 2024-02-07T12:18:04.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.178+0000 7f12292b0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12240fcbd0 0x7f122410cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:04.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.178+0000 7f12292b0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12240fcbd0 0x7f122410cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:49872/0 (socket says 172.21.15.138:49872) 2024-02-07T12:18:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.178+0000 7f12292b0700 1 -- 172.21.15.138:0/6628052 learned_addr learned my addr 172.21.15.138:0/6628052 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:18:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.179+0000 7f12292b0700 1 -- 172.21.15.138:0/6628052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1220005040 con 0x7f12240fcbd0 2024-02-07T12:18:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.179+0000 7f12292b0700 1 --2- 172.21.15.138:0/6628052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12240fcbd0 0x7f122410cec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1220009680 tx=0x7f1220009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.179+0000 7f1219ffb700 1 -- 172.21.15.138:0/6628052 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f122000bed0 con 0x7f12240fcbd0 2024-02-07T12:18:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.179+0000 7f122b514700 1 -- 172.21.15.138:0/6628052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122410d600 con 0x7f12240fcbd0 2024-02-07T12:18:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.179+0000 7f1219ffb700 1 -- 172.21.15.138:0/6628052 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f122000b5c0 con 0x7f12240fcbd0 2024-02-07T12:18:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.179+0000 7f1219ffb700 1 -- 172.21.15.138:0/6628052 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f122001c5b0 con 0x7f12240fcbd0 2024-02-07T12:18:04.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.179+0000 7f122b514700 1 -- 172.21.15.138:0/6628052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122410e2a0 con 0x7f12240fcbd0 2024-02-07T12:18:04.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.180+0000 7f1219ffb700 1 -- 172.21.15.138:0/6628052 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f1220013420 con 0x7f12240fcbd0 2024-02-07T12:18:04.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.180+0000 7f122b514700 1 -- 172.21.15.138:0/6628052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122405f5c0 con 0x7f12240fcbd0 2024-02-07T12:18:04.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.180+0000 7f1219ffb700 1 --2- 172.21.15.138:0/6628052 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f1210036720 0x7f1210038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:04.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.180+0000 7f1219ffb700 1 -- 172.21.15.138:0/6628052 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f12200499f0 con 0x7f12240fcbd0 2024-02-07T12:18:04.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.180+0000 7f1228aaf700 1 -- 172.21.15.138:0/6628052 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f1210036720 msgr2=0x7f1210038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3304641630 2024-02-07T12:18:04.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.180+0000 7f1228aaf700 1 --2- 172.21.15.138:0/6628052 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f1210036720 0x7f1210038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-07T12:18:04.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.185+0000 7f1219ffb700 1 -- 172.21.15.138:0/6628052 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1220004d30 con 0x7f12240fcbd0 2024-02-07T12:18:04.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.381+0000 7f1228aaf700 1 -- 172.21.15.138:0/6628052 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f1210036720 msgr2=0x7f1210038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3304641630 2024-02-07T12:18:04.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.381+0000 7f1228aaf700 1 --2- 172.21.15.138:0/6628052 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f1210036720 0x7f1210038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-07T12:18:04.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.443+0000 7f122b514700 1 -- 172.21.15.138:0/6628052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f122410edf0 con 0x7f12240fcbd0 2024-02-07T12:18:04.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.443+0000 7f1219ffb700 1 -- 172.21.15.138:0/6628052 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1220004d30 con 0x7f12240fcbd0 2024-02-07T12:18:04.446 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:18:04.446 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:18:04.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.445+0000 7f122b514700 1 -- 172.21.15.138:0/6628052 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f1210036720 msgr2=0x7f1210038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-07T12:18:04.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.445+0000 7f122b514700 1 --2- 172.21.15.138:0/6628052 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f1210036720 0x7f1210038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:04.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.445+0000 7f122b514700 1 -- 172.21.15.138:0/6628052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12240fcbd0 msgr2=0x7f122410cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:04.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.445+0000 7f122b514700 1 --2- 172.21.15.138:0/6628052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12240fcbd0 0x7f122410cec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1220009680 tx=0x7f1220009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:04.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.446+0000 7f122b514700 1 -- 172.21.15.138:0/6628052 shutdown_connections 2024-02-07T12:18:04.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.446+0000 7f122b514700 1 --2- 172.21.15.138:0/6628052 >> [v2:172.21.15.47:6800/3304641630,v1:172.21.15.47:6801/3304641630] conn(0x7f1210036720 0x7f1210038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:04.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.446+0000 7f122b514700 1 --2- 172.21.15.138:0/6628052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12240fcbd0 0x7f122410cec0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:04.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.446+0000 7f122b514700 1 -- 172.21.15.138:0/6628052 >> 172.21.15.138:0/6628052 conn(0x7f12240f8290 msgr2=0x7f12240f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:04.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.446+0000 7f122b514700 1 -- 172.21.15.138:0/6628052 shutdown_connections 2024-02-07T12:18:04.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:04.446+0000 7f122b514700 1 -- 172.21.15.138:0/6628052 wait complete. 2024-02-07T12:18:04.449 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:18:04.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:04 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/6628052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:18:06.014 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:18:06.014 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:18:06.262 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:18:06.310 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:18:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:06 smithi047 ceph-mon[28972]: Active manager daemon smithi047.zhgnrm restarted 2024-02-07T12:18:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:06 smithi047 ceph-mon[28972]: Activating manager daemon smithi047.zhgnrm 2024-02-07T12:18:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:06 smithi047 ceph-mon[28972]: osdmap e5: 0 total, 0 up, 0 in 2024-02-07T12:18:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:06 smithi047 ceph-mon[28972]: mgrmap e15: smithi047.zhgnrm(active, starting, since 0.00320984s) 2024-02-07T12:18:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:18:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi047.zhgnrm", "id": "smithi047.zhgnrm"}]: dispatch 2024-02-07T12:18:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-07T12:18:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-07T12:18:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-07T12:18:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:06 smithi047 ceph-mon[28972]: Manager daemon smithi047.zhgnrm is now available 2024-02-07T12:18:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:18:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:18:07.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.861+0000 7f796e126700 1 -- 172.21.15.138:0/2316010098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79680fcbc0 msgr2=0x7f79680fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:07.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.861+0000 7f796e126700 1 --2- 172.21.15.138:0/2316010098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79680fcbc0 0x7f79680fcfd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f79580048c0 tx=0x7f7958009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:07.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.861+0000 7f796e126700 1 -- 172.21.15.138:0/2316010098 shutdown_connections 2024-02-07T12:18:07.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.861+0000 7f796e126700 1 --2- 172.21.15.138:0/2316010098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79680fcbc0 0x7f79680fcfd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:07.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.861+0000 7f796e126700 1 -- 172.21.15.138:0/2316010098 >> 172.21.15.138:0/2316010098 conn(0x7f79680f82a0 msgr2=0x7f79680fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:07.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.861+0000 7f796e126700 1 -- 172.21.15.138:0/2316010098 shutdown_connections 2024-02-07T12:18:07.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.861+0000 7f796e126700 1 -- 172.21.15.138:0/2316010098 wait complete. 2024-02-07T12:18:07.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.861+0000 7f796e126700 1 Processor -- start 2024-02-07T12:18:07.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.861+0000 7f796e126700 1 -- start start 2024-02-07T12:18:07.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.862+0000 7f796e126700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79680fcbc0 0x7f7968071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:07.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.862+0000 7f796e126700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680702e0 con 0x7f79680fcbc0 2024-02-07T12:18:07.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.862+0000 7f79677fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79680fcbc0 0x7f7968071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:07.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.862+0000 7f79677fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79680fcbc0 0x7f7968071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:49894/0 (socket says 172.21.15.138:49894) 2024-02-07T12:18:07.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.862+0000 7f79677fe700 1 -- 172.21.15.138:0/1611014870 learned_addr learned my addr 172.21.15.138:0/1611014870 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:18:07.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.862+0000 7f79677fe700 1 -- 172.21.15.138:0/1611014870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7958005040 con 0x7f79680fcbc0 2024-02-07T12:18:07.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.862+0000 7f79677fe700 1 --2- 172.21.15.138:0/1611014870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79680fcbc0 0x7f7968071e60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7958009680 tx=0x7f7958009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:07.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.862+0000 7f794ffff700 1 -- 172.21.15.138:0/1611014870 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f795800bed0 con 0x7f79680fcbc0 2024-02-07T12:18:07.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.862+0000 7f796e126700 1 -- 172.21.15.138:0/1611014870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79680704e0 con 0x7f79680fcbc0 2024-02-07T12:18:07.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.862+0000 7f794ffff700 1 -- 172.21.15.138:0/1611014870 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f795800b5c0 con 0x7f79680fcbc0 2024-02-07T12:18:07.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.862+0000 7f794ffff700 1 -- 172.21.15.138:0/1611014870 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f795801c5b0 con 0x7f79680fcbc0 2024-02-07T12:18:07.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.862+0000 7f796e126700 1 -- 172.21.15.138:0/1611014870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79680709d0 con 0x7f79680fcbc0 2024-02-07T12:18:07.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.863+0000 7f794ffff700 1 -- 172.21.15.138:0/1611014870 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) v1 ==== 43202+0+0 (secure 0 0 0) 0x7f795801c820 con 0x7f79680fcbc0 2024-02-07T12:18:07.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.863+0000 7f796e126700 1 -- 172.21.15.138:0/1611014870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7968106990 con 0x7f79680fcbc0 2024-02-07T12:18:07.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.863+0000 7f794ffff700 1 --2- 172.21.15.138:0/1611014870 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7950036510 0x7f79500389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:07.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.863+0000 7f794ffff700 1 -- 172.21.15.138:0/1611014870 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f7958049810 con 0x7f79680fcbc0 2024-02-07T12:18:07.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.864+0000 7f7966ffd700 1 --2- 172.21.15.138:0/1611014870 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7950036510 0x7f79500389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:07.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.864+0000 7f7966ffd700 1 --2- 172.21.15.138:0/1611014870 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7950036510 0x7f79500389c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f795c009990 tx=0x7f795c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:07.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:07.868+0000 7f794ffff700 1 -- 172.21.15.138:0/1611014870 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7958025920 con 0x7f79680fcbc0 2024-02-07T12:18:08.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:08.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:18:08.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/mirror_snapshot_schedule"}]: dispatch 2024-02-07T12:18:08.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/trash_purge_schedule"}]: dispatch 2024-02-07T12:18:08.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:07 smithi047 ceph-mon[28972]: [07/Feb/2024:12:18:07] ENGINE Bus STARTING 2024-02-07T12:18:08.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:08.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:08.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:07 smithi047 ceph-mon[28972]: mgrmap e16: smithi047.zhgnrm(active, since 1.00487s) 2024-02-07T12:18:08.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:08.136+0000 7f796e126700 1 -- 172.21.15.138:0/1611014870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f796804bed0 con 0x7f79680fcbc0 2024-02-07T12:18:08.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:08.136+0000 7f794ffff700 1 -- 172.21.15.138:0/1611014870 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7958011b60 con 0x7f79680fcbc0 2024-02-07T12:18:08.139 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:18:08.139 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:18:08.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:08.140+0000 7f796e126700 1 -- 172.21.15.138:0/1611014870 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7950036510 msgr2=0x7f79500389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:08.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:08.140+0000 7f796e126700 1 --2- 172.21.15.138:0/1611014870 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7950036510 0x7f79500389c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f795c009990 tx=0x7f795c006e40 comp rx=0 tx=0).stop 2024-02-07T12:18:08.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:08.140+0000 7f796e126700 1 -- 172.21.15.138:0/1611014870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79680fcbc0 msgr2=0x7f7968071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:08.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:08.140+0000 7f796e126700 1 --2- 172.21.15.138:0/1611014870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79680fcbc0 0x7f7968071e60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7958009680 tx=0x7f7958009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:08.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:08.140+0000 7f796e126700 1 -- 172.21.15.138:0/1611014870 shutdown_connections 2024-02-07T12:18:08.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:08.140+0000 7f796e126700 1 --2- 172.21.15.138:0/1611014870 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7950036510 0x7f79500389c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:08.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:08.140+0000 7f796e126700 1 --2- 172.21.15.138:0/1611014870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79680fcbc0 0x7f7968071e60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:08.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:08.140+0000 7f796e126700 1 -- 172.21.15.138:0/1611014870 >> 172.21.15.138:0/1611014870 conn(0x7f79680f82a0 msgr2=0x7f79680f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:08.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:08.140+0000 7f796e126700 1 -- 172.21.15.138:0/1611014870 shutdown_connections 2024-02-07T12:18:08.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:08.140+0000 7f796e126700 1 -- 172.21.15.138:0/1611014870 wait complete. 2024-02-07T12:18:08.143 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:18:09.258 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:08 smithi047 ceph-mon[28972]: [07/Feb/2024:12:18:07] ENGINE Serving on https://172.21.15.47:7150 2024-02-07T12:18:09.259 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:08 smithi047 ceph-mon[28972]: [07/Feb/2024:12:18:07] ENGINE Bus STARTED 2024-02-07T12:18:09.259 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:08 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:09.259 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:08 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/1611014870' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:18:09.259 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:08 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:09.761 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:18:09.761 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:18:10.091 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:18:10.462 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-07T12:18:11.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:10 smithi047 ceph-mon[28972]: mgrmap e17: smithi047.zhgnrm(active, since 2s) 2024-02-07T12:18:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:18:12.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:12.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:12.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:12.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:12.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi138", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:18:12.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:12.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:18:12.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.680+0000 7f0a0001c700 1 -- 172.21.15.138:0/3539126895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f80fdbe0 msgr2=0x7f09f80fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:12.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.680+0000 7f0a0001c700 1 --2- 172.21.15.138:0/3539126895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f80fdbe0 0x7f09f80fdfb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f09f40048c0 tx=0x7f09f4009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.680+0000 7f0a0001c700 1 -- 172.21.15.138:0/3539126895 shutdown_connections 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.680+0000 7f0a0001c700 1 --2- 172.21.15.138:0/3539126895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f80fdbe0 0x7f09f80fdfb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.680+0000 7f0a0001c700 1 -- 172.21.15.138:0/3539126895 >> 172.21.15.138:0/3539126895 conn(0x7f09f8072850 msgr2=0x7f09f8072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.680+0000 7f0a0001c700 1 -- 172.21.15.138:0/3539126895 shutdown_connections 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.680+0000 7f0a0001c700 1 -- 172.21.15.138:0/3539126895 wait complete. 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.680+0000 7f0a0001c700 1 Processor -- start 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.680+0000 7f0a0001c700 1 -- start start 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.681+0000 7f0a0001c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f80fdbe0 0x7f09f80fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.681+0000 7f0a0001c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f80fbfe0 con 0x7f09f80fdbe0 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.681+0000 7f09fddb8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f80fdbe0 0x7f09f80fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.681+0000 7f09fddb8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f80fdbe0 0x7f09f80fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:60256/0 (socket says 172.21.15.138:60256) 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.681+0000 7f09fddb8700 1 -- 172.21.15.138:0/1590726937 learned_addr learned my addr 172.21.15.138:0/1590726937 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.681+0000 7f09fddb8700 1 -- 172.21.15.138:0/1590726937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f4005040 con 0x7f09f80fdbe0 2024-02-07T12:18:12.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.681+0000 7f09fddb8700 1 --2- 172.21.15.138:0/1590726937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f80fdbe0 0x7f09f80fbaa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009330 tx=0x7f09f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:12.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.681+0000 7f09ee7fc700 1 -- 172.21.15.138:0/1590726937 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09f400be50 con 0x7f09f80fdbe0 2024-02-07T12:18:12.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.681+0000 7f0a0001c700 1 -- 172.21.15.138:0/1590726937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f80fc1e0 con 0x7f09f80fdbe0 2024-02-07T12:18:12.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.681+0000 7f09ee7fc700 1 -- 172.21.15.138:0/1590726937 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f09f4009630 con 0x7f09f80fdbe0 2024-02-07T12:18:12.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.681+0000 7f09ee7fc700 1 -- 172.21.15.138:0/1590726937 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09f401c3f0 con 0x7f09f80fdbe0 2024-02-07T12:18:12.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.681+0000 7f0a0001c700 1 -- 172.21.15.138:0/1590726937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f80fc650 con 0x7f09f80fdbe0 2024-02-07T12:18:12.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.682+0000 7f09ee7fc700 1 -- 172.21.15.138:0/1590726937 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f09f401c6b0 con 0x7f09f80fdbe0 2024-02-07T12:18:12.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.682+0000 7f0a0001c700 1 -- 172.21.15.138:0/1590726937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f8104310 con 0x7f09f80fdbe0 2024-02-07T12:18:12.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.682+0000 7f09ee7fc700 1 --2- 172.21.15.138:0/1590726937 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f09e40367c0 0x7f09e4038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:12.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.683+0000 7f09ee7fc700 1 -- 172.21.15.138:0/1590726937 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f09f4049920 con 0x7f09f80fdbe0 2024-02-07T12:18:12.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.683+0000 7f09fd5b7700 1 --2- 172.21.15.138:0/1590726937 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f09e40367c0 0x7f09e4038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:12.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.683+0000 7f09fd5b7700 1 --2- 172.21.15.138:0/1590726937 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f09e40367c0 0x7f09e4038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009990 tx=0x7f09e8006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:12.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.687+0000 7f09ee7fc700 1 -- 172.21.15.138:0/1590726937 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f09f4025400 con 0x7f09f80fdbe0 2024-02-07T12:18:12.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.974+0000 7f0a0001c700 1 -- 172.21.15.138:0/1590726937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f09f804bed0 con 0x7f09f80fdbe0 2024-02-07T12:18:12.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.975+0000 7f09ee7fc700 1 -- 172.21.15.138:0/1590726937 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f09f4011b60 con 0x7f09f80fdbe0 2024-02-07T12:18:12.978 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:18:12.978 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:18:12.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.977+0000 7f0a0001c700 1 -- 172.21.15.138:0/1590726937 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f09e40367c0 msgr2=0x7f09e4038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:12.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.977+0000 7f0a0001c700 1 --2- 172.21.15.138:0/1590726937 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f09e40367c0 0x7f09e4038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009990 tx=0x7f09e8006e40 comp rx=0 tx=0).stop 2024-02-07T12:18:12.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.977+0000 7f0a0001c700 1 -- 172.21.15.138:0/1590726937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f80fdbe0 msgr2=0x7f09f80fbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:12.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.977+0000 7f0a0001c700 1 --2- 172.21.15.138:0/1590726937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f80fdbe0 0x7f09f80fbaa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009330 tx=0x7f09f4009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:12.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.977+0000 7f0a0001c700 1 -- 172.21.15.138:0/1590726937 shutdown_connections 2024-02-07T12:18:12.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.977+0000 7f0a0001c700 1 --2- 172.21.15.138:0/1590726937 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f09e40367c0 0x7f09e4038c70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:12.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.977+0000 7f0a0001c700 1 --2- 172.21.15.138:0/1590726937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f80fdbe0 0x7f09f80fbaa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:12.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.977+0000 7f0a0001c700 1 -- 172.21.15.138:0/1590726937 >> 172.21.15.138:0/1590726937 conn(0x7f09f8072850 msgr2=0x7f09f8101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:12.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.977+0000 7f0a0001c700 1 -- 172.21.15.138:0/1590726937 shutdown_connections 2024-02-07T12:18:12.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:12.977+0000 7f0a0001c700 1 -- 172.21.15.138:0/1590726937 wait complete. 2024-02-07T12:18:12.980 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:18:13.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: Updating smithi047:/etc/ceph/ceph.conf 2024-02-07T12:18:13.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-07T12:18:13.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:18:13.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:18:13.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:18:13.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:18:13.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:13.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:13.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:13.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:13.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:13.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:18:13.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-07T12:18:13.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:14.226 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:13 smithi047 ceph-mon[28972]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:18:14.227 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:13 smithi047 ceph-mon[28972]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:18:14.227 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:13 smithi047 ceph-mon[28972]: Deploying daemon crash.smithi138 on smithi138 2024-02-07T12:18:14.227 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:13 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/1590726937' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:18:15.089 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:18:15.090 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:18:15.874 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:18:17.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.299+0000 7f4328b97700 1 -- 172.21.15.138:0/3441817243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4324102bb0 msgr2=0x7f4324102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:17.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.299+0000 7f4328b97700 1 --2- 172.21.15.138:0/3441817243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4324102bb0 0x7f4324102f80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f431c0048c0 tx=0x7f431c009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:17.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.299+0000 7f4328b97700 1 -- 172.21.15.138:0/3441817243 shutdown_connections 2024-02-07T12:18:17.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.299+0000 7f4328b97700 1 --2- 172.21.15.138:0/3441817243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4324102bb0 0x7f4324102f80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:17.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.299+0000 7f4328b97700 1 -- 172.21.15.138:0/3441817243 >> 172.21.15.138:0/3441817243 conn(0x7f43240f8760 msgr2=0x7f43240fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:17.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.299+0000 7f4328b97700 1 -- 172.21.15.138:0/3441817243 shutdown_connections 2024-02-07T12:18:17.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.299+0000 7f4328b97700 1 -- 172.21.15.138:0/3441817243 wait complete. 2024-02-07T12:18:17.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.299+0000 7f4328b97700 1 Processor -- start 2024-02-07T12:18:17.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.299+0000 7f4328b97700 1 -- start start 2024-02-07T12:18:17.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.300+0000 7f4328b97700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4324102bb0 0x7f4324070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:17.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.300+0000 7f4328b97700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43240707d0 con 0x7f4324102bb0 2024-02-07T12:18:17.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.300+0000 7f432259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4324102bb0 0x7f4324070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:17.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.300+0000 7f432259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4324102bb0 0x7f4324070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:60276/0 (socket says 172.21.15.138:60276) 2024-02-07T12:18:17.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.300+0000 7f432259c700 1 -- 172.21.15.138:0/3744676371 learned_addr learned my addr 172.21.15.138:0/3744676371 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:18:17.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.300+0000 7f432259c700 1 -- 172.21.15.138:0/3744676371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c005040 con 0x7f4324102bb0 2024-02-07T12:18:17.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.300+0000 7f432259c700 1 --2- 172.21.15.138:0/3744676371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4324102bb0 0x7f4324070290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f431c009300 tx=0x7f431c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:17.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.300+0000 7f4312ffd700 1 -- 172.21.15.138:0/3744676371 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f431c004e60 con 0x7f4324102bb0 2024-02-07T12:18:17.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.300+0000 7f4312ffd700 1 -- 172.21.15.138:0/3744676371 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f431c013420 con 0x7f4324102bb0 2024-02-07T12:18:17.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.300+0000 7f4328b97700 1 -- 172.21.15.138:0/3744676371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43240709d0 con 0x7f4324102bb0 2024-02-07T12:18:17.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.301+0000 7f4312ffd700 1 -- 172.21.15.138:0/3744676371 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f431c01c5b0 con 0x7f4324102bb0 2024-02-07T12:18:17.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.301+0000 7f4328b97700 1 -- 172.21.15.138:0/3744676371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4324070e40 con 0x7f4324102bb0 2024-02-07T12:18:17.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.301+0000 7f4312ffd700 1 -- 172.21.15.138:0/3744676371 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f431c013a90 con 0x7f4324102bb0 2024-02-07T12:18:17.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.301+0000 7f4328b97700 1 -- 172.21.15.138:0/3744676371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4324101ed0 con 0x7f4324102bb0 2024-02-07T12:18:17.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.302+0000 7f4312ffd700 1 --2- 172.21.15.138:0/3744676371 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f430c0367c0 0x7f430c038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:17.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.302+0000 7f4312ffd700 1 -- 172.21.15.138:0/3744676371 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f431c049a30 con 0x7f4324102bb0 2024-02-07T12:18:17.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.302+0000 7f4321d9b700 1 --2- 172.21.15.138:0/3744676371 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f430c0367c0 0x7f430c038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:17.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.302+0000 7f4321d9b700 1 --2- 172.21.15.138:0/3744676371 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f430c0367c0 0x7f430c038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f431800ad90 tx=0x7f4318009410 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:17.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.307+0000 7f4312ffd700 1 -- 172.21.15.138:0/3744676371 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f431c011960 con 0x7f4324102bb0 2024-02-07T12:18:17.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:16 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:17.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:16 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:17.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:16 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:17.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:16 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:17.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:16 smithi047 ceph-mon[28972]: Deploying daemon node-exporter.smithi138 on smithi138 2024-02-07T12:18:17.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.582+0000 7f4328b97700 1 -- 172.21.15.138:0/3744676371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f432404bed0 con 0x7f4324102bb0 2024-02-07T12:18:17.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.583+0000 7f4312ffd700 1 -- 172.21.15.138:0/3744676371 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f431c023560 con 0x7f4324102bb0 2024-02-07T12:18:17.586 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:18:17.586 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:18:17.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.585+0000 7f4328b97700 1 -- 172.21.15.138:0/3744676371 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f430c0367c0 msgr2=0x7f430c038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:17.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.585+0000 7f4328b97700 1 --2- 172.21.15.138:0/3744676371 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f430c0367c0 0x7f430c038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f431800ad90 tx=0x7f4318009410 comp rx=0 tx=0).stop 2024-02-07T12:18:17.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.585+0000 7f4328b97700 1 -- 172.21.15.138:0/3744676371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4324102bb0 msgr2=0x7f4324070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:17.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.585+0000 7f4328b97700 1 --2- 172.21.15.138:0/3744676371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4324102bb0 0x7f4324070290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f431c009300 tx=0x7f431c009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:17.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.585+0000 7f4328b97700 1 -- 172.21.15.138:0/3744676371 shutdown_connections 2024-02-07T12:18:17.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.585+0000 7f4328b97700 1 --2- 172.21.15.138:0/3744676371 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f430c0367c0 0x7f430c038c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:17.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.585+0000 7f4328b97700 1 --2- 172.21.15.138:0/3744676371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4324102bb0 0x7f4324070290 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:17.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.585+0000 7f4328b97700 1 -- 172.21.15.138:0/3744676371 >> 172.21.15.138:0/3744676371 conn(0x7f43240f8760 msgr2=0x7f43240fa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:17.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.585+0000 7f4328b97700 1 -- 172.21.15.138:0/3744676371 shutdown_connections 2024-02-07T12:18:17.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:17.585+0000 7f4328b97700 1 -- 172.21.15.138:0/3744676371 wait complete. 2024-02-07T12:18:17.588 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:18:18.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:17 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:18.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:17 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/3744676371' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:18:19.151 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:18:19.151 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:18:19.408 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:18:22.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.085+0000 7f2eb07c1700 1 -- 172.21.15.138:0/1198485535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ea80fb9b0 msgr2=0x7f2ea80fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:22.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.085+0000 7f2eb07c1700 1 --2- 172.21.15.138:0/1198485535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ea80fb9b0 0x7f2ea80fbd80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40048c0 tx=0x7f2ea4009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:22.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.085+0000 7f2eb07c1700 1 -- 172.21.15.138:0/1198485535 shutdown_connections 2024-02-07T12:18:22.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.085+0000 7f2eb07c1700 1 --2- 172.21.15.138:0/1198485535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ea80fb9b0 0x7f2ea80fbd80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:22.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.085+0000 7f2eb07c1700 1 -- 172.21.15.138:0/1198485535 >> 172.21.15.138:0/1198485535 conn(0x7f2ea8072850 msgr2=0x7f2ea8072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:22.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.085+0000 7f2eb07c1700 1 -- 172.21.15.138:0/1198485535 shutdown_connections 2024-02-07T12:18:22.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.085+0000 7f2eb07c1700 1 -- 172.21.15.138:0/1198485535 wait complete. 2024-02-07T12:18:22.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.085+0000 7f2eb07c1700 1 Processor -- start 2024-02-07T12:18:22.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.085+0000 7f2eb07c1700 1 -- start start 2024-02-07T12:18:22.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.085+0000 7f2eb07c1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ea80fb9b0 0x7f2ea8115100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.085+0000 7f2eb07c1700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea8115640 con 0x7f2ea80fb9b0 2024-02-07T12:18:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.086+0000 7f2eae55d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ea80fb9b0 0x7f2ea8115100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.086+0000 7f2eae55d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ea80fb9b0 0x7f2ea8115100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:42350/0 (socket says 172.21.15.138:42350) 2024-02-07T12:18:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.086+0000 7f2eae55d700 1 -- 172.21.15.138:0/566309804 learned_addr learned my addr 172.21.15.138:0/566309804 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:18:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.086+0000 7f2eae55d700 1 -- 172.21.15.138:0/566309804 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea4005040 con 0x7f2ea80fb9b0 2024-02-07T12:18:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.086+0000 7f2eae55d700 1 --2- 172.21.15.138:0/566309804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ea80fb9b0 0x7f2ea8115100 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009300 tx=0x7f2ea4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.086+0000 7f2e9effd700 1 -- 172.21.15.138:0/566309804 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ea4004e60 con 0x7f2ea80fb9b0 2024-02-07T12:18:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.086+0000 7f2eb07c1700 1 -- 172.21.15.138:0/566309804 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea8115840 con 0x7f2ea80fb9b0 2024-02-07T12:18:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.086+0000 7f2e9effd700 1 -- 172.21.15.138:0/566309804 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ea4013420 con 0x7f2ea80fb9b0 2024-02-07T12:18:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.086+0000 7f2e9effd700 1 -- 172.21.15.138:0/566309804 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ea401c5b0 con 0x7f2ea80fb9b0 2024-02-07T12:18:22.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.086+0000 7f2eb07c1700 1 -- 172.21.15.138:0/566309804 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea8115d30 con 0x7f2ea80fb9b0 2024-02-07T12:18:22.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.087+0000 7f2e9effd700 1 -- 172.21.15.138:0/566309804 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f2ea4013a90 con 0x7f2ea80fb9b0 2024-02-07T12:18:22.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.087+0000 7f2eb07c1700 1 -- 172.21.15.138:0/566309804 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea805f5c0 con 0x7f2ea80fb9b0 2024-02-07T12:18:22.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.087+0000 7f2e9effd700 1 --2- 172.21.15.138:0/566309804 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2e940367c0 0x7f2e94038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:22.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.087+0000 7f2e9effd700 1 -- 172.21.15.138:0/566309804 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2ea4049960 con 0x7f2ea80fb9b0 2024-02-07T12:18:22.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.088+0000 7f2eadd5c700 1 --2- 172.21.15.138:0/566309804 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2e940367c0 0x7f2e94038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:22.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.088+0000 7f2eadd5c700 1 --2- 172.21.15.138:0/566309804 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2e940367c0 0x7f2e94038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009990 tx=0x7f2e98006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:22.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.093+0000 7f2e9effd700 1 -- 172.21.15.138:0/566309804 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2ea4011960 con 0x7f2ea80fb9b0 2024-02-07T12:18:22.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.357+0000 7f2eb07c1700 1 -- 172.21.15.138:0/566309804 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2ea8110870 con 0x7f2ea80fb9b0 2024-02-07T12:18:22.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.357+0000 7f2e9effd700 1 -- 172.21.15.138:0/566309804 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2ea4017200 con 0x7f2ea80fb9b0 2024-02-07T12:18:22.360 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:18:22.360 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:18:22.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.360+0000 7f2eb07c1700 1 -- 172.21.15.138:0/566309804 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2e940367c0 msgr2=0x7f2e94038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:22.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.360+0000 7f2eb07c1700 1 --2- 172.21.15.138:0/566309804 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2e940367c0 0x7f2e94038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009990 tx=0x7f2e98006e40 comp rx=0 tx=0).stop 2024-02-07T12:18:22.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.360+0000 7f2eb07c1700 1 -- 172.21.15.138:0/566309804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ea80fb9b0 msgr2=0x7f2ea8115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:22.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.360+0000 7f2eb07c1700 1 --2- 172.21.15.138:0/566309804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ea80fb9b0 0x7f2ea8115100 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009300 tx=0x7f2ea4009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:22.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.360+0000 7f2eb07c1700 1 -- 172.21.15.138:0/566309804 shutdown_connections 2024-02-07T12:18:22.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.360+0000 7f2eb07c1700 1 --2- 172.21.15.138:0/566309804 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2e940367c0 0x7f2e94038c70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:22.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.360+0000 7f2eb07c1700 1 --2- 172.21.15.138:0/566309804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ea80fb9b0 0x7f2ea8115100 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:22.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.360+0000 7f2eb07c1700 1 -- 172.21.15.138:0/566309804 >> 172.21.15.138:0/566309804 conn(0x7f2ea8072850 msgr2=0x7f2ea80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:22.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.360+0000 7f2eb07c1700 1 -- 172.21.15.138:0/566309804 shutdown_connections 2024-02-07T12:18:22.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:22.360+0000 7f2eb07c1700 1 -- 172.21.15.138:0/566309804 wait complete. 2024-02-07T12:18:22.363 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:18:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.fiugmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:18:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.fiugmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-07T12:18:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:18:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:22 smithi047 ceph-mon[28972]: Deploying daemon mgr.smithi138.fiugmj on smithi138 2024-02-07T12:18:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:18:23.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:23 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/566309804' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:18:24.189 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:18:24.190 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:18:24.480 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:18:25.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:25 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:25.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:25 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:25.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:25 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:25.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:25 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:25.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:25 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-07T12:18:25.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:25 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:25.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:25 smithi047 ceph-mon[28972]: Deploying daemon mon.smithi138 on smithi138 2024-02-07T12:18:25.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.944+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/3072190300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f9c101b60 msgr2=0x7f2f9c101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:25.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.944+0000 7f2fa1f3c700 1 --2- 172.21.15.138:0/3072190300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f9c101b60 0x7f2f9c101f30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0048c0 tx=0x7f2f8c009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:25.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.944+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/3072190300 shutdown_connections 2024-02-07T12:18:25.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.944+0000 7f2fa1f3c700 1 --2- 172.21.15.138:0/3072190300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f9c101b60 0x7f2f9c101f30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:25.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.944+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/3072190300 >> 172.21.15.138:0/3072190300 conn(0x7f2f9c072850 msgr2=0x7f2f9c072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:25.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.944+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/3072190300 shutdown_connections 2024-02-07T12:18:25.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.944+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/3072190300 wait complete. 2024-02-07T12:18:25.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.945+0000 7f2fa1f3c700 1 Processor -- start 2024-02-07T12:18:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.945+0000 7f2fa1f3c700 1 -- start start 2024-02-07T12:18:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.945+0000 7f2fa1f3c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f9c101b60 0x7f2f9c111df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.945+0000 7f2fa1f3c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c112330 con 0x7f2f9c101b60 2024-02-07T12:18:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.946+0000 7f2f9b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f9c101b60 0x7f2f9c111df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.946+0000 7f2f9b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f9c101b60 0x7f2f9c111df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:42388/0 (socket says 172.21.15.138:42388) 2024-02-07T12:18:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.946+0000 7f2f9b7fe700 1 -- 172.21.15.138:0/304676305 learned_addr learned my addr 172.21.15.138:0/304676305 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:18:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.946+0000 7f2f9b7fe700 1 -- 172.21.15.138:0/304676305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c005040 con 0x7f2f9c101b60 2024-02-07T12:18:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.946+0000 7f2f9b7fe700 1 --2- 172.21.15.138:0/304676305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f9c101b60 0x7f2f9c111df0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009c90 tx=0x7f2f8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.946+0000 7f2f83fff700 1 -- 172.21.15.138:0/304676305 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f8c004e60 con 0x7f2f9c101b60 2024-02-07T12:18:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.946+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/304676305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c112530 con 0x7f2f9c101b60 2024-02-07T12:18:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.946+0000 7f2f83fff700 1 -- 172.21.15.138:0/304676305 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f8c009860 con 0x7f2f9c101b60 2024-02-07T12:18:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.946+0000 7f2f83fff700 1 -- 172.21.15.138:0/304676305 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f8c013790 con 0x7f2f9c101b60 2024-02-07T12:18:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.946+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/304676305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9c112a20 con 0x7f2f9c101b60 2024-02-07T12:18:25.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.947+0000 7f2f83fff700 1 -- 172.21.15.138:0/304676305 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f2f8c01e420 con 0x7f2f9c101b60 2024-02-07T12:18:25.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.947+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/304676305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9c05f5c0 con 0x7f2f9c101b60 2024-02-07T12:18:25.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.948+0000 7f2f83fff700 1 --2- 172.21.15.138:0/304676305 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2f840367c0 0x7f2f84038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:25.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.948+0000 7f2f83fff700 1 -- 172.21.15.138:0/304676305 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2f8c04c6c0 con 0x7f2f9c101b60 2024-02-07T12:18:25.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.948+0000 7f2f9affd700 1 --2- 172.21.15.138:0/304676305 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2f840367c0 0x7f2f84038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:25.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.948+0000 7f2f9affd700 1 --2- 172.21.15.138:0/304676305 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2f840367c0 0x7f2f84038c70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009990 tx=0x7f2f90006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:25.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:25.953+0000 7f2f83fff700 1 -- 172.21.15.138:0/304676305 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2f8c011550 con 0x7f2f9c101b60 2024-02-07T12:18:26.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:26.223+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/304676305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2f9c10d530 con 0x7f2f9c101b60 2024-02-07T12:18:26.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:26.224+0000 7f2f83fff700 1 -- 172.21.15.138:0/304676305 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2f8c011370 con 0x7f2f9c101b60 2024-02-07T12:18:26.227 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:18:26.227 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:18:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:26.226+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/304676305 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2f840367c0 msgr2=0x7f2f84038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:26.226+0000 7f2fa1f3c700 1 --2- 172.21.15.138:0/304676305 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2f840367c0 0x7f2f84038c70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009990 tx=0x7f2f90006e40 comp rx=0 tx=0).stop 2024-02-07T12:18:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:26.226+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/304676305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f9c101b60 msgr2=0x7f2f9c111df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:26.226+0000 7f2fa1f3c700 1 --2- 172.21.15.138:0/304676305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f9c101b60 0x7f2f9c111df0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009c90 tx=0x7f2f8c009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:26.226+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/304676305 shutdown_connections 2024-02-07T12:18:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:26.226+0000 7f2fa1f3c700 1 --2- 172.21.15.138:0/304676305 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2f840367c0 0x7f2f84038c70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:26.226+0000 7f2fa1f3c700 1 --2- 172.21.15.138:0/304676305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f9c101b60 0x7f2f9c111df0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:26.226+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/304676305 >> 172.21.15.138:0/304676305 conn(0x7f2f9c072850 msgr2=0x7f2f9c103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:26.227+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/304676305 shutdown_connections 2024-02-07T12:18:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:26.227+0000 7f2fa1f3c700 1 -- 172.21.15.138:0/304676305 wait complete. 2024-02-07T12:18:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:18:26.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:26 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/304676305' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:18:28.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:27 smithi047 ceph-mon[28972]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:28.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:28.778 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:18:28.778 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:18:29.049 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi138/config 2024-02-07T12:18:30.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:29 smithi047 ceph-mon[28972]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:30.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.477+0000 7fd17784b700 1 -- 172.21.15.138:0/3449805911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd170102cd0 msgr2=0x7fd1701030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:30.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.477+0000 7fd17784b700 1 --2- 172.21.15.138:0/3449805911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd170102cd0 0x7fd1701030a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd168009c60 tx=0x7fd168004d10 comp rx=0 tx=0).stop 2024-02-07T12:18:30.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.477+0000 7fd17784b700 1 -- 172.21.15.138:0/3449805911 shutdown_connections 2024-02-07T12:18:30.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.477+0000 7fd17784b700 1 --2- 172.21.15.138:0/3449805911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd170102cd0 0x7fd1701030a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:30.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.477+0000 7fd17784b700 1 -- 172.21.15.138:0/3449805911 >> 172.21.15.138:0/3449805911 conn(0x7fd1700f8860 msgr2=0x7fd1700fac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:30.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.477+0000 7fd17784b700 1 -- 172.21.15.138:0/3449805911 shutdown_connections 2024-02-07T12:18:30.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.477+0000 7fd17784b700 1 -- 172.21.15.138:0/3449805911 wait complete. 2024-02-07T12:18:30.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.478+0000 7fd17784b700 1 Processor -- start 2024-02-07T12:18:30.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.478+0000 7fd17784b700 1 -- start start 2024-02-07T12:18:30.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.478+0000 7fd17784b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd170102cd0 0x7fd1701152c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:30.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.478+0000 7fd17784b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd170115800 con 0x7fd170102cd0 2024-02-07T12:18:30.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.479+0000 7fd1755e7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd170102cd0 0x7fd1701152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:30.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.479+0000 7fd1755e7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd170102cd0 0x7fd1701152c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.138:42400/0 (socket says 172.21.15.138:42400) 2024-02-07T12:18:30.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.479+0000 7fd1755e7700 1 -- 172.21.15.138:0/1866300380 learned_addr learned my addr 172.21.15.138:0/1866300380 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:18:30.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.479+0000 7fd1755e7700 1 -- 172.21.15.138:0/1866300380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd168009940 con 0x7fd170102cd0 2024-02-07T12:18:30.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.479+0000 7fd1755e7700 1 --2- 172.21.15.138:0/1866300380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd170102cd0 0x7fd1701152c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd168004e60 tx=0x7fd168004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:30.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.480+0000 7fd165ffb700 1 -- 172.21.15.138:0/1866300380 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd168007c80 con 0x7fd170102cd0 2024-02-07T12:18:30.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.480+0000 7fd165ffb700 1 -- 172.21.15.138:0/1866300380 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd16801d910 con 0x7fd170102cd0 2024-02-07T12:18:30.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.480+0000 7fd17784b700 1 -- 172.21.15.138:0/1866300380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd170115a00 con 0x7fd170102cd0 2024-02-07T12:18:30.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.480+0000 7fd165ffb700 1 -- 172.21.15.138:0/1866300380 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd168012a00 con 0x7fd170102cd0 2024-02-07T12:18:30.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.480+0000 7fd17784b700 1 -- 172.21.15.138:0/1866300380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd170115ef0 con 0x7fd170102cd0 2024-02-07T12:18:30.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.481+0000 7fd165ffb700 1 -- 172.21.15.138:0/1866300380 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7fd168019040 con 0x7fd170102cd0 2024-02-07T12:18:30.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.481+0000 7fd17784b700 1 -- 172.21.15.138:0/1866300380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17005f5c0 con 0x7fd170102cd0 2024-02-07T12:18:30.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.481+0000 7fd165ffb700 1 --2- 172.21.15.138:0/1866300380 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd15c0367d0 0x7fd15c038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:30.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.481+0000 7fd165ffb700 1 -- 172.21.15.138:0/1866300380 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd16804b3a0 con 0x7fd170102cd0 2024-02-07T12:18:30.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.481+0000 7fd174de6700 1 --2- 172.21.15.138:0/1866300380 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd15c0367d0 0x7fd15c038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:30.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.482+0000 7fd174de6700 1 --2- 172.21.15.138:0/1866300380 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd15c0367d0 0x7fd15c038c80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd160009990 tx=0x7fd160006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:30.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.486+0000 7fd165ffb700 1 -- 172.21.15.138:0/1866300380 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd168024310 con 0x7fd170102cd0 2024-02-07T12:18:30.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.763+0000 7fd17784b700 1 -- 172.21.15.138:0/1866300380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd170110940 con 0x7fd170102cd0 2024-02-07T12:18:30.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.764+0000 7fd165ffb700 1 -- 172.21.15.138:0/1866300380 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd168017020 con 0x7fd170102cd0 2024-02-07T12:18:30.766 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:18:30.767 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:15:59.678751Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-07T12:18:30.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.766+0000 7fd17784b700 1 -- 172.21.15.138:0/1866300380 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd15c0367d0 msgr2=0x7fd15c038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:30.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.766+0000 7fd17784b700 1 --2- 172.21.15.138:0/1866300380 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd15c0367d0 0x7fd15c038c80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd160009990 tx=0x7fd160006e40 comp rx=0 tx=0).stop 2024-02-07T12:18:30.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.766+0000 7fd17784b700 1 -- 172.21.15.138:0/1866300380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd170102cd0 msgr2=0x7fd1701152c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:30.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.766+0000 7fd17784b700 1 --2- 172.21.15.138:0/1866300380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd170102cd0 0x7fd1701152c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd168004e60 tx=0x7fd168004d10 comp rx=0 tx=0).stop 2024-02-07T12:18:30.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.766+0000 7fd17784b700 1 -- 172.21.15.138:0/1866300380 shutdown_connections 2024-02-07T12:18:30.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.766+0000 7fd17784b700 1 --2- 172.21.15.138:0/1866300380 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd15c0367d0 0x7fd15c038c80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:30.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.766+0000 7fd17784b700 1 --2- 172.21.15.138:0/1866300380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd170102cd0 0x7fd1701152c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:30.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.766+0000 7fd17784b700 1 -- 172.21.15.138:0/1866300380 >> 172.21.15.138:0/1866300380 conn(0x7fd1700f8860 msgr2=0x7fd1700f9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:30.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.766+0000 7fd17784b700 1 -- 172.21.15.138:0/1866300380 shutdown_connections 2024-02-07T12:18:30.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:30.766+0000 7fd17784b700 1 -- 172.21.15.138:0/1866300380 wait complete. 2024-02-07T12:18:30.769 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-07T12:18:31.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:30 smithi138 ceph-mon[35528]: mon.smithi138@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-02-07T12:18:31.334 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:31 smithi138 bash[35496]: 02dfa0b8d573d3a2c00cd76f49d700a8225607217bfe7bdd888b159986647535 2024-02-07T12:18:31.334 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:31 smithi138 systemd[1]: Started Ceph mon.smithi138 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:18:32.575 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-07T12:18:32.575 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-07T12:18:32.831 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi138/config 2024-02-07T12:18:36.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:36.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:18:36.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: mon.smithi047 calling monitor election 2024-02-07T12:18:36.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:36.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/4289058098' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/crt"}]: dispatch 2024-02-07T12:18:36.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:36.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:36.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:36.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: mon.smithi138 calling monitor election 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: mon.smithi047 is new leader, mons smithi047,smithi138 in quorum (ranks 0,1) 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: monmap e2: 2 mons at {smithi047=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0],smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: fsmap 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: osdmap e5: 0 total, 0 up, 0 in 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: mgrmap e17: smithi047.zhgnrm(active, since 29s) 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: Standby manager daemon smithi138.fiugmj started 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/4289058098' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: overall HEALTH_OK 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/4289058098' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/key"}]: dispatch 2024-02-07T12:18:36.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/4289058098' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:18:36.287 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:36.287 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:36.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:36.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:18:36.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: mon.smithi047 calling monitor election 2024-02-07T12:18:36.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:36.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/4289058098' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/crt"}]: dispatch 2024-02-07T12:18:36.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:36.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:36.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:36.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: mon.smithi138 calling monitor election 2024-02-07T12:18:36.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:36.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:36.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:36.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:36.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: mon.smithi047 is new leader, mons smithi047,smithi138 in quorum (ranks 0,1) 2024-02-07T12:18:36.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: monmap e2: 2 mons at {smithi047=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0],smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-07T12:18:36.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: fsmap 2024-02-07T12:18:36.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: osdmap e5: 0 total, 0 up, 0 in 2024-02-07T12:18:36.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: mgrmap e17: smithi047.zhgnrm(active, since 29s) 2024-02-07T12:18:36.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: Standby manager daemon smithi138.fiugmj started 2024-02-07T12:18:36.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/4289058098' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:18:36.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: overall HEALTH_OK 2024-02-07T12:18:36.328 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/4289058098' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/key"}]: dispatch 2024-02-07T12:18:36.328 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/4289058098' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:18:36.328 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:36.328 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:37.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.229+0000 7f5380c06700 1 -- 172.21.15.138:0/1188499803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5368003580 msgr2=0x7f5368005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:37.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.229+0000 7f5380c06700 1 --2- 172.21.15.138:0/1188499803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5368003580 0x7f5368005a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f537c0fbb10 tx=0x7f5374009040 comp rx=0 tx=0).stop 2024-02-07T12:18:37.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.229+0000 7f5380c06700 1 -- 172.21.15.138:0/1188499803 shutdown_connections 2024-02-07T12:18:37.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.229+0000 7f5380c06700 1 --2- 172.21.15.138:0/1188499803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5368003580 0x7f5368005a00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:37.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.229+0000 7f5380c06700 1 -- 172.21.15.138:0/1188499803 >> 172.21.15.138:0/1188499803 conn(0x7f537c0729f0 msgr2=0x7f537c072df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:37.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.229+0000 7f5380c06700 1 -- 172.21.15.138:0/1188499803 shutdown_connections 2024-02-07T12:18:37.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.229+0000 7f5380c06700 1 -- 172.21.15.138:0/1188499803 wait complete. 2024-02-07T12:18:37.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:37.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:36 smithi138 ceph-mon[35528]: mgrmap e18: smithi047.zhgnrm(active, since 29s), standbys: smithi138.fiugmj 2024-02-07T12:18:37.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi138.fiugmj", "id": "smithi138.fiugmj"}]: dispatch 2024-02-07T12:18:37.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:37.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:37.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:18:37.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:37.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:18:37.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.229+0000 7f5380c06700 1 Processor -- start 2024-02-07T12:18:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.229+0000 7f5380c06700 1 -- start start 2024-02-07T12:18:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.229+0000 7f5380c06700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5368003580 0x7f537c10e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.229+0000 7f5380c06700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f537c10e7a0 0x7f537c117110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.229+0000 7f5380c06700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c10eca0 con 0x7f5368003580 2024-02-07T12:18:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.229+0000 7f5380c06700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c10ee10 con 0x7f537c10e7a0 2024-02-07T12:18:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f5379d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f537c10e7a0 0x7f537c117110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f5379d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f537c10e7a0 0x7f537c117110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53696/0 (socket says 172.21.15.138:53696) 2024-02-07T12:18:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f537a59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5368003580 0x7f537c10e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f5379d9b700 1 -- 172.21.15.138:0/87867707 learned_addr learned my addr 172.21.15.138:0/87867707 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:18:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f5379d9b700 1 -- 172.21.15.138:0/87867707 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f537c10e7a0 msgr2=0x7f537c117110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-07T12:18:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f5379d9b700 1 -- 172.21.15.138:0/87867707 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f537c10e7a0 msgr2=0x7f537c117110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-07T12:18:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f5379d9b700 1 --2- 172.21.15.138:0/87867707 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f537c10e7a0 0x7f537c117110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-07T12:18:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f5379d9b700 1 --2- 172.21.15.138:0/87867707 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f537c10e7a0 0x7f537c117110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-07T12:18:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f537a59c700 1 -- 172.21.15.138:0/87867707 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f537c10e7a0 msgr2=0x7f537c117110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-07T12:18:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f537a59c700 1 --2- 172.21.15.138:0/87867707 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f537c10e7a0 0x7f537c117110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f537a59c700 1 -- 172.21.15.138:0/87867707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53740079e0 con 0x7f5368003580 2024-02-07T12:18:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f537a59c700 1 --2- 172.21.15.138:0/87867707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5368003580 0x7f537c10e260 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f53740139e0 tx=0x7f5374009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f5372ffd700 1 -- 172.21.15.138:0/87867707 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5374017750 con 0x7f5368003580 2024-02-07T12:18:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f5380c06700 1 -- 172.21.15.138:0/87867707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c117650 con 0x7f5368003580 2024-02-07T12:18:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f5372ffd700 1 -- 172.21.15.138:0/87867707 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5374017d80 con 0x7f5368003580 2024-02-07T12:18:37.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f5372ffd700 1 -- 172.21.15.138:0/87867707 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5374020cf0 con 0x7f5368003580 2024-02-07T12:18:37.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.230+0000 7f5380c06700 1 -- 172.21.15.138:0/87867707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c117b60 con 0x7f5368003580 2024-02-07T12:18:37.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.231+0000 7f5380c06700 1 -- 172.21.15.138:0/87867707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537c05f5c0 con 0x7f5368003580 2024-02-07T12:18:37.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.232+0000 7f5372ffd700 1 -- 172.21.15.138:0/87867707 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f5374020520 con 0x7f5368003580 2024-02-07T12:18:37.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.232+0000 7f5372ffd700 1 --2- 172.21.15.138:0/87867707 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f535c068fe0 0x7f535c06b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:37.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.232+0000 7f5372ffd700 1 -- 172.21.15.138:0/87867707 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f5374088590 con 0x7f5368003580 2024-02-07T12:18:37.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.232+0000 7f5379d9b700 1 --2- 172.21.15.138:0/87867707 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f535c068fe0 0x7f535c06b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:37.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.233+0000 7f5379d9b700 1 --2- 172.21.15.138:0/87867707 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f535c068fe0 0x7f535c06b490 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5364006fd0 tx=0x7f5364008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:37.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.237+0000 7f5372ffd700 1 -- 172.21.15.138:0/87867707 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5374055a20 con 0x7f5368003580 2024-02-07T12:18:37.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:37.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:36 smithi047 ceph-mon[28972]: mgrmap e18: smithi047.zhgnrm(active, since 29s), standbys: smithi138.fiugmj 2024-02-07T12:18:37.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi138.fiugmj", "id": "smithi138.fiugmj"}]: dispatch 2024-02-07T12:18:37.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:37.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:37.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:18:37.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:18:37.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:18:37.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:37.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.505+0000 7f5380c06700 1 -- 172.21.15.138:0/87867707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f537c065e60 con 0x7f5368003580 2024-02-07T12:18:37.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.505+0000 7f5372ffd700 1 -- 172.21.15.138:0/87867707 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f537401b020 con 0x7f5368003580 2024-02-07T12:18:37.509 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-07T12:18:37.509 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":2,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","modified":"2024-02-07T12:18:30.886470Z","created":"2024-02-07T12:15:59.678751Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-07T12:18:37.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.507+0000 7f5380c06700 1 -- 172.21.15.138:0/87867707 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f535c068fe0 msgr2=0x7f535c06b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:37.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.507+0000 7f5380c06700 1 --2- 172.21.15.138:0/87867707 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f535c068fe0 0x7f535c06b490 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5364006fd0 tx=0x7f5364008040 comp rx=0 tx=0).stop 2024-02-07T12:18:37.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.507+0000 7f5380c06700 1 -- 172.21.15.138:0/87867707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5368003580 msgr2=0x7f537c10e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:37.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.507+0000 7f5380c06700 1 --2- 172.21.15.138:0/87867707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5368003580 0x7f537c10e260 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f53740139e0 tx=0x7f5374009040 comp rx=0 tx=0).stop 2024-02-07T12:18:37.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.507+0000 7f5380c06700 1 -- 172.21.15.138:0/87867707 shutdown_connections 2024-02-07T12:18:37.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.507+0000 7f5380c06700 1 --2- 172.21.15.138:0/87867707 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f535c068fe0 0x7f535c06b490 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:37.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.507+0000 7f5380c06700 1 --2- 172.21.15.138:0/87867707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5368003580 0x7f537c10e260 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:37.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.507+0000 7f5380c06700 1 --2- 172.21.15.138:0/87867707 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f537c10e7a0 0x7f537c117110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:37.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.507+0000 7f5380c06700 1 -- 172.21.15.138:0/87867707 >> 172.21.15.138:0/87867707 conn(0x7f537c0729f0 msgr2=0x7f537c1051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:37.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.507+0000 7f5380c06700 1 -- 172.21.15.138:0/87867707 shutdown_connections 2024-02-07T12:18:37.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:18:37.507+0000 7f5380c06700 1 -- 172.21.15.138:0/87867707 wait complete. 2024-02-07T12:18:37.512 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 2 2024-02-07T12:18:38.237 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-07T12:18:38.237 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph config generate-minimal-conf 2024-02-07T12:18:38.267 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:37 smithi047 ceph-mon[28972]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:38.267 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:37 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/87867707' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:18:38.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:37 smithi138 ceph-mon[35528]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:38.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:37 smithi138 ceph-mon[35528]: from='client.? 172.21.15.138:0/87867707' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-07T12:18:38.537 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:18:39.644 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.644 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.644 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:39.644 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:18:39.644 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: Updating smithi047:/etc/ceph/ceph.conf 2024-02-07T12:18:39.644 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-07T12:18:39.644 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:18:39.644 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:18:39.644 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:39.645 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.645 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.645 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.645 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.645 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.645 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: Reconfiguring mon.smithi047 (unknown last config time)... 2024-02-07T12:18:39.645 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-07T12:18:39.645 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-07T12:18:39.645 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:39.645 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:39 smithi047 ceph-mon[28972]: Reconfiguring daemon mon.smithi047 on smithi047 2024-02-07T12:18:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:18:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: Updating smithi047:/etc/ceph/ceph.conf 2024-02-07T12:18:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-07T12:18:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:18:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:18:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: Reconfiguring mon.smithi047 (unknown last config time)... 2024-02-07T12:18:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-07T12:18:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-07T12:18:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:39 smithi138 ceph-mon[35528]: Reconfiguring daemon mon.smithi047 on smithi047 2024-02-07T12:18:40.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.763+0000 7f406e47d700 1 -- 172.21.15.47:0/3306233625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4068070330 msgr2=0x7f4068070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:40.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.763+0000 7f406e47d700 1 --2- 172.21.15.47:0/3306233625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4068070330 0x7f4068070700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f40580048c0 tx=0x7f4058009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:40.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.763+0000 7f406e47d700 1 -- 172.21.15.47:0/3306233625 shutdown_connections 2024-02-07T12:18:40.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.763+0000 7f406e47d700 1 --2- 172.21.15.47:0/3306233625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4068070330 0x7f4068070700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:40.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.763+0000 7f406e47d700 1 -- 172.21.15.47:0/3306233625 >> 172.21.15.47:0/3306233625 conn(0x7f40680f8760 msgr2=0x7f40680fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:40.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.763+0000 7f406e47d700 1 -- 172.21.15.47:0/3306233625 shutdown_connections 2024-02-07T12:18:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.763+0000 7f406e47d700 1 -- 172.21.15.47:0/3306233625 wait complete. 2024-02-07T12:18:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.763+0000 7f406e47d700 1 Processor -- start 2024-02-07T12:18:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.764+0000 7f406e47d700 1 -- start start 2024-02-07T12:18:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.764+0000 7f406e47d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4068070330 0x7f4068115340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.764+0000 7f406e47d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4068115880 0x7f406810f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.764+0000 7f406e47d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4068115e90 con 0x7f4068115880 2024-02-07T12:18:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.764+0000 7f406e47d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406810f720 con 0x7f4068070330 2024-02-07T12:18:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.764+0000 7f40677fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4068115880 0x7f406810f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.764+0000 7f40677fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4068115880 0x7f406810f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55808/0 (socket says 172.21.15.47:55808) 2024-02-07T12:18:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.764+0000 7f40677fe700 1 -- 172.21.15.47:0/2059366003 learned_addr learned my addr 172.21.15.47:0/2059366003 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:18:40.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.764+0000 7f40677fe700 1 -- 172.21.15.47:0/2059366003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4068070330 msgr2=0x7f4068115340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:40.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.764+0000 7f40677fe700 1 --2- 172.21.15.47:0/2059366003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4068070330 0x7f4068115340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:40.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.764+0000 7f40677fe700 1 -- 172.21.15.47:0/2059366003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058005040 con 0x7f4068115880 2024-02-07T12:18:40.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.764+0000 7f40677fe700 1 --2- 172.21.15.47:0/2059366003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4068115880 0x7f406810f1e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f405000b790 tx=0x7f4050009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.764+0000 7f4064ff9700 1 -- 172.21.15.47:0/2059366003 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4050010870 con 0x7f4068115880 2024-02-07T12:18:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.765+0000 7f4064ff9700 1 -- 172.21.15.47:0/2059366003 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f405000f3e0 con 0x7f4068115880 2024-02-07T12:18:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.765+0000 7f406e47d700 1 -- 172.21.15.47:0/2059366003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406810fa00 con 0x7f4068115880 2024-02-07T12:18:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.765+0000 7f4064ff9700 1 -- 172.21.15.47:0/2059366003 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4050010ea0 con 0x7f4068115880 2024-02-07T12:18:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.765+0000 7f406e47d700 1 -- 172.21.15.47:0/2059366003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406810ff40 con 0x7f4068115880 2024-02-07T12:18:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.766+0000 7f406e47d700 1 -- 172.21.15.47:0/2059366003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4068106640 con 0x7f4068115880 2024-02-07T12:18:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.766+0000 7f4064ff9700 1 -- 172.21.15.47:0/2059366003 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f405000f550 con 0x7f4068115880 2024-02-07T12:18:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.766+0000 7f4064ff9700 1 --2- 172.21.15.47:0/2059366003 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f4054069040 0x7f405406b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:40.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.766+0000 7f4064ff9700 1 -- 172.21.15.47:0/2059366003 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f40500861c0 con 0x7f4068115880 2024-02-07T12:18:40.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.766+0000 7f4067fff700 1 --2- 172.21.15.47:0/2059366003 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f4054069040 0x7f405406b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:40.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.767+0000 7f4067fff700 1 --2- 172.21.15.47:0/2059366003 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f4054069040 0x7f405406b4f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4058000c00 tx=0x7f4058009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:40.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.771+0000 7f4064ff9700 1 -- 172.21.15.47:0/2059366003 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4050057200 con 0x7f4068115880 2024-02-07T12:18:40.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.965+0000 7f406e47d700 1 -- 172.21.15.47:0/2059366003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f406805f5c0 con 0x7f4068115880 2024-02-07T12:18:40.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.966+0000 7f4064ff9700 1 -- 172.21.15.47:0/2059366003 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f4050014100 con 0x7f4068115880 2024-02-07T12:18:40.968 INFO:teuthology.orchestra.run.smithi047.stdout:# minimal ceph.conf for 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:18:40.969 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-02-07T12:18:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:18:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: mon_host = [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-02-07T12:18:40.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.968+0000 7f406e47d700 1 -- 172.21.15.47:0/2059366003 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f4054069040 msgr2=0x7f405406b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:40.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.968+0000 7f406e47d700 1 --2- 172.21.15.47:0/2059366003 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f4054069040 0x7f405406b4f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4058000c00 tx=0x7f4058009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:40.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.968+0000 7f406e47d700 1 -- 172.21.15.47:0/2059366003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4068115880 msgr2=0x7f406810f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:40.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.968+0000 7f406e47d700 1 --2- 172.21.15.47:0/2059366003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4068115880 0x7f406810f1e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f405000b790 tx=0x7f4050009250 comp rx=0 tx=0).stop 2024-02-07T12:18:40.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.968+0000 7f406e47d700 1 -- 172.21.15.47:0/2059366003 shutdown_connections 2024-02-07T12:18:40.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.968+0000 7f406e47d700 1 --2- 172.21.15.47:0/2059366003 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f4054069040 0x7f405406b4f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:40.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.968+0000 7f406e47d700 1 --2- 172.21.15.47:0/2059366003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4068070330 0x7f4068115340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:40.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.968+0000 7f406e47d700 1 --2- 172.21.15.47:0/2059366003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4068115880 0x7f406810f1e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:40.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.968+0000 7f406e47d700 1 -- 172.21.15.47:0/2059366003 >> 172.21.15.47:0/2059366003 conn(0x7f40680f8760 msgr2=0x7f40681037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:40.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.968+0000 7f406e47d700 1 -- 172.21.15.47:0/2059366003 shutdown_connections 2024-02-07T12:18:40.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:40.968+0000 7f406e47d700 1 -- 172.21.15.47:0/2059366003 wait complete. 2024-02-07T12:18:41.814 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-07T12:18:41.814 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:18:41.814 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.conf 2024-02-07T12:18:41.884 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:18:41.885 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:18:41.949 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:41 smithi047 ceph-mon[28972]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:41.950 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:41 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2059366003' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:41.950 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:41 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:41.950 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:41 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:41.950 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:41 smithi047 ceph-mon[28972]: Reconfiguring mgr.smithi047.zhgnrm (unknown last config time)... 2024-02-07T12:18:41.950 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:41 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.zhgnrm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:18:41.950 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:41 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:18:41.950 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:41 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:41.950 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:41 smithi047 ceph-mon[28972]: Reconfiguring daemon mgr.smithi047.zhgnrm on smithi047 2024-02-07T12:18:41.953 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:18:41.953 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.conf 2024-02-07T12:18:41.987 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:18:41.988 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:18:42.060 INFO:tasks.cephadm:Deploying OSDs... 2024-02-07T12:18:42.060 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:18:42.060 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-02-07T12:18:42.075 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-07T12:18:42.075 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-02-07T12:18:42.132 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-07T12:18:42.132 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-07T12:18:42.132 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-02-07T12:18:42.133 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-07T12:18:42.133 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-02-07T12:18:42.133 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-02-07 12:17:58.498635964 +0000 2024-02-07T12:18:42.133 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-02-07 12:12:15.450600538 +0000 2024-02-07T12:18:42.133 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-02-07 12:12:15.450600538 +0000 2024-02-07T12:18:42.133 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-02-07 12:12:15.450600538 +0000 2024-02-07T12:18:42.133 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-07T12:18:42.200 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-02-07T12:18:42.200 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-02-07T12:18:42.200 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 9.641e-05 s, 5.3 MB/s 2024-02-07T12:18:42.201 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-07T12:18:42.257 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-02-07T12:18:42.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:41 smithi138 ceph-mon[35528]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:41 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2059366003' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:41 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:41 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:41 smithi138 ceph-mon[35528]: Reconfiguring mgr.smithi047.zhgnrm (unknown last config time)... 2024-02-07T12:18:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:41 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.zhgnrm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:18:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:41 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:18:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:41 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:41 smithi138 ceph-mon[35528]: Reconfiguring daemon mgr.smithi047.zhgnrm on smithi047 2024-02-07T12:18:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-07T12:18:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-07T12:18:42.311 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-02-07T12:18:42.312 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-07T12:18:42.312 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-02-07T12:18:42.312 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-02-07 12:17:58.498635964 +0000 2024-02-07T12:18:42.312 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-02-07 12:12:15.797593365 +0000 2024-02-07T12:18:42.312 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-02-07 12:12:15.797593365 +0000 2024-02-07T12:18:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-02-07 12:12:15.797593365 +0000 2024-02-07T12:18:42.312 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-07T12:18:42.377 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-02-07T12:18:42.377 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-02-07T12:18:42.377 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 8.6766e-05 s, 5.9 MB/s 2024-02-07T12:18:42.378 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-07T12:18:42.433 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-02-07T12:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-07T12:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-07T12:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-02-07T12:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-07T12:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-02-07T12:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-02-07 12:17:58.499635943 +0000 2024-02-07T12:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-02-07 12:12:16.130586481 +0000 2024-02-07T12:18:42.488 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-02-07 12:12:16.130586481 +0000 2024-02-07T12:18:42.489 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-02-07 12:12:16.130586481 +0000 2024-02-07T12:18:42.489 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-07T12:18:42.554 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-02-07T12:18:42.554 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-02-07T12:18:42.554 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 8.6586e-05 s, 5.9 MB/s 2024-02-07T12:18:42.555 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-07T12:18:42.610 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-02-07T12:18:42.664 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-07T12:18:42.665 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-07T12:18:42.665 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-02-07T12:18:42.665 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-07T12:18:42.665 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-02-07T12:18:42.665 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-02-07 12:17:58.499635943 +0000 2024-02-07T12:18:42.665 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-02-07 12:12:16.446579949 +0000 2024-02-07T12:18:42.665 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-02-07 12:12:16.446579949 +0000 2024-02-07T12:18:42.665 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-02-07 12:12:16.446579949 +0000 2024-02-07T12:18:42.665 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-07T12:18:42.730 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-02-07T12:18:42.730 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-02-07T12:18:42.730 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 9.624e-05 s, 5.3 MB/s 2024-02-07T12:18:42.731 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-07T12:18:42.787 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:18:42.787 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-02-07T12:18:42.802 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-07T12:18:42.803 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-02-07T12:18:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-07T12:18:42.858 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-07T12:18:42.858 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-02-07T12:18:42.858 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-07T12:18:42.858 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-02-07T12:18:42.858 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-07 12:18:29.269158875 +0000 2024-02-07T12:18:42.859 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-07 12:12:13.379091834 +0000 2024-02-07T12:18:42.859 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-07 12:12:13.379091834 +0000 2024-02-07T12:18:42.859 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-02-07 12:12:13.379091834 +0000 2024-02-07T12:18:42.859 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-07T12:18:42.924 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-07T12:18:42.924 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-07T12:18:42.924 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000217365 s, 2.4 MB/s 2024-02-07T12:18:42.925 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-07T12:18:42.981 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-02-07T12:18:43.036 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-07T12:18:43.036 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-07T12:18:43.037 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-02-07T12:18:43.037 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-07T12:18:43.037 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-02-07T12:18:43.037 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-07 12:18:29.269158875 +0000 2024-02-07T12:18:43.037 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-07 12:12:13.729084741 +0000 2024-02-07T12:18:43.037 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-07 12:12:13.729084741 +0000 2024-02-07T12:18:43.037 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-02-07 12:12:13.729084741 +0000 2024-02-07T12:18:43.037 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-07T12:18:43.102 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-07T12:18:43.103 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-07T12:18:43.103 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000223365 s, 2.3 MB/s 2024-02-07T12:18:43.104 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-07T12:18:43.159 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-02-07T12:18:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-07T12:18:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-07T12:18:43.213 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-02-07T12:18:43.213 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-07T12:18:43.214 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-02-07T12:18:43.214 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-07 12:18:29.270158855 +0000 2024-02-07T12:18:43.214 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-07 12:12:14.065077932 +0000 2024-02-07T12:18:43.214 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-07 12:12:14.065077932 +0000 2024-02-07T12:18:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-02-07 12:12:14.065077932 +0000 2024-02-07T12:18:43.214 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-07T12:18:43.279 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-07T12:18:43.280 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-07T12:18:43.280 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000304876 s, 1.7 MB/s 2024-02-07T12:18:43.281 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-07T12:18:43.336 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-02-07T12:18:43.390 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-07T12:18:43.390 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-07T12:18:43.390 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-02-07T12:18:43.391 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-07T12:18:43.391 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-02-07T12:18:43.391 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-07 12:18:29.271158834 +0000 2024-02-07T12:18:43.391 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-07 12:12:14.430070535 +0000 2024-02-07T12:18:43.391 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-07 12:12:14.430070535 +0000 2024-02-07T12:18:43.391 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-02-07 12:12:14.430070535 +0000 2024-02-07T12:18:43.391 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-07T12:18:43.456 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-07T12:18:43.456 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-07T12:18:43.456 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000200258 s, 2.6 MB/s 2024-02-07T12:18:43.457 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-07T12:18:43.514 INFO:tasks.cephadm:Deploying osd.0 on smithi047 with /dev/vg_nvme/lv_4... 2024-02-07T12:18:43.514 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-07T12:18:44.102 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:18:44.470 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:44 smithi047 ceph-mon[28972]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:44.470 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:44 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:44.470 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:44 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:44.471 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:44 smithi047 ceph-mon[28972]: Reconfiguring crash.smithi047 (monmap changed)... 2024-02-07T12:18:44.471 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:44 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:18:44.471 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:44 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:44.471 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:44 smithi047 ceph-mon[28972]: Reconfiguring daemon crash.smithi047 on smithi047 2024-02-07T12:18:44.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:44 smithi138 ceph-mon[35528]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:44.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:44 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:44.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:44 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:44.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:44 smithi138 ceph-mon[35528]: Reconfiguring crash.smithi047 (monmap changed)... 2024-02-07T12:18:44.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:44 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:18:44.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:44 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:44.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:44 smithi138 ceph-mon[35528]: Reconfiguring daemon crash.smithi047 on smithi047 2024-02-07T12:18:45.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:45 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:45.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:45 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:45.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:45 smithi047 ceph-mon[28972]: Reconfiguring alertmanager.smithi047 (dependencies changed)... 2024-02-07T12:18:45.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:45 smithi047 ceph-mon[28972]: Reconfiguring daemon alertmanager.smithi047 on smithi047 2024-02-07T12:18:45.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:45 smithi047 ceph-mon[28972]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:45.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:45 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:45.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:45 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:45.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:45 smithi138 ceph-mon[35528]: Reconfiguring alertmanager.smithi047 (dependencies changed)... 2024-02-07T12:18:45.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:45 smithi138 ceph-mon[35528]: Reconfiguring daemon alertmanager.smithi047 on smithi047 2024-02-07T12:18:45.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:45 smithi138 ceph-mon[35528]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-07T12:18:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-07T12:18:47.299 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-02-07T12:18:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-02-07T12:18:47.299 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00844734 s, 1.2 GB/s 2024-02-07T12:18:47.300 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-02-07T12:18:47.950 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:47 smithi047 ceph-mon[28972]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:47.978 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi047:vg_nvme/lv_4 2024-02-07T12:18:48.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:47 smithi138 ceph-mon[35528]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:49.363 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:18:50.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:49 smithi047 ceph-mon[28972]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:50.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:49 smithi138 ceph-mon[35528]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:51.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.017+0000 7ff087160700 1 -- 172.21.15.47:0/3618492256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0800663e0 msgr2=0x7ff0800ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:51.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.017+0000 7ff087160700 1 --2- 172.21.15.47:0/3618492256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0800663e0 0x7ff0800ffaf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff074004940 tx=0x7ff074009e30 comp rx=0 tx=0).stop 2024-02-07T12:18:51.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.017+0000 7ff087160700 1 -- 172.21.15.47:0/3618492256 shutdown_connections 2024-02-07T12:18:51.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.017+0000 7ff087160700 1 --2- 172.21.15.47:0/3618492256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0801000c0 0x7ff080102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:51.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.017+0000 7ff087160700 1 --2- 172.21.15.47:0/3618492256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0800663e0 0x7ff0800ffaf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:51.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.017+0000 7ff087160700 1 -- 172.21.15.47:0/3618492256 >> 172.21.15.47:0/3618492256 conn(0x7ff0800f74e0 msgr2=0x7ff0800f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:18:51.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.017+0000 7ff087160700 1 -- 172.21.15.47:0/3618492256 shutdown_connections 2024-02-07T12:18:51.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.017+0000 7ff087160700 1 -- 172.21.15.47:0/3618492256 wait complete. 2024-02-07T12:18:51.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.018+0000 7ff087160700 1 Processor -- start 2024-02-07T12:18:51.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.018+0000 7ff087160700 1 -- start start 2024-02-07T12:18:51.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.018+0000 7ff087160700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0800663e0 0x7ff0800fd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:51.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.018+0000 7ff087160700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0801000c0 0x7ff0800fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:51.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.018+0000 7ff087160700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0800fc080 con 0x7ff0800663e0 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.018+0000 7ff087160700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0800fc1f0 con 0x7ff0801000c0 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.018+0000 7ff084efc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0800663e0 0x7ff0800fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.018+0000 7ff084efc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0800663e0 0x7ff0800fd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49176/0 (socket says 172.21.15.47:49176) 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.018+0000 7ff084efc700 1 -- 172.21.15.47:0/1333657842 learned_addr learned my addr 172.21.15.47:0/1333657842 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.019+0000 7ff07ffff700 1 --2- 172.21.15.47:0/1333657842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0801000c0 0x7ff0800fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.019+0000 7ff084efc700 1 -- 172.21.15.47:0/1333657842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0801000c0 msgr2=0x7ff0800fb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.019+0000 7ff084efc700 1 --2- 172.21.15.47:0/1333657842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0801000c0 0x7ff0800fb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.019+0000 7ff084efc700 1 -- 172.21.15.47:0/1333657842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff074005040 con 0x7ff0800663e0 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.019+0000 7ff084efc700 1 --2- 172.21.15.47:0/1333657842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0800663e0 0x7ff0800fd570 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0740093b0 tx=0x7ff074009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.019+0000 7ff07d7fa700 1 -- 172.21.15.47:0/1333657842 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff07400e040 con 0x7ff0800663e0 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.019+0000 7ff07d7fa700 1 -- 172.21.15.47:0/1333657842 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff07400bcc0 con 0x7ff0800663e0 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.019+0000 7ff087160700 1 -- 172.21.15.47:0/1333657842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0800fc470 con 0x7ff0800663e0 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.019+0000 7ff07d7fa700 1 -- 172.21.15.47:0/1333657842 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff07401c630 con 0x7ff0800663e0 2024-02-07T12:18:51.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.019+0000 7ff087160700 1 -- 172.21.15.47:0/1333657842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0801159b0 con 0x7ff0800663e0 2024-02-07T12:18:51.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.020+0000 7ff087160700 1 -- 172.21.15.47:0/1333657842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff080107af0 con 0x7ff0800663e0 2024-02-07T12:18:51.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.020+0000 7ff07d7fa700 1 -- 172.21.15.47:0/1333657842 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7ff0740139f0 con 0x7ff0800663e0 2024-02-07T12:18:51.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.021+0000 7ff07d7fa700 1 --2- 172.21.15.47:0/1333657842 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff070068ed0 0x7ff07006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:18:51.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.021+0000 7ff07d7fa700 1 -- 172.21.15.47:0/1333657842 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ff0740870a0 con 0x7ff0800663e0 2024-02-07T12:18:51.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.021+0000 7ff07ffff700 1 --2- 172.21.15.47:0/1333657842 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff070068ed0 0x7ff07006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:18:51.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.021+0000 7ff07ffff700 1 --2- 172.21.15.47:0/1333657842 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff070068ed0 0x7ff07006b380 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff06c006fd0 tx=0x7ff06c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:18:51.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.025+0000 7ff07d7fa700 1 -- 172.21.15.47:0/1333657842 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff0740580e0 con 0x7ff0800663e0 2024-02-07T12:18:51.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:18:51.228+0000 7ff087160700 1 -- 172.21.15.47:0/1333657842 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff08002b340 con 0x7ff070068ed0 2024-02-07T12:18:52.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:52 smithi138 ceph-mon[35528]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:52.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:52 smithi138 ceph-mon[35528]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:18:52.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:52 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-07T12:18:52.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:52 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-07T12:18:52.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:52 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:52.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:52 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:18:52.316 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:52 smithi047 ceph-mon[28972]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:52.316 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:52 smithi047 ceph-mon[28972]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:18:52.316 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:52 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-07T12:18:52.316 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:52 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-07T12:18:52.316 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:52 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:18:52.316 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:52 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:18:54.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:54 smithi047 ceph-mon[28972]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:54.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:54 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:54.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:54 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:54.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:54 smithi138 ceph-mon[35528]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:54.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:54 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:54.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:54 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:18:55.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:55 smithi138 ceph-mon[35528]: Reconfiguring grafana.smithi047 (dependencies changed)... 2024-02-07T12:18:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:55 smithi138 ceph-mon[35528]: Reconfiguring daemon grafana.smithi047 on smithi047 2024-02-07T12:18:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:55 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2362300804' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b37bbc00-7240-422a-977b-c7a9687ce87f"}]: dispatch 2024-02-07T12:18:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:55 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2362300804' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b37bbc00-7240-422a-977b-c7a9687ce87f"}]': finished 2024-02-07T12:18:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:55 smithi138 ceph-mon[35528]: osdmap e6: 1 total, 0 up, 1 in 2024-02-07T12:18:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:55 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:18:55.319 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:55 smithi047 ceph-mon[28972]: Reconfiguring grafana.smithi047 (dependencies changed)... 2024-02-07T12:18:55.319 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:55 smithi047 ceph-mon[28972]: Reconfiguring daemon grafana.smithi047 on smithi047 2024-02-07T12:18:55.319 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:55 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2362300804' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b37bbc00-7240-422a-977b-c7a9687ce87f"}]: dispatch 2024-02-07T12:18:55.319 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:55 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2362300804' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b37bbc00-7240-422a-977b-c7a9687ce87f"}]': finished 2024-02-07T12:18:55.319 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:55 smithi047 ceph-mon[28972]: osdmap e6: 1 total, 0 up, 1 in 2024-02-07T12:18:55.319 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:55 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:18:56.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:56 smithi138 ceph-mon[35528]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:56.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:56 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/697940147' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-07T12:18:56.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:56 smithi047 ceph-mon[28972]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:56.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:56 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/697940147' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-07T12:18:58.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:18:58 smithi138 ceph-mon[35528]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:18:58.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:18:58 smithi047 ceph-mon[28972]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:00.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:00 smithi138 ceph-mon[35528]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:00.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:00 smithi047 ceph-mon[28972]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:02.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:02 smithi138 ceph-mon[35528]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:02.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:02 smithi047 ceph-mon[28972]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:04.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:04 smithi138 ceph-mon[35528]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:04.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:04 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:04.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:04 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:04.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:04 smithi047 ceph-mon[28972]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:04.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:04 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:04.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:04 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:05.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:05 smithi138 ceph-mon[35528]: Reconfiguring prometheus.smithi047 (dependencies changed)... 2024-02-07T12:19:05.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:05 smithi138 ceph-mon[35528]: Reconfiguring daemon prometheus.smithi047 on smithi047 2024-02-07T12:19:05.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:05 smithi047 ceph-mon[28972]: Reconfiguring prometheus.smithi047 (dependencies changed)... 2024-02-07T12:19:05.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:05 smithi047 ceph-mon[28972]: Reconfiguring daemon prometheus.smithi047 on smithi047 2024-02-07T12:19:06.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:06 smithi138 ceph-mon[35528]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:06.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:06 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-07T12:19:06.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:06 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:06.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:06 smithi047 ceph-mon[28972]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:06.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-07T12:19:06.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:07.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:07 smithi138 ceph-mon[35528]: Deploying daemon osd.0 on smithi047 2024-02-07T12:19:07.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:19:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:07 smithi047 ceph-mon[28972]: Deploying daemon osd.0 on smithi047 2024-02-07T12:19:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:19:08.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:08 smithi047 ceph-mon[28972]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:08.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:08 smithi138 ceph-mon[35528]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:10.191 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:10 smithi138 ceph-mon[35528]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:10.191 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:10 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:10.191 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:10 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:10.191 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:10 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:19:10.191 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:10 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:10.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:10 smithi047 ceph-mon[28972]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:10.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:10 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:10.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:10 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:10.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:10 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:19:10.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:10 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:11.156 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:11 smithi047 ceph-mon[28972]: Reconfiguring crash.smithi138 (monmap changed)... 2024-02-07T12:19:11.156 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:11 smithi047 ceph-mon[28972]: Reconfiguring daemon crash.smithi138 on smithi138 2024-02-07T12:19:11.157 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:11.157 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:11.157 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.fiugmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:19:11.157 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:19:11.157 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:11.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:11 smithi138 ceph-mon[35528]: Reconfiguring crash.smithi138 (monmap changed)... 2024-02-07T12:19:11.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:11 smithi138 ceph-mon[35528]: Reconfiguring daemon crash.smithi138 on smithi138 2024-02-07T12:19:11.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:11.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:11.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.fiugmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:19:11.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:19:11.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:12.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:12 smithi138 ceph-mon[35528]: Reconfiguring mgr.smithi138.fiugmj (monmap changed)... 2024-02-07T12:19:12.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:12 smithi138 ceph-mon[35528]: Reconfiguring daemon mgr.smithi138.fiugmj on smithi138 2024-02-07T12:19:12.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:12 smithi138 ceph-mon[35528]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:12.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:12 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:12.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:12 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:12.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:12 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-07T12:19:12.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:12 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-07T12:19:12.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:12 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:12 smithi047 ceph-mon[28972]: Reconfiguring mgr.smithi138.fiugmj (monmap changed)... 2024-02-07T12:19:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:12 smithi047 ceph-mon[28972]: Reconfiguring daemon mgr.smithi138.fiugmj on smithi138 2024-02-07T12:19:12.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:12 smithi047 ceph-mon[28972]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:12.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:12.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:12.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-07T12:19:12.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-07T12:19:12.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:13.179 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:13 smithi138 ceph-mon[35528]: Reconfiguring mon.smithi138 (monmap changed)... 2024-02-07T12:19:13.179 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:13 smithi138 ceph-mon[35528]: Reconfiguring daemon mon.smithi138 on smithi138 2024-02-07T12:19:13.248 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:13 smithi047 ceph-mon[28972]: Reconfiguring mon.smithi138 (monmap changed)... 2024-02-07T12:19:13.248 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:13 smithi047 ceph-mon[28972]: Reconfiguring daemon mon.smithi138 on smithi138 2024-02-07T12:19:14.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:14.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:14.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:14.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-07T12:19:14.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-07T12:19:14.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi047.front.sepia.ceph.com:9093"}]: dispatch 2024-02-07T12:19:14.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi047.front.sepia.ceph.com:9093"}]: dispatch 2024-02-07T12:19:14.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-07T12:19:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-07T12:19:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi047.front.sepia.ceph.com:3000"}]: dispatch 2024-02-07T12:19:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi047.front.sepia.ceph.com:3000"}]: dispatch 2024-02-07T12:19:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:19:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi047.front.sepia.ceph.com:9095"}]: dispatch 2024-02-07T12:19:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:14 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:19:14.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:14.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:14.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:14.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-07T12:19:14.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-07T12:19:14.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi047.front.sepia.ceph.com:9093"}]: dispatch 2024-02-07T12:19:14.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi047.front.sepia.ceph.com:9093"}]: dispatch 2024-02-07T12:19:14.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:14.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-07T12:19:14.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-07T12:19:14.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi047.front.sepia.ceph.com:3000"}]: dispatch 2024-02-07T12:19:14.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi047.front.sepia.ceph.com:3000"}]: dispatch 2024-02-07T12:19:14.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:14.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:19:14.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi047.front.sepia.ceph.com:9095"}]: dispatch 2024-02-07T12:19:14.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:14.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:14 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:19:15.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:15 smithi047 ceph-mon[28972]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:19:15.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:15 smithi047 ceph-mon[28972]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi047.front.sepia.ceph.com:9095"}]: dispatch 2024-02-07T12:19:15.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:15 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:15.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:15 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:15.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:15 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:15.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:15 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:15.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:15 smithi138 ceph-mon[35528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:19:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:15 smithi138 ceph-mon[35528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi047.front.sepia.ceph.com:9095"}]: dispatch 2024-02-07T12:19:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:15 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:15 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:15 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:15 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:16.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:16 smithi047 ceph-mon[28972]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:16.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:16 smithi138 ceph-mon[35528]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:18.385 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:18 smithi047 ceph-mon[28972]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:18.415+0000 7ff07d7fa700 1 -- 172.21.15.47:0/1333657842 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff08002b340 con 0x7ff070068ed0 2024-02-07T12:19:18.418 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 0 on host 'smithi047' 2024-02-07T12:19:18.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:18.417+0000 7ff087160700 1 -- 172.21.15.47:0/1333657842 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff070068ed0 msgr2=0x7ff07006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:19:18.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:18.417+0000 7ff087160700 1 --2- 172.21.15.47:0/1333657842 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff070068ed0 0x7ff07006b380 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff06c006fd0 tx=0x7ff06c008040 comp rx=0 tx=0).stop 2024-02-07T12:19:18.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:18.417+0000 7ff087160700 1 -- 172.21.15.47:0/1333657842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0800663e0 msgr2=0x7ff0800fd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:19:18.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:18.417+0000 7ff087160700 1 --2- 172.21.15.47:0/1333657842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0800663e0 0x7ff0800fd570 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0740093b0 tx=0x7ff074009e30 comp rx=0 tx=0).stop 2024-02-07T12:19:18.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:18.417+0000 7ff087160700 1 -- 172.21.15.47:0/1333657842 shutdown_connections 2024-02-07T12:19:18.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:18.417+0000 7ff087160700 1 --2- 172.21.15.47:0/1333657842 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff070068ed0 0x7ff07006b380 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:19:18.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:18.417+0000 7ff087160700 1 --2- 172.21.15.47:0/1333657842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0800663e0 0x7ff0800fd570 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:19:18.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:18.417+0000 7ff087160700 1 --2- 172.21.15.47:0/1333657842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0801000c0 0x7ff0800fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:19:18.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:18.417+0000 7ff087160700 1 -- 172.21.15.47:0/1333657842 >> 172.21.15.47:0/1333657842 conn(0x7ff0800f74e0 msgr2=0x7ff0800f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:19:18.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:18.417+0000 7ff087160700 1 -- 172.21.15.47:0/1333657842 shutdown_connections 2024-02-07T12:19:18.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:18.417+0000 7ff087160700 1 -- 172.21.15.47:0/1333657842 wait complete. 2024-02-07T12:19:18.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:18 smithi138 ceph-mon[35528]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:19.310 DEBUG:teuthology.orchestra.run.smithi047:osd.0> sudo journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.0.service 2024-02-07T12:19:19.312 INFO:tasks.cephadm:Deploying osd.1 on smithi047 with /dev/vg_nvme/lv_3... 2024-02-07T12:19:19.312 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-07T12:19:19.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:19 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:19.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:19 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:19.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:19 smithi047 ceph-mon[28972]: from='osd.0 [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-07T12:19:19.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:19 smithi047 ceph-mon[28972]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:19.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:19 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:19.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:19 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:19.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:19 smithi138 ceph-mon[35528]: from='osd.0 [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-07T12:19:19.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:19 smithi138 ceph-mon[35528]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:20.027 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:19:20.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:20 smithi047 ceph-mon[28972]: from='osd.0 [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-07T12:19:20.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:20 smithi047 ceph-mon[28972]: osdmap e7: 1 total, 0 up, 1 in 2024-02-07T12:19:20.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:20 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:19:20.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:20 smithi047 ceph-mon[28972]: from='osd.0 [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-02-07T12:19:20.576 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:19:20 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0[47653]: 2024-02-07T12:19:20.423+0000 7f817396a700 -1 osd.0 0 waiting for initial osdmap 2024-02-07T12:19:20.576 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:19:20 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0[47653]: 2024-02-07T12:19:20.426+0000 7f8170769700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-07T12:19:20.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:20 smithi138 ceph-mon[35528]: from='osd.0 [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-07T12:19:20.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:20 smithi138 ceph-mon[35528]: osdmap e7: 1 total, 0 up, 1 in 2024-02-07T12:19:20.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:20 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:19:20.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:20 smithi138 ceph-mon[35528]: from='osd.0 [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-02-07T12:19:21.761 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:21 smithi047 ceph-mon[28972]: from='osd.0 [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-02-07T12:19:21.761 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:21 smithi047 ceph-mon[28972]: osdmap e8: 1 total, 0 up, 1 in 2024-02-07T12:19:21.761 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:21 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:19:21.761 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:21 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:19:21.761 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:21 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:21.761 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:21 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:21.761 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:21 smithi047 ceph-mon[28972]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:21.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:21 smithi138 ceph-mon[35528]: from='osd.0 [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-02-07T12:19:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:21 smithi138 ceph-mon[35528]: osdmap e8: 1 total, 0 up, 1 in 2024-02-07T12:19:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:21 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:19:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:21 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:19:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:21 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:21 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:21 smithi138 ceph-mon[35528]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-07T12:19:22.648 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:22 smithi047 ceph-mon[28972]: purged_snaps scrub starts 2024-02-07T12:19:22.648 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:22 smithi047 ceph-mon[28972]: purged_snaps scrub ok 2024-02-07T12:19:22.648 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:19:22.648 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:22 smithi047 ceph-mon[28972]: osd.0 [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997] boot 2024-02-07T12:19:22.648 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:22 smithi047 ceph-mon[28972]: osdmap e9: 1 total, 1 up, 1 in 2024-02-07T12:19:22.648 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:19:22.648 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:19:22.649 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-07T12:19:22.649 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-07T12:19:22.649 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-02-07T12:19:22.649 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-02-07T12:19:22.649 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00993644 s, 1.1 GB/s 2024-02-07T12:19:22.649 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-02-07T12:19:22.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:22 smithi138 ceph-mon[35528]: purged_snaps scrub starts 2024-02-07T12:19:22.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:22 smithi138 ceph-mon[35528]: purged_snaps scrub ok 2024-02-07T12:19:22.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:19:22.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:22 smithi138 ceph-mon[35528]: osd.0 [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997] boot 2024-02-07T12:19:22.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:22 smithi138 ceph-mon[35528]: osdmap e9: 1 total, 1 up, 1 in 2024-02-07T12:19:22.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:19:22.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:19:23.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:23 smithi138 ceph-mon[35528]: osdmap e10: 1 total, 1 up, 1 in 2024-02-07T12:19:23.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:23 smithi138 ceph-mon[35528]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:23.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:23 smithi047 ceph-mon[28972]: osdmap e10: 1 total, 1 up, 1 in 2024-02-07T12:19:23.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:23 smithi047 ceph-mon[28972]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:24.534 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi047:vg_nvme/lv_3 2024-02-07T12:19:25.227 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:19:26.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:26 smithi047 ceph-mon[28972]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:26.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:26 smithi047 ceph-mon[28972]: Detected new or changed devices on smithi047 2024-02-07T12:19:26.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:26 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:26.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:26 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:26.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:26 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:19:26.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:26 smithi047 ceph-mon[28972]: Adjusting osd_memory_target on smithi047 to 12869M 2024-02-07T12:19:26.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:26 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:26.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:26 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:26.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:26 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:19:26.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:26 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:26.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:26 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:19:26.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:26 smithi138 ceph-mon[35528]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:26.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:26 smithi138 ceph-mon[35528]: Detected new or changed devices on smithi047 2024-02-07T12:19:26.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:26 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:26.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:26 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:26.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:26 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:19:26.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:26 smithi138 ceph-mon[35528]: Adjusting osd_memory_target on smithi047 to 12869M 2024-02-07T12:19:26.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:26 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:26.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:26 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:26.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:26 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:19:26.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:26 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:26.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:26 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:19:26.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 -- 172.21.15.47:0/1627926737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a41000c0 msgr2=0x7ff3a4102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:19:26.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 --2- 172.21.15.47:0/1627926737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a41000c0 0x7ff3a4102520 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff398004940 tx=0x7ff398009e30 comp rx=0 tx=0).stop 2024-02-07T12:19:26.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 -- 172.21.15.47:0/1627926737 shutdown_connections 2024-02-07T12:19:26.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 --2- 172.21.15.47:0/1627926737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a41000c0 0x7ff3a4102520 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:19:26.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 --2- 172.21.15.47:0/1627926737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3a4066c70 0x7ff3a40ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:19:26.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 -- 172.21.15.47:0/1627926737 >> 172.21.15.47:0/1627926737 conn(0x7ff3a40f7520 msgr2=0x7ff3a40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:19:26.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 -- 172.21.15.47:0/1627926737 shutdown_connections 2024-02-07T12:19:26.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 -- 172.21.15.47:0/1627926737 wait complete. 2024-02-07T12:19:26.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 Processor -- start 2024-02-07T12:19:26.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 -- start start 2024-02-07T12:19:26.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a4066c70 0x7ff3a410d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:19:26.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3a41000c0 0x7ff3a410de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:19:26.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a410e430 con 0x7ff3a4066c70 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.791+0000 7ff3a88f4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a410ecd0 con 0x7ff3a41000c0 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.792+0000 7ff3a259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a4066c70 0x7ff3a410d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.792+0000 7ff3a259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a4066c70 0x7ff3a410d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54726/0 (socket says 172.21.15.47:54726) 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.792+0000 7ff3a259c700 1 -- 172.21.15.47:0/2238364324 learned_addr learned my addr 172.21.15.47:0/2238364324 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.792+0000 7ff3a1d9b700 1 --2- 172.21.15.47:0/2238364324 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3a41000c0 0x7ff3a410de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.792+0000 7ff3a259c700 1 -- 172.21.15.47:0/2238364324 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3a41000c0 msgr2=0x7ff3a410de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.792+0000 7ff3a259c700 1 --2- 172.21.15.47:0/2238364324 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3a41000c0 0x7ff3a410de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.792+0000 7ff3a259c700 1 -- 172.21.15.47:0/2238364324 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff398005040 con 0x7ff3a4066c70 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.792+0000 7ff3a259c700 1 --2- 172.21.15.47:0/2238364324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a4066c70 0x7ff3a410d8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff39400eb70 tx=0x7ff39400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.792+0000 7ff392ffd700 1 -- 172.21.15.47:0/2238364324 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff394007cc0 con 0x7ff3a4066c70 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.792+0000 7ff392ffd700 1 -- 172.21.15.47:0/2238364324 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff39400f040 con 0x7ff3a4066c70 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.792+0000 7ff3a88f4700 1 -- 172.21.15.47:0/2238364324 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a410ef50 con 0x7ff3a4066c70 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.792+0000 7ff392ffd700 1 -- 172.21.15.47:0/2238364324 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff39400ca90 con 0x7ff3a4066c70 2024-02-07T12:19:26.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.792+0000 7ff3a88f4700 1 -- 172.21.15.47:0/2238364324 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a410f490 con 0x7ff3a4066c70 2024-02-07T12:19:26.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.793+0000 7ff3a88f4700 1 -- 172.21.15.47:0/2238364324 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a404bed0 con 0x7ff3a4066c70 2024-02-07T12:19:26.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.794+0000 7ff392ffd700 1 -- 172.21.15.47:0/2238364324 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7ff39400cbf0 con 0x7ff3a4066c70 2024-02-07T12:19:26.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.794+0000 7ff392ffd700 1 --2- 172.21.15.47:0/2238364324 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff38c068ed0 0x7ff38c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:19:26.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.794+0000 7ff392ffd700 1 -- 172.21.15.47:0/2238364324 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7ff394085a00 con 0x7ff3a4066c70 2024-02-07T12:19:26.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.794+0000 7ff3a1d9b700 1 --2- 172.21.15.47:0/2238364324 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff38c068ed0 0x7ff38c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:19:26.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.795+0000 7ff3a1d9b700 1 --2- 172.21.15.47:0/2238364324 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff38c068ed0 0x7ff38c06b380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff398013740 tx=0x7ff398009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:19:26.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:26.800+0000 7ff392ffd700 1 -- 172.21.15.47:0/2238364324 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff3940567e0 con 0x7ff3a4066c70 2024-02-07T12:19:27.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:27.006+0000 7ff3a88f4700 1 -- 172.21.15.47:0/2238364324 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3a410f8f0 con 0x7ff38c068ed0 2024-02-07T12:19:27.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-07T12:19:27.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-07T12:19:27.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:27.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:27.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:27.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:27 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-07T12:19:27.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:27 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-07T12:19:27.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:27 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:27.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:27 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:27.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:27 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:28.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:28 smithi138 ceph-mon[35528]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:28.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:28 smithi138 ceph-mon[35528]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:19:28.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:28 smithi047 ceph-mon[28972]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:28.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:28 smithi047 ceph-mon[28972]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:19:30.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:30 smithi138 ceph-mon[35528]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:30.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:30 smithi047 ceph-mon[28972]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:31.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:31 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3738776206' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6a42328-96ea-40de-987d-4edec38a4b72"}]: dispatch 2024-02-07T12:19:31.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:31 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3738776206' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6a42328-96ea-40de-987d-4edec38a4b72"}]': finished 2024-02-07T12:19:31.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:31 smithi138 ceph-mon[35528]: osdmap e11: 2 total, 1 up, 2 in 2024-02-07T12:19:31.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:31 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:19:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:31 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3738776206' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6a42328-96ea-40de-987d-4edec38a4b72"}]: dispatch 2024-02-07T12:19:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:31 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3738776206' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6a42328-96ea-40de-987d-4edec38a4b72"}]': finished 2024-02-07T12:19:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:31 smithi047 ceph-mon[28972]: osdmap e11: 2 total, 1 up, 2 in 2024-02-07T12:19:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:31 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:19:32.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:32 smithi138 ceph-mon[35528]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:32.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:32 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/1475266957' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-07T12:19:32.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:32 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:32.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:32 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:32.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:32 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:32.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:32 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:19:32.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:32 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:32.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:32 smithi047 ceph-mon[28972]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:32.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:32 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1475266957' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-07T12:19:32.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:32 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:32.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:32 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:32.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:32 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:32.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:32 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:19:32.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:32 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:34.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:34 smithi138 ceph-mon[35528]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:34 smithi047 ceph-mon[28972]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:36.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:36 smithi047 ceph-mon[28972]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:36.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:36 smithi138 ceph-mon[35528]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:37.274 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:37 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:19:37.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:37 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:19:38.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:38 smithi047 ceph-mon[28972]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:38.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:38 smithi138 ceph-mon[35528]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:39.488 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-07T12:19:39.488 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:39.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-07T12:19:39.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:40.386 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:40 smithi047 ceph-mon[28972]: Deploying daemon osd.1 on smithi047 2024-02-07T12:19:40.386 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:40 smithi047 ceph-mon[28972]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:40.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:40 smithi138 ceph-mon[35528]: Deploying daemon osd.1 on smithi047 2024-02-07T12:19:40.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:40 smithi138 ceph-mon[35528]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:42.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:42 smithi047 ceph-mon[28972]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:42.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:42 smithi138 ceph-mon[35528]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:44.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:44 smithi047 ceph-mon[28972]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:44.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:44 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:19:44.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:44 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:44.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:44 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:44.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:44 smithi138 ceph-mon[35528]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:44.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:44 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:19:44.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:44 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:44.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:44 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:46.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:46 smithi047 ceph-mon[28972]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:46.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:46 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:46.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:46 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:46.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:46 smithi138 ceph-mon[35528]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:46.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:46 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:46.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:46 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:47.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:47.264+0000 7ff392ffd700 1 -- 172.21.15.47:0/2238364324 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff3a410f8f0 con 0x7ff38c068ed0 2024-02-07T12:19:47.267 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 1 on host 'smithi047' 2024-02-07T12:19:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:47.266+0000 7ff3a88f4700 1 -- 172.21.15.47:0/2238364324 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff38c068ed0 msgr2=0x7ff38c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:19:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:47.266+0000 7ff3a88f4700 1 --2- 172.21.15.47:0/2238364324 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff38c068ed0 0x7ff38c06b380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff398013740 tx=0x7ff398009e30 comp rx=0 tx=0).stop 2024-02-07T12:19:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:47.266+0000 7ff3a88f4700 1 -- 172.21.15.47:0/2238364324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a4066c70 msgr2=0x7ff3a410d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:19:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:47.266+0000 7ff3a88f4700 1 --2- 172.21.15.47:0/2238364324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a4066c70 0x7ff3a410d8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff39400eb70 tx=0x7ff39400b040 comp rx=0 tx=0).stop 2024-02-07T12:19:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:47.266+0000 7ff3a88f4700 1 -- 172.21.15.47:0/2238364324 shutdown_connections 2024-02-07T12:19:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:47.266+0000 7ff3a88f4700 1 --2- 172.21.15.47:0/2238364324 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff38c068ed0 0x7ff38c06b380 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:19:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:47.266+0000 7ff3a88f4700 1 --2- 172.21.15.47:0/2238364324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a4066c70 0x7ff3a410d8f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:19:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:47.266+0000 7ff3a88f4700 1 --2- 172.21.15.47:0/2238364324 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3a41000c0 0x7ff3a410de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:19:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:47.266+0000 7ff3a88f4700 1 -- 172.21.15.47:0/2238364324 >> 172.21.15.47:0/2238364324 conn(0x7ff3a40f7520 msgr2=0x7ff3a40f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:19:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:47.266+0000 7ff3a88f4700 1 -- 172.21.15.47:0/2238364324 shutdown_connections 2024-02-07T12:19:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:47.266+0000 7ff3a88f4700 1 -- 172.21.15.47:0/2238364324 wait complete. 2024-02-07T12:19:48.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:48 smithi047 ceph-mon[28972]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:48.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:48 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:48.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:48 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:48.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:48 smithi047 ceph-mon[28972]: from='osd.1 [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-07T12:19:48.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:48 smithi138 ceph-mon[35528]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:48.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:48 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:48.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:48 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:48.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:48 smithi138 ceph-mon[35528]: from='osd.1 [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-07T12:19:48.837 DEBUG:teuthology.orchestra.run.smithi047:osd.1> sudo journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.1.service 2024-02-07T12:19:48.840 INFO:tasks.cephadm:Deploying osd.2 on smithi047 with /dev/vg_nvme/lv_2... 2024-02-07T12:19:48.840 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-07T12:19:49.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:49 smithi047 ceph-mon[28972]: from='osd.1 [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-07T12:19:49.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:49 smithi047 ceph-mon[28972]: osdmap e12: 2 total, 1 up, 2 in 2024-02-07T12:19:49.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:49 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:19:49.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:49 smithi047 ceph-mon[28972]: from='osd.1 [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-02-07T12:19:49.326 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:19:49 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1[54865]: 2024-02-07T12:19:49.243+0000 7f4d2aec8700 -1 osd.1 0 waiting for initial osdmap 2024-02-07T12:19:49.326 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:19:49 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1[54865]: 2024-02-07T12:19:49.247+0000 7f4d224bc700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-07T12:19:49.505 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:19:49.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:49 smithi138 ceph-mon[35528]: from='osd.1 [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-07T12:19:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:49 smithi138 ceph-mon[35528]: osdmap e12: 2 total, 1 up, 2 in 2024-02-07T12:19:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:49 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:19:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:49 smithi138 ceph-mon[35528]: from='osd.1 [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-02-07T12:19:50.533 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:50 smithi047 ceph-mon[28972]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:50.533 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:50 smithi047 ceph-mon[28972]: from='osd.1 [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-02-07T12:19:50.534 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:50 smithi047 ceph-mon[28972]: osdmap e13: 2 total, 1 up, 2 in 2024-02-07T12:19:50.534 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:50 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:19:50.534 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:50 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:19:50.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:50 smithi138 ceph-mon[35528]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:50.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:50 smithi138 ceph-mon[35528]: from='osd.1 [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-02-07T12:19:50.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:50 smithi138 ceph-mon[35528]: osdmap e13: 2 total, 1 up, 2 in 2024-02-07T12:19:50.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:50 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:19:50.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:50 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:19:51.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:51 smithi047 ceph-mon[28972]: purged_snaps scrub starts 2024-02-07T12:19:51.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:51 smithi047 ceph-mon[28972]: purged_snaps scrub ok 2024-02-07T12:19:51.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:51 smithi047 ceph-mon[28972]: osd.1 [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846] boot 2024-02-07T12:19:51.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:51 smithi047 ceph-mon[28972]: osdmap e14: 2 total, 2 up, 2 in 2024-02-07T12:19:51.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:51 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:19:51.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:51 smithi138 ceph-mon[35528]: purged_snaps scrub starts 2024-02-07T12:19:51.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:51 smithi138 ceph-mon[35528]: purged_snaps scrub ok 2024-02-07T12:19:51.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:51 smithi138 ceph-mon[35528]: osd.1 [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846] boot 2024-02-07T12:19:51.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:51 smithi138 ceph-mon[35528]: osdmap e14: 2 total, 2 up, 2 in 2024-02-07T12:19:51.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:51 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:19:52.316 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-07T12:19:52.316 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-07T12:19:52.316 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-02-07T12:19:52.316 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-02-07T12:19:52.317 INFO:teuthology.orchestra.run.smithi047.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00848883 s, 1.2 GB/s 2024-02-07T12:19:52.317 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-02-07T12:19:52.398 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:52 smithi047 ceph-mon[28972]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:52.398 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:52 smithi047 ceph-mon[28972]: osdmap e15: 2 total, 2 up, 2 in 2024-02-07T12:19:52.398 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:52 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:52.398 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:52 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:52.398 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:52 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:19:52.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:52 smithi138 ceph-mon[35528]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-07T12:19:52.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:52 smithi138 ceph-mon[35528]: osdmap e15: 2 total, 2 up, 2 in 2024-02-07T12:19:52.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:52 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:52.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:52 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:52.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:52 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:19:53.278 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi047:vg_nvme/lv_2 2024-02-07T12:19:54.163 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:19:54.511 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:54 smithi047 ceph-mon[28972]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:19:54.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:54 smithi138 ceph-mon[35528]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:19:56.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.408+0000 7f0c70d24700 1 -- 172.21.15.47:0/2385195219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c6c102430 msgr2=0x7f0c6c104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:19:56.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.408+0000 7f0c70d24700 1 --2- 172.21.15.47:0/2385195219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c6c102430 0x7f0c6c104810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0c60004940 tx=0x7f0c60009e30 comp rx=0 tx=0).stop 2024-02-07T12:19:56.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.408+0000 7f0c70d24700 1 -- 172.21.15.47:0/2385195219 shutdown_connections 2024-02-07T12:19:56.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.408+0000 7f0c70d24700 1 --2- 172.21.15.47:0/2385195219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c6c102430 0x7f0c6c104810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:19:56.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.408+0000 7f0c70d24700 1 --2- 172.21.15.47:0/2385195219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c6c0663e0 0x7f0c6c101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:19:56.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.408+0000 7f0c70d24700 1 -- 172.21.15.47:0/2385195219 >> 172.21.15.47:0/2385195219 conn(0x7f0c6c0f74e0 msgr2=0x7f0c6c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:19:56.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.408+0000 7f0c70d24700 1 -- 172.21.15.47:0/2385195219 shutdown_connections 2024-02-07T12:19:56.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.408+0000 7f0c70d24700 1 -- 172.21.15.47:0/2385195219 wait complete. 2024-02-07T12:19:56.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.408+0000 7f0c70d24700 1 Processor -- start 2024-02-07T12:19:56.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.408+0000 7f0c70d24700 1 -- start start 2024-02-07T12:19:56.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c70d24700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c6c0663e0 0x7f0c6c10fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:19:56.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c70d24700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c6c102430 0x7f0c6c1100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:19:56.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c70d24700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c110750 con 0x7f0c6c102430 2024-02-07T12:19:56.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c70d24700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c110f90 con 0x7f0c6c0663e0 2024-02-07T12:19:56.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c69d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c6c102430 0x7f0c6c1100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:19:56.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c69d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c6c102430 0x7f0c6c1100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54302/0 (socket says 172.21.15.47:54302) 2024-02-07T12:19:56.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c69d9b700 1 -- 172.21.15.47:0/2946505039 learned_addr learned my addr 172.21.15.47:0/2946505039 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:19:56.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c6a59c700 1 --2- 172.21.15.47:0/2946505039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c6c0663e0 0x7f0c6c10fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:19:56.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c69d9b700 1 -- 172.21.15.47:0/2946505039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c6c0663e0 msgr2=0x7f0c6c10fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:19:56.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c69d9b700 1 --2- 172.21.15.47:0/2946505039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c6c0663e0 0x7f0c6c10fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:19:56.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c69d9b700 1 -- 172.21.15.47:0/2946505039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c60005040 con 0x7f0c6c102430 2024-02-07T12:19:56.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c6a59c700 1 --2- 172.21.15.47:0/2946505039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c6c0663e0 0x7f0c6c10fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:19:56.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c69d9b700 1 --2- 172.21.15.47:0/2946505039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c6c102430 0x7f0c6c1100c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000b3b0 tx=0x7f0c60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:19:56.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.409+0000 7f0c5affd700 1 -- 172.21.15.47:0/2946505039 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c6000e040 con 0x7f0c6c102430 2024-02-07T12:19:56.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.410+0000 7f0c5affd700 1 -- 172.21.15.47:0/2946505039 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c6000bcc0 con 0x7f0c6c102430 2024-02-07T12:19:56.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.410+0000 7f0c5affd700 1 -- 172.21.15.47:0/2946505039 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c6001c630 con 0x7f0c6c102430 2024-02-07T12:19:56.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.410+0000 7f0c70d24700 1 -- 172.21.15.47:0/2946505039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6c111210 con 0x7f0c6c102430 2024-02-07T12:19:56.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.410+0000 7f0c70d24700 1 -- 172.21.15.47:0/2946505039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6c111750 con 0x7f0c6c102430 2024-02-07T12:19:56.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.411+0000 7f0c70d24700 1 -- 172.21.15.47:0/2946505039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6c04bed0 con 0x7f0c6c102430 2024-02-07T12:19:56.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.411+0000 7f0c5affd700 1 -- 172.21.15.47:0/2946505039 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f0c600139f0 con 0x7f0c6c102430 2024-02-07T12:19:56.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.412+0000 7f0c5affd700 1 --2- 172.21.15.47:0/2946505039 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f0c54068ed0 0x7f0c5406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:19:56.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.412+0000 7f0c5affd700 1 -- 172.21.15.47:0/2946505039 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f0c60087430 con 0x7f0c6c102430 2024-02-07T12:19:56.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.412+0000 7f0c6a59c700 1 --2- 172.21.15.47:0/2946505039 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f0c54068ed0 0x7f0c5406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:19:56.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.412+0000 7f0c6a59c700 1 --2- 172.21.15.47:0/2946505039 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f0c54068ed0 0x7f0c5406b380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009b10 tx=0x7f0c5c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:19:56.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.417+0000 7f0c5affd700 1 -- 172.21.15.47:0/2946505039 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0c600581b0 con 0x7f0c6c102430 2024-02-07T12:19:56.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:56 smithi138 ceph-mon[35528]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:19:56.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:56 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:56.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:56 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:56.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:56 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:19:56.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:56 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:19:56.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:56 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:56.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:56 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:56.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:56 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:19:56.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:56 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:56.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:56 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:19:56.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:56 smithi047 ceph-mon[28972]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:19:56.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:56 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:56.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:56 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:56.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:56 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:19:56.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:56 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:19:56.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:56 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:56.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:56 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:56.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:56 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:19:56.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:56 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:19:56.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:56 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:19:56.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:19:56.627+0000 7f0c70d24700 1 -- 172.21.15.47:0/2946505039 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c6c111c20 con 0x7f0c54068ed0 2024-02-07T12:19:57.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:57 smithi138 ceph-mon[35528]: Detected new or changed devices on smithi047 2024-02-07T12:19:57.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:57 smithi138 ceph-mon[35528]: Adjusting osd_memory_target on smithi047 to 6434M 2024-02-07T12:19:57.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:57 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-07T12:19:57.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:57 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-07T12:19:57.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:57 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:57.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:57 smithi047 ceph-mon[28972]: Detected new or changed devices on smithi047 2024-02-07T12:19:57.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:57 smithi047 ceph-mon[28972]: Adjusting osd_memory_target on smithi047 to 6434M 2024-02-07T12:19:57.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:57 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-07T12:19:57.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:57 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-07T12:19:57.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:57 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:19:58.305 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:58 smithi047 ceph-mon[28972]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:19:58.305 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:58 smithi047 ceph-mon[28972]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:19:58.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:58 smithi138 ceph-mon[35528]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:19:58.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:58 smithi138 ceph-mon[35528]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:19:59.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:19:59 smithi138 ceph-mon[35528]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:19:59.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:19:59 smithi047 ceph-mon[28972]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:00.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:00 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2065699757' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8925cb3-0da0-4f01-90c3-1b6fb6e15331"}]: dispatch 2024-02-07T12:20:00.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:00 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2065699757' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8925cb3-0da0-4f01-90c3-1b6fb6e15331"}]': finished 2024-02-07T12:20:00.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:00 smithi138 ceph-mon[35528]: osdmap e16: 3 total, 2 up, 3 in 2024-02-07T12:20:00.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:00 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:20:00.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:00 smithi138 ceph-mon[35528]: overall HEALTH_OK 2024-02-07T12:20:00.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:00 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2065699757' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8925cb3-0da0-4f01-90c3-1b6fb6e15331"}]: dispatch 2024-02-07T12:20:00.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:00 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2065699757' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8925cb3-0da0-4f01-90c3-1b6fb6e15331"}]': finished 2024-02-07T12:20:00.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:00 smithi047 ceph-mon[28972]: osdmap e16: 3 total, 2 up, 3 in 2024-02-07T12:20:00.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:00 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:20:00.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:00 smithi047 ceph-mon[28972]: overall HEALTH_OK 2024-02-07T12:20:01.510 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:01 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1344664302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-07T12:20:01.510 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:01 smithi047 ceph-mon[28972]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:01.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:01 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/1344664302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-07T12:20:01.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:01 smithi138 ceph-mon[35528]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:03.196 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:02 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:03.196 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:02 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:03.196 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:02 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:03.196 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:02 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:20:03.196 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:02 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:03.317 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:02 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:03.318 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:02 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:03.318 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:02 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:03.318 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:02 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:20:03.318 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:02 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:03.931 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:03 smithi047 ceph-mon[28972]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:04.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:03 smithi138 ceph-mon[35528]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:06.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:06 smithi138 ceph-mon[35528]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:06.286 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:06 smithi047 ceph-mon[28972]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:07.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-07T12:20:07.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:07.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:20:07.289 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-07T12:20:07.289 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:07.289 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:20:08.277 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:08 smithi047 ceph-mon[28972]: Deploying daemon osd.2 on smithi047 2024-02-07T12:20:08.277 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:08 smithi047 ceph-mon[28972]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:08.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:08 smithi138 ceph-mon[35528]: Deploying daemon osd.2 on smithi047 2024-02-07T12:20:08.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:08 smithi138 ceph-mon[35528]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:10.052 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:10 smithi047 ceph-mon[28972]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:10.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:10 smithi138 ceph-mon[35528]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:12.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:12 smithi138 ceph-mon[35528]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:12 smithi047 ceph-mon[28972]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:13.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:13 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:13.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:13 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:13.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:13 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:20:13.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:13 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:13.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:13 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:13.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:13 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:20:14.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:14 smithi138 ceph-mon[35528]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:14.540 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:14 smithi047 ceph-mon[28972]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:15.946 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 2 on host 'smithi047' 2024-02-07T12:20:15.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:20:15.942+0000 7f0c5affd700 1 -- 172.21.15.47:0/2946505039 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0c6c111c20 con 0x7f0c54068ed0 2024-02-07T12:20:15.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:20:15.945+0000 7f0c70d24700 1 -- 172.21.15.47:0/2946505039 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f0c54068ed0 msgr2=0x7f0c5406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:20:15.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:20:15.945+0000 7f0c70d24700 1 --2- 172.21.15.47:0/2946505039 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f0c54068ed0 0x7f0c5406b380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009b10 tx=0x7f0c5c008040 comp rx=0 tx=0).stop 2024-02-07T12:20:15.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:20:15.945+0000 7f0c70d24700 1 -- 172.21.15.47:0/2946505039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c6c102430 msgr2=0x7f0c6c1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:20:15.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:20:15.945+0000 7f0c70d24700 1 --2- 172.21.15.47:0/2946505039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c6c102430 0x7f0c6c1100c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000b3b0 tx=0x7f0c60009e30 comp rx=0 tx=0).stop 2024-02-07T12:20:15.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:20:15.945+0000 7f0c70d24700 1 -- 172.21.15.47:0/2946505039 shutdown_connections 2024-02-07T12:20:15.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:20:15.945+0000 7f0c70d24700 1 --2- 172.21.15.47:0/2946505039 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f0c54068ed0 0x7f0c5406b380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:20:15.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:20:15.945+0000 7f0c70d24700 1 --2- 172.21.15.47:0/2946505039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c6c0663e0 0x7f0c6c10fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:20:15.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:20:15.945+0000 7f0c70d24700 1 --2- 172.21.15.47:0/2946505039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c6c102430 0x7f0c6c1100c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:20:15.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:20:15.945+0000 7f0c70d24700 1 -- 172.21.15.47:0/2946505039 >> 172.21.15.47:0/2946505039 conn(0x7f0c6c0f74e0 msgr2=0x7f0c6c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:20:15.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:20:15.945+0000 7f0c70d24700 1 -- 172.21.15.47:0/2946505039 shutdown_connections 2024-02-07T12:20:15.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:20:15.945+0000 7f0c70d24700 1 -- 172.21.15.47:0/2946505039 wait complete. 2024-02-07T12:20:16.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:16 smithi138 ceph-mon[35528]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:16.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:16 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:16.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:16 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:16.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:16 smithi138 ceph-mon[35528]: from='osd.2 [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-07T12:20:16.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:16 smithi047 ceph-mon[28972]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:16.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:16 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:16.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:16 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:16.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:16 smithi047 ceph-mon[28972]: from='osd.2 [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-07T12:20:17.492 DEBUG:teuthology.orchestra.run.smithi047:osd.2> sudo journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.2.service 2024-02-07T12:20:17.494 INFO:tasks.cephadm:Deploying osd.3 on smithi138 with /dev/vg_nvme/lv_4... 2024-02-07T12:20:17.495 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-07T12:20:17.752 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi138/config 2024-02-07T12:20:18.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:17 smithi047 ceph-mon[28972]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:18.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:17 smithi047 ceph-mon[28972]: from='osd.2 [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-07T12:20:18.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:17 smithi047 ceph-mon[28972]: osdmap e17: 3 total, 2 up, 3 in 2024-02-07T12:20:18.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:17 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:20:18.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:17 smithi047 ceph-mon[28972]: from='osd.2 [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-02-07T12:20:18.076 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:20:17 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2[62214]: 2024-02-07T12:20:17.937+0000 7fa273600700 -1 osd.2 0 waiting for initial osdmap 2024-02-07T12:20:18.076 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:20:17 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2[62214]: 2024-02-07T12:20:17.942+0000 7fa26fbfe700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-07T12:20:18.167 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:17 smithi138 ceph-mon[35528]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:18.167 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:17 smithi138 ceph-mon[35528]: from='osd.2 [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-07T12:20:18.167 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:17 smithi138 ceph-mon[35528]: osdmap e17: 3 total, 2 up, 3 in 2024-02-07T12:20:18.167 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:17 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:20:18.167 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:17 smithi138 ceph-mon[35528]: from='osd.2 [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-02-07T12:20:19.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:18 smithi138 ceph-mon[35528]: from='osd.2 [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-02-07T12:20:19.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:18 smithi138 ceph-mon[35528]: osdmap e18: 3 total, 2 up, 3 in 2024-02-07T12:20:19.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:18 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:20:19.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:18 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:20:19.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:18 smithi047 ceph-mon[28972]: from='osd.2 [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-02-07T12:20:19.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:18 smithi047 ceph-mon[28972]: osdmap e18: 3 total, 2 up, 3 in 2024-02-07T12:20:19.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:18 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:20:19.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:18 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:20:19.639 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-07T12:20:19.640 INFO:teuthology.orchestra.run.smithi138.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-07T12:20:19.640 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10+0 records in 2024-02-07T12:20:19.640 INFO:teuthology.orchestra.run.smithi138.stderr:10+0 records out 2024-02-07T12:20:19.640 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111969 s, 936 MB/s 2024-02-07T12:20:19.640 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping successful for: 2024-02-07T12:20:20.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:19 smithi047 ceph-mon[28972]: purged_snaps scrub starts 2024-02-07T12:20:20.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:19 smithi047 ceph-mon[28972]: purged_snaps scrub ok 2024-02-07T12:20:20.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:19 smithi047 ceph-mon[28972]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:20.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:19 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:20:20.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:19 smithi047 ceph-mon[28972]: osd.2 [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024] boot 2024-02-07T12:20:20.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:19 smithi047 ceph-mon[28972]: osdmap e19: 3 total, 3 up, 3 in 2024-02-07T12:20:20.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:19 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:20:20.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:19 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:20.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:19 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:20.220 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:19 smithi138 ceph-mon[35528]: purged_snaps scrub starts 2024-02-07T12:20:20.256 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:19 smithi138 ceph-mon[35528]: purged_snaps scrub ok 2024-02-07T12:20:20.256 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:19 smithi138 ceph-mon[35528]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-07T12:20:20.256 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:19 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:20:20.256 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:19 smithi138 ceph-mon[35528]: osd.2 [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024] boot 2024-02-07T12:20:20.256 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:19 smithi138 ceph-mon[35528]: osdmap e19: 3 total, 3 up, 3 in 2024-02-07T12:20:20.256 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:19 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:20:20.256 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:19 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:20.256 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:19 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:20.258 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi138:vg_nvme/lv_4 2024-02-07T12:20:20.503 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi138/config 2024-02-07T12:20:21.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:21 smithi138 ceph-mon[35528]: osdmap e20: 3 total, 3 up, 3 in 2024-02-07T12:20:21.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:21 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-07T12:20:21.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:21 smithi047 ceph-mon[28972]: osdmap e20: 3 total, 3 up, 3 in 2024-02-07T12:20:21.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:21 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-07T12:20:21.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.958+0000 7f7ec1551700 1 -- 172.21.15.138:0/1122186285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ebc0fcfb0 msgr2=0x7f7ebc0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.958+0000 7f7ec1551700 1 --2- 172.21.15.138:0/1122186285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ebc0fcfb0 0x7f7ebc0fd420 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0004940 tx=0x7f7eb0009e30 comp rx=0 tx=0).stop 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.958+0000 7f7ec1551700 1 -- 172.21.15.138:0/1122186285 shutdown_connections 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.958+0000 7f7ec1551700 1 --2- 172.21.15.138:0/1122186285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ebc0fcfb0 0x7f7ebc0fd420 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.958+0000 7f7ec1551700 1 --2- 172.21.15.138:0/1122186285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ebc0fbe40 0x7f7ebc0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.958+0000 7f7ec1551700 1 -- 172.21.15.138:0/1122186285 >> 172.21.15.138:0/1122186285 conn(0x7f7ebc0f7520 msgr2=0x7f7ebc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.958+0000 7f7ec1551700 1 -- 172.21.15.138:0/1122186285 shutdown_connections 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.958+0000 7f7ec1551700 1 -- 172.21.15.138:0/1122186285 wait complete. 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.959+0000 7f7ec1551700 1 Processor -- start 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.959+0000 7f7ec1551700 1 -- start start 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.959+0000 7f7ec1551700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ebc0fbe40 0x7f7ebc1105d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.959+0000 7f7ec1551700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ebc0fcfb0 0x7f7ebc112b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.959+0000 7f7ec1551700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc066d10 con 0x7f7ebc0fcfb0 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.959+0000 7f7ec1551700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc066e50 con 0x7f7ebc0fbe40 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.959+0000 7f7ebaffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ebc0fbe40 0x7f7ebc1105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:20:21.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.959+0000 7f7ebaffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ebc0fbe40 0x7f7ebc1105d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57944/0 (socket says 172.21.15.138:57944) 2024-02-07T12:20:21.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.959+0000 7f7ebaffd700 1 -- 172.21.15.138:0/2700329705 learned_addr learned my addr 172.21.15.138:0/2700329705 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:20:21.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.959+0000 7f7eba7fc700 1 --2- 172.21.15.138:0/2700329705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ebc0fcfb0 0x7f7ebc112b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:20:21.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.960+0000 7f7ebaffd700 1 -- 172.21.15.138:0/2700329705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ebc0fcfb0 msgr2=0x7f7ebc112b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:20:21.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.960+0000 7f7ebaffd700 1 --2- 172.21.15.138:0/2700329705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ebc0fcfb0 0x7f7ebc112b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:20:21.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.960+0000 7f7ebaffd700 1 -- 172.21.15.138:0/2700329705 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0005040 con 0x7f7ebc0fbe40 2024-02-07T12:20:21.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.960+0000 7f7ebaffd700 1 --2- 172.21.15.138:0/2700329705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ebc0fbe40 0x7f7ebc1105d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00eb40 tx=0x7f7eac00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:20:21.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.960+0000 7f7ea37fe700 1 -- 172.21.15.138:0/2700329705 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eac007cc0 con 0x7f7ebc0fbe40 2024-02-07T12:20:21.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.960+0000 7f7ea37fe700 1 -- 172.21.15.138:0/2700329705 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7eac00f040 con 0x7f7ebc0fbe40 2024-02-07T12:20:21.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.960+0000 7f7ea37fe700 1 -- 172.21.15.138:0/2700329705 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eac00ca10 con 0x7f7ebc0fbe40 2024-02-07T12:20:21.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.960+0000 7f7ec1551700 1 -- 172.21.15.138:0/2700329705 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ebc113120 con 0x7f7ebc0fbe40 2024-02-07T12:20:21.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.960+0000 7f7ec1551700 1 -- 172.21.15.138:0/2700329705 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ebc113610 con 0x7f7ebc0fbe40 2024-02-07T12:20:21.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.961+0000 7f7ec1551700 1 -- 172.21.15.138:0/2700329705 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ebc04bed0 con 0x7f7ebc0fbe40 2024-02-07T12:20:21.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.961+0000 7f7ea37fe700 1 -- 172.21.15.138:0/2700329705 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f7eac00cb70 con 0x7f7ebc0fbe40 2024-02-07T12:20:21.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.962+0000 7f7ea37fe700 1 --2- 172.21.15.138:0/2700329705 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7ea4068ed0 0x7f7ea406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:20:21.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.962+0000 7f7ea37fe700 1 -- 172.21.15.138:0/2700329705 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3217+0+0 (secure 0 0 0) 0x7f7eac085f20 con 0x7f7ebc0fbe40 2024-02-07T12:20:21.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.962+0000 7f7eba7fc700 1 --2- 172.21.15.138:0/2700329705 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7ea4068ed0 0x7f7ea406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:20:21.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.962+0000 7f7eba7fc700 1 --2- 172.21.15.138:0/2700329705 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7ea4068ed0 0x7f7ea406b380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009b30 tx=0x7f7eb0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:20:21.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:21.966+0000 7f7ea37fe700 1 -- 172.21.15.138:0/2700329705 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7eac04da00 con 0x7f7ebc0fbe40 2024-02-07T12:20:22.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:22.156+0000 7f7ec1551700 1 -- 172.21.15.138:0/2700329705 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ebc101990 con 0x7f7ea4068ed0 2024-02-07T12:20:22.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: pgmap v75: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:22.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-07T12:20:22.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: osdmap e21: 3 total, 3 up, 3 in 2024-02-07T12:20:22.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-07T12:20:22.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:20:22.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-07T12:20:22.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-07T12:20:22.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:22.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:22.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:22.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:20:22.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:20:22.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:20:22.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:22.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:22.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:20:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: pgmap v75: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-07T12:20:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: osdmap e21: 3 total, 3 up, 3 in 2024-02-07T12:20:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-07T12:20:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:20:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-07T12:20:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-07T12:20:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:20:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:20:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:20:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:20:23.511 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:23 smithi138 ceph-mon[35528]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:20:23.511 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:23 smithi138 ceph-mon[35528]: Detected new or changed devices on smithi047 2024-02-07T12:20:23.511 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:23 smithi138 ceph-mon[35528]: Adjusting osd_memory_target on smithi047 to 4289M 2024-02-07T12:20:23.511 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:23 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:23.511 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:23 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-07T12:20:23.512 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:23 smithi138 ceph-mon[35528]: osdmap e22: 3 total, 3 up, 3 in 2024-02-07T12:20:23.512 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:23 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:20:23.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:23 smithi047 ceph-mon[28972]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:20:23.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:23 smithi047 ceph-mon[28972]: Detected new or changed devices on smithi047 2024-02-07T12:20:23.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:23 smithi047 ceph-mon[28972]: Adjusting osd_memory_target on smithi047 to 4289M 2024-02-07T12:20:23.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:23 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:23.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:23 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-07T12:20:23.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:23 smithi047 ceph-mon[28972]: osdmap e22: 3 total, 3 up, 3 in 2024-02-07T12:20:23.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:23 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:20:23.576 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:20:23 smithi047 sudo[66568]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-07T12:20:23.576 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:20:23 smithi047 sudo[66568]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-07T12:20:23.576 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:20:23 smithi047 sudo[66568]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-07T12:20:23.576 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:20:23 smithi047 sudo[66568]: pam_unix(sudo:session): session closed for user root 2024-02-07T12:20:23.941 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:20:23 smithi047 sudo[66624]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-07T12:20:23.941 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:20:23 smithi047 sudo[66624]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-07T12:20:23.941 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:20:23 smithi047 sudo[66624]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-07T12:20:23.941 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:20:23 smithi047 sudo[66624]: pam_unix(sudo:session): session closed for user root 2024-02-07T12:20:24.210 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:20:23 smithi047 sudo[66650]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-07T12:20:24.210 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:20:23 smithi047 sudo[66650]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-07T12:20:24.210 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:20:23 smithi047 sudo[66650]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-07T12:20:24.210 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:20:23 smithi047 sudo[66650]: pam_unix(sudo:session): session closed for user root 2024-02-07T12:20:24.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:24.257+0000 7f7ea37fe700 1 -- 172.21.15.138:0/2700329705 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7eac053210 con 0x7f7ebc0fbe40 2024-02-07T12:20:24.472 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:24 smithi047 ceph-mon[28972]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:24.472 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:24 smithi047 ceph-mon[28972]: osdmap e23: 3 total, 3 up, 3 in 2024-02-07T12:20:24.472 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:24 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:24.472 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:20:24 smithi047 sudo[66664]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-07T12:20:24.473 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:20:24 smithi047 sudo[66664]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-07T12:20:24.473 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:20:24 smithi047 sudo[66664]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-07T12:20:24.473 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:20:24 smithi047 sudo[66664]: pam_unix(sudo:session): session closed for user root 2024-02-07T12:20:24.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:24 smithi138 ceph-mon[35528]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:24.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:24 smithi138 ceph-mon[35528]: osdmap e23: 3 total, 3 up, 3 in 2024-02-07T12:20:24.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:24 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:24.743 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:20:24 smithi047 sudo[66702]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-07T12:20:24.743 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:20:24 smithi047 sudo[66702]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-07T12:20:24.744 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:20:24 smithi047 sudo[66702]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-07T12:20:24.744 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:20:24 smithi047 sudo[66702]: pam_unix(sudo:session): session closed for user root 2024-02-07T12:20:25.005 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:20:24 smithi047 sudo[66732]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-07T12:20:25.005 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:20:24 smithi047 sudo[66732]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-07T12:20:25.006 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:20:24 smithi047 sudo[66732]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-07T12:20:25.006 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:20:24 smithi047 sudo[66732]: pam_unix(sudo:session): session closed for user root 2024-02-07T12:20:25.274 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 sudo[66781]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-07T12:20:25.274 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 sudo[66781]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-07T12:20:25.275 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 sudo[66781]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-07T12:20:25.275 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 sudo[66781]: pam_unix(sudo:session): session closed for user root 2024-02-07T12:20:25.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 sudo[66802]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-07T12:20:25.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 sudo[66802]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-07T12:20:25.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 sudo[66802]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-07T12:20:25.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 sudo[66802]: pam_unix(sudo:session): session closed for user root 2024-02-07T12:20:25.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 ceph-mon[28972]: mgrmap e19: smithi047.zhgnrm(active, since 2m), standbys: smithi138.fiugmj 2024-02-07T12:20:25.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/820838127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47130a0a-e27f-4129-abbb-4bef9b460ebe"}]: dispatch 2024-02-07T12:20:25.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 ceph-mon[28972]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47130a0a-e27f-4129-abbb-4bef9b460ebe"}]: dispatch 2024-02-07T12:20:25.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 ceph-mon[28972]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47130a0a-e27f-4129-abbb-4bef9b460ebe"}]': finished 2024-02-07T12:20:25.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 ceph-mon[28972]: osdmap e24: 4 total, 3 up, 4 in 2024-02-07T12:20:25.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:20:25.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:25 smithi047 ceph-mon[28972]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-07T12:20:25.844 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 sudo[39050]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-07T12:20:25.844 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 sudo[39050]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-07T12:20:25.844 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 sudo[39050]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-07T12:20:25.844 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 sudo[39050]: pam_unix(sudo:session): session closed for user root 2024-02-07T12:20:26.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 sudo[39075]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-07T12:20:26.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 sudo[39075]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-07T12:20:26.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 sudo[39075]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-07T12:20:26.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 sudo[39075]: pam_unix(sudo:session): session closed for user root 2024-02-07T12:20:26.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 ceph-mon[35528]: mgrmap e19: smithi047.zhgnrm(active, since 2m), standbys: smithi138.fiugmj 2024-02-07T12:20:26.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 ceph-mon[35528]: from='client.? 172.21.15.138:0/820838127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47130a0a-e27f-4129-abbb-4bef9b460ebe"}]: dispatch 2024-02-07T12:20:26.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 ceph-mon[35528]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47130a0a-e27f-4129-abbb-4bef9b460ebe"}]: dispatch 2024-02-07T12:20:26.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 ceph-mon[35528]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47130a0a-e27f-4129-abbb-4bef9b460ebe"}]': finished 2024-02-07T12:20:26.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 ceph-mon[35528]: osdmap e24: 4 total, 3 up, 4 in 2024-02-07T12:20:26.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:20:26.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:25 smithi138 ceph-mon[35528]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-07T12:20:26.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:26 smithi138 ceph-mon[35528]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:26.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:26 smithi138 ceph-mon[35528]: from='client.? 172.21.15.138:0/4198043251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-07T12:20:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:26 smithi138 ceph-mon[35528]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-07T12:20:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:26 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:20:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:26 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:20:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:26 smithi138 ceph-mon[35528]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-07T12:20:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:26 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:20:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:26 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:20:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:26 smithi138 ceph-mon[35528]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-07T12:20:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:26 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:26.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:26 smithi047 ceph-mon[28972]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:26.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:26 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/4198043251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-07T12:20:26.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:26 smithi047 ceph-mon[28972]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-07T12:20:26.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:26 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:20:26.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:26 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:20:26.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:26 smithi047 ceph-mon[28972]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-07T12:20:26.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:26 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:20:26.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:26 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:20:26.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:26 smithi047 ceph-mon[28972]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-07T12:20:26.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:26 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:27 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:27 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:27 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:27 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:20:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:27 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:27 smithi138 ceph-mon[35528]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:27.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:27.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:27.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:27.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:20:27.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:27.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:27 smithi047 ceph-mon[28972]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:30.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:29 smithi138 ceph-mon[35528]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:30.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:29 smithi047 ceph-mon[28972]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:31.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:31 smithi138 ceph-mon[35528]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:31 smithi047 ceph-mon[28972]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:32.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:32 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-07T12:20:32.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:32 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:32.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:32 smithi138 ceph-mon[35528]: Deploying daemon osd.3 on smithi138 2024-02-07T12:20:32.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:32 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-07T12:20:32.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:32 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:32.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:32 smithi047 ceph-mon[28972]: Deploying daemon osd.3 on smithi138 2024-02-07T12:20:33.463 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:33 smithi138 ceph-mon[35528]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:33.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:33 smithi047 ceph-mon[28972]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:36.220 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:35 smithi138 ceph-mon[35528]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:36.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:35 smithi047 ceph-mon[28972]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:37 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:37 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:37 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:20:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:37 smithi138 ceph-mon[35528]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:37 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:20:37.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:37 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:37.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:37 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:37.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:37 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:20:37.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:37 smithi047 ceph-mon[28972]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:37.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:37 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:20:39.873 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 3 on host 'smithi138' 2024-02-07T12:20:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:39.870+0000 7f7ea37fe700 1 -- 172.21.15.138:0/2700329705 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7ebc101990 con 0x7f7ea4068ed0 2024-02-07T12:20:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:39.872+0000 7f7ec1551700 1 -- 172.21.15.138:0/2700329705 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7ea4068ed0 msgr2=0x7f7ea406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:20:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:39.872+0000 7f7ec1551700 1 --2- 172.21.15.138:0/2700329705 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7ea4068ed0 0x7f7ea406b380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009b30 tx=0x7f7eb0009e30 comp rx=0 tx=0).stop 2024-02-07T12:20:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:39.872+0000 7f7ec1551700 1 -- 172.21.15.138:0/2700329705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ebc0fbe40 msgr2=0x7f7ebc1105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:20:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:39.872+0000 7f7ec1551700 1 --2- 172.21.15.138:0/2700329705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ebc0fbe40 0x7f7ebc1105d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00eb40 tx=0x7f7eac00b040 comp rx=0 tx=0).stop 2024-02-07T12:20:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:39.872+0000 7f7ec1551700 1 -- 172.21.15.138:0/2700329705 shutdown_connections 2024-02-07T12:20:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:39.872+0000 7f7ec1551700 1 --2- 172.21.15.138:0/2700329705 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7ea4068ed0 0x7f7ea406b380 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:20:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:39.872+0000 7f7ec1551700 1 --2- 172.21.15.138:0/2700329705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ebc0fbe40 0x7f7ebc1105d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:20:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:39.872+0000 7f7ec1551700 1 --2- 172.21.15.138:0/2700329705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ebc0fcfb0 0x7f7ebc112b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:20:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:39.872+0000 7f7ec1551700 1 -- 172.21.15.138:0/2700329705 >> 172.21.15.138:0/2700329705 conn(0x7f7ebc0f7520 msgr2=0x7f7ebc100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:20:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:39.873+0000 7f7ec1551700 1 -- 172.21.15.138:0/2700329705 shutdown_connections 2024-02-07T12:20:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:39.873+0000 7f7ec1551700 1 -- 172.21.15.138:0/2700329705 wait complete. 2024-02-07T12:20:40.146 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:39 smithi138 ceph-mon[35528]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:40.146 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:40.146 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:39 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:40.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:39 smithi047 ceph-mon[28972]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:40.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:40.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:39 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:40.681 DEBUG:teuthology.orchestra.run.smithi138:osd.3> sudo journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.3.service 2024-02-07T12:20:40.684 INFO:tasks.cephadm:Deploying osd.4 on smithi138 with /dev/vg_nvme/lv_3... 2024-02-07T12:20:40.684 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-07T12:20:40.984 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi138/config 2024-02-07T12:20:41.378 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:41 smithi138 ceph-mon[35528]: from='osd.3 [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-07T12:20:41.378 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:41 smithi138 ceph-mon[35528]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-07T12:20:41.379 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:41 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:41.379 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:41 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:41.379 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:41 smithi138 ceph-mon[35528]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:41.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:41 smithi047 ceph-mon[28972]: from='osd.3 [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-07T12:20:41.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:41 smithi047 ceph-mon[28972]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-07T12:20:41.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:41 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:41.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:41 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:41.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:41 smithi047 ceph-mon[28972]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:42.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:42 smithi138 ceph-mon[35528]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-07T12:20:42.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:42 smithi138 ceph-mon[35528]: osdmap e25: 4 total, 3 up, 4 in 2024-02-07T12:20:42.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:42 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:20:42.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:42 smithi138 ceph-mon[35528]: from='osd.3 [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:20:42.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:42 smithi138 ceph-mon[35528]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:20:42.535 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:20:42 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[41088]: 2024-02-07T12:20:42.295+0000 7fd1318d9700 -1 osd.3 0 waiting for initial osdmap 2024-02-07T12:20:42.535 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:20:42 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[41088]: 2024-02-07T12:20:42.300+0000 7fd12bed3700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-07T12:20:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:42 smithi047 ceph-mon[28972]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-07T12:20:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:42 smithi047 ceph-mon[28972]: osdmap e25: 4 total, 3 up, 4 in 2024-02-07T12:20:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:42 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:20:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:42 smithi047 ceph-mon[28972]: from='osd.3 [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:20:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:42 smithi047 ceph-mon[28972]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:20:43.070 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-07T12:20:43.070 INFO:teuthology.orchestra.run.smithi138.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-07T12:20:43.070 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10+0 records in 2024-02-07T12:20:43.070 INFO:teuthology.orchestra.run.smithi138.stderr:10+0 records out 2024-02-07T12:20:43.070 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125095 s, 838 MB/s 2024-02-07T12:20:43.071 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping successful for: 2024-02-07T12:20:43.372 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:43 smithi138 ceph-mon[35528]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-07T12:20:43.372 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:43 smithi138 ceph-mon[35528]: osdmap e26: 4 total, 3 up, 4 in 2024-02-07T12:20:43.372 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:43 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:20:43.372 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:43 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:20:43.373 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:43 smithi138 ceph-mon[35528]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:43.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:43 smithi047 ceph-mon[28972]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-07T12:20:43.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:43 smithi047 ceph-mon[28972]: osdmap e26: 4 total, 3 up, 4 in 2024-02-07T12:20:43.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:43 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:20:43.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:43 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:20:43.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:43 smithi047 ceph-mon[28972]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-02-07T12:20:43.770 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi138:vg_nvme/lv_3 2024-02-07T12:20:44.374 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:44 smithi138 ceph-mon[35528]: purged_snaps scrub starts 2024-02-07T12:20:44.374 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:44 smithi138 ceph-mon[35528]: purged_snaps scrub ok 2024-02-07T12:20:44.374 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:44 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:20:44.374 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:44 smithi138 ceph-mon[35528]: osd.3 [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764] boot 2024-02-07T12:20:44.374 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:44 smithi138 ceph-mon[35528]: osdmap e27: 4 total, 4 up, 4 in 2024-02-07T12:20:44.374 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:44 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:20:44.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:44 smithi047 ceph-mon[28972]: purged_snaps scrub starts 2024-02-07T12:20:44.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:44 smithi047 ceph-mon[28972]: purged_snaps scrub ok 2024-02-07T12:20:44.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:44 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:20:44.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:44 smithi047 ceph-mon[28972]: osd.3 [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764] boot 2024-02-07T12:20:44.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:44 smithi047 ceph-mon[28972]: osdmap e27: 4 total, 4 up, 4 in 2024-02-07T12:20:44.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:44 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:20:44.657 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi138/config 2024-02-07T12:20:45.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:45 smithi047 ceph-mon[28972]: osdmap e28: 4 total, 4 up, 4 in 2024-02-07T12:20:45.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:45 smithi047 ceph-mon[28972]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:20:45.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:45 smithi138 ceph-mon[35528]: osdmap e28: 4 total, 4 up, 4 in 2024-02-07T12:20:45.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:45 smithi138 ceph-mon[35528]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:20:46.526 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: osdmap e29: 4 total, 4 up, 4 in 2024-02-07T12:20:46.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: Detected new or changed devices on smithi138 2024-02-07T12:20:46.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:46.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:46.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:20:46.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: Adjusting osd_memory_target on smithi138 to 15936M 2024-02-07T12:20:46.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:46.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:46.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:20:46.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:46.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:20:46.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:46.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:20:46.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:46 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:46.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: osdmap e29: 4 total, 4 up, 4 in 2024-02-07T12:20:46.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: Detected new or changed devices on smithi138 2024-02-07T12:20:46.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:46.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:46.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:20:46.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: Adjusting osd_memory_target on smithi138 to 15936M 2024-02-07T12:20:46.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:46.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:46.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:20:46.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:46.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:20:46.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:46.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:20:46.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:46 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:20:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.713+0000 7f03e0ed1700 1 -- 172.21.15.138:0/1495634073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03dc0fe0e0 msgr2=0x7f03dc0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:20:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.713+0000 7f03e0ed1700 1 --2- 172.21.15.138:0/1495634073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03dc0fe0e0 0x7f03dc0fe550 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f03d0004970 tx=0x7f03d0009e30 comp rx=0 tx=0).stop 2024-02-07T12:20:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.713+0000 7f03e0ed1700 1 -- 172.21.15.138:0/1495634073 shutdown_connections 2024-02-07T12:20:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.713+0000 7f03e0ed1700 1 --2- 172.21.15.138:0/1495634073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03dc0fe0e0 0x7f03dc0fe550 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:20:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.713+0000 7f03e0ed1700 1 --2- 172.21.15.138:0/1495634073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03dc0fcef0 0x7f03dc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:20:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.713+0000 7f03e0ed1700 1 -- 172.21.15.138:0/1495634073 >> 172.21.15.138:0/1495634073 conn(0x7f03dc0f8620 msgr2=0x7f03dc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:20:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.713+0000 7f03e0ed1700 1 -- 172.21.15.138:0/1495634073 shutdown_connections 2024-02-07T12:20:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.713+0000 7f03e0ed1700 1 -- 172.21.15.138:0/1495634073 wait complete. 2024-02-07T12:20:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.713+0000 7f03e0ed1700 1 Processor -- start 2024-02-07T12:20:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.713+0000 7f03e0ed1700 1 -- start start 2024-02-07T12:20:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03e0ed1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03dc0fcef0 0x7f03dc10d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:20:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03e0ed1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03dc0fe0e0 0x7f03dc10de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:20:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03e0ed1700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc10e430 con 0x7f03dc0fcef0 2024-02-07T12:20:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03e0ed1700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc10ecd0 con 0x7f03dc0fe0e0 2024-02-07T12:20:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03d9d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03dc0fe0e0 0x7f03dc10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:20:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03d9d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03dc0fe0e0 0x7f03dc10de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:43594/0 (socket says 172.21.15.138:43594) 2024-02-07T12:20:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03d9d9b700 1 -- 172.21.15.138:0/78512736 learned_addr learned my addr 172.21.15.138:0/78512736 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:20:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03da59c700 1 --2- 172.21.15.138:0/78512736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03dc0fcef0 0x7f03dc10d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:20:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03d9d9b700 1 -- 172.21.15.138:0/78512736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03dc0fcef0 msgr2=0x7f03dc10d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:20:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03d9d9b700 1 --2- 172.21.15.138:0/78512736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03dc0fcef0 0x7f03dc10d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:20:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03d9d9b700 1 -- 172.21.15.138:0/78512736 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d0005040 con 0x7f03dc0fe0e0 2024-02-07T12:20:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03d9d9b700 1 --2- 172.21.15.138:0/78512736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03dc0fe0e0 0x7f03dc10de30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f03d0004890 tx=0x7f03d0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:20:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03caffd700 1 -- 172.21.15.138:0/78512736 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d000e040 con 0x7f03dc0fe0e0 2024-02-07T12:20:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03caffd700 1 -- 172.21.15.138:0/78512736 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03d0009af0 con 0x7f03dc0fe0e0 2024-02-07T12:20:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03e0ed1700 1 -- 172.21.15.138:0/78512736 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc10ef50 con 0x7f03dc0fe0e0 2024-02-07T12:20:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03caffd700 1 -- 172.21.15.138:0/78512736 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d0013ea0 con 0x7f03dc0fe0e0 2024-02-07T12:20:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.714+0000 7f03e0ed1700 1 -- 172.21.15.138:0/78512736 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc10f490 con 0x7f03dc0fe0e0 2024-02-07T12:20:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.715+0000 7f03e0ed1700 1 -- 172.21.15.138:0/78512736 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc04bed0 con 0x7f03dc0fe0e0 2024-02-07T12:20:46.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.716+0000 7f03caffd700 1 -- 172.21.15.138:0/78512736 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f03d0013420 con 0x7f03dc0fe0e0 2024-02-07T12:20:46.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.716+0000 7f03caffd700 1 --2- 172.21.15.138:0/78512736 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f03c4068f60 0x7f03c406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:20:46.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.716+0000 7f03caffd700 1 -- 172.21.15.138:0/78512736 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f03d0087a90 con 0x7f03dc0fe0e0 2024-02-07T12:20:46.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.716+0000 7f03da59c700 1 --2- 172.21.15.138:0/78512736 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f03c4068f60 0x7f03c406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:20:46.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.717+0000 7f03da59c700 1 --2- 172.21.15.138:0/78512736 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f03c4068f60 0x7f03c406b410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0fcc30 tx=0x7f03d400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:20:46.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.721+0000 7f03caffd700 1 -- 172.21.15.138:0/78512736 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f03d0058090 con 0x7f03dc0fe0e0 2024-02-07T12:20:46.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:20:46.909+0000 7f03e0ed1700 1 -- 172.21.15.138:0/78512736 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f03dc10f920 con 0x7f03c4068f60 2024-02-07T12:20:47.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:47 smithi047 ceph-mon[28972]: osdmap e30: 4 total, 4 up, 4 in 2024-02-07T12:20:47.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:47 smithi047 ceph-mon[28972]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-07T12:20:47.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:47 smithi047 ceph-mon[28972]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:20:47.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:47 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-07T12:20:47.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:47 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-07T12:20:47.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:47 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:47.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:47 smithi138 ceph-mon[35528]: osdmap e30: 4 total, 4 up, 4 in 2024-02-07T12:20:47.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:47 smithi138 ceph-mon[35528]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-07T12:20:47.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:47 smithi138 ceph-mon[35528]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:20:47.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:47 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-07T12:20:47.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:47 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-07T12:20:47.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:47 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:48.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:48 smithi138 ceph-mon[35528]: osdmap e31: 4 total, 4 up, 4 in 2024-02-07T12:20:48.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:48 smithi047 ceph-mon[28972]: osdmap e31: 4 total, 4 up, 4 in 2024-02-07T12:20:49.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:49 smithi047 ceph-mon[28972]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-02-07T12:20:49.743 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:49 smithi138 ceph-mon[35528]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-02-07T12:20:50.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:50 smithi138 ceph-mon[35528]: from='client.? 172.21.15.138:0/3469122919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "103459b7-4883-4248-a64d-21c396324237"}]: dispatch 2024-02-07T12:20:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:50 smithi138 ceph-mon[35528]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "103459b7-4883-4248-a64d-21c396324237"}]: dispatch 2024-02-07T12:20:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:50 smithi138 ceph-mon[35528]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "103459b7-4883-4248-a64d-21c396324237"}]': finished 2024-02-07T12:20:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:50 smithi138 ceph-mon[35528]: osdmap e32: 5 total, 4 up, 5 in 2024-02-07T12:20:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:50 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:20:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:50 smithi138 ceph-mon[35528]: from='client.? 172.21.15.138:0/3441659336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-07T12:20:50.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:50 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/3469122919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "103459b7-4883-4248-a64d-21c396324237"}]: dispatch 2024-02-07T12:20:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:50 smithi047 ceph-mon[28972]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "103459b7-4883-4248-a64d-21c396324237"}]: dispatch 2024-02-07T12:20:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:50 smithi047 ceph-mon[28972]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "103459b7-4883-4248-a64d-21c396324237"}]': finished 2024-02-07T12:20:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:50 smithi047 ceph-mon[28972]: osdmap e32: 5 total, 4 up, 5 in 2024-02-07T12:20:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:50 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:20:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:50 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/3441659336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-07T12:20:51.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:51 smithi138 ceph-mon[35528]: pgmap v102: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-02-07T12:20:51.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:51 smithi047 ceph-mon[28972]: pgmap v102: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-02-07T12:20:52.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:52 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:20:52.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:52 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:20:53.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:53 smithi138 ceph-mon[35528]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:20:53.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:53 smithi047 ceph-mon[28972]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:20:56.216 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:55 smithi047 ceph-mon[28972]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:20:56.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:55 smithi138 ceph-mon[35528]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:20:57.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:56 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-07T12:20:57.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:56 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:57.165 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:56 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-07T12:20:57.165 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:56 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:20:58.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:57 smithi138 ceph-mon[35528]: Deploying daemon osd.4 on smithi138 2024-02-07T12:20:58.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:57 smithi138 ceph-mon[35528]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:20:58.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:57 smithi047 ceph-mon[28972]: Deploying daemon osd.4 on smithi138 2024-02-07T12:20:58.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:57 smithi047 ceph-mon[28972]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:21:00.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:20:59 smithi138 ceph-mon[35528]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:21:00.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:20:59 smithi047 ceph-mon[28972]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:21:01.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:01 smithi047 ceph-mon[28972]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:21:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:01 smithi138 ceph-mon[35528]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:21:02.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:02 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:02.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:02 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:02.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:02 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:21:02.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:02 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:02.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:02 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:02.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:02 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:21:03.719 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:03 smithi138 ceph-mon[35528]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:21:03.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:03 smithi047 ceph-mon[28972]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:21:05.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:05.121+0000 7f03caffd700 1 -- 172.21.15.138:0/78512736 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f03dc10f920 con 0x7f03c4068f60 2024-02-07T12:21:05.126 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 4 on host 'smithi138' 2024-02-07T12:21:05.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:05.123+0000 7f03e0ed1700 1 -- 172.21.15.138:0/78512736 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f03c4068f60 msgr2=0x7f03c406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:05.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:05.123+0000 7f03e0ed1700 1 --2- 172.21.15.138:0/78512736 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f03c4068f60 0x7f03c406b410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0fcc30 tx=0x7f03d400b040 comp rx=0 tx=0).stop 2024-02-07T12:21:05.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:05.123+0000 7f03e0ed1700 1 -- 172.21.15.138:0/78512736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03dc0fe0e0 msgr2=0x7f03dc10de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:05.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:05.123+0000 7f03e0ed1700 1 --2- 172.21.15.138:0/78512736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03dc0fe0e0 0x7f03dc10de30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f03d0004890 tx=0x7f03d0009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:05.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:05.124+0000 7f03e0ed1700 1 -- 172.21.15.138:0/78512736 shutdown_connections 2024-02-07T12:21:05.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:05.124+0000 7f03e0ed1700 1 --2- 172.21.15.138:0/78512736 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f03c4068f60 0x7f03c406b410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:05.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:05.124+0000 7f03e0ed1700 1 --2- 172.21.15.138:0/78512736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03dc0fcef0 0x7f03dc10d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:05.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:05.124+0000 7f03e0ed1700 1 --2- 172.21.15.138:0/78512736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03dc0fe0e0 0x7f03dc10de30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:05.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:05.124+0000 7f03e0ed1700 1 -- 172.21.15.138:0/78512736 >> 172.21.15.138:0/78512736 conn(0x7f03dc0f8620 msgr2=0x7f03dc1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:05.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:05.124+0000 7f03e0ed1700 1 -- 172.21.15.138:0/78512736 shutdown_connections 2024-02-07T12:21:05.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:05.124+0000 7f03e0ed1700 1 -- 172.21.15.138:0/78512736 wait complete. 2024-02-07T12:21:05.714 DEBUG:teuthology.orchestra.run.smithi138:osd.4> sudo journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.4.service 2024-02-07T12:21:05.716 INFO:tasks.cephadm:Deploying osd.5 on smithi138 with /dev/vg_nvme/lv_2... 2024-02-07T12:21:05.716 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-07T12:21:06.012 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi138/config 2024-02-07T12:21:06.408 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:06 smithi138 ceph-mon[35528]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:21:06.408 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:06 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:06.409 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:06 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:06.409 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:06 smithi138 ceph-mon[35528]: from='osd.4 [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-07T12:21:06.409 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:06 smithi138 ceph-mon[35528]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-07T12:21:06.409 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:06 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:06.409 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:06 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:06 smithi047 ceph-mon[28972]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:21:06.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:06.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:06.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:06 smithi047 ceph-mon[28972]: from='osd.4 [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-07T12:21:06.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:06 smithi047 ceph-mon[28972]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-07T12:21:06.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:06.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:07.307 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:07 smithi138 ceph-mon[35528]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-07T12:21:07.308 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:07 smithi138 ceph-mon[35528]: osdmap e33: 5 total, 4 up, 5 in 2024-02-07T12:21:07.308 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:21:07.308 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:07 smithi138 ceph-mon[35528]: from='osd.4 [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:21:07.308 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:07 smithi138 ceph-mon[35528]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:21:07.308 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:07 smithi138 ceph-mon[35528]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:21:07.308 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:21:07.308 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:21:07 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[47510]: 2024-02-07T12:21:07.297+0000 7ff228306700 -1 osd.4 0 waiting for initial osdmap 2024-02-07T12:21:07.308 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:21:07 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[47510]: 2024-02-07T12:21:07.304+0000 7ff2218fe700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-07T12:21:07.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:07 smithi047 ceph-mon[28972]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-07T12:21:07.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:07 smithi047 ceph-mon[28972]: osdmap e33: 5 total, 4 up, 5 in 2024-02-07T12:21:07.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:21:07.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:07 smithi047 ceph-mon[28972]: from='osd.4 [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:21:07.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:07 smithi047 ceph-mon[28972]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:21:07.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:07 smithi047 ceph-mon[28972]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:21:07.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:21:08.334 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:08 smithi138 ceph-mon[35528]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-07T12:21:08.334 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:08 smithi138 ceph-mon[35528]: osdmap e34: 5 total, 4 up, 5 in 2024-02-07T12:21:08.334 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:08 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:21:08.334 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:08 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:21:08.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:08 smithi047 ceph-mon[28972]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-07T12:21:08.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:08 smithi047 ceph-mon[28972]: osdmap e34: 5 total, 4 up, 5 in 2024-02-07T12:21:08.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:08 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:21:08.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:08 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:21:09.123 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-07T12:21:09.123 INFO:teuthology.orchestra.run.smithi138.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-07T12:21:09.123 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10+0 records in 2024-02-07T12:21:09.123 INFO:teuthology.orchestra.run.smithi138.stderr:10+0 records out 2024-02-07T12:21:09.123 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123219 s, 851 MB/s 2024-02-07T12:21:09.123 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping successful for: 2024-02-07T12:21:09.510 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:09 smithi138 ceph-mon[35528]: purged_snaps scrub starts 2024-02-07T12:21:09.510 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:09 smithi138 ceph-mon[35528]: purged_snaps scrub ok 2024-02-07T12:21:09.510 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:09 smithi138 ceph-mon[35528]: osd.4 [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890] boot 2024-02-07T12:21:09.510 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:09 smithi138 ceph-mon[35528]: osdmap e35: 5 total, 5 up, 5 in 2024-02-07T12:21:09.511 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:09 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:21:09.511 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:09 smithi138 ceph-mon[35528]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:21:09.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:09 smithi047 ceph-mon[28972]: purged_snaps scrub starts 2024-02-07T12:21:09.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:09 smithi047 ceph-mon[28972]: purged_snaps scrub ok 2024-02-07T12:21:09.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:09 smithi047 ceph-mon[28972]: osd.4 [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890] boot 2024-02-07T12:21:09.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:09 smithi047 ceph-mon[28972]: osdmap e35: 5 total, 5 up, 5 in 2024-02-07T12:21:09.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:09 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:21:09.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:09 smithi047 ceph-mon[28972]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-07T12:21:09.789 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi138:vg_nvme/lv_2 2024-02-07T12:21:10.384 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:10 smithi138 ceph-mon[35528]: osdmap e36: 5 total, 5 up, 5 in 2024-02-07T12:21:10.473 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi138/config 2024-02-07T12:21:10.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:10 smithi047 ceph-mon[28972]: osdmap e36: 5 total, 5 up, 5 in 2024-02-07T12:21:11.689 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: Detected new or changed devices on smithi138 2024-02-07T12:21:11.689 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:11.690 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:11.690 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:21:11.690 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:21:11.690 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: Adjusting osd_memory_target on smithi138 to 7968M 2024-02-07T12:21:11.690 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:11.690 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:21:11.690 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:21:11.691 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:11.691 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:21:11.691 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:21:11.691 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:21:11.691 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:11.691 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:11 smithi138 ceph-mon[35528]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:11.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: Detected new or changed devices on smithi138 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: Adjusting osd_memory_target on smithi138 to 7968M 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:11 smithi047 ceph-mon[28972]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.008+0000 7f3b379f8700 1 -- 172.21.15.138:0/3848783259 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b300fefa0 msgr2=0x7f3b300fb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.008+0000 7f3b379f8700 1 --2- 172.21.15.138:0/3848783259 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b300fefa0 0x7f3b300fb050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c004940 tx=0x7f3b2c009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.008+0000 7f3b379f8700 1 -- 172.21.15.138:0/3848783259 shutdown_connections 2024-02-07T12:21:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.008+0000 7f3b379f8700 1 --2- 172.21.15.138:0/3848783259 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b300fefa0 0x7f3b300fb050 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.008+0000 7f3b379f8700 1 --2- 172.21.15.138:0/3848783259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b300fe5c0 0x7f3b300fe9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.008+0000 7f3b379f8700 1 -- 172.21.15.138:0/3848783259 >> 172.21.15.138:0/3848783259 conn(0x7f3b300f6ca0 msgr2=0x7f3b300f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.008+0000 7f3b379f8700 1 -- 172.21.15.138:0/3848783259 shutdown_connections 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.008+0000 7f3b379f8700 1 -- 172.21.15.138:0/3848783259 wait complete. 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.009+0000 7f3b379f8700 1 Processor -- start 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.009+0000 7f3b379f8700 1 -- start start 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.009+0000 7f3b379f8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b300fe5c0 0x7f3b300fde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.009+0000 7f3b379f8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b300fc280 0x7f3b300fc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.009+0000 7f3b379f8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300fcd10 con 0x7f3b300fe5c0 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.009+0000 7f3b379f8700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300fce50 con 0x7f3b300fc280 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.009+0000 7f3b34f93700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b300fc280 0x7f3b300fc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.009+0000 7f3b34f93700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b300fc280 0x7f3b300fc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45426/0 (socket says 172.21.15.138:45426) 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.009+0000 7f3b34f93700 1 -- 172.21.15.138:0/934575796 learned_addr learned my addr 172.21.15.138:0/934575796 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.009+0000 7f3b35794700 1 --2- 172.21.15.138:0/934575796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b300fe5c0 0x7f3b300fde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.010+0000 7f3b34f93700 1 -- 172.21.15.138:0/934575796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b300fe5c0 msgr2=0x7f3b300fde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.010+0000 7f3b34f93700 1 --2- 172.21.15.138:0/934575796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b300fe5c0 0x7f3b300fde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.010+0000 7f3b34f93700 1 -- 172.21.15.138:0/934575796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c005040 con 0x7f3b300fc280 2024-02-07T12:21:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.010+0000 7f3b34f93700 1 --2- 172.21.15.138:0/934575796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b300fc280 0x7f3b300fc6f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009150 tx=0x7f3b2c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.010+0000 7f3b25ffb700 1 -- 172.21.15.138:0/934575796 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b2c00e040 con 0x7f3b300fc280 2024-02-07T12:21:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.010+0000 7f3b25ffb700 1 -- 172.21.15.138:0/934575796 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b2c00bbf0 con 0x7f3b300fc280 2024-02-07T12:21:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.010+0000 7f3b379f8700 1 -- 172.21.15.138:0/934575796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b300fd0d0 con 0x7f3b300fc280 2024-02-07T12:21:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.010+0000 7f3b25ffb700 1 -- 172.21.15.138:0/934575796 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b2c01c630 con 0x7f3b300fc280 2024-02-07T12:21:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.010+0000 7f3b379f8700 1 -- 172.21.15.138:0/934575796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b30115e00 con 0x7f3b300fc280 2024-02-07T12:21:12.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.011+0000 7f3b379f8700 1 -- 172.21.15.138:0/934575796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3004bed0 con 0x7f3b300fc280 2024-02-07T12:21:12.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.012+0000 7f3b25ffb700 1 -- 172.21.15.138:0/934575796 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3b2c00bd60 con 0x7f3b300fc280 2024-02-07T12:21:12.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.012+0000 7f3b25ffb700 1 --2- 172.21.15.138:0/934575796 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3b1c068f60 0x7f3b1c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:12.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.012+0000 7f3b25ffb700 1 -- 172.21.15.138:0/934575796 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f3b2c087af0 con 0x7f3b300fc280 2024-02-07T12:21:12.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.012+0000 7f3b35794700 1 --2- 172.21.15.138:0/934575796 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3b1c068f60 0x7f3b1c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:12.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.013+0000 7f3b35794700 1 --2- 172.21.15.138:0/934575796 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3b1c068f60 0x7f3b1c06b410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b20006fd0 tx=0x7f3b20008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:12.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.016+0000 7f3b25ffb700 1 -- 172.21.15.138:0/934575796 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3b2c058090 con 0x7f3b300fc280 2024-02-07T12:21:12.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:12.203+0000 7f3b379f8700 1 -- 172.21.15.138:0/934575796 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b30102cc0 con 0x7f3b1c068f60 2024-02-07T12:21:12.774 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:12 smithi138 ceph-mon[35528]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:21:12.774 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:12 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-07T12:21:12.774 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:12 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-07T12:21:12.774 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:12 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:21:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:12 smithi047 ceph-mon[28972]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:21:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-07T12:21:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-07T12:21:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:12 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:21:13.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:13 smithi047 ceph-mon[28972]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:13.863 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:13 smithi138 ceph-mon[35528]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:15.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:14 smithi138 ceph-mon[35528]: from='client.? 172.21.15.138:0/3065738606' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8acb2ff-d0f5-4daf-82ee-6c4fddf1580d"}]: dispatch 2024-02-07T12:21:15.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:14 smithi138 ceph-mon[35528]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8acb2ff-d0f5-4daf-82ee-6c4fddf1580d"}]: dispatch 2024-02-07T12:21:15.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:14 smithi138 ceph-mon[35528]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8acb2ff-d0f5-4daf-82ee-6c4fddf1580d"}]': finished 2024-02-07T12:21:15.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:14 smithi138 ceph-mon[35528]: osdmap e37: 6 total, 5 up, 6 in 2024-02-07T12:21:15.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:14 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:21:15.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:14 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/3065738606' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8acb2ff-d0f5-4daf-82ee-6c4fddf1580d"}]: dispatch 2024-02-07T12:21:15.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:14 smithi047 ceph-mon[28972]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8acb2ff-d0f5-4daf-82ee-6c4fddf1580d"}]: dispatch 2024-02-07T12:21:15.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:14 smithi047 ceph-mon[28972]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8acb2ff-d0f5-4daf-82ee-6c4fddf1580d"}]': finished 2024-02-07T12:21:15.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:14 smithi047 ceph-mon[28972]: osdmap e37: 6 total, 5 up, 6 in 2024-02-07T12:21:15.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:14 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:21:16.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:15 smithi138 ceph-mon[35528]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:16.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:15 smithi138 ceph-mon[35528]: from='client.? 172.21.15.138:0/4096965049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-07T12:21:16.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:15 smithi047 ceph-mon[28972]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:16.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:15 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/4096965049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-07T12:21:18.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:17 smithi138 ceph-mon[35528]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:18.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:17 smithi047 ceph-mon[28972]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:20.275 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:19 smithi138 ceph-mon[35528]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:20.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:19 smithi047 ceph-mon[28972]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:21.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:21 smithi138 ceph-mon[35528]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:21.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:21 smithi047 ceph-mon[28972]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:22.510 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-07T12:21:22.511 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:21:22.511 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:22 smithi138 ceph-mon[35528]: Deploying daemon osd.5 on smithi138 2024-02-07T12:21:22.511 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:21:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-07T12:21:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:21:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:22 smithi047 ceph-mon[28972]: Deploying daemon osd.5 on smithi138 2024-02-07T12:21:22.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:21:23.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:23 smithi138 ceph-mon[35528]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:23.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:23 smithi047 ceph-mon[28972]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:26.212 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:25 smithi138 ceph-mon[35528]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:26.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:25 smithi047 ceph-mon[28972]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:28.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:27 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:28.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:27 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:28.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:27 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:21:28.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:27 smithi138 ceph-mon[35528]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:28.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:28.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:28.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:27 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:21:28.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:27 smithi047 ceph-mon[28972]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:29.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:29.717+0000 7f3b25ffb700 1 -- 172.21.15.138:0/934575796 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3b30102cc0 con 0x7f3b1c068f60 2024-02-07T12:21:29.719 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 5 on host 'smithi138' 2024-02-07T12:21:29.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:29.719+0000 7f3b379f8700 1 -- 172.21.15.138:0/934575796 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3b1c068f60 msgr2=0x7f3b1c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:29.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:29.719+0000 7f3b379f8700 1 --2- 172.21.15.138:0/934575796 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3b1c068f60 0x7f3b1c06b410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b20006fd0 tx=0x7f3b20008040 comp rx=0 tx=0).stop 2024-02-07T12:21:29.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:29.719+0000 7f3b379f8700 1 -- 172.21.15.138:0/934575796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b300fc280 msgr2=0x7f3b300fc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:29.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:29.719+0000 7f3b379f8700 1 --2- 172.21.15.138:0/934575796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b300fc280 0x7f3b300fc6f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009150 tx=0x7f3b2c009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:29.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:29.719+0000 7f3b379f8700 1 -- 172.21.15.138:0/934575796 shutdown_connections 2024-02-07T12:21:29.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:29.719+0000 7f3b379f8700 1 --2- 172.21.15.138:0/934575796 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3b1c068f60 0x7f3b1c06b410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:29.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:29.719+0000 7f3b379f8700 1 --2- 172.21.15.138:0/934575796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b300fe5c0 0x7f3b300fde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:29.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:29.719+0000 7f3b379f8700 1 --2- 172.21.15.138:0/934575796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b300fc280 0x7f3b300fc6f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:29.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:29.719+0000 7f3b379f8700 1 -- 172.21.15.138:0/934575796 >> 172.21.15.138:0/934575796 conn(0x7f3b300f6ca0 msgr2=0x7f3b301015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:29.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:29.719+0000 7f3b379f8700 1 -- 172.21.15.138:0/934575796 shutdown_connections 2024-02-07T12:21:29.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:29.719+0000 7f3b379f8700 1 -- 172.21.15.138:0/934575796 wait complete. 2024-02-07T12:21:30.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:29 smithi138 ceph-mon[35528]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:30.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:29 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:30.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:29 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:30.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:29 smithi047 ceph-mon[28972]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:30.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:29 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:30.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:29 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:30.528 DEBUG:teuthology.orchestra.run.smithi138:osd.5> sudo journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.5.service 2024-02-07T12:21:30.530 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-07T12:21:30.531 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph osd stat -f json 2024-02-07T12:21:30.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:21:30 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[53997]: 2024-02-07T12:21:30.619+0000 7f2a0185f540 -1 osd.5 0 log_to_monitors true 2024-02-07T12:21:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:21:31.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:31 smithi138 ceph-mon[35528]: from='osd.5 [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-07T12:21:31.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:31 smithi138 ceph-mon[35528]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-07T12:21:31.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:31 smithi138 ceph-mon[35528]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:31 smithi047 ceph-mon[28972]: from='osd.5 [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-07T12:21:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:31 smithi047 ceph-mon[28972]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-07T12:21:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:31 smithi047 ceph-mon[28972]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:32.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:32 smithi047 ceph-mon[28972]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-07T12:21:32.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:32 smithi047 ceph-mon[28972]: osdmap e38: 6 total, 5 up, 6 in 2024-02-07T12:21:32.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:32 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:21:32.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:32 smithi047 ceph-mon[28972]: from='osd.5 [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:21:32.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:32 smithi047 ceph-mon[28972]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:21:32.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:32 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:32.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:32 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:32.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.573+0000 7feae4a6e700 1 -- 172.21.15.47:0/816114757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae00fe2b0 msgr2=0x7feae00fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:32.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.573+0000 7feae4a6e700 1 --2- 172.21.15.47:0/816114757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae00fe2b0 0x7feae00fe700 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fead4004940 tx=0x7fead4009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:32.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.573+0000 7feae4a6e700 1 -- 172.21.15.47:0/816114757 shutdown_connections 2024-02-07T12:21:32.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.573+0000 7feae4a6e700 1 --2- 172.21.15.47:0/816114757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae00fe2b0 0x7feae00fe700 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:32.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.573+0000 7feae4a6e700 1 --2- 172.21.15.47:0/816114757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feae00fb220 0x7feae00fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:32.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.573+0000 7feae4a6e700 1 -- 172.21.15.47:0/816114757 >> 172.21.15.47:0/816114757 conn(0x7feae00f6ca0 msgr2=0x7feae00f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:32.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.573+0000 7feae4a6e700 1 -- 172.21.15.47:0/816114757 shutdown_connections 2024-02-07T12:21:32.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.573+0000 7feae4a6e700 1 -- 172.21.15.47:0/816114757 wait complete. 2024-02-07T12:21:32.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feae4a6e700 1 Processor -- start 2024-02-07T12:21:32.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feae4a6e700 1 -- start start 2024-02-07T12:21:32.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feae4a6e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feae00fb220 0x7feae00fdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:32.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feae4a6e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae00fe2b0 0x7feae00fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feae4a6e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae00fc850 con 0x7feae00fe2b0 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feae4a6e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae00fc9c0 con 0x7feae00fb220 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feaddd9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae00fe2b0 0x7feae00fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feaddd9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae00fe2b0 0x7feae00fc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54334/0 (socket says 172.21.15.47:54334) 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feaddd9b700 1 -- 172.21.15.47:0/858769285 learned_addr learned my addr 172.21.15.47:0/858769285 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feade59c700 1 --2- 172.21.15.47:0/858769285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feae00fb220 0x7feae00fdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feaddd9b700 1 -- 172.21.15.47:0/858769285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feae00fb220 msgr2=0x7feae00fdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feaddd9b700 1 --2- 172.21.15.47:0/858769285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feae00fb220 0x7feae00fdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feaddd9b700 1 -- 172.21.15.47:0/858769285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4005040 con 0x7feae00fe2b0 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.574+0000 7feade59c700 1 --2- 172.21.15.47:0/858769285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feae00fb220 0x7feae00fdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.575+0000 7feaddd9b700 1 --2- 172.21.15.47:0/858769285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae00fe2b0 0x7feae00fc1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fead400b3b0 tx=0x7fead4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.575+0000 7feaceffd700 1 -- 172.21.15.47:0/858769285 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead400e040 con 0x7feae00fe2b0 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.575+0000 7feae4a6e700 1 -- 172.21.15.47:0/858769285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae00fcc40 con 0x7feae00fe2b0 2024-02-07T12:21:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.575+0000 7feaceffd700 1 -- 172.21.15.47:0/858769285 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fead400bbf0 con 0x7feae00fe2b0 2024-02-07T12:21:32.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.575+0000 7feaceffd700 1 -- 172.21.15.47:0/858769285 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead401c410 con 0x7feae00fe2b0 2024-02-07T12:21:32.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.575+0000 7feae4a6e700 1 -- 172.21.15.47:0/858769285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae0115a20 con 0x7feae00fe2b0 2024-02-07T12:21:32.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.576+0000 7feae4a6e700 1 -- 172.21.15.47:0/858769285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae004bed0 con 0x7feae00fe2b0 2024-02-07T12:21:32.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.576+0000 7feaceffd700 1 -- 172.21.15.47:0/858769285 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fead400bd60 con 0x7feae00fe2b0 2024-02-07T12:21:32.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.577+0000 7feaceffd700 1 --2- 172.21.15.47:0/858769285 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7feac8068f60 0x7feac806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:32.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.577+0000 7feade59c700 1 --2- 172.21.15.47:0/858769285 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7feac8068f60 0x7feac806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:32.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.577+0000 7feaceffd700 1 -- 172.21.15.47:0/858769285 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4354+0+0 (secure 0 0 0) 0x7fead4087da0 con 0x7feae00fe2b0 2024-02-07T12:21:32.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.577+0000 7feade59c700 1 --2- 172.21.15.47:0/858769285 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7feac8068f60 0x7feac806b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feae00fdad0 tx=0x7fead0008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:32.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.582+0000 7feaceffd700 1 -- 172.21.15.47:0/858769285 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fead4058180 con 0x7feae00fe2b0 2024-02-07T12:21:32.595 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:21:32 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[53997]: 2024-02-07T12:21:32.303+0000 7f29f8031700 -1 osd.5 0 waiting for initial osdmap 2024-02-07T12:21:32.595 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:21:32 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[53997]: 2024-02-07T12:21:32.310+0000 7f29f362d700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-07T12:21:32.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:32 smithi138 ceph-mon[35528]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-07T12:21:32.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:32 smithi138 ceph-mon[35528]: osdmap e38: 6 total, 5 up, 6 in 2024-02-07T12:21:32.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:32 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:21:32.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:32 smithi138 ceph-mon[35528]: from='osd.5 [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:21:32.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:32 smithi138 ceph-mon[35528]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:21:32.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:32 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:32.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:32 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:32.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.776+0000 7feae4a6e700 1 -- 172.21.15.47:0/858769285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7feae0115da0 con 0x7feae00fe2b0 2024-02-07T12:21:32.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.776+0000 7feaceffd700 1 -- 172.21.15.47:0/858769285 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7fead4057d10 con 0x7feae00fe2b0 2024-02-07T12:21:32.779 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:21:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.778+0000 7feae4a6e700 1 -- 172.21.15.47:0/858769285 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7feac8068f60 msgr2=0x7feac806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.778+0000 7feae4a6e700 1 --2- 172.21.15.47:0/858769285 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7feac8068f60 0x7feac806b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feae00fdad0 tx=0x7fead0008040 comp rx=0 tx=0).stop 2024-02-07T12:21:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.778+0000 7feae4a6e700 1 -- 172.21.15.47:0/858769285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae00fe2b0 msgr2=0x7feae00fc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.778+0000 7feae4a6e700 1 --2- 172.21.15.47:0/858769285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae00fe2b0 0x7feae00fc1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fead400b3b0 tx=0x7fead4009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.778+0000 7feae4a6e700 1 -- 172.21.15.47:0/858769285 shutdown_connections 2024-02-07T12:21:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.778+0000 7feae4a6e700 1 --2- 172.21.15.47:0/858769285 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7feac8068f60 0x7feac806b410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.778+0000 7feae4a6e700 1 --2- 172.21.15.47:0/858769285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feae00fb220 0x7feae00fdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.778+0000 7feae4a6e700 1 --2- 172.21.15.47:0/858769285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae00fe2b0 0x7feae00fc1c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.778+0000 7feae4a6e700 1 -- 172.21.15.47:0/858769285 >> 172.21.15.47:0/858769285 conn(0x7feae00f6ca0 msgr2=0x7feae01014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.778+0000 7feae4a6e700 1 -- 172.21.15.47:0/858769285 shutdown_connections 2024-02-07T12:21:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:32.778+0000 7feae4a6e700 1 -- 172.21.15.47:0/858769285 wait complete. 2024-02-07T12:21:33.446 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:33 smithi047 ceph-mon[28972]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-07T12:21:33.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:33 smithi047 ceph-mon[28972]: osdmap e39: 6 total, 5 up, 6 in 2024-02-07T12:21:33.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:33 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:21:33.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:33 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:21:33.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:33 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/858769285' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-07T12:21:33.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:33 smithi047 ceph-mon[28972]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:33.475 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":39,"num_osds":6,"num_up_osds":5,"osd_up_since":1707308468,"num_in_osds":6,"osd_in_since":1707308474,"num_remapped_pgs":0} 2024-02-07T12:21:33.475 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:33 smithi138 ceph-mon[35528]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-07T12:21:33.476 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:33 smithi138 ceph-mon[35528]: osdmap e39: 6 total, 5 up, 6 in 2024-02-07T12:21:33.476 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:33 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:21:33.476 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:33 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:21:33.476 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:33 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/858769285' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-07T12:21:33.476 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:33 smithi138 ceph-mon[35528]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-07T12:21:34.476 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph osd stat -f json 2024-02-07T12:21:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:34 smithi047 ceph-mon[28972]: purged_snaps scrub starts 2024-02-07T12:21:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:34 smithi047 ceph-mon[28972]: purged_snaps scrub ok 2024-02-07T12:21:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:34 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:21:34.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:34 smithi047 ceph-mon[28972]: osd.5 [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019] boot 2024-02-07T12:21:34.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:34 smithi047 ceph-mon[28972]: osdmap e40: 6 total, 6 up, 6 in 2024-02-07T12:21:34.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:34 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:21:34.680 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:34 smithi138 ceph-mon[35528]: purged_snaps scrub starts 2024-02-07T12:21:34.680 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:34 smithi138 ceph-mon[35528]: purged_snaps scrub ok 2024-02-07T12:21:34.681 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:34 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:21:34.681 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:34 smithi138 ceph-mon[35528]: osd.5 [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019] boot 2024-02-07T12:21:34.681 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:34 smithi138 ceph-mon[35528]: osdmap e40: 6 total, 6 up, 6 in 2024-02-07T12:21:34.681 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:34 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:21:34.741 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:21:35.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: osdmap e41: 6 total, 6 up, 6 in 2024-02-07T12:21:35.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:35.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: Detected new or changed devices on smithi138 2024-02-07T12:21:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:21:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:21:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:21:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: Adjusting osd_memory_target on smithi138 to 5312M 2024-02-07T12:21:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:21:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:21:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:35.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:21:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: osdmap e41: 6 total, 6 up, 6 in 2024-02-07T12:21:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: Detected new or changed devices on smithi138 2024-02-07T12:21:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:21:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:21:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:21:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: Adjusting osd_memory_target on smithi138 to 5312M 2024-02-07T12:21:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:21:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:21:35.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:35.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:21:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.454+0000 7fd7ad34c700 1 -- 172.21.15.47:0/1349356404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7a81000c0 msgr2=0x7fd7a81024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.454+0000 7fd7ad34c700 1 --2- 172.21.15.47:0/1349356404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7a81000c0 0x7fd7a81024a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd798004940 tx=0x7fd798009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.454+0000 7fd7ad34c700 1 -- 172.21.15.47:0/1349356404 shutdown_connections 2024-02-07T12:21:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.454+0000 7fd7ad34c700 1 --2- 172.21.15.47:0/1349356404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7a81000c0 0x7fd7a81024a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.454+0000 7fd7ad34c700 1 --2- 172.21.15.47:0/1349356404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7a8066bf0 0x7fd7a80ffb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.454+0000 7fd7ad34c700 1 -- 172.21.15.47:0/1349356404 >> 172.21.15.47:0/1349356404 conn(0x7fd7a80f7590 msgr2=0x7fd7a80f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.454+0000 7fd7ad34c700 1 -- 172.21.15.47:0/1349356404 shutdown_connections 2024-02-07T12:21:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.454+0000 7fd7ad34c700 1 -- 172.21.15.47:0/1349356404 wait complete. 2024-02-07T12:21:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.455+0000 7fd7ad34c700 1 Processor -- start 2024-02-07T12:21:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.455+0000 7fd7ad34c700 1 -- start start 2024-02-07T12:21:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.455+0000 7fd7ad34c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7a8066bf0 0x7fd7a810d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.455+0000 7fd7ad34c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7a81000c0 0x7fd7a810de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.455+0000 7fd7ad34c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a810e440 con 0x7fd7a8066bf0 2024-02-07T12:21:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.455+0000 7fd7ad34c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a810ece0 con 0x7fd7a81000c0 2024-02-07T12:21:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.455+0000 7fd7a6ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7a8066bf0 0x7fd7a810d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.455+0000 7fd7a6ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7a8066bf0 0x7fd7a810d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54350/0 (socket says 172.21.15.47:54350) 2024-02-07T12:21:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.455+0000 7fd7a6ffd700 1 -- 172.21.15.47:0/3435766662 learned_addr learned my addr 172.21.15.47:0/3435766662 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:21:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.456+0000 7fd7a67fc700 1 --2- 172.21.15.47:0/3435766662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7a81000c0 0x7fd7a810de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.456+0000 7fd7a6ffd700 1 -- 172.21.15.47:0/3435766662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7a81000c0 msgr2=0x7fd7a810de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:36.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.456+0000 7fd7a6ffd700 1 --2- 172.21.15.47:0/3435766662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7a81000c0 0x7fd7a810de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:36.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.456+0000 7fd7a6ffd700 1 -- 172.21.15.47:0/3435766662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd798005040 con 0x7fd7a8066bf0 2024-02-07T12:21:36.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.456+0000 7fd7a6ffd700 1 --2- 172.21.15.47:0/3435766662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7a8066bf0 0x7fd7a810d900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd79c002a80 tx=0x7fd79c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:36.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.456+0000 7fd78f7fe700 1 -- 172.21.15.47:0/3435766662 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd79c007cc0 con 0x7fd7a8066bf0 2024-02-07T12:21:36.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.456+0000 7fd78f7fe700 1 -- 172.21.15.47:0/3435766662 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd79c00f040 con 0x7fd7a8066bf0 2024-02-07T12:21:36.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.456+0000 7fd7ad34c700 1 -- 172.21.15.47:0/3435766662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a810efc0 con 0x7fd7a8066bf0 2024-02-07T12:21:36.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.456+0000 7fd78f7fe700 1 -- 172.21.15.47:0/3435766662 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd79c00dad0 con 0x7fd7a8066bf0 2024-02-07T12:21:36.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.456+0000 7fd7ad34c700 1 -- 172.21.15.47:0/3435766662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a810f500 con 0x7fd7a8066bf0 2024-02-07T12:21:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.457+0000 7fd7ad34c700 1 -- 172.21.15.47:0/3435766662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a804bed0 con 0x7fd7a8066bf0 2024-02-07T12:21:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.457+0000 7fd78f7fe700 1 -- 172.21.15.47:0/3435766662 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd79c00dc30 con 0x7fd7a8066bf0 2024-02-07T12:21:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.458+0000 7fd78f7fe700 1 --2- 172.21.15.47:0/3435766662 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd790069030 0x7fd79006b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.458+0000 7fd78f7fe700 1 -- 172.21.15.47:0/3435766662 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd79c0867e0 con 0x7fd7a8066bf0 2024-02-07T12:21:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.458+0000 7fd7a67fc700 1 --2- 172.21.15.47:0/3435766662 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd790069030 0x7fd79006b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.458+0000 7fd7a67fc700 1 --2- 172.21.15.47:0/3435766662 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd790069030 0x7fd79006b4e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd798004f90 tx=0x7fd798009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.462+0000 7fd78f7fe700 1 -- 172.21.15.47:0/3435766662 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd79c0569e0 con 0x7fd7a8066bf0 2024-02-07T12:21:36.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:21:36.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:21:36.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:36.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.652+0000 7fd7ad34c700 1 -- 172.21.15.47:0/3435766662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fd7a8105a10 con 0x7fd7a8066bf0 2024-02-07T12:21:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.652+0000 7fd78f7fe700 1 -- 172.21.15.47:0/3435766662 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7fd79c056570 con 0x7fd7a8066bf0 2024-02-07T12:21:36.655 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:21:36.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.654+0000 7fd7ad34c700 1 -- 172.21.15.47:0/3435766662 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd790069030 msgr2=0x7fd79006b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:36.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.654+0000 7fd7ad34c700 1 --2- 172.21.15.47:0/3435766662 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd790069030 0x7fd79006b4e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd798004f90 tx=0x7fd798009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:36.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.654+0000 7fd7ad34c700 1 -- 172.21.15.47:0/3435766662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7a8066bf0 msgr2=0x7fd7a810d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:36.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.654+0000 7fd7ad34c700 1 --2- 172.21.15.47:0/3435766662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7a8066bf0 0x7fd7a810d900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd79c002a80 tx=0x7fd79c004600 comp rx=0 tx=0).stop 2024-02-07T12:21:36.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.654+0000 7fd7ad34c700 1 -- 172.21.15.47:0/3435766662 shutdown_connections 2024-02-07T12:21:36.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.654+0000 7fd7ad34c700 1 --2- 172.21.15.47:0/3435766662 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd790069030 0x7fd79006b4e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:36.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.654+0000 7fd7ad34c700 1 --2- 172.21.15.47:0/3435766662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7a8066bf0 0x7fd7a810d900 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:36.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.654+0000 7fd7ad34c700 1 --2- 172.21.15.47:0/3435766662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7a81000c0 0x7fd7a810de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:36.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.654+0000 7fd7ad34c700 1 -- 172.21.15.47:0/3435766662 >> 172.21.15.47:0/3435766662 conn(0x7fd7a80f7590 msgr2=0x7fd7a80f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:36.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.655+0000 7fd7ad34c700 1 -- 172.21.15.47:0/3435766662 shutdown_connections 2024-02-07T12:21:36.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:36.655+0000 7fd7ad34c700 1 -- 172.21.15.47:0/3435766662 wait complete. 2024-02-07T12:21:36.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:21:36.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:21:36.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:21:37.392 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1707308493,"num_in_osds":6,"osd_in_since":1707308474,"num_remapped_pgs":0} 2024-02-07T12:21:37.392 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph osd dump --format=json 2024-02-07T12:21:37.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:37 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3435766662' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-07T12:21:37.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:37 smithi047 ceph-mon[28972]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:37.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:37 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:21:37.650 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:21:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:37 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3435766662' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-07T12:21:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:37 smithi138 ceph-mon[35528]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:37 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:21:39.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.184+0000 7fa6cedfa700 1 -- 172.21.15.47:0/136878292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6c8103140 msgr2=0x7fa6c8103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:39.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.184+0000 7fa6cedfa700 1 --2- 172.21.15.47:0/136878292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6c8103140 0x7fa6c8103510 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8004940 tx=0x7fa6b8009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:39.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.184+0000 7fa6cedfa700 1 -- 172.21.15.47:0/136878292 shutdown_connections 2024-02-07T12:21:39.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.184+0000 7fa6cedfa700 1 --2- 172.21.15.47:0/136878292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6c80fb570 0x7fa6c80fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:39.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.184+0000 7fa6cedfa700 1 --2- 172.21.15.47:0/136878292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6c8103140 0x7fa6c8103510 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.184+0000 7fa6cedfa700 1 -- 172.21.15.47:0/136878292 >> 172.21.15.47:0/136878292 conn(0x7fa6c8071560 msgr2=0x7fa6c8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.184+0000 7fa6cedfa700 1 -- 172.21.15.47:0/136878292 shutdown_connections 2024-02-07T12:21:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.184+0000 7fa6cedfa700 1 -- 172.21.15.47:0/136878292 wait complete. 2024-02-07T12:21:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.184+0000 7fa6cedfa700 1 Processor -- start 2024-02-07T12:21:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.184+0000 7fa6cedfa700 1 -- start start 2024-02-07T12:21:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6cedfa700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6c80fb570 0x7fa6c8113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6cedfa700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6c8103140 0x7fa6c8114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6cedfa700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c81146a0 con 0x7fa6c80fb570 2024-02-07T12:21:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6cedfa700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c810d9d0 con 0x7fa6c8103140 2024-02-07T12:21:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6ccb96700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6c80fb570 0x7fa6c8113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6ccb96700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6c80fb570 0x7fa6c8113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54366/0 (socket says 172.21.15.47:54366) 2024-02-07T12:21:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6ccb96700 1 -- 172.21.15.47:0/322421543 learned_addr learned my addr 172.21.15.47:0/322421543 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:21:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6c7fff700 1 --2- 172.21.15.47:0/322421543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6c8103140 0x7fa6c8114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:39.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6ccb96700 1 -- 172.21.15.47:0/322421543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6c8103140 msgr2=0x7fa6c8114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:39.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6ccb96700 1 --2- 172.21.15.47:0/322421543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6c8103140 0x7fa6c8114050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:39.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6ccb96700 1 -- 172.21.15.47:0/322421543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b8005040 con 0x7fa6c80fb570 2024-02-07T12:21:39.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6ccb96700 1 --2- 172.21.15.47:0/322421543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6c80fb570 0x7fa6c8113b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa6b800b3b0 tx=0x7fa6b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:39.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6c57fa700 1 -- 172.21.15.47:0/322421543 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6b800e040 con 0x7fa6c80fb570 2024-02-07T12:21:39.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6c57fa700 1 -- 172.21.15.47:0/322421543 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6b800bbf0 con 0x7fa6c80fb570 2024-02-07T12:21:39.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6cedfa700 1 -- 172.21.15.47:0/322421543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c810dc50 con 0x7fa6c80fb570 2024-02-07T12:21:39.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6c57fa700 1 -- 172.21.15.47:0/322421543 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6b801c630 con 0x7fa6c80fb570 2024-02-07T12:21:39.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.185+0000 7fa6cedfa700 1 -- 172.21.15.47:0/322421543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c810e190 con 0x7fa6c80fb570 2024-02-07T12:21:39.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.186+0000 7fa6cedfa700 1 -- 172.21.15.47:0/322421543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c8100310 con 0x7fa6c80fb570 2024-02-07T12:21:39.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.187+0000 7fa6c57fa700 1 -- 172.21.15.47:0/322421543 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa6b800bd60 con 0x7fa6c80fb570 2024-02-07T12:21:39.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.187+0000 7fa6c57fa700 1 --2- 172.21.15.47:0/322421543 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa6b0068f60 0x7fa6b006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:39.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.187+0000 7fa6c57fa700 1 -- 172.21.15.47:0/322421543 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa6b8087e60 con 0x7fa6c80fb570 2024-02-07T12:21:39.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.187+0000 7fa6c7fff700 1 --2- 172.21.15.47:0/322421543 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa6b0068f60 0x7fa6b006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:39.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.188+0000 7fa6c7fff700 1 --2- 172.21.15.47:0/322421543 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa6b0068f60 0x7fa6b006b410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa6c810f340 tx=0x7fa6bc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:39.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.192+0000 7fa6c57fa700 1 -- 172.21.15.47:0/322421543 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa6b8058100 con 0x7fa6c80fb570 2024-02-07T12:21:39.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.384+0000 7fa6cedfa700 1 -- 172.21.15.47:0/322421543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6c804bed0 con 0x7fa6c80fb570 2024-02-07T12:21:39.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.384+0000 7fa6c57fa700 1 -- 172.21.15.47:0/322421543 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11084 (secure 0 0 0) 0x7fa6b8057c90 con 0x7fa6c80fb570 2024-02-07T12:21:39.387 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:21:39.387 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":41,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","created":"2024-02-07T12:16:03.682077+0000","modified":"2024-02-07T12:21:34.305073+0000","last_up_change":"2024-02-07T12:21:33.301075+0000","last_in_change":"2024-02-07T12:21:14.657544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-07T12:20:21.191001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b37bbc00-7240-422a-977b-c7a9687ce87f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6803","nonce":3625841997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6805","nonce":3625841997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6809","nonce":3625841997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6807","nonce":3625841997}]},"public_addr":"172.21.15.47:6803/3625841997","cluster_addr":"172.21.15.47:6805/3625841997","heartbeat_back_addr":"172.21.15.47:6809/3625841997","heartbeat_front_addr":"172.21.15.47:6807/3625841997","state":["exists","up"]},{"osd":1,"uuid":"e6a42328-96ea-40de-987d-4edec38a4b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6811","nonce":3556866846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6813","nonce":3556866846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6817","nonce":3556866846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6815","nonce":3556866846}]},"public_addr":"172.21.15.47:6811/3556866846","cluster_addr":"172.21.15.47:6813/3556866846","heartbeat_back_addr":"172.21.15.47:6817/3556866846","heartbeat_front_addr":"172.21.15.47:6815/3556866846","state":["exists","up"]},{"osd":2,"uuid":"c8925cb3-0da0-4f01-90c3-1b6fb6e15331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6819","nonce":3651330024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6821","nonce":3651330024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6825","nonce":3651330024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6823","nonce":3651330024}]},"public_addr":"172.21.15.47:6819/3651330024","cluster_addr":"172.21.15.47:6821/3651330024","heartbeat_back_addr":"172.21.15.47:6825/3651330024","heartbeat_front_addr":"172.21.15.47:6823/3651330024","state":["exists","up"]},{"osd":3,"uuid":"47130a0a-e27f-4129-abbb-4bef9b460ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6801","nonce":2068429764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6803","nonce":2068429764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6807","nonce":2068429764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6805","nonce":2068429764}]},"public_addr":"172.21.15.138:6801/2068429764","cluster_addr":"172.21.15.138:6803/2068429764","heartbeat_back_addr":"172.21.15.138:6807/2068429764","heartbeat_front_addr":"172.21.15.138:6805/2068429764","state":["exists","up"]},{"osd":4,"uuid":"103459b7-4883-4248-a64d-21c396324237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6809","nonce":873394890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6811","nonce":873394890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6815","nonce":873394890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6813","nonce":873394890}]},"public_addr":"172.21.15.138:6809/873394890","cluster_addr":"172.21.15.138:6811/873394890","heartbeat_back_addr":"172.21.15.138:6815/873394890","heartbeat_front_addr":"172.21.15.138:6813/873394890","state":["exists","up"]},{"osd":5,"uuid":"e8acb2ff-d0f5-4daf-82ee-6c4fddf1580d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6817","nonce":3475843019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6819","nonce":3475843019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6823","nonce":3475843019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6821","nonce":3475843019}]},"public_addr":"172.21.15.138:6817/3475843019","cluster_addr":"172.21.15.138:6819/3475843019","heartbeat_back_addr":"172.21.15.138:6823/3475843019","heartbeat_front_addr":"172.21.15.138:6821/3475843019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:19.518708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:48.503474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:17.112205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:41.349671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:06.347737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:31.635560+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3304641630":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/3586302931":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6801/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6800/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.47:0/3361862950":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6801/3304641630":"2024-02-08T12:18:06.849658+0000","172.21.15.47:6801/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/2757370866":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/3413297119":"2024-02-08T12:16:30.972957+0000","172.21.15.47:6800/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/3354208208":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/454079597":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/1415322117":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/2768201708":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/1918664197":"2024-02-08T12:17:02.806879+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-07T12:21:39.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.386+0000 7fa6cedfa700 1 -- 172.21.15.47:0/322421543 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa6b0068f60 msgr2=0x7fa6b006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:39.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.386+0000 7fa6cedfa700 1 --2- 172.21.15.47:0/322421543 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa6b0068f60 0x7fa6b006b410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa6c810f340 tx=0x7fa6bc00b040 comp rx=0 tx=0).stop 2024-02-07T12:21:39.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.386+0000 7fa6cedfa700 1 -- 172.21.15.47:0/322421543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6c80fb570 msgr2=0x7fa6c8113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:39.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.386+0000 7fa6cedfa700 1 --2- 172.21.15.47:0/322421543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6c80fb570 0x7fa6c8113b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa6b800b3b0 tx=0x7fa6b8009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:39.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.387+0000 7fa6cedfa700 1 -- 172.21.15.47:0/322421543 shutdown_connections 2024-02-07T12:21:39.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.387+0000 7fa6cedfa700 1 --2- 172.21.15.47:0/322421543 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa6b0068f60 0x7fa6b006b410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:39.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.387+0000 7fa6cedfa700 1 --2- 172.21.15.47:0/322421543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6c80fb570 0x7fa6c8113b10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:39.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.387+0000 7fa6cedfa700 1 --2- 172.21.15.47:0/322421543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6c8103140 0x7fa6c8114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:39.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.387+0000 7fa6cedfa700 1 -- 172.21.15.47:0/322421543 >> 172.21.15.47:0/322421543 conn(0x7fa6c8071560 msgr2=0x7fa6c80fa5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:39.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.387+0000 7fa6cedfa700 1 -- 172.21.15.47:0/322421543 shutdown_connections 2024-02-07T12:21:39.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:39.387+0000 7fa6cedfa700 1 -- 172.21.15.47:0/322421543 wait complete. 2024-02-07T12:21:40.026 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-07T12:20:21.191001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-02-07T12:21:40.027 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-07T12:21:40.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:39 smithi138 ceph-mon[35528]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:40.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:39 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/322421543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:21:40.287 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:21:40.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:39 smithi047 ceph-mon[28972]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:40.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:39 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/322421543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:21:41.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:41 smithi047 ceph-mon[28972]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:41.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:41 smithi138 ceph-mon[35528]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:41.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.955+0000 7f84c0069700 1 -- 172.21.15.47:0/1430583453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b80fe900 msgr2=0x7f84b8106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:41.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.955+0000 7f84c0069700 1 --2- 172.21.15.47:0/1430583453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b80fe900 0x7f84b8106f40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f84a8004940 tx=0x7f84a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:41.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.955+0000 7f84c0069700 1 -- 172.21.15.47:0/1430583453 shutdown_connections 2024-02-07T12:21:41.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.955+0000 7f84c0069700 1 --2- 172.21.15.47:0/1430583453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b80fe900 0x7f84b8106f40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:41.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.955+0000 7f84c0069700 1 --2- 172.21.15.47:0/1430583453 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84b80fdf60 0x7f84b80fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:41.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.955+0000 7f84c0069700 1 -- 172.21.15.47:0/1430583453 >> 172.21.15.47:0/1430583453 conn(0x7f84b80f7a10 msgr2=0x7f84b80f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:41.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.955+0000 7f84c0069700 1 -- 172.21.15.47:0/1430583453 shutdown_connections 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.955+0000 7f84c0069700 1 -- 172.21.15.47:0/1430583453 wait complete. 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.955+0000 7f84c0069700 1 Processor -- start 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.955+0000 7f84c0069700 1 -- start start 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84c0069700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84b80fdf60 0x7f84b8113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84c0069700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b80fe900 0x7f84b8114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84c0069700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b81146c0 con 0x7f84b80fe900 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84c0069700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b810d9f0 con 0x7f84b80fdf60 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84bd604700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b80fe900 0x7f84b8114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84bd604700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b80fe900 0x7f84b8114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57992/0 (socket says 172.21.15.47:57992) 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84bd604700 1 -- 172.21.15.47:0/1468085338 learned_addr learned my addr 172.21.15.47:0/1468085338 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84bde05700 1 --2- 172.21.15.47:0/1468085338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84b80fdf60 0x7f84b8113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84bd604700 1 -- 172.21.15.47:0/1468085338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84b80fdf60 msgr2=0x7f84b8113b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84bd604700 1 --2- 172.21.15.47:0/1468085338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84b80fdf60 0x7f84b8113b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84bd604700 1 -- 172.21.15.47:0/1468085338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a8005040 con 0x7f84b80fe900 2024-02-07T12:21:41.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84bde05700 1 --2- 172.21.15.47:0/1468085338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84b80fdf60 0x7f84b8113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:21:41.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84bd604700 1 --2- 172.21.15.47:0/1468085338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b80fe900 0x7f84b8114070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f84a8004890 tx=0x7f84a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:41.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84ae7fc700 1 -- 172.21.15.47:0/1468085338 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84a800e040 con 0x7f84b80fe900 2024-02-07T12:21:41.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84ae7fc700 1 -- 172.21.15.47:0/1468085338 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84a8004290 con 0x7f84b80fe900 2024-02-07T12:21:41.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84c0069700 1 -- 172.21.15.47:0/1468085338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b810dc70 con 0x7f84b80fe900 2024-02-07T12:21:41.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84ae7fc700 1 -- 172.21.15.47:0/1468085338 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84a801c630 con 0x7f84b80fe900 2024-02-07T12:21:41.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.956+0000 7f84c0069700 1 -- 172.21.15.47:0/1468085338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b810e1b0 con 0x7f84b80fe900 2024-02-07T12:21:41.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.957+0000 7f84c0069700 1 -- 172.21.15.47:0/1468085338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b8104550 con 0x7f84b80fe900 2024-02-07T12:21:41.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.958+0000 7f84ae7fc700 1 -- 172.21.15.47:0/1468085338 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f84a800bbf0 con 0x7f84b80fe900 2024-02-07T12:21:41.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.958+0000 7f84ae7fc700 1 --2- 172.21.15.47:0/1468085338 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f84a4068f60 0x7f84a406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:41.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.958+0000 7f84ae7fc700 1 -- 172.21.15.47:0/1468085338 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f84a8087f70 con 0x7f84b80fe900 2024-02-07T12:21:41.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.958+0000 7f84bde05700 1 --2- 172.21.15.47:0/1468085338 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f84a4068f60 0x7f84a406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:41.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.959+0000 7f84bde05700 1 --2- 172.21.15.47:0/1468085338 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f84a4068f60 0x7f84a406b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009fd0 tx=0x7f84b400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:41.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:41.963+0000 7f84ae7fc700 1 -- 172.21.15.47:0/1468085338 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f84a80b9a00 con 0x7f84b80fe900 2024-02-07T12:21:42.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:42.152+0000 7f84c0069700 1 -- 172.21.15.47:0/1468085338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84b8109ff0 con 0x7f84b80fe900 2024-02-07T12:21:42.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:42.152+0000 7f84ae7fc700 1 -- 172.21.15.47:0/1468085338 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84a80582c0 con 0x7f84b80fe900 2024-02-07T12:21:42.155 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-02-07T12:21:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:42.154+0000 7f84c0069700 1 -- 172.21.15.47:0/1468085338 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f84a4068f60 msgr2=0x7f84a406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:42.154+0000 7f84c0069700 1 --2- 172.21.15.47:0/1468085338 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f84a4068f60 0x7f84a406b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009fd0 tx=0x7f84b400b040 comp rx=0 tx=0).stop 2024-02-07T12:21:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:42.154+0000 7f84c0069700 1 -- 172.21.15.47:0/1468085338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b80fe900 msgr2=0x7f84b8114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:42.154+0000 7f84c0069700 1 --2- 172.21.15.47:0/1468085338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b80fe900 0x7f84b8114070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f84a8004890 tx=0x7f84a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:42.154+0000 7f84c0069700 1 -- 172.21.15.47:0/1468085338 shutdown_connections 2024-02-07T12:21:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:42.154+0000 7f84c0069700 1 --2- 172.21.15.47:0/1468085338 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f84a4068f60 0x7f84a406b410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:42.154+0000 7f84c0069700 1 --2- 172.21.15.47:0/1468085338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84b80fdf60 0x7f84b8113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:42.154+0000 7f84c0069700 1 --2- 172.21.15.47:0/1468085338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b80fe900 0x7f84b8114070 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:42.154+0000 7f84c0069700 1 -- 172.21.15.47:0/1468085338 >> 172.21.15.47:0/1468085338 conn(0x7f84b80f7a10 msgr2=0x7f84b81016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:42.154+0000 7f84c0069700 1 -- 172.21.15.47:0/1468085338 shutdown_connections 2024-02-07T12:21:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:42.154+0000 7f84c0069700 1 -- 172.21.15.47:0/1468085338 wait complete. 2024-02-07T12:21:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:42 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1468085338' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-07T12:21:42.686 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:42 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/1468085338' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-07T12:21:42.791 INFO:tasks.cephadm:Setting up client nodes... 2024-02-07T12:21:42.792 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-07T12:21:43.050 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:21:43.493 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:43 smithi047 ceph-mon[28972]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:43.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:43 smithi138 ceph-mon[35528]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:44.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.640+0000 7faaeb1cd700 1 -- 172.21.15.47:0/601357197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faae40fe0e0 msgr2=0x7faae40fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:44.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.640+0000 7faaeb1cd700 1 --2- 172.21.15.47:0/601357197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faae40fe0e0 0x7faae40fe550 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faacc004940 tx=0x7faacc009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:44.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.640+0000 7faaeb1cd700 1 -- 172.21.15.47:0/601357197 shutdown_connections 2024-02-07T12:21:44.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.640+0000 7faaeb1cd700 1 --2- 172.21.15.47:0/601357197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faae40fe0e0 0x7faae40fe550 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:44.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.640+0000 7faaeb1cd700 1 --2- 172.21.15.47:0/601357197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faae40fcef0 0x7faae40fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:44.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.640+0000 7faaeb1cd700 1 -- 172.21.15.47:0/601357197 >> 172.21.15.47:0/601357197 conn(0x7faae40f8620 msgr2=0x7faae40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:44.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.640+0000 7faaeb1cd700 1 -- 172.21.15.47:0/601357197 shutdown_connections 2024-02-07T12:21:44.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.640+0000 7faaeb1cd700 1 -- 172.21.15.47:0/601357197 wait complete. 2024-02-07T12:21:44.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.640+0000 7faaeb1cd700 1 Processor -- start 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.640+0000 7faaeb1cd700 1 -- start start 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faaeb1cd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faae40fcef0 0x7faae410d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faaeb1cd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faae40fe0e0 0x7faae410de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faaeb1cd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae410e410 con 0x7faae40fcef0 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faaeb1cd700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae410ecb0 con 0x7faae40fe0e0 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faae8f69700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faae40fcef0 0x7faae410d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faae8f69700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faae40fcef0 0x7faae410d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58008/0 (socket says 172.21.15.47:58008) 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faae8f69700 1 -- 172.21.15.47:0/176687282 learned_addr learned my addr 172.21.15.47:0/176687282 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faae3fff700 1 --2- 172.21.15.47:0/176687282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faae40fe0e0 0x7faae410de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faae8f69700 1 -- 172.21.15.47:0/176687282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faae40fe0e0 msgr2=0x7faae410de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faae8f69700 1 --2- 172.21.15.47:0/176687282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faae40fe0e0 0x7faae410de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faae8f69700 1 -- 172.21.15.47:0/176687282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc005040 con 0x7faae40fcef0 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faae8f69700 1 --2- 172.21.15.47:0/176687282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faae40fcef0 0x7faae410d8d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faad4001db0 tx=0x7faad4009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faae17fa700 1 -- 172.21.15.47:0/176687282 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faad400ed50 con 0x7faae40fcef0 2024-02-07T12:21:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faaeb1cd700 1 -- 172.21.15.47:0/176687282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae410ef90 con 0x7faae40fcef0 2024-02-07T12:21:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faae17fa700 1 -- 172.21.15.47:0/176687282 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faad4007df0 con 0x7faae40fcef0 2024-02-07T12:21:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.641+0000 7faae17fa700 1 -- 172.21.15.47:0/176687282 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faad4014640 con 0x7faae40fcef0 2024-02-07T12:21:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.642+0000 7faaeb1cd700 1 -- 172.21.15.47:0/176687282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae410f4d0 con 0x7faae40fcef0 2024-02-07T12:21:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.642+0000 7faaeb1cd700 1 -- 172.21.15.47:0/176687282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae404bed0 con 0x7faae40fcef0 2024-02-07T12:21:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.643+0000 7faae17fa700 1 -- 172.21.15.47:0/176687282 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7faad4007920 con 0x7faae40fcef0 2024-02-07T12:21:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.643+0000 7faae17fa700 1 --2- 172.21.15.47:0/176687282 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7faad0068fb0 0x7faad006b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.643+0000 7faae17fa700 1 -- 172.21.15.47:0/176687282 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faad40868a0 con 0x7faae40fcef0 2024-02-07T12:21:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.643+0000 7faae3fff700 1 --2- 172.21.15.47:0/176687282 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7faad0068fb0 0x7faad006b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.644+0000 7faae3fff700 1 --2- 172.21.15.47:0/176687282 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7faad0068fb0 0x7faad006b460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faacc004f90 tx=0x7faacc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:44.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.648+0000 7faae17fa700 1 -- 172.21.15.47:0/176687282 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faad4056ad0 con 0x7faae40fcef0 2024-02-07T12:21:44.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.916+0000 7faaeb1cd700 1 -- 172.21.15.47:0/176687282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7faae4105a30 con 0x7faae40fcef0 2024-02-07T12:21:44.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.920+0000 7faae17fa700 1 -- 172.21.15.47:0/176687282 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7faad4056660 con 0x7faae40fcef0 2024-02-07T12:21:44.923 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-02-07T12:21:44.924 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDYdcNlR4vJNhAAPqrkr1Zl056KIo1odEjc2w== 2024-02-07T12:21:44.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.922+0000 7faaeb1cd700 1 -- 172.21.15.47:0/176687282 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7faad0068fb0 msgr2=0x7faad006b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:44.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.922+0000 7faaeb1cd700 1 --2- 172.21.15.47:0/176687282 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7faad0068fb0 0x7faad006b460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faacc004f90 tx=0x7faacc009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:44.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.922+0000 7faaeb1cd700 1 -- 172.21.15.47:0/176687282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faae40fcef0 msgr2=0x7faae410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:44.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.922+0000 7faaeb1cd700 1 --2- 172.21.15.47:0/176687282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faae40fcef0 0x7faae410d8d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faad4001db0 tx=0x7faad4009ee0 comp rx=0 tx=0).stop 2024-02-07T12:21:44.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.922+0000 7faaeb1cd700 1 -- 172.21.15.47:0/176687282 shutdown_connections 2024-02-07T12:21:44.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.922+0000 7faaeb1cd700 1 --2- 172.21.15.47:0/176687282 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7faad0068fb0 0x7faad006b460 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:44.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.922+0000 7faaeb1cd700 1 --2- 172.21.15.47:0/176687282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faae40fcef0 0x7faae410d8d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:44.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.922+0000 7faaeb1cd700 1 --2- 172.21.15.47:0/176687282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faae40fe0e0 0x7faae410de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:44.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.922+0000 7faaeb1cd700 1 -- 172.21.15.47:0/176687282 >> 172.21.15.47:0/176687282 conn(0x7faae40f8620 msgr2=0x7faae41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:44.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.922+0000 7faaeb1cd700 1 -- 172.21.15.47:0/176687282 shutdown_connections 2024-02-07T12:21:44.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:44.922+0000 7faaeb1cd700 1 -- 172.21.15.47:0/176687282 wait complete. 2024-02-07T12:21:45.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:44 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/176687282' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-07T12:21:45.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:44 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/176687282' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-07T12:21:45.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:44 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/176687282' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-07T12:21:45.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:44 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/176687282' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-07T12:21:45.791 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:21:45.792 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-07T12:21:45.792 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-07T12:21:45.839 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-07T12:21:46.064 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:45 smithi047 ceph-mon[28972]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:46.101 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi138/config 2024-02-07T12:21:46.207 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:45 smithi138 ceph-mon[35528]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:47.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.582+0000 7f7c38184700 1 -- 172.21.15.138:0/2279957699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c300fcef0 msgr2=0x7f7c300fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:47.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.582+0000 7f7c38184700 1 --2- 172.21.15.138:0/2279957699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c300fcef0 0x7f7c300fd320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7c20004970 tx=0x7f7c20009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:47.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.582+0000 7f7c38184700 1 -- 172.21.15.138:0/2279957699 shutdown_connections 2024-02-07T12:21:47.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.582+0000 7f7c38184700 1 --2- 172.21.15.138:0/2279957699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c300fe0e0 0x7f7c300fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:47.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.582+0000 7f7c38184700 1 --2- 172.21.15.138:0/2279957699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c300fcef0 0x7f7c300fd320 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:47.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.582+0000 7f7c38184700 1 -- 172.21.15.138:0/2279957699 >> 172.21.15.138:0/2279957699 conn(0x7f7c300f8620 msgr2=0x7f7c300faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:47.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.582+0000 7f7c38184700 1 -- 172.21.15.138:0/2279957699 shutdown_connections 2024-02-07T12:21:47.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.582+0000 7f7c38184700 1 -- 172.21.15.138:0/2279957699 wait complete. 2024-02-07T12:21:47.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.583+0000 7f7c38184700 1 Processor -- start 2024-02-07T12:21:47.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.583+0000 7f7c38184700 1 -- start start 2024-02-07T12:21:47.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.583+0000 7f7c38184700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c300fcef0 0x7f7c3010aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.583+0000 7f7c38184700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c300fe0e0 0x7f7c3010b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.583+0000 7f7c38184700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3010b680 con 0x7f7c300fcef0 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.583+0000 7f7c38184700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3010bf20 con 0x7f7c300fe0e0 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.583+0000 7f7c3571f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c300fe0e0 0x7f7c3010b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.583+0000 7f7c3571f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c300fe0e0 0x7f7c3010b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40132/0 (socket says 172.21.15.138:40132) 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.583+0000 7f7c3571f700 1 -- 172.21.15.138:0/403487194 learned_addr learned my addr 172.21.15.138:0/403487194 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.583+0000 7f7c35f20700 1 --2- 172.21.15.138:0/403487194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c300fcef0 0x7f7c3010aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.583+0000 7f7c3571f700 1 -- 172.21.15.138:0/403487194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c300fcef0 msgr2=0x7f7c3010aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.583+0000 7f7c3571f700 1 --2- 172.21.15.138:0/403487194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c300fcef0 0x7f7c3010aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.583+0000 7f7c3571f700 1 -- 172.21.15.138:0/403487194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c20005040 con 0x7f7c300fe0e0 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.584+0000 7f7c3571f700 1 --2- 172.21.15.138:0/403487194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c300fe0e0 0x7f7c3010b030 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00c810 tx=0x7f7c2c004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.584+0000 7f7c267fc700 1 -- 172.21.15.138:0/403487194 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c2c012810 con 0x7f7c300fe0e0 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.584+0000 7f7c38184700 1 -- 172.21.15.138:0/403487194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3010c200 con 0x7f7c300fe0e0 2024-02-07T12:21:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.584+0000 7f7c267fc700 1 -- 172.21.15.138:0/403487194 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c2c012e40 con 0x7f7c300fe0e0 2024-02-07T12:21:47.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.584+0000 7f7c267fc700 1 -- 172.21.15.138:0/403487194 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c2c00a370 con 0x7f7c300fe0e0 2024-02-07T12:21:47.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.584+0000 7f7c38184700 1 -- 172.21.15.138:0/403487194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3010c740 con 0x7f7c300fe0e0 2024-02-07T12:21:47.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.585+0000 7f7c38184700 1 -- 172.21.15.138:0/403487194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c30102210 con 0x7f7c300fe0e0 2024-02-07T12:21:47.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.585+0000 7f7c267fc700 1 -- 172.21.15.138:0/403487194 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7c2c011810 con 0x7f7c300fe0e0 2024-02-07T12:21:47.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.585+0000 7f7c267fc700 1 --2- 172.21.15.138:0/403487194 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7c1c068f60 0x7f7c1c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:47.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.585+0000 7f7c267fc700 1 -- 172.21.15.138:0/403487194 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7c2c086e30 con 0x7f7c300fe0e0 2024-02-07T12:21:47.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.586+0000 7f7c35f20700 1 --2- 172.21.15.138:0/403487194 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7c1c068f60 0x7f7c1c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:47.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.586+0000 7f7c35f20700 1 --2- 172.21.15.138:0/403487194 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7c1c068f60 0x7f7c1c06b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c20004940 tx=0x7f7c20009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:47.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.590+0000 7f7c267fc700 1 -- 172.21.15.138:0/403487194 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7c2c053640 con 0x7f7c300fe0e0 2024-02-07T12:21:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.846+0000 7f7c38184700 1 -- 172.21.15.138:0/403487194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f7c3004bed0 con 0x7f7c300fe0e0 2024-02-07T12:21:47.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.851+0000 7f7c267fc700 1 -- 172.21.15.138:0/403487194 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f7c2c016050 con 0x7f7c300fe0e0 2024-02-07T12:21:47.853 INFO:teuthology.orchestra.run.smithi138.stdout:[client.1] 2024-02-07T12:21:47.853 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDbdcNl/J6LMhAAFnwoLp8byPcNAFQbn1AmRw== 2024-02-07T12:21:47.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.853+0000 7f7c38184700 1 -- 172.21.15.138:0/403487194 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7c1c068f60 msgr2=0x7f7c1c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:47.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.853+0000 7f7c38184700 1 --2- 172.21.15.138:0/403487194 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7c1c068f60 0x7f7c1c06b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c20004940 tx=0x7f7c20009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:47.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.853+0000 7f7c38184700 1 -- 172.21.15.138:0/403487194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c300fe0e0 msgr2=0x7f7c3010b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:47.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.853+0000 7f7c38184700 1 --2- 172.21.15.138:0/403487194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c300fe0e0 0x7f7c3010b030 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00c810 tx=0x7f7c2c004470 comp rx=0 tx=0).stop 2024-02-07T12:21:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.853+0000 7f7c38184700 1 -- 172.21.15.138:0/403487194 shutdown_connections 2024-02-07T12:21:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.853+0000 7f7c38184700 1 --2- 172.21.15.138:0/403487194 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7c1c068f60 0x7f7c1c06b410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.853+0000 7f7c38184700 1 --2- 172.21.15.138:0/403487194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c300fcef0 0x7f7c3010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.853+0000 7f7c38184700 1 --2- 172.21.15.138:0/403487194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c300fe0e0 0x7f7c3010b030 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.853+0000 7f7c38184700 1 -- 172.21.15.138:0/403487194 >> 172.21.15.138:0/403487194 conn(0x7f7c300f8620 msgr2=0x7f7c300ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.853+0000 7f7c38184700 1 -- 172.21.15.138:0/403487194 shutdown_connections 2024-02-07T12:21:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-07T12:21:47.853+0000 7f7c38184700 1 -- 172.21.15.138:0/403487194 wait complete. 2024-02-07T12:21:48.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:47 smithi138 ceph-mon[35528]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:48.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:47 smithi138 ceph-mon[35528]: from='client.? 172.21.15.138:0/403487194' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-07T12:21:48.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:47 smithi138 ceph-mon[35528]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-07T12:21:48.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:47 smithi138 ceph-mon[35528]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-07T12:21:48.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:47 smithi047 ceph-mon[28972]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:48.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:47 smithi047 ceph-mon[28972]: from='client.? 172.21.15.138:0/403487194' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-07T12:21:48.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:47 smithi047 ceph-mon[28972]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-07T12:21:48.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:47 smithi047 ceph-mon[28972]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-07T12:21:48.546 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:21:48.546 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-07T12:21:48.546 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-07T12:21:48.590 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-07T12:21:48.590 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-07T12:21:48.590 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph mgr dump --format=json 2024-02-07T12:21:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:21:50.255 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:49 smithi047 ceph-mon[28972]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:50.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:49 smithi138 ceph-mon[35528]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:50.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.611+0000 7eff33df1700 1 -- 172.21.15.47:0/1159766915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff2c102800 msgr2=0x7eff2c0fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:50.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.611+0000 7eff33df1700 1 --2- 172.21.15.47:0/1159766915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff2c102800 0x7eff2c0fbe70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7eff1c004940 tx=0x7eff1c009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.611+0000 7eff33df1700 1 -- 172.21.15.47:0/1159766915 shutdown_connections 2024-02-07T12:21:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.611+0000 7eff33df1700 1 --2- 172.21.15.47:0/1159766915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff2c102800 0x7eff2c0fbe70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.611+0000 7eff33df1700 1 --2- 172.21.15.47:0/1159766915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff2c101e60 0x7eff2c102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.611+0000 7eff33df1700 1 -- 172.21.15.47:0/1159766915 >> 172.21.15.47:0/1159766915 conn(0x7eff2c0f7a10 msgr2=0x7eff2c0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.611+0000 7eff33df1700 1 -- 172.21.15.47:0/1159766915 shutdown_connections 2024-02-07T12:21:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.611+0000 7eff33df1700 1 -- 172.21.15.47:0/1159766915 wait complete. 2024-02-07T12:21:50.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.611+0000 7eff33df1700 1 Processor -- start 2024-02-07T12:21:50.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.611+0000 7eff33df1700 1 -- start start 2024-02-07T12:21:50.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.611+0000 7eff33df1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff2c101e60 0x7eff2c112a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.611+0000 7eff33df1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff2c102800 0x7eff2c112f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff33df1700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c113590 con 0x7eff2c101e60 2024-02-07T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff33df1700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c10c8c0 con 0x7eff2c102800 2024-02-07T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff31b8d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff2c101e60 0x7eff2c112a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff31b8d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff2c101e60 0x7eff2c112a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38408/0 (socket says 172.21.15.47:38408) 2024-02-07T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff31b8d700 1 -- 172.21.15.47:0/1983547965 learned_addr learned my addr 172.21.15.47:0/1983547965 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff3138c700 1 --2- 172.21.15.47:0/1983547965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff2c102800 0x7eff2c112f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff31b8d700 1 -- 172.21.15.47:0/1983547965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff2c102800 msgr2=0x7eff2c112f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff31b8d700 1 --2- 172.21.15.47:0/1983547965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff2c102800 0x7eff2c112f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff31b8d700 1 -- 172.21.15.47:0/1983547965 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c005040 con 0x7eff2c101e60 2024-02-07T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff3138c700 1 --2- 172.21.15.47:0/1983547965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff2c102800 0x7eff2c112f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff31b8d700 1 --2- 172.21.15.47:0/1983547965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff2c101e60 0x7eff2c112a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7eff2800c830 tx=0x7eff28004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff227fc700 1 -- 172.21.15.47:0/1983547965 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff2800a760 con 0x7eff2c101e60 2024-02-07T12:21:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff227fc700 1 -- 172.21.15.47:0/1983547965 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff2800ad90 con 0x7eff2c101e60 2024-02-07T12:21:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff33df1700 1 -- 172.21.15.47:0/1983547965 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2c10cba0 con 0x7eff2c101e60 2024-02-07T12:21:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff227fc700 1 -- 172.21.15.47:0/1983547965 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff280113a0 con 0x7eff2c101e60 2024-02-07T12:21:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.612+0000 7eff33df1700 1 -- 172.21.15.47:0/1983547965 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c10d0e0 con 0x7eff2c101e60 2024-02-07T12:21:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.613+0000 7eff33df1700 1 -- 172.21.15.47:0/1983547965 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2c104330 con 0x7eff2c101e60 2024-02-07T12:21:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.614+0000 7eff227fc700 1 -- 172.21.15.47:0/1983547965 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7eff28012400 con 0x7eff2c101e60 2024-02-07T12:21:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.614+0000 7eff227fc700 1 --2- 172.21.15.47:0/1983547965 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7eff18068f60 0x7eff1806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.614+0000 7eff227fc700 1 -- 172.21.15.47:0/1983547965 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7eff280869e0 con 0x7eff2c101e60 2024-02-07T12:21:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.614+0000 7eff3138c700 1 --2- 172.21.15.47:0/1983547965 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7eff18068f60 0x7eff1806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:50.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.615+0000 7eff3138c700 1 --2- 172.21.15.47:0/1983547965 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7eff18068f60 0x7eff1806b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00b3b0 tx=0x7eff1c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:50.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.619+0000 7eff227fc700 1 -- 172.21.15.47:0/1983547965 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7eff28056d20 con 0x7eff2c101e60 2024-02-07T12:21:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.861+0000 7eff33df1700 1 -- 172.21.15.47:0/1983547965 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7eff2c04bed0 con 0x7eff2c101e60 2024-02-07T12:21:50.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.864+0000 7eff227fc700 1 -- 172.21.15.47:0/1983547965 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166776 (secure 0 0 0) 0x7eff280568b0 con 0x7eff2c101e60 2024-02-07T12:21:50.871 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:21:50.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.867+0000 7eff33df1700 1 -- 172.21.15.47:0/1983547965 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7eff18068f60 msgr2=0x7eff1806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:50.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.867+0000 7eff33df1700 1 --2- 172.21.15.47:0/1983547965 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7eff18068f60 0x7eff1806b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00b3b0 tx=0x7eff1c009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:50.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.867+0000 7eff33df1700 1 -- 172.21.15.47:0/1983547965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff2c101e60 msgr2=0x7eff2c112a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:50.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.867+0000 7eff33df1700 1 --2- 172.21.15.47:0/1983547965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff2c101e60 0x7eff2c112a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7eff2800c830 tx=0x7eff28004470 comp rx=0 tx=0).stop 2024-02-07T12:21:50.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.867+0000 7eff33df1700 1 -- 172.21.15.47:0/1983547965 shutdown_connections 2024-02-07T12:21:50.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.867+0000 7eff33df1700 1 --2- 172.21.15.47:0/1983547965 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7eff18068f60 0x7eff1806b410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:50.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.867+0000 7eff33df1700 1 --2- 172.21.15.47:0/1983547965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff2c101e60 0x7eff2c112a00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:50.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.867+0000 7eff33df1700 1 --2- 172.21.15.47:0/1983547965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff2c102800 0x7eff2c112f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:50.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.867+0000 7eff33df1700 1 -- 172.21.15.47:0/1983547965 >> 172.21.15.47:0/1983547965 conn(0x7eff2c0f7a10 msgr2=0x7eff2c0f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:50.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.867+0000 7eff33df1700 1 -- 172.21.15.47:0/1983547965 shutdown_connections 2024-02-07T12:21:50.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:50.867+0000 7eff33df1700 1 -- 172.21.15.47:0/1983547965 wait complete. 2024-02-07T12:21:51.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:51 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1983547965' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-07T12:21:51.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:51 smithi047 ceph-mon[28972]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:51.622 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"active_gid":14208,"active_name":"smithi047.zhgnrm","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":3356603129},{"type":"v1","addr":"172.21.15.47:6801","nonce":3356603129}]},"active_addr":"172.21.15.47:6801/3356603129","active_change":"2024-02-07T12:18:06.849818+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14228,"name":"smithi138.fiugmj","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.47:8443/","prometheus":"http://172.21.15.47:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":1926405874}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3785090733}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":179765176}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2651788466}]}]} 2024-02-07T12:21:51.626 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-07T12:21:51.626 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-07T12:21:51.626 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph osd dump --format=json 2024-02-07T12:21:51.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:51 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/1983547965' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-07T12:21:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:51 smithi138 ceph-mon[35528]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:51.888 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:21:52.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:52 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:21:52.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:52 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:21:53.480 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:53 smithi047 ceph-mon[28972]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:53.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:53 smithi138 ceph-mon[35528]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:53.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.692+0000 7fb78d4be700 1 -- 172.21.15.47:0/966703135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7880702d0 msgr2=0x7fb7880706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:53.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.692+0000 7fb78d4be700 1 --2- 172.21.15.47:0/966703135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7880702d0 0x7fb7880706a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb778004970 tx=0x7fb778009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:53.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.692+0000 7fb78d4be700 1 -- 172.21.15.47:0/966703135 shutdown_connections 2024-02-07T12:21:53.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.692+0000 7fb78d4be700 1 --2- 172.21.15.47:0/966703135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb788070be0 0x7fb7881092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:53.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.692+0000 7fb78d4be700 1 --2- 172.21.15.47:0/966703135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7880702d0 0x7fb7880706a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:53.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.692+0000 7fb78d4be700 1 -- 172.21.15.47:0/966703135 >> 172.21.15.47:0/966703135 conn(0x7fb7880f8af0 msgr2=0x7fb7880faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:53.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.693+0000 7fb78d4be700 1 -- 172.21.15.47:0/966703135 shutdown_connections 2024-02-07T12:21:53.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.693+0000 7fb78d4be700 1 -- 172.21.15.47:0/966703135 wait complete. 2024-02-07T12:21:53.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.693+0000 7fb78d4be700 1 Processor -- start 2024-02-07T12:21:53.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.693+0000 7fb78d4be700 1 -- start start 2024-02-07T12:21:53.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb78d4be700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7880702d0 0x7fb788115c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:53.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb78d4be700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb788070be0 0x7fb7881161d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:53.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb78d4be700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7881168b0 con 0x7fb788070be0 2024-02-07T12:21:53.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb78d4be700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78810fb50 con 0x7fb7880702d0 2024-02-07T12:21:53.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb7867fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb788070be0 0x7fb7881161d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:53.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb7867fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb788070be0 0x7fb7881161d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38438/0 (socket says 172.21.15.47:38438) 2024-02-07T12:21:53.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb7867fc700 1 -- 172.21.15.47:0/976125528 learned_addr learned my addr 172.21.15.47:0/976125528 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:21:53.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb786ffd700 1 --2- 172.21.15.47:0/976125528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7880702d0 0x7fb788115c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:53.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb7867fc700 1 -- 172.21.15.47:0/976125528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7880702d0 msgr2=0x7fb788115c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:53.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb7867fc700 1 --2- 172.21.15.47:0/976125528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7880702d0 0x7fb788115c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:53.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb7867fc700 1 -- 172.21.15.47:0/976125528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb778005040 con 0x7fb788070be0 2024-02-07T12:21:53.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb7867fc700 1 --2- 172.21.15.47:0/976125528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb788070be0 0x7fb7881161d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00b790 tx=0x7fb77c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:53.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb76f7fe700 1 -- 172.21.15.47:0/976125528 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77c00f770 con 0x7fb788070be0 2024-02-07T12:21:53.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb78d4be700 1 -- 172.21.15.47:0/976125528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78810fe30 con 0x7fb788070be0 2024-02-07T12:21:53.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb76f7fe700 1 -- 172.21.15.47:0/976125528 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb77c00fda0 con 0x7fb788070be0 2024-02-07T12:21:53.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb76f7fe700 1 -- 172.21.15.47:0/976125528 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77c00d310 con 0x7fb788070be0 2024-02-07T12:21:53.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.694+0000 7fb78d4be700 1 -- 172.21.15.47:0/976125528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb788110370 con 0x7fb788070be0 2024-02-07T12:21:53.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.695+0000 7fb78d4be700 1 -- 172.21.15.47:0/976125528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb788106970 con 0x7fb788070be0 2024-02-07T12:21:53.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.696+0000 7fb76f7fe700 1 -- 172.21.15.47:0/976125528 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb77c010420 con 0x7fb788070be0 2024-02-07T12:21:53.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.696+0000 7fb76f7fe700 1 --2- 172.21.15.47:0/976125528 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb770068f60 0x7fb77006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:53.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.696+0000 7fb76f7fe700 1 -- 172.21.15.47:0/976125528 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb77c086aa0 con 0x7fb788070be0 2024-02-07T12:21:53.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.696+0000 7fb786ffd700 1 --2- 172.21.15.47:0/976125528 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb770068f60 0x7fb77006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:53.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.697+0000 7fb786ffd700 1 --2- 172.21.15.47:0/976125528 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb770068f60 0x7fb77006b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb778000c00 tx=0x7fb778009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:53.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.701+0000 7fb76f7fe700 1 -- 172.21.15.47:0/976125528 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb77c056d40 con 0x7fb788070be0 2024-02-07T12:21:53.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.895+0000 7fb78d4be700 1 -- 172.21.15.47:0/976125528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7880fc6f0 con 0x7fb788070be0 2024-02-07T12:21:53.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.895+0000 7fb76f7fe700 1 -- 172.21.15.47:0/976125528 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11084 (secure 0 0 0) 0x7fb77c0568d0 con 0x7fb788070be0 2024-02-07T12:21:53.898 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:21:53.898 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":41,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","created":"2024-02-07T12:16:03.682077+0000","modified":"2024-02-07T12:21:34.305073+0000","last_up_change":"2024-02-07T12:21:33.301075+0000","last_in_change":"2024-02-07T12:21:14.657544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-07T12:20:21.191001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b37bbc00-7240-422a-977b-c7a9687ce87f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6803","nonce":3625841997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6805","nonce":3625841997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6809","nonce":3625841997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6807","nonce":3625841997}]},"public_addr":"172.21.15.47:6803/3625841997","cluster_addr":"172.21.15.47:6805/3625841997","heartbeat_back_addr":"172.21.15.47:6809/3625841997","heartbeat_front_addr":"172.21.15.47:6807/3625841997","state":["exists","up"]},{"osd":1,"uuid":"e6a42328-96ea-40de-987d-4edec38a4b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6811","nonce":3556866846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6813","nonce":3556866846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6817","nonce":3556866846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6815","nonce":3556866846}]},"public_addr":"172.21.15.47:6811/3556866846","cluster_addr":"172.21.15.47:6813/3556866846","heartbeat_back_addr":"172.21.15.47:6817/3556866846","heartbeat_front_addr":"172.21.15.47:6815/3556866846","state":["exists","up"]},{"osd":2,"uuid":"c8925cb3-0da0-4f01-90c3-1b6fb6e15331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6819","nonce":3651330024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6821","nonce":3651330024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6825","nonce":3651330024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6823","nonce":3651330024}]},"public_addr":"172.21.15.47:6819/3651330024","cluster_addr":"172.21.15.47:6821/3651330024","heartbeat_back_addr":"172.21.15.47:6825/3651330024","heartbeat_front_addr":"172.21.15.47:6823/3651330024","state":["exists","up"]},{"osd":3,"uuid":"47130a0a-e27f-4129-abbb-4bef9b460ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6801","nonce":2068429764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6803","nonce":2068429764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6807","nonce":2068429764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6805","nonce":2068429764}]},"public_addr":"172.21.15.138:6801/2068429764","cluster_addr":"172.21.15.138:6803/2068429764","heartbeat_back_addr":"172.21.15.138:6807/2068429764","heartbeat_front_addr":"172.21.15.138:6805/2068429764","state":["exists","up"]},{"osd":4,"uuid":"103459b7-4883-4248-a64d-21c396324237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6809","nonce":873394890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6811","nonce":873394890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6815","nonce":873394890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6813","nonce":873394890}]},"public_addr":"172.21.15.138:6809/873394890","cluster_addr":"172.21.15.138:6811/873394890","heartbeat_back_addr":"172.21.15.138:6815/873394890","heartbeat_front_addr":"172.21.15.138:6813/873394890","state":["exists","up"]},{"osd":5,"uuid":"e8acb2ff-d0f5-4daf-82ee-6c4fddf1580d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6817","nonce":3475843019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6819","nonce":3475843019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6823","nonce":3475843019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6821","nonce":3475843019}]},"public_addr":"172.21.15.138:6817/3475843019","cluster_addr":"172.21.15.138:6819/3475843019","heartbeat_back_addr":"172.21.15.138:6823/3475843019","heartbeat_front_addr":"172.21.15.138:6821/3475843019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:19.518708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:48.503474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:17.112205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:41.349671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:06.347737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:31.635560+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3304641630":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/3586302931":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6801/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6800/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.47:0/3361862950":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6801/3304641630":"2024-02-08T12:18:06.849658+0000","172.21.15.47:6801/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/2757370866":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/3413297119":"2024-02-08T12:16:30.972957+0000","172.21.15.47:6800/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/3354208208":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/454079597":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/1415322117":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/2768201708":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/1918664197":"2024-02-08T12:17:02.806879+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-07T12:21:53.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.898+0000 7fb78d4be700 1 -- 172.21.15.47:0/976125528 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb770068f60 msgr2=0x7fb77006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:53.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.898+0000 7fb78d4be700 1 --2- 172.21.15.47:0/976125528 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb770068f60 0x7fb77006b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb778000c00 tx=0x7fb778009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:53.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.898+0000 7fb78d4be700 1 -- 172.21.15.47:0/976125528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb788070be0 msgr2=0x7fb7881161d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:53.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.898+0000 7fb78d4be700 1 --2- 172.21.15.47:0/976125528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb788070be0 0x7fb7881161d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00b790 tx=0x7fb77c009250 comp rx=0 tx=0).stop 2024-02-07T12:21:53.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.898+0000 7fb78d4be700 1 -- 172.21.15.47:0/976125528 shutdown_connections 2024-02-07T12:21:53.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.898+0000 7fb78d4be700 1 --2- 172.21.15.47:0/976125528 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb770068f60 0x7fb77006b410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:53.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.898+0000 7fb78d4be700 1 --2- 172.21.15.47:0/976125528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7880702d0 0x7fb788115c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:53.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.898+0000 7fb78d4be700 1 --2- 172.21.15.47:0/976125528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb788070be0 0x7fb7881161d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:53.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.898+0000 7fb78d4be700 1 -- 172.21.15.47:0/976125528 >> 172.21.15.47:0/976125528 conn(0x7fb7880f8af0 msgr2=0x7fb788103af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:53.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.898+0000 7fb78d4be700 1 -- 172.21.15.47:0/976125528 shutdown_connections 2024-02-07T12:21:53.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:53.898+0000 7fb78d4be700 1 -- 172.21.15.47:0/976125528 wait complete. 2024-02-07T12:21:54.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:54 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/976125528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:21:54.720 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-07T12:21:54.720 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph osd dump --format=json 2024-02-07T12:21:54.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:54 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/976125528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:21:54.983 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:21:55.411 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:55 smithi047 ceph-mon[28972]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:55.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:55 smithi138 ceph-mon[35528]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:56.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.567+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/341856876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb4101e40 msgr2=0x7f3fb4102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:56.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.567+0000 7f3fb9ba4700 1 --2- 172.21.15.47:0/341856876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb4101e40 0x7f3fb4102210 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4004940 tx=0x7f3fa4009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:56.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.567+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/341856876 shutdown_connections 2024-02-07T12:21:56.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.567+0000 7f3fb9ba4700 1 --2- 172.21.15.47:0/341856876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fb41027e0 0x7f3fb40fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:56.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.567+0000 7f3fb9ba4700 1 --2- 172.21.15.47:0/341856876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb4101e40 0x7f3fb4102210 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.567+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/341856876 >> 172.21.15.47:0/341856876 conn(0x7f3fb4071d90 msgr2=0x7f3fb4072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.567+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/341856876 shutdown_connections 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.567+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/341856876 wait complete. 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.568+0000 7f3fb9ba4700 1 Processor -- start 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.568+0000 7f3fb9ba4700 1 -- start start 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.568+0000 7f3fb9ba4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb4101e40 0x7f3fb410eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.568+0000 7f3fb9ba4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fb41027e0 0x7f3fb410eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.568+0000 7f3fb9ba4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb410f610 con 0x7f3fb4101e40 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.568+0000 7f3fb9ba4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb410f780 con 0x7f3fb41027e0 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.568+0000 7f3fb37fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb4101e40 0x7f3fb410eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.568+0000 7f3fb37fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb4101e40 0x7f3fb410eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38464/0 (socket says 172.21.15.47:38464) 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.568+0000 7f3fb37fe700 1 -- 172.21.15.47:0/2435503349 learned_addr learned my addr 172.21.15.47:0/2435503349 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.568+0000 7f3fb37fe700 1 -- 172.21.15.47:0/2435503349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fb41027e0 msgr2=0x7f3fb410eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:56.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.568+0000 7f3fb37fe700 1 --2- 172.21.15.47:0/2435503349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fb41027e0 0x7f3fb410eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:56.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.568+0000 7f3fb37fe700 1 -- 172.21.15.47:0/2435503349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa4005040 con 0x7f3fb4101e40 2024-02-07T12:21:56.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.569+0000 7f3fb37fe700 1 --2- 172.21.15.47:0/2435503349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb4101e40 0x7f3fb410eab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400b8b0 tx=0x7f3fa4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:56.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.569+0000 7f3f9bfff700 1 -- 172.21.15.47:0/2435503349 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa400e040 con 0x7f3fb4101e40 2024-02-07T12:21:56.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.569+0000 7f3f9bfff700 1 -- 172.21.15.47:0/2435503349 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3fa400bbf0 con 0x7f3fb4101e40 2024-02-07T12:21:56.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.569+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/2435503349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb4117a70 con 0x7f3fb4101e40 2024-02-07T12:21:56.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.569+0000 7f3f9bfff700 1 -- 172.21.15.47:0/2435503349 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa401c630 con 0x7f3fb4101e40 2024-02-07T12:21:56.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.569+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/2435503349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb4117fb0 con 0x7f3fb4101e40 2024-02-07T12:21:56.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.570+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/2435503349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb40738b0 con 0x7f3fb4101e40 2024-02-07T12:21:56.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.570+0000 7f3f9bfff700 1 -- 172.21.15.47:0/2435503349 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3fa400bd60 con 0x7f3fb4101e40 2024-02-07T12:21:56.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.571+0000 7f3f9bfff700 1 --2- 172.21.15.47:0/2435503349 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3f9c068f60 0x7f3f9c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:21:56.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.571+0000 7f3f9bfff700 1 -- 172.21.15.47:0/2435503349 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3fa4087e40 con 0x7f3fb4101e40 2024-02-07T12:21:56.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.571+0000 7f3fb2ffd700 1 --2- 172.21.15.47:0/2435503349 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3f9c068f60 0x7f3f9c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:21:56.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.571+0000 7f3fb2ffd700 1 --2- 172.21.15.47:0/2435503349 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3f9c068f60 0x7f3f9c06b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8006fd0 tx=0x7f3fa8006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:21:56.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.575+0000 7f3f9bfff700 1 -- 172.21.15.47:0/2435503349 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3fa4054700 con 0x7f3fb4101e40 2024-02-07T12:21:56.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.766+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/2435503349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fb4066020 con 0x7f3fb4101e40 2024-02-07T12:21:56.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.767+0000 7f3f9bfff700 1 -- 172.21.15.47:0/2435503349 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11084 (secure 0 0 0) 0x7f3fb4066020 con 0x7f3fb4101e40 2024-02-07T12:21:56.769 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:21:56.770 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":41,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","created":"2024-02-07T12:16:03.682077+0000","modified":"2024-02-07T12:21:34.305073+0000","last_up_change":"2024-02-07T12:21:33.301075+0000","last_in_change":"2024-02-07T12:21:14.657544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-07T12:20:21.191001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b37bbc00-7240-422a-977b-c7a9687ce87f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6803","nonce":3625841997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6805","nonce":3625841997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6809","nonce":3625841997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6807","nonce":3625841997}]},"public_addr":"172.21.15.47:6803/3625841997","cluster_addr":"172.21.15.47:6805/3625841997","heartbeat_back_addr":"172.21.15.47:6809/3625841997","heartbeat_front_addr":"172.21.15.47:6807/3625841997","state":["exists","up"]},{"osd":1,"uuid":"e6a42328-96ea-40de-987d-4edec38a4b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6811","nonce":3556866846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6813","nonce":3556866846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6817","nonce":3556866846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6815","nonce":3556866846}]},"public_addr":"172.21.15.47:6811/3556866846","cluster_addr":"172.21.15.47:6813/3556866846","heartbeat_back_addr":"172.21.15.47:6817/3556866846","heartbeat_front_addr":"172.21.15.47:6815/3556866846","state":["exists","up"]},{"osd":2,"uuid":"c8925cb3-0da0-4f01-90c3-1b6fb6e15331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6819","nonce":3651330024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6821","nonce":3651330024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6825","nonce":3651330024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6823","nonce":3651330024}]},"public_addr":"172.21.15.47:6819/3651330024","cluster_addr":"172.21.15.47:6821/3651330024","heartbeat_back_addr":"172.21.15.47:6825/3651330024","heartbeat_front_addr":"172.21.15.47:6823/3651330024","state":["exists","up"]},{"osd":3,"uuid":"47130a0a-e27f-4129-abbb-4bef9b460ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6801","nonce":2068429764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6803","nonce":2068429764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6807","nonce":2068429764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6805","nonce":2068429764}]},"public_addr":"172.21.15.138:6801/2068429764","cluster_addr":"172.21.15.138:6803/2068429764","heartbeat_back_addr":"172.21.15.138:6807/2068429764","heartbeat_front_addr":"172.21.15.138:6805/2068429764","state":["exists","up"]},{"osd":4,"uuid":"103459b7-4883-4248-a64d-21c396324237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6809","nonce":873394890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6811","nonce":873394890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6815","nonce":873394890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6813","nonce":873394890}]},"public_addr":"172.21.15.138:6809/873394890","cluster_addr":"172.21.15.138:6811/873394890","heartbeat_back_addr":"172.21.15.138:6815/873394890","heartbeat_front_addr":"172.21.15.138:6813/873394890","state":["exists","up"]},{"osd":5,"uuid":"e8acb2ff-d0f5-4daf-82ee-6c4fddf1580d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6817","nonce":3475843019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6819","nonce":3475843019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6823","nonce":3475843019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6821","nonce":3475843019}]},"public_addr":"172.21.15.138:6817/3475843019","cluster_addr":"172.21.15.138:6819/3475843019","heartbeat_back_addr":"172.21.15.138:6823/3475843019","heartbeat_front_addr":"172.21.15.138:6821/3475843019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:19.518708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:48.503474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:17.112205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:41.349671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:06.347737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:31.635560+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3304641630":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/3586302931":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6801/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6800/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.47:0/3361862950":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6801/3304641630":"2024-02-08T12:18:06.849658+0000","172.21.15.47:6801/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/2757370866":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/3413297119":"2024-02-08T12:16:30.972957+0000","172.21.15.47:6800/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/3354208208":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/454079597":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/1415322117":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/2768201708":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/1918664197":"2024-02-08T12:17:02.806879+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-07T12:21:56.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.769+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/2435503349 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3f9c068f60 msgr2=0x7f3f9c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:56.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.769+0000 7f3fb9ba4700 1 --2- 172.21.15.47:0/2435503349 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3f9c068f60 0x7f3f9c06b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8006fd0 tx=0x7f3fa8006db0 comp rx=0 tx=0).stop 2024-02-07T12:21:56.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.769+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/2435503349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb4101e40 msgr2=0x7f3fb410eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:21:56.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.769+0000 7f3fb9ba4700 1 --2- 172.21.15.47:0/2435503349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb4101e40 0x7f3fb410eab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400b8b0 tx=0x7f3fa4009e30 comp rx=0 tx=0).stop 2024-02-07T12:21:56.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.769+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/2435503349 shutdown_connections 2024-02-07T12:21:56.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.769+0000 7f3fb9ba4700 1 --2- 172.21.15.47:0/2435503349 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3f9c068f60 0x7f3f9c06b410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:56.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.769+0000 7f3fb9ba4700 1 --2- 172.21.15.47:0/2435503349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb4101e40 0x7f3fb410eab0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:56.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.769+0000 7f3fb9ba4700 1 --2- 172.21.15.47:0/2435503349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fb41027e0 0x7f3fb410eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:21:56.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.769+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/2435503349 >> 172.21.15.47:0/2435503349 conn(0x7f3fb4071d90 msgr2=0x7f3fb40fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:21:56.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.769+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/2435503349 shutdown_connections 2024-02-07T12:21:56.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:21:56.769+0000 7f3fb9ba4700 1 -- 172.21.15.47:0/2435503349 wait complete. 2024-02-07T12:21:57.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:56 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2435503349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:21:57.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:56 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2435503349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:21:57.430 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-07T12:21:57.431 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-07T12:21:57.431 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-07T12:21:57.432 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-07T12:21:57.432 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-07T12:21:57.433 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-07T12:21:57.758 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:21:57.759 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:21:58.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:57 smithi047 ceph-mon[28972]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:58.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:57 smithi138 ceph-mon[35528]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:21:59.229 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:21:59.230 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:21:59.658 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:21:59.660 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:00.184 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:21:59 smithi047 ceph-mon[28972]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:00.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:21:59 smithi138 ceph-mon[35528]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:01.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:01 smithi047 ceph-mon[28972]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:01.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:01 smithi138 ceph-mon[35528]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:03.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.199+0000 7f99327b5700 1 -- 172.21.15.47:0/4250546527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f992c101e60 msgr2=0x7f992c102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:03.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.199+0000 7f99327b5700 1 --2- 172.21.15.47:0/4250546527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f992c101e60 0x7f992c102230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f991c004940 tx=0x7f991c009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:03.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.199+0000 7f99327b5700 1 -- 172.21.15.47:0/4250546527 shutdown_connections 2024-02-07T12:22:03.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.199+0000 7f99327b5700 1 --2- 172.21.15.47:0/4250546527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f992c102800 0x7f992c0fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:03.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.199+0000 7f99327b5700 1 --2- 172.21.15.47:0/4250546527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f992c101e60 0x7f992c102230 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:03.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.199+0000 7f99327b5700 1 -- 172.21.15.47:0/4250546527 >> 172.21.15.47:0/4250546527 conn(0x7f992c0f7a10 msgr2=0x7f992c0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:03.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.199+0000 7f99327b5700 1 -- 172.21.15.47:0/4250546527 shutdown_connections 2024-02-07T12:22:03.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.199+0000 7f99327b5700 1 -- 172.21.15.47:0/4250546527 wait complete. 2024-02-07T12:22:03.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.199+0000 7f99327b5700 1 Processor -- start 2024-02-07T12:22:03.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.200+0000 7f99327b5700 1 -- start start 2024-02-07T12:22:03.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.200+0000 7f99327b5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f992c101e60 0x7f992c112a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:03.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.200+0000 7f99327b5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f992c102800 0x7f992c112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:03.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.200+0000 7f99327b5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c1135a0 con 0x7f992c102800 2024-02-07T12:22:03.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.200+0000 7f99327b5700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c10c8d0 con 0x7f992c101e60 2024-02-07T12:22:03.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.200+0000 7f992b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f992c102800 0x7f992c112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:03.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.200+0000 7f992b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f992c102800 0x7f992c112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35484/0 (socket says 172.21.15.47:35484) 2024-02-07T12:22:03.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.200+0000 7f992b7fe700 1 -- 172.21.15.47:0/3805337882 learned_addr learned my addr 172.21.15.47:0/3805337882 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:03.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.200+0000 7f992bfff700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f992c101e60 0x7f992c112a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:03.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.200+0000 7f992b7fe700 1 -- 172.21.15.47:0/3805337882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f992c101e60 msgr2=0x7f992c112a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:03.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.200+0000 7f992b7fe700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f992c101e60 0x7f992c112a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:03.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.200+0000 7f992b7fe700 1 -- 172.21.15.47:0/3805337882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c005040 con 0x7f992c102800 2024-02-07T12:22:03.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.200+0000 7f992b7fe700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f992c102800 0x7f992c112f50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9920002a50 tx=0x7f9920004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:03.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.201+0000 7f9928ff9700 1 -- 172.21.15.47:0/3805337882 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9920007cc0 con 0x7f992c102800 2024-02-07T12:22:03.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.201+0000 7f99327b5700 1 -- 172.21.15.47:0/3805337882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992c10cbb0 con 0x7f992c102800 2024-02-07T12:22:03.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.201+0000 7f9928ff9700 1 -- 172.21.15.47:0/3805337882 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f992000f040 con 0x7f992c102800 2024-02-07T12:22:03.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.201+0000 7f9928ff9700 1 -- 172.21.15.47:0/3805337882 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f992000da40 con 0x7f992c102800 2024-02-07T12:22:03.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.201+0000 7f99327b5700 1 -- 172.21.15.47:0/3805337882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992c10d0f0 con 0x7f992c102800 2024-02-07T12:22:03.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.202+0000 7f99327b5700 1 -- 172.21.15.47:0/3805337882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f992c10d5a0 con 0x7f992c102800 2024-02-07T12:22:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.202+0000 7f9928ff9700 1 -- 172.21.15.47:0/3805337882 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f99200097c0 con 0x7f992c102800 2024-02-07T12:22:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.203+0000 7f9928ff9700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9914068f60 0x7f991406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.203+0000 7f9928ff9700 1 -- 172.21.15.47:0/3805337882 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f99200867c0 con 0x7f992c102800 2024-02-07T12:22:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.203+0000 7f992bfff700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9914068f60 0x7f991406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.203+0000 7f9928ff9700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997] conn(0x7f991406ec30 0x7f9914071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.203+0000 7f9928ff9700 1 -- 172.21.15.47:0/3805337882 --> [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99140716f0 con 0x7f991406ec30 2024-02-07T12:22:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.203+0000 7f9928ff9700 1 -- 172.21.15.47:0/3805337882 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9920088db0 con 0x7f992c102800 2024-02-07T12:22:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.203+0000 7f9930d52700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997] conn(0x7f991406ec30 0x7f9914071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.203+0000 7f992bfff700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9914068f60 0x7f991406b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f991c004f90 tx=0x7f991c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.203+0000 7f9930d52700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997] conn(0x7f991406ec30 0x7f9914071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.204+0000 7f9928ff9700 1 -- 172.21.15.47:0/3805337882 <== osd.0 v2:172.21.15.47:6802/3625841997 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f99140716f0 con 0x7f991406ec30 2024-02-07T12:22:03.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.219+0000 7f99327b5700 1 -- 172.21.15.47:0/3805337882 --> [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f992c05e610 con 0x7f991406ec30 2024-02-07T12:22:03.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.219+0000 7f9928ff9700 1 -- 172.21.15.47:0/3805337882 <== osd.0 v2:172.21.15.47:6802/3625841997 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f992c05e610 con 0x7f991406ec30 2024-02-07T12:22:03.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 -- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997] conn(0x7f991406ec30 msgr2=0x7f9914071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:03.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997] conn(0x7f991406ec30 0x7f9914071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:03.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 -- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9914068f60 msgr2=0x7f991406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:03.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9914068f60 0x7f991406b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f991c004f90 tx=0x7f991c009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:03.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 -- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f992c102800 msgr2=0x7f992c112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:03.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f992c102800 0x7f992c112f50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9920002a50 tx=0x7f9920004600 comp rx=0 tx=0).stop 2024-02-07T12:22:03.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 -- 172.21.15.47:0/3805337882 shutdown_connections 2024-02-07T12:22:03.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:6802/3625841997,v1:172.21.15.47:6803/3625841997] conn(0x7f991406ec30 0x7f9914071040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:03.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9914068f60 0x7f991406b410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:03.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f992c101e60 0x7f992c112a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:03.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 --2- 172.21.15.47:0/3805337882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f992c102800 0x7f992c112f50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:03.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 -- 172.21.15.47:0/3805337882 >> 172.21.15.47:0/3805337882 conn(0x7f992c0f7a10 msgr2=0x7f992c0f9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:03.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 -- 172.21.15.47:0/3805337882 shutdown_connections 2024-02-07T12:22:03.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:03.220+0000 7f99327b5700 1 -- 172.21.15.47:0/3805337882 wait complete. 2024-02-07T12:22:04.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:03 smithi138 ceph-mon[35528]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:04.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:03 smithi047 ceph-mon[28972]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:05.081 INFO:teuthology.orchestra.run.smithi047.stdout:38654705700 2024-02-07T12:22:05.082 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-07T12:22:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.490+0000 7f5414dd3700 1 -- 172.21.15.47:0/574094278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54101038f0 msgr2=0x7f54100fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.490+0000 7f5414dd3700 1 --2- 172.21.15.47:0/574094278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54101038f0 0x7f54100fcf60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5404004940 tx=0x7f5404009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.490+0000 7f5414dd3700 1 -- 172.21.15.47:0/574094278 shutdown_connections 2024-02-07T12:22:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.490+0000 7f5414dd3700 1 --2- 172.21.15.47:0/574094278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54101038f0 0x7f54100fcf60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.490+0000 7f5414dd3700 1 --2- 172.21.15.47:0/574094278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5410102f50 0x7f5410103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.490+0000 7f5414dd3700 1 -- 172.21.15.47:0/574094278 >> 172.21.15.47:0/574094278 conn(0x7f54100f8ae0 msgr2=0x7f54100faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.490+0000 7f5414dd3700 1 -- 172.21.15.47:0/574094278 shutdown_connections 2024-02-07T12:22:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.490+0000 7f5414dd3700 1 -- 172.21.15.47:0/574094278 wait complete. 2024-02-07T12:22:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f5414dd3700 1 Processor -- start 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f5414dd3700 1 -- start start 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f5414dd3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5410102f50 0x7f5410113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f5414dd3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54101038f0 0x7f5410113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f5414dd3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5410114590 con 0x7f5410102f50 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f5414dd3700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541010d930 con 0x7f54101038f0 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f540e59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5410102f50 0x7f5410113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f540e59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5410102f50 0x7f5410113a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35494/0 (socket says 172.21.15.47:35494) 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f540e59c700 1 -- 172.21.15.47:0/831729732 learned_addr learned my addr 172.21.15.47:0/831729732 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f540dd9b700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54101038f0 0x7f5410113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f540e59c700 1 -- 172.21.15.47:0/831729732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54101038f0 msgr2=0x7f5410113f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f540e59c700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54101038f0 0x7f5410113f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f540e59c700 1 -- 172.21.15.47:0/831729732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404005040 con 0x7f5410102f50 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f540dd9b700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54101038f0 0x7f5410113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.491+0000 7f540e59c700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5410102f50 0x7f5410113a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f540000c8c0 tx=0x7f54000044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.492+0000 7f53feffd700 1 -- 172.21.15.47:0/831729732 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f540000a980 con 0x7f5410102f50 2024-02-07T12:22:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.492+0000 7f5414dd3700 1 -- 172.21.15.47:0/831729732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541010dc10 con 0x7f5410102f50 2024-02-07T12:22:05.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.492+0000 7f53feffd700 1 -- 172.21.15.47:0/831729732 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f540000ce60 con 0x7f5410102f50 2024-02-07T12:22:05.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.492+0000 7f53feffd700 1 -- 172.21.15.47:0/831729732 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54000115e0 con 0x7f5410102f50 2024-02-07T12:22:05.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.492+0000 7f5414dd3700 1 -- 172.21.15.47:0/831729732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541010e150 con 0x7f5410102f50 2024-02-07T12:22:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.493+0000 7f5414dd3700 1 -- 172.21.15.47:0/831729732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f541010e690 con 0x7f5410102f50 2024-02-07T12:22:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.493+0000 7f53feffd700 1 -- 172.21.15.47:0/831729732 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5400012400 con 0x7f5410102f50 2024-02-07T12:22:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.494+0000 7f53feffd700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f53f8068f60 0x7f53f806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.494+0000 7f540dd9b700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f53f8068f60 0x7f53f806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.494+0000 7f53feffd700 1 -- 172.21.15.47:0/831729732 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5400086b60 con 0x7f5410102f50 2024-02-07T12:22:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.494+0000 7f53feffd700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890] conn(0x7f53f806ec30 0x7f53f8071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.494+0000 7f53feffd700 1 -- 172.21.15.47:0/831729732 --> [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53f80716f0 con 0x7f53f806ec30 2024-02-07T12:22:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.494+0000 7f53feffd700 1 -- 172.21.15.47:0/831729732 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f540008b220 con 0x7f5410102f50 2024-02-07T12:22:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.494+0000 7f540dd9b700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f53f8068f60 0x7f53f806b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f540400b3b0 tx=0x7f5404009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.494+0000 7f540ed9d700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890] conn(0x7f53f806ec30 0x7f53f8071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:05.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.495+0000 7f540ed9d700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890] conn(0x7f53f806ec30 0x7f53f8071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:05.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.496+0000 7f53feffd700 1 -- 172.21.15.47:0/831729732 <== osd.4 v2:172.21.15.138:6808/873394890 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f53f80716f0 con 0x7f53f806ec30 2024-02-07T12:22:05.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.511+0000 7f5414dd3700 1 -- 172.21.15.47:0/831729732 --> [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f541005e6c0 con 0x7f53f806ec30 2024-02-07T12:22:05.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.512+0000 7f53feffd700 1 -- 172.21.15.47:0/831729732 <== osd.4 v2:172.21.15.138:6808/873394890 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f541005e6c0 con 0x7f53f806ec30 2024-02-07T12:22:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.512+0000 7f5414dd3700 1 -- 172.21.15.47:0/831729732 >> [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890] conn(0x7f53f806ec30 msgr2=0x7f53f8071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.512+0000 7f5414dd3700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890] conn(0x7f53f806ec30 0x7f53f8071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.512+0000 7f5414dd3700 1 -- 172.21.15.47:0/831729732 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f53f8068f60 msgr2=0x7f53f806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.512+0000 7f5414dd3700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f53f8068f60 0x7f53f806b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f540400b3b0 tx=0x7f5404009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.512+0000 7f5414dd3700 1 -- 172.21.15.47:0/831729732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5410102f50 msgr2=0x7f5410113a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.512+0000 7f5414dd3700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5410102f50 0x7f5410113a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f540000c8c0 tx=0x7f54000044c0 comp rx=0 tx=0).stop 2024-02-07T12:22:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.512+0000 7f5414dd3700 1 -- 172.21.15.47:0/831729732 shutdown_connections 2024-02-07T12:22:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.512+0000 7f5414dd3700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f53f8068f60 0x7f53f806b410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.512+0000 7f5414dd3700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5410102f50 0x7f5410113a00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.513+0000 7f5414dd3700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.138:6808/873394890,v1:172.21.15.138:6809/873394890] conn(0x7f53f806ec30 0x7f53f8071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.513+0000 7f5414dd3700 1 --2- 172.21.15.47:0/831729732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54101038f0 0x7f5410113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.513+0000 7f5414dd3700 1 -- 172.21.15.47:0/831729732 >> 172.21.15.47:0/831729732 conn(0x7f54100f8ae0 msgr2=0x7f54100fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.513+0000 7f5414dd3700 1 -- 172.21.15.47:0/831729732 shutdown_connections 2024-02-07T12:22:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:05.513+0000 7f5414dd3700 1 -- 172.21.15.47:0/831729732 wait complete. 2024-02-07T12:22:06.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:05 smithi138 ceph-mon[35528]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:06.311 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:05 smithi047 ceph-mon[28972]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:06.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.412+0000 7f7f005b8700 1 -- 172.21.15.47:0/4188633314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef81027e0 msgr2=0x7f7ef80fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:06.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.412+0000 7f7f005b8700 1 --2- 172.21.15.47:0/4188633314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef81027e0 0x7f7ef80fbea0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8004940 tx=0x7f7ee8009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:06.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.413+0000 7f7f005b8700 1 -- 172.21.15.47:0/4188633314 shutdown_connections 2024-02-07T12:22:06.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.413+0000 7f7f005b8700 1 --2- 172.21.15.47:0/4188633314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef81027e0 0x7f7ef80fbea0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:06.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.413+0000 7f7f005b8700 1 --2- 172.21.15.47:0/4188633314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ef8101e40 0x7f7ef8102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:06.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.413+0000 7f7f005b8700 1 -- 172.21.15.47:0/4188633314 >> 172.21.15.47:0/4188633314 conn(0x7f7ef8071d90 msgr2=0x7f7ef8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:06.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.413+0000 7f7f005b8700 1 -- 172.21.15.47:0/4188633314 shutdown_connections 2024-02-07T12:22:06.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.413+0000 7f7f005b8700 1 -- 172.21.15.47:0/4188633314 wait complete. 2024-02-07T12:22:06.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.413+0000 7f7f005b8700 1 Processor -- start 2024-02-07T12:22:06.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.413+0000 7f7f005b8700 1 -- start start 2024-02-07T12:22:06.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.413+0000 7f7f005b8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ef8101e40 0x7f7ef810eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:06.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.413+0000 7f7f005b8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef81027e0 0x7f7ef810f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:06.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.413+0000 7f7f005b8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef810f600 con 0x7f7ef81027e0 2024-02-07T12:22:06.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.413+0000 7f7f005b8700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef810f770 con 0x7f7ef8101e40 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.414+0000 7f7efdb53700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef81027e0 0x7f7ef810f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.414+0000 7f7efdb53700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef81027e0 0x7f7ef810f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35504/0 (socket says 172.21.15.47:35504) 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.414+0000 7f7efdb53700 1 -- 172.21.15.47:0/1057812928 learned_addr learned my addr 172.21.15.47:0/1057812928 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.414+0000 7f7efe354700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ef8101e40 0x7f7ef810eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.414+0000 7f7efdb53700 1 -- 172.21.15.47:0/1057812928 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ef8101e40 msgr2=0x7f7ef810eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.414+0000 7f7efdb53700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ef8101e40 0x7f7ef810eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.414+0000 7f7efdb53700 1 -- 172.21.15.47:0/1057812928 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee8005040 con 0x7f7ef81027e0 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.414+0000 7f7efdb53700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef81027e0 0x7f7ef810f050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80090d0 tx=0x7f7ee8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.414+0000 7f7eeeffd700 1 -- 172.21.15.47:0/1057812928 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee800e040 con 0x7f7ef81027e0 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.414+0000 7f7eeeffd700 1 -- 172.21.15.47:0/1057812928 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ee8009430 con 0x7f7ef81027e0 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.414+0000 7f7f005b8700 1 -- 172.21.15.47:0/1057812928 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef8117a80 con 0x7f7ef81027e0 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.414+0000 7f7eeeffd700 1 -- 172.21.15.47:0/1057812928 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee801c3f0 con 0x7f7ef81027e0 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.414+0000 7f7f005b8700 1 -- 172.21.15.47:0/1057812928 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef8117f90 con 0x7f7ef81027e0 2024-02-07T12:22:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.415+0000 7f7f005b8700 1 -- 172.21.15.47:0/1057812928 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ef805e610 con 0x7f7ef81027e0 2024-02-07T12:22:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.416+0000 7f7eeeffd700 1 -- 172.21.15.47:0/1057812928 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7ee800bbf0 con 0x7f7ef81027e0 2024-02-07T12:22:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.416+0000 7f7eeeffd700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7ee4068f60 0x7f7ee406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.416+0000 7f7eeeffd700 1 -- 172.21.15.47:0/1057812928 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7ee8087d10 con 0x7f7ef81027e0 2024-02-07T12:22:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.416+0000 7f7efe354700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7ee4068f60 0x7f7ee406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.416+0000 7f7eeeffd700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846] conn(0x7f7ee406ec30 0x7f7ee4071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.416+0000 7f7eeeffd700 1 -- 172.21.15.47:0/1057812928 --> [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ee40716f0 con 0x7f7ee406ec30 2024-02-07T12:22:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.416+0000 7f7eeeffd700 1 -- 172.21.15.47:0/1057812928 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ee808d310 con 0x7f7ef81027e0 2024-02-07T12:22:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.416+0000 7f7efeb55700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846] conn(0x7f7ee406ec30 0x7f7ee4071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.417+0000 7f7efe354700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7ee4068f60 0x7f7ee406b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4004eb0 tx=0x7f7ef400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.417+0000 7f7efeb55700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846] conn(0x7f7ee406ec30 0x7f7ee4071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.417+0000 7f7eeeffd700 1 -- 172.21.15.47:0/1057812928 <== osd.1 v2:172.21.15.47:6810/3556866846 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7ee40716f0 con 0x7f7ee406ec30 2024-02-07T12:22:06.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.432+0000 7f7f005b8700 1 -- 172.21.15.47:0/1057812928 --> [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ef805eac0 con 0x7f7ee406ec30 2024-02-07T12:22:06.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.432+0000 7f7eeeffd700 1 -- 172.21.15.47:0/1057812928 <== osd.1 v2:172.21.15.47:6810/3556866846 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ef805eac0 con 0x7f7ee406ec30 2024-02-07T12:22:06.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 -- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846] conn(0x7f7ee406ec30 msgr2=0x7f7ee4071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:06.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846] conn(0x7f7ee406ec30 0x7f7ee4071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:06.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 -- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7ee4068f60 msgr2=0x7f7ee406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:06.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7ee4068f60 0x7f7ee406b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4004eb0 tx=0x7f7ef400b040 comp rx=0 tx=0).stop 2024-02-07T12:22:06.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 -- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef81027e0 msgr2=0x7f7ef810f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:06.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef81027e0 0x7f7ef810f050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80090d0 tx=0x7f7ee8009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 -- 172.21.15.47:0/1057812928 shutdown_connections 2024-02-07T12:22:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:6810/3556866846,v1:172.21.15.47:6811/3556866846] conn(0x7f7ee406ec30 0x7f7ee4071040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7ee4068f60 0x7f7ee406b410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ef8101e40 0x7f7ef810eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 --2- 172.21.15.47:0/1057812928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef81027e0 0x7f7ef810f050 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 -- 172.21.15.47:0/1057812928 >> 172.21.15.47:0/1057812928 conn(0x7f7ef8071d90 msgr2=0x7f7ef80fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 -- 172.21.15.47:0/1057812928 shutdown_connections 2024-02-07T12:22:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:06.433+0000 7f7f005b8700 1 -- 172.21.15.47:0/1057812928 wait complete. 2024-02-07T12:22:07.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:06 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:22:07.318 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:22:07.752 INFO:teuthology.orchestra.run.smithi047.stdout:60129542173 2024-02-07T12:22:07.753 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-07T12:22:07.978 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:07 smithi047 ceph-mon[28972]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:08.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.163+0000 7f2c5347d700 1 -- 172.21.15.47:0/566254652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c4c101e40 msgr2=0x7f2c4c102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:08.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.163+0000 7f2c5347d700 1 --2- 172.21.15.47:0/566254652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c4c101e40 0x7f2c4c102210 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2c48004940 tx=0x7f2c48009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:08.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.163+0000 7f2c5347d700 1 -- 172.21.15.47:0/566254652 shutdown_connections 2024-02-07T12:22:08.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.163+0000 7f2c5347d700 1 --2- 172.21.15.47:0/566254652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c4c1027e0 0x7f2c4c0fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.163+0000 7f2c5347d700 1 --2- 172.21.15.47:0/566254652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c4c101e40 0x7f2c4c102210 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.163+0000 7f2c5347d700 1 -- 172.21.15.47:0/566254652 >> 172.21.15.47:0/566254652 conn(0x7f2c4c071d90 msgr2=0x7f2c4c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.163+0000 7f2c5347d700 1 -- 172.21.15.47:0/566254652 shutdown_connections 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.163+0000 7f2c5347d700 1 -- 172.21.15.47:0/566254652 wait complete. 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c5347d700 1 Processor -- start 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c5347d700 1 -- start start 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c5347d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c4c101e40 0x7f2c4c102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c5347d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c4c1027e0 0x7f2c4c1031e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c5347d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c103870 con 0x7f2c4c1027e0 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c5347d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c1039e0 con 0x7f2c4c101e40 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c50a18700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c4c1027e0 0x7f2c4c1031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c50a18700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c4c1027e0 0x7f2c4c1031e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35522/0 (socket says 172.21.15.47:35522) 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c50a18700 1 -- 172.21.15.47:0/505226640 learned_addr learned my addr 172.21.15.47:0/505226640 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:08.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c51219700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c4c101e40 0x7f2c4c102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:08.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c50a18700 1 -- 172.21.15.47:0/505226640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c4c101e40 msgr2=0x7f2c4c102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:08.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c50a18700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c4c101e40 0x7f2c4c102ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:08.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c50a18700 1 -- 172.21.15.47:0/505226640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c48005040 con 0x7f2c4c1027e0 2024-02-07T12:22:08.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.164+0000 7f2c50a18700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c4c1027e0 0x7f2c4c1031e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00b790 tx=0x7f2c3c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:08.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.165+0000 7f2c41ffb700 1 -- 172.21.15.47:0/505226640 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c3c00f6f0 con 0x7f2c4c1027e0 2024-02-07T12:22:08.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.165+0000 7f2c5347d700 1 -- 172.21.15.47:0/505226640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4c119d10 con 0x7f2c4c1027e0 2024-02-07T12:22:08.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.165+0000 7f2c41ffb700 1 -- 172.21.15.47:0/505226640 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c3c00fd20 con 0x7f2c4c1027e0 2024-02-07T12:22:08.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.165+0000 7f2c41ffb700 1 -- 172.21.15.47:0/505226640 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c3c0103a0 con 0x7f2c4c1027e0 2024-02-07T12:22:08.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.165+0000 7f2c5347d700 1 -- 172.21.15.47:0/505226640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4c11a200 con 0x7f2c4c1027e0 2024-02-07T12:22:08.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.166+0000 7f2c5347d700 1 -- 172.21.15.47:0/505226640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c4c0660b0 con 0x7f2c4c1027e0 2024-02-07T12:22:08.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.166+0000 7f2c41ffb700 1 -- 172.21.15.47:0/505226640 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2c3c011400 con 0x7f2c4c1027e0 2024-02-07T12:22:08.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.167+0000 7f2c41ffb700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2c38068f60 0x7f2c3806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:08.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.167+0000 7f2c51219700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2c38068f60 0x7f2c3806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:08.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.167+0000 7f2c41ffb700 1 -- 172.21.15.47:0/505226640 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2c3c0868f0 con 0x7f2c4c1027e0 2024-02-07T12:22:08.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.167+0000 7f2c41ffb700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764] conn(0x7f2c3806ec30 0x7f2c38071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:08.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.167+0000 7f2c41ffb700 1 -- 172.21.15.47:0/505226640 --> [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c380716f0 con 0x7f2c3806ec30 2024-02-07T12:22:08.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.167+0000 7f2c41ffb700 1 -- 172.21.15.47:0/505226640 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c3c08b220 con 0x7f2c4c1027e0 2024-02-07T12:22:08.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.167+0000 7f2c51219700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2c38068f60 0x7f2c3806b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2c48004f90 tx=0x7f2c48009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:08.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.167+0000 7f2c51a1a700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764] conn(0x7f2c3806ec30 0x7f2c38071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:08.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.168+0000 7f2c51a1a700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764] conn(0x7f2c3806ec30 0x7f2c38071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:08.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.168+0000 7f2c41ffb700 1 -- 172.21.15.47:0/505226640 <== osd.3 v2:172.21.15.138:6800/2068429764 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2c380716f0 con 0x7f2c3806ec30 2024-02-07T12:22:08.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.183+0000 7f2c5347d700 1 -- 172.21.15.47:0/505226640 --> [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c4c0738b0 con 0x7f2c3806ec30 2024-02-07T12:22:08.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.184+0000 7f2c41ffb700 1 -- 172.21.15.47:0/505226640 <== osd.3 v2:172.21.15.138:6800/2068429764 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2c4c0738b0 con 0x7f2c3806ec30 2024-02-07T12:22:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.184+0000 7f2c5347d700 1 -- 172.21.15.47:0/505226640 >> [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764] conn(0x7f2c3806ec30 msgr2=0x7f2c38071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.184+0000 7f2c5347d700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764] conn(0x7f2c3806ec30 0x7f2c38071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.184+0000 7f2c5347d700 1 -- 172.21.15.47:0/505226640 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2c38068f60 msgr2=0x7f2c3806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.184+0000 7f2c5347d700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2c38068f60 0x7f2c3806b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2c48004f90 tx=0x7f2c48009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.184+0000 7f2c5347d700 1 -- 172.21.15.47:0/505226640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c4c1027e0 msgr2=0x7f2c4c1031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.184+0000 7f2c5347d700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c4c1027e0 0x7f2c4c1031e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00b790 tx=0x7f2c3c009220 comp rx=0 tx=0).stop 2024-02-07T12:22:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.184+0000 7f2c5347d700 1 -- 172.21.15.47:0/505226640 shutdown_connections 2024-02-07T12:22:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.184+0000 7f2c5347d700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.138:6800/2068429764,v1:172.21.15.138:6801/2068429764] conn(0x7f2c3806ec30 0x7f2c38071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.184+0000 7f2c5347d700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f2c38068f60 0x7f2c3806b410 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.184+0000 7f2c5347d700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c4c101e40 0x7f2c4c102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.184+0000 7f2c5347d700 1 --2- 172.21.15.47:0/505226640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c4c1027e0 0x7f2c4c1031e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.184+0000 7f2c5347d700 1 -- 172.21.15.47:0/505226640 >> 172.21.15.47:0/505226640 conn(0x7f2c4c071d90 msgr2=0x7f2c4c0656e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:08.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.185+0000 7f2c5347d700 1 -- 172.21.15.47:0/505226640 shutdown_connections 2024-02-07T12:22:08.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:08.185+0000 7f2c5347d700 1 -- 172.21.15.47:0/505226640 wait complete. 2024-02-07T12:22:08.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:07 smithi138 ceph-mon[35528]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:08.837 INFO:teuthology.orchestra.run.smithi047.stdout:150323855373 2024-02-07T12:22:08.838 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-07T12:22:09.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.013+0000 7f18d9157700 1 -- 172.21.15.47:0/774662404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18d40fdfb0 msgr2=0x7f18d40fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:09.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.013+0000 7f18d9157700 1 --2- 172.21.15.47:0/774662404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18d40fdfb0 0x7f18d40fe380 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f18c4004940 tx=0x7f18c4009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:09.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.013+0000 7f18d9157700 1 -- 172.21.15.47:0/774662404 shutdown_connections 2024-02-07T12:22:09.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.013+0000 7f18d9157700 1 --2- 172.21.15.47:0/774662404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18d40fe950 0x7f18d4106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.013+0000 7f18d9157700 1 --2- 172.21.15.47:0/774662404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18d40fdfb0 0x7f18d40fe380 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.013+0000 7f18d9157700 1 -- 172.21.15.47:0/774662404 >> 172.21.15.47:0/774662404 conn(0x7f18d40f79e0 msgr2=0x7f18d40f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:09.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.013+0000 7f18d9157700 1 -- 172.21.15.47:0/774662404 shutdown_connections 2024-02-07T12:22:09.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.013+0000 7f18d9157700 1 -- 172.21.15.47:0/774662404 wait complete. 2024-02-07T12:22:09.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d9157700 1 Processor -- start 2024-02-07T12:22:09.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d9157700 1 -- start start 2024-02-07T12:22:09.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d9157700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18d40fdfb0 0x7f18d40fbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:09.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d9157700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18d40fe950 0x7f18d40fc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:09.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d9157700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40fc920 con 0x7f18d40fdfb0 2024-02-07T12:22:09.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d9157700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40fca90 con 0x7f18d40fe950 2024-02-07T12:22:09.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d2d9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18d40fdfb0 0x7f18d40fbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:09.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d2d9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18d40fdfb0 0x7f18d40fbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35542/0 (socket says 172.21.15.47:35542) 2024-02-07T12:22:09.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d2d9d700 1 -- 172.21.15.47:0/2314046225 learned_addr learned my addr 172.21.15.47:0/2314046225 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:09.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d259c700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18d40fe950 0x7f18d40fc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:09.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d2d9d700 1 -- 172.21.15.47:0/2314046225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18d40fe950 msgr2=0x7f18d40fc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:09.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d2d9d700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18d40fe950 0x7f18d40fc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d2d9d700 1 -- 172.21.15.47:0/2314046225 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4005040 con 0x7f18d40fdfb0 2024-02-07T12:22:09.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.014+0000 7f18d2d9d700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18d40fdfb0 0x7f18d40fbde0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f18c4000c00 tx=0x7f18c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:09.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.015+0000 7f18bb7fe700 1 -- 172.21.15.47:0/2314046225 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18c400e040 con 0x7f18d40fdfb0 2024-02-07T12:22:09.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.015+0000 7f18d9157700 1 -- 172.21.15.47:0/2314046225 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d4119bc0 con 0x7f18d40fdfb0 2024-02-07T12:22:09.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.015+0000 7f18bb7fe700 1 -- 172.21.15.47:0/2314046225 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f18c4009af0 con 0x7f18d40fdfb0 2024-02-07T12:22:09.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.015+0000 7f18bb7fe700 1 -- 172.21.15.47:0/2314046225 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18c401c630 con 0x7f18d40fdfb0 2024-02-07T12:22:09.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.015+0000 7f18d9157700 1 -- 172.21.15.47:0/2314046225 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d411a0a0 con 0x7f18d40fdfb0 2024-02-07T12:22:09.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.016+0000 7f18d9157700 1 -- 172.21.15.47:0/2314046225 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18d405e650 con 0x7f18d40fdfb0 2024-02-07T12:22:09.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.016+0000 7f18bb7fe700 1 -- 172.21.15.47:0/2314046225 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f18c400bbf0 con 0x7f18d40fdfb0 2024-02-07T12:22:09.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.017+0000 7f18bb7fe700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f18bc068f60 0x7f18bc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:09.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.017+0000 7f18bb7fe700 1 -- 172.21.15.47:0/2314046225 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f18c4087e30 con 0x7f18d40fdfb0 2024-02-07T12:22:09.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.017+0000 7f18d259c700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f18bc068f60 0x7f18bc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:09.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.017+0000 7f18bb7fe700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024] conn(0x7f18bc06ec30 0x7f18bc071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:09.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.017+0000 7f18bb7fe700 1 -- 172.21.15.47:0/2314046225 --> [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18bc0716f0 con 0x7f18bc06ec30 2024-02-07T12:22:09.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.017+0000 7f18bb7fe700 1 -- 172.21.15.47:0/2314046225 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18c408d430 con 0x7f18d40fdfb0 2024-02-07T12:22:09.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.017+0000 7f18d359e700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024] conn(0x7f18bc06ec30 0x7f18bc071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:09.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.017+0000 7f18d259c700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f18bc068f60 0x7f18bc06b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009b80 tx=0x7f18c800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:09.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.017+0000 7f18d359e700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024] conn(0x7f18bc06ec30 0x7f18bc071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:09.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.018+0000 7f18bb7fe700 1 -- 172.21.15.47:0/2314046225 <== osd.2 v2:172.21.15.47:6818/3651330024 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f18bc0716f0 con 0x7f18bc06ec30 2024-02-07T12:22:09.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.034+0000 7f18d9157700 1 -- 172.21.15.47:0/2314046225 --> [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18d405ea80 con 0x7f18bc06ec30 2024-02-07T12:22:09.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.034+0000 7f18bb7fe700 1 -- 172.21.15.47:0/2314046225 <== osd.2 v2:172.21.15.47:6818/3651330024 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f18d405ea80 con 0x7f18bc06ec30 2024-02-07T12:22:09.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.034+0000 7f18d9157700 1 -- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024] conn(0x7f18bc06ec30 msgr2=0x7f18bc071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:09.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.034+0000 7f18d9157700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024] conn(0x7f18bc06ec30 0x7f18bc071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.034+0000 7f18d9157700 1 -- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f18bc068f60 msgr2=0x7f18bc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:09.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.034+0000 7f18d9157700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f18bc068f60 0x7f18bc06b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009b80 tx=0x7f18c800b040 comp rx=0 tx=0).stop 2024-02-07T12:22:09.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.034+0000 7f18d9157700 1 -- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18d40fdfb0 msgr2=0x7f18d40fbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:09.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.034+0000 7f18d9157700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18d40fdfb0 0x7f18d40fbde0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f18c4000c00 tx=0x7f18c4009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:09.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.035+0000 7f18d9157700 1 -- 172.21.15.47:0/2314046225 shutdown_connections 2024-02-07T12:22:09.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.035+0000 7f18d9157700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:6818/3651330024,v1:172.21.15.47:6819/3651330024] conn(0x7f18bc06ec30 0x7f18bc071040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.035+0000 7f18d9157700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f18bc068f60 0x7f18bc06b410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.035+0000 7f18d9157700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18d40fdfb0 0x7f18d40fbde0 secure :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f18c4000c00 tx=0x7f18c4009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:09.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.035+0000 7f18d9157700 1 --2- 172.21.15.47:0/2314046225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18d40fe950 0x7f18d40fc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.035+0000 7f18d9157700 1 -- 172.21.15.47:0/2314046225 >> 172.21.15.47:0/2314046225 conn(0x7f18d40f79e0 msgr2=0x7f18d4101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:09.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.035+0000 7f18d9157700 1 -- 172.21.15.47:0/2314046225 shutdown_connections 2024-02-07T12:22:09.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.035+0000 7f18d9157700 1 -- 172.21.15.47:0/2314046225 wait complete. 2024-02-07T12:22:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.616+0000 7f8c69fbf700 1 -- 172.21.15.47:0/1561319496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c64101e40 msgr2=0x7f8c64102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.616+0000 7f8c69fbf700 1 --2- 172.21.15.47:0/1561319496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c64101e40 0x7f8c64102210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009ce0 tx=0x7f8c54004d10 comp rx=0 tx=0).stop 2024-02-07T12:22:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.616+0000 7f8c69fbf700 1 -- 172.21.15.47:0/1561319496 shutdown_connections 2024-02-07T12:22:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.616+0000 7f8c69fbf700 1 --2- 172.21.15.47:0/1561319496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c641027e0 0x7f8c640fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.616+0000 7f8c69fbf700 1 --2- 172.21.15.47:0/1561319496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c64101e40 0x7f8c64102210 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.616+0000 7f8c69fbf700 1 -- 172.21.15.47:0/1561319496 >> 172.21.15.47:0/1561319496 conn(0x7f8c64071d90 msgr2=0x7f8c64072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.616+0000 7f8c69fbf700 1 -- 172.21.15.47:0/1561319496 shutdown_connections 2024-02-07T12:22:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.616+0000 7f8c69fbf700 1 -- 172.21.15.47:0/1561319496 wait complete. 2024-02-07T12:22:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.616+0000 7f8c69fbf700 1 Processor -- start 2024-02-07T12:22:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c69fbf700 1 -- start start 2024-02-07T12:22:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c69fbf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c64101e40 0x7f8c6410ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c69fbf700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c641027e0 0x7f8c6410f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c69fbf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6410f7d0 con 0x7f8c64101e40 2024-02-07T12:22:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c69fbf700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6410f910 con 0x7f8c641027e0 2024-02-07T12:22:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c637fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c64101e40 0x7f8c6410ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c637fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c64101e40 0x7f8c6410ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39650/0 (socket says 172.21.15.47:39650) 2024-02-07T12:22:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c637fe700 1 -- 172.21.15.47:0/99729751 learned_addr learned my addr 172.21.15.47:0/99729751 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c637fe700 1 -- 172.21.15.47:0/99729751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c641027e0 msgr2=0x7f8c6410f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c62ffd700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c641027e0 0x7f8c6410f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c637fe700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c641027e0 0x7f8c6410f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c637fe700 1 -- 172.21.15.47:0/99729751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c54009940 con 0x7f8c64101e40 2024-02-07T12:22:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c62ffd700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c641027e0 0x7f8c6410f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:22:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.617+0000 7f8c637fe700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c64101e40 0x7f8c6410ec70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400bf60 tx=0x7f8c54004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.618+0000 7f8c5bfff700 1 -- 172.21.15.47:0/99729751 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c5400e040 con 0x7f8c64101e40 2024-02-07T12:22:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.618+0000 7f8c5bfff700 1 -- 172.21.15.47:0/99729751 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c54004610 con 0x7f8c64101e40 2024-02-07T12:22:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.618+0000 7f8c5bfff700 1 -- 172.21.15.47:0/99729751 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c5401c850 con 0x7f8c64101e40 2024-02-07T12:22:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.618+0000 7f8c69fbf700 1 -- 172.21.15.47:0/99729751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c64117be0 con 0x7f8c64101e40 2024-02-07T12:22:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.618+0000 7f8c69fbf700 1 -- 172.21.15.47:0/99729751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c64118120 con 0x7f8c64101e40 2024-02-07T12:22:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.619+0000 7f8c69fbf700 1 -- 172.21.15.47:0/99729751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c640fb700 con 0x7f8c64101e40 2024-02-07T12:22:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.619+0000 7f8c5bfff700 1 -- 172.21.15.47:0/99729751 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8c54012c00 con 0x7f8c64101e40 2024-02-07T12:22:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.619+0000 7f8c5bfff700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8c50068f70 0x7f8c5006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.620+0000 7f8c5bfff700 1 -- 172.21.15.47:0/99729751 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8c54088640 con 0x7f8c64101e40 2024-02-07T12:22:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.620+0000 7f8c62ffd700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8c50068f70 0x7f8c5006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.620+0000 7f8c5bfff700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019] conn(0x7f8c5006ec40 0x7f8c50071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.620+0000 7f8c5bfff700 1 -- 172.21.15.47:0/99729751 --> [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c50071700 con 0x7f8c5006ec40 2024-02-07T12:22:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.620+0000 7f8c5bfff700 1 -- 172.21.15.47:0/99729751 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c5408ac90 con 0x7f8c64101e40 2024-02-07T12:22:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.620+0000 7f8c63fff700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019] conn(0x7f8c5006ec40 0x7f8c50071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.620+0000 7f8c62ffd700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8c50068f70 0x7f8c5006b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c006fd0 tx=0x7f8c4c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:09.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.620+0000 7f8c63fff700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019] conn(0x7f8c5006ec40 0x7f8c50071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:09.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.621+0000 7f8c5bfff700 1 -- 172.21.15.47:0/99729751 <== osd.5 v2:172.21.15.138:6816/3475843019 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8c50071700 con 0x7f8c5006ec40 2024-02-07T12:22:09.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.636+0000 7f8c69fbf700 1 -- 172.21.15.47:0/99729751 --> [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c640738b0 con 0x7f8c5006ec40 2024-02-07T12:22:09.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c5bfff700 1 -- 172.21.15.47:0/99729751 <== osd.5 v2:172.21.15.138:6816/3475843019 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8c640738b0 con 0x7f8c5006ec40 2024-02-07T12:22:09.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 -- 172.21.15.47:0/99729751 >> [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019] conn(0x7f8c5006ec40 msgr2=0x7f8c50071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:09.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019] conn(0x7f8c5006ec40 0x7f8c50071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 -- 172.21.15.47:0/99729751 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8c50068f70 msgr2=0x7f8c5006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:09.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8c50068f70 0x7f8c5006b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c006fd0 tx=0x7f8c4c008040 comp rx=0 tx=0).stop 2024-02-07T12:22:09.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 -- 172.21.15.47:0/99729751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c64101e40 msgr2=0x7f8c6410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:09.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c64101e40 0x7f8c6410ec70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400bf60 tx=0x7f8c54004d10 comp rx=0 tx=0).stop 2024-02-07T12:22:09.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 -- 172.21.15.47:0/99729751 shutdown_connections 2024-02-07T12:22:09.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8c50068f70 0x7f8c5006b420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.138:6816/3475843019,v1:172.21.15.138:6817/3475843019] conn(0x7f8c5006ec40 0x7f8c50071050 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c64101e40 0x7f8c6410ec70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 --2- 172.21.15.47:0/99729751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c641027e0 0x7f8c6410f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:09.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 -- 172.21.15.47:0/99729751 >> 172.21.15.47:0/99729751 conn(0x7f8c64071d90 msgr2=0x7f8c640fad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:09.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 -- 172.21.15.47:0/99729751 shutdown_connections 2024-02-07T12:22:09.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:09.637+0000 7f8c69fbf700 1 -- 172.21.15.47:0/99729751 wait complete. 2024-02-07T12:22:10.172 INFO:teuthology.orchestra.run.smithi047.stdout:81604378649 2024-02-07T12:22:10.172 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-07T12:22:10.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:09 smithi138 ceph-mon[35528]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:10.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:09 smithi047 ceph-mon[28972]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:10.779 INFO:teuthology.orchestra.run.smithi047.stdout:171798691851 2024-02-07T12:22:10.779 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-07T12:22:11.190 INFO:teuthology.orchestra.run.smithi047.stdout:115964117012 2024-02-07T12:22:11.190 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-07T12:22:11.301 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:11.301 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:11.307 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:11.342 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:11.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:11 smithi047 ceph-mon[28972]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:11.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:11 smithi138 ceph-mon[35528]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:14.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:13 smithi047 ceph-mon[28972]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:14.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:13 smithi138 ceph-mon[35528]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:15.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.028+0000 7f96430df700 1 -- 172.21.15.47:0/57024634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f963c0fdfe0 msgr2=0x7f963c0fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:15.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.028+0000 7f96430df700 1 --2- 172.21.15.47:0/57024634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f963c0fdfe0 0x7f963c0fe3b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9630004970 tx=0x7f9630009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:15.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.028+0000 7f96430df700 1 -- 172.21.15.47:0/57024634 shutdown_connections 2024-02-07T12:22:15.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.028+0000 7f96430df700 1 --2- 172.21.15.47:0/57024634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f963c0fe8f0 0x7f963c107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.028+0000 7f96430df700 1 --2- 172.21.15.47:0/57024634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f963c0fdfe0 0x7f963c0fe3b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.028+0000 7f96430df700 1 -- 172.21.15.47:0/57024634 >> 172.21.15.47:0/57024634 conn(0x7f963c071d90 msgr2=0x7f963c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.028+0000 7f96430df700 1 -- 172.21.15.47:0/57024634 shutdown_connections 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.028+0000 7f96430df700 1 -- 172.21.15.47:0/57024634 wait complete. 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.028+0000 7f96430df700 1 Processor -- start 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.028+0000 7f96430df700 1 -- start start 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.029+0000 7f96430df700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f963c0fdfe0 0x7f963c113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.029+0000 7f96430df700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f963c0fe8f0 0x7f963c113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.029+0000 7f96430df700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c1145e0 con 0x7f963c0fdfe0 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.029+0000 7f96430df700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c10d910 con 0x7f963c0fe8f0 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.029+0000 7f9640e7b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f963c0fdfe0 0x7f963c113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.029+0000 7f9640e7b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f963c0fdfe0 0x7f963c113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39678/0 (socket says 172.21.15.47:39678) 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.029+0000 7f9640e7b700 1 -- 172.21.15.47:0/2709863950 learned_addr learned my addr 172.21.15.47:0/2709863950 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.029+0000 7f963bfff700 1 --2- 172.21.15.47:0/2709863950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f963c0fe8f0 0x7f963c113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.029+0000 7f9640e7b700 1 -- 172.21.15.47:0/2709863950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f963c0fe8f0 msgr2=0x7f963c113f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.029+0000 7f9640e7b700 1 --2- 172.21.15.47:0/2709863950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f963c0fe8f0 0x7f963c113f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.029+0000 7f9640e7b700 1 -- 172.21.15.47:0/2709863950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9630005040 con 0x7f963c0fdfe0 2024-02-07T12:22:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.029+0000 7f9640e7b700 1 --2- 172.21.15.47:0/2709863950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f963c0fdfe0 0x7f963c113a50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9630000c00 tx=0x7f9630009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.030+0000 7f96397fa700 1 -- 172.21.15.47:0/2709863950 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f963000e040 con 0x7f963c0fdfe0 2024-02-07T12:22:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.030+0000 7f96397fa700 1 -- 172.21.15.47:0/2709863950 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9630004290 con 0x7f963c0fdfe0 2024-02-07T12:22:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.030+0000 7f96430df700 1 -- 172.21.15.47:0/2709863950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f963c10db90 con 0x7f963c0fdfe0 2024-02-07T12:22:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.030+0000 7f96397fa700 1 -- 172.21.15.47:0/2709863950 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f963001c630 con 0x7f963c0fdfe0 2024-02-07T12:22:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.030+0000 7f96430df700 1 -- 172.21.15.47:0/2709863950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963c10e0d0 con 0x7f963c0fdfe0 2024-02-07T12:22:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.031+0000 7f96430df700 1 -- 172.21.15.47:0/2709863950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963c1046c0 con 0x7f963c0fdfe0 2024-02-07T12:22:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.031+0000 7f96397fa700 1 -- 172.21.15.47:0/2709863950 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9630013980 con 0x7f963c0fdfe0 2024-02-07T12:22:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.031+0000 7f96397fa700 1 --2- 172.21.15.47:0/2709863950 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f962c068f60 0x7f962c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.032+0000 7f96397fa700 1 -- 172.21.15.47:0/2709863950 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9630087d90 con 0x7f963c0fdfe0 2024-02-07T12:22:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.032+0000 7f963bfff700 1 --2- 172.21.15.47:0/2709863950 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f962c068f60 0x7f962c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.032+0000 7f963bfff700 1 --2- 172.21.15.47:0/2709863950 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f962c068f60 0x7f962c06b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9628007fd0 tx=0x7f9628009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:15.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.036+0000 7f96397fa700 1 -- 172.21.15.47:0/2709863950 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9630058030 con 0x7f963c0fdfe0 2024-02-07T12:22:15.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.230+0000 7f96430df700 1 -- 172.21.15.47:0/2709863950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f963c04bed0 con 0x7f963c0fdfe0 2024-02-07T12:22:15.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.230+0000 7f96397fa700 1 -- 172.21.15.47:0/2709863950 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9630057bc0 con 0x7f963c0fdfe0 2024-02-07T12:22:15.234 INFO:teuthology.orchestra.run.smithi047.stdout:38654705702 2024-02-07T12:22:15.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.232+0000 7f96430df700 1 -- 172.21.15.47:0/2709863950 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f962c068f60 msgr2=0x7f962c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:15.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.232+0000 7f96430df700 1 --2- 172.21.15.47:0/2709863950 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f962c068f60 0x7f962c06b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9628007fd0 tx=0x7f9628009040 comp rx=0 tx=0).stop 2024-02-07T12:22:15.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.232+0000 7f96430df700 1 -- 172.21.15.47:0/2709863950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f963c0fdfe0 msgr2=0x7f963c113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:15.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.232+0000 7f96430df700 1 --2- 172.21.15.47:0/2709863950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f963c0fdfe0 0x7f963c113a50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9630000c00 tx=0x7f9630009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:15.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.232+0000 7f96430df700 1 -- 172.21.15.47:0/2709863950 shutdown_connections 2024-02-07T12:22:15.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.232+0000 7f96430df700 1 --2- 172.21.15.47:0/2709863950 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f962c068f60 0x7f962c06b410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:15.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.232+0000 7f96430df700 1 --2- 172.21.15.47:0/2709863950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f963c0fdfe0 0x7f963c113a50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:15.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.232+0000 7f96430df700 1 --2- 172.21.15.47:0/2709863950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f963c0fe8f0 0x7f963c113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:15.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.232+0000 7f96430df700 1 -- 172.21.15.47:0/2709863950 >> 172.21.15.47:0/2709863950 conn(0x7f963c071d90 msgr2=0x7f963c101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:15.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.232+0000 7f96430df700 1 -- 172.21.15.47:0/2709863950 shutdown_connections 2024-02-07T12:22:15.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:15.232+0000 7f96430df700 1 -- 172.21.15.47:0/2709863950 wait complete. 2024-02-07T12:22:16.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:15 smithi047 ceph-mon[28972]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:16.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:15 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2709863950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-07T12:22:16.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:15 smithi138 ceph-mon[35528]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:16.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:15 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2709863950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-07T12:22:16.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.793+0000 7f3dcef2b700 1 -- 172.21.15.47:0/4264097628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc8101e60 msgr2=0x7f3dc8102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:16.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.793+0000 7f3dcef2b700 1 --2- 172.21.15.47:0/4264097628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc8101e60 0x7f3dc8102230 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc004940 tx=0x7f3dbc009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:16.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.793+0000 7f3dcef2b700 1 -- 172.21.15.47:0/4264097628 shutdown_connections 2024-02-07T12:22:16.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.793+0000 7f3dcef2b700 1 --2- 172.21.15.47:0/4264097628 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dc8102800 0x7f3dc80fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:16.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.793+0000 7f3dcef2b700 1 --2- 172.21.15.47:0/4264097628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc8101e60 0x7f3dc8102230 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:16.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.793+0000 7f3dcef2b700 1 -- 172.21.15.47:0/4264097628 >> 172.21.15.47:0/4264097628 conn(0x7f3dc80f7a10 msgr2=0x7f3dc80f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:16.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.793+0000 7f3dcef2b700 1 -- 172.21.15.47:0/4264097628 shutdown_connections 2024-02-07T12:22:16.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.793+0000 7f3dcef2b700 1 -- 172.21.15.47:0/4264097628 wait complete. 2024-02-07T12:22:16.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.794+0000 7f3dcef2b700 1 Processor -- start 2024-02-07T12:22:16.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.794+0000 7f3dcef2b700 1 -- start start 2024-02-07T12:22:16.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dcef2b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dc8101e60 0x7f3dc8112990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dcef2b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc8102800 0x7f3dc8112ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dcef2b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc81135b0 con 0x7f3dc8102800 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dcef2b700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc810c850 con 0x7f3dc8101e60 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dc7fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc8102800 0x7f3dc8112ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dc7fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc8102800 0x7f3dc8112ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39686/0 (socket says 172.21.15.47:39686) 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dc7fff700 1 -- 172.21.15.47:0/3885229509 learned_addr learned my addr 172.21.15.47:0/3885229509 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dcccc7700 1 --2- 172.21.15.47:0/3885229509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dc8101e60 0x7f3dc8112990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dc7fff700 1 -- 172.21.15.47:0/3885229509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dc8101e60 msgr2=0x7f3dc8112990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dc7fff700 1 --2- 172.21.15.47:0/3885229509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dc8101e60 0x7f3dc8112990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dc7fff700 1 -- 172.21.15.47:0/3885229509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc005040 con 0x7f3dc8102800 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dcccc7700 1 --2- 172.21.15.47:0/3885229509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dc8101e60 0x7f3dc8112990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dc7fff700 1 --2- 172.21.15.47:0/3885229509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc8102800 0x7f3dc8112ed0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3db400b790 tx=0x7f3db4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dc57fa700 1 -- 172.21.15.47:0/3885229509 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3db400f6f0 con 0x7f3dc8102800 2024-02-07T12:22:16.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dc57fa700 1 -- 172.21.15.47:0/3885229509 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3db400fd20 con 0x7f3dc8102800 2024-02-07T12:22:16.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dcef2b700 1 -- 172.21.15.47:0/3885229509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc810cb30 con 0x7f3dc8102800 2024-02-07T12:22:16.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dc57fa700 1 -- 172.21.15.47:0/3885229509 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3db40103a0 con 0x7f3dc8102800 2024-02-07T12:22:16.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.795+0000 7f3dcef2b700 1 -- 172.21.15.47:0/3885229509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc810d070 con 0x7f3dc8102800 2024-02-07T12:22:16.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.796+0000 7f3dcef2b700 1 -- 172.21.15.47:0/3885229509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc80fb610 con 0x7f3dc8102800 2024-02-07T12:22:16.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.797+0000 7f3dc57fa700 1 -- 172.21.15.47:0/3885229509 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3db4011400 con 0x7f3dc8102800 2024-02-07T12:22:16.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.797+0000 7f3dc57fa700 1 --2- 172.21.15.47:0/3885229509 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3db8068f70 0x7f3db806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:16.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.797+0000 7f3dc57fa700 1 -- 172.21.15.47:0/3885229509 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3db40868e0 con 0x7f3dc8102800 2024-02-07T12:22:16.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.797+0000 7f3dcccc7700 1 --2- 172.21.15.47:0/3885229509 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3db8068f70 0x7f3db806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:16.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.798+0000 7f3dcccc7700 1 --2- 172.21.15.47:0/3885229509 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3db8068f70 0x7f3db806b420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009fd0 tx=0x7f3dbc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:16.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:16.802+0000 7f3dc57fa700 1 -- 172.21.15.47:0/3885229509 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3db4056b00 con 0x7f3dc8102800 2024-02-07T12:22:17.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:17.008+0000 7f3dcef2b700 1 -- 172.21.15.47:0/3885229509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3dc810df70 con 0x7f3dc8102800 2024-02-07T12:22:17.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:17.009+0000 7f3dc57fa700 1 -- 172.21.15.47:0/3885229509 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3db4056690 con 0x7f3dc8102800 2024-02-07T12:22:17.011 INFO:teuthology.orchestra.run.smithi047.stdout:81604378651 2024-02-07T12:22:17.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:17.011+0000 7f3dcef2b700 1 -- 172.21.15.47:0/3885229509 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3db8068f70 msgr2=0x7f3db806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:17.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:17.011+0000 7f3dcef2b700 1 --2- 172.21.15.47:0/3885229509 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3db8068f70 0x7f3db806b420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009fd0 tx=0x7f3dbc009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:17.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:17.011+0000 7f3dcef2b700 1 -- 172.21.15.47:0/3885229509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc8102800 msgr2=0x7f3dc8112ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:17.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:17.011+0000 7f3dcef2b700 1 --2- 172.21.15.47:0/3885229509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc8102800 0x7f3dc8112ed0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3db400b790 tx=0x7f3db4009220 comp rx=0 tx=0).stop 2024-02-07T12:22:17.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:17.011+0000 7f3dcef2b700 1 -- 172.21.15.47:0/3885229509 shutdown_connections 2024-02-07T12:22:17.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:17.011+0000 7f3dcef2b700 1 --2- 172.21.15.47:0/3885229509 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3db8068f70 0x7f3db806b420 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:17.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:17.011+0000 7f3dcef2b700 1 --2- 172.21.15.47:0/3885229509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dc8101e60 0x7f3dc8112990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:17.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:17.011+0000 7f3dcef2b700 1 --2- 172.21.15.47:0/3885229509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc8102800 0x7f3dc8112ed0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:17.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:17.011+0000 7f3dcef2b700 1 -- 172.21.15.47:0/3885229509 >> 172.21.15.47:0/3885229509 conn(0x7f3dc80f7a10 msgr2=0x7f3dc80f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:17.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:17.011+0000 7f3dcef2b700 1 -- 172.21.15.47:0/3885229509 shutdown_connections 2024-02-07T12:22:17.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:17.011+0000 7f3dcef2b700 1 -- 172.21.15.47:0/3885229509 wait complete. 2024-02-07T12:22:17.716 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705702 for osd.0 2024-02-07T12:22:17.717 DEBUG:teuthology.parallel:result is None 2024-02-07T12:22:18.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:17 smithi138 ceph-mon[35528]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:18.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:17 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3885229509' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-07T12:22:18.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:17 smithi047 ceph-mon[28972]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:18.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:17 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3885229509' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-07T12:22:19.088 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.383+0000 7fdec00f6700 1 -- 172.21.15.47:0/1331035474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdeb80fdf50 msgr2=0x7fdeb80fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.383+0000 7fdec00f6700 1 --2- 172.21.15.47:0/1331035474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdeb80fdf50 0x7fdeb80fe320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4004940 tx=0x7fdeb4009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.383+0000 7fdec00f6700 1 -- 172.21.15.47:0/1331035474 shutdown_connections 2024-02-07T12:22:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.383+0000 7fdec00f6700 1 --2- 172.21.15.47:0/1331035474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeb80fe8f0 0x7fdeb8106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.383+0000 7fdec00f6700 1 --2- 172.21.15.47:0/1331035474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdeb80fdf50 0x7fdeb80fe320 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.383+0000 7fdec00f6700 1 -- 172.21.15.47:0/1331035474 >> 172.21.15.47:0/1331035474 conn(0x7fdeb80f7a10 msgr2=0x7fdeb80f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.383+0000 7fdec00f6700 1 -- 172.21.15.47:0/1331035474 shutdown_connections 2024-02-07T12:22:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.383+0000 7fdec00f6700 1 -- 172.21.15.47:0/1331035474 wait complete. 2024-02-07T12:22:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.384+0000 7fdec00f6700 1 Processor -- start 2024-02-07T12:22:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.384+0000 7fdec00f6700 1 -- start start 2024-02-07T12:22:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.384+0000 7fdec00f6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdeb80fdf50 0x7fdeb8113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.384+0000 7fdec00f6700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeb80fe8f0 0x7fdeb8113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.384+0000 7fdec00f6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb8114660 con 0x7fdeb80fdf50 2024-02-07T12:22:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.384+0000 7fdec00f6700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb810d900 con 0x7fdeb80fe8f0 2024-02-07T12:22:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.384+0000 7fdebde92700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdeb80fdf50 0x7fdeb8113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.384+0000 7fdebde92700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdeb80fdf50 0x7fdeb8113a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39712/0 (socket says 172.21.15.47:39712) 2024-02-07T12:22:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.384+0000 7fdebde92700 1 -- 172.21.15.47:0/3497682962 learned_addr learned my addr 172.21.15.47:0/3497682962 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.384+0000 7fdebde92700 1 -- 172.21.15.47:0/3497682962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeb80fe8f0 msgr2=0x7fdeb8113f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:19.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.384+0000 7fdebde92700 1 --2- 172.21.15.47:0/3497682962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeb80fe8f0 0x7fdeb8113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:19.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.384+0000 7fdebde92700 1 -- 172.21.15.47:0/3497682962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb4005040 con 0x7fdeb80fdf50 2024-02-07T12:22:19.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.384+0000 7fdebde92700 1 --2- 172.21.15.47:0/3497682962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdeb80fdf50 0x7fdeb8113a40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009380 tx=0x7fdeb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:19.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.385+0000 7fdeae7fc700 1 -- 172.21.15.47:0/3497682962 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeb400e040 con 0x7fdeb80fdf50 2024-02-07T12:22:19.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.385+0000 7fdeae7fc700 1 -- 172.21.15.47:0/3497682962 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdeb4009af0 con 0x7fdeb80fdf50 2024-02-07T12:22:19.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.385+0000 7fdec00f6700 1 -- 172.21.15.47:0/3497682962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb810db80 con 0x7fdeb80fdf50 2024-02-07T12:22:19.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.385+0000 7fdeae7fc700 1 -- 172.21.15.47:0/3497682962 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeb401c630 con 0x7fdeb80fdf50 2024-02-07T12:22:19.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.385+0000 7fdec00f6700 1 -- 172.21.15.47:0/3497682962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb810e0c0 con 0x7fdeb80fdf50 2024-02-07T12:22:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.386+0000 7fdec00f6700 1 -- 172.21.15.47:0/3497682962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb8104620 con 0x7fdeb80fdf50 2024-02-07T12:22:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.386+0000 7fdeae7fc700 1 -- 172.21.15.47:0/3497682962 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fdeb400bcc0 con 0x7fdeb80fdf50 2024-02-07T12:22:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.386+0000 7fdeae7fc700 1 --2- 172.21.15.47:0/3497682962 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdea4068f60 0x7fdea406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.387+0000 7fdeae7fc700 1 -- 172.21.15.47:0/3497682962 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdeb4087870 con 0x7fdeb80fdf50 2024-02-07T12:22:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.387+0000 7fdebd691700 1 --2- 172.21.15.47:0/3497682962 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdea4068f60 0x7fdea406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.387+0000 7fdebd691700 1 --2- 172.21.15.47:0/3497682962 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdea4068f60 0x7fdea406b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdea8006fd0 tx=0x7fdea8006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.391+0000 7fdeae7fc700 1 -- 172.21.15.47:0/3497682962 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdeb4057b10 con 0x7fdeb80fdf50 2024-02-07T12:22:19.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.588+0000 7fdec00f6700 1 -- 172.21.15.47:0/3497682962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fdeb804bed0 con 0x7fdeb80fdf50 2024-02-07T12:22:19.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.588+0000 7fdeae7fc700 1 -- 172.21.15.47:0/3497682962 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdeb40576a0 con 0x7fdeb80fdf50 2024-02-07T12:22:19.591 INFO:teuthology.orchestra.run.smithi047.stdout:171798691852 2024-02-07T12:22:19.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.590+0000 7fdec00f6700 1 -- 172.21.15.47:0/3497682962 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdea4068f60 msgr2=0x7fdea406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:19.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.590+0000 7fdec00f6700 1 --2- 172.21.15.47:0/3497682962 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdea4068f60 0x7fdea406b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdea8006fd0 tx=0x7fdea8006db0 comp rx=0 tx=0).stop 2024-02-07T12:22:19.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.590+0000 7fdec00f6700 1 -- 172.21.15.47:0/3497682962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdeb80fdf50 msgr2=0x7fdeb8113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:19.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.590+0000 7fdec00f6700 1 --2- 172.21.15.47:0/3497682962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdeb80fdf50 0x7fdeb8113a40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009380 tx=0x7fdeb4009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:19.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.590+0000 7fdec00f6700 1 -- 172.21.15.47:0/3497682962 shutdown_connections 2024-02-07T12:22:19.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.590+0000 7fdec00f6700 1 --2- 172.21.15.47:0/3497682962 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdea4068f60 0x7fdea406b410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:19.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.590+0000 7fdec00f6700 1 --2- 172.21.15.47:0/3497682962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdeb80fdf50 0x7fdeb8113a40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:19.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.590+0000 7fdec00f6700 1 --2- 172.21.15.47:0/3497682962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeb80fe8f0 0x7fdeb8113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:19.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.590+0000 7fdec00f6700 1 -- 172.21.15.47:0/3497682962 >> 172.21.15.47:0/3497682962 conn(0x7fdeb80f7a10 msgr2=0x7fdeb81017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:19.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.591+0000 7fdec00f6700 1 -- 172.21.15.47:0/3497682962 shutdown_connections 2024-02-07T12:22:19.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:19.591+0000 7fdec00f6700 1 -- 172.21.15.47:0/3497682962 wait complete. 2024-02-07T12:22:20.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:19 smithi138 ceph-mon[35528]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:20.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:19 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3497682962' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-07T12:22:20.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:19 smithi047 ceph-mon[28972]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:20.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:19 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3497682962' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-07T12:22:20.610 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378651 for osd.2 2024-02-07T12:22:20.611 DEBUG:teuthology.parallel:result is None 2024-02-07T12:22:21.014 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691851 got 171798691852 for osd.5 2024-02-07T12:22:21.014 DEBUG:teuthology.parallel:result is None 2024-02-07T12:22:21.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.321+0000 7fa595b10700 1 -- 172.21.15.47:0/3575456453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102800 msgr2=0x7fa5900fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:21.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.321+0000 7fa595b10700 1 --2- 172.21.15.47:0/3575456453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102800 0x7fa5900fbe70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa578004940 tx=0x7fa578009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:21.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.321+0000 7fa595b10700 1 -- 172.21.15.47:0/3575456453 shutdown_connections 2024-02-07T12:22:21.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.321+0000 7fa595b10700 1 --2- 172.21.15.47:0/3575456453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102800 0x7fa5900fbe70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:21.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.321+0000 7fa595b10700 1 --2- 172.21.15.47:0/3575456453 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa590101e60 0x7fa590102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:21.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.321+0000 7fa595b10700 1 -- 172.21.15.47:0/3575456453 >> 172.21.15.47:0/3575456453 conn(0x7fa5900f7a10 msgr2=0x7fa5900f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:21.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.321+0000 7fa595b10700 1 -- 172.21.15.47:0/3575456453 shutdown_connections 2024-02-07T12:22:21.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.321+0000 7fa595b10700 1 -- 172.21.15.47:0/3575456453 wait complete. 2024-02-07T12:22:21.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.321+0000 7fa595b10700 1 Processor -- start 2024-02-07T12:22:21.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.322+0000 7fa595b10700 1 -- start start 2024-02-07T12:22:21.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.322+0000 7fa595b10700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa590101e60 0x7fa59010eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:21.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.322+0000 7fa595b10700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102800 0x7fa59010f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:21.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.322+0000 7fa595b10700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59010f630 con 0x7fa590102800 2024-02-07T12:22:21.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.322+0000 7fa595b10700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59010f770 con 0x7fa590101e60 2024-02-07T12:22:21.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.322+0000 7fa58effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102800 0x7fa59010f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:21.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.322+0000 7fa58effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102800 0x7fa59010f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44960/0 (socket says 172.21.15.47:44960) 2024-02-07T12:22:21.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.322+0000 7fa58effd700 1 -- 172.21.15.47:0/206398543 learned_addr learned my addr 172.21.15.47:0/206398543 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:21.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.322+0000 7fa58f7fe700 1 --2- 172.21.15.47:0/206398543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa590101e60 0x7fa59010eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:21.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.322+0000 7fa58effd700 1 -- 172.21.15.47:0/206398543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa590101e60 msgr2=0x7fa59010eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:21.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.322+0000 7fa58effd700 1 --2- 172.21.15.47:0/206398543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa590101e60 0x7fa59010eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:21.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.322+0000 7fa58effd700 1 -- 172.21.15.47:0/206398543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa578005040 con 0x7fa590102800 2024-02-07T12:22:21.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.322+0000 7fa58effd700 1 --2- 172.21.15.47:0/206398543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102800 0x7fa59010f0a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa578009150 tx=0x7fa578009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:21.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.323+0000 7fa587fff700 1 -- 172.21.15.47:0/206398543 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa57800e040 con 0x7fa590102800 2024-02-07T12:22:21.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.323+0000 7fa587fff700 1 -- 172.21.15.47:0/206398543 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa57800bbf0 con 0x7fa590102800 2024-02-07T12:22:21.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.323+0000 7fa595b10700 1 -- 172.21.15.47:0/206398543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa590117a70 con 0x7fa590102800 2024-02-07T12:22:21.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.323+0000 7fa587fff700 1 -- 172.21.15.47:0/206398543 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa57801c630 con 0x7fa590102800 2024-02-07T12:22:21.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.323+0000 7fa595b10700 1 -- 172.21.15.47:0/206398543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa590117f80 con 0x7fa590102800 2024-02-07T12:22:21.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.324+0000 7fa595b10700 1 -- 172.21.15.47:0/206398543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa590104330 con 0x7fa590102800 2024-02-07T12:22:21.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.324+0000 7fa587fff700 1 -- 172.21.15.47:0/206398543 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa57800bd60 con 0x7fa590102800 2024-02-07T12:22:21.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.325+0000 7fa587fff700 1 --2- 172.21.15.47:0/206398543 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa57c068f60 0x7fa57c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:21.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.325+0000 7fa587fff700 1 -- 172.21.15.47:0/206398543 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa578087b80 con 0x7fa590102800 2024-02-07T12:22:21.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.325+0000 7fa58f7fe700 1 --2- 172.21.15.47:0/206398543 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa57c068f60 0x7fa57c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:21.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.325+0000 7fa58f7fe700 1 --2- 172.21.15.47:0/206398543 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa57c068f60 0x7fa57c06b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa580004ec0 tx=0x7fa580009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:21.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.329+0000 7fa587fff700 1 -- 172.21.15.47:0/206398543 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa578054370 con 0x7fa590102800 2024-02-07T12:22:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.525+0000 7fa595b10700 1 -- 172.21.15.47:0/206398543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa59004bed0 con 0x7fa590102800 2024-02-07T12:22:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.525+0000 7fa587fff700 1 -- 172.21.15.47:0/206398543 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa578057990 con 0x7fa590102800 2024-02-07T12:22:21.528 INFO:teuthology.orchestra.run.smithi047.stdout:60129542175 2024-02-07T12:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.527+0000 7fa595b10700 1 -- 172.21.15.47:0/206398543 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa57c068f60 msgr2=0x7fa57c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.527+0000 7fa595b10700 1 --2- 172.21.15.47:0/206398543 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa57c068f60 0x7fa57c06b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa580004ec0 tx=0x7fa580009040 comp rx=0 tx=0).stop 2024-02-07T12:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.527+0000 7fa595b10700 1 -- 172.21.15.47:0/206398543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102800 msgr2=0x7fa59010f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.527+0000 7fa595b10700 1 --2- 172.21.15.47:0/206398543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102800 0x7fa59010f0a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa578009150 tx=0x7fa578009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.527+0000 7fa595b10700 1 -- 172.21.15.47:0/206398543 shutdown_connections 2024-02-07T12:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.527+0000 7fa595b10700 1 --2- 172.21.15.47:0/206398543 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa57c068f60 0x7fa57c06b410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.527+0000 7fa595b10700 1 --2- 172.21.15.47:0/206398543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa590101e60 0x7fa59010eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.527+0000 7fa595b10700 1 --2- 172.21.15.47:0/206398543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa590102800 0x7fa59010f0a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.527+0000 7fa595b10700 1 -- 172.21.15.47:0/206398543 >> 172.21.15.47:0/206398543 conn(0x7fa5900f7a10 msgr2=0x7fa5900f9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.527+0000 7fa595b10700 1 -- 172.21.15.47:0/206398543 shutdown_connections 2024-02-07T12:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:21.527+0000 7fa595b10700 1 -- 172.21.15.47:0/206398543 wait complete. 2024-02-07T12:22:21.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:21 smithi047 ceph-mon[28972]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:21.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:21 smithi138 ceph-mon[35528]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:22.489 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:22 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/206398543' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-07T12:22:22.489 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:22:22.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.592+0000 7f1d399ed700 1 -- 172.21.15.47:0/432762349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d34101e40 msgr2=0x7f1d34102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:22.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.592+0000 7f1d399ed700 1 --2- 172.21.15.47:0/432762349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d34101e40 0x7f1d34102210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1d28004940 tx=0x7f1d28009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:22.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.592+0000 7f1d399ed700 1 -- 172.21.15.47:0/432762349 shutdown_connections 2024-02-07T12:22:22.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.592+0000 7f1d399ed700 1 --2- 172.21.15.47:0/432762349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d341027e0 0x7f1d340fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.592+0000 7f1d399ed700 1 --2- 172.21.15.47:0/432762349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d34101e40 0x7f1d34102210 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.592+0000 7f1d399ed700 1 -- 172.21.15.47:0/432762349 >> 172.21.15.47:0/432762349 conn(0x7f1d34071d90 msgr2=0x7f1d34072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.592+0000 7f1d399ed700 1 -- 172.21.15.47:0/432762349 shutdown_connections 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.592+0000 7f1d399ed700 1 -- 172.21.15.47:0/432762349 wait complete. 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.593+0000 7f1d399ed700 1 Processor -- start 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.593+0000 7f1d399ed700 1 -- start start 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.593+0000 7f1d399ed700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d34101e40 0x7f1d34113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.593+0000 7f1d399ed700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d341027e0 0x7f1d34113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.593+0000 7f1d399ed700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d341145e0 con 0x7f1d341027e0 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.593+0000 7f1d399ed700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3410d910 con 0x7f1d34101e40 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.593+0000 7f1d327fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d341027e0 0x7f1d34113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.593+0000 7f1d327fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d341027e0 0x7f1d34113f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44974/0 (socket says 172.21.15.47:44974) 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.593+0000 7f1d327fc700 1 -- 172.21.15.47:0/3471176431 learned_addr learned my addr 172.21.15.47:0/3471176431 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.593+0000 7f1d327fc700 1 -- 172.21.15.47:0/3471176431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d34101e40 msgr2=0x7f1d34113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:22.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.593+0000 7f1d327fc700 1 --2- 172.21.15.47:0/3471176431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d34101e40 0x7f1d34113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.593+0000 7f1d327fc700 1 -- 172.21.15.47:0/3471176431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d28005040 con 0x7f1d341027e0 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.593+0000 7f1d327fc700 1 --2- 172.21.15.47:0/3471176431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d341027e0 0x7f1d34113f90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c800 tx=0x7f1d24004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.594+0000 7f1d1b7fe700 1 -- 172.21.15.47:0/3471176431 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d2400a760 con 0x7f1d341027e0 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.594+0000 7f1d399ed700 1 -- 172.21.15.47:0/3471176431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3410dbf0 con 0x7f1d341027e0 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.594+0000 7f1d1b7fe700 1 -- 172.21.15.47:0/3471176431 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d2400ad90 con 0x7f1d341027e0 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.594+0000 7f1d1b7fe700 1 -- 172.21.15.47:0/3471176431 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d240113a0 con 0x7f1d341027e0 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.594+0000 7f1d399ed700 1 -- 172.21.15.47:0/3471176431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3410e130 con 0x7f1d341027e0 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.595+0000 7f1d399ed700 1 -- 172.21.15.47:0/3471176431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d340738b0 con 0x7f1d341027e0 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.595+0000 7f1d1b7fe700 1 -- 172.21.15.47:0/3471176431 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f1d24012400 con 0x7f1d341027e0 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.595+0000 7f1d1b7fe700 1 --2- 172.21.15.47:0/3471176431 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f1d1c068f60 0x7f1d1c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.596+0000 7f1d1b7fe700 1 -- 172.21.15.47:0/3471176431 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1d24086b70 con 0x7f1d341027e0 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.596+0000 7f1d32ffd700 1 --2- 172.21.15.47:0/3471176431 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f1d1c068f60 0x7f1d1c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.596+0000 7f1d32ffd700 1 --2- 172.21.15.47:0/3471176431 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f1d1c068f60 0x7f1d1c06b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d28004f90 tx=0x7f1d28009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:22.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.600+0000 7f1d1b7fe700 1 -- 172.21.15.47:0/3471176431 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1d24056d70 con 0x7f1d341027e0 2024-02-07T12:22:22.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:22 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/206398543' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-07T12:22:22.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:22:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.793+0000 7f1d399ed700 1 -- 172.21.15.47:0/3471176431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1d3404bed0 con 0x7f1d341027e0 2024-02-07T12:22:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.793+0000 7f1d1b7fe700 1 -- 172.21.15.47:0/3471176431 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d24056900 con 0x7f1d341027e0 2024-02-07T12:22:22.796 INFO:teuthology.orchestra.run.smithi047.stdout:150323855376 2024-02-07T12:22:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.795+0000 7f1d399ed700 1 -- 172.21.15.47:0/3471176431 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f1d1c068f60 msgr2=0x7f1d1c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.795+0000 7f1d399ed700 1 --2- 172.21.15.47:0/3471176431 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f1d1c068f60 0x7f1d1c06b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d28004f90 tx=0x7f1d28009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.795+0000 7f1d399ed700 1 -- 172.21.15.47:0/3471176431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d341027e0 msgr2=0x7f1d34113f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.795+0000 7f1d399ed700 1 --2- 172.21.15.47:0/3471176431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d341027e0 0x7f1d34113f90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c800 tx=0x7f1d24004470 comp rx=0 tx=0).stop 2024-02-07T12:22:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.795+0000 7f1d399ed700 1 -- 172.21.15.47:0/3471176431 shutdown_connections 2024-02-07T12:22:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.795+0000 7f1d399ed700 1 --2- 172.21.15.47:0/3471176431 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f1d1c068f60 0x7f1d1c06b410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.795+0000 7f1d399ed700 1 --2- 172.21.15.47:0/3471176431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d34101e40 0x7f1d34113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.795+0000 7f1d399ed700 1 --2- 172.21.15.47:0/3471176431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d341027e0 0x7f1d34113f90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.795+0000 7f1d399ed700 1 -- 172.21.15.47:0/3471176431 >> 172.21.15.47:0/3471176431 conn(0x7f1d34071d90 msgr2=0x7f1d340facb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.796+0000 7f1d399ed700 1 -- 172.21.15.47:0/3471176431 shutdown_connections 2024-02-07T12:22:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:22.796+0000 7f1d399ed700 1 -- 172.21.15.47:0/3471176431 wait complete. 2024-02-07T12:22:23.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.280+0000 7fd19db7f700 1 -- 172.21.15.47:0/3777769703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1980fb620 msgr2=0x7fd1980fba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:23.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.280+0000 7fd19db7f700 1 --2- 172.21.15.47:0/3777769703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1980fb620 0x7fd1980fba90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd18c004940 tx=0x7fd18c009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:23.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.280+0000 7fd19db7f700 1 -- 172.21.15.47:0/3777769703 shutdown_connections 2024-02-07T12:22:23.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.280+0000 7fd19db7f700 1 --2- 172.21.15.47:0/3777769703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1980fb620 0x7fd1980fba90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:23.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.280+0000 7fd19db7f700 1 --2- 172.21.15.47:0/3777769703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1981015d0 0x7fd1981019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:23.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.280+0000 7fd19db7f700 1 -- 172.21.15.47:0/3777769703 >> 172.21.15.47:0/3777769703 conn(0x7fd198071500 msgr2=0x7fd198071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:23.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.280+0000 7fd19db7f700 1 -- 172.21.15.47:0/3777769703 shutdown_connections 2024-02-07T12:22:23.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.280+0000 7fd19db7f700 1 -- 172.21.15.47:0/3777769703 wait complete. 2024-02-07T12:22:23.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.281+0000 7fd19db7f700 1 Processor -- start 2024-02-07T12:22:23.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.281+0000 7fd19db7f700 1 -- start start 2024-02-07T12:22:23.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.281+0000 7fd19db7f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1980fb620 0x7fd19810eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:23.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.281+0000 7fd19db7f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1981015d0 0x7fd19810f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:23.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.281+0000 7fd19db7f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19810f680 con 0x7fd1980fb620 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.281+0000 7fd19db7f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19810f7c0 con 0x7fd1981015d0 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.281+0000 7fd1977fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1980fb620 0x7fd19810eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.282+0000 7fd1977fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1980fb620 0x7fd19810eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44990/0 (socket says 172.21.15.47:44990) 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.282+0000 7fd1977fe700 1 -- 172.21.15.47:0/1270298207 learned_addr learned my addr 172.21.15.47:0/1270298207 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.282+0000 7fd196ffd700 1 --2- 172.21.15.47:0/1270298207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1981015d0 0x7fd19810f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.282+0000 7fd1977fe700 1 -- 172.21.15.47:0/1270298207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1981015d0 msgr2=0x7fd19810f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.282+0000 7fd1977fe700 1 --2- 172.21.15.47:0/1270298207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1981015d0 0x7fd19810f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.282+0000 7fd1977fe700 1 -- 172.21.15.47:0/1270298207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c005040 con 0x7fd1980fb620 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.282+0000 7fd1977fe700 1 --2- 172.21.15.47:0/1270298207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1980fb620 0x7fd19810eb20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd18800b7c0 tx=0x7fd188009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.282+0000 7fd17ffff700 1 -- 172.21.15.47:0/1270298207 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd18800f6f0 con 0x7fd1980fb620 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.282+0000 7fd19db7f700 1 -- 172.21.15.47:0/1270298207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd198117af0 con 0x7fd1980fb620 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.282+0000 7fd17ffff700 1 -- 172.21.15.47:0/1270298207 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd18800fd20 con 0x7fd1980fb620 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.282+0000 7fd17ffff700 1 -- 172.21.15.47:0/1270298207 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1880103a0 con 0x7fd1980fb620 2024-02-07T12:22:23.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.282+0000 7fd19db7f700 1 -- 172.21.15.47:0/1270298207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd198118030 con 0x7fd1980fb620 2024-02-07T12:22:23.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.283+0000 7fd19db7f700 1 -- 172.21.15.47:0/1270298207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1980754c0 con 0x7fd1980fb620 2024-02-07T12:22:23.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.284+0000 7fd17ffff700 1 -- 172.21.15.47:0/1270298207 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd188011400 con 0x7fd1980fb620 2024-02-07T12:22:23.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.284+0000 7fd17ffff700 1 --2- 172.21.15.47:0/1270298207 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd180068f60 0x7fd18006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:23.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.284+0000 7fd17ffff700 1 -- 172.21.15.47:0/1270298207 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd188086850 con 0x7fd1980fb620 2024-02-07T12:22:23.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.284+0000 7fd196ffd700 1 --2- 172.21.15.47:0/1270298207 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd180068f60 0x7fd18006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:23.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.284+0000 7fd196ffd700 1 --2- 172.21.15.47:0/1270298207 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd180068f60 0x7fd18006b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1980faca0 tx=0x7fd18c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:23.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.288+0000 7fd17ffff700 1 -- 172.21.15.47:0/1270298207 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd188053060 con 0x7fd1980fb620 2024-02-07T12:22:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:23 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3471176431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-07T12:22:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:23 smithi047 ceph-mon[28972]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:23.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.489+0000 7fd19db7f700 1 -- 172.21.15.47:0/1270298207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd1980faa80 con 0x7fd1980fb620 2024-02-07T12:22:23.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.489+0000 7fd17ffff700 1 -- 172.21.15.47:0/1270298207 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd188056680 con 0x7fd1980fb620 2024-02-07T12:22:23.492 INFO:teuthology.orchestra.run.smithi047.stdout:115964117015 2024-02-07T12:22:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.491+0000 7fd19db7f700 1 -- 172.21.15.47:0/1270298207 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd180068f60 msgr2=0x7fd18006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.491+0000 7fd19db7f700 1 --2- 172.21.15.47:0/1270298207 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd180068f60 0x7fd18006b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1980faca0 tx=0x7fd18c009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.491+0000 7fd19db7f700 1 -- 172.21.15.47:0/1270298207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1980fb620 msgr2=0x7fd19810eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:23.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.491+0000 7fd19db7f700 1 --2- 172.21.15.47:0/1270298207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1980fb620 0x7fd19810eb20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd18800b7c0 tx=0x7fd188009250 comp rx=0 tx=0).stop 2024-02-07T12:22:23.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.491+0000 7fd19db7f700 1 -- 172.21.15.47:0/1270298207 shutdown_connections 2024-02-07T12:22:23.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.491+0000 7fd19db7f700 1 --2- 172.21.15.47:0/1270298207 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd180068f60 0x7fd18006b410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:23.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.491+0000 7fd19db7f700 1 --2- 172.21.15.47:0/1270298207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1980fb620 0x7fd19810eb20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:23.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.491+0000 7fd19db7f700 1 --2- 172.21.15.47:0/1270298207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1981015d0 0x7fd19810f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:23.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.491+0000 7fd19db7f700 1 -- 172.21.15.47:0/1270298207 >> 172.21.15.47:0/1270298207 conn(0x7fd198071500 msgr2=0x7fd1980ffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:23.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.491+0000 7fd19db7f700 1 -- 172.21.15.47:0/1270298207 shutdown_connections 2024-02-07T12:22:23.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:23.491+0000 7fd19db7f700 1 -- 172.21.15.47:0/1270298207 wait complete. 2024-02-07T12:22:23.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:23 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3471176431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-07T12:22:23.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:23 smithi138 ceph-mon[35528]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:23.736 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542175 for osd.1 2024-02-07T12:22:23.736 DEBUG:teuthology.parallel:result is None 2024-02-07T12:22:24.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:24 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/1270298207' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-07T12:22:24.540 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:24 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1270298207' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-07T12:22:24.568 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117012 got 115964117015 for osd.3 2024-02-07T12:22:24.569 DEBUG:teuthology.parallel:result is None 2024-02-07T12:22:25.031 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855373 got 150323855376 for osd.4 2024-02-07T12:22:25.031 DEBUG:teuthology.parallel:result is None 2024-02-07T12:22:25.031 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-07T12:22:25.031 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph pg dump --format=json 2024-02-07T12:22:25.306 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:25.559 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:25 smithi047 ceph-mon[28972]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:25.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:25 smithi138 ceph-mon[35528]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:26.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.971+0000 7f3d199e3700 1 -- 172.21.15.47:0/4030698223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d14102f50 msgr2=0x7f3d14103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:26.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.971+0000 7f3d199e3700 1 --2- 172.21.15.47:0/4030698223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d14102f50 0x7f3d14103320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009ce0 tx=0x7f3d04004d10 comp rx=0 tx=0).stop 2024-02-07T12:22:26.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.971+0000 7f3d199e3700 1 -- 172.21.15.47:0/4030698223 shutdown_connections 2024-02-07T12:22:26.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.971+0000 7f3d199e3700 1 --2- 172.21.15.47:0/4030698223 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d141038f0 0x7f3d140fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:26.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.971+0000 7f3d199e3700 1 --2- 172.21.15.47:0/4030698223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d14102f50 0x7f3d14103320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:26.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.971+0000 7f3d199e3700 1 -- 172.21.15.47:0/4030698223 >> 172.21.15.47:0/4030698223 conn(0x7f3d140f8ae0 msgr2=0x7f3d140faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:26.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.971+0000 7f3d199e3700 1 -- 172.21.15.47:0/4030698223 shutdown_connections 2024-02-07T12:22:26.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.971+0000 7f3d199e3700 1 -- 172.21.15.47:0/4030698223 wait complete. 2024-02-07T12:22:26.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.971+0000 7f3d199e3700 1 Processor -- start 2024-02-07T12:22:26.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.971+0000 7f3d199e3700 1 -- start start 2024-02-07T12:22:26.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d199e3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d14102f50 0x7f3d14113c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:26.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d199e3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d141038f0 0x7f3d14114160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:26.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d199e3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d14114840 con 0x7f3d141038f0 2024-02-07T12:22:26.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d199e3700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1410dae0 con 0x7f3d14102f50 2024-02-07T12:22:26.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d127fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d141038f0 0x7f3d14114160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:26.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d127fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d141038f0 0x7f3d14114160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45000/0 (socket says 172.21.15.47:45000) 2024-02-07T12:22:26.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d127fc700 1 -- 172.21.15.47:0/2039362677 learned_addr learned my addr 172.21.15.47:0/2039362677 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:26.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d12ffd700 1 --2- 172.21.15.47:0/2039362677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d14102f50 0x7f3d14113c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:26.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d127fc700 1 -- 172.21.15.47:0/2039362677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d14102f50 msgr2=0x7f3d14113c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:26.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d127fc700 1 --2- 172.21.15.47:0/2039362677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d14102f50 0x7f3d14113c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:26.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d127fc700 1 -- 172.21.15.47:0/2039362677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04009940 con 0x7f3d141038f0 2024-02-07T12:22:26.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d127fc700 1 --2- 172.21.15.47:0/2039362677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d141038f0 0x7f3d14114160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00b790 tx=0x7f3cfc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:26.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d0b7fe700 1 -- 172.21.15.47:0/2039362677 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cfc00f6f0 con 0x7f3d141038f0 2024-02-07T12:22:26.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d0b7fe700 1 -- 172.21.15.47:0/2039362677 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3cfc00fd20 con 0x7f3d141038f0 2024-02-07T12:22:26.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d0b7fe700 1 -- 172.21.15.47:0/2039362677 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cfc0103a0 con 0x7f3d141038f0 2024-02-07T12:22:26.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.972+0000 7f3d199e3700 1 -- 172.21.15.47:0/2039362677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1410ddc0 con 0x7f3d141038f0 2024-02-07T12:22:26.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.973+0000 7f3d199e3700 1 -- 172.21.15.47:0/2039362677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1410e300 con 0x7f3d141038f0 2024-02-07T12:22:26.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.973+0000 7f3d199e3700 1 -- 172.21.15.47:0/2039362677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d140fc6e0 con 0x7f3d141038f0 2024-02-07T12:22:26.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.974+0000 7f3d0b7fe700 1 -- 172.21.15.47:0/2039362677 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3cfc011400 con 0x7f3d141038f0 2024-02-07T12:22:26.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.974+0000 7f3d0b7fe700 1 --2- 172.21.15.47:0/2039362677 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3d00068f70 0x7f3d0006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:26.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.974+0000 7f3d12ffd700 1 --2- 172.21.15.47:0/2039362677 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3d00068f70 0x7f3d0006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:26.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.974+0000 7f3d0b7fe700 1 -- 172.21.15.47:0/2039362677 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3cfc086740 con 0x7f3d141038f0 2024-02-07T12:22:26.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.975+0000 7f3d12ffd700 1 --2- 172.21.15.47:0/2039362677 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3d00068f70 0x7f3d0006b420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3d04005010 tx=0x7f3d04004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:26.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:26.979+0000 7f3d0b7fe700 1 -- 172.21.15.47:0/2039362677 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3cfc056a80 con 0x7f3d141038f0 2024-02-07T12:22:27.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:27.167+0000 7f3d199e3700 1 -- 172.21.15.47:0/2039362677 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d1404bed0 con 0x7f3d00068f70 2024-02-07T12:22:27.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:27.168+0000 7f3d0b7fe700 1 -- 172.21.15.47:0/2039362677 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28045 (secure 0 0 0) 0x7f3d1404bed0 con 0x7f3d00068f70 2024-02-07T12:22:27.171 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:22:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:27.170+0000 7f3d199e3700 1 -- 172.21.15.47:0/2039362677 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3d00068f70 msgr2=0x7f3d0006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:27.170+0000 7f3d199e3700 1 --2- 172.21.15.47:0/2039362677 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3d00068f70 0x7f3d0006b420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3d04005010 tx=0x7f3d04004d10 comp rx=0 tx=0).stop 2024-02-07T12:22:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:27.170+0000 7f3d199e3700 1 -- 172.21.15.47:0/2039362677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d141038f0 msgr2=0x7f3d14114160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:27.170+0000 7f3d199e3700 1 --2- 172.21.15.47:0/2039362677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d141038f0 0x7f3d14114160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00b790 tx=0x7f3cfc009220 comp rx=0 tx=0).stop 2024-02-07T12:22:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:27.170+0000 7f3d199e3700 1 -- 172.21.15.47:0/2039362677 shutdown_connections 2024-02-07T12:22:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:27.170+0000 7f3d199e3700 1 --2- 172.21.15.47:0/2039362677 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f3d00068f70 0x7f3d0006b420 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:27.170+0000 7f3d199e3700 1 --2- 172.21.15.47:0/2039362677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d14102f50 0x7f3d14113c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:27.170+0000 7f3d199e3700 1 --2- 172.21.15.47:0/2039362677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d141038f0 0x7f3d14114160 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:27.170+0000 7f3d199e3700 1 -- 172.21.15.47:0/2039362677 >> 172.21.15.47:0/2039362677 conn(0x7f3d140f8ae0 msgr2=0x7f3d140fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:27.170+0000 7f3d199e3700 1 -- 172.21.15.47:0/2039362677 shutdown_connections 2024-02-07T12:22:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:27.170+0000 7f3d199e3700 1 -- 172.21.15.47:0/2039362677 wait complete. 2024-02-07T12:22:27.174 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-02-07T12:22:27.952 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-02-07T12:22:26.898255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787652,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683260,"statfs":{"total":575970213888,"available":574139658240,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002224"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":189,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-07T12:21:33.307695+0000","last_change":"2024-02-07T12:21:08.302779+0000","last_active":"2024-02-07T12:21:33.307695+0000","last_peered":"2024-02-07T12:21:33.307695+0000","last_clean":"2024-02-07T12:21:33.307695+0000","last_became_active":"2024-02-07T12:21:08.302512+0000","last_became_peered":"2024-02-07T12:21:08.302512+0000","last_unstale":"2024-02-07T12:21:33.307695+0000","last_undegraded":"2024-02-07T12:21:33.307695+0000","last_fullsized":"2024-02-07T12:21:33.307695+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-07T12:20:21.241131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-07T12:20:21.241131+0000","last_clean_scrub_stamp":"2024-02-07T12:20:21.241131+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-09T00:15:17.904112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":4,"up_from":35,"seq":150323855377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 7 12:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.74099999999999999}]},{"osd":1,"last update":"Wed Feb 7 12:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.61399999999999999}]},{"osd":2,"last update":"Wed Feb 7 12:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.69999999999999996}]},{"osd":3,"last update":"Wed Feb 7 12:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 7 12:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.41099999999999998}]},{"osd":1,"last update":"Wed Feb 7 12:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.53200000000000003}]},{"osd":2,"last update":"Wed Feb 7 12:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.42599999999999999}]},{"osd":4,"last update":"Wed Feb 7 12:22:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 7 12:22:22 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36599999999999999,"15min":0.371},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46899999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38500000000000001,"15min":0.39100000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.49299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.32100000000000001}]},{"osd":1,"last update":"Wed Feb 7 12:22:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55000000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41299999999999998,"15min":0.42099999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58099999999999996,"5min":0.621,"15min":0.621},"last":0.309}]},{"osd":3,"last update":"Wed Feb 7 12:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Feb 7 12:22:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.497},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 7 12:21:55 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.29799999999999999,"15min":0.28799999999999998},"min":{"1min":0.23699999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.313,"15min":0.30599999999999999},"min":{"1min":0.24099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Wed Feb 7 12:21:25 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.378},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.39700000000000002}]},{"osd":3,"last update":"Wed Feb 7 12:21:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.65100000000000002}]},{"osd":4,"last update":"Wed Feb 7 12:22:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 7 12:21:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.314,"15min":0.30099999999999999},"min":{"1min":0.23699999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.32800000000000001,"15min":0.32200000000000001},"min":{"1min":0.26800000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.373}]},{"osd":2,"last update":"Wed Feb 7 12:22:25 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36299999999999999},"min":{"1min":0.27100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.51300000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.54300000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.32400000000000001}]},{"osd":3,"last update":"Wed Feb 7 12:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57999999999999996}]},{"osd":4,"last update":"Wed Feb 7 12:22:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-07T12:22:27.953 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph pg dump --format=json 2024-02-07T12:22:28.219 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:28.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:27 smithi138 ceph-mon[35528]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:28.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:27 smithi138 ceph-mon[35528]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-07T12:22:28.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:27 smithi047 ceph-mon[28972]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:28.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:27 smithi047 ceph-mon[28972]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-07T12:22:29.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.838+0000 7fe4dca79700 1 -- 172.21.15.47:0/3754952760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4d8103140 msgr2=0x7fe4d8103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:29.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.838+0000 7fe4dca79700 1 --2- 172.21.15.47:0/3754952760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4d8103140 0x7fe4d8103510 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009ce0 tx=0x7fe4d0004d10 comp rx=0 tx=0).stop 2024-02-07T12:22:29.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.838+0000 7fe4dca79700 1 -- 172.21.15.47:0/3754952760 shutdown_connections 2024-02-07T12:22:29.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.838+0000 7fe4dca79700 1 --2- 172.21.15.47:0/3754952760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4d80fb570 0x7fe4d80fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.838+0000 7fe4dca79700 1 --2- 172.21.15.47:0/3754952760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4d8103140 0x7fe4d8103510 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.838+0000 7fe4dca79700 1 -- 172.21.15.47:0/3754952760 >> 172.21.15.47:0/3754952760 conn(0x7fe4d8071560 msgr2=0x7fe4d8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.838+0000 7fe4dca79700 1 -- 172.21.15.47:0/3754952760 shutdown_connections 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.838+0000 7fe4dca79700 1 -- 172.21.15.47:0/3754952760 wait complete. 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.838+0000 7fe4dca79700 1 Processor -- start 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4dca79700 1 -- start start 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4dca79700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4d80fb570 0x7fe4d8113d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4dca79700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4d8103140 0x7fe4d8114250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4dca79700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d8114930 con 0x7fe4d80fb570 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4dca79700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d810dbb0 con 0x7fe4d8103140 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4d659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4d80fb570 0x7fe4d8113d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4d659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4d80fb570 0x7fe4d8113d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39598/0 (socket says 172.21.15.47:39598) 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4d659c700 1 -- 172.21.15.47:0/3364873909 learned_addr learned my addr 172.21.15.47:0/3364873909 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4d5d9b700 1 --2- 172.21.15.47:0/3364873909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4d8103140 0x7fe4d8114250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:29.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4d659c700 1 -- 172.21.15.47:0/3364873909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4d8103140 msgr2=0x7fe4d8114250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:29.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4d659c700 1 --2- 172.21.15.47:0/3364873909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4d8103140 0x7fe4d8114250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:29.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4d659c700 1 -- 172.21.15.47:0/3364873909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0009940 con 0x7fe4d80fb570 2024-02-07T12:22:29.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4d5d9b700 1 --2- 172.21.15.47:0/3364873909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4d8103140 0x7fe4d8114250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:22:29.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.839+0000 7fe4d659c700 1 --2- 172.21.15.47:0/3364873909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4d80fb570 0x7fe4d8113d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000bf60 tx=0x7fe4d0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:29.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.840+0000 7fe4ceffd700 1 -- 172.21.15.47:0/3364873909 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d000e040 con 0x7fe4d80fb570 2024-02-07T12:22:29.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.840+0000 7fe4ceffd700 1 -- 172.21.15.47:0/3364873909 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4d00128e0 con 0x7fe4d80fb570 2024-02-07T12:22:29.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.840+0000 7fe4dca79700 1 -- 172.21.15.47:0/3364873909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d810ddd0 con 0x7fe4d80fb570 2024-02-07T12:22:29.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.840+0000 7fe4ceffd700 1 -- 172.21.15.47:0/3364873909 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d001c870 con 0x7fe4d80fb570 2024-02-07T12:22:29.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.840+0000 7fe4dca79700 1 -- 172.21.15.47:0/3364873909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d810e310 con 0x7fe4d80fb570 2024-02-07T12:22:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.840+0000 7fe4dca79700 1 -- 172.21.15.47:0/3364873909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d8073080 con 0x7fe4d80fb570 2024-02-07T12:22:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.841+0000 7fe4ceffd700 1 -- 172.21.15.47:0/3364873909 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe4d0012a50 con 0x7fe4d80fb570 2024-02-07T12:22:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.841+0000 7fe4ceffd700 1 --2- 172.21.15.47:0/3364873909 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fe4c4068f60 0x7fe4c406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.842+0000 7fe4d5d9b700 1 --2- 172.21.15.47:0/3364873909 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fe4c4068f60 0x7fe4c406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.842+0000 7fe4ceffd700 1 -- 172.21.15.47:0/3364873909 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe4d00887b0 con 0x7fe4d80fb570 2024-02-07T12:22:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.842+0000 7fe4d5d9b700 1 --2- 172.21.15.47:0/3364873909 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fe4c4068f60 0x7fe4c406b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0006fd0 tx=0x7fe4c0008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:29.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:29.846+0000 7fe4ceffd700 1 -- 172.21.15.47:0/3364873909 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe4d00589d0 con 0x7fe4d80fb570 2024-02-07T12:22:29.956 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:29 smithi047 ceph-mon[28972]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:30.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:30.035+0000 7fe4dca79700 1 -- 172.21.15.47:0/3364873909 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4d804bed0 con 0x7fe4c4068f60 2024-02-07T12:22:30.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:30.036+0000 7fe4ceffd700 1 -- 172.21.15.47:0/3364873909 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28042 (secure 0 0 0) 0x7fe4d804bed0 con 0x7fe4c4068f60 2024-02-07T12:22:30.039 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:22:30.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:30.038+0000 7fe4dca79700 1 -- 172.21.15.47:0/3364873909 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fe4c4068f60 msgr2=0x7fe4c406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:30.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:30.038+0000 7fe4dca79700 1 --2- 172.21.15.47:0/3364873909 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fe4c4068f60 0x7fe4c406b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0006fd0 tx=0x7fe4c0008040 comp rx=0 tx=0).stop 2024-02-07T12:22:30.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:30.038+0000 7fe4dca79700 1 -- 172.21.15.47:0/3364873909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4d80fb570 msgr2=0x7fe4d8113d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:30.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:30.038+0000 7fe4dca79700 1 --2- 172.21.15.47:0/3364873909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4d80fb570 0x7fe4d8113d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000bf60 tx=0x7fe4d0004d10 comp rx=0 tx=0).stop 2024-02-07T12:22:30.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:30.038+0000 7fe4dca79700 1 -- 172.21.15.47:0/3364873909 shutdown_connections 2024-02-07T12:22:30.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:30.038+0000 7fe4dca79700 1 --2- 172.21.15.47:0/3364873909 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fe4c4068f60 0x7fe4c406b410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:30.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:30.038+0000 7fe4dca79700 1 --2- 172.21.15.47:0/3364873909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4d80fb570 0x7fe4d8113d10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:30.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:30.038+0000 7fe4dca79700 1 --2- 172.21.15.47:0/3364873909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4d8103140 0x7fe4d8114250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:30.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:30.038+0000 7fe4dca79700 1 -- 172.21.15.47:0/3364873909 >> 172.21.15.47:0/3364873909 conn(0x7fe4d8071560 msgr2=0x7fe4d80f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:30.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:30.039+0000 7fe4dca79700 1 -- 172.21.15.47:0/3364873909 shutdown_connections 2024-02-07T12:22:30.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:30.039+0000 7fe4dca79700 1 -- 172.21.15.47:0/3364873909 wait complete. 2024-02-07T12:22:30.042 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-02-07T12:22:30.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:29 smithi138 ceph-mon[35528]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:30.779 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-02-07T12:22:28.898589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787652,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683260,"statfs":{"total":575970213888,"available":574139658240,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002070"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":189,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-07T12:21:33.307695+0000","last_change":"2024-02-07T12:21:08.302779+0000","last_active":"2024-02-07T12:21:33.307695+0000","last_peered":"2024-02-07T12:21:33.307695+0000","last_clean":"2024-02-07T12:21:33.307695+0000","last_became_active":"2024-02-07T12:21:08.302512+0000","last_became_peered":"2024-02-07T12:21:08.302512+0000","last_unstale":"2024-02-07T12:21:33.307695+0000","last_undegraded":"2024-02-07T12:21:33.307695+0000","last_fullsized":"2024-02-07T12:21:33.307695+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-07T12:20:21.241131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-07T12:20:21.241131+0000","last_clean_scrub_stamp":"2024-02-07T12:20:21.241131+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-09T00:15:17.904112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":4,"up_from":35,"seq":150323855377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 7 12:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.74099999999999999}]},{"osd":1,"last update":"Wed Feb 7 12:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.61399999999999999}]},{"osd":2,"last update":"Wed Feb 7 12:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.69999999999999996}]},{"osd":3,"last update":"Wed Feb 7 12:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 7 12:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.41099999999999998}]},{"osd":1,"last update":"Wed Feb 7 12:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.53200000000000003}]},{"osd":2,"last update":"Wed Feb 7 12:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.42599999999999999}]},{"osd":4,"last update":"Wed Feb 7 12:22:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 7 12:22:22 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36599999999999999,"15min":0.371},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46899999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38500000000000001,"15min":0.39100000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.49299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.32100000000000001}]},{"osd":1,"last update":"Wed Feb 7 12:22:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55000000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41299999999999998,"15min":0.42099999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58099999999999996,"5min":0.621,"15min":0.621},"last":0.309}]},{"osd":3,"last update":"Wed Feb 7 12:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Feb 7 12:22:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.497},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 7 12:21:55 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.29799999999999999,"15min":0.28799999999999998},"min":{"1min":0.23699999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.313,"15min":0.30599999999999999},"min":{"1min":0.24099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.24099999999999999}]},{"osd":2,"last update":"Wed Feb 7 12:22:27 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.36699999999999999,"15min":0.373},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.434,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.40400000000000003,"15min":0.41399999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.42199999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.28000000000000003}]},{"osd":3,"last update":"Wed Feb 7 12:21:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed Feb 7 12:22:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 7 12:21:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.314,"15min":0.30099999999999999},"min":{"1min":0.23699999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.32800000000000001,"15min":0.32200000000000001},"min":{"1min":0.26800000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.373}]},{"osd":2,"last update":"Wed Feb 7 12:22:25 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36299999999999999},"min":{"1min":0.27100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.51300000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.54300000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.32400000000000001}]},{"osd":3,"last update":"Wed Feb 7 12:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57999999999999996}]},{"osd":4,"last update":"Wed Feb 7 12:22:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-07T12:22:30.780 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-07T12:22:30.780 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-07T12:22:30.780 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-07T12:22:30.780 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph health --format=json 2024-02-07T12:22:31.043 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:31.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:30 smithi047 ceph-mon[28972]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-07T12:22:31.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:30 smithi138 ceph-mon[35528]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-07T12:22:32.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:31 smithi138 ceph-mon[35528]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:32.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:31 smithi047 ceph-mon[28972]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:32.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.651+0000 7fed36928700 1 -- 172.21.15.47:0/2575683935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed30102f40 msgr2=0x7fed30103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:32.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.651+0000 7fed36928700 1 --2- 172.21.15.47:0/2575683935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed30102f40 0x7fed30103310 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fed18004940 tx=0x7fed18009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:32.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.651+0000 7fed36928700 1 -- 172.21.15.47:0/2575683935 shutdown_connections 2024-02-07T12:22:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.651+0000 7fed36928700 1 --2- 172.21.15.47:0/2575683935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed301038e0 0x7fed300fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.651+0000 7fed36928700 1 --2- 172.21.15.47:0/2575683935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed30102f40 0x7fed30103310 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.651+0000 7fed36928700 1 -- 172.21.15.47:0/2575683935 >> 172.21.15.47:0/2575683935 conn(0x7fed300f8af0 msgr2=0x7fed300faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.651+0000 7fed36928700 1 -- 172.21.15.47:0/2575683935 shutdown_connections 2024-02-07T12:22:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.651+0000 7fed36928700 1 -- 172.21.15.47:0/2575683935 wait complete. 2024-02-07T12:22:32.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.651+0000 7fed36928700 1 Processor -- start 2024-02-07T12:22:32.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.652+0000 7fed36928700 1 -- start start 2024-02-07T12:22:32.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.652+0000 7fed36928700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed30102f40 0x7fed30113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:32.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.652+0000 7fed36928700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed301038e0 0x7fed30113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:32.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.652+0000 7fed36928700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed301145f0 con 0x7fed30102f40 2024-02-07T12:22:32.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.652+0000 7fed36928700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3010d920 con 0x7fed301038e0 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.652+0000 7fed2ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed30102f40 0x7fed30113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.652+0000 7fed2ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed30102f40 0x7fed30113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39620/0 (socket says 172.21.15.47:39620) 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.652+0000 7fed2ffff700 1 -- 172.21.15.47:0/572492250 learned_addr learned my addr 172.21.15.47:0/572492250 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.652+0000 7fed2f7fe700 1 --2- 172.21.15.47:0/572492250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed301038e0 0x7fed30113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.652+0000 7fed2ffff700 1 -- 172.21.15.47:0/572492250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed301038e0 msgr2=0x7fed30113fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.652+0000 7fed2ffff700 1 --2- 172.21.15.47:0/572492250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed301038e0 0x7fed30113fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.652+0000 7fed2ffff700 1 -- 172.21.15.47:0/572492250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed18005040 con 0x7fed30102f40 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.652+0000 7fed2ffff700 1 --2- 172.21.15.47:0/572492250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed30102f40 0x7fed30113a60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fed1800b3b0 tx=0x7fed18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.653+0000 7fed2cff9700 1 -- 172.21.15.47:0/572492250 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1800e040 con 0x7fed30102f40 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.653+0000 7fed2cff9700 1 -- 172.21.15.47:0/572492250 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed1800bbf0 con 0x7fed30102f40 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.653+0000 7fed36928700 1 -- 172.21.15.47:0/572492250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3010dba0 con 0x7fed30102f40 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.653+0000 7fed36928700 1 -- 172.21.15.47:0/572492250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3010e0e0 con 0x7fed30102f40 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.653+0000 7fed2cff9700 1 -- 172.21.15.47:0/572492250 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1801c630 con 0x7fed30102f40 2024-02-07T12:22:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.654+0000 7fed36928700 1 -- 172.21.15.47:0/572492250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed300fc6f0 con 0x7fed30102f40 2024-02-07T12:22:32.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.654+0000 7fed2cff9700 1 -- 172.21.15.47:0/572492250 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fed1800bd60 con 0x7fed30102f40 2024-02-07T12:22:32.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.654+0000 7fed2cff9700 1 --2- 172.21.15.47:0/572492250 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fed1c068f60 0x7fed1c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:32.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.654+0000 7fed2cff9700 1 -- 172.21.15.47:0/572492250 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fed18087e70 con 0x7fed30102f40 2024-02-07T12:22:32.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.654+0000 7fed2f7fe700 1 --2- 172.21.15.47:0/572492250 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fed1c068f60 0x7fed1c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:32.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.655+0000 7fed2f7fe700 1 --2- 172.21.15.47:0/572492250 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fed1c068f60 0x7fed1c06b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fed3010f290 tx=0x7fed20009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:32.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.659+0000 7fed2cff9700 1 -- 172.21.15.47:0/572492250 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fed18058110 con 0x7fed30102f40 2024-02-07T12:22:32.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.893+0000 7fed36928700 1 -- 172.21.15.47:0/572492250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fed3010f040 con 0x7fed30102f40 2024-02-07T12:22:32.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.894+0000 7fed2cff9700 1 -- 172.21.15.47:0/572492250 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fed18057ca0 con 0x7fed30102f40 2024-02-07T12:22:32.897 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:22:32.897 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-07T12:22:32.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.896+0000 7fed36928700 1 -- 172.21.15.47:0/572492250 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fed1c068f60 msgr2=0x7fed1c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:32.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.896+0000 7fed36928700 1 --2- 172.21.15.47:0/572492250 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fed1c068f60 0x7fed1c06b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fed3010f290 tx=0x7fed20009ee0 comp rx=0 tx=0).stop 2024-02-07T12:22:32.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.896+0000 7fed36928700 1 -- 172.21.15.47:0/572492250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed30102f40 msgr2=0x7fed30113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:32.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.896+0000 7fed36928700 1 --2- 172.21.15.47:0/572492250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed30102f40 0x7fed30113a60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fed1800b3b0 tx=0x7fed18009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:32.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.896+0000 7fed36928700 1 -- 172.21.15.47:0/572492250 shutdown_connections 2024-02-07T12:22:32.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.896+0000 7fed36928700 1 --2- 172.21.15.47:0/572492250 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fed1c068f60 0x7fed1c06b410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:32.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.896+0000 7fed36928700 1 --2- 172.21.15.47:0/572492250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed30102f40 0x7fed30113a60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:32.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.896+0000 7fed36928700 1 --2- 172.21.15.47:0/572492250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed301038e0 0x7fed30113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:32.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.896+0000 7fed36928700 1 -- 172.21.15.47:0/572492250 >> 172.21.15.47:0/572492250 conn(0x7fed300f8af0 msgr2=0x7fed300fa4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:32.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.896+0000 7fed36928700 1 -- 172.21.15.47:0/572492250 shutdown_connections 2024-02-07T12:22:32.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:32.896+0000 7fed36928700 1 -- 172.21.15.47:0/572492250 wait complete. 2024-02-07T12:22:33.190 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:32 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/572492250' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-07T12:22:33.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:32 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/572492250' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-07T12:22:33.542 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-07T12:22:33.543 INFO:tasks.cephadm:Setup complete, yielding 2024-02-07T12:22:33.543 INFO:teuthology.run_tasks:Running task print... 2024-02-07T12:22:33.553 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-02-07T12:22:33.553 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-07T12:22:33.563 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:22:33.564 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-02-07T12:22:33.821 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:34.278 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:33 smithi047 ceph-mon[28972]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:34.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:33 smithi138 ceph-mon[35528]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:35.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.585+0000 7f803fc51700 1 -- 172.21.15.47:0/209995431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80380fcfb0 msgr2=0x7f80380fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:35.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.585+0000 7f803fc51700 1 --2- 172.21.15.47:0/209995431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80380fcfb0 0x7f80380fd420 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8028004940 tx=0x7f8028009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:35.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.586+0000 7f803fc51700 1 -- 172.21.15.47:0/209995431 shutdown_connections 2024-02-07T12:22:35.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.586+0000 7f803fc51700 1 --2- 172.21.15.47:0/209995431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80380fcfb0 0x7f80380fd420 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:35.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.586+0000 7f803fc51700 1 --2- 172.21.15.47:0/209995431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80380fbe40 0x7f80380fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:35.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.586+0000 7f803fc51700 1 -- 172.21.15.47:0/209995431 >> 172.21.15.47:0/209995431 conn(0x7f80380f7520 msgr2=0x7f80380f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:35.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.586+0000 7f803fc51700 1 -- 172.21.15.47:0/209995431 shutdown_connections 2024-02-07T12:22:35.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.586+0000 7f803fc51700 1 -- 172.21.15.47:0/209995431 wait complete. 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.586+0000 7f803fc51700 1 Processor -- start 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.586+0000 7f803fc51700 1 -- start start 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.586+0000 7f803fc51700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80380fbe40 0x7f803810d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.586+0000 7f803fc51700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80380fcfb0 0x7f803810de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.586+0000 7f803fc51700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803810e4f0 con 0x7f80380fcfb0 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.586+0000 7f803fc51700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803810ed30 con 0x7f80380fbe40 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.587+0000 7f803d1ec700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80380fcfb0 0x7f803810de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.587+0000 7f803d1ec700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80380fcfb0 0x7f803810de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39646/0 (socket says 172.21.15.47:39646) 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.587+0000 7f803d1ec700 1 -- 172.21.15.47:0/1549979306 learned_addr learned my addr 172.21.15.47:0/1549979306 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.587+0000 7f803d9ed700 1 --2- 172.21.15.47:0/1549979306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80380fbe40 0x7f803810d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.587+0000 7f803d1ec700 1 -- 172.21.15.47:0/1549979306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80380fbe40 msgr2=0x7f803810d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.587+0000 7f803d1ec700 1 --2- 172.21.15.47:0/1549979306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80380fbe40 0x7f803810d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.587+0000 7f803d1ec700 1 -- 172.21.15.47:0/1549979306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8028005040 con 0x7f80380fcfb0 2024-02-07T12:22:35.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.587+0000 7f803d1ec700 1 --2- 172.21.15.47:0/1549979306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80380fcfb0 0x7f803810de60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f802800b3b0 tx=0x7f8028009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:35.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.587+0000 7f802e7fc700 1 -- 172.21.15.47:0/1549979306 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f802800e040 con 0x7f80380fcfb0 2024-02-07T12:22:35.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.587+0000 7f802e7fc700 1 -- 172.21.15.47:0/1549979306 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8028009b10 con 0x7f80380fcfb0 2024-02-07T12:22:35.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.587+0000 7f803fc51700 1 -- 172.21.15.47:0/1549979306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803810efb0 con 0x7f80380fcfb0 2024-02-07T12:22:35.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.588+0000 7f802e7fc700 1 -- 172.21.15.47:0/1549979306 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8028013ea0 con 0x7f80380fcfb0 2024-02-07T12:22:35.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.588+0000 7f803fc51700 1 -- 172.21.15.47:0/1549979306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803810f4f0 con 0x7f80380fcfb0 2024-02-07T12:22:35.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.589+0000 7f802e7fc700 1 -- 172.21.15.47:0/1549979306 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f802800bcc0 con 0x7f80380fcfb0 2024-02-07T12:22:35.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.589+0000 7f803fc51700 1 -- 172.21.15.47:0/1549979306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803804bed0 con 0x7f80380fcfb0 2024-02-07T12:22:35.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.589+0000 7f802e7fc700 1 --2- 172.21.15.47:0/1549979306 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8024068f60 0x7f802406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:35.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.589+0000 7f802e7fc700 1 -- 172.21.15.47:0/1549979306 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8028087d60 con 0x7f80380fcfb0 2024-02-07T12:22:35.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.589+0000 7f803d9ed700 1 --2- 172.21.15.47:0/1549979306 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8024068f60 0x7f802406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:35.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.589+0000 7f803d9ed700 1 --2- 172.21.15.47:0/1549979306 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8024068f60 0x7f802406b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8034009bf0 tx=0x7f80340091a0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:35.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.594+0000 7f802e7fc700 1 -- 172.21.15.47:0/1549979306 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f80280580a0 con 0x7f80380fcfb0 2024-02-07T12:22:35.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.810+0000 7f803fc51700 1 -- 172.21.15.47:0/1549979306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f803810f9b0 con 0x7f80380fcfb0 2024-02-07T12:22:35.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.814+0000 7f802e7fc700 1 -- 172.21.15.47:0/1549979306 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f8028057c30 con 0x7f80380fcfb0 2024-02-07T12:22:35.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.817+0000 7f803fc51700 1 -- 172.21.15.47:0/1549979306 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8024068f60 msgr2=0x7f802406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:35.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.817+0000 7f803fc51700 1 --2- 172.21.15.47:0/1549979306 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8024068f60 0x7f802406b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8034009bf0 tx=0x7f80340091a0 comp rx=0 tx=0).stop 2024-02-07T12:22:35.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.817+0000 7f803fc51700 1 -- 172.21.15.47:0/1549979306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80380fcfb0 msgr2=0x7f803810de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:35.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.817+0000 7f803fc51700 1 --2- 172.21.15.47:0/1549979306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80380fcfb0 0x7f803810de60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f802800b3b0 tx=0x7f8028009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:35.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.817+0000 7f803fc51700 1 -- 172.21.15.47:0/1549979306 shutdown_connections 2024-02-07T12:22:35.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.817+0000 7f803fc51700 1 --2- 172.21.15.47:0/1549979306 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8024068f60 0x7f802406b410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:35.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.817+0000 7f803fc51700 1 --2- 172.21.15.47:0/1549979306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80380fbe40 0x7f803810d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:35.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.817+0000 7f803fc51700 1 --2- 172.21.15.47:0/1549979306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80380fcfb0 0x7f803810de60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:35.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.817+0000 7f803fc51700 1 -- 172.21.15.47:0/1549979306 >> 172.21.15.47:0/1549979306 conn(0x7f80380f7520 msgr2=0x7f8038065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:35.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.817+0000 7f803fc51700 1 -- 172.21.15.47:0/1549979306 shutdown_connections 2024-02-07T12:22:35.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:35.817+0000 7f803fc51700 1 -- 172.21.15.47:0/1549979306 wait complete. 2024-02-07T12:22:36.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:35 smithi047 ceph-mon[28972]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:36.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:22:36.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:35 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1549979306' entity='client.admin' 2024-02-07T12:22:36.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:35 smithi138 ceph-mon[35528]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:36.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:22:36.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:35 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/1549979306' entity='client.admin' 2024-02-07T12:22:36.530 INFO:teuthology.run_tasks:Running task print... 2024-02-07T12:22:36.539 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-02-07T12:22:36.539 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-07T12:22:36.547 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:22:36.547 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph orch status' 2024-02-07T12:22:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:37.276 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:22:37.276 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:22:37.276 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:37.276 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:22:37.276 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:22:37.276 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:22:37.276 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:37.276 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:22:37.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:22:37.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:22:37.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:37.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:22:37.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:22:37.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:22:37.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:37.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:22:38.182 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:37 smithi047 ceph-mon[28972]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:38.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:37 smithi138 ceph-mon[35528]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.414+0000 7fd8672d0700 1 -- 172.21.15.47:0/3218634235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd860100120 msgr2=0x7fd860102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.414+0000 7fd8672d0700 1 --2- 172.21.15.47:0/3218634235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd860100120 0x7fd860102520 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd854004940 tx=0x7fd854009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.414+0000 7fd8672d0700 1 -- 172.21.15.47:0/3218634235 shutdown_connections 2024-02-07T12:22:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.414+0000 7fd8672d0700 1 --2- 172.21.15.47:0/3218634235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd860100120 0x7fd860102520 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.414+0000 7fd8672d0700 1 --2- 172.21.15.47:0/3218634235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd860066380 0x7fd8600ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.414+0000 7fd8672d0700 1 -- 172.21.15.47:0/3218634235 >> 172.21.15.47:0/3218634235 conn(0x7fd8600f74e0 msgr2=0x7fd8600f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.414+0000 7fd8672d0700 1 -- 172.21.15.47:0/3218634235 shutdown_connections 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.414+0000 7fd8672d0700 1 -- 172.21.15.47:0/3218634235 wait complete. 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.415+0000 7fd8672d0700 1 Processor -- start 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.415+0000 7fd8672d0700 1 -- start start 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.415+0000 7fd8672d0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd860066380 0x7fd86010d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.415+0000 7fd8672d0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd860100120 0x7fd86010de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.415+0000 7fd8672d0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86010e510 con 0x7fd860066380 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.415+0000 7fd8672d0700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86010ed50 con 0x7fd860100120 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.415+0000 7fd86506c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd860066380 0x7fd86010d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.415+0000 7fd86506c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd860066380 0x7fd86010d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39664/0 (socket says 172.21.15.47:39664) 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.415+0000 7fd86506c700 1 -- 172.21.15.47:0/1052506883 learned_addr learned my addr 172.21.15.47:0/1052506883 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.415+0000 7fd86506c700 1 -- 172.21.15.47:0/1052506883 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd860100120 msgr2=0x7fd86010de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.415+0000 7fd86506c700 1 --2- 172.21.15.47:0/1052506883 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd860100120 0x7fd86010de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:38.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.415+0000 7fd86506c700 1 -- 172.21.15.47:0/1052506883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd854005040 con 0x7fd860066380 2024-02-07T12:22:38.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.415+0000 7fd86506c700 1 --2- 172.21.15.47:0/1052506883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd860066380 0x7fd86010d940 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00b790 tx=0x7fd85c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:38.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.416+0000 7fd851ffb700 1 -- 172.21.15.47:0/1052506883 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd85c00f770 con 0x7fd860066380 2024-02-07T12:22:38.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.416+0000 7fd851ffb700 1 -- 172.21.15.47:0/1052506883 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd85c00fda0 con 0x7fd860066380 2024-02-07T12:22:38.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.416+0000 7fd851ffb700 1 -- 172.21.15.47:0/1052506883 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd85c00d310 con 0x7fd860066380 2024-02-07T12:22:38.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.416+0000 7fd8672d0700 1 -- 172.21.15.47:0/1052506883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86010f030 con 0x7fd860066380 2024-02-07T12:22:38.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.416+0000 7fd8672d0700 1 -- 172.21.15.47:0/1052506883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86010f570 con 0x7fd860066380 2024-02-07T12:22:38.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.417+0000 7fd8672d0700 1 -- 172.21.15.47:0/1052506883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd860107ad0 con 0x7fd860066380 2024-02-07T12:22:38.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.417+0000 7fd851ffb700 1 -- 172.21.15.47:0/1052506883 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd85c010420 con 0x7fd860066380 2024-02-07T12:22:38.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.417+0000 7fd851ffb700 1 --2- 172.21.15.47:0/1052506883 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd84c068f70 0x7fd84c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:38.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.417+0000 7fd851ffb700 1 -- 172.21.15.47:0/1052506883 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd85c086970 con 0x7fd860066380 2024-02-07T12:22:38.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.417+0000 7fd86486b700 1 --2- 172.21.15.47:0/1052506883 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd84c068f70 0x7fd84c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:38.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.418+0000 7fd86486b700 1 --2- 172.21.15.47:0/1052506883 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd84c068f70 0x7fd84c06b420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd854004f90 tx=0x7fd854009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:38.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.422+0000 7fd851ffb700 1 -- 172.21.15.47:0/1052506883 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd85c056cb0 con 0x7fd860066380 2024-02-07T12:22:38.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.628+0000 7fd8672d0700 1 -- 172.21.15.47:0/1052506883 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd86010f9b0 con 0x7fd84c068f70 2024-02-07T12:22:38.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.629+0000 7fd851ffb700 1 -- 172.21.15.47:0/1052506883 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd86010f9b0 con 0x7fd84c068f70 2024-02-07T12:22:38.632 INFO:teuthology.orchestra.run.smithi047.stdout:Backend: cephadm 2024-02-07T12:22:38.632 INFO:teuthology.orchestra.run.smithi047.stdout:Available: Yes 2024-02-07T12:22:38.633 INFO:teuthology.orchestra.run.smithi047.stdout:Paused: No 2024-02-07T12:22:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.631+0000 7fd8672d0700 1 -- 172.21.15.47:0/1052506883 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd84c068f70 msgr2=0x7fd84c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.631+0000 7fd8672d0700 1 --2- 172.21.15.47:0/1052506883 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd84c068f70 0x7fd84c06b420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd854004f90 tx=0x7fd854009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.631+0000 7fd8672d0700 1 -- 172.21.15.47:0/1052506883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd860066380 msgr2=0x7fd86010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.631+0000 7fd8672d0700 1 --2- 172.21.15.47:0/1052506883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd860066380 0x7fd86010d940 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00b790 tx=0x7fd85c009250 comp rx=0 tx=0).stop 2024-02-07T12:22:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.631+0000 7fd8672d0700 1 -- 172.21.15.47:0/1052506883 shutdown_connections 2024-02-07T12:22:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.631+0000 7fd8672d0700 1 --2- 172.21.15.47:0/1052506883 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fd84c068f70 0x7fd84c06b420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.631+0000 7fd8672d0700 1 --2- 172.21.15.47:0/1052506883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd860066380 0x7fd86010d940 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.631+0000 7fd8672d0700 1 --2- 172.21.15.47:0/1052506883 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd860100120 0x7fd86010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.631+0000 7fd8672d0700 1 -- 172.21.15.47:0/1052506883 >> 172.21.15.47:0/1052506883 conn(0x7fd8600f74e0 msgr2=0x7fd8600f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.631+0000 7fd8672d0700 1 -- 172.21.15.47:0/1052506883 shutdown_connections 2024-02-07T12:22:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:38.631+0000 7fd8672d0700 1 -- 172.21.15.47:0/1052506883 wait complete. 2024-02-07T12:22:39.239 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-07T12:22:39.504 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:40.259 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:39 smithi047 ceph-mon[28972]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:22:40.260 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:39 smithi047 ceph-mon[28972]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:40.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:39 smithi138 ceph-mon[35528]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:22:40.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:39 smithi138 ceph-mon[35528]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.078+0000 7f5c8da62700 1 -- 172.21.15.47:0/1089889852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c880fe0e0 msgr2=0x7f5c880fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.078+0000 7f5c8da62700 1 --2- 172.21.15.47:0/1089889852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c880fe0e0 0x7f5c880fe550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5c70004940 tx=0x7f5c70009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.078+0000 7f5c8da62700 1 -- 172.21.15.47:0/1089889852 shutdown_connections 2024-02-07T12:22:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.078+0000 7f5c8da62700 1 --2- 172.21.15.47:0/1089889852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c880fe0e0 0x7f5c880fe550 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.078+0000 7f5c8da62700 1 --2- 172.21.15.47:0/1089889852 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c880fcef0 0x7f5c880fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.078+0000 7f5c8da62700 1 -- 172.21.15.47:0/1089889852 >> 172.21.15.47:0/1089889852 conn(0x7f5c880f8620 msgr2=0x7f5c880faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.078+0000 7f5c8da62700 1 -- 172.21.15.47:0/1089889852 shutdown_connections 2024-02-07T12:22:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.078+0000 7f5c8da62700 1 -- 172.21.15.47:0/1089889852 wait complete. 2024-02-07T12:22:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.078+0000 7f5c8da62700 1 Processor -- start 2024-02-07T12:22:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.078+0000 7f5c8da62700 1 -- start start 2024-02-07T12:22:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c8da62700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c880fcef0 0x7f5c88071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c8da62700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c880fe0e0 0x7f5c880702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c8da62700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c880708e0 con 0x7f5c880fe0e0 2024-02-07T12:22:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c8da62700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c88070a50 con 0x7f5c880fcef0 2024-02-07T12:22:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c86ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c880fe0e0 0x7f5c880702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c86ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c880fe0e0 0x7f5c880702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49868/0 (socket says 172.21.15.47:49868) 2024-02-07T12:22:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c86ffd700 1 -- 172.21.15.47:0/1005158722 learned_addr learned my addr 172.21.15.47:0/1005158722 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c877fe700 1 --2- 172.21.15.47:0/1005158722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c880fcef0 0x7f5c88071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c86ffd700 1 -- 172.21.15.47:0/1005158722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c880fcef0 msgr2=0x7f5c88071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c86ffd700 1 --2- 172.21.15.47:0/1005158722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c880fcef0 0x7f5c88071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c86ffd700 1 -- 172.21.15.47:0/1005158722 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c70005040 con 0x7f5c880fe0e0 2024-02-07T12:22:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c86ffd700 1 --2- 172.21.15.47:0/1005158722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c880fe0e0 0x7f5c880702e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5c700093b0 tx=0x7f5c70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c7ffff700 1 -- 172.21.15.47:0/1005158722 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c7000e040 con 0x7f5c880fe0e0 2024-02-07T12:22:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c8da62700 1 -- 172.21.15.47:0/1005158722 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c88070cd0 con 0x7f5c880fe0e0 2024-02-07T12:22:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c7ffff700 1 -- 172.21.15.47:0/1005158722 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c7000bcc0 con 0x7f5c880fe0e0 2024-02-07T12:22:41.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.079+0000 7f5c7ffff700 1 -- 172.21.15.47:0/1005158722 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c7001c630 con 0x7f5c880fe0e0 2024-02-07T12:22:41.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.080+0000 7f5c8da62700 1 -- 172.21.15.47:0/1005158722 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c881159a0 con 0x7f5c880fe0e0 2024-02-07T12:22:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.080+0000 7f5c7dffb700 1 -- 172.21.15.47:0/1005158722 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6c0052b0 con 0x7f5c880fe0e0 2024-02-07T12:22:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.081+0000 7f5c7ffff700 1 -- 172.21.15.47:0/1005158722 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5c70013980 con 0x7f5c880fe0e0 2024-02-07T12:22:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.081+0000 7f5c7ffff700 1 --2- 172.21.15.47:0/1005158722 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f5c74068f60 0x7f5c7406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.081+0000 7f5c7ffff700 1 -- 172.21.15.47:0/1005158722 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5c70087e80 con 0x7f5c880fe0e0 2024-02-07T12:22:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.081+0000 7f5c877fe700 1 --2- 172.21.15.47:0/1005158722 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f5c74068f60 0x7f5c7406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.082+0000 7f5c877fe700 1 --2- 172.21.15.47:0/1005158722 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f5c74068f60 0x7f5c7406b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5c88071bf0 tx=0x7f5c8000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:41.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.086+0000 7f5c7ffff700 1 -- 172.21.15.47:0/1005158722 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5c70058080 con 0x7f5c880fe0e0 2024-02-07T12:22:41.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.284+0000 7f5c7dffb700 1 -- 172.21.15.47:0/1005158722 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c6c000bc0 con 0x7f5c74068f60 2024-02-07T12:22:41.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.294+0000 7f5c7ffff700 1 -- 172.21.15.47:0/1005158722 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2700 (secure 0 0 0) 0x7f5c6c000bc0 con 0x7f5c74068f60 2024-02-07T12:22:41.297 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:22:41.297 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (3m) 2m ago 5m 28.3M - 0.25.0 c8568f914cd2 edd19ce884c8 2024-02-07T12:22:41.297 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (5m) 2m ago 5m 6660k - 17.2.7-491-gf2462625 4ad3622d1b31 bca7317ed169 2024-02-07T12:22:41.297 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (4m) 69s ago 4m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 110c84c6624b 2024-02-07T12:22:41.297 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (3m) 2m ago 4m 78.0M - 9.4.7 954c08fa6188 5b93631efbfc 2024-02-07T12:22:41.297 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:9283 running (6m) 2m ago 6m 470M - 17.2.7-491-gf2462625 4ad3622d1b31 f3b25479d84e 2024-02-07T12:22:41.298 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283 running (4m) 69s ago 4m 434M - 17.2.7-491-gf2462625 4ad3622d1b31 ad543214819c 2024-02-07T12:22:41.298 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (6m) 2m ago 6m 40.7M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 105826d9ef9a 2024-02-07T12:22:41.298 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (4m) 69s ago 4m 38.4M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 02dfa0b8d573 2024-02-07T12:22:41.298 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (5m) 2m ago 5m 15.9M - 1.5.0 0da6a335fe13 ba35c488ed6d 2024-02-07T12:22:41.298 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (4m) 69s ago 4m 15.7M - 1.5.0 0da6a335fe13 8823dad6f717 2024-02-07T12:22:41.298 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (3m) 2m ago 3m 38.3M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 4f37918f583a 2024-02-07T12:22:41.298 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (2m) 2m ago 2m 35.8M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 1c6e3c603ed3 2024-02-07T12:22:41.298 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (2m) 2m ago 2m 35.4M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:22:41.298 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (2m) 69s ago 2m 41.5M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:22:41.298 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (100s) 69s ago 99s 36.5M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:22:41.298 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (74s) 69s ago 74s 13.4M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:22:41.298 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (3m) 2m ago 4m 39.5M - 2.43.0 a07b618ecd1d e41b94b0d167 2024-02-07T12:22:41.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.296+0000 7f5c7dffb700 1 -- 172.21.15.47:0/1005158722 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f5c74068f60 msgr2=0x7f5c7406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.296+0000 7f5c7dffb700 1 --2- 172.21.15.47:0/1005158722 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f5c74068f60 0x7f5c7406b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5c88071bf0 tx=0x7f5c8000b040 comp rx=0 tx=0).stop 2024-02-07T12:22:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.296+0000 7f5c7dffb700 1 -- 172.21.15.47:0/1005158722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c880fe0e0 msgr2=0x7f5c880702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.296+0000 7f5c7dffb700 1 --2- 172.21.15.47:0/1005158722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c880fe0e0 0x7f5c880702e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5c700093b0 tx=0x7f5c70009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.296+0000 7f5c7dffb700 1 -- 172.21.15.47:0/1005158722 shutdown_connections 2024-02-07T12:22:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.296+0000 7f5c7dffb700 1 --2- 172.21.15.47:0/1005158722 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f5c74068f60 0x7f5c7406b410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.296+0000 7f5c7dffb700 1 --2- 172.21.15.47:0/1005158722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c880fcef0 0x7f5c88071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.296+0000 7f5c7dffb700 1 --2- 172.21.15.47:0/1005158722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c880fe0e0 0x7f5c880702e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.296+0000 7f5c7dffb700 1 -- 172.21.15.47:0/1005158722 >> 172.21.15.47:0/1005158722 conn(0x7f5c880f8620 msgr2=0x7f5c881013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.296+0000 7f5c7dffb700 1 -- 172.21.15.47:0/1005158722 shutdown_connections 2024-02-07T12:22:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:41.296+0000 7f5c7dffb700 1 -- 172.21.15.47:0/1005158722 wait complete. 2024-02-07T12:22:41.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:41 smithi047 ceph-mon[28972]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:41.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:41 smithi047 ceph-mon[28972]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:22:41.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:41 smithi138 ceph-mon[35528]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:41.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:41 smithi138 ceph-mon[35528]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:22:41.873 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-07T12:22:42.135 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:43.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.708+0000 7fbc85f1f700 1 -- 172.21.15.47:0/3478502007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc800fcfb0 msgr2=0x7fbc800fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:43.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.708+0000 7fbc85f1f700 1 --2- 172.21.15.47:0/3478502007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc800fcfb0 0x7fbc800fd420 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbc68004940 tx=0x7fbc68009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:43.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.708+0000 7fbc85f1f700 1 -- 172.21.15.47:0/3478502007 shutdown_connections 2024-02-07T12:22:43.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.708+0000 7fbc85f1f700 1 --2- 172.21.15.47:0/3478502007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc800fcfb0 0x7fbc800fd420 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:43.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.708+0000 7fbc85f1f700 1 --2- 172.21.15.47:0/3478502007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc800fbe40 0x7fbc800fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:43.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.708+0000 7fbc85f1f700 1 -- 172.21.15.47:0/3478502007 >> 172.21.15.47:0/3478502007 conn(0x7fbc800f7500 msgr2=0x7fbc800f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:43.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.708+0000 7fbc85f1f700 1 -- 172.21.15.47:0/3478502007 shutdown_connections 2024-02-07T12:22:43.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.708+0000 7fbc85f1f700 1 -- 172.21.15.47:0/3478502007 wait complete. 2024-02-07T12:22:43.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.709+0000 7fbc85f1f700 1 Processor -- start 2024-02-07T12:22:43.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.709+0000 7fbc85f1f700 1 -- start start 2024-02-07T12:22:43.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.709+0000 7fbc85f1f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc800fbe40 0x7fbc8010c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:43.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.709+0000 7fbc85f1f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc800fcfb0 0x7fbc8010cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:43.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.709+0000 7fbc85f1f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8010d380 con 0x7fbc800fcfb0 2024-02-07T12:22:43.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.709+0000 7fbc85f1f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8010dc20 con 0x7fbc800fbe40 2024-02-07T12:22:43.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.709+0000 7fbc77fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc800fcfb0 0x7fbc8010cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:43.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.709+0000 7fbc77fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc800fcfb0 0x7fbc8010cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49882/0 (socket says 172.21.15.47:49882) 2024-02-07T12:22:43.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.709+0000 7fbc77fff700 1 -- 172.21.15.47:0/1477556502 learned_addr learned my addr 172.21.15.47:0/1477556502 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:43.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.710+0000 7fbc7f7fe700 1 --2- 172.21.15.47:0/1477556502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc800fbe40 0x7fbc8010c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:43.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.710+0000 7fbc77fff700 1 -- 172.21.15.47:0/1477556502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc800fbe40 msgr2=0x7fbc8010c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:43.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.710+0000 7fbc77fff700 1 --2- 172.21.15.47:0/1477556502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc800fbe40 0x7fbc8010c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:43.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.710+0000 7fbc77fff700 1 -- 172.21.15.47:0/1477556502 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc68005040 con 0x7fbc800fcfb0 2024-02-07T12:22:43.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.710+0000 7fbc7f7fe700 1 --2- 172.21.15.47:0/1477556502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc800fbe40 0x7fbc8010c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:22:43.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.710+0000 7fbc77fff700 1 --2- 172.21.15.47:0/1477556502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc800fcfb0 0x7fbc8010cd80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbc680093b0 tx=0x7fbc68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:43.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.710+0000 7fbc7cff9700 1 -- 172.21.15.47:0/1477556502 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc6800e040 con 0x7fbc800fcfb0 2024-02-07T12:22:43.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.710+0000 7fbc7cff9700 1 -- 172.21.15.47:0/1477556502 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc6800bcc0 con 0x7fbc800fcfb0 2024-02-07T12:22:43.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.710+0000 7fbc85f1f700 1 -- 172.21.15.47:0/1477556502 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8010dea0 con 0x7fbc800fcfb0 2024-02-07T12:22:43.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.710+0000 7fbc7cff9700 1 -- 172.21.15.47:0/1477556502 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc6801c630 con 0x7fbc800fcfb0 2024-02-07T12:22:43.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.710+0000 7fbc85f1f700 1 -- 172.21.15.47:0/1477556502 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8010e3e0 con 0x7fbc800fcfb0 2024-02-07T12:22:43.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.711+0000 7fbc85f1f700 1 -- 172.21.15.47:0/1477556502 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8004bed0 con 0x7fbc800fcfb0 2024-02-07T12:22:43.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.712+0000 7fbc7cff9700 1 -- 172.21.15.47:0/1477556502 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fbc68013420 con 0x7fbc800fcfb0 2024-02-07T12:22:43.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.712+0000 7fbc7cff9700 1 --2- 172.21.15.47:0/1477556502 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fbc6c068f60 0x7fbc6c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:43.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.712+0000 7fbc7cff9700 1 -- 172.21.15.47:0/1477556502 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbc68087db0 con 0x7fbc800fcfb0 2024-02-07T12:22:43.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.712+0000 7fbc7f7fe700 1 --2- 172.21.15.47:0/1477556502 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fbc6c068f60 0x7fbc6c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:43.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.712+0000 7fbc7f7fe700 1 --2- 172.21.15.47:0/1477556502 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fbc6c068f60 0x7fbc6c06b410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbc70009fd0 tx=0x7fbc70009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:43.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.716+0000 7fbc7cff9700 1 -- 172.21.15.47:0/1477556502 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbc680580f0 con 0x7fbc800fcfb0 2024-02-07T12:22:43.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.917+0000 7fbc85f1f700 1 -- 172.21.15.47:0/1477556502 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc8010e880 con 0x7fbc6c068f60 2024-02-07T12:22:43.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.921+0000 7fbc7cff9700 1 -- 172.21.15.47:0/1477556502 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7fbc8010e880 con 0x7fbc6c068f60 2024-02-07T12:22:43.923 INFO:teuthology.orchestra.run.smithi047.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-07T12:22:43.923 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-02-07T12:22:43.924 INFO:teuthology.orchestra.run.smithi047.stdout:crash 2/2 2m ago 5m * 2024-02-07T12:22:43.924 INFO:teuthology.orchestra.run.smithi047.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-02-07T12:22:43.924 INFO:teuthology.orchestra.run.smithi047.stdout:mgr 2/2 2m ago 6m count:2 2024-02-07T12:22:43.924 INFO:teuthology.orchestra.run.smithi047.stdout:mon 2/2 2m ago 5m smithi047:172.21.15.47=smithi047;smithi138:172.21.15.138=smithi138;count:2 2024-02-07T12:22:43.924 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-02-07T12:22:43.924 INFO:teuthology.orchestra.run.smithi047.stdout:osd 6 2m ago - 2024-02-07T12:22:43.924 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-02-07T12:22:43.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.923+0000 7fbc85f1f700 1 -- 172.21.15.47:0/1477556502 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fbc6c068f60 msgr2=0x7fbc6c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:43.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.923+0000 7fbc85f1f700 1 --2- 172.21.15.47:0/1477556502 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fbc6c068f60 0x7fbc6c06b410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbc70009fd0 tx=0x7fbc70009ee0 comp rx=0 tx=0).stop 2024-02-07T12:22:43.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.923+0000 7fbc85f1f700 1 -- 172.21.15.47:0/1477556502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc800fcfb0 msgr2=0x7fbc8010cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.923+0000 7fbc85f1f700 1 --2- 172.21.15.47:0/1477556502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc800fcfb0 0x7fbc8010cd80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbc680093b0 tx=0x7fbc68009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.923+0000 7fbc85f1f700 1 -- 172.21.15.47:0/1477556502 shutdown_connections 2024-02-07T12:22:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.923+0000 7fbc85f1f700 1 --2- 172.21.15.47:0/1477556502 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fbc6c068f60 0x7fbc6c06b410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.923+0000 7fbc85f1f700 1 --2- 172.21.15.47:0/1477556502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc800fbe40 0x7fbc8010c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.923+0000 7fbc85f1f700 1 --2- 172.21.15.47:0/1477556502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc800fcfb0 0x7fbc8010cd80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.923+0000 7fbc85f1f700 1 -- 172.21.15.47:0/1477556502 >> 172.21.15.47:0/1477556502 conn(0x7fbc800f7500 msgr2=0x7fbc80100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.923+0000 7fbc85f1f700 1 -- 172.21.15.47:0/1477556502 shutdown_connections 2024-02-07T12:22:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:43.923+0000 7fbc85f1f700 1 -- 172.21.15.47:0/1477556502 wait complete. 2024-02-07T12:22:44.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:43 smithi047 ceph-mon[28972]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:44.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:43 smithi138 ceph-mon[35528]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:44.681 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-07T12:22:44.942 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:45.230 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:44 smithi047 ceph-mon[28972]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:22:45.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:44 smithi138 ceph-mon[35528]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:22:45.961 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:45 smithi138 ceph-mon[35528]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:46.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:45 smithi047 ceph-mon[28972]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.692+0000 7f8536cc7700 1 -- 172.21.15.47:0/2375169164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85300fe2b0 msgr2=0x7f85300fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.692+0000 7f8536cc7700 1 --2- 172.21.15.47:0/2375169164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85300fe2b0 0x7f85300fe700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f851c004940 tx=0x7f851c009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.692+0000 7f8536cc7700 1 -- 172.21.15.47:0/2375169164 shutdown_connections 2024-02-07T12:22:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.692+0000 7f8536cc7700 1 --2- 172.21.15.47:0/2375169164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85300fe2b0 0x7f85300fe700 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.692+0000 7f8536cc7700 1 --2- 172.21.15.47:0/2375169164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85300fb220 0x7f85300fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.692+0000 7f8536cc7700 1 -- 172.21.15.47:0/2375169164 >> 172.21.15.47:0/2375169164 conn(0x7f85300f6ca0 msgr2=0x7f85300f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.692+0000 7f8536cc7700 1 -- 172.21.15.47:0/2375169164 shutdown_connections 2024-02-07T12:22:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.692+0000 7f8536cc7700 1 -- 172.21.15.47:0/2375169164 wait complete. 2024-02-07T12:22:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.692+0000 7f8536cc7700 1 Processor -- start 2024-02-07T12:22:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.692+0000 7f8536cc7700 1 -- start start 2024-02-07T12:22:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.693+0000 7f8536cc7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85300fb220 0x7f85300fdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.693+0000 7f8536cc7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85300fe2b0 0x7f85300fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.693+0000 7f8536cc7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300fc7c0 con 0x7f85300fb220 2024-02-07T12:22:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.693+0000 7f8536cc7700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300fc930 con 0x7f85300fe2b0 2024-02-07T12:22:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.693+0000 7f8534a63700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85300fb220 0x7f85300fdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.693+0000 7f8534a63700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85300fb220 0x7f85300fdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49906/0 (socket says 172.21.15.47:49906) 2024-02-07T12:22:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.693+0000 7f8534a63700 1 -- 172.21.15.47:0/1931324238 learned_addr learned my addr 172.21.15.47:0/1931324238 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.693+0000 7f852ffff700 1 --2- 172.21.15.47:0/1931324238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85300fe2b0 0x7f85300fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.693+0000 7f8534a63700 1 -- 172.21.15.47:0/1931324238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85300fe2b0 msgr2=0x7f85300fc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.693+0000 7f8534a63700 1 --2- 172.21.15.47:0/1931324238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85300fe2b0 0x7f85300fc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.693+0000 7f8534a63700 1 -- 172.21.15.47:0/1931324238 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c005040 con 0x7f85300fb220 2024-02-07T12:22:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.693+0000 7f852ffff700 1 --2- 172.21.15.47:0/1931324238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85300fe2b0 0x7f85300fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:22:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.693+0000 7f8534a63700 1 --2- 172.21.15.47:0/1931324238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85300fb220 0x7f85300fdd40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8524002a80 tx=0x7f8524004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.694+0000 7f852d7fa700 1 -- 172.21.15.47:0/1931324238 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8524007cc0 con 0x7f85300fb220 2024-02-07T12:22:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.694+0000 7f8536cc7700 1 -- 172.21.15.47:0/1931324238 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85300fcc10 con 0x7f85300fb220 2024-02-07T12:22:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.694+0000 7f852d7fa700 1 -- 172.21.15.47:0/1931324238 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f852400f040 con 0x7f85300fb220 2024-02-07T12:22:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.694+0000 7f852d7fa700 1 -- 172.21.15.47:0/1931324238 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f852400dad0 con 0x7f85300fb220 2024-02-07T12:22:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.694+0000 7f8536cc7700 1 -- 172.21.15.47:0/1931324238 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8530115a50 con 0x7f85300fb220 2024-02-07T12:22:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.694+0000 7f8536cc7700 1 -- 172.21.15.47:0/1931324238 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853004bed0 con 0x7f85300fb220 2024-02-07T12:22:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.695+0000 7f852d7fa700 1 -- 172.21.15.47:0/1931324238 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f852400dc30 con 0x7f85300fb220 2024-02-07T12:22:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.695+0000 7f852d7fa700 1 --2- 172.21.15.47:0/1931324238 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8520068f70 0x7f852006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.695+0000 7f852d7fa700 1 -- 172.21.15.47:0/1931324238 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f85240867f0 con 0x7f85300fb220 2024-02-07T12:22:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.696+0000 7f852ffff700 1 --2- 172.21.15.47:0/1931324238 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8520068f70 0x7f852006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.696+0000 7f852ffff700 1 --2- 172.21.15.47:0/1931324238 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8520068f70 0x7f852006b420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f851c00b840 tx=0x7f851c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:46.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.700+0000 7f852d7fa700 1 -- 172.21.15.47:0/1931324238 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8524056a10 con 0x7f85300fb220 2024-02-07T12:22:46.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.898+0000 7f8536cc7700 1 -- 172.21.15.47:0/1931324238 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8530102c00 con 0x7f8520068f70 2024-02-07T12:22:46.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.899+0000 7f852d7fa700 1 -- 172.21.15.47:0/1931324238 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f8530102c00 con 0x7f8520068f70 2024-02-07T12:22:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:HOST ADDR LABELS STATUS 2024-02-07T12:22:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047 172.21.15.47 2024-02-07T12:22:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:smithi138 172.21.15.138 2024-02-07T12:22:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:2 hosts in cluster 2024-02-07T12:22:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.901+0000 7f8536cc7700 1 -- 172.21.15.47:0/1931324238 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8520068f70 msgr2=0x7f852006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.901+0000 7f8536cc7700 1 --2- 172.21.15.47:0/1931324238 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8520068f70 0x7f852006b420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f851c00b840 tx=0x7f851c009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.901+0000 7f8536cc7700 1 -- 172.21.15.47:0/1931324238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85300fb220 msgr2=0x7f85300fdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.901+0000 7f8536cc7700 1 --2- 172.21.15.47:0/1931324238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85300fb220 0x7f85300fdd40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8524002a80 tx=0x7f8524004600 comp rx=0 tx=0).stop 2024-02-07T12:22:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.901+0000 7f8536cc7700 1 -- 172.21.15.47:0/1931324238 shutdown_connections 2024-02-07T12:22:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.901+0000 7f8536cc7700 1 --2- 172.21.15.47:0/1931324238 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8520068f70 0x7f852006b420 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.901+0000 7f8536cc7700 1 --2- 172.21.15.47:0/1931324238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85300fb220 0x7f85300fdd40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.901+0000 7f8536cc7700 1 --2- 172.21.15.47:0/1931324238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85300fe2b0 0x7f85300fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.901+0000 7f8536cc7700 1 -- 172.21.15.47:0/1931324238 >> 172.21.15.47:0/1931324238 conn(0x7f85300f6ca0 msgr2=0x7f85301014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.901+0000 7f8536cc7700 1 -- 172.21.15.47:0/1931324238 shutdown_connections 2024-02-07T12:22:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:46.901+0000 7f8536cc7700 1 -- 172.21.15.47:0/1931324238 wait complete. 2024-02-07T12:22:47.595 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-07T12:22:47.858 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:48.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:47 smithi138 ceph-mon[35528]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:22:48.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:47 smithi138 ceph-mon[35528]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:48.289 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:47 smithi047 ceph-mon[28972]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:22:48.290 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:47 smithi047 ceph-mon[28972]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.423+0000 7f7ae838a700 1 -- 172.21.15.47:0/1936013551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ae01000c0 msgr2=0x7f7ae0102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.423+0000 7f7ae838a700 1 --2- 172.21.15.47:0/1936013551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ae01000c0 0x7f7ae0102520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7adc004940 tx=0x7f7adc009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.423+0000 7f7ae838a700 1 -- 172.21.15.47:0/1936013551 shutdown_connections 2024-02-07T12:22:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.423+0000 7f7ae838a700 1 --2- 172.21.15.47:0/1936013551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ae01000c0 0x7f7ae0102520 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.423+0000 7f7ae838a700 1 --2- 172.21.15.47:0/1936013551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ae0066c70 0x7f7ae00ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.423+0000 7f7ae838a700 1 -- 172.21.15.47:0/1936013551 >> 172.21.15.47:0/1936013551 conn(0x7f7ae00f7520 msgr2=0x7f7ae00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.423+0000 7f7ae838a700 1 -- 172.21.15.47:0/1936013551 shutdown_connections 2024-02-07T12:22:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.423+0000 7f7ae838a700 1 -- 172.21.15.47:0/1936013551 wait complete. 2024-02-07T12:22:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.424+0000 7f7ae838a700 1 Processor -- start 2024-02-07T12:22:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.424+0000 7f7ae838a700 1 -- start start 2024-02-07T12:22:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.424+0000 7f7ae838a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ae0066c70 0x7f7ae00fd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.424+0000 7f7ae838a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ae01000c0 0x7f7ae00fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.424+0000 7f7ae838a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00fbff0 con 0x7f7ae01000c0 2024-02-07T12:22:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.424+0000 7f7ae838a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00fc160 con 0x7f7ae0066c70 2024-02-07T12:22:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.424+0000 7f7ae5925700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ae01000c0 0x7f7ae00fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.424+0000 7f7ae5925700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ae01000c0 0x7f7ae00fb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49912/0 (socket says 172.21.15.47:49912) 2024-02-07T12:22:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.424+0000 7f7ae5925700 1 -- 172.21.15.47:0/3148414507 learned_addr learned my addr 172.21.15.47:0/3148414507 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.424+0000 7f7ae6126700 1 --2- 172.21.15.47:0/3148414507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ae0066c70 0x7f7ae00fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.425+0000 7f7ae5925700 1 -- 172.21.15.47:0/3148414507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ae0066c70 msgr2=0x7f7ae00fd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.425+0000 7f7ae5925700 1 --2- 172.21.15.47:0/3148414507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ae0066c70 0x7f7ae00fd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.425+0000 7f7ae5925700 1 -- 172.21.15.47:0/3148414507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc005040 con 0x7f7ae01000c0 2024-02-07T12:22:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.425+0000 7f7ae6126700 1 --2- 172.21.15.47:0/3148414507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ae0066c70 0x7f7ae00fd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:22:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.425+0000 7f7ae5925700 1 --2- 172.21.15.47:0/3148414507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ae01000c0 0x7f7ae00fb9f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7adc000c00 tx=0x7f7adc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.425+0000 7f7ad6ffd700 1 -- 172.21.15.47:0/3148414507 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7adc00e040 con 0x7f7ae01000c0 2024-02-07T12:22:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.425+0000 7f7ad6ffd700 1 -- 172.21.15.47:0/3148414507 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7adc00bcc0 con 0x7f7ae01000c0 2024-02-07T12:22:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.425+0000 7f7ae838a700 1 -- 172.21.15.47:0/3148414507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae00fc3e0 con 0x7f7ae01000c0 2024-02-07T12:22:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.425+0000 7f7ad6ffd700 1 -- 172.21.15.47:0/3148414507 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7adc01c630 con 0x7f7ae01000c0 2024-02-07T12:22:49.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.425+0000 7f7ae838a700 1 -- 172.21.15.47:0/3148414507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae0115970 con 0x7f7ae01000c0 2024-02-07T12:22:49.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.426+0000 7f7ae838a700 1 -- 172.21.15.47:0/3148414507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae004bed0 con 0x7f7ae01000c0 2024-02-07T12:22:49.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.426+0000 7f7ad6ffd700 1 -- 172.21.15.47:0/3148414507 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7adc013980 con 0x7f7ae01000c0 2024-02-07T12:22:49.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.427+0000 7f7ad6ffd700 1 --2- 172.21.15.47:0/3148414507 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7acc068f60 0x7f7acc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:49.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.427+0000 7f7ad6ffd700 1 -- 172.21.15.47:0/3148414507 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7adc087e10 con 0x7f7ae01000c0 2024-02-07T12:22:49.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.427+0000 7f7ae6126700 1 --2- 172.21.15.47:0/3148414507 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7acc068f60 0x7f7acc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:49.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.427+0000 7f7ae6126700 1 --2- 172.21.15.47:0/3148414507 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7acc068f60 0x7f7acc06b410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0007fd0 tx=0x7f7ad0009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:49.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.431+0000 7f7ad6ffd700 1 -- 172.21.15.47:0/3148414507 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7adc0580b0 con 0x7f7ae01000c0 2024-02-07T12:22:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.632+0000 7f7ae838a700 1 -- 172.21.15.47:0/3148414507 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ae0100d60 con 0x7f7acc068f60 2024-02-07T12:22:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.634+0000 7f7ad6ffd700 1 -- 172.21.15.47:0/3148414507 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f7ae0100d60 con 0x7f7acc068f60 2024-02-07T12:22:49.636 INFO:teuthology.orchestra.run.smithi047.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-07T12:22:49.636 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130022480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-02-07T12:22:49.636 INFO:teuthology.orchestra.run.smithi047.stdout:smithi138 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6161003C400BGN 372G No 74s ago Has a FileSystem, LVM detected 2024-02-07T12:22:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.636+0000 7f7ae838a700 1 -- 172.21.15.47:0/3148414507 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7acc068f60 msgr2=0x7f7acc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.636+0000 7f7ae838a700 1 --2- 172.21.15.47:0/3148414507 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7acc068f60 0x7f7acc06b410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0007fd0 tx=0x7f7ad0009040 comp rx=0 tx=0).stop 2024-02-07T12:22:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.636+0000 7f7ae838a700 1 -- 172.21.15.47:0/3148414507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ae01000c0 msgr2=0x7f7ae00fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.636+0000 7f7ae838a700 1 --2- 172.21.15.47:0/3148414507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ae01000c0 0x7f7ae00fb9f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7adc000c00 tx=0x7f7adc009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.636+0000 7f7ae838a700 1 -- 172.21.15.47:0/3148414507 shutdown_connections 2024-02-07T12:22:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.636+0000 7f7ae838a700 1 --2- 172.21.15.47:0/3148414507 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7acc068f60 0x7f7acc06b410 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.636+0000 7f7ae838a700 1 --2- 172.21.15.47:0/3148414507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ae0066c70 0x7f7ae00fd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.636+0000 7f7ae838a700 1 --2- 172.21.15.47:0/3148414507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ae01000c0 0x7f7ae00fb9f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.636+0000 7f7ae838a700 1 -- 172.21.15.47:0/3148414507 >> 172.21.15.47:0/3148414507 conn(0x7f7ae00f7520 msgr2=0x7f7ae00f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.636+0000 7f7ae838a700 1 -- 172.21.15.47:0/3148414507 shutdown_connections 2024-02-07T12:22:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:49.636+0000 7f7ae838a700 1 -- 172.21.15.47:0/3148414507 wait complete. 2024-02-07T12:22:50.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:49 smithi138 ceph-mon[35528]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:50.297 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:49 smithi047 ceph-mon[28972]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:50.327 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-07T12:22:50.337 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:22:50.337 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-07T12:22:50.600 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:51.050 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:50 smithi047 ceph-mon[28972]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:22:51.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:50 smithi138 ceph-mon[35528]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:22:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.176+0000 7fa25059b700 1 -- 172.21.15.47:0/162601787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2480fe0e0 msgr2=0x7fa2480fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.176+0000 7fa25059b700 1 --2- 172.21.15.47:0/162601787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2480fe0e0 0x7fa2480fe550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa23c004940 tx=0x7fa23c009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.176+0000 7fa25059b700 1 -- 172.21.15.47:0/162601787 shutdown_connections 2024-02-07T12:22:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.176+0000 7fa25059b700 1 --2- 172.21.15.47:0/162601787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2480fe0e0 0x7fa2480fe550 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.176+0000 7fa25059b700 1 --2- 172.21.15.47:0/162601787 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2480fcef0 0x7fa2480fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.176+0000 7fa25059b700 1 -- 172.21.15.47:0/162601787 >> 172.21.15.47:0/162601787 conn(0x7fa2480f8620 msgr2=0x7fa2480faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.176+0000 7fa25059b700 1 -- 172.21.15.47:0/162601787 shutdown_connections 2024-02-07T12:22:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.176+0000 7fa25059b700 1 -- 172.21.15.47:0/162601787 wait complete. 2024-02-07T12:22:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.176+0000 7fa25059b700 1 Processor -- start 2024-02-07T12:22:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.176+0000 7fa25059b700 1 -- start start 2024-02-07T12:22:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa25059b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2480fcef0 0x7fa248071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa25059b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2480fe0e0 0x7fa2480702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa25059b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480708e0 con 0x7fa2480fe0e0 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa25059b700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa248070a50 con 0x7fa2480fcef0 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa24db36700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2480fe0e0 0x7fa2480702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa24db36700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2480fe0e0 0x7fa2480702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36242/0 (socket says 172.21.15.47:36242) 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa24db36700 1 -- 172.21.15.47:0/3935809196 learned_addr learned my addr 172.21.15.47:0/3935809196 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa24e337700 1 --2- 172.21.15.47:0/3935809196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2480fcef0 0x7fa248071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa24db36700 1 -- 172.21.15.47:0/3935809196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2480fcef0 msgr2=0x7fa248071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa24db36700 1 --2- 172.21.15.47:0/3935809196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2480fcef0 0x7fa248071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa24db36700 1 -- 172.21.15.47:0/3935809196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c005040 con 0x7fa2480fe0e0 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa24e337700 1 --2- 172.21.15.47:0/3935809196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2480fcef0 0x7fa248071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa24db36700 1 --2- 172.21.15.47:0/3935809196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2480fe0e0 0x7fa2480702e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0093b0 tx=0x7fa23c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa246ffd700 1 -- 172.21.15.47:0/3935809196 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa23c00e040 con 0x7fa2480fe0e0 2024-02-07T12:22:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa25059b700 1 -- 172.21.15.47:0/3935809196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa248070cd0 con 0x7fa2480fe0e0 2024-02-07T12:22:52.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa246ffd700 1 -- 172.21.15.47:0/3935809196 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa23c00bcc0 con 0x7fa2480fe0e0 2024-02-07T12:22:52.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa246ffd700 1 -- 172.21.15.47:0/3935809196 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa23c01c630 con 0x7fa2480fe0e0 2024-02-07T12:22:52.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.177+0000 7fa25059b700 1 -- 172.21.15.47:0/3935809196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa248115990 con 0x7fa2480fe0e0 2024-02-07T12:22:52.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.178+0000 7fa25059b700 1 -- 172.21.15.47:0/3935809196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24804bed0 con 0x7fa2480fe0e0 2024-02-07T12:22:52.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.179+0000 7fa246ffd700 1 -- 172.21.15.47:0/3935809196 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa23c0139f0 con 0x7fa2480fe0e0 2024-02-07T12:22:52.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.179+0000 7fa246ffd700 1 --2- 172.21.15.47:0/3935809196 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa230068f60 0x7fa23006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:52.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.179+0000 7fa246ffd700 1 -- 172.21.15.47:0/3935809196 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa23c087e80 con 0x7fa2480fe0e0 2024-02-07T12:22:52.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.179+0000 7fa24e337700 1 --2- 172.21.15.47:0/3935809196 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa230068f60 0x7fa23006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:52.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.179+0000 7fa24e337700 1 --2- 172.21.15.47:0/3935809196 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa230068f60 0x7fa23006b410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa248071bf0 tx=0x7fa24000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:52.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.184+0000 7fa246ffd700 1 -- 172.21.15.47:0/3935809196 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa23c058120 con 0x7fa2480fe0e0 2024-02-07T12:22:52.186 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:51 smithi047 ceph-mon[28972]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:52.186 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:51 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:22:52.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:51 smithi138 ceph-mon[35528]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:52.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:51 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:22:52.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:52.402+0000 7fa25059b700 1 -- 172.21.15.47:0/3935809196 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa248102ac0 con 0x7fa230068f60 2024-02-07T12:22:53.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:52 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-07T12:22:53.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:52 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-07T12:22:54.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:54.022+0000 7fa246ffd700 1 -- 172.21.15.47:0/3935809196 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa248102ac0 con 0x7fa230068f60 2024-02-07T12:22:54.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:54.024+0000 7fa25059b700 1 -- 172.21.15.47:0/3935809196 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa230068f60 msgr2=0x7fa23006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:54.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:54.024+0000 7fa25059b700 1 --2- 172.21.15.47:0/3935809196 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa230068f60 0x7fa23006b410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa248071bf0 tx=0x7fa24000b040 comp rx=0 tx=0).stop 2024-02-07T12:22:54.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:54.024+0000 7fa25059b700 1 -- 172.21.15.47:0/3935809196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2480fe0e0 msgr2=0x7fa2480702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:54.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:54.024+0000 7fa25059b700 1 --2- 172.21.15.47:0/3935809196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2480fe0e0 0x7fa2480702e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0093b0 tx=0x7fa23c009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:54.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:54.024+0000 7fa25059b700 1 -- 172.21.15.47:0/3935809196 shutdown_connections 2024-02-07T12:22:54.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:54.024+0000 7fa25059b700 1 --2- 172.21.15.47:0/3935809196 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa230068f60 0x7fa23006b410 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:54.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:54.024+0000 7fa25059b700 1 --2- 172.21.15.47:0/3935809196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2480fcef0 0x7fa248071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:54.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:54.024+0000 7fa25059b700 1 --2- 172.21.15.47:0/3935809196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2480fe0e0 0x7fa2480702e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:54.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:54.024+0000 7fa25059b700 1 -- 172.21.15.47:0/3935809196 >> 172.21.15.47:0/3935809196 conn(0x7fa2480f8620 msgr2=0x7fa2481013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:54.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:54.024+0000 7fa25059b700 1 -- 172.21.15.47:0/3935809196 shutdown_connections 2024-02-07T12:22:54.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:54.024+0000 7fa25059b700 1 -- 172.21.15.47:0/3935809196 wait complete. 2024-02-07T12:22:54.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:53 smithi138 ceph-mon[35528]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:22:54.332 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:53 smithi138 ceph-mon[35528]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:54.332 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:53 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-07T12:22:54.332 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:53 smithi138 ceph-mon[35528]: osdmap e42: 6 total, 6 up, 6 in 2024-02-07T12:22:54.332 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:53 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-07T12:22:54.333 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:53 smithi047 ceph-mon[28972]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:22:54.333 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:53 smithi047 ceph-mon[28972]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:54.333 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:53 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-07T12:22:54.333 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:53 smithi047 ceph-mon[28972]: osdmap e42: 6 total, 6 up, 6 in 2024-02-07T12:22:54.333 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:53 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-07T12:22:54.334 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047[28968]: 2024-02-07T12:22:54.001+0000 7f406b4f8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-07T12:22:54.667 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-07T12:22:55.222 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-07T12:22:55.222 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: osdmap e43: 6 total, 6 up, 6 in 2024-02-07T12:22:55.222 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-07T12:22:55.222 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-07T12:22:55.222 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-07T12:22:55.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: osdmap e44: 6 total, 6 up, 6 in 2024-02-07T12:22:55.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-07T12:22:55.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: fsmap cephfs:0 2024-02-07T12:22:55.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: Saving service mds.cephfs spec with placement count:4 2024-02-07T12:22:55.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:55.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:22:55.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:22:55.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:22:55.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:55.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.lagmef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:22:55.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.lagmef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-07T12:22:55.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:22:55.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:54 smithi047 ceph-mon[28972]: Deploying daemon mds.cephfs.smithi047.lagmef on smithi047 2024-02-07T12:22:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-07T12:22:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: osdmap e43: 6 total, 6 up, 6 in 2024-02-07T12:22:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-07T12:22:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-07T12:22:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-07T12:22:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: osdmap e44: 6 total, 6 up, 6 in 2024-02-07T12:22:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-07T12:22:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: fsmap cephfs:0 2024-02-07T12:22:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: Saving service mds.cephfs spec with placement count:4 2024-02-07T12:22:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:55.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:22:55.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:22:55.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:22:55.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:55.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.lagmef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:22:55.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.lagmef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-07T12:22:55.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:22:55.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:54 smithi138 ceph-mon[35528]: Deploying daemon mds.cephfs.smithi047.lagmef on smithi047 2024-02-07T12:22:56.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:56 smithi138 ceph-mon[35528]: pgmap v176: 65 pgs: 14 creating+peering, 3 creating+activating, 30 unknown, 18 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:56.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:56 smithi138 ceph-mon[35528]: osdmap e45: 6 total, 6 up, 6 in 2024-02-07T12:22:56.082 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:56.208 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:56 smithi047 ceph-mon[28972]: pgmap v176: 65 pgs: 14 creating+peering, 3 creating+activating, 30 unknown, 18 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:56.208 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:56 smithi047 ceph-mon[28972]: osdmap e45: 6 total, 6 up, 6 in 2024-02-07T12:22:57.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:57 smithi138 ceph-mon[35528]: osdmap e46: 6 total, 6 up, 6 in 2024-02-07T12:22:57.292 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:57 smithi047 ceph-mon[28972]: osdmap e46: 6 total, 6 up, 6 in 2024-02-07T12:22:58.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.094+0000 7eff88612700 1 -- 172.21.15.47:0/807577119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff800fb220 msgr2=0x7eff800fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:58.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.094+0000 7eff88612700 1 --2- 172.21.15.47:0/807577119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff800fb220 0x7eff800fb630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7eff7c004940 tx=0x7eff7c009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:58.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.094+0000 7eff88612700 1 -- 172.21.15.47:0/807577119 shutdown_connections 2024-02-07T12:22:58.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.094+0000 7eff88612700 1 --2- 172.21.15.47:0/807577119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff800fe2b0 0x7eff800fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:58.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.094+0000 7eff88612700 1 --2- 172.21.15.47:0/807577119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff800fb220 0x7eff800fb630 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:58.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.094+0000 7eff88612700 1 -- 172.21.15.47:0/807577119 >> 172.21.15.47:0/807577119 conn(0x7eff800f6ca0 msgr2=0x7eff800f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:58.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.094+0000 7eff88612700 1 -- 172.21.15.47:0/807577119 shutdown_connections 2024-02-07T12:22:58.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.094+0000 7eff88612700 1 -- 172.21.15.47:0/807577119 wait complete. 2024-02-07T12:22:58.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff88612700 1 Processor -- start 2024-02-07T12:22:58.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff88612700 1 -- start start 2024-02-07T12:22:58.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff88612700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff800fb220 0x7eff8010da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:58.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff88612700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff800fe2b0 0x7eff8010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:58.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff88612700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8010e5c0 con 0x7eff800fe2b0 2024-02-07T12:22:58.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff88612700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8010ee60 con 0x7eff800fb220 2024-02-07T12:22:58.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff85bad700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff800fe2b0 0x7eff8010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:58.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff85bad700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff800fe2b0 0x7eff8010dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36278/0 (socket says 172.21.15.47:36278) 2024-02-07T12:22:58.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff85bad700 1 -- 172.21.15.47:0/3528913652 learned_addr learned my addr 172.21.15.47:0/3528913652 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:22:58.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff863ae700 1 --2- 172.21.15.47:0/3528913652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff800fb220 0x7eff8010da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:58.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff85bad700 1 -- 172.21.15.47:0/3528913652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff800fb220 msgr2=0x7eff8010da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:58.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff85bad700 1 --2- 172.21.15.47:0/3528913652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff800fb220 0x7eff8010da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:58.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff85bad700 1 -- 172.21.15.47:0/3528913652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c005040 con 0x7eff800fe2b0 2024-02-07T12:22:58.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.095+0000 7eff85bad700 1 --2- 172.21.15.47:0/3528913652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff800fe2b0 0x7eff8010dfc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7eff7000c830 tx=0x7eff70004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:58.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.096+0000 7eff76ffd700 1 -- 172.21.15.47:0/3528913652 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff700106f0 con 0x7eff800fe2b0 2024-02-07T12:22:58.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.096+0000 7eff76ffd700 1 -- 172.21.15.47:0/3528913652 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff70010d20 con 0x7eff800fe2b0 2024-02-07T12:22:58.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.096+0000 7eff88612700 1 -- 172.21.15.47:0/3528913652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8010f140 con 0x7eff800fe2b0 2024-02-07T12:22:58.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.096+0000 7eff76ffd700 1 -- 172.21.15.47:0/3528913652 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff700113a0 con 0x7eff800fe2b0 2024-02-07T12:22:58.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.096+0000 7eff88612700 1 -- 172.21.15.47:0/3528913652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8010f680 con 0x7eff800fe2b0 2024-02-07T12:22:58.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.097+0000 7eff88612700 1 -- 172.21.15.47:0/3528913652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff80107a80 con 0x7eff800fe2b0 2024-02-07T12:22:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.097+0000 7eff76ffd700 1 -- 172.21.15.47:0/3528913652 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7eff70012400 con 0x7eff800fe2b0 2024-02-07T12:22:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.098+0000 7eff76ffd700 1 --2- 172.21.15.47:0/3528913652 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7eff6c068f60 0x7eff6c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:22:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.098+0000 7eff863ae700 1 --2- 172.21.15.47:0/3528913652 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7eff6c068f60 0x7eff6c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:22:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.098+0000 7eff76ffd700 1 -- 172.21.15.47:0/3528913652 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7eff70086ca0 con 0x7eff800fe2b0 2024-02-07T12:22:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.098+0000 7eff863ae700 1 --2- 172.21.15.47:0/3528913652 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7eff6c068f60 0x7eff6c06b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00b3b0 tx=0x7eff7c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:22:58.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.103+0000 7eff76ffd700 1 -- 172.21.15.47:0/3528913652 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7eff7008b070 con 0x7eff800fe2b0 2024-02-07T12:22:58.198 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:58 smithi047 ceph-mon[28972]: pgmap v179: 65 pgs: 18 creating+peering, 3 creating+activating, 9 unknown, 35 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:58.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:58 smithi138 ceph-mon[35528]: pgmap v179: 65 pgs: 18 creating+peering, 3 creating+activating, 9 unknown, 35 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:22:58.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.348+0000 7eff88612700 1 -- 172.21.15.47:0/3528913652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7eff8010f950 con 0x7eff800fe2b0 2024-02-07T12:22:58.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.349+0000 7eff76ffd700 1 -- 172.21.15.47:0/3528913652 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 4 v4) v1 ==== 75+0+1247 (secure 0 0 0) 0x7eff7005ae60 con 0x7eff800fe2b0 2024-02-07T12:22:58.351 INFO:teuthology.orchestra.run.smithi047.stdout:e4 2024-02-07T12:22:58.351 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:22:58.351 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:22:58.351 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:22:58.351 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:22:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:22:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:22:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 4 2024-02-07T12:22:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-07T12:22:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:22:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:22:58.018342+0000 2024-02-07T12:22:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:22:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:22:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:22:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:22:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:22:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:22:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 0 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 1 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:in 0 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460} 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 0 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:creating seq 1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:22:58.353 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:22:58.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.351+0000 7eff88612700 1 -- 172.21.15.47:0/3528913652 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7eff6c068f60 msgr2=0x7eff6c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:58.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.351+0000 7eff88612700 1 --2- 172.21.15.47:0/3528913652 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7eff6c068f60 0x7eff6c06b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00b3b0 tx=0x7eff7c009e30 comp rx=0 tx=0).stop 2024-02-07T12:22:58.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.351+0000 7eff88612700 1 -- 172.21.15.47:0/3528913652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff800fe2b0 msgr2=0x7eff8010dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:22:58.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.351+0000 7eff88612700 1 --2- 172.21.15.47:0/3528913652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff800fe2b0 0x7eff8010dfc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7eff7000c830 tx=0x7eff70004470 comp rx=0 tx=0).stop 2024-02-07T12:22:58.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.351+0000 7eff88612700 1 -- 172.21.15.47:0/3528913652 shutdown_connections 2024-02-07T12:22:58.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.351+0000 7eff88612700 1 --2- 172.21.15.47:0/3528913652 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7eff6c068f60 0x7eff6c06b410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:58.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.351+0000 7eff88612700 1 --2- 172.21.15.47:0/3528913652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff800fb220 0x7eff8010da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:58.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.351+0000 7eff88612700 1 --2- 172.21.15.47:0/3528913652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff800fe2b0 0x7eff8010dfc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:22:58.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.351+0000 7eff88612700 1 -- 172.21.15.47:0/3528913652 >> 172.21.15.47:0/3528913652 conn(0x7eff800f6ca0 msgr2=0x7eff800f8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:22:58.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.351+0000 7eff88612700 1 -- 172.21.15.47:0/3528913652 shutdown_connections 2024-02-07T12:22:58.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:22:58.351+0000 7eff88612700 1 -- 172.21.15.47:0/3528913652 wait complete. 2024-02-07T12:22:58.355 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 4 2024-02-07T12:22:59.046 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-07T12:22:59.056 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:22:59.056 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-02-07T12:22:59.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] up:boot 2024-02-07T12:22:59.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: daemon mds.cephfs.smithi047.lagmef assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-07T12:22:59.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-07T12:22:59.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-07T12:22:59.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: Cluster is now healthy 2024-02-07T12:22:59.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: fsmap cephfs:0 1 up:standby 2024-02-07T12:22:59.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:22:59.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:creating} 2024-02-07T12:22:59.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: daemon mds.cephfs.smithi047.lagmef is now active in filesystem cephfs as rank 0 2024-02-07T12:22:59.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:59.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:59.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:59.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.jhsygn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:22:59.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.jhsygn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-07T12:22:59.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:22:59.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: Deploying daemon mds.cephfs.smithi138.jhsygn on smithi138 2024-02-07T12:22:59.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:22:59 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3528913652' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:22:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:22:59.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] up:boot 2024-02-07T12:22:59.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: daemon mds.cephfs.smithi047.lagmef assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-07T12:22:59.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-07T12:22:59.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-07T12:22:59.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: Cluster is now healthy 2024-02-07T12:22:59.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: fsmap cephfs:0 1 up:standby 2024-02-07T12:22:59.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:22:59.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:creating} 2024-02-07T12:22:59.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: daemon mds.cephfs.smithi047.lagmef is now active in filesystem cephfs as rank 0 2024-02-07T12:22:59.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:59.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:59.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:22:59.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.jhsygn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:22:59.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.jhsygn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-07T12:22:59.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:22:59.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: Deploying daemon mds.cephfs.smithi138.jhsygn on smithi138 2024-02-07T12:22:59.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:22:59 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3528913652' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:23:00.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:00 smithi138 ceph-mon[35528]: pgmap v180: 65 pgs: 18 creating+peering, 3 creating+activating, 44 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:23:00.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:00 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] up:active 2024-02-07T12:23:00.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:00 smithi138 ceph-mon[35528]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 2024-02-07T12:23:00.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:00 smithi047 ceph-mon[28972]: pgmap v180: 65 pgs: 18 creating+peering, 3 creating+activating, 44 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-07T12:23:00.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:00 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] up:active 2024-02-07T12:23:00.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:00 smithi047 ceph-mon[28972]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 2024-02-07T12:23:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.918+0000 7fcaa280d700 1 -- 172.21.15.47:0/3848444805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c0fda90 msgr2=0x7fca9c0ffe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.918+0000 7fcaa280d700 1 --2- 172.21.15.47:0/3848444805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c0fda90 0x7fca9c0ffe70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fca8c004940 tx=0x7fca8c009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.918+0000 7fcaa280d700 1 -- 172.21.15.47:0/3848444805 shutdown_connections 2024-02-07T12:23:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.918+0000 7fcaa280d700 1 --2- 172.21.15.47:0/3848444805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca9c1003b0 0x7fca9c102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.918+0000 7fcaa280d700 1 --2- 172.21.15.47:0/3848444805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c0fda90 0x7fca9c0ffe70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.918+0000 7fcaa280d700 1 -- 172.21.15.47:0/3848444805 >> 172.21.15.47:0/3848444805 conn(0x7fca9c0f7510 msgr2=0x7fca9c0f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.918+0000 7fcaa280d700 1 -- 172.21.15.47:0/3848444805 shutdown_connections 2024-02-07T12:23:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.918+0000 7fcaa280d700 1 -- 172.21.15.47:0/3848444805 wait complete. 2024-02-07T12:23:00.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.919+0000 7fcaa280d700 1 Processor -- start 2024-02-07T12:23:00.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.919+0000 7fcaa280d700 1 -- start start 2024-02-07T12:23:00.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.919+0000 7fcaa280d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca9c0fda90 0x7fca9c0fd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:00.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.919+0000 7fcaa280d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c1003b0 0x7fca9c0fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:00.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.919+0000 7fcaa280d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0fbfa0 con 0x7fca9c1003b0 2024-02-07T12:23:00.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.919+0000 7fcaa280d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0fc110 con 0x7fca9c0fda90 2024-02-07T12:23:00.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.919+0000 7fca9b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c1003b0 0x7fca9c0fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:00.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.919+0000 7fca9b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c1003b0 0x7fca9c0fb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34374/0 (socket says 172.21.15.47:34374) 2024-02-07T12:23:00.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.919+0000 7fca9b7fe700 1 -- 172.21.15.47:0/3360835222 learned_addr learned my addr 172.21.15.47:0/3360835222 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:00.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.919+0000 7fca9bfff700 1 --2- 172.21.15.47:0/3360835222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca9c0fda90 0x7fca9c0fd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:00.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.919+0000 7fca9b7fe700 1 -- 172.21.15.47:0/3360835222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca9c0fda90 msgr2=0x7fca9c0fd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:00.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.919+0000 7fca9b7fe700 1 --2- 172.21.15.47:0/3360835222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca9c0fda90 0x7fca9c0fd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:00.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.919+0000 7fca9b7fe700 1 -- 172.21.15.47:0/3360835222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c005040 con 0x7fca9c1003b0 2024-02-07T12:23:00.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.920+0000 7fca9b7fe700 1 --2- 172.21.15.47:0/3360835222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c1003b0 0x7fca9c0fb9a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fca8400eb40 tx=0x7fca8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:00.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.920+0000 7fca98ff9700 1 -- 172.21.15.47:0/3360835222 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca84007cc0 con 0x7fca9c1003b0 2024-02-07T12:23:00.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.920+0000 7fcaa280d700 1 -- 172.21.15.47:0/3360835222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c0fc390 con 0x7fca9c1003b0 2024-02-07T12:23:00.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.920+0000 7fca98ff9700 1 -- 172.21.15.47:0/3360835222 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca8400f040 con 0x7fca9c1003b0 2024-02-07T12:23:00.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.920+0000 7fca98ff9700 1 -- 172.21.15.47:0/3360835222 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca84009620 con 0x7fca9c1003b0 2024-02-07T12:23:00.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.920+0000 7fcaa280d700 1 -- 172.21.15.47:0/3360835222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c1158d0 con 0x7fca9c1003b0 2024-02-07T12:23:00.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.921+0000 7fcaa280d700 1 -- 172.21.15.47:0/3360835222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c107a60 con 0x7fca9c1003b0 2024-02-07T12:23:00.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.922+0000 7fca98ff9700 1 -- 172.21.15.47:0/3360835222 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fca84009780 con 0x7fca9c1003b0 2024-02-07T12:23:00.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.922+0000 7fca98ff9700 1 --2- 172.21.15.47:0/3360835222 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fca88068f60 0x7fca8806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:00.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.922+0000 7fca98ff9700 1 -- 172.21.15.47:0/3360835222 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fca840869e0 con 0x7fca9c1003b0 2024-02-07T12:23:00.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.922+0000 7fca9bfff700 1 --2- 172.21.15.47:0/3360835222 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fca88068f60 0x7fca8806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:00.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.923+0000 7fca9bfff700 1 --2- 172.21.15.47:0/3360835222 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fca88068f60 0x7fca8806b410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca8c000c00 tx=0x7fca8c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:00.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:00.931+0000 7fca98ff9700 1 -- 172.21.15.47:0/3360835222 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fca8404da00 con 0x7fca9c1003b0 2024-02-07T12:23:01.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:01.171+0000 7fcaa280d700 1 -- 172.21.15.47:0/3360835222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fca9c105a20 con 0x7fca9c1003b0 2024-02-07T12:23:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:01.312+0000 7fca98ff9700 1 -- 172.21.15.47:0/3360835222 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fca84056970 con 0x7fca9c1003b0 2024-02-07T12:23:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:01.314+0000 7fcaa280d700 1 -- 172.21.15.47:0/3360835222 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fca88068f60 msgr2=0x7fca8806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:01.314+0000 7fcaa280d700 1 --2- 172.21.15.47:0/3360835222 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fca88068f60 0x7fca8806b410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca8c000c00 tx=0x7fca8c009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:01.314+0000 7fcaa280d700 1 -- 172.21.15.47:0/3360835222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c1003b0 msgr2=0x7fca9c0fb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:01.314+0000 7fcaa280d700 1 --2- 172.21.15.47:0/3360835222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c1003b0 0x7fca9c0fb9a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fca8400eb40 tx=0x7fca8400b040 comp rx=0 tx=0).stop 2024-02-07T12:23:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:01.314+0000 7fcaa280d700 1 -- 172.21.15.47:0/3360835222 shutdown_connections 2024-02-07T12:23:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:01.314+0000 7fcaa280d700 1 --2- 172.21.15.47:0/3360835222 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fca88068f60 0x7fca8806b410 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:01.314+0000 7fcaa280d700 1 --2- 172.21.15.47:0/3360835222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca9c0fda90 0x7fca9c0fd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:01.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:01.315+0000 7fcaa280d700 1 --2- 172.21.15.47:0/3360835222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c1003b0 0x7fca9c0fb9a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:01.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:01.315+0000 7fcaa280d700 1 -- 172.21.15.47:0/3360835222 >> 172.21.15.47:0/3360835222 conn(0x7fca9c0f7510 msgr2=0x7fca9c0f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:01.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:01.315+0000 7fcaa280d700 1 -- 172.21.15.47:0/3360835222 shutdown_connections 2024-02-07T12:23:01.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:01.315+0000 7fcaa280d700 1 -- 172.21.15.47:0/3360835222 wait complete. 2024-02-07T12:23:01.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:01.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:01.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:01.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.jsgfge", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:23:01.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.jsgfge", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: Deploying daemon mds.cephfs.smithi047.jsgfge on smithi047 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: pgmap v181: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 593 B/s wr, 4 op/s 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3360835222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.138:6824/2917636817,v1:172.21.15.138:6825/2917636817] up:boot 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3360835222' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: daemon mds.cephfs.smithi138.jhsygn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 1 up:standby 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi138.jhsygn=up:creating} 2024-02-07T12:23:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:01 smithi047 ceph-mon[28972]: daemon mds.cephfs.smithi138.jhsygn is now active in filesystem cephfs as rank 1 2024-02-07T12:23:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.jsgfge", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:23:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.jsgfge", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-07T12:23:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:23:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: Deploying daemon mds.cephfs.smithi047.jsgfge on smithi047 2024-02-07T12:23:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: pgmap v181: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 593 B/s wr, 4 op/s 2024-02-07T12:23:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3360835222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-07T12:23:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-07T12:23:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.138:6824/2917636817,v1:172.21.15.138:6825/2917636817] up:boot 2024-02-07T12:23:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3360835222' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-07T12:23:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: daemon mds.cephfs.smithi138.jhsygn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-07T12:23:02.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-07T12:23:02.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-07T12:23:02.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 1 up:standby 2024-02-07T12:23:02.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:23:02.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi138.jhsygn=up:creating} 2024-02-07T12:23:02.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:01 smithi138 ceph-mon[35528]: daemon mds.cephfs.smithi138.jhsygn is now active in filesystem cephfs as rank 1 2024-02-07T12:23:02.980 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-07T12:23:02.990 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:23:02.990 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-02-07T12:23:03.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:03 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.138:6824/2917636817,v1:172.21.15.138:6825/2917636817] up:active 2024-02-07T12:23:03.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:03 smithi047 ceph-mon[28972]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi138.jhsygn=up:active} 2024-02-07T12:23:03.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:03 smithi047 ceph-mon[28972]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-02-07T12:23:03.638 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:23:03.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:03 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.138:6824/2917636817,v1:172.21.15.138:6825/2917636817] up:active 2024-02-07T12:23:03.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:03 smithi138 ceph-mon[35528]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi138.jhsygn=up:active} 2024-02-07T12:23:03.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:03 smithi138 ceph-mon[35528]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-02-07T12:23:04.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:04 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:04.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:04 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:04.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:04 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:04.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:04 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.axpdsx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:23:04.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:04 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.axpdsx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-07T12:23:04.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:04 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:23:04.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:04 smithi047 ceph-mon[28972]: Deploying daemon mds.cephfs.smithi138.axpdsx on smithi138 2024-02-07T12:23:04.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:04 smithi047 ceph-mon[28972]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-07T12:23:04.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:04 smithi047 ceph-mon[28972]: Cluster is now healthy 2024-02-07T12:23:04.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:04 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] up:boot 2024-02-07T12:23:04.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:04 smithi047 ceph-mon[28972]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi138.jhsygn=up:active} 1 up:standby 2024-02-07T12:23:04.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:04 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:23:05.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:04 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:05.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:04 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:05.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:04 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:05.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:04 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.axpdsx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:23:05.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:04 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.axpdsx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-07T12:23:05.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:04 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:23:05.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:04 smithi138 ceph-mon[35528]: Deploying daemon mds.cephfs.smithi138.axpdsx on smithi138 2024-02-07T12:23:05.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:04 smithi138 ceph-mon[35528]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-07T12:23:05.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:04 smithi138 ceph-mon[35528]: Cluster is now healthy 2024-02-07T12:23:05.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:04 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] up:boot 2024-02-07T12:23:05.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:04 smithi138 ceph-mon[35528]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi138.jhsygn=up:active} 1 up:standby 2024-02-07T12:23:05.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:04 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:23:05.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.251+0000 7f84ced06700 1 -- 172.21.15.47:0/4195526298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c80fde10 msgr2=0x7f84c80faff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:05.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.251+0000 7f84ced06700 1 --2- 172.21.15.47:0/4195526298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c80fde10 0x7f84c80faff0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f84b4004940 tx=0x7f84b4009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:05.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.251+0000 7f84ced06700 1 -- 172.21.15.47:0/4195526298 shutdown_connections 2024-02-07T12:23:05.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.251+0000 7f84ced06700 1 --2- 172.21.15.47:0/4195526298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c80fde10 0x7f84c80faff0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:05.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.251+0000 7f84ced06700 1 --2- 172.21.15.47:0/4195526298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c80fd430 0x7f84c80fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:05.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.251+0000 7f84ced06700 1 -- 172.21.15.47:0/4195526298 >> 172.21.15.47:0/4195526298 conn(0x7f84c80f6ca0 msgr2=0x7f84c80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:05.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.251+0000 7f84ced06700 1 -- 172.21.15.47:0/4195526298 shutdown_connections 2024-02-07T12:23:05.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.251+0000 7f84ced06700 1 -- 172.21.15.47:0/4195526298 wait complete. 2024-02-07T12:23:05.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.251+0000 7f84ced06700 1 Processor -- start 2024-02-07T12:23:05.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.251+0000 7f84ced06700 1 -- start start 2024-02-07T12:23:05.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84ced06700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c80fd430 0x7f84c810fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:05.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84ced06700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c8110220 0x7f84c8110f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:05.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84ced06700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c81106e0 con 0x7f84c8110220 2024-02-07T12:23:05.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84ced06700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8110820 con 0x7f84c80fd430 2024-02-07T12:23:05.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84c7fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c8110220 0x7f84c8110f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:05.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84c7fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c8110220 0x7f84c8110f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34408/0 (socket says 172.21.15.47:34408) 2024-02-07T12:23:05.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84c7fff700 1 -- 172.21.15.47:0/3038959561 learned_addr learned my addr 172.21.15.47:0/3038959561 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:05.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84ccaa2700 1 --2- 172.21.15.47:0/3038959561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c80fd430 0x7f84c810fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:05.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84c7fff700 1 -- 172.21.15.47:0/3038959561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c80fd430 msgr2=0x7f84c810fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:05.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84c7fff700 1 --2- 172.21.15.47:0/3038959561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c80fd430 0x7f84c810fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:05.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84c7fff700 1 -- 172.21.15.47:0/3038959561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b4005040 con 0x7f84c8110220 2024-02-07T12:23:05.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84c7fff700 1 --2- 172.21.15.47:0/3038959561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c8110220 0x7f84c8110f80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009150 tx=0x7f84b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:05.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84c57fa700 1 -- 172.21.15.47:0/3038959561 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b400e040 con 0x7f84c8110220 2024-02-07T12:23:05.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84ced06700 1 -- 172.21.15.47:0/3038959561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c8111600 con 0x7f84c8110220 2024-02-07T12:23:05.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84c57fa700 1 -- 172.21.15.47:0/3038959561 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84b400bbf0 con 0x7f84c8110220 2024-02-07T12:23:05.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84c57fa700 1 -- 172.21.15.47:0/3038959561 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b401c3f0 con 0x7f84c8110220 2024-02-07T12:23:05.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.252+0000 7f84ced06700 1 -- 172.21.15.47:0/3038959561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c8111b40 con 0x7f84c8110220 2024-02-07T12:23:05.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.253+0000 7f84ced06700 1 -- 172.21.15.47:0/3038959561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c804bed0 con 0x7f84c8110220 2024-02-07T12:23:05.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.254+0000 7f84c57fa700 1 -- 172.21.15.47:0/3038959561 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f84b400bd60 con 0x7f84c8110220 2024-02-07T12:23:05.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.254+0000 7f84c57fa700 1 --2- 172.21.15.47:0/3038959561 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f84b8068f60 0x7f84b806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:05.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.254+0000 7f84ccaa2700 1 --2- 172.21.15.47:0/3038959561 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f84b8068f60 0x7f84b806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:05.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.254+0000 7f84c57fa700 1 -- 172.21.15.47:0/3038959561 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f84b40881a0 con 0x7f84c8110220 2024-02-07T12:23:05.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.255+0000 7f84ccaa2700 1 --2- 172.21.15.47:0/3038959561 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f84b8068f60 0x7f84b806b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f84bc007fd0 tx=0x7f84bc009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:05.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.259+0000 7f84c57fa700 1 -- 172.21.15.47:0/3038959561 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f84b4058100 con 0x7f84c8110220 2024-02-07T12:23:05.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:05.498+0000 7f84ced06700 1 -- 172.21.15.47:0/3038959561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f84c8111d60 con 0x7f84c8110220 2024-02-07T12:23:05.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:05 smithi138 ceph-mon[35528]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-02-07T12:23:05.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:05 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3038959561' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-07T12:23:05.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:05 smithi047 ceph-mon[28972]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-02-07T12:23:05.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:05 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3038959561' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-07T12:23:06.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:06.313+0000 7f84c57fa700 1 -- 172.21.15.47:0/3038959561 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v10) v1 ==== 121+0+0 (secure 0 0 0) 0x7f84b4057c90 con 0x7f84c8110220 2024-02-07T12:23:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:06.316+0000 7f84ced06700 1 -- 172.21.15.47:0/3038959561 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f84b8068f60 msgr2=0x7f84b806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:06.316+0000 7f84ced06700 1 --2- 172.21.15.47:0/3038959561 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f84b8068f60 0x7f84b806b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f84bc007fd0 tx=0x7f84bc009040 comp rx=0 tx=0).stop 2024-02-07T12:23:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:06.316+0000 7f84ced06700 1 -- 172.21.15.47:0/3038959561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c8110220 msgr2=0x7f84c8110f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:06.316+0000 7f84ced06700 1 --2- 172.21.15.47:0/3038959561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c8110220 0x7f84c8110f80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009150 tx=0x7f84b4009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:06.316+0000 7f84ced06700 1 -- 172.21.15.47:0/3038959561 shutdown_connections 2024-02-07T12:23:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:06.316+0000 7f84ced06700 1 --2- 172.21.15.47:0/3038959561 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f84b8068f60 0x7f84b806b410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:06.316+0000 7f84ced06700 1 --2- 172.21.15.47:0/3038959561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c80fd430 0x7f84c810fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:06.316+0000 7f84ced06700 1 --2- 172.21.15.47:0/3038959561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c8110220 0x7f84c8110f80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:06.316+0000 7f84ced06700 1 -- 172.21.15.47:0/3038959561 >> 172.21.15.47:0/3038959561 conn(0x7f84c80f6ca0 msgr2=0x7f84c81046d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:06.316+0000 7f84ced06700 1 -- 172.21.15.47:0/3038959561 shutdown_connections 2024-02-07T12:23:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:06.316+0000 7f84ced06700 1 -- 172.21.15.47:0/3038959561 wait complete. 2024-02-07T12:23:06.939 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-07T12:23:06.949 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:23:06.950 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2024-02-07T12:23:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:23:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:07 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3038959561' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-07T12:23:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:07 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] up:boot 2024-02-07T12:23:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:07 smithi047 ceph-mon[28972]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi138.jhsygn=up:active} 2 up:standby 2024-02-07T12:23:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:23:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:07 smithi047 ceph-mon[28972]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi138.jhsygn=up:active} 2 up:standby-replay 2024-02-07T12:23:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:23:07.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:07.455 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:07.455 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:07.455 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:07.455 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:07.455 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:07.455 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:23:07.455 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:07 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3038959561' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-07T12:23:07.456 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:07 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] up:boot 2024-02-07T12:23:07.456 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:07 smithi138 ceph-mon[35528]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi138.jhsygn=up:active} 2 up:standby 2024-02-07T12:23:07.456 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:23:07.456 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:07 smithi138 ceph-mon[35528]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi138.jhsygn=up:active} 2 up:standby-replay 2024-02-07T12:23:07.456 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:23:07.456 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:07.869 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:23:08.308 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:08 smithi047 ceph-mon[28972]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s wr, 7 op/s 2024-02-07T12:23:08.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:08 smithi138 ceph-mon[35528]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s wr, 7 op/s 2024-02-07T12:23:09.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:09 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:09.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:09 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:09.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:09 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] up:standby-replay 2024-02-07T12:23:09.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:09 smithi047 ceph-mon[28972]: Dropping low affinity active daemon mds.cephfs.smithi138.jhsygn in favor of higher affinity standby. 2024-02-07T12:23:09.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:09 smithi047 ceph-mon[28972]: Replacing daemon mds.cephfs.smithi138.jhsygn as rank 1 with standby daemon mds.cephfs.smithi047.jsgfge 2024-02-07T12:23:09.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:09 smithi047 ceph-mon[28972]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-07T12:23:09.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:09 smithi047 ceph-mon[28972]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi138.jhsygn=up:active} 2 up:standby-replay 2024-02-07T12:23:09.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:09 smithi047 ceph-mon[28972]: osdmap e47: 6 total, 6 up, 6 in 2024-02-07T12:23:09.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:09 smithi047 ceph-mon[28972]: fsmap cephfs:2/2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:replay} 1 up:standby-replay 2024-02-07T12:23:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:09 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:09 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:09 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] up:standby-replay 2024-02-07T12:23:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:09 smithi138 ceph-mon[35528]: Dropping low affinity active daemon mds.cephfs.smithi138.jhsygn in favor of higher affinity standby. 2024-02-07T12:23:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:09 smithi138 ceph-mon[35528]: Replacing daemon mds.cephfs.smithi138.jhsygn as rank 1 with standby daemon mds.cephfs.smithi047.jsgfge 2024-02-07T12:23:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:09 smithi138 ceph-mon[35528]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-07T12:23:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:09 smithi138 ceph-mon[35528]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi138.jhsygn=up:active} 2 up:standby-replay 2024-02-07T12:23:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:09 smithi138 ceph-mon[35528]: osdmap e47: 6 total, 6 up, 6 in 2024-02-07T12:23:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:09 smithi138 ceph-mon[35528]: fsmap cephfs:2/2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:replay} 1 up:standby-replay 2024-02-07T12:23:10.387 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:10 smithi047 ceph-mon[28972]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 2.4 KiB/s wr, 8 op/s 2024-02-07T12:23:10.387 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:10 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] up:resolve 2024-02-07T12:23:10.387 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:10 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] up:boot 2024-02-07T12:23:10.387 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:10 smithi047 ceph-mon[28972]: fsmap cephfs:2/2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:resolve} 1 up:standby-replay 1 up:standby 2024-02-07T12:23:10.387 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:10 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:23:10.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:10 smithi138 ceph-mon[35528]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 2.4 KiB/s wr, 8 op/s 2024-02-07T12:23:10.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:10 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] up:resolve 2024-02-07T12:23:10.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:10 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] up:boot 2024-02-07T12:23:10.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:10 smithi138 ceph-mon[35528]: fsmap cephfs:2/2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:resolve} 1 up:standby-replay 1 up:standby 2024-02-07T12:23:10.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:10 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:23:10.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.946+0000 7f953c817700 1 -- 172.21.15.47:0/1318146322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95380fcfb0 msgr2=0x7f95380fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.946+0000 7f953c817700 1 --2- 172.21.15.47:0/1318146322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95380fcfb0 0x7f95380fd420 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f95200049c0 tx=0x7f9520009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.946+0000 7f953c817700 1 -- 172.21.15.47:0/1318146322 shutdown_connections 2024-02-07T12:23:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.946+0000 7f953c817700 1 --2- 172.21.15.47:0/1318146322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95380fcfb0 0x7f95380fd420 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.946+0000 7f953c817700 1 --2- 172.21.15.47:0/1318146322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95380fbe40 0x7f95380fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.946+0000 7f953c817700 1 -- 172.21.15.47:0/1318146322 >> 172.21.15.47:0/1318146322 conn(0x7f95380f7520 msgr2=0x7f95380f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.946+0000 7f953c817700 1 -- 172.21.15.47:0/1318146322 shutdown_connections 2024-02-07T12:23:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.946+0000 7f953c817700 1 -- 172.21.15.47:0/1318146322 wait complete. 2024-02-07T12:23:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.947+0000 7f953c817700 1 Processor -- start 2024-02-07T12:23:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.947+0000 7f953c817700 1 -- start start 2024-02-07T12:23:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.947+0000 7f953c817700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95380fbe40 0x7f953810b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.947+0000 7f953c817700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95380fcfb0 0x7f953810bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.947+0000 7f953c817700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953810c1f0 con 0x7f95380fbe40 2024-02-07T12:23:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.947+0000 7f953c817700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953810ca90 con 0x7f95380fcfb0 2024-02-07T12:23:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.947+0000 7f953659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95380fbe40 0x7f953810b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.947+0000 7f953659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95380fbe40 0x7f953810b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46488/0 (socket says 172.21.15.47:46488) 2024-02-07T12:23:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.947+0000 7f953659c700 1 -- 172.21.15.47:0/2245775608 learned_addr learned my addr 172.21.15.47:0/2245775608 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.948+0000 7f9535d9b700 1 --2- 172.21.15.47:0/2245775608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95380fcfb0 0x7f953810bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.948+0000 7f953659c700 1 -- 172.21.15.47:0/2245775608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95380fcfb0 msgr2=0x7f953810bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.948+0000 7f953659c700 1 --2- 172.21.15.47:0/2245775608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95380fcfb0 0x7f953810bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.948+0000 7f953659c700 1 -- 172.21.15.47:0/2245775608 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9520005040 con 0x7f95380fbe40 2024-02-07T12:23:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.948+0000 7f953659c700 1 --2- 172.21.15.47:0/2245775608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95380fbe40 0x7f953810b6b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9530001d80 tx=0x7f9530009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.948+0000 7f952effd700 1 -- 172.21.15.47:0/2245775608 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9530007d10 con 0x7f95380fbe40 2024-02-07T12:23:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.948+0000 7f953c817700 1 -- 172.21.15.47:0/2245775608 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953810cd70 con 0x7f95380fbe40 2024-02-07T12:23:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.948+0000 7f952effd700 1 -- 172.21.15.47:0/2245775608 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9530007e70 con 0x7f95380fbe40 2024-02-07T12:23:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.948+0000 7f952effd700 1 -- 172.21.15.47:0/2245775608 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9530014640 con 0x7f95380fbe40 2024-02-07T12:23:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.948+0000 7f953c817700 1 -- 172.21.15.47:0/2245775608 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953810d2b0 con 0x7f95380fbe40 2024-02-07T12:23:10.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.949+0000 7f953c817700 1 -- 172.21.15.47:0/2245775608 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953804bed0 con 0x7f95380fbe40 2024-02-07T12:23:10.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.949+0000 7f952effd700 1 -- 172.21.15.47:0/2245775608 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f953000e960 con 0x7f95380fbe40 2024-02-07T12:23:10.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.950+0000 7f952effd700 1 --2- 172.21.15.47:0/2245775608 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9524068f60 0x7f952406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:10.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.950+0000 7f952effd700 1 -- 172.21.15.47:0/2245775608 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9530086ae0 con 0x7f95380fbe40 2024-02-07T12:23:10.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.950+0000 7f9535d9b700 1 --2- 172.21.15.47:0/2245775608 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9524068f60 0x7f952406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:10.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.950+0000 7f9535d9b700 1 --2- 172.21.15.47:0/2245775608 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9524068f60 0x7f952406b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9520009fd0 tx=0x7f9520009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:10.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:10.954+0000 7f952effd700 1 -- 172.21.15.47:0/2245775608 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f953004da00 con 0x7f95380fbe40 2024-02-07T12:23:11.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:11.200+0000 7f953c817700 1 -- 172.21.15.47:0/2245775608 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f95381037d0 con 0x7f95380fbe40 2024-02-07T12:23:11.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:11.333+0000 7f952effd700 1 -- 172.21.15.47:0/2245775608 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v16) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9530056aa0 con 0x7f95380fbe40 2024-02-07T12:23:11.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:11.335+0000 7f953c817700 1 -- 172.21.15.47:0/2245775608 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9524068f60 msgr2=0x7f952406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:11.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:11.335+0000 7f953c817700 1 --2- 172.21.15.47:0/2245775608 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9524068f60 0x7f952406b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9520009fd0 tx=0x7f9520009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:11.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:11.335+0000 7f953c817700 1 -- 172.21.15.47:0/2245775608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95380fbe40 msgr2=0x7f953810b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:11.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:11.335+0000 7f953c817700 1 --2- 172.21.15.47:0/2245775608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95380fbe40 0x7f953810b6b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9530001d80 tx=0x7f9530009ec0 comp rx=0 tx=0).stop 2024-02-07T12:23:11.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:11.335+0000 7f953c817700 1 -- 172.21.15.47:0/2245775608 shutdown_connections 2024-02-07T12:23:11.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:11.335+0000 7f953c817700 1 --2- 172.21.15.47:0/2245775608 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9524068f60 0x7f952406b410 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:11.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:11.335+0000 7f953c817700 1 --2- 172.21.15.47:0/2245775608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95380fbe40 0x7f953810b6b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:11.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:11.335+0000 7f953c817700 1 --2- 172.21.15.47:0/2245775608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95380fcfb0 0x7f953810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:11.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:11.335+0000 7f953c817700 1 -- 172.21.15.47:0/2245775608 >> 172.21.15.47:0/2245775608 conn(0x7f95380f7520 msgr2=0x7f9538100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:11.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:11.335+0000 7f953c817700 1 -- 172.21.15.47:0/2245775608 shutdown_connections 2024-02-07T12:23:11.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:11.335+0000 7f953c817700 1 -- 172.21.15.47:0/2245775608 wait complete. 2024-02-07T12:23:11.338 INFO:teuthology.orchestra.run.smithi047.stderr:inline data disabled 2024-02-07T12:23:11.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:11 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] up:reconnect 2024-02-07T12:23:11.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:11 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] up:active 2024-02-07T12:23:11.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:11 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] up:standby-replay 2024-02-07T12:23:11.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:11 smithi047 ceph-mon[28972]: fsmap cephfs:2/2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:reconnect} 1 up:standby-replay 1 up:standby 2024-02-07T12:23:11.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:11 smithi047 ceph-mon[28972]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-02-07T12:23:11.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:11 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2245775608' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-07T12:23:11.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:11 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] up:reconnect 2024-02-07T12:23:11.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:11 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] up:active 2024-02-07T12:23:11.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:11 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] up:standby-replay 2024-02-07T12:23:11.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:11 smithi138 ceph-mon[35528]: fsmap cephfs:2/2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:reconnect} 1 up:standby-replay 1 up:standby 2024-02-07T12:23:11.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:11 smithi138 ceph-mon[35528]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-02-07T12:23:11.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:11 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2245775608' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-07T12:23:12.324 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-07T12:23:12.334 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:23:12.335 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-07T12:23:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:12 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] up:rejoin 2024-02-07T12:23:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:12 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2245775608' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-07T12:23:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:12 smithi047 ceph-mon[28972]: fsmap cephfs:2/2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:rejoin} 1 up:standby-replay 1 up:standby 2024-02-07T12:23:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:12 smithi047 ceph-mon[28972]: daemon mds.cephfs.smithi047.jsgfge is now active in filesystem cephfs as rank 1 2024-02-07T12:23:12.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:12 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] up:rejoin 2024-02-07T12:23:12.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:12 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2245775608' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-07T12:23:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:12 smithi138 ceph-mon[35528]: fsmap cephfs:2/2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:rejoin} 1 up:standby-replay 1 up:standby 2024-02-07T12:23:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:12 smithi138 ceph-mon[35528]: daemon mds.cephfs.smithi047.jsgfge is now active in filesystem cephfs as rank 1 2024-02-07T12:23:13.140 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:23:13.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:13 smithi138 ceph-mon[35528]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-07T12:23:13.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:13 smithi138 ceph-mon[35528]: Cluster is now healthy 2024-02-07T12:23:13.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:13 smithi138 ceph-mon[35528]: mds.? [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] up:active 2024-02-07T12:23:13.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:13 smithi138 ceph-mon[35528]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 1 up:standby-replay 1 up:standby 2024-02-07T12:23:13.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:13 smithi138 ceph-mon[35528]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:23:13.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:13 smithi138 ceph-mon[35528]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-02-07T12:23:13.543 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:13 smithi047 ceph-mon[28972]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-07T12:23:13.543 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:13 smithi047 ceph-mon[28972]: Cluster is now healthy 2024-02-07T12:23:13.543 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:13 smithi047 ceph-mon[28972]: mds.? [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] up:active 2024-02-07T12:23:13.544 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:13 smithi047 ceph-mon[28972]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 1 up:standby-replay 1 up:standby 2024-02-07T12:23:13.544 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:13 smithi047 ceph-mon[28972]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:23:13.544 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:13 smithi047 ceph-mon[28972]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-02-07T12:23:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 -- 172.21.15.47:0/2725574256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82580fb220 msgr2=0x7f82580fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 --2- 172.21.15.47:0/2725574256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82580fb220 0x7f82580fb630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8254004940 tx=0x7f8254009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 -- 172.21.15.47:0/2725574256 shutdown_connections 2024-02-07T12:23:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 --2- 172.21.15.47:0/2725574256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82580fe2b0 0x7f82580fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 --2- 172.21.15.47:0/2725574256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82580fb220 0x7f82580fb630 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 -- 172.21.15.47:0/2725574256 >> 172.21.15.47:0/2725574256 conn(0x7f82580f6ca0 msgr2=0x7f82580f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 -- 172.21.15.47:0/2725574256 shutdown_connections 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 -- 172.21.15.47:0/2725574256 wait complete. 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 Processor -- start 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 -- start start 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82580fb220 0x7f825810d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82580fe2b0 0x7f825810dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825810e4e0 con 0x7f82580fb220 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.885+0000 7f826035e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825810ed80 con 0x7f82580fe2b0 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.886+0000 7f825e0fa700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82580fb220 0x7f825810d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.886+0000 7f825e0fa700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82580fb220 0x7f825810d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46500/0 (socket says 172.21.15.47:46500) 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.886+0000 7f825e0fa700 1 -- 172.21.15.47:0/1201966852 learned_addr learned my addr 172.21.15.47:0/1201966852 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.886+0000 7f825d8f9700 1 --2- 172.21.15.47:0/1201966852 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82580fe2b0 0x7f825810dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.886+0000 7f825e0fa700 1 -- 172.21.15.47:0/1201966852 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82580fe2b0 msgr2=0x7f825810dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.886+0000 7f825e0fa700 1 --2- 172.21.15.47:0/1201966852 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82580fe2b0 0x7f825810dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.886+0000 7f825e0fa700 1 -- 172.21.15.47:0/1201966852 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8254005040 con 0x7f82580fb220 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.886+0000 7f825e0fa700 1 --2- 172.21.15.47:0/1201966852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82580fb220 0x7f825810d9a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8254000c00 tx=0x7f8254009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.886+0000 7f824effd700 1 -- 172.21.15.47:0/1201966852 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8254021070 con 0x7f82580fb220 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.886+0000 7f824effd700 1 -- 172.21.15.47:0/1201966852 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8254013de0 con 0x7f82580fb220 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.886+0000 7f826035e700 1 -- 172.21.15.47:0/1201966852 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825810f000 con 0x7f82580fb220 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.886+0000 7f824effd700 1 -- 172.21.15.47:0/1201966852 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f825400e070 con 0x7f82580fb220 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.886+0000 7f826035e700 1 -- 172.21.15.47:0/1201966852 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825810f4e0 con 0x7f82580fb220 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.887+0000 7f826035e700 1 -- 172.21.15.47:0/1201966852 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825804bed0 con 0x7f82580fb220 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.888+0000 7f824effd700 1 -- 172.21.15.47:0/1201966852 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f825401c400 con 0x7f82580fb220 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.888+0000 7f824effd700 1 --2- 172.21.15.47:0/1201966852 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8244068f70 0x7f824406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.888+0000 7f824effd700 1 -- 172.21.15.47:0/1201966852 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8254087f50 con 0x7f82580fb220 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.888+0000 7f825d8f9700 1 --2- 172.21.15.47:0/1201966852 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8244068f70 0x7f824406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.888+0000 7f825d8f9700 1 --2- 172.21.15.47:0/1201966852 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8244068f70 0x7f824406b420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8248009b80 tx=0x7f824800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:14.892+0000 7f824effd700 1 -- 172.21.15.47:0/1201966852 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f82540b9a00 con 0x7f82580fb220 2024-02-07T12:23:15.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:15.139+0000 7f826035e700 1 -- 172.21.15.47:0/1201966852 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f825810f880 con 0x7f82580fb220 2024-02-07T12:23:15.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:15.140+0000 7f824effd700 1 -- 172.21.15.47:0/1201966852 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1834 (secure 0 0 0) 0x7f8254057e60 con 0x7f82580fb220 2024-02-07T12:23:15.143 INFO:teuthology.orchestra.run.smithi047.stdout:e18 2024-02-07T12:23:15.143 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:23:15.143 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:23:15.143 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:23:15.143 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:23:15.143 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:23:15.143 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:23:15.143 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 18 2024-02-07T12:23:15.143 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:23:15.143 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:23:15.143 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:23:12.341179+0000 2024-02-07T12:23:15.144 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:23:15.144 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:23:15.144 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:23:15.144 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:23:15.144 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:23:15.144 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:23:15.144 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:23:15.144 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:23:15.144 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:23:15.144 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:23:15.144 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:23:15.144 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:23:15.144 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:23:15.145 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:23:15.145 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:23:15.145 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:23:15.145 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:23:15.145 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:23:15.145 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:23:15.145 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:23:15.145 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:23:15.145 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:23:15.145 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:23:15.145 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:23:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:23:15.145 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:23:15.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:15.142+0000 7f826035e700 1 -- 172.21.15.47:0/1201966852 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8244068f70 msgr2=0x7f824406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:15.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:15.142+0000 7f826035e700 1 --2- 172.21.15.47:0/1201966852 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8244068f70 0x7f824406b420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8248009b80 tx=0x7f824800b040 comp rx=0 tx=0).stop 2024-02-07T12:23:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:15.142+0000 7f826035e700 1 -- 172.21.15.47:0/1201966852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82580fb220 msgr2=0x7f825810d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:15.142+0000 7f826035e700 1 --2- 172.21.15.47:0/1201966852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82580fb220 0x7f825810d9a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8254000c00 tx=0x7f8254009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:15.142+0000 7f826035e700 1 -- 172.21.15.47:0/1201966852 shutdown_connections 2024-02-07T12:23:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:15.142+0000 7f826035e700 1 --2- 172.21.15.47:0/1201966852 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8244068f70 0x7f824406b420 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:15.142+0000 7f826035e700 1 --2- 172.21.15.47:0/1201966852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82580fb220 0x7f825810d9a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:15.142+0000 7f826035e700 1 --2- 172.21.15.47:0/1201966852 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82580fe2b0 0x7f825810dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:15.142+0000 7f826035e700 1 -- 172.21.15.47:0/1201966852 >> 172.21.15.47:0/1201966852 conn(0x7f82580f6ca0 msgr2=0x7f82581014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:15.142+0000 7f826035e700 1 -- 172.21.15.47:0/1201966852 shutdown_connections 2024-02-07T12:23:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:15.142+0000 7f826035e700 1 -- 172.21.15.47:0/1201966852 wait complete. 2024-02-07T12:23:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 18 2024-02-07T12:23:15.672 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:15 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:15.672 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:15 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:15.672 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:15 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:23:15.672 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:15 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:23:15.672 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:15 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:15.672 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:15 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:23:15.672 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:15 smithi047 ceph-mon[28972]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.4 KiB/s rd, 409 B/s wr, 8 op/s 2024-02-07T12:23:15.672 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:15 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1201966852' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:23:15.779 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:15 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:15.779 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:15 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:15.779 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:15 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:23:15.779 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:15 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:23:15.780 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:15 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:15.780 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:15 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:23:15.780 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:15 smithi138 ceph-mon[35528]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.4 KiB/s rd, 409 B/s wr, 8 op/s 2024-02-07T12:23:15.780 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:15 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/1201966852' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:23:16.202 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-07T12:23:17.739 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:23:17.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:17 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:17.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:17 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:17.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:17 smithi047 ceph-mon[28972]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-02-07T12:23:18.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:17 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:18.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:17 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:18.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:17 smithi138 ceph-mon[35528]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-02-07T12:23:20.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:19 smithi047 ceph-mon[28972]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-02-07T12:23:20.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:19 smithi138 ceph-mon[35528]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-02-07T12:23:20.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.603+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/2405811746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfd41000e0 msgr2=0x7fdfd4102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:20.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.603+0000 7fdfd9ed6700 1 --2- 172.21.15.47:0/2405811746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfd41000e0 0x7fdfd4102520 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc004940 tx=0x7fdfbc009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:20.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.603+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/2405811746 shutdown_connections 2024-02-07T12:23:20.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.603+0000 7fdfd9ed6700 1 --2- 172.21.15.47:0/2405811746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfd41000e0 0x7fdfd4102520 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:20.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.603+0000 7fdfd9ed6700 1 --2- 172.21.15.47:0/2405811746 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd40663c0 0x7fdfd40ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:20.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.603+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/2405811746 >> 172.21.15.47:0/2405811746 conn(0x7fdfd40f74e0 msgr2=0x7fdfd40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:20.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.603+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/2405811746 shutdown_connections 2024-02-07T12:23:20.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.603+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/2405811746 wait complete. 2024-02-07T12:23:20.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.603+0000 7fdfd9ed6700 1 Processor -- start 2024-02-07T12:23:20.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfd9ed6700 1 -- start start 2024-02-07T12:23:20.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfd9ed6700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd40663c0 0x7fdfd40fd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:20.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfd9ed6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfd41000e0 0x7fdfd40fba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:20.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfd9ed6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40fc010 con 0x7fdfd41000e0 2024-02-07T12:23:20.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfd9ed6700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40fc180 con 0x7fdfd40663c0 2024-02-07T12:23:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfd2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfd41000e0 0x7fdfd40fba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfd2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfd41000e0 0x7fdfd40fba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34056/0 (socket says 172.21.15.47:34056) 2024-02-07T12:23:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfd2ffd700 1 -- 172.21.15.47:0/4178059284 learned_addr learned my addr 172.21.15.47:0/4178059284 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfd37fe700 1 --2- 172.21.15.47:0/4178059284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd40663c0 0x7fdfd40fd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfd2ffd700 1 -- 172.21.15.47:0/4178059284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd40663c0 msgr2=0x7fdfd40fd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfd2ffd700 1 --2- 172.21.15.47:0/4178059284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd40663c0 0x7fdfd40fd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfd2ffd700 1 -- 172.21.15.47:0/4178059284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc005040 con 0x7fdfd41000e0 2024-02-07T12:23:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfd2ffd700 1 --2- 172.21.15.47:0/4178059284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfd41000e0 0x7fdfd40fba10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc000c00 tx=0x7fdfbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.604+0000 7fdfcbfff700 1 -- 172.21.15.47:0/4178059284 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfbc00e040 con 0x7fdfd41000e0 2024-02-07T12:23:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.605+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/4178059284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd40fc400 con 0x7fdfd41000e0 2024-02-07T12:23:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.605+0000 7fdfcbfff700 1 -- 172.21.15.47:0/4178059284 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdfbc00bcc0 con 0x7fdfd41000e0 2024-02-07T12:23:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.605+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/4178059284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd41158f0 con 0x7fdfd41000e0 2024-02-07T12:23:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.605+0000 7fdfcbfff700 1 -- 172.21.15.47:0/4178059284 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfbc0255e0 con 0x7fdfd41000e0 2024-02-07T12:23:20.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.605+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/4178059284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd404bed0 con 0x7fdfd41000e0 2024-02-07T12:23:20.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.606+0000 7fdfcbfff700 1 -- 172.21.15.47:0/4178059284 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fdfbc013980 con 0x7fdfd41000e0 2024-02-07T12:23:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.606+0000 7fdfcbfff700 1 --2- 172.21.15.47:0/4178059284 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdfc0068f60 0x7fdfc006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.606+0000 7fdfcbfff700 1 -- 172.21.15.47:0/4178059284 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdfbc088200 con 0x7fdfd41000e0 2024-02-07T12:23:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.607+0000 7fdfd37fe700 1 --2- 172.21.15.47:0/4178059284 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdfc0068f60 0x7fdfc006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.607+0000 7fdfd37fe700 1 --2- 172.21.15.47:0/4178059284 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdfc0068f60 0x7fdfc006b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009fd0 tx=0x7fdfc4009f60 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:20.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.611+0000 7fdfcbfff700 1 -- 172.21.15.47:0/4178059284 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdfbc058140 con 0x7fdfd41000e0 2024-02-07T12:23:20.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.855+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/4178059284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfd4105a10 con 0x7fdfd41000e0 2024-02-07T12:23:20.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.856+0000 7fdfcbfff700 1 -- 172.21.15.47:0/4178059284 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4725 (secure 0 0 0) 0x7fdfbc057cd0 con 0x7fdfd41000e0 2024-02-07T12:23:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.858+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/4178059284 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdfc0068f60 msgr2=0x7fdfc006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.858+0000 7fdfd9ed6700 1 --2- 172.21.15.47:0/4178059284 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdfc0068f60 0x7fdfc006b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009fd0 tx=0x7fdfc4009f60 comp rx=0 tx=0).stop 2024-02-07T12:23:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.858+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/4178059284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfd41000e0 msgr2=0x7fdfd40fba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.858+0000 7fdfd9ed6700 1 --2- 172.21.15.47:0/4178059284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfd41000e0 0x7fdfd40fba10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc000c00 tx=0x7fdfbc009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.858+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/4178059284 shutdown_connections 2024-02-07T12:23:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.858+0000 7fdfd9ed6700 1 --2- 172.21.15.47:0/4178059284 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdfc0068f60 0x7fdfc006b410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.858+0000 7fdfd9ed6700 1 --2- 172.21.15.47:0/4178059284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd40663c0 0x7fdfd40fd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.858+0000 7fdfd9ed6700 1 --2- 172.21.15.47:0/4178059284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfd41000e0 0x7fdfd40fba10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.859+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/4178059284 >> 172.21.15.47:0/4178059284 conn(0x7fdfd40f74e0 msgr2=0x7fdfd40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.859+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/4178059284 shutdown_connections 2024-02-07T12:23:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:20.859+0000 7fdfd9ed6700 1 -- 172.21.15.47:0/4178059284 wait complete. 2024-02-07T12:23:20.863 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 18 2024-02-07T12:23:20.873 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:23:21.544 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-07T12:23:21.803 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:23:22.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:21 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:22.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:21 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:22.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:21 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:23:22.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:21 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:23:22.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:21 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:22.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:21 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/4178059284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-07T12:23:22.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:21 smithi047 ceph-mon[28972]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-02-07T12:23:22.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:21 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:22.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:21 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:22.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:21 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:23:22.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:21 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:23:22.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:21 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:22.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:21 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/4178059284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-07T12:23:22.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:21 smithi138 ceph-mon[35528]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-02-07T12:23:23.062 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:23:23.197 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:23:23.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.471+0000 7f51e21e8700 1 -- 172.21.15.47:0/1135342537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51dc100360 msgr2=0x7f51dc1007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:23.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.471+0000 7f51e21e8700 1 --2- 172.21.15.47:0/1135342537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51dc100360 0x7f51dc1007b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f51d0004940 tx=0x7f51d0009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:23.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.471+0000 7f51e21e8700 1 -- 172.21.15.47:0/1135342537 shutdown_connections 2024-02-07T12:23:23.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.471+0000 7f51e21e8700 1 --2- 172.21.15.47:0/1135342537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51dc100360 0x7f51dc1007b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:23.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.471+0000 7f51e21e8700 1 --2- 172.21.15.47:0/1135342537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51dc0ff150 0x7f51dc0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:23.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.471+0000 7f51e21e8700 1 -- 172.21.15.47:0/1135342537 >> 172.21.15.47:0/1135342537 conn(0x7f51dc0fa920 msgr2=0x7f51dc0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:23.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.471+0000 7f51e21e8700 1 -- 172.21.15.47:0/1135342537 shutdown_connections 2024-02-07T12:23:23.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.471+0000 7f51e21e8700 1 -- 172.21.15.47:0/1135342537 wait complete. 2024-02-07T12:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.471+0000 7f51e21e8700 1 Processor -- start 2024-02-07T12:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.471+0000 7f51e21e8700 1 -- start start 2024-02-07T12:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51e21e8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51dc0ff150 0x7f51dc10fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51e21e8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51dc100360 0x7f51dc1100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51e21e8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc1106b0 con 0x7f51dc0ff150 2024-02-07T12:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51e21e8700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc110f50 con 0x7f51dc100360 2024-02-07T12:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51db7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51dc0ff150 0x7f51dc10fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51db7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51dc0ff150 0x7f51dc10fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34064/0 (socket says 172.21.15.47:34064) 2024-02-07T12:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51db7fe700 1 -- 172.21.15.47:0/2587278568 learned_addr learned my addr 172.21.15.47:0/2587278568 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51daffd700 1 --2- 172.21.15.47:0/2587278568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51dc100360 0x7f51dc1100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:23.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51db7fe700 1 -- 172.21.15.47:0/2587278568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51dc100360 msgr2=0x7f51dc1100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:23.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51db7fe700 1 --2- 172.21.15.47:0/2587278568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51dc100360 0x7f51dc1100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:23.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51db7fe700 1 -- 172.21.15.47:0/2587278568 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d0005040 con 0x7f51dc0ff150 2024-02-07T12:23:23.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51daffd700 1 --2- 172.21.15.47:0/2587278568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51dc100360 0x7f51dc1100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:23:23.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51db7fe700 1 --2- 172.21.15.47:0/2587278568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51dc0ff150 0x7f51dc10fb70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00c8e0 tx=0x7f51cc0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:23.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51c3fff700 1 -- 172.21.15.47:0/2587278568 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51cc00a940 con 0x7f51dc0ff150 2024-02-07T12:23:23.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51c3fff700 1 -- 172.21.15.47:0/2587278568 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51cc00ce80 con 0x7f51dc0ff150 2024-02-07T12:23:23.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51e21e8700 1 -- 172.21.15.47:0/2587278568 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc111230 con 0x7f51dc0ff150 2024-02-07T12:23:23.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51c3fff700 1 -- 172.21.15.47:0/2587278568 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51cc0113a0 con 0x7f51dc0ff150 2024-02-07T12:23:23.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.472+0000 7f51e21e8700 1 -- 172.21.15.47:0/2587278568 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc111770 con 0x7f51dc0ff150 2024-02-07T12:23:23.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.473+0000 7f51e21e8700 1 -- 172.21.15.47:0/2587278568 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc04bed0 con 0x7f51dc0ff150 2024-02-07T12:23:23.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.474+0000 7f51c3fff700 1 -- 172.21.15.47:0/2587278568 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f51cc012400 con 0x7f51dc0ff150 2024-02-07T12:23:23.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.474+0000 7f51c3fff700 1 --2- 172.21.15.47:0/2587278568 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f51c4068f60 0x7f51c406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:23.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.474+0000 7f51c3fff700 1 -- 172.21.15.47:0/2587278568 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f51cc086ef0 con 0x7f51dc0ff150 2024-02-07T12:23:23.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.474+0000 7f51daffd700 1 --2- 172.21.15.47:0/2587278568 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f51c4068f60 0x7f51c406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:23.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.475+0000 7f51daffd700 1 --2- 172.21.15.47:0/2587278568 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f51c4068f60 0x7f51c406b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f51d0004f90 tx=0x7f51d0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:23.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.479+0000 7f51c3fff700 1 -- 172.21.15.47:0/2587278568 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f51cc056e00 con 0x7f51dc0ff150 2024-02-07T12:23:23.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.748+0000 7f51e21e8700 1 -- 172.21.15.47:0/2587278568 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f51dc107c30 con 0x7f51dc0ff150 2024-02-07T12:23:23.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.749+0000 7f51c3fff700 1 -- 172.21.15.47:0/2587278568 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v18) v1 ==== 78+0+99 (secure 0 0 0) 0x7f51cc056990 con 0x7f51dc0ff150 2024-02-07T12:23:23.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.750+0000 7f51e21e8700 1 -- 172.21.15.47:0/2587278568 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f51c4068f60 msgr2=0x7f51c406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:23.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.750+0000 7f51e21e8700 1 --2- 172.21.15.47:0/2587278568 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f51c4068f60 0x7f51c406b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f51d0004f90 tx=0x7f51d0009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:23.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.750+0000 7f51e21e8700 1 -- 172.21.15.47:0/2587278568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51dc0ff150 msgr2=0x7f51dc10fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:23.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.750+0000 7f51e21e8700 1 --2- 172.21.15.47:0/2587278568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51dc0ff150 0x7f51dc10fb70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00c8e0 tx=0x7f51cc0044c0 comp rx=0 tx=0).stop 2024-02-07T12:23:23.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.751+0000 7f51e21e8700 1 -- 172.21.15.47:0/2587278568 shutdown_connections 2024-02-07T12:23:23.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.751+0000 7f51e21e8700 1 --2- 172.21.15.47:0/2587278568 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f51c4068f60 0x7f51c406b410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:23.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.751+0000 7f51e21e8700 1 --2- 172.21.15.47:0/2587278568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51dc0ff150 0x7f51dc10fb70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:23.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.751+0000 7f51e21e8700 1 --2- 172.21.15.47:0/2587278568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51dc100360 0x7f51dc1100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:23.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.751+0000 7f51e21e8700 1 -- 172.21.15.47:0/2587278568 >> 172.21.15.47:0/2587278568 conn(0x7f51dc0fa920 msgr2=0x7f51dc103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:23.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.751+0000 7f51e21e8700 1 -- 172.21.15.47:0/2587278568 shutdown_connections 2024-02-07T12:23:23.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:23.751+0000 7f51e21e8700 1 -- 172.21.15.47:0/2587278568 wait complete. 2024-02-07T12:23:23.764 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:23:24.058 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:23 smithi047 ceph-mon[28972]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.5 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-07T12:23:24.058 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:23 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2587278568' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-07T12:23:24.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:23 smithi138 ceph-mon[35528]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.5 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-07T12:23:24.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:23 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2587278568' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-07T12:23:24.324 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-07T12:23:24.366 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-07T12:23:24.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.474+0000 7fdd99b1d640 1 -- 172.21.15.47:0/2295056240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940fc470 msgr2=0x7fdd940fc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:24.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.474+0000 7fdd99b1d640 1 --2- 172.21.15.47:0/2295056240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940fc470 0x7fdd940fc8e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdd880048d0 tx=0x7fdd88009da0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.474+0000 7fdd99b1d640 1 -- 172.21.15.47:0/2295056240 shutdown_connections 2024-02-07T12:23:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.474+0000 7fdd99b1d640 1 --2- 172.21.15.47:0/2295056240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940fc470 0x7fdd940fc8e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.474+0000 7fdd99b1d640 1 --2- 172.21.15.47:0/2295056240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd940fb1a0 0x7fdd940fb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.474+0000 7fdd99b1d640 1 -- 172.21.15.47:0/2295056240 >> 172.21.15.47:0/2295056240 conn(0x7fdd940f6960 msgr2=0x7fdd940f8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.475+0000 7fdd99b1d640 1 -- 172.21.15.47:0/2295056240 shutdown_connections 2024-02-07T12:23:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.475+0000 7fdd99b1d640 1 -- 172.21.15.47:0/2295056240 wait complete. 2024-02-07T12:23:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.475+0000 7fdd99b1d640 1 Processor -- start 2024-02-07T12:23:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.475+0000 7fdd99b1d640 1 -- start start 2024-02-07T12:23:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.475+0000 7fdd99b1d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd940fb1a0 0x7fdd9410cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.475+0000 7fdd99b1d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940fc470 0x7fdd9410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.475+0000 7fdd99b1d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9410d6e0 con 0x7fdd940fc470 2024-02-07T12:23:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.475+0000 7fdd99b1d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94112130 con 0x7fdd940fb1a0 2024-02-07T12:23:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.475+0000 7fdd92ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940fc470 0x7fdd9410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.475+0000 7fdd92ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940fc470 0x7fdd9410d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34088/0 (socket says 172.21.15.47:34088) 2024-02-07T12:23:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.475+0000 7fdd92ffd640 1 -- 172.21.15.47:0/268152598 learned_addr learned my addr 172.21.15.47:0/268152598 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.476+0000 7fdd937fe640 1 --2- 172.21.15.47:0/268152598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd940fb1a0 0x7fdd9410cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.476+0000 7fdd92ffd640 1 -- 172.21.15.47:0/268152598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd940fb1a0 msgr2=0x7fdd9410cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.476+0000 7fdd92ffd640 1 --2- 172.21.15.47:0/268152598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd940fb1a0 0x7fdd9410cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.476+0000 7fdd92ffd640 1 -- 172.21.15.47:0/268152598 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88005040 con 0x7fdd940fc470 2024-02-07T12:23:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.476+0000 7fdd92ffd640 1 --2- 172.21.15.47:0/268152598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940fc470 0x7fdd9410d090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdd88007da0 tx=0x7fdd88009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.476+0000 7fdd7bfff640 1 -- 172.21.15.47:0/268152598 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd880094c0 con 0x7fdd940fc470 2024-02-07T12:23:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.476+0000 7fdd99b1d640 1 -- 172.21.15.47:0/268152598 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd94112270 con 0x7fdd940fc470 2024-02-07T12:23:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.476+0000 7fdd7bfff640 1 -- 172.21.15.47:0/268152598 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd88009620 con 0x7fdd940fc470 2024-02-07T12:23:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.476+0000 7fdd7bfff640 1 -- 172.21.15.47:0/268152598 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd8803b620 con 0x7fdd940fc470 2024-02-07T12:23:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.476+0000 7fdd99b1d640 1 -- 172.21.15.47:0/268152598 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd94112760 con 0x7fdd940fc470 2024-02-07T12:23:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.477+0000 7fdd99b1d640 1 -- 172.21.15.47:0/268152598 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd94103cf0 con 0x7fdd940fc470 2024-02-07T12:23:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.477+0000 7fdd7bfff640 1 -- 172.21.15.47:0/268152598 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fdd8802f070 con 0x7fdd940fc470 2024-02-07T12:23:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.478+0000 7fdd7bfff640 1 --2- 172.21.15.47:0/268152598 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdd7c068ed0 0x7fdd7c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.478+0000 7fdd7bfff640 1 -- 172.21.15.47:0/268152598 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdd880a9430 con 0x7fdd940fc470 2024-02-07T12:23:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.478+0000 7fdd937fe640 1 --2- 172.21.15.47:0/268152598 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdd7c068ed0 0x7fdd7c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.478+0000 7fdd937fe640 1 --2- 172.21.15.47:0/268152598 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdd7c068ed0 0x7fdd7c06b380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009470 tx=0x7fdd84009ed0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:24.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.482+0000 7fdd7bfff640 1 -- 172.21.15.47:0/268152598 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdd88075830 con 0x7fdd940fc470 2024-02-07T12:23:24.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.655+0000 7fdd99b1d640 1 -- 172.21.15.47:0/268152598 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd94112a30 con 0x7fdd940fc470 2024-02-07T12:23:24.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.656+0000 7fdd7bfff640 1 -- 172.21.15.47:0/268152598 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14401 (secure 0 0 0) 0x7fdd88078e50 con 0x7fdd940fc470 2024-02-07T12:23:24.659 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:23:24.659 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":47,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","created":"2024-02-07T12:16:03.682077+0000","modified":"2024-02-07T12:23:08.319203+0000","last_up_change":"2024-02-07T12:21:33.301075+0000","last_in_change":"2024-02-07T12:21:14.657544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-07T12:20:21.191001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-07T12:22:52.656534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-07T12:22:53.237906+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b37bbc00-7240-422a-977b-c7a9687ce87f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6803","nonce":3625841997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6805","nonce":3625841997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6809","nonce":3625841997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3625841997},{"type":"v1","addr":"172.21.15.47:6807","nonce":3625841997}]},"public_addr":"172.21.15.47:6803/3625841997","cluster_addr":"172.21.15.47:6805/3625841997","heartbeat_back_addr":"172.21.15.47:6809/3625841997","heartbeat_front_addr":"172.21.15.47:6807/3625841997","state":["exists","up"]},{"osd":1,"uuid":"e6a42328-96ea-40de-987d-4edec38a4b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6811","nonce":3556866846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6813","nonce":3556866846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6817","nonce":3556866846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3556866846},{"type":"v1","addr":"172.21.15.47:6815","nonce":3556866846}]},"public_addr":"172.21.15.47:6811/3556866846","cluster_addr":"172.21.15.47:6813/3556866846","heartbeat_back_addr":"172.21.15.47:6817/3556866846","heartbeat_front_addr":"172.21.15.47:6815/3556866846","state":["exists","up"]},{"osd":2,"uuid":"c8925cb3-0da0-4f01-90c3-1b6fb6e15331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6819","nonce":3651330024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6821","nonce":3651330024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6825","nonce":3651330024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3651330024},{"type":"v1","addr":"172.21.15.47:6823","nonce":3651330024}]},"public_addr":"172.21.15.47:6819/3651330024","cluster_addr":"172.21.15.47:6821/3651330024","heartbeat_back_addr":"172.21.15.47:6825/3651330024","heartbeat_front_addr":"172.21.15.47:6823/3651330024","state":["exists","up"]},{"osd":3,"uuid":"47130a0a-e27f-4129-abbb-4bef9b460ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6801","nonce":2068429764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6803","nonce":2068429764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6807","nonce":2068429764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2068429764},{"type":"v1","addr":"172.21.15.138:6805","nonce":2068429764}]},"public_addr":"172.21.15.138:6801/2068429764","cluster_addr":"172.21.15.138:6803/2068429764","heartbeat_back_addr":"172.21.15.138:6807/2068429764","heartbeat_front_addr":"172.21.15.138:6805/2068429764","state":["exists","up"]},{"osd":4,"uuid":"103459b7-4883-4248-a64d-21c396324237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6809","nonce":873394890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6811","nonce":873394890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6815","nonce":873394890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":873394890},{"type":"v1","addr":"172.21.15.138:6813","nonce":873394890}]},"public_addr":"172.21.15.138:6809/873394890","cluster_addr":"172.21.15.138:6811/873394890","heartbeat_back_addr":"172.21.15.138:6815/873394890","heartbeat_front_addr":"172.21.15.138:6813/873394890","state":["exists","up"]},{"osd":5,"uuid":"e8acb2ff-d0f5-4daf-82ee-6c4fddf1580d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6817","nonce":3475843019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6819","nonce":3475843019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6823","nonce":3475843019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3475843019},{"type":"v1","addr":"172.21.15.138:6821","nonce":3475843019}]},"public_addr":"172.21.15.138:6817/3475843019","cluster_addr":"172.21.15.138:6819/3475843019","heartbeat_back_addr":"172.21.15.138:6823/3475843019","heartbeat_front_addr":"172.21.15.138:6821/3475843019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:19.518708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:48.503474+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:17.112205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:41.349671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:06.347737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:31.635560+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/1918664197":"2024-02-08T12:17:02.806879+0000","172.21.15.47:0/2768201708":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/1415322117":"2024-02-08T12:18:06.849658+0000","172.21.15.47:6800/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/3413297119":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/2757370866":"2024-02-08T12:18:06.849658+0000","172.21.15.47:6801/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/454079597":"2024-02-08T12:18:06.849658+0000","172.21.15.47:6801/3304641630":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/3361862950":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6800/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.138:6824/2917636817":"2024-02-08T12:23:08.319154+0000","172.21.15.138:6825/2917636817":"2024-02-08T12:23:08.319154+0000","172.21.15.47:6801/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.47:0/3354208208":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/3586302931":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6800/3304641630":"2024-02-08T12:18:06.849658+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-07T12:23:24.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.658+0000 7fdd99b1d640 1 -- 172.21.15.47:0/268152598 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdd7c068ed0 msgr2=0x7fdd7c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:24.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.658+0000 7fdd99b1d640 1 --2- 172.21.15.47:0/268152598 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdd7c068ed0 0x7fdd7c06b380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009470 tx=0x7fdd84009ed0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.658+0000 7fdd99b1d640 1 -- 172.21.15.47:0/268152598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940fc470 msgr2=0x7fdd9410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:24.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.658+0000 7fdd99b1d640 1 --2- 172.21.15.47:0/268152598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940fc470 0x7fdd9410d090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdd88007da0 tx=0x7fdd88009da0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.658+0000 7fdd99b1d640 1 -- 172.21.15.47:0/268152598 shutdown_connections 2024-02-07T12:23:24.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.658+0000 7fdd99b1d640 1 --2- 172.21.15.47:0/268152598 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fdd7c068ed0 0x7fdd7c06b380 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.658+0000 7fdd99b1d640 1 --2- 172.21.15.47:0/268152598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940fc470 0x7fdd9410d090 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.658+0000 7fdd99b1d640 1 --2- 172.21.15.47:0/268152598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd940fb1a0 0x7fdd9410cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.658+0000 7fdd99b1d640 1 -- 172.21.15.47:0/268152598 >> 172.21.15.47:0/268152598 conn(0x7fdd940f6960 msgr2=0x7fdd940656f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:24.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.658+0000 7fdd99b1d640 1 -- 172.21.15.47:0/268152598 shutdown_connections 2024-02-07T12:23:24.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.658+0000 7fdd99b1d640 1 -- 172.21.15.47:0/268152598 wait complete. 2024-02-07T12:23:24.672 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-07T12:20:21.191001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-07T12:22:52.656534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-07T12:22:53.237906+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-07T12:23:24.673 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-07T12:23:24.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.770+0000 7f7ba8eae640 1 -- 172.21.15.47:0/4033137934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba40fd590 msgr2=0x7f7ba40fda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:24.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.770+0000 7f7ba8eae640 1 --2- 172.21.15.47:0/4033137934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba40fd590 0x7f7ba40fda00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0048d0 tx=0x7f7b8c009da0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.770+0000 7f7ba8eae640 1 -- 172.21.15.47:0/4033137934 shutdown_connections 2024-02-07T12:23:24.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.770+0000 7f7ba8eae640 1 --2- 172.21.15.47:0/4033137934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba40fd590 0x7f7ba40fda00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.770+0000 7f7ba8eae640 1 --2- 172.21.15.47:0/4033137934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ba40fc2c0 0x7f7ba40fc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.770+0000 7f7ba8eae640 1 -- 172.21.15.47:0/4033137934 >> 172.21.15.47:0/4033137934 conn(0x7f7ba40f7a60 msgr2=0x7f7ba40f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:24.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.770+0000 7f7ba8eae640 1 -- 172.21.15.47:0/4033137934 shutdown_connections 2024-02-07T12:23:24.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.770+0000 7f7ba8eae640 1 -- 172.21.15.47:0/4033137934 wait complete. 2024-02-07T12:23:24.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba8eae640 1 Processor -- start 2024-02-07T12:23:24.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba8eae640 1 -- start start 2024-02-07T12:23:24.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba8eae640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ba40fc2c0 0x7f7ba410cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:24.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba8eae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba40fd590 0x7f7ba410d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:24.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba8eae640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba410d710 con 0x7f7ba40fd590 2024-02-07T12:23:24.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba8eae640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba4112160 con 0x7f7ba40fc2c0 2024-02-07T12:23:24.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba40fd590 0x7f7ba410d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:24.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba40fd590 0x7f7ba410d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34106/0 (socket says 172.21.15.47:34106) 2024-02-07T12:23:24.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba1d9b640 1 -- 172.21.15.47:0/117380104 learned_addr learned my addr 172.21.15.47:0/117380104 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:24.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba259c640 1 --2- 172.21.15.47:0/117380104 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ba40fc2c0 0x7f7ba410cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:24.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba1d9b640 1 -- 172.21.15.47:0/117380104 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ba40fc2c0 msgr2=0x7f7ba410cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:24.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba1d9b640 1 --2- 172.21.15.47:0/117380104 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ba40fc2c0 0x7f7ba410cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba1d9b640 1 -- 172.21.15.47:0/117380104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c005040 con 0x7f7ba40fd590 2024-02-07T12:23:24.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.771+0000 7f7ba1d9b640 1 --2- 172.21.15.47:0/117380104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba40fd590 0x7f7ba410d0c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c007d20 tx=0x7f7b8c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:24.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.772+0000 7f7b9affd640 1 -- 172.21.15.47:0/117380104 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b8c009590 con 0x7f7ba40fd590 2024-02-07T12:23:24.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.772+0000 7f7b9affd640 1 -- 172.21.15.47:0/117380104 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b8c0096f0 con 0x7f7ba40fd590 2024-02-07T12:23:24.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.772+0000 7f7ba8eae640 1 -- 172.21.15.47:0/117380104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba41122a0 con 0x7f7ba40fd590 2024-02-07T12:23:24.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.772+0000 7f7b9affd640 1 -- 172.21.15.47:0/117380104 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b8c03b6d0 con 0x7f7ba40fd590 2024-02-07T12:23:24.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.772+0000 7f7ba8eae640 1 -- 172.21.15.47:0/117380104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba4112790 con 0x7f7ba40fd590 2024-02-07T12:23:24.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.772+0000 7f7ba8eae640 1 -- 172.21.15.47:0/117380104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba4104e10 con 0x7f7ba40fd590 2024-02-07T12:23:24.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.773+0000 7f7b9affd640 1 -- 172.21.15.47:0/117380104 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7b8c02f070 con 0x7f7ba40fd590 2024-02-07T12:23:24.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.773+0000 7f7b9affd640 1 --2- 172.21.15.47:0/117380104 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7b90068ed0 0x7f7b9006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:24.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.773+0000 7f7b9affd640 1 -- 172.21.15.47:0/117380104 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7b8c0a95a0 con 0x7f7ba40fd590 2024-02-07T12:23:24.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.773+0000 7f7ba259c640 1 --2- 172.21.15.47:0/117380104 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7b90068ed0 0x7f7b9006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:24.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.774+0000 7f7ba259c640 1 --2- 172.21.15.47:0/117380104 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7b90068ed0 0x7f7b9006b380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c004bc0 tx=0x7f7b9c009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:24.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.778+0000 7f7b9affd640 1 -- 172.21.15.47:0/117380104 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7b8c0759a0 con 0x7f7ba40fd590 2024-02-07T12:23:24.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.949+0000 7f7ba8eae640 1 -- 172.21.15.47:0/117380104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ba4104fa0 con 0x7f7ba40fd590 2024-02-07T12:23:24.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.949+0000 7f7b9affd640 1 -- 172.21.15.47:0/117380104 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ba4104fa0 con 0x7f7ba40fd590 2024-02-07T12:23:24.953 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-02-07T12:23:24.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.951+0000 7f7ba8eae640 1 -- 172.21.15.47:0/117380104 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7b90068ed0 msgr2=0x7f7b9006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:24.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.951+0000 7f7ba8eae640 1 --2- 172.21.15.47:0/117380104 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7b90068ed0 0x7f7b9006b380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c004bc0 tx=0x7f7b9c009040 comp rx=0 tx=0).stop 2024-02-07T12:23:24.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.951+0000 7f7ba8eae640 1 -- 172.21.15.47:0/117380104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba40fd590 msgr2=0x7f7ba410d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:24.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.951+0000 7f7ba8eae640 1 --2- 172.21.15.47:0/117380104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba40fd590 0x7f7ba410d0c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c007d20 tx=0x7f7b8c009da0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.951+0000 7f7ba8eae640 1 -- 172.21.15.47:0/117380104 shutdown_connections 2024-02-07T12:23:24.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.951+0000 7f7ba8eae640 1 --2- 172.21.15.47:0/117380104 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7b90068ed0 0x7f7b9006b380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.951+0000 7f7ba8eae640 1 --2- 172.21.15.47:0/117380104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba40fd590 0x7f7ba410d0c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.951+0000 7f7ba8eae640 1 --2- 172.21.15.47:0/117380104 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ba40fc2c0 0x7f7ba410cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:24.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.951+0000 7f7ba8eae640 1 -- 172.21.15.47:0/117380104 >> 172.21.15.47:0/117380104 conn(0x7f7ba40f7a60 msgr2=0x7f7ba41007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:24.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.951+0000 7f7ba8eae640 1 -- 172.21.15.47:0/117380104 shutdown_connections 2024-02-07T12:23:24.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:24.951+0000 7f7ba8eae640 1 -- 172.21.15.47:0/117380104 wait complete. 2024-02-07T12:23:24.964 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:24 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/268152598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:23:24.965 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-07T12:23:25.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.062+0000 7f229ba6e640 1 -- 172.21.15.47:0/2269848654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22940fc400 msgr2=0x7f22940fc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:25.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.062+0000 7f229ba6e640 1 --2- 172.21.15.47:0/2269848654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22940fc400 0x7f22940fc870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f22880048d0 tx=0x7f2288009da0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.062+0000 7f229ba6e640 1 -- 172.21.15.47:0/2269848654 shutdown_connections 2024-02-07T12:23:25.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.062+0000 7f229ba6e640 1 --2- 172.21.15.47:0/2269848654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22940fc400 0x7f22940fc870 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.062+0000 7f229ba6e640 1 --2- 172.21.15.47:0/2269848654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22940fb1d0 0x7f22940fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.062+0000 7f229ba6e640 1 -- 172.21.15.47:0/2269848654 >> 172.21.15.47:0/2269848654 conn(0x7f22940f68d0 msgr2=0x7f22940f8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:25.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.062+0000 7f229ba6e640 1 -- 172.21.15.47:0/2269848654 shutdown_connections 2024-02-07T12:23:25.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.062+0000 7f229ba6e640 1 -- 172.21.15.47:0/2269848654 wait complete. 2024-02-07T12:23:25.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f229ba6e640 1 Processor -- start 2024-02-07T12:23:25.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f229ba6e640 1 -- start start 2024-02-07T12:23:25.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f229ba6e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22940fb1d0 0x7f22940ff0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:25.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f229ba6e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22940fc400 0x7f22940fd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:25.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f229ba6e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940fdc80 con 0x7f22940fc400 2024-02-07T12:23:25.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f229ba6e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940fddf0 con 0x7f22940fb1d0 2024-02-07T12:23:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f2299009640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22940fc400 0x7f22940fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f2299009640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22940fc400 0x7f22940fd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34114/0 (socket says 172.21.15.47:34114) 2024-02-07T12:23:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f2299009640 1 -- 172.21.15.47:0/585869049 learned_addr learned my addr 172.21.15.47:0/585869049 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f229980a640 1 --2- 172.21.15.47:0/585869049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22940fb1d0 0x7f22940ff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f2299009640 1 -- 172.21.15.47:0/585869049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22940fb1d0 msgr2=0x7f22940ff0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f2299009640 1 --2- 172.21.15.47:0/585869049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22940fb1d0 0x7f22940ff0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f2299009640 1 -- 172.21.15.47:0/585869049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2288005040 con 0x7f22940fc400 2024-02-07T12:23:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.063+0000 7f2299009640 1 --2- 172.21.15.47:0/585869049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22940fc400 0x7f22940fd740 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2288007da0 tx=0x7f2288009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.064+0000 7f22927fc640 1 -- 172.21.15.47:0/585869049 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22880094c0 con 0x7f22940fc400 2024-02-07T12:23:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.064+0000 7f229ba6e640 1 -- 172.21.15.47:0/585869049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22940fe070 con 0x7f22940fc400 2024-02-07T12:23:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.064+0000 7f22927fc640 1 -- 172.21.15.47:0/585869049 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2288009620 con 0x7f22940fc400 2024-02-07T12:23:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.064+0000 7f22927fc640 1 -- 172.21.15.47:0/585869049 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f228803b620 con 0x7f22940fc400 2024-02-07T12:23:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.064+0000 7f229ba6e640 1 -- 172.21.15.47:0/585869049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22940fe590 con 0x7f22940fc400 2024-02-07T12:23:25.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.065+0000 7f229ba6e640 1 -- 172.21.15.47:0/585869049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2294103d40 con 0x7f22940fc400 2024-02-07T12:23:25.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.065+0000 7f22927fc640 1 -- 172.21.15.47:0/585869049 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f228802f070 con 0x7f22940fc400 2024-02-07T12:23:25.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.065+0000 7f22927fc640 1 --2- 172.21.15.47:0/585869049 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f227c068ed0 0x7f227c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:25.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.065+0000 7f22927fc640 1 -- 172.21.15.47:0/585869049 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f22880a9470 con 0x7f22940fc400 2024-02-07T12:23:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.065+0000 7f229980a640 1 --2- 172.21.15.47:0/585869049 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f227c068ed0 0x7f227c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.066+0000 7f229980a640 1 --2- 172.21.15.47:0/585869049 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f227c068ed0 0x7f227c06b380 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f22940fc260 tx=0x7f228c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:25.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.070+0000 7f22927fc640 1 -- 172.21.15.47:0/585869049 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2288075870 con 0x7f22940fc400 2024-02-07T12:23:25.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.242+0000 7f229ba6e640 1 -- 172.21.15.47:0/585869049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f2294114d80 con 0x7f22940fc400 2024-02-07T12:23:25.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.243+0000 7f22927fc640 1 -- 172.21.15.47:0/585869049 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f2288078e90 con 0x7f22940fc400 2024-02-07T12:23:25.246 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-02-07T12:23:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.245+0000 7f229ba6e640 1 -- 172.21.15.47:0/585869049 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f227c068ed0 msgr2=0x7f227c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.245+0000 7f229ba6e640 1 --2- 172.21.15.47:0/585869049 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f227c068ed0 0x7f227c06b380 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f22940fc260 tx=0x7f228c00b040 comp rx=0 tx=0).stop 2024-02-07T12:23:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.245+0000 7f229ba6e640 1 -- 172.21.15.47:0/585869049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22940fc400 msgr2=0x7f22940fd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.245+0000 7f229ba6e640 1 --2- 172.21.15.47:0/585869049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22940fc400 0x7f22940fd740 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2288007da0 tx=0x7f2288009da0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.245+0000 7f229ba6e640 1 -- 172.21.15.47:0/585869049 shutdown_connections 2024-02-07T12:23:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.245+0000 7f229ba6e640 1 --2- 172.21.15.47:0/585869049 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f227c068ed0 0x7f227c06b380 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.245+0000 7f229ba6e640 1 --2- 172.21.15.47:0/585869049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22940fc400 0x7f22940fd740 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.245+0000 7f229ba6e640 1 --2- 172.21.15.47:0/585869049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22940fb1d0 0x7f22940ff0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.245+0000 7f229ba6e640 1 -- 172.21.15.47:0/585869049 >> 172.21.15.47:0/585869049 conn(0x7f22940f68d0 msgr2=0x7f2294064480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.245+0000 7f229ba6e640 1 -- 172.21.15.47:0/585869049 shutdown_connections 2024-02-07T12:23:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.245+0000 7f229ba6e640 1 -- 172.21.15.47:0/585869049 wait complete. 2024-02-07T12:23:25.259 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-07T12:23:25.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:24 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/268152598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:23:25.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.357+0000 7f6b6022e640 1 -- 172.21.15.47:0/2338589058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580fd540 msgr2=0x7f6b580fd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:25.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.357+0000 7f6b6022e640 1 --2- 172.21.15.47:0/2338589058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580fd540 0x7f6b580fd9b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6b480048d0 tx=0x7f6b48009da0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.357+0000 7f6b6022e640 1 -- 172.21.15.47:0/2338589058 shutdown_connections 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.357+0000 7f6b6022e640 1 --2- 172.21.15.47:0/2338589058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580fd540 0x7f6b580fd9b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.357+0000 7f6b6022e640 1 --2- 172.21.15.47:0/2338589058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b580fc270 0x7f6b580fc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.357+0000 7f6b6022e640 1 -- 172.21.15.47:0/2338589058 >> 172.21.15.47:0/2338589058 conn(0x7f6b580f7a30 msgr2=0x7f6b580f9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.357+0000 7f6b6022e640 1 -- 172.21.15.47:0/2338589058 shutdown_connections 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.357+0000 7f6b6022e640 1 -- 172.21.15.47:0/2338589058 wait complete. 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.357+0000 7f6b6022e640 1 Processor -- start 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.357+0000 7f6b6022e640 1 -- start start 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b6022e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580fc270 0x7f6b5810cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b6022e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b580fd540 0x7f6b5810d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b6022e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5810d6a0 con 0x7f6b580fc270 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b6022e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b581120f0 con 0x7f6b580fd540 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b5dfca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580fc270 0x7f6b5810cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b5dfca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580fc270 0x7f6b5810cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34140/0 (socket says 172.21.15.47:34140) 2024-02-07T12:23:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b5dfca640 1 -- 172.21.15.47:0/302062059 learned_addr learned my addr 172.21.15.47:0/302062059 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:25.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b5d7c9640 1 --2- 172.21.15.47:0/302062059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b580fd540 0x7f6b5810d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:25.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b5dfca640 1 -- 172.21.15.47:0/302062059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b580fd540 msgr2=0x7f6b5810d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:25.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b5dfca640 1 --2- 172.21.15.47:0/302062059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b580fd540 0x7f6b5810d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b5dfca640 1 -- 172.21.15.47:0/302062059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b48005040 con 0x7f6b580fc270 2024-02-07T12:23:25.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b5d7c9640 1 --2- 172.21.15.47:0/302062059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b580fd540 0x7f6b5810d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:23:25.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b5dfca640 1 --2- 172.21.15.47:0/302062059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580fc270 0x7f6b5810cb10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6b5400c790 tx=0x7f6b540043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:25.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b4e7fc640 1 -- 172.21.15.47:0/302062059 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b5400a820 con 0x7f6b580fc270 2024-02-07T12:23:25.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b6022e640 1 -- 172.21.15.47:0/302062059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b58112290 con 0x7f6b580fc270 2024-02-07T12:23:25.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b4e7fc640 1 -- 172.21.15.47:0/302062059 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b5400ae50 con 0x7f6b580fc270 2024-02-07T12:23:25.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b4e7fc640 1 -- 172.21.15.47:0/302062059 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b540115e0 con 0x7f6b580fc270 2024-02-07T12:23:25.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.358+0000 7f6b6022e640 1 -- 172.21.15.47:0/302062059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b58112780 con 0x7f6b580fc270 2024-02-07T12:23:25.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.359+0000 7f6b6022e640 1 -- 172.21.15.47:0/302062059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b58104de0 con 0x7f6b580fc270 2024-02-07T12:23:25.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.360+0000 7f6b4e7fc640 1 -- 172.21.15.47:0/302062059 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6b54012400 con 0x7f6b580fc270 2024-02-07T12:23:25.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.360+0000 7f6b4e7fc640 1 --2- 172.21.15.47:0/302062059 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f6b44068ed0 0x7f6b4406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:25.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.360+0000 7f6b4e7fc640 1 -- 172.21.15.47:0/302062059 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6b54087010 con 0x7f6b580fc270 2024-02-07T12:23:25.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.360+0000 7f6b5d7c9640 1 --2- 172.21.15.47:0/302062059 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f6b44068ed0 0x7f6b4406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:25.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.361+0000 7f6b5d7c9640 1 --2- 172.21.15.47:0/302062059 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f6b44068ed0 0x7f6b4406b380 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6b4802bda0 tx=0x7f6b48009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:25.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.365+0000 7f6b4e7fc640 1 -- 172.21.15.47:0/302062059 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6b54053490 con 0x7f6b580fc270 2024-02-07T12:23:25.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.534+0000 7f6b6022e640 1 -- 172.21.15.47:0/302062059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f6b58104f70 con 0x7f6b580fc270 2024-02-07T12:23:25.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.535+0000 7f6b4e7fc640 1 -- 172.21.15.47:0/302062059 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6b58104f70 con 0x7f6b580fc270 2024-02-07T12:23:25.538 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-02-07T12:23:25.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.537+0000 7f6b6022e640 1 -- 172.21.15.47:0/302062059 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f6b44068ed0 msgr2=0x7f6b4406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:25.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.537+0000 7f6b6022e640 1 --2- 172.21.15.47:0/302062059 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f6b44068ed0 0x7f6b4406b380 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6b4802bda0 tx=0x7f6b48009da0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.537+0000 7f6b6022e640 1 -- 172.21.15.47:0/302062059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580fc270 msgr2=0x7f6b5810cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:25.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.537+0000 7f6b6022e640 1 --2- 172.21.15.47:0/302062059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580fc270 0x7f6b5810cb10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6b5400c790 tx=0x7f6b540043c0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.537+0000 7f6b6022e640 1 -- 172.21.15.47:0/302062059 shutdown_connections 2024-02-07T12:23:25.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.537+0000 7f6b6022e640 1 --2- 172.21.15.47:0/302062059 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f6b44068ed0 0x7f6b4406b380 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.537+0000 7f6b6022e640 1 --2- 172.21.15.47:0/302062059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b580fd540 0x7f6b5810d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.537+0000 7f6b6022e640 1 --2- 172.21.15.47:0/302062059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580fc270 0x7f6b5810cb10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.537+0000 7f6b6022e640 1 -- 172.21.15.47:0/302062059 >> 172.21.15.47:0/302062059 conn(0x7f6b580f7a30 msgr2=0x7f6b58100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:25.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.537+0000 7f6b6022e640 1 -- 172.21.15.47:0/302062059 shutdown_connections 2024-02-07T12:23:25.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.537+0000 7f6b6022e640 1 -- 172.21.15.47:0/302062059 wait complete. 2024-02-07T12:23:25.551 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-07T12:23:25.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.646+0000 7f114599d640 1 -- 172.21.15.47:0/1768666663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11400fb180 msgr2=0x7f11400fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:25.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.646+0000 7f114599d640 1 --2- 172.21.15.47:0/1768666663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11400fb180 0x7f11400fb590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f11380048d0 tx=0x7f1138009da0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.646+0000 7f114599d640 1 -- 172.21.15.47:0/1768666663 shutdown_connections 2024-02-07T12:23:25.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.646+0000 7f114599d640 1 --2- 172.21.15.47:0/1768666663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11400fc450 0x7f11400fc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.646+0000 7f114599d640 1 --2- 172.21.15.47:0/1768666663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11400fb180 0x7f11400fb590 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.646+0000 7f114599d640 1 -- 172.21.15.47:0/1768666663 >> 172.21.15.47:0/1768666663 conn(0x7f11400f6940 msgr2=0x7f11400f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:25.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.646+0000 7f114599d640 1 -- 172.21.15.47:0/1768666663 shutdown_connections 2024-02-07T12:23:25.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.646+0000 7f114599d640 1 -- 172.21.15.47:0/1768666663 wait complete. 2024-02-07T12:23:25.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.647+0000 7f114599d640 1 Processor -- start 2024-02-07T12:23:25.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.647+0000 7f114599d640 1 -- start start 2024-02-07T12:23:25.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.647+0000 7f114599d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11400fb180 0x7f114010cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:25.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.647+0000 7f114599d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11400fc450 0x7f114010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:25.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.647+0000 7f114599d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114010d6e0 con 0x7f11400fb180 2024-02-07T12:23:25.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.647+0000 7f114599d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1140112130 con 0x7f11400fc450 2024-02-07T12:23:25.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.647+0000 7f113effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11400fb180 0x7f114010cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:25.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.647+0000 7f113effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11400fb180 0x7f114010cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34148/0 (socket says 172.21.15.47:34148) 2024-02-07T12:23:25.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.647+0000 7f113effd640 1 -- 172.21.15.47:0/3140677661 learned_addr learned my addr 172.21.15.47:0/3140677661 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:25.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.647+0000 7f113effd640 1 -- 172.21.15.47:0/3140677661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11400fc450 msgr2=0x7f114010d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:25.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.647+0000 7f113effd640 1 --2- 172.21.15.47:0/3140677661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11400fc450 0x7f114010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.647+0000 7f113effd640 1 -- 172.21.15.47:0/3140677661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138005040 con 0x7f11400fb180 2024-02-07T12:23:25.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.647+0000 7f113effd640 1 --2- 172.21.15.47:0/3140677661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11400fb180 0x7f114010cb50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1138007da0 tx=0x7f1138009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:25.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.648+0000 7f11377fe640 1 -- 172.21.15.47:0/3140677661 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11380094c0 con 0x7f11400fb180 2024-02-07T12:23:25.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.648+0000 7f11377fe640 1 -- 172.21.15.47:0/3140677661 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1138009620 con 0x7f11400fb180 2024-02-07T12:23:25.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.648+0000 7f114599d640 1 -- 172.21.15.47:0/3140677661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1140112270 con 0x7f11400fb180 2024-02-07T12:23:25.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.648+0000 7f11377fe640 1 -- 172.21.15.47:0/3140677661 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f113803b620 con 0x7f11400fb180 2024-02-07T12:23:25.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.648+0000 7f114599d640 1 -- 172.21.15.47:0/3140677661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1140112760 con 0x7f11400fb180 2024-02-07T12:23:25.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.649+0000 7f114599d640 1 -- 172.21.15.47:0/3140677661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1140103cd0 con 0x7f11400fb180 2024-02-07T12:23:25.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.649+0000 7f11377fe640 1 -- 172.21.15.47:0/3140677661 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f113802f070 con 0x7f11400fb180 2024-02-07T12:23:25.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.649+0000 7f11377fe640 1 --2- 172.21.15.47:0/3140677661 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f112c068ed0 0x7f112c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:25.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.649+0000 7f11377fe640 1 -- 172.21.15.47:0/3140677661 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f11380a9460 con 0x7f11400fb180 2024-02-07T12:23:25.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.649+0000 7f113e7fc640 1 --2- 172.21.15.47:0/3140677661 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f112c068ed0 0x7f112c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:25.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.650+0000 7f113e7fc640 1 --2- 172.21.15.47:0/3140677661 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f112c068ed0 0x7f112c06b380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f114010e0a0 tx=0x7f1128009c50 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:25.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.654+0000 7f11377fe640 1 -- 172.21.15.47:0/3140677661 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1138075860 con 0x7f11400fb180 2024-02-07T12:23:25.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.861+0000 7f114599d640 1 -- 172.21.15.47:0/3140677661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11401128f0 con 0x7f11400fb180 2024-02-07T12:23:25.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.862+0000 7f11377fe640 1 -- 172.21.15.47:0/3140677661 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4725 (secure 0 0 0) 0x7f1138078e80 con 0x7f11400fb180 2024-02-07T12:23:25.865 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:23:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:23:12.341179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14460,"mds_1":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6827/3633114050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3633114050},{"type":"v1","addr":"172.21.15.47:6827","nonce":3633114050}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14472":{"gid":14472,"name":"cephfs.smithi047.jsgfge","rank":1,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6829/1833631011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1833631011},{"type":"v1","addr":"172.21.15.47:6829","nonce":1833631011}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24259":{"gid":24259,"name":"cephfs.smithi138.axpdsx","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.138:6827/3408663554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3408663554},{"type":"v1","addr":"172.21.15.138:6827","nonce":3408663554}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24263":{"gid":24263,"name":"cephfs.smithi138.jhsygn","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6825/2163008835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2163008835},{"type":"v1","addr":"172.21.15.138:6825","nonce":2163008835}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-07T12:23:25.866 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 18 2024-02-07T12:23:25.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.864+0000 7f114599d640 1 -- 172.21.15.47:0/3140677661 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f112c068ed0 msgr2=0x7f112c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:25.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.864+0000 7f114599d640 1 --2- 172.21.15.47:0/3140677661 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f112c068ed0 0x7f112c06b380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f114010e0a0 tx=0x7f1128009c50 comp rx=0 tx=0).stop 2024-02-07T12:23:25.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.864+0000 7f114599d640 1 -- 172.21.15.47:0/3140677661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11400fb180 msgr2=0x7f114010cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:25.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.864+0000 7f114599d640 1 --2- 172.21.15.47:0/3140677661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11400fb180 0x7f114010cb50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1138007da0 tx=0x7f1138009da0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.864+0000 7f114599d640 1 -- 172.21.15.47:0/3140677661 shutdown_connections 2024-02-07T12:23:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.864+0000 7f114599d640 1 --2- 172.21.15.47:0/3140677661 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f112c068ed0 0x7f112c06b380 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.864+0000 7f114599d640 1 --2- 172.21.15.47:0/3140677661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11400fc450 0x7f114010d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.864+0000 7f114599d640 1 --2- 172.21.15.47:0/3140677661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11400fb180 0x7f114010cb50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.864+0000 7f114599d640 1 -- 172.21.15.47:0/3140677661 >> 172.21.15.47:0/3140677661 conn(0x7f11400f6940 msgr2=0x7f11400656f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.864+0000 7f114599d640 1 -- 172.21.15.47:0/3140677661 shutdown_connections 2024-02-07T12:23:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:25.864+0000 7f114599d640 1 -- 172.21.15.47:0/3140677661 wait complete. 2024-02-07T12:23:25.878 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 50} 2024-02-07T12:23:25.878 INFO:teuthology.run_tasks:Running task kclient... 2024-02-07T12:23:25.942 INFO:tasks.kclient:Mounting kernel clients... 2024-02-07T12:23:25.942 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-02-07T12:23:25.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:25.942 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-02-07T12:23:25.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:25.957 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-02-07T12:23:26.027 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-02-07T12:23:26.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-07T12:23:26.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:26.029 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-02-07T12:23:26.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:26.048 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2024-02-07T12:23:26.117 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:25 smithi138 ceph-mon[35528]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.5 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-07T12:23:26.117 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:25 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/117380104' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-07T12:23:26.117 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:25 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/585869049' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-07T12:23:26.117 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:25 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/302062059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-07T12:23:26.123 INFO:teuthology.orchestra.run.smithi138.stderr:Cannot find device "ceph-brx" 2024-02-07T12:23:26.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-07T12:23:26.125 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-02-07T12:23:26.125 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-07T12:23:26.126 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-07T12:23:26.126 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph fs ls 2024-02-07T12:23:26.150 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:25 smithi047 ceph-mon[28972]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.5 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-07T12:23:26.150 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:25 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/117380104' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-07T12:23:26.150 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:25 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/585869049' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-07T12:23:26.150 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:25 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/302062059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-07T12:23:26.385 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:23:27.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:26 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3140677661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-07T12:23:27.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:26 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3140677661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-07T12:23:27.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.955+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1684881219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0981027f0 msgr2=0x7fa0980fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.955+0000 7fa0a06c9700 1 --2- 172.21.15.47:0/1684881219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0981027f0 0x7fa0980fbe60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa08c004940 tx=0x7fa08c009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.955+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1684881219 shutdown_connections 2024-02-07T12:23:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.955+0000 7fa0a06c9700 1 --2- 172.21.15.47:0/1684881219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0981027f0 0x7fa0980fbe60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.955+0000 7fa0a06c9700 1 --2- 172.21.15.47:0/1684881219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa098101e50 0x7fa098102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.955+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1684881219 >> 172.21.15.47:0/1684881219 conn(0x7fa0980f79e0 msgr2=0x7fa0980f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.955+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1684881219 shutdown_connections 2024-02-07T12:23:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.955+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1684881219 wait complete. 2024-02-07T12:23:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.956+0000 7fa0a06c9700 1 Processor -- start 2024-02-07T12:23:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.956+0000 7fa0a06c9700 1 -- start start 2024-02-07T12:23:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.956+0000 7fa0a06c9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa098101e50 0x7fa098112990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.956+0000 7fa0a06c9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0981027f0 0x7fa098112ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.956+0000 7fa0a06c9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa098113520 con 0x7fa0981027f0 2024-02-07T12:23:27.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.956+0000 7fa0a06c9700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09810c850 con 0x7fa098101e50 2024-02-07T12:23:27.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.956+0000 7fa09dc64700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0981027f0 0x7fa098112ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:27.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.956+0000 7fa09dc64700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0981027f0 0x7fa098112ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34164/0 (socket says 172.21.15.47:34164) 2024-02-07T12:23:27.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.956+0000 7fa09dc64700 1 -- 172.21.15.47:0/1641495332 learned_addr learned my addr 172.21.15.47:0/1641495332 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:27.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.956+0000 7fa09e465700 1 --2- 172.21.15.47:0/1641495332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa098101e50 0x7fa098112990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:27.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.956+0000 7fa09dc64700 1 -- 172.21.15.47:0/1641495332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa098101e50 msgr2=0x7fa098112990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:27.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.956+0000 7fa09dc64700 1 --2- 172.21.15.47:0/1641495332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa098101e50 0x7fa098112990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:27.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.956+0000 7fa09dc64700 1 -- 172.21.15.47:0/1641495332 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c005040 con 0x7fa0981027f0 2024-02-07T12:23:27.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.957+0000 7fa09dc64700 1 --2- 172.21.15.47:0/1641495332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0981027f0 0x7fa098112ed0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0090d0 tx=0x7fa08c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:27.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.957+0000 7fa096ffd700 1 -- 172.21.15.47:0/1641495332 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa08c00e040 con 0x7fa0981027f0 2024-02-07T12:23:27.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.957+0000 7fa096ffd700 1 -- 172.21.15.47:0/1641495332 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa08c00bbf0 con 0x7fa0981027f0 2024-02-07T12:23:27.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.957+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1641495332 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09810cad0 con 0x7fa0981027f0 2024-02-07T12:23:27.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.957+0000 7fa096ffd700 1 -- 172.21.15.47:0/1641495332 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa08c01c630 con 0x7fa0981027f0 2024-02-07T12:23:27.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.957+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1641495332 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09810d010 con 0x7fa0981027f0 2024-02-07T12:23:27.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.958+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1641495332 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa098104320 con 0x7fa0981027f0 2024-02-07T12:23:27.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.958+0000 7fa096ffd700 1 -- 172.21.15.47:0/1641495332 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa08c00bd60 con 0x7fa0981027f0 2024-02-07T12:23:27.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.959+0000 7fa096ffd700 1 --2- 172.21.15.47:0/1641495332 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa080068f60 0x7fa08006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:27.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.959+0000 7fa09e465700 1 --2- 172.21.15.47:0/1641495332 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa080068f60 0x7fa08006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:27.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.959+0000 7fa096ffd700 1 -- 172.21.15.47:0/1641495332 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa08c088150 con 0x7fa0981027f0 2024-02-07T12:23:27.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.959+0000 7fa09e465700 1 --2- 172.21.15.47:0/1641495332 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa080068f60 0x7fa08006b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa088004550 tx=0x7fa088009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:27.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:27.963+0000 7fa096ffd700 1 -- 172.21.15.47:0/1641495332 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa08c058110 con 0x7fa0981027f0 2024-02-07T12:23:28.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:27 smithi047 ceph-mon[28972]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-07T12:23:28.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:28.199+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1641495332 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa098064b00 con 0x7fa0981027f0 2024-02-07T12:23:28.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:28.199+0000 7fa096ffd700 1 -- 172.21.15.47:0/1641495332 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7fa08c013e60 con 0x7fa0981027f0 2024-02-07T12:23:28.203 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-07T12:23:28.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:28.201+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1641495332 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa080068f60 msgr2=0x7fa08006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:28.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:28.201+0000 7fa0a06c9700 1 --2- 172.21.15.47:0/1641495332 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa080068f60 0x7fa08006b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa088004550 tx=0x7fa088009040 comp rx=0 tx=0).stop 2024-02-07T12:23:28.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:28.201+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1641495332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0981027f0 msgr2=0x7fa098112ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:28.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:28.201+0000 7fa0a06c9700 1 --2- 172.21.15.47:0/1641495332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0981027f0 0x7fa098112ed0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0090d0 tx=0x7fa08c009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:28.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:28.201+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1641495332 shutdown_connections 2024-02-07T12:23:28.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:28.201+0000 7fa0a06c9700 1 --2- 172.21.15.47:0/1641495332 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fa080068f60 0x7fa08006b410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:28.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:28.201+0000 7fa0a06c9700 1 --2- 172.21.15.47:0/1641495332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa098101e50 0x7fa098112990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:28.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:28.201+0000 7fa0a06c9700 1 --2- 172.21.15.47:0/1641495332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0981027f0 0x7fa098112ed0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:28.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:28.201+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1641495332 >> 172.21.15.47:0/1641495332 conn(0x7fa0980f79e0 msgr2=0x7fa0980f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:28.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:28.201+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1641495332 shutdown_connections 2024-02-07T12:23:28.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:28.201+0000 7fa0a06c9700 1 -- 172.21.15.47:0/1641495332 wait complete. 2024-02-07T12:23:28.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:27 smithi138 ceph-mon[35528]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-07T12:23:28.873 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-07T12:23:28.874 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-07T12:23:28.874 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-02-07T12:23:28.874 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-07T12:23:28.874 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-07T12:23:28.874 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-07T12:23:28.874 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-07T12:23:28.874 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-07T12:23:28.874 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-07T12:23:28.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:28.874 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-02-07T12:23:28.930 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-07T12:23:28.930 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-07T12:23:28.931 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-02-07T12:23:28.931 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-02-07T12:23:28.931 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-02-07T12:23:28.931 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-02-07T12:23:28.931 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-07T12:23:28.931 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-02-07T12:23:28.931 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-02-07T12:23:28.931 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-07T12:23:28.931 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-02-07T12:23:28.931 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-02-07T12:23:28.931 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-07T12:23:28.931 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-02-07T12:23:28.931 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-02-07T12:23:28.932 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-07T12:23:28.932 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42287sec preferred_lft 42287sec 2024-02-07T12:23:28.932 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-02-07T12:23:28.932 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-02-07T12:23:28.932 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-07T12:23:28.932 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-02-07T12:23:28.932 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-02-07T12:23:28.932 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-07T12:23:28.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:28.933 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-02-07T12:23:28.933 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-02-07T12:23:28.933 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-02-07T12:23:28.933 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-02-07T12:23:28.933 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-02-07T12:23:28.933 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-07T12:23:28.933 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-02-07T12:23:29.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:29.095 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-07T12:23:29.107 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:28 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1641495332' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-07T12:23:29.122 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-02-07T12:23:29.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:29.124 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-02-07T12:23:29.199 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-02-07T12:23:29.199 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-07T12:23:29.199 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-07T12:23:29.199 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-07T12:23:29.199 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-07T12:23:29.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:29.200 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-02-07T12:23:29.200 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-02-07T12:23:29.200 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-07T12:23:29.200 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-07T12:23:29.200 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-07T12:23:29.200 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-02-07T12:23:29.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:28 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/1641495332' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-07T12:23:29.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:29.482 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-02-07T12:23:29.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:29.497 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-02-07T12:23:29.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:29.552 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-02-07T12:23:29.552 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-02-07T12:23:29.552 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-07T12:23:29.552 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-07T12:23:29.552 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-02-07T12:23:29.634 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-07T12:23:29.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:29.634 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-02-07T12:23:29.634 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-02-07T12:23:29.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-07T12:23:29.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-07T12:23:29.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-07T12:23:29.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-07T12:23:29.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-07T12:23:29.635 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-02-07T12:23:29.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:29.786 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-02-07T12:23:29.786 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-02-07T12:23:29.786 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-02-07T12:23:29.786 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-02-07T12:23:29.786 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-02-07T12:23:29.827 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-07T12:23:29.827 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-07T12:23:29.882 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-07T12:23:29.882 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-07T12:23:29.882 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-07T12:23:29.936 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-07T12:23:29.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:29.936 DEBUG:teuthology.orchestra.run.smithi047:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-07T12:23:29.999 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:29 smithi047 ceph-mon[28972]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:23:30.029 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-07T12:23:30.029 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-07T12:23:30.029 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-02-07T12:23:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-07T12:23:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-07T12:23:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-02-07T12:23:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.138:3300" 2024-02-07T12:23:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-07T12:23:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-07T12:23:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-07T12:23:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-02-07T12:23:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.138:3300" 2024-02-07T12:23:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-07T12:23:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:6789,172.21.15.138:6789" 2024-02-07T12:23:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.47:6789,172.21.15.138:6789:/ 2024-02-07T12:23:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=818049ec-c5b2-11ee-95b6-87774f69a715" will pass to kernel 2024-02-07T12:23:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-07T12:23:30.152 INFO:teuthology.orchestra.run.smithi047.stdout: You just mounted a file system that supports labels which does not 2024-02-07T12:23:30.152 INFO:teuthology.orchestra.run.smithi047.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-07T12:23:30.152 INFO:teuthology.orchestra.run.smithi047.stdout: applications will generate AVC messages and not be allowed access to 2024-02-07T12:23:30.152 INFO:teuthology.orchestra.run.smithi047.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-07T12:23:30.153 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-07T12:23:30.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:30.154 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-07T12:23:30.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:30.221 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-07T12:23:30.281 INFO:teuthology.orchestra.run.smithi047.stdout:client14524 2024-02-07T12:23:30.281 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:23:30.281 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-07T12:23:30.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:29 smithi138 ceph-mon[35528]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:23:30.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:30.337 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-07T12:23:30.397 INFO:teuthology.orchestra.run.smithi047.stdout:client14524 2024-02-07T12:23:30.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:30.398 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-07T12:23:30.457 INFO:teuthology.orchestra.run.smithi047.stdout:client14524 2024-02-07T12:23:30.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:30.458 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/818049ec-c5b2-11ee-95b6-87774f69a715.client14524/status') 2024-02-07T12:23:30.527 INFO:teuthology.orchestra.run.smithi047.stdout:instance: client.14524 (3)192.168.0.1:0/1195374876 2024-02-07T12:23:30.528 INFO:teuthology.orchestra.run.smithi047.stdout:blocklisted: false 2024-02-07T12:23:30.528 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records in 2024-02-07T12:23:30.528 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records out 2024-02-07T12:23:30.528 INFO:teuthology.orchestra.run.smithi047.stderr:70 bytes copied, 2.0067e-05 s, 3.5 MB/s 2024-02-07T12:23:30.529 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-02-07T12:23:30.529 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-07T12:23:30.529 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-07T12:23:30.529 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- ceph fs ls 2024-02-07T12:23:30.832 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:23:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:31 smithi047 ceph-mon[28972]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:23:31.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:31 smithi138 ceph-mon[35528]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:23:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.518+0000 7ff9c74da700 1 -- 172.21.15.47:0/3330168862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9c0102fe0 msgr2=0x7ff9c01033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.518+0000 7ff9c74da700 1 --2- 172.21.15.47:0/3330168862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9c0102fe0 0x7ff9c01033b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc004940 tx=0x7ff9bc009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.519+0000 7ff9c74da700 1 -- 172.21.15.47:0/3330168862 shutdown_connections 2024-02-07T12:23:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.519+0000 7ff9c74da700 1 --2- 172.21.15.47:0/3330168862 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c00fb560 0x7ff9c00fb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.519+0000 7ff9c74da700 1 --2- 172.21.15.47:0/3330168862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9c0102fe0 0x7ff9c01033b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.519+0000 7ff9c74da700 1 -- 172.21.15.47:0/3330168862 >> 172.21.15.47:0/3330168862 conn(0x7ff9c0071500 msgr2=0x7ff9c0071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.519+0000 7ff9c74da700 1 -- 172.21.15.47:0/3330168862 shutdown_connections 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.519+0000 7ff9c74da700 1 -- 172.21.15.47:0/3330168862 wait complete. 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.519+0000 7ff9c74da700 1 Processor -- start 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.519+0000 7ff9c74da700 1 -- start start 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.519+0000 7ff9c74da700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9c00fb560 0x7ff9c00fc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.519+0000 7ff9c74da700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c0102fe0 0x7ff9c00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.519+0000 7ff9c74da700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c00fd280 con 0x7ff9c00fb560 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.519+0000 7ff9c74da700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c00fd3f0 con 0x7ff9c0102fe0 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.520+0000 7ff9c5276700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9c00fb560 0x7ff9c00fc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.520+0000 7ff9c5276700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9c00fb560 0x7ff9c00fc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54912/0 (socket says 172.21.15.47:54912) 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.520+0000 7ff9c5276700 1 -- 172.21.15.47:0/3486909156 learned_addr learned my addr 172.21.15.47:0/3486909156 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.520+0000 7ff9c4a75700 1 --2- 172.21.15.47:0/3486909156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c0102fe0 0x7ff9c00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.520+0000 7ff9c5276700 1 -- 172.21.15.47:0/3486909156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c0102fe0 msgr2=0x7ff9c00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.520+0000 7ff9c5276700 1 --2- 172.21.15.47:0/3486909156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c0102fe0 0x7ff9c00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.520+0000 7ff9c5276700 1 -- 172.21.15.47:0/3486909156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc005040 con 0x7ff9c00fb560 2024-02-07T12:23:32.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.520+0000 7ff9c5276700 1 --2- 172.21.15.47:0/3486909156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9c00fb560 0x7ff9c00fc740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0090d0 tx=0x7ff9bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.520+0000 7ff9b5ffb700 1 -- 172.21.15.47:0/3486909156 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9bc00e040 con 0x7ff9c00fb560 2024-02-07T12:23:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.520+0000 7ff9b5ffb700 1 -- 172.21.15.47:0/3486909156 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9bc009430 con 0x7ff9c00fb560 2024-02-07T12:23:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.520+0000 7ff9b5ffb700 1 -- 172.21.15.47:0/3486909156 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9bc01c3f0 con 0x7ff9c00fb560 2024-02-07T12:23:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.520+0000 7ff9c74da700 1 -- 172.21.15.47:0/3486909156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c0119cc0 con 0x7ff9c00fb560 2024-02-07T12:23:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.520+0000 7ff9c74da700 1 -- 172.21.15.47:0/3486909156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c011a120 con 0x7ff9c00fb560 2024-02-07T12:23:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.521+0000 7ff9c74da700 1 -- 172.21.15.47:0/3486909156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c0100290 con 0x7ff9c00fb560 2024-02-07T12:23:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.522+0000 7ff9b5ffb700 1 -- 172.21.15.47:0/3486909156 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff9bc00bbf0 con 0x7ff9c00fb560 2024-02-07T12:23:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.522+0000 7ff9b5ffb700 1 --2- 172.21.15.47:0/3486909156 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff9ac068f60 0x7ff9ac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.522+0000 7ff9b5ffb700 1 -- 172.21.15.47:0/3486909156 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff9bc0880b0 con 0x7ff9c00fb560 2024-02-07T12:23:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.522+0000 7ff9c4a75700 1 --2- 172.21.15.47:0/3486909156 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff9ac068f60 0x7ff9ac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.523+0000 7ff9c4a75700 1 --2- 172.21.15.47:0/3486909156 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff9ac068f60 0x7ff9ac06b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00fe140 tx=0x7ff9b00043c0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:32.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.527+0000 7ff9b5ffb700 1 -- 172.21.15.47:0/3486909156 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff9bc054530 con 0x7ff9c00fb560 2024-02-07T12:23:32.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.759+0000 7ff9c74da700 1 -- 172.21.15.47:0/3486909156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff9c00fd5b0 con 0x7ff9c00fb560 2024-02-07T12:23:32.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.759+0000 7ff9b5ffb700 1 -- 172.21.15.47:0/3486909156 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7ff9c00fd5b0 con 0x7ff9c00fb560 2024-02-07T12:23:32.761 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-07T12:23:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.762+0000 7ff9c74da700 1 -- 172.21.15.47:0/3486909156 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff9ac068f60 msgr2=0x7ff9ac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.762+0000 7ff9c74da700 1 --2- 172.21.15.47:0/3486909156 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff9ac068f60 0x7ff9ac06b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00fe140 tx=0x7ff9b00043c0 comp rx=0 tx=0).stop 2024-02-07T12:23:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.762+0000 7ff9c74da700 1 -- 172.21.15.47:0/3486909156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9c00fb560 msgr2=0x7ff9c00fc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.762+0000 7ff9c74da700 1 --2- 172.21.15.47:0/3486909156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9c00fb560 0x7ff9c00fc740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0090d0 tx=0x7ff9bc009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.762+0000 7ff9c74da700 1 -- 172.21.15.47:0/3486909156 shutdown_connections 2024-02-07T12:23:32.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.762+0000 7ff9c74da700 1 --2- 172.21.15.47:0/3486909156 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff9ac068f60 0x7ff9ac06b410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:32.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.762+0000 7ff9c74da700 1 --2- 172.21.15.47:0/3486909156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9c00fb560 0x7ff9c00fc740 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:32.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.762+0000 7ff9c74da700 1 --2- 172.21.15.47:0/3486909156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c0102fe0 0x7ff9c00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:32.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.762+0000 7ff9c74da700 1 -- 172.21.15.47:0/3486909156 >> 172.21.15.47:0/3486909156 conn(0x7ff9c0071500 msgr2=0x7ff9c00fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:32.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.762+0000 7ff9c74da700 1 -- 172.21.15.47:0/3486909156 shutdown_connections 2024-02-07T12:23:32.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:32.762+0000 7ff9c74da700 1 -- 172.21.15.47:0/3486909156 wait complete. 2024-02-07T12:23:33.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:32 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3486909156' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-07T12:23:33.195 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:32 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3486909156' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-07T12:23:33.450 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-07T12:23:33.450 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-07T12:23:33.450 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2024-02-07T12:23:33.450 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-07T12:23:33.450 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-07T12:23:33.450 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-07T12:23:33.450 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-07T12:23:33.450 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-07T12:23:33.451 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-07T12:23:33.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:33.451 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2024-02-07T12:23:33.470 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-07T12:23:33.470 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-07T12:23:33.470 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2024-02-07T12:23:33.470 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-02-07T12:23:33.470 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2024-02-07T12:23:33.470 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-02-07T12:23:33.470 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-07T12:23:33.470 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2024-02-07T12:23:33.470 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2024-02-07T12:23:33.470 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-07T12:23:33.470 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2024-02-07T12:23:33.470 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2024-02-07T12:23:33.471 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-07T12:23:33.471 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2024-02-07T12:23:33.471 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-07T12:23:33.471 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2024-02-07T12:23:33.471 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-07T12:23:33.471 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42287sec preferred_lft 42287sec 2024-02-07T12:23:33.471 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2024-02-07T12:23:33.471 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-02-07T12:23:33.471 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-07T12:23:33.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:33.471 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-07T12:23:33.471 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-07T12:23:33.471 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add name ceph-brx type bridge 2024-02-07T12:23:33.472 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr flush dev ceph-brx 2024-02-07T12:23:33.472 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set ceph-brx up 2024-02-07T12:23:33.472 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-07T12:23:33.472 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-07T12:23:33.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:33.680 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-07T12:23:33.708 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-02-07T12:23:33.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:33.710 DEBUG:teuthology.orchestra.run.smithi138:> route 2024-02-07T12:23:33.779 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2024-02-07T12:23:33.780 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-07T12:23:33.780 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-07T12:23:33.780 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-07T12:23:33.780 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-07T12:23:33.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:33.780 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-07T12:23:33.780 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-07T12:23:33.781 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-07T12:23:33.781 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-07T12:23:33.781 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-07T12:23:33.781 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-07T12:23:34.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:34.046 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-02-07T12:23:34.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:34.060 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list-id 2024-02-07T12:23:34.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:33 smithi047 ceph-mon[28972]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-07T12:23:34.096 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:33 smithi138 ceph-mon[35528]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-07T12:23:34.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:34.110 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-07T12:23:34.110 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-07T12:23:34.110 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-07T12:23:34.110 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-07T12:23:34.110 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-07T12:23:34.193 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-07T12:23:34.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:34.194 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-07T12:23:34.194 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-07T12:23:34.194 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-07T12:23:34.194 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-07T12:23:34.194 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-07T12:23:34.194 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-07T12:23:34.194 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-07T12:23:34.194 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-07T12:23:34.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:34.360 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-07T12:23:34.360 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-07T12:23:34.360 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2024-02-07T12:23:34.360 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set dev brx.0 master ceph-brx 2024-02-07T12:23:34.360 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-07T12:23:34.401 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-07T12:23:34.401 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-07T12:23:34.459 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-07T12:23:34.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-07T12:23:34.460 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-07T12:23:34.515 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-07T12:23:34.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:34.515 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-07T12:23:34.609 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-07T12:23:34.609 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-07T12:23:34.609 INFO:teuthology.orchestra.run.smithi138.stdout:invalid new device string format 2024-02-07T12:23:34.721 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-07T12:23:34.721 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-07T12:23:34.721 INFO:teuthology.orchestra.run.smithi138.stdout:invalid new device string format 2024-02-07T12:23:34.721 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.138:3300" 2024-02-07T12:23:34.721 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-07T12:23:34.726 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-07T12:23:34.726 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-07T12:23:34.726 INFO:teuthology.orchestra.run.smithi138.stdout:invalid new device string format 2024-02-07T12:23:34.726 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.138:3300" 2024-02-07T12:23:34.726 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-07T12:23:34.726 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.47:6789,172.21.15.138:6789" 2024-02-07T12:23:34.727 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.47:6789,172.21.15.138:6789:/ 2024-02-07T12:23:34.727 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=818049ec-c5b2-11ee-95b6-87774f69a715" will pass to kernel 2024-02-07T12:23:34.727 INFO:teuthology.orchestra.run.smithi138.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-02-07T12:23:34.727 INFO:teuthology.orchestra.run.smithi138.stdout: You just mounted a file system that supports labels which does not 2024-02-07T12:23:34.727 INFO:teuthology.orchestra.run.smithi138.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-07T12:23:34.727 INFO:teuthology.orchestra.run.smithi138.stdout: applications will generate AVC messages and not be allowed access to 2024-02-07T12:23:34.727 INFO:teuthology.orchestra.run.smithi138.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-07T12:23:34.730 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-07T12:23:34.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:34.730 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-07T12:23:34.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:34.757 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-07T12:23:34.813 INFO:teuthology.orchestra.run.smithi138.stdout:client24291 2024-02-07T12:23:34.813 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:23:34.813 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-07T12:23:34.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:34.869 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-07T12:23:34.925 INFO:teuthology.orchestra.run.smithi138.stdout:client24291 2024-02-07T12:23:34.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:34.925 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-07T12:23:34.980 INFO:teuthology.orchestra.run.smithi138.stdout:client24291 2024-02-07T12:23:34.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:23:34.981 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/818049ec-c5b2-11ee-95b6-87774f69a715.client24291/status') 2024-02-07T12:23:35.049 INFO:teuthology.orchestra.run.smithi138.stdout:instance: client.24291 (3)192.168.0.1:0/1103379993 2024-02-07T12:23:35.049 INFO:teuthology.orchestra.run.smithi138.stdout:blocklisted: false 2024-02-07T12:23:35.049 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records in 2024-02-07T12:23:35.049 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records out 2024-02-07T12:23:35.049 INFO:teuthology.orchestra.run.smithi138.stderr:70 bytes copied, 2.1699e-05 s, 3.2 MB/s 2024-02-07T12:23:35.050 INFO:teuthology.run_tasks:Running task print... 2024-02-07T12:23:35.060 INFO:teuthology.task.print:**** done client 2024-02-07T12:23:35.060 INFO:teuthology.run_tasks:Running task parallel... 2024-02-07T12:23:35.070 INFO:teuthology.task.parallel:starting parallel... 2024-02-07T12:23:35.070 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-07T12:23:35.071 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-07T12:23:35.071 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:23:35.071 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-02-07T12:23:35.072 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-07T12:23:35.072 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-07T12:23:35.075 INFO:tasks.workunit:Pulling workunits from ref 44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:23:35.076 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-07T12:23:35.076 INFO:tasks.workunit:timeout=3h 2024-02-07T12:23:35.076 INFO:tasks.workunit:cleanup=True 2024-02-07T12:23:35.076 DEBUG:teuthology.orchestra.run.smithi047:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-07T12:23:35.096 INFO:teuthology.orchestra.run.smithi047.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-07T12:23:35.096 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-02-07T12:23:35.096 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 94h/148d Inode: 1 Links: 2 2024-02-07T12:23:35.096 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-07T12:23:35.096 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-07T12:23:35.096 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-07T12:23:35.096 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-02-07 12:22:58.020298230 +0000 2024-02-07T12:23:35.096 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-02-07 12:23:30.212794864 +0000 2024-02-07T12:23:35.097 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-02-07 12:22:58.020298230 +0000 2024-02-07T12:23:35.097 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-07T12:23:35.097 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-07T12:23:35.170 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-07T12:23:35.187 INFO:teuthology.orchestra.run.smithi138.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-07T12:23:35.187 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-02-07T12:23:35.187 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 73h/115d Inode: 1 Links: 3 2024-02-07T12:23:35.187 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-07T12:23:35.187 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-07T12:23:35.187 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-07T12:23:35.187 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-07 12:23:35.162692185 +0000 2024-02-07T12:23:35.187 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-07 12:23:35.162692185 +0000 2024-02-07T12:23:35.187 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-02-07 12:22:58.020298230 +0000 2024-02-07T12:23:35.188 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-07T12:23:35.188 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-07T12:23:35.261 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:23:35.262 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:23:35.276 INFO:tasks.workunit.client.0.smithi047.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-07T12:23:35.316 INFO:tasks.workunit.client.1.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-07T12:23:35.357 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:23:36.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:35 smithi047 ceph-mon[28972]: pgmap v199: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-02-07T12:23:36.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:35 smithi138 ceph-mon[35528]: pgmap v199: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-02-07T12:23:37.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.997+0000 7f127003d700 1 -- 172.21.15.47:0/1806665900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12680fda80 msgr2=0x7f12680ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:37.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.997+0000 7f127003d700 1 --2- 172.21.15.47:0/1806665900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12680fda80 0x7f12680ffe60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1260004940 tx=0x7f1260009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:37.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.997+0000 7f127003d700 1 -- 172.21.15.47:0/1806665900 shutdown_connections 2024-02-07T12:23:37.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.997+0000 7f127003d700 1 --2- 172.21.15.47:0/1806665900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f12681003a0 0x7f1268102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:37.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.997+0000 7f127003d700 1 --2- 172.21.15.47:0/1806665900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12680fda80 0x7f12680ffe60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:37.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.997+0000 7f127003d700 1 -- 172.21.15.47:0/1806665900 >> 172.21.15.47:0/1806665900 conn(0x7f12680f74e0 msgr2=0x7f12680f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:37.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.997+0000 7f127003d700 1 -- 172.21.15.47:0/1806665900 shutdown_connections 2024-02-07T12:23:37.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.997+0000 7f127003d700 1 -- 172.21.15.47:0/1806665900 wait complete. 2024-02-07T12:23:37.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.997+0000 7f127003d700 1 Processor -- start 2024-02-07T12:23:37.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.997+0000 7f127003d700 1 -- start start 2024-02-07T12:23:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.998+0000 7f127003d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f12680fda80 0x7f126810d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.998+0000 7f127003d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12681003a0 0x7f126810de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.998+0000 7f127003d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126810e470 con 0x7f12681003a0 2024-02-07T12:23:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.998+0000 7f127003d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126810ed10 con 0x7f12680fda80 2024-02-07T12:23:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.998+0000 7f126d5d8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12681003a0 0x7f126810de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.998+0000 7f126d5d8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12681003a0 0x7f126810de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54930/0 (socket says 172.21.15.47:54930) 2024-02-07T12:23:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.998+0000 7f126d5d8700 1 -- 172.21.15.47:0/586621563 learned_addr learned my addr 172.21.15.47:0/586621563 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.998+0000 7f126ddd9700 1 --2- 172.21.15.47:0/586621563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f12680fda80 0x7f126810d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.998+0000 7f126d5d8700 1 -- 172.21.15.47:0/586621563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f12680fda80 msgr2=0x7f126810d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.998+0000 7f126d5d8700 1 --2- 172.21.15.47:0/586621563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f12680fda80 0x7f126810d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.998+0000 7f126d5d8700 1 -- 172.21.15.47:0/586621563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1260005040 con 0x7f12681003a0 2024-02-07T12:23:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.998+0000 7f126d5d8700 1 --2- 172.21.15.47:0/586621563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12681003a0 0x7f126810de70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f125c00c8c0 tx=0x7f125c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.998+0000 7f12667fc700 1 -- 172.21.15.47:0/586621563 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f125c00a760 con 0x7f12681003a0 2024-02-07T12:23:37.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.999+0000 7f127003d700 1 -- 172.21.15.47:0/586621563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126810eff0 con 0x7f12681003a0 2024-02-07T12:23:37.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.999+0000 7f127003d700 1 -- 172.21.15.47:0/586621563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126810f530 con 0x7f12681003a0 2024-02-07T12:23:37.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.999+0000 7f12667fc700 1 -- 172.21.15.47:0/586621563 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f125c00ad90 con 0x7f12681003a0 2024-02-07T12:23:37.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:36.999+0000 7f12667fc700 1 -- 172.21.15.47:0/586621563 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f125c012400 con 0x7f12681003a0 2024-02-07T12:23:37.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:37.000+0000 7f127003d700 1 -- 172.21.15.47:0/586621563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12540052e0 con 0x7f12681003a0 2024-02-07T12:23:37.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:37.000+0000 7f12667fc700 1 -- 172.21.15.47:0/586621563 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f125c00a8c0 con 0x7f12681003a0 2024-02-07T12:23:37.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:37.000+0000 7f12667fc700 1 --2- 172.21.15.47:0/586621563 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f1250068f60 0x7f125006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:37.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:37.001+0000 7f12667fc700 1 -- 172.21.15.47:0/586621563 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f125c086cc0 con 0x7f12681003a0 2024-02-07T12:23:37.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:37.001+0000 7f126ddd9700 1 --2- 172.21.15.47:0/586621563 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f1250068f60 0x7f125006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:37.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:37.001+0000 7f126ddd9700 1 --2- 172.21.15.47:0/586621563 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f1250068f60 0x7f125006b410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f126000b3b0 tx=0x7f1260009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:37.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:37.005+0000 7f12667fc700 1 -- 172.21.15.47:0/586621563 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f125c056c70 con 0x7f12681003a0 2024-02-07T12:23:37.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:36 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:23:37.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:37.196+0000 7f127003d700 1 -- 172.21.15.47:0/586621563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f1254005b10 con 0x7f12681003a0 2024-02-07T12:23:37.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:37.197+0000 7f12667fc700 1 -- 172.21.15.47:0/586621563 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f125c056800 con 0x7f12681003a0 2024-02-07T12:23:37.201 INFO:teuthology.orchestra.run.smithi047.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-02-07T12:23:37.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:36 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:23:37.815 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-07T12:23:37.815 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:23:37.815 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-07T12:23:38.125 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:23:38.246 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:37 smithi047 ceph-mon[28972]: pgmap v200: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-07T12:23:38.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:37 smithi138 ceph-mon[35528]: pgmap v200: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-07T12:23:39.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.895+0000 7f854645b700 1 -- 172.21.15.47:0/3044347229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85400fe0e0 msgr2=0x7f85400fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:39.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.895+0000 7f854645b700 1 --2- 172.21.15.47:0/3044347229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85400fe0e0 0x7f85400fe550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8534004940 tx=0x7f8534009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:39.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.895+0000 7f854645b700 1 -- 172.21.15.47:0/3044347229 shutdown_connections 2024-02-07T12:23:39.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.895+0000 7f854645b700 1 --2- 172.21.15.47:0/3044347229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85400fe0e0 0x7f85400fe550 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:39.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.895+0000 7f854645b700 1 --2- 172.21.15.47:0/3044347229 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85400fcef0 0x7f85400fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.895+0000 7f854645b700 1 -- 172.21.15.47:0/3044347229 >> 172.21.15.47:0/3044347229 conn(0x7f85400f8620 msgr2=0x7f85400faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.895+0000 7f854645b700 1 -- 172.21.15.47:0/3044347229 shutdown_connections 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.895+0000 7f854645b700 1 -- 172.21.15.47:0/3044347229 wait complete. 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.895+0000 7f854645b700 1 Processor -- start 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f854645b700 1 -- start start 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f854645b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85400fcef0 0x7f854010d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f854645b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85400fe0e0 0x7f854010dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f854645b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854010e4a0 con 0x7f85400fe0e0 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f854645b700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854010ed40 con 0x7f85400fcef0 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85400fe0e0 0x7f854010dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85400fe0e0 0x7f854010dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42028/0 (socket says 172.21.15.47:42028) 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f853f7fe700 1 -- 172.21.15.47:0/1712100730 learned_addr learned my addr 172.21.15.47:0/1712100730 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f853ffff700 1 --2- 172.21.15.47:0/1712100730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85400fcef0 0x7f854010d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f853f7fe700 1 -- 172.21.15.47:0/1712100730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85400fcef0 msgr2=0x7f854010d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f853f7fe700 1 --2- 172.21.15.47:0/1712100730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85400fcef0 0x7f854010d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f853f7fe700 1 -- 172.21.15.47:0/1712100730 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8534005040 con 0x7f85400fe0e0 2024-02-07T12:23:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f853f7fe700 1 --2- 172.21.15.47:0/1712100730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85400fe0e0 0x7f854010dea0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f85340093b0 tx=0x7f8534009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.896+0000 7f853cff9700 1 -- 172.21.15.47:0/1712100730 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f853400e040 con 0x7f85400fe0e0 2024-02-07T12:23:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.897+0000 7f854645b700 1 -- 172.21.15.47:0/1712100730 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854010efc0 con 0x7f85400fe0e0 2024-02-07T12:23:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.897+0000 7f853cff9700 1 -- 172.21.15.47:0/1712100730 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f853400bcc0 con 0x7f85400fe0e0 2024-02-07T12:23:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.897+0000 7f853cff9700 1 -- 172.21.15.47:0/1712100730 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f853401c630 con 0x7f85400fe0e0 2024-02-07T12:23:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.897+0000 7f854645b700 1 -- 172.21.15.47:0/1712100730 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854010f500 con 0x7f85400fe0e0 2024-02-07T12:23:39.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.898+0000 7f854645b700 1 -- 172.21.15.47:0/1712100730 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854004bed0 con 0x7f85400fe0e0 2024-02-07T12:23:39.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.898+0000 7f853cff9700 1 -- 172.21.15.47:0/1712100730 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8534013980 con 0x7f85400fe0e0 2024-02-07T12:23:39.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.898+0000 7f853cff9700 1 --2- 172.21.15.47:0/1712100730 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8528068f60 0x7f852806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:39.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.899+0000 7f853cff9700 1 -- 172.21.15.47:0/1712100730 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8534088070 con 0x7f85400fe0e0 2024-02-07T12:23:39.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.899+0000 7f853ffff700 1 --2- 172.21.15.47:0/1712100730 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8528068f60 0x7f852806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:39.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.899+0000 7f853ffff700 1 --2- 172.21.15.47:0/1712100730 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8528068f60 0x7f852806b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f85400fcc30 tx=0x7f8530009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:39.903+0000 7f853cff9700 1 -- 172.21.15.47:0/1712100730 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8534058020 con 0x7f85400fe0e0 2024-02-07T12:23:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:40.095+0000 7f854645b700 1 -- 172.21.15.47:0/1712100730 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f8540105a30 con 0x7f85400fe0e0 2024-02-07T12:23:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:40.095+0000 7f853cff9700 1 -- 172.21.15.47:0/1712100730 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f8534052e60 con 0x7f85400fe0e0 2024-02-07T12:23:40.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:40.097+0000 7f854645b700 1 -- 172.21.15.47:0/1712100730 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8528068f60 msgr2=0x7f852806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:40.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:40.097+0000 7f854645b700 1 --2- 172.21.15.47:0/1712100730 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8528068f60 0x7f852806b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f85400fcc30 tx=0x7f8530009040 comp rx=0 tx=0).stop 2024-02-07T12:23:40.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:40.097+0000 7f854645b700 1 -- 172.21.15.47:0/1712100730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85400fe0e0 msgr2=0x7f854010dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:40.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:40.097+0000 7f854645b700 1 --2- 172.21.15.47:0/1712100730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85400fe0e0 0x7f854010dea0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f85340093b0 tx=0x7f8534009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:40.097+0000 7f854645b700 1 -- 172.21.15.47:0/1712100730 shutdown_connections 2024-02-07T12:23:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:40.097+0000 7f854645b700 1 --2- 172.21.15.47:0/1712100730 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8528068f60 0x7f852806b410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:40.097+0000 7f854645b700 1 --2- 172.21.15.47:0/1712100730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85400fcef0 0x7f854010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:40.097+0000 7f854645b700 1 --2- 172.21.15.47:0/1712100730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85400fe0e0 0x7f854010dea0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:40.097+0000 7f854645b700 1 -- 172.21.15.47:0/1712100730 >> 172.21.15.47:0/1712100730 conn(0x7f85400f8620 msgr2=0x7f85401013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:40.097+0000 7f854645b700 1 -- 172.21.15.47:0/1712100730 shutdown_connections 2024-02-07T12:23:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:40.097+0000 7f854645b700 1 -- 172.21.15.47:0/1712100730 wait complete. 2024-02-07T12:23:40.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:39 smithi138 ceph-mon[35528]: pgmap v201: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-07T12:23:40.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:39 smithi047 ceph-mon[28972]: pgmap v201: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-07T12:23:40.804 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-07T12:23:41.069 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:23:41.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:41 smithi047 ceph-mon[28972]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-02-07T12:23:41.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:41 smithi138 ceph-mon[35528]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-02-07T12:23:42.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.824+0000 7f055998f700 1 -- 172.21.15.47:0/2158396575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05540fe1f0 msgr2=0x7f05540fe660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:42.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.824+0000 7f055998f700 1 --2- 172.21.15.47:0/2158396575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05540fe1f0 0x7f05540fe660 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0548004940 tx=0x7f0548009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:42.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.824+0000 7f055998f700 1 -- 172.21.15.47:0/2158396575 shutdown_connections 2024-02-07T12:23:42.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.824+0000 7f055998f700 1 --2- 172.21.15.47:0/2158396575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05540fe1f0 0x7f05540fe660 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:42.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.824+0000 7f055998f700 1 --2- 172.21.15.47:0/2158396575 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05540fcf40 0x7f05540fd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:42.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.824+0000 7f055998f700 1 -- 172.21.15.47:0/2158396575 >> 172.21.15.47:0/2158396575 conn(0x7f05540f8680 msgr2=0x7f05540faad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:42.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.824+0000 7f055998f700 1 -- 172.21.15.47:0/2158396575 shutdown_connections 2024-02-07T12:23:42.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.824+0000 7f055998f700 1 -- 172.21.15.47:0/2158396575 wait complete. 2024-02-07T12:23:42.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.825+0000 7f055998f700 1 Processor -- start 2024-02-07T12:23:42.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.825+0000 7f055998f700 1 -- start start 2024-02-07T12:23:42.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.825+0000 7f055998f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05540fcf40 0x7f055410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.825+0000 7f055998f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05540fe1f0 0x7f055410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.825+0000 7f055998f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055410e4b0 con 0x7f05540fe1f0 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.825+0000 7f055998f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055410ed50 con 0x7f05540fcf40 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.825+0000 7f05527fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05540fe1f0 0x7f055410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.825+0000 7f05527fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05540fe1f0 0x7f055410deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42058/0 (socket says 172.21.15.47:42058) 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.825+0000 7f05527fc700 1 -- 172.21.15.47:0/356208828 learned_addr learned my addr 172.21.15.47:0/356208828 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.825+0000 7f0552ffd700 1 --2- 172.21.15.47:0/356208828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05540fcf40 0x7f055410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.826+0000 7f05527fc700 1 -- 172.21.15.47:0/356208828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05540fcf40 msgr2=0x7f055410d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.826+0000 7f05527fc700 1 --2- 172.21.15.47:0/356208828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05540fcf40 0x7f055410d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.826+0000 7f05527fc700 1 -- 172.21.15.47:0/356208828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548005040 con 0x7f05540fe1f0 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.826+0000 7f05527fc700 1 --2- 172.21.15.47:0/356208828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05540fe1f0 0x7f055410deb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f05480093b0 tx=0x7f0548009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.826+0000 7f053b7fe700 1 -- 172.21.15.47:0/356208828 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f054800e040 con 0x7f05540fe1f0 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.826+0000 7f053b7fe700 1 -- 172.21.15.47:0/356208828 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f054800bcc0 con 0x7f05540fe1f0 2024-02-07T12:23:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.826+0000 7f055998f700 1 -- 172.21.15.47:0/356208828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055410efd0 con 0x7f05540fe1f0 2024-02-07T12:23:42.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.826+0000 7f053b7fe700 1 -- 172.21.15.47:0/356208828 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f054801c630 con 0x7f05540fe1f0 2024-02-07T12:23:42.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.826+0000 7f055998f700 1 -- 172.21.15.47:0/356208828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055410f510 con 0x7f05540fe1f0 2024-02-07T12:23:42.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.827+0000 7f055998f700 1 -- 172.21.15.47:0/356208828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055404bed0 con 0x7f05540fe1f0 2024-02-07T12:23:42.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.828+0000 7f053b7fe700 1 -- 172.21.15.47:0/356208828 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0548013980 con 0x7f05540fe1f0 2024-02-07T12:23:42.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.828+0000 7f053b7fe700 1 --2- 172.21.15.47:0/356208828 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f053c068f60 0x7f053c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:42.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.828+0000 7f053b7fe700 1 -- 172.21.15.47:0/356208828 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0548088070 con 0x7f05540fe1f0 2024-02-07T12:23:42.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.828+0000 7f0552ffd700 1 --2- 172.21.15.47:0/356208828 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f053c068f60 0x7f053c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:42.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.828+0000 7f0552ffd700 1 --2- 172.21.15.47:0/356208828 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f053c068f60 0x7f053c06b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0544007fd0 tx=0x7f0544009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:42.833+0000 7f053b7fe700 1 -- 172.21.15.47:0/356208828 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0548058020 con 0x7f05540fe1f0 2024-02-07T12:23:43.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:43.026+0000 7f055998f700 1 -- 172.21.15.47:0/356208828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f0554105a30 con 0x7f05540fe1f0 2024-02-07T12:23:43.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:43.026+0000 7f053b7fe700 1 -- 172.21.15.47:0/356208828 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f0548052e60 con 0x7f05540fe1f0 2024-02-07T12:23:43.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:43.028+0000 7f055998f700 1 -- 172.21.15.47:0/356208828 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f053c068f60 msgr2=0x7f053c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:43.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:43.028+0000 7f055998f700 1 --2- 172.21.15.47:0/356208828 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f053c068f60 0x7f053c06b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0544007fd0 tx=0x7f0544009040 comp rx=0 tx=0).stop 2024-02-07T12:23:43.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:43.028+0000 7f055998f700 1 -- 172.21.15.47:0/356208828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05540fe1f0 msgr2=0x7f055410deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:43.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:43.028+0000 7f055998f700 1 --2- 172.21.15.47:0/356208828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05540fe1f0 0x7f055410deb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f05480093b0 tx=0x7f0548009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:43.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:43.028+0000 7f055998f700 1 -- 172.21.15.47:0/356208828 shutdown_connections 2024-02-07T12:23:43.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:43.028+0000 7f055998f700 1 --2- 172.21.15.47:0/356208828 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f053c068f60 0x7f053c06b410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:43.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:43.028+0000 7f055998f700 1 --2- 172.21.15.47:0/356208828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05540fcf40 0x7f055410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:43.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:43.028+0000 7f055998f700 1 --2- 172.21.15.47:0/356208828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05540fe1f0 0x7f055410deb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:43.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:43.028+0000 7f055998f700 1 -- 172.21.15.47:0/356208828 >> 172.21.15.47:0/356208828 conn(0x7f05540f8680 msgr2=0x7f0554101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:43.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:43.029+0000 7f055998f700 1 -- 172.21.15.47:0/356208828 shutdown_connections 2024-02-07T12:23:43.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:43.029+0000 7f055998f700 1 -- 172.21.15.47:0/356208828 wait complete. 2024-02-07T12:23:43.758 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-07T12:23:44.020 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:23:44.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:43 smithi047 ceph-mon[28972]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-02-07T12:23:44.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:43 smithi138 ceph-mon[35528]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-02-07T12:23:45.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 -- 172.21.15.47:0/1110870953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77ac0fe0e0 msgr2=0x7f77ac0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:45.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 --2- 172.21.15.47:0/1110870953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77ac0fe0e0 0x7f77ac0fe550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f779c004940 tx=0x7f779c009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:45.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 -- 172.21.15.47:0/1110870953 shutdown_connections 2024-02-07T12:23:45.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 --2- 172.21.15.47:0/1110870953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77ac0fe0e0 0x7f77ac0fe550 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:45.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 --2- 172.21.15.47:0/1110870953 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77ac0fcef0 0x7f77ac0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:45.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 -- 172.21.15.47:0/1110870953 >> 172.21.15.47:0/1110870953 conn(0x7f77ac0f8620 msgr2=0x7f77ac0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:45.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 -- 172.21.15.47:0/1110870953 shutdown_connections 2024-02-07T12:23:45.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 -- 172.21.15.47:0/1110870953 wait complete. 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 Processor -- start 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 -- start start 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77ac0fcef0 0x7f77ac071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77ac0fe0e0 0x7f77ac0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac0708e0 con 0x7f77ac0fe0e0 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.779+0000 7f77b44df700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac070a50 con 0x7f77ac0fcef0 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.780+0000 7f77b1a7a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77ac0fe0e0 0x7f77ac0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.780+0000 7f77b1a7a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77ac0fe0e0 0x7f77ac0702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42072/0 (socket says 172.21.15.47:42072) 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.780+0000 7f77b1a7a700 1 -- 172.21.15.47:0/3394402867 learned_addr learned my addr 172.21.15.47:0/3394402867 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.780+0000 7f77b227b700 1 --2- 172.21.15.47:0/3394402867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77ac0fcef0 0x7f77ac071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.780+0000 7f77b1a7a700 1 -- 172.21.15.47:0/3394402867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77ac0fcef0 msgr2=0x7f77ac071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.780+0000 7f77b1a7a700 1 --2- 172.21.15.47:0/3394402867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77ac0fcef0 0x7f77ac071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.780+0000 7f77b1a7a700 1 -- 172.21.15.47:0/3394402867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c005040 con 0x7f77ac0fe0e0 2024-02-07T12:23:45.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.780+0000 7f77b1a7a700 1 --2- 172.21.15.47:0/3394402867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77ac0fe0e0 0x7f77ac0702e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f779c0093b0 tx=0x7f779c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:45.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.780+0000 7f77a2ffd700 1 -- 172.21.15.47:0/3394402867 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f779c00e040 con 0x7f77ac0fe0e0 2024-02-07T12:23:45.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.780+0000 7f77b44df700 1 -- 172.21.15.47:0/3394402867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ac070cd0 con 0x7f77ac0fe0e0 2024-02-07T12:23:45.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.780+0000 7f77a2ffd700 1 -- 172.21.15.47:0/3394402867 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f779c00bcc0 con 0x7f77ac0fe0e0 2024-02-07T12:23:45.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.780+0000 7f77a2ffd700 1 -- 172.21.15.47:0/3394402867 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f779c01c630 con 0x7f77ac0fe0e0 2024-02-07T12:23:45.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.780+0000 7f77b44df700 1 -- 172.21.15.47:0/3394402867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ac115990 con 0x7f77ac0fe0e0 2024-02-07T12:23:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.781+0000 7f77b44df700 1 -- 172.21.15.47:0/3394402867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ac04bed0 con 0x7f77ac0fe0e0 2024-02-07T12:23:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.782+0000 7f77a2ffd700 1 -- 172.21.15.47:0/3394402867 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f779c013980 con 0x7f77ac0fe0e0 2024-02-07T12:23:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.782+0000 7f77a2ffd700 1 --2- 172.21.15.47:0/3394402867 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7798068f60 0x7f779806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.782+0000 7f77a2ffd700 1 -- 172.21.15.47:0/3394402867 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f779c088170 con 0x7f77ac0fe0e0 2024-02-07T12:23:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.782+0000 7f77b227b700 1 --2- 172.21.15.47:0/3394402867 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7798068f60 0x7f779806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.783+0000 7f77b227b700 1 --2- 172.21.15.47:0/3394402867 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7798068f60 0x7f779806b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f77ac071bf0 tx=0x7f77a8009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:45.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.787+0000 7f77a2ffd700 1 -- 172.21.15.47:0/3394402867 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f779c058080 con 0x7f77ac0fe0e0 2024-02-07T12:23:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.978+0000 7f77b44df700 1 -- 172.21.15.47:0/3394402867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f77ac105a30 con 0x7f77ac0fe0e0 2024-02-07T12:23:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.978+0000 7f77a2ffd700 1 -- 172.21.15.47:0/3394402867 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f779c057c10 con 0x7f77ac0fe0e0 2024-02-07T12:23:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.980+0000 7f77b44df700 1 -- 172.21.15.47:0/3394402867 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7798068f60 msgr2=0x7f779806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.980+0000 7f77b44df700 1 --2- 172.21.15.47:0/3394402867 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7798068f60 0x7f779806b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f77ac071bf0 tx=0x7f77a8009040 comp rx=0 tx=0).stop 2024-02-07T12:23:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.980+0000 7f77b44df700 1 -- 172.21.15.47:0/3394402867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77ac0fe0e0 msgr2=0x7f77ac0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.980+0000 7f77b44df700 1 --2- 172.21.15.47:0/3394402867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77ac0fe0e0 0x7f77ac0702e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f779c0093b0 tx=0x7f779c009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.980+0000 7f77b44df700 1 -- 172.21.15.47:0/3394402867 shutdown_connections 2024-02-07T12:23:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.980+0000 7f77b44df700 1 --2- 172.21.15.47:0/3394402867 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7798068f60 0x7f779806b410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.980+0000 7f77b44df700 1 --2- 172.21.15.47:0/3394402867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77ac0fcef0 0x7f77ac071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.980+0000 7f77b44df700 1 --2- 172.21.15.47:0/3394402867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77ac0fe0e0 0x7f77ac0702e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.980+0000 7f77b44df700 1 -- 172.21.15.47:0/3394402867 >> 172.21.15.47:0/3394402867 conn(0x7f77ac0f8620 msgr2=0x7f77ac1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.980+0000 7f77b44df700 1 -- 172.21.15.47:0/3394402867 shutdown_connections 2024-02-07T12:23:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:45.980+0000 7f77b44df700 1 -- 172.21.15.47:0/3394402867 wait complete. 2024-02-07T12:23:46.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:45 smithi138 ceph-mon[35528]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-07T12:23:46.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:45 smithi047 ceph-mon[28972]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-07T12:23:46.751 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-07T12:23:47.020 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:23:48.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:47 smithi047 ceph-mon[28972]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 682 B/s wr, 4 op/s 2024-02-07T12:23:48.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:47 smithi138 ceph-mon[35528]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 682 B/s wr, 4 op/s 2024-02-07T12:23:48.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.719+0000 7efd00b0d700 1 -- 172.21.15.47:0/390868179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcfc0fbe40 msgr2=0x7efcfc0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:48.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.719+0000 7efd00b0d700 1 --2- 172.21.15.47:0/390868179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcfc0fbe40 0x7efcfc0fc250 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efcf4004940 tx=0x7efcf4009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:48.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.719+0000 7efd00b0d700 1 -- 172.21.15.47:0/390868179 shutdown_connections 2024-02-07T12:23:48.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.719+0000 7efd00b0d700 1 --2- 172.21.15.47:0/390868179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcfc0fcfb0 0x7efcfc0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:48.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.719+0000 7efd00b0d700 1 --2- 172.21.15.47:0/390868179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcfc0fbe40 0x7efcfc0fc250 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:48.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.719+0000 7efd00b0d700 1 -- 172.21.15.47:0/390868179 >> 172.21.15.47:0/390868179 conn(0x7efcfc0f7520 msgr2=0x7efcfc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:48.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.719+0000 7efd00b0d700 1 -- 172.21.15.47:0/390868179 shutdown_connections 2024-02-07T12:23:48.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.719+0000 7efd00b0d700 1 -- 172.21.15.47:0/390868179 wait complete. 2024-02-07T12:23:48.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.719+0000 7efd00b0d700 1 Processor -- start 2024-02-07T12:23:48.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efd00b0d700 1 -- start start 2024-02-07T12:23:48.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efd00b0d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcfc0fbe40 0x7efcfc110630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:48.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efd00b0d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcfc0fcfb0 0x7efcfc112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:48.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efd00b0d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc066d10 con 0x7efcfc0fcfb0 2024-02-07T12:23:48.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efd00b0d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc066e50 con 0x7efcfc0fbe40 2024-02-07T12:23:48.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efcf9d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcfc0fcfb0 0x7efcfc112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:48.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efcf9d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcfc0fcfb0 0x7efcfc112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42082/0 (socket says 172.21.15.47:42082) 2024-02-07T12:23:48.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efcf9d9b700 1 -- 172.21.15.47:0/1745658200 learned_addr learned my addr 172.21.15.47:0/1745658200 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:48.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efcfa59c700 1 --2- 172.21.15.47:0/1745658200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcfc0fbe40 0x7efcfc110630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:48.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efcf9d9b700 1 -- 172.21.15.47:0/1745658200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcfc0fbe40 msgr2=0x7efcfc110630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:48.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efcf9d9b700 1 --2- 172.21.15.47:0/1745658200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcfc0fbe40 0x7efcfc110630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:48.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efcf9d9b700 1 -- 172.21.15.47:0/1745658200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf4005040 con 0x7efcfc0fcfb0 2024-02-07T12:23:48.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efcf9d9b700 1 --2- 172.21.15.47:0/1745658200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcfc0fcfb0 0x7efcfc112b80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efce400c830 tx=0x7efce4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:48.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efcf2ffd700 1 -- 172.21.15.47:0/1745658200 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efce400a760 con 0x7efcfc0fcfb0 2024-02-07T12:23:48.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.720+0000 7efcf2ffd700 1 -- 172.21.15.47:0/1745658200 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efce400ad90 con 0x7efcfc0fcfb0 2024-02-07T12:23:48.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.721+0000 7efd00b0d700 1 -- 172.21.15.47:0/1745658200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcfc1131e0 con 0x7efcfc0fcfb0 2024-02-07T12:23:48.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.721+0000 7efcf2ffd700 1 -- 172.21.15.47:0/1745658200 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efce40113a0 con 0x7efcfc0fcfb0 2024-02-07T12:23:48.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.721+0000 7efd00b0d700 1 -- 172.21.15.47:0/1745658200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcfc1136d0 con 0x7efcfc0fcfb0 2024-02-07T12:23:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.722+0000 7efd00b0d700 1 -- 172.21.15.47:0/1745658200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcfc04bed0 con 0x7efcfc0fcfb0 2024-02-07T12:23:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.722+0000 7efcf2ffd700 1 -- 172.21.15.47:0/1745658200 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7efce4012400 con 0x7efcfc0fcfb0 2024-02-07T12:23:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.722+0000 7efcf2ffd700 1 --2- 172.21.15.47:0/1745658200 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7efce8068f60 0x7efce806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.722+0000 7efcf2ffd700 1 -- 172.21.15.47:0/1745658200 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7efce4086e70 con 0x7efcfc0fcfb0 2024-02-07T12:23:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.723+0000 7efcfa59c700 1 --2- 172.21.15.47:0/1745658200 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7efce8068f60 0x7efce806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.723+0000 7efcfa59c700 1 --2- 172.21.15.47:0/1745658200 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7efce8068f60 0x7efce806b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efcf400b3b0 tx=0x7efcf4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:48.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.727+0000 7efcf2ffd700 1 -- 172.21.15.47:0/1745658200 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7efce40532f0 con 0x7efcfc0fcfb0 2024-02-07T12:23:48.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.940+0000 7efd00b0d700 1 -- 172.21.15.47:0/1745658200 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:44458ccedb18241cc2e17f10cdab3d1385399261", "target": ["mon-mgr", ""]}) v1 -- 0x7efcfc101990 con 0x7efce8068f60 2024-02-07T12:23:48.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.945+0000 7efcf2ffd700 1 -- 172.21.15.47:0/1745658200 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7efcfc101990 con 0x7efce8068f60 2024-02-07T12:23:48.947 INFO:teuthology.orchestra.run.smithi047.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:23:48.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.947+0000 7efd00b0d700 1 -- 172.21.15.47:0/1745658200 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7efce8068f60 msgr2=0x7efce806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:48.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.947+0000 7efd00b0d700 1 --2- 172.21.15.47:0/1745658200 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7efce8068f60 0x7efce806b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efcf400b3b0 tx=0x7efcf4009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:48.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.947+0000 7efd00b0d700 1 -- 172.21.15.47:0/1745658200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcfc0fcfb0 msgr2=0x7efcfc112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:48.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.947+0000 7efd00b0d700 1 --2- 172.21.15.47:0/1745658200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcfc0fcfb0 0x7efcfc112b80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efce400c830 tx=0x7efce4004470 comp rx=0 tx=0).stop 2024-02-07T12:23:48.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.947+0000 7efd00b0d700 1 -- 172.21.15.47:0/1745658200 shutdown_connections 2024-02-07T12:23:48.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.947+0000 7efd00b0d700 1 --2- 172.21.15.47:0/1745658200 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7efce8068f60 0x7efce806b410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:48.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.947+0000 7efd00b0d700 1 --2- 172.21.15.47:0/1745658200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcfc0fbe40 0x7efcfc110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:48.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.947+0000 7efd00b0d700 1 --2- 172.21.15.47:0/1745658200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcfc0fcfb0 0x7efcfc112b80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:48.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.947+0000 7efd00b0d700 1 -- 172.21.15.47:0/1745658200 >> 172.21.15.47:0/1745658200 conn(0x7efcfc0f7520 msgr2=0x7efcfc100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:48.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.947+0000 7efd00b0d700 1 -- 172.21.15.47:0/1745658200 shutdown_connections 2024-02-07T12:23:48.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:48.947+0000 7efd00b0d700 1 -- 172.21.15.47:0/1745658200 wait complete. 2024-02-07T12:23:49.684 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-07T12:23:49.685 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:23:49.685 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-02-07T12:23:49.994 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:23:50.255 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:49 smithi047 ceph-mon[28972]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 597 B/s wr, 3 op/s 2024-02-07T12:23:50.255 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:49 smithi047 ceph-mon[28972]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:44458ccedb18241cc2e17f10cdab3d1385399261", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:23:50.255 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:49 smithi047 ceph-mon[28972]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:23:50.256 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:49 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:50.256 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:49 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:23:50.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:49 smithi138 ceph-mon[35528]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 597 B/s wr, 3 op/s 2024-02-07T12:23:50.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:49 smithi138 ceph-mon[35528]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:44458ccedb18241cc2e17f10cdab3d1385399261", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:23:50.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:49 smithi138 ceph-mon[35528]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:23:50.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:49 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:50.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:49 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:23:51.253 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:50 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:23:51.253 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:50 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:23:51.253 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:50 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:51.253 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:50 smithi047 ceph-mon[28972]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:23:51.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:50 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:23:51.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:50 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:23:51.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:50 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:23:51.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:50 smithi138 ceph-mon[35528]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:44458ccedb18241cc2e17f10cdab3d1385399261 2024-02-07T12:23:51.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.580+0000 7f0207881700 1 -- 172.21.15.47:0/2782099295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02000fd550 msgr2=0x7f02000fd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:51.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.580+0000 7f0207881700 1 --2- 172.21.15.47:0/2782099295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02000fd550 0x7f02000fd960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f01fc004940 tx=0x7f01fc009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:51.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.580+0000 7f0207881700 1 -- 172.21.15.47:0/2782099295 shutdown_connections 2024-02-07T12:23:51.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.580+0000 7f0207881700 1 --2- 172.21.15.47:0/2782099295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02000fdea0 0x7f02001047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:51.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.580+0000 7f0207881700 1 --2- 172.21.15.47:0/2782099295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02000fd550 0x7f02000fd960 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:51.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.580+0000 7f0207881700 1 -- 172.21.15.47:0/2782099295 >> 172.21.15.47:0/2782099295 conn(0x7f02000f6d20 msgr2=0x7f02000f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:51.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.580+0000 7f0207881700 1 -- 172.21.15.47:0/2782099295 shutdown_connections 2024-02-07T12:23:51.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.580+0000 7f0207881700 1 -- 172.21.15.47:0/2782099295 wait complete. 2024-02-07T12:23:51.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.581+0000 7f0207881700 1 Processor -- start 2024-02-07T12:23:51.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.581+0000 7f0207881700 1 -- start start 2024-02-07T12:23:51.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.581+0000 7f0207881700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02000fd550 0x7f020010fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:51.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.581+0000 7f0207881700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02000fdea0 0x7f02001103e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:51.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.581+0000 7f0207881700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02001109e0 con 0x7f02000fdea0 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.581+0000 7f0207881700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0200111280 con 0x7f02000fd550 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.581+0000 7f0204e1c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02000fdea0 0x7f02001103e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.581+0000 7f0204e1c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02000fdea0 0x7f02001103e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49054/0 (socket says 172.21.15.47:49054) 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.581+0000 7f0204e1c700 1 -- 172.21.15.47:0/4054046559 learned_addr learned my addr 172.21.15.47:0/4054046559 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.581+0000 7f020561d700 1 --2- 172.21.15.47:0/4054046559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02000fd550 0x7f020010fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.581+0000 7f0204e1c700 1 -- 172.21.15.47:0/4054046559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02000fd550 msgr2=0x7f020010fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.581+0000 7f0204e1c700 1 --2- 172.21.15.47:0/4054046559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02000fd550 0x7f020010fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.581+0000 7f0204e1c700 1 -- 172.21.15.47:0/4054046559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc005040 con 0x7f02000fdea0 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.582+0000 7f0204e1c700 1 --2- 172.21.15.47:0/4054046559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02000fdea0 0x7f02001103e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f01f000c830 tx=0x7f01f0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.582+0000 7f01f5ffb700 1 -- 172.21.15.47:0/4054046559 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01f000a760 con 0x7f02000fdea0 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.582+0000 7f01f5ffb700 1 -- 172.21.15.47:0/4054046559 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01f000ad90 con 0x7f02000fdea0 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.582+0000 7f0207881700 1 -- 172.21.15.47:0/4054046559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0200111560 con 0x7f02000fdea0 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.582+0000 7f01f5ffb700 1 -- 172.21.15.47:0/4054046559 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01f00113a0 con 0x7f02000fdea0 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.582+0000 7f0207881700 1 -- 172.21.15.47:0/4054046559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0200111aa0 con 0x7f02000fdea0 2024-02-07T12:23:51.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.583+0000 7f0207881700 1 -- 172.21.15.47:0/4054046559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0200109c80 con 0x7f02000fdea0 2024-02-07T12:23:51.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.583+0000 7f01f5ffb700 1 -- 172.21.15.47:0/4054046559 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f01f0012400 con 0x7f02000fdea0 2024-02-07T12:23:51.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.584+0000 7f01f5ffb700 1 --2- 172.21.15.47:0/4054046559 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f01ec068f60 0x7f01ec06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:51.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.584+0000 7f01f5ffb700 1 -- 172.21.15.47:0/4054046559 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f01f0086f10 con 0x7f02000fdea0 2024-02-07T12:23:51.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.584+0000 7f020561d700 1 --2- 172.21.15.47:0/4054046559 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f01ec068f60 0x7f01ec06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:51.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.584+0000 7f020561d700 1 --2- 172.21.15.47:0/4054046559 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f01ec068f60 0x7f01ec06b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f01fc004f90 tx=0x7f01fc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:51.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.589+0000 7f01f5ffb700 1 -- 172.21.15.47:0/4054046559 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f01f0056d80 con 0x7f02000fdea0 2024-02-07T12:23:51.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.805+0000 7f0207881700 1 -- 172.21.15.47:0/4054046559 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02000008d0 con 0x7f01ec068f60 2024-02-07T12:23:51.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.806+0000 7f01f5ffb700 1 -- 172.21.15.47:0/4054046559 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f02000008d0 con 0x7f01ec068f60 2024-02-07T12:23:51.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.808+0000 7f0207881700 1 -- 172.21.15.47:0/4054046559 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f01ec068f60 msgr2=0x7f01ec06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:51.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.808+0000 7f0207881700 1 --2- 172.21.15.47:0/4054046559 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f01ec068f60 0x7f01ec06b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f01fc004f90 tx=0x7f01fc009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:51.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.808+0000 7f0207881700 1 -- 172.21.15.47:0/4054046559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02000fdea0 msgr2=0x7f02001103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:51.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.808+0000 7f0207881700 1 --2- 172.21.15.47:0/4054046559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02000fdea0 0x7f02001103e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f01f000c830 tx=0x7f01f0004470 comp rx=0 tx=0).stop 2024-02-07T12:23:51.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.808+0000 7f0207881700 1 -- 172.21.15.47:0/4054046559 shutdown_connections 2024-02-07T12:23:51.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.808+0000 7f0207881700 1 --2- 172.21.15.47:0/4054046559 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f01ec068f60 0x7f01ec06b410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:51.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.808+0000 7f0207881700 1 --2- 172.21.15.47:0/4054046559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02000fd550 0x7f020010fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:51.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.808+0000 7f0207881700 1 --2- 172.21.15.47:0/4054046559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02000fdea0 0x7f02001103e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:51.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.808+0000 7f0207881700 1 -- 172.21.15.47:0/4054046559 >> 172.21.15.47:0/4054046559 conn(0x7f02000f6d20 msgr2=0x7f02000f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:51.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.808+0000 7f0207881700 1 -- 172.21.15.47:0/4054046559 shutdown_connections 2024-02-07T12:23:51.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.808+0000 7f0207881700 1 -- 172.21.15.47:0/4054046559 wait complete. 2024-02-07T12:23:51.820 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:23:51.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.917+0000 7f0f7fc14700 1 -- 172.21.15.47:0/2451883380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f780fc180 msgr2=0x7f0f780fc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:51.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.917+0000 7f0f7fc14700 1 --2- 172.21.15.47:0/2451883380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f780fc180 0x7f0f780fc5f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0f68004940 tx=0x7f0f68009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:51.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.918+0000 7f0f7fc14700 1 -- 172.21.15.47:0/2451883380 shutdown_connections 2024-02-07T12:23:51.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.918+0000 7f0f7fc14700 1 --2- 172.21.15.47:0/2451883380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f780fc180 0x7f0f780fc5f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:51.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.918+0000 7f0f7fc14700 1 --2- 172.21.15.47:0/2451883380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f780fd470 0x7f0f780fd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:51.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.918+0000 7f0f7fc14700 1 -- 172.21.15.47:0/2451883380 >> 172.21.15.47:0/2451883380 conn(0x7f0f780f6ca0 msgr2=0x7f0f780f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:51.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.918+0000 7f0f7fc14700 1 -- 172.21.15.47:0/2451883380 shutdown_connections 2024-02-07T12:23:51.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.918+0000 7f0f7fc14700 1 -- 172.21.15.47:0/2451883380 wait complete. 2024-02-07T12:23:51.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.918+0000 7f0f7fc14700 1 Processor -- start 2024-02-07T12:23:51.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.918+0000 7f0f7fc14700 1 -- start start 2024-02-07T12:23:51.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.919+0000 7f0f7fc14700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f780fc180 0x7f0f7810c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.919+0000 7f0f7fc14700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f780fd470 0x7f0f7810cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.919+0000 7f0f7fc14700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7810d530 con 0x7f0f780fc180 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.919+0000 7f0f7fc14700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7810dd70 con 0x7f0f780fd470 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.919+0000 7f0f7d9b0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f780fc180 0x7f0f7810c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.919+0000 7f0f7d1af700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f780fd470 0x7f0f7810cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.919+0000 7f0f7d9b0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f780fc180 0x7f0f7810c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49070/0 (socket says 172.21.15.47:49070) 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.919+0000 7f0f7d9b0700 1 -- 172.21.15.47:0/3766423147 learned_addr learned my addr 172.21.15.47:0/3766423147 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.919+0000 7f0f7d9b0700 1 -- 172.21.15.47:0/3766423147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f780fd470 msgr2=0x7f0f7810cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.919+0000 7f0f7d9b0700 1 --2- 172.21.15.47:0/3766423147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f780fd470 0x7f0f7810cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.919+0000 7f0f7d9b0700 1 -- 172.21.15.47:0/3766423147 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f68005040 con 0x7f0f780fc180 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.919+0000 7f0f7d1af700 1 --2- 172.21.15.47:0/3766423147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f780fd470 0x7f0f7810cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.919+0000 7f0f7d9b0700 1 --2- 172.21.15.47:0/3766423147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f780fc180 0x7f0f7810c960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400b790 tx=0x7f0f74009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.920+0000 7f0f6e7fc700 1 -- 172.21.15.47:0/3766423147 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f7400f6f0 con 0x7f0f780fc180 2024-02-07T12:23:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.920+0000 7f0f6e7fc700 1 -- 172.21.15.47:0/3766423147 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f7400fd20 con 0x7f0f780fc180 2024-02-07T12:23:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.920+0000 7f0f7fc14700 1 -- 172.21.15.47:0/3766423147 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7810e050 con 0x7f0f780fc180 2024-02-07T12:23:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.920+0000 7f0f6e7fc700 1 -- 172.21.15.47:0/3766423147 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f740103a0 con 0x7f0f780fc180 2024-02-07T12:23:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.920+0000 7f0f7fc14700 1 -- 172.21.15.47:0/3766423147 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7810e540 con 0x7f0f780fc180 2024-02-07T12:23:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.921+0000 7f0f7fc14700 1 -- 172.21.15.47:0/3766423147 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7804bed0 con 0x7f0f780fc180 2024-02-07T12:23:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.922+0000 7f0f6e7fc700 1 -- 172.21.15.47:0/3766423147 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0f74011400 con 0x7f0f780fc180 2024-02-07T12:23:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.922+0000 7f0f6e7fc700 1 --2- 172.21.15.47:0/3766423147 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f0f64068f70 0x7f0f6406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.922+0000 7f0f6e7fc700 1 -- 172.21.15.47:0/3766423147 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0f74086c60 con 0x7f0f780fc180 2024-02-07T12:23:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.922+0000 7f0f7d1af700 1 --2- 172.21.15.47:0/3766423147 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f0f64068f70 0x7f0f6406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.923+0000 7f0f7d1af700 1 --2- 172.21.15.47:0/3766423147 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f0f64068f70 0x7f0f6406b420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800b3b0 tx=0x7f0f68009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:51.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:51.927+0000 7f0f6e7fc700 1 -- 172.21.15.47:0/3766423147 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0f74056af0 con 0x7f0f780fc180 2024-02-07T12:23:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.162+0000 7f0f7fc14700 1 -- 172.21.15.47:0/3766423147 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f78101ae0 con 0x7f0f64068f70 2024-02-07T12:23:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.163+0000 7f0f6e7fc700 1 -- 172.21.15.47:0/3766423147 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f0f78101ae0 con 0x7f0f64068f70 2024-02-07T12:23:52.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.165+0000 7f0f7fc14700 1 -- 172.21.15.47:0/3766423147 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f0f64068f70 msgr2=0x7f0f6406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:52.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.165+0000 7f0f7fc14700 1 --2- 172.21.15.47:0/3766423147 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f0f64068f70 0x7f0f6406b420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800b3b0 tx=0x7f0f68009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:52.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.165+0000 7f0f7fc14700 1 -- 172.21.15.47:0/3766423147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f780fc180 msgr2=0x7f0f7810c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:52.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.165+0000 7f0f7fc14700 1 --2- 172.21.15.47:0/3766423147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f780fc180 0x7f0f7810c960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400b790 tx=0x7f0f74009220 comp rx=0 tx=0).stop 2024-02-07T12:23:52.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.165+0000 7f0f7fc14700 1 -- 172.21.15.47:0/3766423147 shutdown_connections 2024-02-07T12:23:52.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.165+0000 7f0f7fc14700 1 --2- 172.21.15.47:0/3766423147 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f0f64068f70 0x7f0f6406b420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.165+0000 7f0f7fc14700 1 --2- 172.21.15.47:0/3766423147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f780fc180 0x7f0f7810c960 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.165+0000 7f0f7fc14700 1 --2- 172.21.15.47:0/3766423147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f780fd470 0x7f0f7810cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.165+0000 7f0f7fc14700 1 -- 172.21.15.47:0/3766423147 >> 172.21.15.47:0/3766423147 conn(0x7f0f780f6ca0 msgr2=0x7f0f781003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:52.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.165+0000 7f0f7fc14700 1 -- 172.21.15.47:0/3766423147 shutdown_connections 2024-02-07T12:23:52.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.165+0000 7f0f7fc14700 1 -- 172.21.15.47:0/3766423147 wait complete. 2024-02-07T12:23:52.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.275+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1007812107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40fcef0 msgr2=0x7f9cc40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:52.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.275+0000 7f9cc9e62700 1 --2- 172.21.15.47:0/1007812107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40fcef0 0x7f9cc40fd320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4004940 tx=0x7f9cb4009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:52.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.275+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1007812107 shutdown_connections 2024-02-07T12:23:52.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.275+0000 7f9cc9e62700 1 --2- 172.21.15.47:0/1007812107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9cc40fe0e0 0x7f9cc40fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.275+0000 7f9cc9e62700 1 --2- 172.21.15.47:0/1007812107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40fcef0 0x7f9cc40fd320 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.275+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1007812107 >> 172.21.15.47:0/1007812107 conn(0x7f9cc40f8620 msgr2=0x7f9cc40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:52.278 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:51 smithi047 ceph-mon[28972]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 597 B/s wr, 5 op/s 2024-02-07T12:23:52.278 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:51 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:23:52.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.275+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1007812107 shutdown_connections 2024-02-07T12:23:52.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.275+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1007812107 wait complete. 2024-02-07T12:23:52.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.276+0000 7f9cc9e62700 1 Processor -- start 2024-02-07T12:23:52.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.276+0000 7f9cc9e62700 1 -- start start 2024-02-07T12:23:52.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.276+0000 7f9cc9e62700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9cc40fcef0 0x7f9cc410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:52.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.276+0000 7f9cc9e62700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40fe0e0 0x7f9cc410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:52.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.276+0000 7f9cc9e62700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc410e4b0 con 0x7f9cc40fe0e0 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.276+0000 7f9cc9e62700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc410ed50 con 0x7f9cc40fcef0 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.277+0000 7f9cc2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40fe0e0 0x7f9cc410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.277+0000 7f9cc2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40fe0e0 0x7f9cc410deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49094/0 (socket says 172.21.15.47:49094) 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.277+0000 7f9cc2ffd700 1 -- 172.21.15.47:0/1191798310 learned_addr learned my addr 172.21.15.47:0/1191798310 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.277+0000 7f9cc37fe700 1 --2- 172.21.15.47:0/1191798310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9cc40fcef0 0x7f9cc410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.277+0000 7f9cc2ffd700 1 -- 172.21.15.47:0/1191798310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9cc40fcef0 msgr2=0x7f9cc410d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.277+0000 7f9cc2ffd700 1 --2- 172.21.15.47:0/1191798310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9cc40fcef0 0x7f9cc410d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.277+0000 7f9cc2ffd700 1 -- 172.21.15.47:0/1191798310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb4005040 con 0x7f9cc40fe0e0 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.277+0000 7f9cc2ffd700 1 --2- 172.21.15.47:0/1191798310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40fe0e0 0x7f9cc410deb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8002a50 tx=0x7f9cb80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.277+0000 7f9cabfff700 1 -- 172.21.15.47:0/1191798310 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb8007cc0 con 0x7f9cc40fe0e0 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.277+0000 7f9cabfff700 1 -- 172.21.15.47:0/1191798310 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cb800f040 con 0x7f9cc40fe0e0 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.277+0000 7f9cabfff700 1 -- 172.21.15.47:0/1191798310 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb800da30 con 0x7f9cc40fe0e0 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.277+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1191798310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc410f030 con 0x7f9cc40fe0e0 2024-02-07T12:23:52.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.277+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1191798310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc410f520 con 0x7f9cc40fe0e0 2024-02-07T12:23:52.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.279+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1191798310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc404bed0 con 0x7f9cc40fe0e0 2024-02-07T12:23:52.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.279+0000 7f9cabfff700 1 -- 172.21.15.47:0/1191798310 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9cb800db90 con 0x7f9cc40fe0e0 2024-02-07T12:23:52.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.279+0000 7f9cabfff700 1 --2- 172.21.15.47:0/1191798310 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9cac068f60 0x7f9cac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:52.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.279+0000 7f9cabfff700 1 -- 172.21.15.47:0/1191798310 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9cb8086b90 con 0x7f9cc40fe0e0 2024-02-07T12:23:52.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.279+0000 7f9cc37fe700 1 --2- 172.21.15.47:0/1191798310 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9cac068f60 0x7f9cac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:52.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.280+0000 7f9cc37fe700 1 --2- 172.21.15.47:0/1191798310 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9cac068f60 0x7f9cac06b410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4004890 tx=0x7f9cb4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:52.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:51 smithi138 ceph-mon[35528]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 597 B/s wr, 5 op/s 2024-02-07T12:23:52.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:51 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:23:52.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.284+0000 7f9cabfff700 1 -- 172.21.15.47:0/1191798310 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9cb8056a20 con 0x7f9cc40fe0e0 2024-02-07T12:23:52.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.506+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1191798310 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cc410f9c0 con 0x7f9cac068f60 2024-02-07T12:23:52.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.517+0000 7f9cabfff700 1 -- 172.21.15.47:0/1191798310 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f9cc410f9c0 con 0x7f9cac068f60 2024-02-07T12:23:52.519 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:23:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (4m) 31s ago 6m 26.9M - 0.25.0 c8568f914cd2 edd19ce884c8 2024-02-07T12:23:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (6m) 31s ago 6m 6660k - 17.2.7-491-gf2462625 4ad3622d1b31 bca7317ed169 2024-02-07T12:23:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (5m) 35s ago 5m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 110c84c6624b 2024-02-07T12:23:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (4m) 31s ago 6m 82.8M - 9.4.7 954c08fa6188 5b93631efbfc 2024-02-07T12:23:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (49s) 31s ago 48s 16.7M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:23:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (55s) 31s ago 54s 14.7M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:23:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (46s) 35s ago 46s 14.8M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:23:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (52s) 35s ago 51s 11.3M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:23:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:9283 running (7m) 31s ago 7m 481M - 17.2.7-491-gf2462625 4ad3622d1b31 f3b25479d84e 2024-02-07T12:23:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283 running (5m) 35s ago 5m 435M - 17.2.7-491-gf2462625 4ad3622d1b31 ad543214819c 2024-02-07T12:23:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (7m) 31s ago 7m 42.4M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 105826d9ef9a 2024-02-07T12:23:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (5m) 35s ago 5m 36.3M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 02dfa0b8d573 2024-02-07T12:23:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (6m) 31s ago 6m 16.2M - 1.5.0 0da6a335fe13 ba35c488ed6d 2024-02-07T12:23:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (5m) 35s ago 5m 15.2M - 1.5.0 0da6a335fe13 8823dad6f717 2024-02-07T12:23:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (4m) 31s ago 4m 47.6M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 4f37918f583a 2024-02-07T12:23:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (4m) 31s ago 4m 46.3M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 1c6e3c603ed3 2024-02-07T12:23:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (3m) 31s ago 3m 44.7M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:23:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (3m) 35s ago 3m 48.0M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:23:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (2m) 35s ago 2m 41.9M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:23:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (2m) 35s ago 2m 44.7M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:23:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (4m) 31s ago 5m 55.1M - 2.43.0 a07b618ecd1d e41b94b0d167 2024-02-07T12:23:52.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.519+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1191798310 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9cac068f60 msgr2=0x7f9cac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:52.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.519+0000 7f9cc9e62700 1 --2- 172.21.15.47:0/1191798310 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9cac068f60 0x7f9cac06b410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4004890 tx=0x7f9cb4009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:52.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.519+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1191798310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40fe0e0 msgr2=0x7f9cc410deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:52.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.519+0000 7f9cc9e62700 1 --2- 172.21.15.47:0/1191798310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40fe0e0 0x7f9cc410deb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8002a50 tx=0x7f9cb80046b0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.519+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1191798310 shutdown_connections 2024-02-07T12:23:52.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.519+0000 7f9cc9e62700 1 --2- 172.21.15.47:0/1191798310 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f9cac068f60 0x7f9cac06b410 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.519+0000 7f9cc9e62700 1 --2- 172.21.15.47:0/1191798310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9cc40fcef0 0x7f9cc410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.519+0000 7f9cc9e62700 1 --2- 172.21.15.47:0/1191798310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40fe0e0 0x7f9cc410deb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.519+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1191798310 >> 172.21.15.47:0/1191798310 conn(0x7f9cc40f8620 msgr2=0x7f9cc41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:52.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.519+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1191798310 shutdown_connections 2024-02-07T12:23:52.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.519+0000 7f9cc9e62700 1 -- 172.21.15.47:0/1191798310 wait complete. 2024-02-07T12:23:52.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.624+0000 7fb5384f8700 1 -- 172.21.15.47:0/2381313612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5300fcef0 msgr2=0x7fb5300fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:52.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.624+0000 7fb5384f8700 1 --2- 172.21.15.47:0/2381313612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5300fcef0 0x7fb5300fd320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb52c004940 tx=0x7fb52c009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:52.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.624+0000 7fb5384f8700 1 -- 172.21.15.47:0/2381313612 shutdown_connections 2024-02-07T12:23:52.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.624+0000 7fb5384f8700 1 --2- 172.21.15.47:0/2381313612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5300fe0e0 0x7fb5300fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.624+0000 7fb5384f8700 1 --2- 172.21.15.47:0/2381313612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5300fcef0 0x7fb5300fd320 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.624+0000 7fb5384f8700 1 -- 172.21.15.47:0/2381313612 >> 172.21.15.47:0/2381313612 conn(0x7fb5300f8620 msgr2=0x7fb5300faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:52.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.624+0000 7fb5384f8700 1 -- 172.21.15.47:0/2381313612 shutdown_connections 2024-02-07T12:23:52.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.624+0000 7fb5384f8700 1 -- 172.21.15.47:0/2381313612 wait complete. 2024-02-07T12:23:52.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.624+0000 7fb5384f8700 1 Processor -- start 2024-02-07T12:23:52.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.624+0000 7fb5384f8700 1 -- start start 2024-02-07T12:23:52.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb5384f8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5300fcef0 0x7fb530071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:52.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb5384f8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5300fe0e0 0x7fb5300702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:52.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb5384f8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300708e0 con 0x7fb5300fe0e0 2024-02-07T12:23:52.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb5384f8700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb530070a50 con 0x7fb5300fcef0 2024-02-07T12:23:52.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb535a93700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5300fe0e0 0x7fb5300702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:52.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb535a93700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5300fe0e0 0x7fb5300702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49100/0 (socket says 172.21.15.47:49100) 2024-02-07T12:23:52.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb535a93700 1 -- 172.21.15.47:0/3669187370 learned_addr learned my addr 172.21.15.47:0/3669187370 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:52.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb536294700 1 --2- 172.21.15.47:0/3669187370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5300fcef0 0x7fb530071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:52.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb535a93700 1 -- 172.21.15.47:0/3669187370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5300fcef0 msgr2=0x7fb530071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:52.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb535a93700 1 --2- 172.21.15.47:0/3669187370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5300fcef0 0x7fb530071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb535a93700 1 -- 172.21.15.47:0/3669187370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c005040 con 0x7fb5300fe0e0 2024-02-07T12:23:52.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb535a93700 1 --2- 172.21.15.47:0/3669187370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5300fe0e0 0x7fb5300702e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb520002a50 tx=0x7fb5200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:52.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb526ffd700 1 -- 172.21.15.47:0/3669187370 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb520007cc0 con 0x7fb5300fe0e0 2024-02-07T12:23:52.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb526ffd700 1 -- 172.21.15.47:0/3669187370 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb52000f040 con 0x7fb5300fe0e0 2024-02-07T12:23:52.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb5384f8700 1 -- 172.21.15.47:0/3669187370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb530070d30 con 0x7fb5300fe0e0 2024-02-07T12:23:52.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.625+0000 7fb526ffd700 1 -- 172.21.15.47:0/3669187370 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb52000da30 con 0x7fb5300fe0e0 2024-02-07T12:23:52.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.626+0000 7fb5384f8700 1 -- 172.21.15.47:0/3669187370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5301159a0 con 0x7fb5300fe0e0 2024-02-07T12:23:52.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.627+0000 7fb5384f8700 1 -- 172.21.15.47:0/3669187370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53004bed0 con 0x7fb5300fe0e0 2024-02-07T12:23:52.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.627+0000 7fb526ffd700 1 -- 172.21.15.47:0/3669187370 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb52000db90 con 0x7fb5300fe0e0 2024-02-07T12:23:52.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.627+0000 7fb526ffd700 1 --2- 172.21.15.47:0/3669187370 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb51c068f70 0x7fb51c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:52.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.627+0000 7fb526ffd700 1 -- 172.21.15.47:0/3669187370 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb520086aa0 con 0x7fb5300fe0e0 2024-02-07T12:23:52.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.627+0000 7fb536294700 1 --2- 172.21.15.47:0/3669187370 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb51c068f70 0x7fb51c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:52.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.628+0000 7fb536294700 1 --2- 172.21.15.47:0/3669187370 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb51c068f70 0x7fb51c06b420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00b840 tx=0x7fb52c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:52.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.632+0000 7fb526ffd700 1 -- 172.21.15.47:0/3669187370 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb5200569b0 con 0x7fb5300fe0e0 2024-02-07T12:23:52.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.919+0000 7fb5384f8700 1 -- 172.21.15.47:0/3669187370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb530105a30 con 0x7fb5300fe0e0 2024-02-07T12:23:52.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.920+0000 7fb526ffd700 1 -- 172.21.15.47:0/3669187370 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fb520056540 con 0x7fb5300fe0e0 2024-02-07T12:23:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:23:52.922 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:23:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2 2024-02-07T12:23:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:23:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:23:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2 2024-02-07T12:23:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:23:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:23:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 6 2024-02-07T12:23:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:23:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:23:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:23:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:23:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:23:52.923 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 14 2024-02-07T12:23:52.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:23:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:23:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.922+0000 7fb5384f8700 1 -- 172.21.15.47:0/3669187370 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb51c068f70 msgr2=0x7fb51c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.922+0000 7fb5384f8700 1 --2- 172.21.15.47:0/3669187370 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb51c068f70 0x7fb51c06b420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00b840 tx=0x7fb52c009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.922+0000 7fb5384f8700 1 -- 172.21.15.47:0/3669187370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5300fe0e0 msgr2=0x7fb5300702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.922+0000 7fb5384f8700 1 --2- 172.21.15.47:0/3669187370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5300fe0e0 0x7fb5300702e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb520002a50 tx=0x7fb5200046b0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.922+0000 7fb5384f8700 1 -- 172.21.15.47:0/3669187370 shutdown_connections 2024-02-07T12:23:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.922+0000 7fb5384f8700 1 --2- 172.21.15.47:0/3669187370 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb51c068f70 0x7fb51c06b420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.922+0000 7fb5384f8700 1 --2- 172.21.15.47:0/3669187370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5300fcef0 0x7fb530071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.922+0000 7fb5384f8700 1 --2- 172.21.15.47:0/3669187370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5300fe0e0 0x7fb5300702e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.922+0000 7fb5384f8700 1 -- 172.21.15.47:0/3669187370 >> 172.21.15.47:0/3669187370 conn(0x7fb5300f8620 msgr2=0x7fb5301013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.922+0000 7fb5384f8700 1 -- 172.21.15.47:0/3669187370 shutdown_connections 2024-02-07T12:23:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:52.923+0000 7fb5384f8700 1 -- 172.21.15.47:0/3669187370 wait complete. 2024-02-07T12:23:53.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.034+0000 7f146a63d700 1 -- 172.21.15.47:0/1022353166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14640fbe40 msgr2=0x7f14640fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:53.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.034+0000 7f146a63d700 1 --2- 172.21.15.47:0/1022353166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14640fbe40 0x7f14640fc250 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1454004940 tx=0x7f1454009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:53.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.034+0000 7f146a63d700 1 -- 172.21.15.47:0/1022353166 shutdown_connections 2024-02-07T12:23:53.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.034+0000 7f146a63d700 1 --2- 172.21.15.47:0/1022353166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14640fcfb0 0x7f14640fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.034+0000 7f146a63d700 1 --2- 172.21.15.47:0/1022353166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14640fbe40 0x7f14640fc250 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.034+0000 7f146a63d700 1 -- 172.21.15.47:0/1022353166 >> 172.21.15.47:0/1022353166 conn(0x7f14640f74e0 msgr2=0x7f14640f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:53.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.034+0000 7f146a63d700 1 -- 172.21.15.47:0/1022353166 shutdown_connections 2024-02-07T12:23:53.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.034+0000 7f146a63d700 1 -- 172.21.15.47:0/1022353166 wait complete. 2024-02-07T12:23:53.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.034+0000 7f146a63d700 1 Processor -- start 2024-02-07T12:23:53.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.035+0000 7f146a63d700 1 -- start start 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.035+0000 7f146a63d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14640fbe40 0x7f14640fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.035+0000 7f146a63d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14640fcfb0 0x7f14640fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.035+0000 7f146a63d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14640fe980 con 0x7f14640fcfb0 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.035+0000 7f146a63d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14640feaf0 con 0x7f14640fbe40 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.035+0000 7f14637fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14640fcfb0 0x7f14640fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.035+0000 7f14637fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14640fcfb0 0x7f14640fe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49116/0 (socket says 172.21.15.47:49116) 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.035+0000 7f14637fe700 1 -- 172.21.15.47:0/1947194901 learned_addr learned my addr 172.21.15.47:0/1947194901 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.035+0000 7f1463fff700 1 --2- 172.21.15.47:0/1947194901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14640fbe40 0x7f14640fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.035+0000 7f14637fe700 1 -- 172.21.15.47:0/1947194901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14640fbe40 msgr2=0x7f14640fff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.035+0000 7f14637fe700 1 --2- 172.21.15.47:0/1947194901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14640fbe40 0x7f14640fff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.035+0000 7f14637fe700 1 -- 172.21.15.47:0/1947194901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1454005040 con 0x7f14640fcfb0 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.035+0000 7f14637fe700 1 --2- 172.21.15.47:0/1947194901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14640fcfb0 0x7f14640fe380 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1458002a80 tx=0x7f14580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.036+0000 7f1460ff9700 1 -- 172.21.15.47:0/1947194901 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1458007cc0 con 0x7f14640fcfb0 2024-02-07T12:23:53.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.036+0000 7f146a63d700 1 -- 172.21.15.47:0/1947194901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14640fedd0 con 0x7f14640fcfb0 2024-02-07T12:23:53.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.036+0000 7f1460ff9700 1 -- 172.21.15.47:0/1947194901 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f145800f040 con 0x7f14640fcfb0 2024-02-07T12:23:53.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.036+0000 7f1460ff9700 1 -- 172.21.15.47:0/1947194901 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f145800dac0 con 0x7f14640fcfb0 2024-02-07T12:23:53.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.036+0000 7f146a63d700 1 -- 172.21.15.47:0/1947194901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14641158e0 con 0x7f14640fcfb0 2024-02-07T12:23:53.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.037+0000 7f146a63d700 1 -- 172.21.15.47:0/1947194901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146404bed0 con 0x7f14640fcfb0 2024-02-07T12:23:53.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.037+0000 7f1460ff9700 1 -- 172.21.15.47:0/1947194901 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f145800dc20 con 0x7f14640fcfb0 2024-02-07T12:23:53.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.037+0000 7f1460ff9700 1 --2- 172.21.15.47:0/1947194901 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f144c068f60 0x7f144c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:53.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.038+0000 7f1460ff9700 1 -- 172.21.15.47:0/1947194901 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1458086b80 con 0x7f14640fcfb0 2024-02-07T12:23:53.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.038+0000 7f1463fff700 1 --2- 172.21.15.47:0/1947194901 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f144c068f60 0x7f144c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:53.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.038+0000 7f1463fff700 1 --2- 172.21.15.47:0/1947194901 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f144c068f60 0x7f144c06b410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1454004890 tx=0x7f1454009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:53.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.042+0000 7f1460ff9700 1 -- 172.21.15.47:0/1947194901 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1458056a10 con 0x7f14640fcfb0 2024-02-07T12:23:53.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:52 smithi138 ceph-mon[35528]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:23:53.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:52 smithi138 ceph-mon[35528]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:23:53.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:52 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3669187370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:23:53.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.291+0000 7f146a63d700 1 -- 172.21.15.47:0/1947194901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1464104930 con 0x7f14640fcfb0 2024-02-07T12:23:53.293 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:52 smithi047 ceph-mon[28972]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:23:53.294 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:52 smithi047 ceph-mon[28972]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:23:53.294 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:52 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3669187370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:23:53.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.291+0000 7f1460ff9700 1 -- 172.21.15.47:0/1947194901 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1834 (secure 0 0 0) 0x7f14580565a0 con 0x7f14640fcfb0 2024-02-07T12:23:53.294 INFO:teuthology.orchestra.run.smithi047.stdout:e18 2024-02-07T12:23:53.294 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:23:53.294 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:23:53.294 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:23:53.294 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 18 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:23:12.341179+0000 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:23:53.295 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:23:53.296 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:23:53.296 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:23:53.296 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:23:53.296 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:23:53.296 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:23:53.296 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:23:53.296 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:23:53.296 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:23:53.296 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:23:53.296 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:23:53.296 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:23:53.296 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:23:53.296 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:23:53.297 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:23:53.297 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:23:53.297 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:23:53.297 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:23:53.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.294+0000 7f146a63d700 1 -- 172.21.15.47:0/1947194901 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f144c068f60 msgr2=0x7f144c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.294+0000 7f146a63d700 1 --2- 172.21.15.47:0/1947194901 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f144c068f60 0x7f144c06b410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1454004890 tx=0x7f1454009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.294+0000 7f146a63d700 1 -- 172.21.15.47:0/1947194901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14640fcfb0 msgr2=0x7f14640fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.294+0000 7f146a63d700 1 --2- 172.21.15.47:0/1947194901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14640fcfb0 0x7f14640fe380 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1458002a80 tx=0x7f14580046b0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.294+0000 7f146a63d700 1 -- 172.21.15.47:0/1947194901 shutdown_connections 2024-02-07T12:23:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.294+0000 7f146a63d700 1 --2- 172.21.15.47:0/1947194901 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f144c068f60 0x7f144c06b410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.294+0000 7f146a63d700 1 --2- 172.21.15.47:0/1947194901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14640fbe40 0x7f14640fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.294+0000 7f146a63d700 1 --2- 172.21.15.47:0/1947194901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14640fcfb0 0x7f14640fe380 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.294+0000 7f146a63d700 1 -- 172.21.15.47:0/1947194901 >> 172.21.15.47:0/1947194901 conn(0x7f14640f74e0 msgr2=0x7f14640656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.295+0000 7f146a63d700 1 -- 172.21.15.47:0/1947194901 shutdown_connections 2024-02-07T12:23:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.295+0000 7f146a63d700 1 -- 172.21.15.47:0/1947194901 wait complete. 2024-02-07T12:23:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 18 2024-02-07T12:23:53.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.400+0000 7f82ce69c700 1 -- 172.21.15.47:0/619941281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c80fda80 msgr2=0x7f82c80ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:53.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.400+0000 7f82ce69c700 1 --2- 172.21.15.47:0/619941281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c80fda80 0x7f82c80ffe60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f82b8004940 tx=0x7f82b8009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:53.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.400+0000 7f82ce69c700 1 -- 172.21.15.47:0/619941281 shutdown_connections 2024-02-07T12:23:53.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.400+0000 7f82ce69c700 1 --2- 172.21.15.47:0/619941281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c81003a0 0x7f82c8102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.400+0000 7f82ce69c700 1 --2- 172.21.15.47:0/619941281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c80fda80 0x7f82c80ffe60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.400+0000 7f82ce69c700 1 -- 172.21.15.47:0/619941281 >> 172.21.15.47:0/619941281 conn(0x7f82c80f74e0 msgr2=0x7f82c80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:53.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.400+0000 7f82ce69c700 1 -- 172.21.15.47:0/619941281 shutdown_connections 2024-02-07T12:23:53.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.400+0000 7f82ce69c700 1 -- 172.21.15.47:0/619941281 wait complete. 2024-02-07T12:23:53.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.401+0000 7f82ce69c700 1 Processor -- start 2024-02-07T12:23:53.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.401+0000 7f82ce69c700 1 -- start start 2024-02-07T12:23:53.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.401+0000 7f82ce69c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c80fda80 0x7f82c80fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:53.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.401+0000 7f82ce69c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c81003a0 0x7f82c80fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:53.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.401+0000 7f82ce69c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80fbf90 con 0x7f82c81003a0 2024-02-07T12:23:53.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.401+0000 7f82ce69c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80fc100 con 0x7f82c80fda80 2024-02-07T12:23:53.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.402+0000 7f82c77fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c81003a0 0x7f82c80fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:53.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.402+0000 7f82c77fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c81003a0 0x7f82c80fb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49144/0 (socket says 172.21.15.47:49144) 2024-02-07T12:23:53.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.402+0000 7f82c77fe700 1 -- 172.21.15.47:0/3899730253 learned_addr learned my addr 172.21.15.47:0/3899730253 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:53.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.402+0000 7f82c7fff700 1 --2- 172.21.15.47:0/3899730253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c80fda80 0x7f82c80fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:53.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.402+0000 7f82c77fe700 1 -- 172.21.15.47:0/3899730253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c80fda80 msgr2=0x7f82c80fd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:53.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.402+0000 7f82c77fe700 1 --2- 172.21.15.47:0/3899730253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c80fda80 0x7f82c80fd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.402+0000 7f82c77fe700 1 -- 172.21.15.47:0/3899730253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b8005040 con 0x7f82c81003a0 2024-02-07T12:23:53.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.402+0000 7f82c77fe700 1 --2- 172.21.15.47:0/3899730253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c81003a0 0x7f82c80fb990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f82bc002a50 tx=0x7f82bc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:53.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.402+0000 7f82c4ff9700 1 -- 172.21.15.47:0/3899730253 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82bc007cc0 con 0x7f82c81003a0 2024-02-07T12:23:53.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.402+0000 7f82ce69c700 1 -- 172.21.15.47:0/3899730253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c80fc3e0 con 0x7f82c81003a0 2024-02-07T12:23:53.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.402+0000 7f82c4ff9700 1 -- 172.21.15.47:0/3899730253 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f82bc00f040 con 0x7f82c81003a0 2024-02-07T12:23:53.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.402+0000 7f82c4ff9700 1 -- 172.21.15.47:0/3899730253 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82bc00da30 con 0x7f82c81003a0 2024-02-07T12:23:53.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.402+0000 7f82ce69c700 1 -- 172.21.15.47:0/3899730253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c8115960 con 0x7f82c81003a0 2024-02-07T12:23:53.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.403+0000 7f82ce69c700 1 -- 172.21.15.47:0/3899730253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c804bed0 con 0x7f82c81003a0 2024-02-07T12:23:53.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.404+0000 7f82c4ff9700 1 -- 172.21.15.47:0/3899730253 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f82bc00db90 con 0x7f82c81003a0 2024-02-07T12:23:53.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.404+0000 7f82c4ff9700 1 --2- 172.21.15.47:0/3899730253 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f82b0068f60 0x7f82b006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:53.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.404+0000 7f82c4ff9700 1 -- 172.21.15.47:0/3899730253 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f82bc086b90 con 0x7f82c81003a0 2024-02-07T12:23:53.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.404+0000 7f82c7fff700 1 --2- 172.21.15.47:0/3899730253 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f82b0068f60 0x7f82b006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:53.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.405+0000 7f82c7fff700 1 --2- 172.21.15.47:0/3899730253 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f82b0068f60 0x7f82b006b410 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f82b8004890 tx=0x7f82b8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:53.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.408+0000 7f82c4ff9700 1 -- 172.21.15.47:0/3899730253 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f82bc056a20 con 0x7f82c81003a0 2024-02-07T12:23:53.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.621+0000 7f82ce69c700 1 -- 172.21.15.47:0/3899730253 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82c8101000 con 0x7f82b0068f60 2024-02-07T12:23:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.622+0000 7f82c4ff9700 1 -- 172.21.15.47:0/3899730253 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f82c8101000 con 0x7f82b0068f60 2024-02-07T12:23:53.624 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:23:53.624 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:44458ccedb18241cc2e17f10cdab3d1385399261", 2024-02-07T12:23:53.624 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:23:53.624 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:23:53.624 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [], 2024-02-07T12:23:53.625 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "", 2024-02-07T12:23:53.625 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:44458ccedb18241cc2e17f10cdab3d1385399261 image", 2024-02-07T12:23:53.625 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:23:53.625 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:23:53.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.624+0000 7f82ce69c700 1 -- 172.21.15.47:0/3899730253 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f82b0068f60 msgr2=0x7f82b006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:53.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.624+0000 7f82ce69c700 1 --2- 172.21.15.47:0/3899730253 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f82b0068f60 0x7f82b006b410 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f82b8004890 tx=0x7f82b8009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:53.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.624+0000 7f82ce69c700 1 -- 172.21.15.47:0/3899730253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c81003a0 msgr2=0x7f82c80fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:53.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.624+0000 7f82ce69c700 1 --2- 172.21.15.47:0/3899730253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c81003a0 0x7f82c80fb990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f82bc002a50 tx=0x7f82bc0046b0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.624+0000 7f82ce69c700 1 -- 172.21.15.47:0/3899730253 shutdown_connections 2024-02-07T12:23:53.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.624+0000 7f82ce69c700 1 --2- 172.21.15.47:0/3899730253 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f82b0068f60 0x7f82b006b410 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.624+0000 7f82ce69c700 1 --2- 172.21.15.47:0/3899730253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c80fda80 0x7f82c80fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.624+0000 7f82ce69c700 1 --2- 172.21.15.47:0/3899730253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c81003a0 0x7f82c80fb990 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.624+0000 7f82ce69c700 1 -- 172.21.15.47:0/3899730253 >> 172.21.15.47:0/3899730253 conn(0x7f82c80f74e0 msgr2=0x7f82c80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:53.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.624+0000 7f82ce69c700 1 -- 172.21.15.47:0/3899730253 shutdown_connections 2024-02-07T12:23:53.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.624+0000 7f82ce69c700 1 -- 172.21.15.47:0/3899730253 wait complete. 2024-02-07T12:23:53.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.727+0000 7ff10b36f700 1 -- 172.21.15.47:0/2781167763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1040fe2b0 msgr2=0x7ff1040fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:53.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.727+0000 7ff10b36f700 1 --2- 172.21.15.47:0/2781167763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1040fe2b0 0x7ff1040fe700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8004940 tx=0x7ff0f8009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:53.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10b36f700 1 -- 172.21.15.47:0/2781167763 shutdown_connections 2024-02-07T12:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10b36f700 1 --2- 172.21.15.47:0/2781167763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1040fe2b0 0x7ff1040fe700 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10b36f700 1 --2- 172.21.15.47:0/2781167763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1040fb220 0x7ff1040fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10b36f700 1 -- 172.21.15.47:0/2781167763 >> 172.21.15.47:0/2781167763 conn(0x7ff1040f6ca0 msgr2=0x7ff1040f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10b36f700 1 -- 172.21.15.47:0/2781167763 shutdown_connections 2024-02-07T12:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10b36f700 1 -- 172.21.15.47:0/2781167763 wait complete. 2024-02-07T12:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10b36f700 1 Processor -- start 2024-02-07T12:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10b36f700 1 -- start start 2024-02-07T12:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10b36f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1040fb220 0x7ff10410d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10b36f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1040fe2b0 0x7ff10410dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10b36f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10410e4c0 con 0x7ff1040fe2b0 2024-02-07T12:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10b36f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10410ed60 con 0x7ff1040fb220 2024-02-07T12:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10890a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1040fe2b0 0x7ff10410dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10890a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1040fe2b0 0x7ff10410dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49172/0 (socket says 172.21.15.47:49172) 2024-02-07T12:23:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.728+0000 7ff10890a700 1 -- 172.21.15.47:0/2327875690 learned_addr learned my addr 172.21.15.47:0/2327875690 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:23:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.729+0000 7ff10910b700 1 --2- 172.21.15.47:0/2327875690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1040fb220 0x7ff10410d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.729+0000 7ff10890a700 1 -- 172.21.15.47:0/2327875690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1040fb220 msgr2=0x7ff10410d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.729+0000 7ff10890a700 1 --2- 172.21.15.47:0/2327875690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1040fb220 0x7ff10410d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.729+0000 7ff10890a700 1 -- 172.21.15.47:0/2327875690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f8005040 con 0x7ff1040fe2b0 2024-02-07T12:23:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.729+0000 7ff10890a700 1 --2- 172.21.15.47:0/2327875690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1040fe2b0 0x7ff10410dec0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8009180 tx=0x7ff0f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.729+0000 7ff101ffb700 1 -- 172.21.15.47:0/2327875690 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0f800e040 con 0x7ff1040fe2b0 2024-02-07T12:23:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.729+0000 7ff10b36f700 1 -- 172.21.15.47:0/2327875690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10410efe0 con 0x7ff1040fe2b0 2024-02-07T12:23:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.729+0000 7ff101ffb700 1 -- 172.21.15.47:0/2327875690 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0f8009410 con 0x7ff1040fe2b0 2024-02-07T12:23:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.729+0000 7ff101ffb700 1 -- 172.21.15.47:0/2327875690 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0f801c630 con 0x7ff1040fe2b0 2024-02-07T12:23:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.729+0000 7ff10b36f700 1 -- 172.21.15.47:0/2327875690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10410f520 con 0x7ff1040fe2b0 2024-02-07T12:23:53.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.730+0000 7ff10b36f700 1 -- 172.21.15.47:0/2327875690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10404bed0 con 0x7ff1040fe2b0 2024-02-07T12:23:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.731+0000 7ff101ffb700 1 -- 172.21.15.47:0/2327875690 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff0f800bbf0 con 0x7ff1040fe2b0 2024-02-07T12:23:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.731+0000 7ff101ffb700 1 --2- 172.21.15.47:0/2327875690 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff0ec068f60 0x7ff0ec06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:23:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.731+0000 7ff101ffb700 1 -- 172.21.15.47:0/2327875690 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff0f8088120 con 0x7ff1040fe2b0 2024-02-07T12:23:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.731+0000 7ff10910b700 1 --2- 172.21.15.47:0/2327875690 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff0ec068f60 0x7ff0ec06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:23:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.732+0000 7ff10910b700 1 --2- 172.21.15.47:0/2327875690 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff0ec068f60 0x7ff0ec06b410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff104065cb0 tx=0x7ff0f4009e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:23:53.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:53.735+0000 7ff101ffb700 1 -- 172.21.15.47:0/2327875690 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff0f8058030 con 0x7ff1040fe2b0 2024-02-07T12:23:54.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:54.023+0000 7ff10b36f700 1 -- 172.21.15.47:0/2327875690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff104105a40 con 0x7ff1040fe2b0 2024-02-07T12:23:54.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:54.024+0000 7ff101ffb700 1 -- 172.21.15.47:0/2327875690 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff0f8057bc0 con 0x7ff1040fe2b0 2024-02-07T12:23:54.026 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:23:54.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:54.026+0000 7ff10b36f700 1 -- 172.21.15.47:0/2327875690 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff0ec068f60 msgr2=0x7ff0ec06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:54.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:54.026+0000 7ff10b36f700 1 --2- 172.21.15.47:0/2327875690 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff0ec068f60 0x7ff0ec06b410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff104065cb0 tx=0x7ff0f4009e40 comp rx=0 tx=0).stop 2024-02-07T12:23:54.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:54.026+0000 7ff10b36f700 1 -- 172.21.15.47:0/2327875690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1040fe2b0 msgr2=0x7ff10410dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:23:54.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:54.026+0000 7ff10b36f700 1 --2- 172.21.15.47:0/2327875690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1040fe2b0 0x7ff10410dec0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8009180 tx=0x7ff0f8009e30 comp rx=0 tx=0).stop 2024-02-07T12:23:54.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:54.026+0000 7ff10b36f700 1 -- 172.21.15.47:0/2327875690 shutdown_connections 2024-02-07T12:23:54.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:54.026+0000 7ff10b36f700 1 --2- 172.21.15.47:0/2327875690 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7ff0ec068f60 0x7ff0ec06b410 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:54.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:54.026+0000 7ff10b36f700 1 --2- 172.21.15.47:0/2327875690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1040fb220 0x7ff10410d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:54.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:54.026+0000 7ff10b36f700 1 --2- 172.21.15.47:0/2327875690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1040fe2b0 0x7ff10410dec0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:23:54.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:54.026+0000 7ff10b36f700 1 -- 172.21.15.47:0/2327875690 >> 172.21.15.47:0/2327875690 conn(0x7ff1040f6ca0 msgr2=0x7ff1041014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:23:54.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:54.026+0000 7ff10b36f700 1 -- 172.21.15.47:0/2327875690 shutdown_connections 2024-02-07T12:23:54.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:23:54.026+0000 7ff10b36f700 1 -- 172.21.15.47:0/2327875690 wait complete. 2024-02-07T12:23:54.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:53 smithi138 ceph-mon[35528]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:23:54.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:53 smithi138 ceph-mon[35528]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-07T12:23:54.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:53 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/1947194901' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:23:54.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:53 smithi047 ceph-mon[28972]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:23:54.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:53 smithi047 ceph-mon[28972]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-07T12:23:54.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:53 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1947194901' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:23:55.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:54 smithi138 ceph-mon[35528]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:23:55.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:54 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2327875690' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:23:55.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:54 smithi047 ceph-mon[28972]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:23:55.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:54 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2327875690' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:23:56.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:55 smithi138 ceph-mon[35528]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:23:56.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:55 smithi047 ceph-mon[28972]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:23:58.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:57 smithi138 ceph-mon[35528]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:23:58.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:57 smithi047 ceph-mon[28972]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:00.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:23:59 smithi138 ceph-mon[35528]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:00.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:23:59 smithi047 ceph-mon[28972]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:01.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:01 smithi138 ceph-mon[35528]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:24:01.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:01 smithi047 ceph-mon[28972]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:24:04.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:03 smithi138 ceph-mon[35528]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:04.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:03 smithi047 ceph-mon[28972]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:06.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:05 smithi138 ceph-mon[35528]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:24:06.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:05 smithi047 ceph-mon[28972]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:24:07.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:06 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:24:07.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:24:08.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:07 smithi138 ceph-mon[35528]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:08.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:07 smithi047 ceph-mon[28972]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:10.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:09 smithi138 ceph-mon[35528]: pgmap v216: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:10.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:09 smithi047 ceph-mon[28972]: pgmap v216: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:11.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:11 smithi138 ceph-mon[35528]: pgmap v217: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-07T12:24:11.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:11 smithi047 ceph-mon[28972]: pgmap v217: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-07T12:24:14.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:13 smithi138 ceph-mon[35528]: pgmap v218: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-07T12:24:14.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:13 smithi047 ceph-mon[28972]: pgmap v218: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-07T12:24:16.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:15 smithi138 ceph-mon[35528]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-02-07T12:24:16.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:15 smithi047 ceph-mon[28972]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-02-07T12:24:18.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:17 smithi138 ceph-mon[35528]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-07T12:24:18.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:17 smithi047 ceph-mon[28972]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-07T12:24:20.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:19 smithi138 ceph-mon[35528]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-07T12:24:20.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:19 smithi047 ceph-mon[28972]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-07T12:24:21.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:21 smithi138 ceph-mon[35528]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-07T12:24:21.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:21 smithi047 ceph-mon[28972]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-07T12:24:22.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:24:22.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:24:23.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:23 smithi138 ceph-mon[35528]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 341 B/s wr, 4 op/s 2024-02-07T12:24:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:23 smithi047 ceph-mon[28972]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 341 B/s wr, 4 op/s 2024-02-07T12:24:24.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.173+0000 7fb7227fc700 1 -- 172.21.15.47:0/449859710 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb71800bcb0 con 0x7fb7240fe0e0 2024-02-07T12:24:24.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.174+0000 7fb72a25e700 1 -- 172.21.15.47:0/449859710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7240fe0e0 msgr2=0x7fb7240fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:24.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.174+0000 7fb72a25e700 1 --2- 172.21.15.47:0/449859710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7240fe0e0 0x7fb7240fe550 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb718004940 tx=0x7fb718009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:24.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.174+0000 7fb72a25e700 1 -- 172.21.15.47:0/449859710 shutdown_connections 2024-02-07T12:24:24.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.174+0000 7fb72a25e700 1 --2- 172.21.15.47:0/449859710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7240fe0e0 0x7fb7240fe550 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:24.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.174+0000 7fb72a25e700 1 --2- 172.21.15.47:0/449859710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7240fcef0 0x7fb7240fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:24.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.174+0000 7fb72a25e700 1 -- 172.21.15.47:0/449859710 >> 172.21.15.47:0/449859710 conn(0x7fb7240f8620 msgr2=0x7fb7240faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:24.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.174+0000 7fb72a25e700 1 -- 172.21.15.47:0/449859710 shutdown_connections 2024-02-07T12:24:24.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.175+0000 7fb72a25e700 1 -- 172.21.15.47:0/449859710 wait complete. 2024-02-07T12:24:24.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.175+0000 7fb72a25e700 1 Processor -- start 2024-02-07T12:24:24.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.175+0000 7fb72a25e700 1 -- start start 2024-02-07T12:24:24.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.176+0000 7fb72a25e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7240fcef0 0x7fb72410b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:24.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.176+0000 7fb72a25e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72410bd50 0x7fb72410cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:24.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.176+0000 7fb72a25e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72410c210 con 0x7fb7240fcef0 2024-02-07T12:24:24.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.176+0000 7fb72a25e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72410c380 con 0x7fb72410bd50 2024-02-07T12:24:24.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.176+0000 7fb7237fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7240fcef0 0x7fb72410b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:24.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.176+0000 7fb7237fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7240fcef0 0x7fb72410b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45402/0 (socket says 172.21.15.47:45402) 2024-02-07T12:24:24.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.176+0000 7fb7237fe700 1 -- 172.21.15.47:0/776334433 learned_addr learned my addr 172.21.15.47:0/776334433 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:24:24.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.176+0000 7fb722ffd700 1 --2- 172.21.15.47:0/776334433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72410bd50 0x7fb72410cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:24.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.176+0000 7fb7237fe700 1 -- 172.21.15.47:0/776334433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72410bd50 msgr2=0x7fb72410cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:24.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.176+0000 7fb7237fe700 1 --2- 172.21.15.47:0/776334433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72410bd50 0x7fb72410cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:24.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.176+0000 7fb7237fe700 1 -- 172.21.15.47:0/776334433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718005040 con 0x7fb7240fcef0 2024-02-07T12:24:24.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.176+0000 7fb722ffd700 1 --2- 172.21.15.47:0/776334433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72410bd50 0x7fb72410cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:24:24.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.177+0000 7fb7237fe700 1 --2- 172.21.15.47:0/776334433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7240fcef0 0x7fb72410b810 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb714002c00 tx=0x7fb7140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:24.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.177+0000 7fb70bfff700 1 -- 172.21.15.47:0/776334433 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb714007ab0 con 0x7fb7240fcef0 2024-02-07T12:24:24.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.177+0000 7fb70bfff700 1 -- 172.21.15.47:0/776334433 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb71400f040 con 0x7fb7240fcef0 2024-02-07T12:24:24.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.177+0000 7fb70bfff700 1 -- 172.21.15.47:0/776334433 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb714009780 con 0x7fb7240fcef0 2024-02-07T12:24:24.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.177+0000 7fb72a25e700 1 -- 172.21.15.47:0/776334433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72410d2a0 con 0x7fb7240fcef0 2024-02-07T12:24:24.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.177+0000 7fb72a25e700 1 -- 172.21.15.47:0/776334433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72410d760 con 0x7fb7240fcef0 2024-02-07T12:24:24.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.179+0000 7fb72a25e700 1 -- 172.21.15.47:0/776334433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7240fc2a0 con 0x7fb7240fcef0 2024-02-07T12:24:24.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.180+0000 7fb70bfff700 1 -- 172.21.15.47:0/776334433 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb71400d950 con 0x7fb7240fcef0 2024-02-07T12:24:24.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.180+0000 7fb70bfff700 1 --2- 172.21.15.47:0/776334433 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb70c069100 0x7fb70c06b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:24.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.180+0000 7fb70bfff700 1 -- 172.21.15.47:0/776334433 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb714086b90 con 0x7fb7240fcef0 2024-02-07T12:24:24.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.180+0000 7fb722ffd700 1 --2- 172.21.15.47:0/776334433 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb70c069100 0x7fb70c06b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:24.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.181+0000 7fb722ffd700 1 --2- 172.21.15.47:0/776334433 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb70c069100 0x7fb70c06b5b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb718004890 tx=0x7fb718009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:24.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.189+0000 7fb70bfff700 1 -- 172.21.15.47:0/776334433 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb714052ff0 con 0x7fb7240fcef0 2024-02-07T12:24:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.560+0000 7fb72a25e700 1 -- 172.21.15.47:0/776334433 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb724101ca0 con 0x7fb70c069100 2024-02-07T12:24:24.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.562+0000 7fb70bfff700 1 -- 172.21.15.47:0/776334433 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb724101ca0 con 0x7fb70c069100 2024-02-07T12:24:24.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.565+0000 7fb72a25e700 1 -- 172.21.15.47:0/776334433 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb70c069100 msgr2=0x7fb70c06b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:24.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.565+0000 7fb72a25e700 1 --2- 172.21.15.47:0/776334433 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb70c069100 0x7fb70c06b5b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb718004890 tx=0x7fb718009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:24.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.565+0000 7fb72a25e700 1 -- 172.21.15.47:0/776334433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7240fcef0 msgr2=0x7fb72410b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:24.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.565+0000 7fb72a25e700 1 --2- 172.21.15.47:0/776334433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7240fcef0 0x7fb72410b810 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb714002c00 tx=0x7fb7140046b0 comp rx=0 tx=0).stop 2024-02-07T12:24:24.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.565+0000 7fb72a25e700 1 -- 172.21.15.47:0/776334433 shutdown_connections 2024-02-07T12:24:24.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.565+0000 7fb72a25e700 1 --2- 172.21.15.47:0/776334433 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb70c069100 0x7fb70c06b5b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:24.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.565+0000 7fb72a25e700 1 --2- 172.21.15.47:0/776334433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7240fcef0 0x7fb72410b810 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb714002c00 tx=0x7fb7140046b0 comp rx=0 tx=0).stop 2024-02-07T12:24:24.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.565+0000 7fb72a25e700 1 --2- 172.21.15.47:0/776334433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72410bd50 0x7fb72410cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:24.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.565+0000 7fb72a25e700 1 -- 172.21.15.47:0/776334433 >> 172.21.15.47:0/776334433 conn(0x7fb7240f8620 msgr2=0x7fb7240ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.566+0000 7fb72a25e700 1 -- 172.21.15.47:0/776334433 shutdown_connections 2024-02-07T12:24:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.566+0000 7fb72a25e700 1 -- 172.21.15.47:0/776334433 wait complete. 2024-02-07T12:24:24.579 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:24:24.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.724+0000 7faf658f9700 1 -- 172.21.15.47:0/2016817778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf600fbe40 msgr2=0x7faf600fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:24.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.724+0000 7faf658f9700 1 --2- 172.21.15.47:0/2016817778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf600fbe40 0x7faf600fc250 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faf50004940 tx=0x7faf50009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:24.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.724+0000 7faf658f9700 1 -- 172.21.15.47:0/2016817778 shutdown_connections 2024-02-07T12:24:24.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.724+0000 7faf658f9700 1 --2- 172.21.15.47:0/2016817778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf600fcfb0 0x7faf600fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:24.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.724+0000 7faf658f9700 1 --2- 172.21.15.47:0/2016817778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf600fbe40 0x7faf600fc250 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:24.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.724+0000 7faf658f9700 1 -- 172.21.15.47:0/2016817778 >> 172.21.15.47:0/2016817778 conn(0x7faf600f7520 msgr2=0x7faf600f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:24.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.724+0000 7faf658f9700 1 -- 172.21.15.47:0/2016817778 shutdown_connections 2024-02-07T12:24:24.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.724+0000 7faf658f9700 1 -- 172.21.15.47:0/2016817778 wait complete. 2024-02-07T12:24:24.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.725+0000 7faf658f9700 1 Processor -- start 2024-02-07T12:24:24.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.725+0000 7faf658f9700 1 -- start start 2024-02-07T12:24:24.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.725+0000 7faf658f9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf600fcfb0 0x7faf600fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:24.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.725+0000 7faf658f9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf600fe380 0x7faf600fe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:24.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.725+0000 7faf658f9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf601116e0 con 0x7faf600fe380 2024-02-07T12:24:24.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.725+0000 7faf658f9700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf60111820 con 0x7faf600fcfb0 2024-02-07T12:24:24.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.725+0000 7faf5effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf600fcfb0 0x7faf600fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:24.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.725+0000 7faf5effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf600fcfb0 0x7faf600fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.47:60434/0 (socket says 172.21.15.47:60434) 2024-02-07T12:24:24.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.725+0000 7faf5effd700 1 -- 172.21.15.47:0/951658140 learned_addr learned my addr 172.21.15.47:0/951658140 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:24:24.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.725+0000 7faf5e7fc700 1 --2- 172.21.15.47:0/951658140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf600fe380 0x7faf600fe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:24.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.726+0000 7faf5effd700 1 -- 172.21.15.47:0/951658140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf600fe380 msgr2=0x7faf600fe7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:24.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.726+0000 7faf5effd700 1 --2- 172.21.15.47:0/951658140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf600fe380 0x7faf600fe7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:24.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.726+0000 7faf5effd700 1 -- 172.21.15.47:0/951658140 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf50005040 con 0x7faf600fcfb0 2024-02-07T12:24:24.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.726+0000 7faf5e7fc700 1 --2- 172.21.15.47:0/951658140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf600fe380 0x7faf600fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-07T12:24:24.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.726+0000 7faf5effd700 1 --2- 172.21.15.47:0/951658140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf600fcfb0 0x7faf600fff00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf50000c00 tx=0x7faf50009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:24.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.726+0000 7faf477fe700 1 -- 172.21.15.47:0/951658140 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf50021070 con 0x7faf600fcfb0 2024-02-07T12:24:24.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.726+0000 7faf658f9700 1 -- 172.21.15.47:0/951658140 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf600fed90 con 0x7faf600fcfb0 2024-02-07T12:24:24.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.726+0000 7faf477fe700 1 -- 172.21.15.47:0/951658140 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf50013de0 con 0x7faf600fcfb0 2024-02-07T12:24:24.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.726+0000 7faf477fe700 1 -- 172.21.15.47:0/951658140 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf5000e070 con 0x7faf600fcfb0 2024-02-07T12:24:24.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.727+0000 7faf658f9700 1 -- 172.21.15.47:0/951658140 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6011a290 con 0x7faf600fcfb0 2024-02-07T12:24:24.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.728+0000 7faf658f9700 1 -- 172.21.15.47:0/951658140 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6004bed0 con 0x7faf600fcfb0 2024-02-07T12:24:24.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.728+0000 7faf477fe700 1 -- 172.21.15.47:0/951658140 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7faf5001c400 con 0x7faf600fcfb0 2024-02-07T12:24:24.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.729+0000 7faf477fe700 1 --2- 172.21.15.47:0/951658140 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7faf48068f60 0x7faf4806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:24.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.729+0000 7faf477fe700 1 -- 172.21.15.47:0/951658140 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7faf50087e80 con 0x7faf600fcfb0 2024-02-07T12:24:24.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.729+0000 7faf5e7fc700 1 --2- 172.21.15.47:0/951658140 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7faf48068f60 0x7faf4806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:24.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.729+0000 7faf5e7fc700 1 --2- 172.21.15.47:0/951658140 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7faf48068f60 0x7faf4806b410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf54009b80 tx=0x7faf5400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:24.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:24.737+0000 7faf477fe700 1 -- 172.21.15.47:0/951658140 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faf50057e30 con 0x7faf600fcfb0 2024-02-07T12:24:25.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.064+0000 7faf658f9700 1 -- 172.21.15.47:0/951658140 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faf60066660 con 0x7faf48068f60 2024-02-07T12:24:25.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.065+0000 7faf477fe700 1 -- 172.21.15.47:0/951658140 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7faf60066660 con 0x7faf48068f60 2024-02-07T12:24:25.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.068+0000 7faf658f9700 1 -- 172.21.15.47:0/951658140 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7faf48068f60 msgr2=0x7faf4806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:25.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.068+0000 7faf658f9700 1 --2- 172.21.15.47:0/951658140 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7faf48068f60 0x7faf4806b410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf54009b80 tx=0x7faf5400b040 comp rx=0 tx=0).stop 2024-02-07T12:24:25.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.068+0000 7faf658f9700 1 -- 172.21.15.47:0/951658140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf600fcfb0 msgr2=0x7faf600fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:25.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.068+0000 7faf658f9700 1 --2- 172.21.15.47:0/951658140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf600fcfb0 0x7faf600fff00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf50000c00 tx=0x7faf50009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.068+0000 7faf658f9700 1 -- 172.21.15.47:0/951658140 shutdown_connections 2024-02-07T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.068+0000 7faf658f9700 1 --2- 172.21.15.47:0/951658140 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7faf48068f60 0x7faf4806b410 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.068+0000 7faf658f9700 1 --2- 172.21.15.47:0/951658140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf600fcfb0 0x7faf600fff00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.068+0000 7faf658f9700 1 --2- 172.21.15.47:0/951658140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf600fe380 0x7faf600fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.068+0000 7faf658f9700 1 -- 172.21.15.47:0/951658140 >> 172.21.15.47:0/951658140 conn(0x7faf600f7520 msgr2=0x7faf60065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.069+0000 7faf658f9700 1 -- 172.21.15.47:0/951658140 shutdown_connections 2024-02-07T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.069+0000 7faf658f9700 1 -- 172.21.15.47:0/951658140 wait complete. 2024-02-07T12:24:25.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.212+0000 7fea393d4700 1 -- 172.21.15.47:0/930517729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea340fbe40 msgr2=0x7fea340fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:25.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.212+0000 7fea393d4700 1 --2- 172.21.15.47:0/930517729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea340fbe40 0x7fea340fc250 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fea24004940 tx=0x7fea24009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:25.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.212+0000 7fea393d4700 1 -- 172.21.15.47:0/930517729 shutdown_connections 2024-02-07T12:24:25.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.212+0000 7fea393d4700 1 --2- 172.21.15.47:0/930517729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea340fcfb0 0x7fea340fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:25.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.212+0000 7fea393d4700 1 --2- 172.21.15.47:0/930517729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea340fbe40 0x7fea340fc250 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:25.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.212+0000 7fea393d4700 1 -- 172.21.15.47:0/930517729 >> 172.21.15.47:0/930517729 conn(0x7fea340f7520 msgr2=0x7fea340f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:25.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.212+0000 7fea393d4700 1 -- 172.21.15.47:0/930517729 shutdown_connections 2024-02-07T12:24:25.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.212+0000 7fea393d4700 1 -- 172.21.15.47:0/930517729 wait complete. 2024-02-07T12:24:25.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.213+0000 7fea393d4700 1 Processor -- start 2024-02-07T12:24:25.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.213+0000 7fea393d4700 1 -- start start 2024-02-07T12:24:25.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.213+0000 7fea393d4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea340fbe40 0x7fea3410faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:25.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.214+0000 7fea393d4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea340fcfb0 0x7fea3410ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:25.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.214+0000 7fea393d4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea341105e0 con 0x7fea340fbe40 2024-02-07T12:24:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.214+0000 7fea393d4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea34110e80 con 0x7fea340fcfb0 2024-02-07T12:24:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.214+0000 7fea32ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea340fbe40 0x7fea3410faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.214+0000 7fea32ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea340fbe40 0x7fea3410faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45428/0 (socket says 172.21.15.47:45428) 2024-02-07T12:24:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.214+0000 7fea32ffd700 1 -- 172.21.15.47:0/2971331867 learned_addr learned my addr 172.21.15.47:0/2971331867 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:24:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.214+0000 7fea327fc700 1 --2- 172.21.15.47:0/2971331867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea340fcfb0 0x7fea3410ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.214+0000 7fea32ffd700 1 -- 172.21.15.47:0/2971331867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea340fcfb0 msgr2=0x7fea3410ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.214+0000 7fea32ffd700 1 --2- 172.21.15.47:0/2971331867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea340fcfb0 0x7fea3410ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.214+0000 7fea32ffd700 1 -- 172.21.15.47:0/2971331867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea24005040 con 0x7fea340fbe40 2024-02-07T12:24:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.214+0000 7fea327fc700 1 --2- 172.21.15.47:0/2971331867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea340fcfb0 0x7fea3410ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-07T12:24:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.214+0000 7fea32ffd700 1 --2- 172.21.15.47:0/2971331867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea340fbe40 0x7fea3410faa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fea24007d40 tx=0x7fea24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.215+0000 7fea1b7fe700 1 -- 172.21.15.47:0/2971331867 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea2400e070 con 0x7fea340fbe40 2024-02-07T12:24:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.215+0000 7fea1b7fe700 1 -- 172.21.15.47:0/2971331867 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea24009430 con 0x7fea340fbe40 2024-02-07T12:24:25.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.215+0000 7fea393d4700 1 -- 172.21.15.47:0/2971331867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea34111100 con 0x7fea340fbe40 2024-02-07T12:24:25.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.215+0000 7fea1b7fe700 1 -- 172.21.15.47:0/2971331867 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea2401c400 con 0x7fea340fbe40 2024-02-07T12:24:25.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.215+0000 7fea393d4700 1 -- 172.21.15.47:0/2971331867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea34111520 con 0x7fea340fbe40 2024-02-07T12:24:25.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.216+0000 7fea1b7fe700 1 -- 172.21.15.47:0/2971331867 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fea2401c560 con 0x7fea340fbe40 2024-02-07T12:24:25.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.217+0000 7fea393d4700 1 -- 172.21.15.47:0/2971331867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3404bed0 con 0x7fea340fbe40 2024-02-07T12:24:25.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.217+0000 7fea1b7fe700 1 --2- 172.21.15.47:0/2971331867 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fea1c068f50 0x7fea1c06b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:25.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.217+0000 7fea1b7fe700 1 -- 172.21.15.47:0/2971331867 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fea24088740 con 0x7fea340fbe40 2024-02-07T12:24:25.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.217+0000 7fea327fc700 1 --2- 172.21.15.47:0/2971331867 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fea1c068f50 0x7fea1c06b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:25.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.218+0000 7fea327fc700 1 --2- 172.21.15.47:0/2971331867 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fea1c068f50 0x7fea1c06b400 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fea28010520 tx=0x7fea2800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:25.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.222+0000 7fea1b7fe700 1 -- 172.21.15.47:0/2971331867 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fea24058650 con 0x7fea340fbe40 2024-02-07T12:24:25.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.582+0000 7fea393d4700 1 -- 172.21.15.47:0/2971331867 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fea34111d20 con 0x7fea1c068f50 2024-02-07T12:24:25.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.599+0000 7fea1b7fe700 1 -- 172.21.15.47:0/2971331867 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fea34111d20 con 0x7fea1c068f50 2024-02-07T12:24:25.601 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:24:25.601 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (5m) 64s ago 6m 26.9M - 0.25.0 c8568f914cd2 edd19ce884c8 2024-02-07T12:24:25.601 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (7m) 64s ago 7m 6660k - 17.2.7-491-gf2462625 4ad3622d1b31 bca7317ed169 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (6m) 69s ago 6m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 110c84c6624b 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (5m) 64s ago 6m 82.8M - 9.4.7 954c08fa6188 5b93631efbfc 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (82s) 64s ago 81s 16.7M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (88s) 64s ago 87s 14.7M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (79s) 69s ago 79s 14.8M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (85s) 69s ago 84s 11.3M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:9283 running (8m) 64s ago 8m 481M - 17.2.7-491-gf2462625 4ad3622d1b31 f3b25479d84e 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283 running (6m) 69s ago 6m 435M - 17.2.7-491-gf2462625 4ad3622d1b31 ad543214819c 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (8m) 64s ago 8m 42.4M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 105826d9ef9a 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (5m) 69s ago 5m 36.3M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 02dfa0b8d573 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (7m) 64s ago 7m 16.2M - 1.5.0 0da6a335fe13 ba35c488ed6d 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (6m) 69s ago 6m 15.2M - 1.5.0 0da6a335fe13 8823dad6f717 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (5m) 64s ago 5m 47.6M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 4f37918f583a 2024-02-07T12:24:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (4m) 64s ago 4m 46.3M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 1c6e3c603ed3 2024-02-07T12:24:25.603 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (4m) 64s ago 4m 44.7M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:24:25.603 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (3m) 69s ago 3m 48.0M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:24:25.603 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (3m) 69s ago 3m 41.9M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:24:25.603 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (2m) 69s ago 2m 44.7M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:24:25.603 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (5m) 64s ago 6m 55.1M - 2.43.0 a07b618ecd1d e41b94b0d167 2024-02-07T12:24:25.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.601+0000 7fea393d4700 1 -- 172.21.15.47:0/2971331867 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fea1c068f50 msgr2=0x7fea1c06b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:25.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.601+0000 7fea393d4700 1 --2- 172.21.15.47:0/2971331867 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fea1c068f50 0x7fea1c06b400 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fea28010520 tx=0x7fea2800b040 comp rx=0 tx=0).stop 2024-02-07T12:24:25.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.601+0000 7fea393d4700 1 -- 172.21.15.47:0/2971331867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea340fbe40 msgr2=0x7fea3410faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:25.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.601+0000 7fea393d4700 1 --2- 172.21.15.47:0/2971331867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea340fbe40 0x7fea3410faa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fea24007d40 tx=0x7fea24009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:25.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.602+0000 7fea393d4700 1 -- 172.21.15.47:0/2971331867 shutdown_connections 2024-02-07T12:24:25.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.602+0000 7fea393d4700 1 --2- 172.21.15.47:0/2971331867 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fea1c068f50 0x7fea1c06b400 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:25.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.602+0000 7fea393d4700 1 --2- 172.21.15.47:0/2971331867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea340fbe40 0x7fea3410faa0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:25.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.602+0000 7fea393d4700 1 --2- 172.21.15.47:0/2971331867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea340fcfb0 0x7fea3410ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:25.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.602+0000 7fea393d4700 1 -- 172.21.15.47:0/2971331867 >> 172.21.15.47:0/2971331867 conn(0x7fea340f7520 msgr2=0x7fea34100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:25.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.602+0000 7fea393d4700 1 -- 172.21.15.47:0/2971331867 shutdown_connections 2024-02-07T12:24:25.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.602+0000 7fea393d4700 1 -- 172.21.15.47:0/2971331867 wait complete. 2024-02-07T12:24:25.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.758+0000 7f50b8916700 1 -- 172.21.15.47:0/3233190446 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50a800bcb0 con 0x7f50b406eeb0 2024-02-07T12:24:25.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.758+0000 7f50bbb7c700 1 -- 172.21.15.47:0/3233190446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50b406eeb0 msgr2=0x7f50b4108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:25.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.758+0000 7f50bbb7c700 1 --2- 172.21.15.47:0/3233190446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50b406eeb0 0x7f50b4108fb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f50a8004940 tx=0x7f50a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:25.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.758+0000 7f50bbb7c700 1 -- 172.21.15.47:0/3233190446 shutdown_connections 2024-02-07T12:24:25.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.758+0000 7f50bbb7c700 1 --2- 172.21.15.47:0/3233190446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50b406eeb0 0x7f50b4108fb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:25.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.758+0000 7f50bbb7c700 1 --2- 172.21.15.47:0/3233190446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50b406e560 0x7f50b406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:25.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.759+0000 7f50bbb7c700 1 -- 172.21.15.47:0/3233190446 >> 172.21.15.47:0/3233190446 conn(0x7f50b4069e70 msgr2=0x7f50b406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:25.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.759+0000 7f50bbb7c700 1 -- 172.21.15.47:0/3233190446 shutdown_connections 2024-02-07T12:24:25.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.759+0000 7f50bbb7c700 1 -- 172.21.15.47:0/3233190446 wait complete. 2024-02-07T12:24:25.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.760+0000 7f50bbb7c700 1 Processor -- start 2024-02-07T12:24:25.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.760+0000 7f50bbb7c700 1 -- start start 2024-02-07T12:24:25.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.760+0000 7f50bbb7c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50b406e560 0x7f50b4112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:25.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.760+0000 7f50bbb7c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50b4113490 0x7f50b41265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:25.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.760+0000 7f50bbb7c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4113950 con 0x7f50b406e560 2024-02-07T12:24:25.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.760+0000 7f50bbb7c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4113a90 con 0x7f50b4113490 2024-02-07T12:24:25.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.760+0000 7f50b9918700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50b406e560 0x7f50b4112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:25.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.760+0000 7f50b9918700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50b406e560 0x7f50b4112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45444/0 (socket says 172.21.15.47:45444) 2024-02-07T12:24:25.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.760+0000 7f50b9918700 1 -- 172.21.15.47:0/287980246 learned_addr learned my addr 172.21.15.47:0/287980246 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:24:25.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.760+0000 7f50b9117700 1 --2- 172.21.15.47:0/287980246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50b4113490 0x7f50b41265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:25.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.761+0000 7f50b9918700 1 -- 172.21.15.47:0/287980246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50b4113490 msgr2=0x7f50b41265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:25.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.761+0000 7f50b9918700 1 --2- 172.21.15.47:0/287980246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50b4113490 0x7f50b41265e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:25.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.761+0000 7f50b9918700 1 -- 172.21.15.47:0/287980246 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a8005040 con 0x7f50b406e560 2024-02-07T12:24:25.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.761+0000 7f50b9117700 1 --2- 172.21.15.47:0/287980246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50b4113490 0x7f50b41265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:24:25.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.761+0000 7f50b9918700 1 --2- 172.21.15.47:0/287980246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50b406e560 0x7f50b4112f50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f50ac001ce0 tx=0x7f50ac009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:25.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.761+0000 7f50b27fc700 1 -- 172.21.15.47:0/287980246 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50ac00db60 con 0x7f50b406e560 2024-02-07T12:24:25.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.761+0000 7f50b27fc700 1 -- 172.21.15.47:0/287980246 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50ac00f040 con 0x7f50b406e560 2024-02-07T12:24:25.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.761+0000 7f50b27fc700 1 -- 172.21.15.47:0/287980246 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50ac009790 con 0x7f50b406e560 2024-02-07T12:24:25.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.762+0000 7f50bbb7c700 1 -- 172.21.15.47:0/287980246 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b4126c40 con 0x7f50b406e560 2024-02-07T12:24:25.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.762+0000 7f50bbb7c700 1 -- 172.21.15.47:0/287980246 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b4127100 con 0x7f50b406e560 2024-02-07T12:24:25.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.763+0000 7f50bbb7c700 1 -- 172.21.15.47:0/287980246 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b410cd10 con 0x7f50b406e560 2024-02-07T12:24:25.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.764+0000 7f50b27fc700 1 -- 172.21.15.47:0/287980246 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f50ac007920 con 0x7f50b406e560 2024-02-07T12:24:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.765+0000 7f50b27fc700 1 --2- 172.21.15.47:0/287980246 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f509c069020 0x7f509c06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.765+0000 7f50b27fc700 1 -- 172.21.15.47:0/287980246 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f50ac086820 con 0x7f50b406e560 2024-02-07T12:24:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.765+0000 7f50b9117700 1 --2- 172.21.15.47:0/287980246 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f509c069020 0x7f509c06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.766+0000 7f50b9117700 1 --2- 172.21.15.47:0/287980246 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f509c069020 0x7f509c06b4d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f50a800b840 tx=0x7f50a8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:25.772+0000 7f50b27fc700 1 -- 172.21.15.47:0/287980246 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f50ac056880 con 0x7f50b406e560 2024-02-07T12:24:25.981 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:25 smithi047 ceph-mon[28972]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:24:25.982 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:25 smithi047 ceph-mon[28972]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-02-07T12:24:25.982 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:25 smithi047 ceph-mon[28972]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:24:26.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.239+0000 7f50bbb7c700 1 -- 172.21.15.47:0/287980246 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f50b41148f0 con 0x7f50b406e560 2024-02-07T12:24:26.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.240+0000 7f50b27fc700 1 -- 172.21.15.47:0/287980246 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f50ac056410 con 0x7f50b406e560 2024-02-07T12:24:26.243 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:24:26.243 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:24:26.243 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2 2024-02-07T12:24:26.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:24:26.243 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:24:26.243 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2 2024-02-07T12:24:26.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:24:26.244 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:24:26.244 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 6 2024-02-07T12:24:26.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:24:26.244 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:24:26.244 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:24:26.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:24:26.244 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:24:26.244 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 14 2024-02-07T12:24:26.244 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:24:26.244 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:24:26.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.243+0000 7f50bbb7c700 1 -- 172.21.15.47:0/287980246 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f509c069020 msgr2=0x7f509c06b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:26.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.243+0000 7f50bbb7c700 1 --2- 172.21.15.47:0/287980246 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f509c069020 0x7f509c06b4d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f50a800b840 tx=0x7f50a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:26.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.243+0000 7f50bbb7c700 1 -- 172.21.15.47:0/287980246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50b406e560 msgr2=0x7f50b4112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:26.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.243+0000 7f50bbb7c700 1 --2- 172.21.15.47:0/287980246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50b406e560 0x7f50b4112f50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f50ac001ce0 tx=0x7f50ac009e60 comp rx=0 tx=0).stop 2024-02-07T12:24:26.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.243+0000 7f50bbb7c700 1 -- 172.21.15.47:0/287980246 shutdown_connections 2024-02-07T12:24:26.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.243+0000 7f50bbb7c700 1 --2- 172.21.15.47:0/287980246 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f509c069020 0x7f509c06b4d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:26.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.243+0000 7f50bbb7c700 1 --2- 172.21.15.47:0/287980246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50b406e560 0x7f50b4112f50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:26.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.243+0000 7f50bbb7c700 1 --2- 172.21.15.47:0/287980246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50b4113490 0x7f50b41265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:26.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.243+0000 7f50bbb7c700 1 -- 172.21.15.47:0/287980246 >> 172.21.15.47:0/287980246 conn(0x7f50b4069e70 msgr2=0x7f50b4107830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:26.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.244+0000 7f50bbb7c700 1 -- 172.21.15.47:0/287980246 shutdown_connections 2024-02-07T12:24:26.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.244+0000 7f50bbb7c700 1 -- 172.21.15.47:0/287980246 wait complete. 2024-02-07T12:24:26.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:25 smithi138 ceph-mon[35528]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:24:26.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:25 smithi138 ceph-mon[35528]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-02-07T12:24:26.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:25 smithi138 ceph-mon[35528]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:24:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.403+0000 7fb7331d5700 1 -- 172.21.15.47:0/2350530833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0fcfb0 msgr2=0x7fb72c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.403+0000 7fb7331d5700 1 --2- 172.21.15.47:0/2350530833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0fcfb0 0x7fb72c0fd420 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb720004940 tx=0x7fb720009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.404+0000 7fb7331d5700 1 -- 172.21.15.47:0/2350530833 shutdown_connections 2024-02-07T12:24:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.404+0000 7fb7331d5700 1 --2- 172.21.15.47:0/2350530833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0fcfb0 0x7fb72c0fd420 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.404+0000 7fb7331d5700 1 --2- 172.21.15.47:0/2350530833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0fbe40 0x7fb72c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.404+0000 7fb7331d5700 1 -- 172.21.15.47:0/2350530833 >> 172.21.15.47:0/2350530833 conn(0x7fb72c0f7520 msgr2=0x7fb72c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.404+0000 7fb7331d5700 1 -- 172.21.15.47:0/2350530833 shutdown_connections 2024-02-07T12:24:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.404+0000 7fb7331d5700 1 -- 172.21.15.47:0/2350530833 wait complete. 2024-02-07T12:24:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.404+0000 7fb7331d5700 1 Processor -- start 2024-02-07T12:24:26.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.404+0000 7fb7331d5700 1 -- start start 2024-02-07T12:24:26.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.405+0000 7fb7331d5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0fbe40 0x7fb72c10fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:26.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.405+0000 7fb7331d5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0fcfb0 0x7fb72c10ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:26.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.405+0000 7fb7331d5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c1105d0 con 0x7fb72c0fbe40 2024-02-07T12:24:26.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.405+0000 7fb7331d5700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c110e70 con 0x7fb72c0fcfb0 2024-02-07T12:24:26.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.405+0000 7fb730f71700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0fbe40 0x7fb72c10fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:26.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.405+0000 7fb72bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0fcfb0 0x7fb72c10ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:26.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.405+0000 7fb730f71700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0fbe40 0x7fb72c10fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45466/0 (socket says 172.21.15.47:45466) 2024-02-07T12:24:26.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.405+0000 7fb72bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0fcfb0 0x7fb72c10ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.47:60494/0 (socket says 172.21.15.47:60494) 2024-02-07T12:24:26.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.405+0000 7fb730f71700 1 -- 172.21.15.47:0/282413161 learned_addr learned my addr 172.21.15.47:0/282413161 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:24:26.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.406+0000 7fb72bfff700 1 -- 172.21.15.47:0/282413161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0fbe40 msgr2=0x7fb72c10fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:26.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.406+0000 7fb72bfff700 1 --2- 172.21.15.47:0/282413161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0fbe40 0x7fb72c10fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:26.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.406+0000 7fb72bfff700 1 -- 172.21.15.47:0/282413161 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720005040 con 0x7fb72c0fcfb0 2024-02-07T12:24:26.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.406+0000 7fb730f71700 1 --2- 172.21.15.47:0/282413161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0fbe40 0x7fb72c10fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-07T12:24:26.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.406+0000 7fb72bfff700 1 --2- 172.21.15.47:0/282413161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0fcfb0 0x7fb72c10ffd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb720009fd0 tx=0x7fb720009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:26.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.406+0000 7fb7297fa700 1 -- 172.21.15.47:0/282413161 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb720021070 con 0x7fb72c0fcfb0 2024-02-07T12:24:26.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.406+0000 7fb7331d5700 1 -- 172.21.15.47:0/282413161 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72c111070 con 0x7fb72c0fcfb0 2024-02-07T12:24:26.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.406+0000 7fb7331d5700 1 -- 172.21.15.47:0/282413161 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72c111550 con 0x7fb72c0fcfb0 2024-02-07T12:24:26.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.406+0000 7fb7297fa700 1 -- 172.21.15.47:0/282413161 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb72001c400 con 0x7fb72c0fcfb0 2024-02-07T12:24:26.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.406+0000 7fb7297fa700 1 -- 172.21.15.47:0/282413161 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb72000e070 con 0x7fb72c0fcfb0 2024-02-07T12:24:26.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.408+0000 7fb7331d5700 1 -- 172.21.15.47:0/282413161 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7100052e0 con 0x7fb72c0fcfb0 2024-02-07T12:24:26.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.409+0000 7fb7297fa700 1 -- 172.21.15.47:0/282413161 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb720013a50 con 0x7fb72c0fcfb0 2024-02-07T12:24:26.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.410+0000 7fb7297fa700 1 --2- 172.21.15.47:0/282413161 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb71c068f60 0x7fb71c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:26.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.410+0000 7fb7297fa700 1 -- 172.21.15.47:0/282413161 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb720087ed0 con 0x7fb72c0fcfb0 2024-02-07T12:24:26.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.410+0000 7fb730f71700 1 --2- 172.21.15.47:0/282413161 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb71c068f60 0x7fb71c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:26.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.410+0000 7fb730f71700 1 --2- 172.21.15.47:0/282413161 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb71c068f60 0x7fb71c06b410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb7180041d0 tx=0x7fb71800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:26.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.418+0000 7fb7297fa700 1 -- 172.21.15.47:0/282413161 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb720057dc0 con 0x7fb72c0fcfb0 2024-02-07T12:24:26.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.737+0000 7fb7331d5700 1 -- 172.21.15.47:0/282413161 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb710005da0 con 0x7fb72c0fcfb0 2024-02-07T12:24:26.740 INFO:teuthology.orchestra.run.smithi047.stdout:e18 2024-02-07T12:24:26.740 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:24:26.740 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:24:26.740 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:24:26.740 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:24:26.740 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:24:26.741 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:24:26.741 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 18 2024-02-07T12:24:26.741 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:24:26.741 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:24:26.741 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:23:12.341179+0000 2024-02-07T12:24:26.741 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:24:26.741 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:24:26.741 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:24:26.741 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:24:26.741 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:24:26.741 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:24:26.742 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:24:26.742 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:24:26.742 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:24:26.742 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:24:26.742 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:24:26.742 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:24:26.742 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:24:26.742 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:24:26.742 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:24:26.742 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:24:26.742 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:24:26.742 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:24:26.743 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:24:26.743 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:24:26.743 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:24:26.743 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:24:26.743 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:24:26.743 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:24:26.743 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:24:26.743 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:24:26.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.737+0000 7fb7297fa700 1 -- 172.21.15.47:0/282413161 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1834 (secure 0 0 0) 0x7fb720057950 con 0x7fb72c0fcfb0 2024-02-07T12:24:26.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.741+0000 7fb7331d5700 1 -- 172.21.15.47:0/282413161 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb71c068f60 msgr2=0x7fb71c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:26.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.741+0000 7fb7331d5700 1 --2- 172.21.15.47:0/282413161 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb71c068f60 0x7fb71c06b410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb7180041d0 tx=0x7fb71800b040 comp rx=0 tx=0).stop 2024-02-07T12:24:26.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.741+0000 7fb7331d5700 1 -- 172.21.15.47:0/282413161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0fcfb0 msgr2=0x7fb72c10ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:26.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.741+0000 7fb7331d5700 1 --2- 172.21.15.47:0/282413161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0fcfb0 0x7fb72c10ffd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb720009fd0 tx=0x7fb720009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:26.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.741+0000 7fb7331d5700 1 -- 172.21.15.47:0/282413161 shutdown_connections 2024-02-07T12:24:26.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.741+0000 7fb7331d5700 1 --2- 172.21.15.47:0/282413161 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fb71c068f60 0x7fb71c06b410 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:26.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.741+0000 7fb7331d5700 1 --2- 172.21.15.47:0/282413161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0fbe40 0x7fb72c10fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:26.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.741+0000 7fb7331d5700 1 --2- 172.21.15.47:0/282413161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0fcfb0 0x7fb72c10ffd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:26.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.741+0000 7fb7331d5700 1 -- 172.21.15.47:0/282413161 >> 172.21.15.47:0/282413161 conn(0x7fb72c0f7520 msgr2=0x7fb72c1020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:26.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.743+0000 7fb7331d5700 1 -- 172.21.15.47:0/282413161 shutdown_connections 2024-02-07T12:24:26.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.743+0000 7fb7331d5700 1 -- 172.21.15.47:0/282413161 wait complete. 2024-02-07T12:24:26.746 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 18 2024-02-07T12:24:26.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.877+0000 7fc2b9a24700 1 -- 172.21.15.47:0/775768768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b41000c0 msgr2=0x7fc2b4102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:26.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.877+0000 7fc2b9a24700 1 --2- 172.21.15.47:0/775768768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b41000c0 0x7fc2b4102520 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8004940 tx=0x7fc2a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:26.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.877+0000 7fc2b9a24700 1 -- 172.21.15.47:0/775768768 shutdown_connections 2024-02-07T12:24:26.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.877+0000 7fc2b9a24700 1 --2- 172.21.15.47:0/775768768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b41000c0 0x7fc2b4102520 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:26.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.877+0000 7fc2b9a24700 1 --2- 172.21.15.47:0/775768768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2b4066c70 0x7fc2b40ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:26.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.877+0000 7fc2b9a24700 1 -- 172.21.15.47:0/775768768 >> 172.21.15.47:0/775768768 conn(0x7fc2b40f7500 msgr2=0x7fc2b40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:26.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.877+0000 7fc2b9a24700 1 -- 172.21.15.47:0/775768768 shutdown_connections 2024-02-07T12:24:26.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.877+0000 7fc2b9a24700 1 -- 172.21.15.47:0/775768768 wait complete. 2024-02-07T12:24:26.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.878+0000 7fc2b9a24700 1 Processor -- start 2024-02-07T12:24:26.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.878+0000 7fc2b9a24700 1 -- start start 2024-02-07T12:24:26.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.879+0000 7fc2b9a24700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2b4066c70 0x7fc2b410d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:26.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.879+0000 7fc2b9a24700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b41000c0 0x7fc2b410de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:26.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.879+0000 7fc2b9a24700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b410e450 con 0x7fc2b41000c0 2024-02-07T12:24:26.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.879+0000 7fc2b9a24700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b410ecf0 con 0x7fc2b4066c70 2024-02-07T12:24:26.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.879+0000 7fc2b27fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b41000c0 0x7fc2b410de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:26.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.879+0000 7fc2b27fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b41000c0 0x7fc2b410de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45482/0 (socket says 172.21.15.47:45482) 2024-02-07T12:24:26.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.879+0000 7fc2b27fc700 1 -- 172.21.15.47:0/2823961351 learned_addr learned my addr 172.21.15.47:0/2823961351 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:24:26.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.879+0000 7fc2b2ffd700 1 --2- 172.21.15.47:0/2823961351 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2b4066c70 0x7fc2b410d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:26.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.879+0000 7fc2b27fc700 1 -- 172.21.15.47:0/2823961351 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2b4066c70 msgr2=0x7fc2b410d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:26.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.879+0000 7fc2b27fc700 1 --2- 172.21.15.47:0/2823961351 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2b4066c70 0x7fc2b410d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:26.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.879+0000 7fc2b27fc700 1 -- 172.21.15.47:0/2823961351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8005040 con 0x7fc2b41000c0 2024-02-07T12:24:26.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.880+0000 7fc2b27fc700 1 --2- 172.21.15.47:0/2823961351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b41000c0 0x7fc2b410de50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009040 tx=0x7fc2a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:26.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.880+0000 7fc29b7fe700 1 -- 172.21.15.47:0/2823961351 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a8021070 con 0x7fc2b41000c0 2024-02-07T12:24:26.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.880+0000 7fc29b7fe700 1 -- 172.21.15.47:0/2823961351 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2a801c400 con 0x7fc2b41000c0 2024-02-07T12:24:26.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.880+0000 7fc29b7fe700 1 -- 172.21.15.47:0/2823961351 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a800e070 con 0x7fc2b41000c0 2024-02-07T12:24:26.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.880+0000 7fc2b9a24700 1 -- 172.21.15.47:0/2823961351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b410ef70 con 0x7fc2b41000c0 2024-02-07T12:24:26.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.880+0000 7fc2b9a24700 1 -- 172.21.15.47:0/2823961351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b410f390 con 0x7fc2b41000c0 2024-02-07T12:24:26.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.881+0000 7fc2b9a24700 1 -- 172.21.15.47:0/2823961351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b404bed0 con 0x7fc2b41000c0 2024-02-07T12:24:26.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.882+0000 7fc29b7fe700 1 -- 172.21.15.47:0/2823961351 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc2a801ca00 con 0x7fc2b41000c0 2024-02-07T12:24:26.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.883+0000 7fc29b7fe700 1 --2- 172.21.15.47:0/2823961351 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fc29c068f70 0x7fc29c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:26.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.883+0000 7fc29b7fe700 1 -- 172.21.15.47:0/2823961351 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc2a8087f60 con 0x7fc2b41000c0 2024-02-07T12:24:26.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.883+0000 7fc2b2ffd700 1 --2- 172.21.15.47:0/2823961351 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fc29c068f70 0x7fc29c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:26.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.884+0000 7fc2b2ffd700 1 --2- 172.21.15.47:0/2823961351 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fc29c068f70 0x7fc29c06b420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4004600 tx=0x7fc2a400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:26.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:26.888+0000 7fc29b7fe700 1 -- 172.21.15.47:0/2823961351 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc2a80b9a00 con 0x7fc2b41000c0 2024-02-07T12:24:27.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:26 smithi047 ceph-mon[28972]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:24:27.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:26 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/287980246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:24:27.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:26 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/282413161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:24:27.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.265+0000 7fc2b9a24700 1 -- 172.21.15.47:0/2823961351 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2b410fb20 con 0x7fc29c068f70 2024-02-07T12:24:27.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.266+0000 7fc29b7fe700 1 -- 172.21.15.47:0/2823961351 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fc2b410fb20 con 0x7fc29c068f70 2024-02-07T12:24:27.268 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:24:27.269 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:44458ccedb18241cc2e17f10cdab3d1385399261", 2024-02-07T12:24:27.269 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:24:27.269 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:24:27.269 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [], 2024-02-07T12:24:27.269 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "", 2024-02-07T12:24:27.269 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:44458ccedb18241cc2e17f10cdab3d1385399261 image", 2024-02-07T12:24:27.269 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:24:27.269 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:24:27.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.269+0000 7fc2b9a24700 1 -- 172.21.15.47:0/2823961351 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fc29c068f70 msgr2=0x7fc29c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:27.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.269+0000 7fc2b9a24700 1 --2- 172.21.15.47:0/2823961351 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fc29c068f70 0x7fc29c06b420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4004600 tx=0x7fc2a400b040 comp rx=0 tx=0).stop 2024-02-07T12:24:27.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.269+0000 7fc2b9a24700 1 -- 172.21.15.47:0/2823961351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b41000c0 msgr2=0x7fc2b410de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:27.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.269+0000 7fc2b9a24700 1 --2- 172.21.15.47:0/2823961351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b41000c0 0x7fc2b410de50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009040 tx=0x7fc2a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:27.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.269+0000 7fc2b9a24700 1 -- 172.21.15.47:0/2823961351 shutdown_connections 2024-02-07T12:24:27.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.269+0000 7fc2b9a24700 1 --2- 172.21.15.47:0/2823961351 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fc29c068f70 0x7fc29c06b420 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:27.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.269+0000 7fc2b9a24700 1 --2- 172.21.15.47:0/2823961351 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2b4066c70 0x7fc2b410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:27.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.269+0000 7fc2b9a24700 1 --2- 172.21.15.47:0/2823961351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b41000c0 0x7fc2b410de50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:27.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.269+0000 7fc2b9a24700 1 -- 172.21.15.47:0/2823961351 >> 172.21.15.47:0/2823961351 conn(0x7fc2b40f7500 msgr2=0x7fc2b40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:27.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.270+0000 7fc2b9a24700 1 -- 172.21.15.47:0/2823961351 shutdown_connections 2024-02-07T12:24:27.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.270+0000 7fc2b9a24700 1 -- 172.21.15.47:0/2823961351 wait complete. 2024-02-07T12:24:27.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:26 smithi138 ceph-mon[35528]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:24:27.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:26 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/287980246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:24:27.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:26 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/282413161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:24:27.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.440+0000 7f558ab8a700 1 -- 172.21.15.47:0/3580746868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55840fb5e0 msgr2=0x7f55840fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:27.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.440+0000 7f558ab8a700 1 --2- 172.21.15.47:0/3580746868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55840fb5e0 0x7f55840fb9f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f55780049f0 tx=0x7f557800ae80 comp rx=0 tx=0).stop 2024-02-07T12:24:27.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.440+0000 7f558ab8a700 1 -- 172.21.15.47:0/3580746868 shutdown_connections 2024-02-07T12:24:27.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.440+0000 7f558ab8a700 1 --2- 172.21.15.47:0/3580746868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55840fc7f0 0x7f55840fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:27.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.440+0000 7f558ab8a700 1 --2- 172.21.15.47:0/3580746868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55840fb5e0 0x7f55840fb9f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:27.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.440+0000 7f558ab8a700 1 -- 172.21.15.47:0/3580746868 >> 172.21.15.47:0/3580746868 conn(0x7f55840f6ca0 msgr2=0x7f55840f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:27.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.440+0000 7f558ab8a700 1 -- 172.21.15.47:0/3580746868 shutdown_connections 2024-02-07T12:24:27.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.440+0000 7f558ab8a700 1 -- 172.21.15.47:0/3580746868 wait complete. 2024-02-07T12:24:27.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.441+0000 7f558ab8a700 1 Processor -- start 2024-02-07T12:24:27.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.441+0000 7f558ab8a700 1 -- start start 2024-02-07T12:24:27.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.442+0000 7f558ab8a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55840fb5e0 0x7f558410b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:27.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.442+0000 7f558ab8a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55840fc7f0 0x7f558410bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:27.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.442+0000 7f558ab8a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558410c370 con 0x7f55840fb5e0 2024-02-07T12:24:27.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.442+0000 7f558ab8a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558410cc10 con 0x7f55840fc7f0 2024-02-07T12:24:27.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.442+0000 7f5588926700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55840fb5e0 0x7f558410b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:27.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.442+0000 7f5588926700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55840fb5e0 0x7f558410b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45492/0 (socket says 172.21.15.47:45492) 2024-02-07T12:24:27.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.442+0000 7f5588926700 1 -- 172.21.15.47:0/3035617071 learned_addr learned my addr 172.21.15.47:0/3035617071 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:24:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.442+0000 7f5583fff700 1 --2- 172.21.15.47:0/3035617071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55840fc7f0 0x7f558410bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.442+0000 7f5588926700 1 -- 172.21.15.47:0/3035617071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55840fc7f0 msgr2=0x7f558410bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.442+0000 7f5588926700 1 --2- 172.21.15.47:0/3035617071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55840fc7f0 0x7f558410bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.442+0000 7f5588926700 1 -- 172.21.15.47:0/3035617071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578005040 con 0x7f55840fb5e0 2024-02-07T12:24:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.443+0000 7f5583fff700 1 --2- 172.21.15.47:0/3035617071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55840fc7f0 0x7f558410bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:24:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.443+0000 7f5588926700 1 --2- 172.21.15.47:0/3035617071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55840fb5e0 0x7f558410b830 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5578000c00 tx=0x7f557800ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.443+0000 7f55817fa700 1 -- 172.21.15.47:0/3035617071 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f557800fbd0 con 0x7f55840fb5e0 2024-02-07T12:24:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.443+0000 7f55817fa700 1 -- 172.21.15.47:0/3035617071 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f557800fd30 con 0x7f55840fb5e0 2024-02-07T12:24:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.443+0000 7f55817fa700 1 -- 172.21.15.47:0/3035617071 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5578021860 con 0x7f55840fb5e0 2024-02-07T12:24:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.443+0000 7f558ab8a700 1 -- 172.21.15.47:0/3035617071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558410ce90 con 0x7f55840fb5e0 2024-02-07T12:24:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.443+0000 7f558ab8a700 1 -- 172.21.15.47:0/3035617071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558410d320 con 0x7f55840fb5e0 2024-02-07T12:24:27.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.445+0000 7f558ab8a700 1 -- 172.21.15.47:0/3035617071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5584105880 con 0x7f55840fb5e0 2024-02-07T12:24:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.446+0000 7f55817fa700 1 -- 172.21.15.47:0/3035617071 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f557802b440 con 0x7f55840fb5e0 2024-02-07T12:24:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.446+0000 7f55817fa700 1 --2- 172.21.15.47:0/3035617071 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f5574068fb0 0x7f557406b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.447+0000 7f55817fa700 1 -- 172.21.15.47:0/3035617071 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f557808c280 con 0x7f55840fb5e0 2024-02-07T12:24:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.447+0000 7f5583fff700 1 --2- 172.21.15.47:0/3035617071 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f5574068fb0 0x7f557406b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.447+0000 7f5583fff700 1 --2- 172.21.15.47:0/3035617071 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f5574068fb0 0x7f557406b460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5570004620 tx=0x7f5570009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:27.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.455+0000 7f55817fa700 1 -- 172.21.15.47:0/3035617071 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f557805c130 con 0x7f55840fb5e0 2024-02-07T12:24:27.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.932+0000 7f558ab8a700 1 -- 172.21.15.47:0/3035617071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f558404bed0 con 0x7f55840fb5e0 2024-02-07T12:24:27.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.933+0000 7f55817fa700 1 -- 172.21.15.47:0/3035617071 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f557805bcc0 con 0x7f55840fb5e0 2024-02-07T12:24:27.936 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:24:27.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.936+0000 7f558ab8a700 1 -- 172.21.15.47:0/3035617071 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f5574068fb0 msgr2=0x7f557406b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:27.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.936+0000 7f558ab8a700 1 --2- 172.21.15.47:0/3035617071 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f5574068fb0 0x7f557406b460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5570004620 tx=0x7f5570009040 comp rx=0 tx=0).stop 2024-02-07T12:24:27.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.936+0000 7f558ab8a700 1 -- 172.21.15.47:0/3035617071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55840fb5e0 msgr2=0x7f558410b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:27.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.936+0000 7f558ab8a700 1 --2- 172.21.15.47:0/3035617071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55840fb5e0 0x7f558410b830 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5578000c00 tx=0x7f557800ae80 comp rx=0 tx=0).stop 2024-02-07T12:24:27.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.937+0000 7f558ab8a700 1 -- 172.21.15.47:0/3035617071 shutdown_connections 2024-02-07T12:24:27.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.937+0000 7f558ab8a700 1 --2- 172.21.15.47:0/3035617071 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f5574068fb0 0x7f557406b460 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:27.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.937+0000 7f558ab8a700 1 --2- 172.21.15.47:0/3035617071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55840fb5e0 0x7f558410b830 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:27.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.937+0000 7f558ab8a700 1 --2- 172.21.15.47:0/3035617071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55840fc7f0 0x7f558410bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:27.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.937+0000 7f558ab8a700 1 -- 172.21.15.47:0/3035617071 >> 172.21.15.47:0/3035617071 conn(0x7f55840f6ca0 msgr2=0x7f55840f8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:27.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.937+0000 7f558ab8a700 1 -- 172.21.15.47:0/3035617071 shutdown_connections 2024-02-07T12:24:27.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:27.937+0000 7f558ab8a700 1 -- 172.21.15.47:0/3035617071 wait complete. 2024-02-07T12:24:28.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:27 smithi138 ceph-mon[35528]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-07T12:24:28.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:27 smithi138 ceph-mon[35528]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:24:28.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:27 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3035617071' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:24:28.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:27 smithi047 ceph-mon[28972]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-07T12:24:28.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:27 smithi047 ceph-mon[28972]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:24:28.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:27 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3035617071' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:24:30.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:29 smithi138 ceph-mon[35528]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-07T12:24:30.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:29 smithi047 ceph-mon[28972]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-07T12:24:31.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:31 smithi138 ceph-mon[35528]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-07T12:24:31.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:31 smithi047 ceph-mon[28972]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-07T12:24:34.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:33 smithi138 ceph-mon[35528]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-07T12:24:34.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:33 smithi047 ceph-mon[28972]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-07T12:24:35.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:24:35.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:35 smithi047 ceph-mon[28972]: Upgrade: Target is version 19.0.0-1252-g44458cce (unknown) 2024-02-07T12:24:35.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:35 smithi047 ceph-mon[28972]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, digests ['quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe'] 2024-02-07T12:24:35.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:24:35.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:35 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:24:35.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:35 smithi047 ceph-mon[28972]: Upgrade: Need to upgrade myself (mgr.smithi047.zhgnrm) 2024-02-07T12:24:35.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:24:35.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:35 smithi138 ceph-mon[35528]: Upgrade: Target is version 19.0.0-1252-g44458cce (unknown) 2024-02-07T12:24:35.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:35 smithi138 ceph-mon[35528]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, digests ['quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe'] 2024-02-07T12:24:35.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:24:35.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:35 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:24:35.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:35 smithi138 ceph-mon[35528]: Upgrade: Need to upgrade myself (mgr.smithi047.zhgnrm) 2024-02-07T12:24:36.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:36 smithi047 ceph-mon[28972]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe on smithi138 2024-02-07T12:24:36.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:36 smithi047 ceph-mon[28972]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:24:36.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:36 smithi138 ceph-mon[35528]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe on smithi138 2024-02-07T12:24:36.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:36 smithi138 ceph-mon[35528]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:24:37.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:37 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:24:37.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:37 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:24:38.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:38 smithi047 ceph-mon[28972]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:38.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:38 smithi138 ceph-mon[35528]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:40.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:40 smithi047 ceph-mon[28972]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:40.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:40 smithi138 ceph-mon[35528]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:41.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:41 smithi138 ceph-mon[35528]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:24:41.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:41 smithi047 ceph-mon[28972]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:24:44.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:43 smithi138 ceph-mon[35528]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:44.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:43 smithi047 ceph-mon[28972]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:46.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:45 smithi047 ceph-mon[28972]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:24:46.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:45 smithi138 ceph-mon[35528]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:24:48.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:47 smithi138 ceph-mon[35528]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:48.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:47 smithi047 ceph-mon[28972]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:50.182 INFO:tasks.workunit.client.1.smithi138.stderr:Updating files: 94% (11540/12223) Updating files: 95% (11612/12223) Updating files: 96% (11735/12223) Updating files: 97% (11857/12223) Updating files: 98% (11979/12223) Updating files: 99% (12101/12223) Updating files: 100% (12223/12223) Updating files: 100% (12223/12223), done. 2024-02-07T12:24:50.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:49 smithi138 ceph-mon[35528]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:50.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:49 smithi047 ceph-mon[28972]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:50.375 INFO:tasks.workunit.client.1.smithi138.stderr:Note: switching to '44458ccedb18241cc2e17f10cdab3d1385399261'. 2024-02-07T12:24:50.376 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-07T12:24:50.376 INFO:tasks.workunit.client.1.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-07T12:24:50.376 INFO:tasks.workunit.client.1.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-07T12:24:50.376 INFO:tasks.workunit.client.1.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-02-07T12:24:50.376 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-07T12:24:50.376 INFO:tasks.workunit.client.1.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-07T12:24:50.376 INFO:tasks.workunit.client.1.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-07T12:24:50.377 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-07T12:24:50.377 INFO:tasks.workunit.client.1.smithi138.stderr: git switch -c 2024-02-07T12:24:50.377 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-07T12:24:50.377 INFO:tasks.workunit.client.1.smithi138.stderr:Or undo this operation with: 2024-02-07T12:24:50.377 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-07T12:24:50.377 INFO:tasks.workunit.client.1.smithi138.stderr: git switch - 2024-02-07T12:24:50.377 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-07T12:24:50.378 INFO:tasks.workunit.client.1.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-07T12:24:50.378 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-07T12:24:50.378 INFO:tasks.workunit.client.1.smithi138.stderr:HEAD is now at 44458ccedb1 Merge branch 'wip-ifed-fix-ceph-vol-migrate-wal' of https://github.com/ifed01/ceph into wip-guits-testing-4-2024-02-05-1854 2024-02-07T12:24:50.380 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-07T12:24:50.442 INFO:tasks.workunit.client.1.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-07T12:24:50.444 INFO:tasks.workunit.client.1.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-07T12:24:50.445 INFO:tasks.workunit.client.1.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-07T12:24:51.185 INFO:tasks.workunit.client.1.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-07T12:24:51.252 INFO:tasks.workunit.client.1.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-07T12:24:51.293 INFO:tasks.workunit.client.1.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-07T12:24:51.294 INFO:tasks.workunit.client.1.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-07T12:24:51.294 INFO:tasks.workunit.client.1.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-07T12:24:51.334 INFO:tasks.workunit.client.1.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-07T12:24:51.337 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:24:51.338 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-07T12:24:51.394 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-07T12:24:51.397 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-07T12:24:51.398 DEBUG:teuthology.orchestra.run.smithi138:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=44458ccedb18241cc2e17f10cdab3d1385399261 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-07T12:24:51.460 INFO:tasks.workunit.client.1.smithi138.stderr:+ mkdir -p fsstress 2024-02-07T12:24:51.462 INFO:tasks.workunit.client.1.smithi138.stderr:+ pushd fsstress 2024-02-07T12:24:51.462 INFO:tasks.workunit.client.1.smithi138.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-07T12:24:51.462 INFO:tasks.workunit.client.1.smithi138.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-07T12:24:51.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:51 smithi138 ceph-mon[35528]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:24:51.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:51 smithi047 ceph-mon[28972]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:24:52.143 INFO:tasks.workunit.client.1.smithi138.stderr:+ tar xzf ltp-full.tgz 2024-02-07T12:24:52.491 INFO:tasks.workunit.client.0.smithi047.stderr:Updating files: 95% (11668/12223) Updating files: 96% (11735/12223) Updating files: 97% (11857/12223) Updating files: 98% (11979/12223) Updating files: 99% (12101/12223) Updating files: 100% (12223/12223) Updating files: 100% (12223/12223), done. 2024-02-07T12:24:52.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:52 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:24:52.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:52 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:24:52.982 INFO:tasks.workunit.client.0.smithi047.stderr:Note: switching to '44458ccedb18241cc2e17f10cdab3d1385399261'. 2024-02-07T12:24:52.982 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-02-07T12:24:52.982 INFO:tasks.workunit.client.0.smithi047.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-07T12:24:52.982 INFO:tasks.workunit.client.0.smithi047.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-07T12:24:52.982 INFO:tasks.workunit.client.0.smithi047.stderr:state without impacting any branches by switching back to a branch. 2024-02-07T12:24:52.982 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-02-07T12:24:52.982 INFO:tasks.workunit.client.0.smithi047.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-07T12:24:52.983 INFO:tasks.workunit.client.0.smithi047.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-07T12:24:52.983 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-02-07T12:24:52.983 INFO:tasks.workunit.client.0.smithi047.stderr: git switch -c 2024-02-07T12:24:52.983 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-02-07T12:24:52.983 INFO:tasks.workunit.client.0.smithi047.stderr:Or undo this operation with: 2024-02-07T12:24:52.983 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-02-07T12:24:52.983 INFO:tasks.workunit.client.0.smithi047.stderr: git switch - 2024-02-07T12:24:52.983 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-02-07T12:24:52.983 INFO:tasks.workunit.client.0.smithi047.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-07T12:24:52.983 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-02-07T12:24:52.983 INFO:tasks.workunit.client.0.smithi047.stderr:HEAD is now at 44458ccedb1 Merge branch 'wip-ifed-fix-ceph-vol-migrate-wal' of https://github.com/ifed01/ceph into wip-guits-testing-4-2024-02-05-1854 2024-02-07T12:24:52.984 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-07T12:24:53.010 INFO:tasks.workunit.client.0.smithi047.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-07T12:24:53.012 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-07T12:24:53.012 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-07T12:24:53.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:53 smithi138 ceph-mon[35528]: pgmap v238: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:53.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:53 smithi047 ceph-mon[28972]: pgmap v238: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:24:56.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:55 smithi138 ceph-mon[35528]: pgmap v239: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 279 KiB/s rd, 341 KiB/s wr, 5 op/s 2024-02-07T12:24:56.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:55 smithi047 ceph-mon[28972]: pgmap v239: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 279 KiB/s rd, 341 KiB/s wr, 5 op/s 2024-02-07T12:24:56.664 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-07T12:24:56.797 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-07T12:24:56.856 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-07T12:24:56.858 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-07T12:24:56.858 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-07T12:24:56.935 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-07T12:24:56.938 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:24:56.938 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-07T12:24:56.995 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-07T12:24:56.996 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-07T12:24:56.996 DEBUG:teuthology.orchestra.run.smithi047:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=44458ccedb18241cc2e17f10cdab3d1385399261 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-07T12:24:57.056 INFO:tasks.workunit.client.0.smithi047.stderr:+ mkdir -p fsstress 2024-02-07T12:24:57.057 INFO:tasks.workunit.client.0.smithi047.stderr:+ pushd fsstress 2024-02-07T12:24:57.058 INFO:tasks.workunit.client.0.smithi047.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-07T12:24:57.058 INFO:tasks.workunit.client.0.smithi047.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-07T12:24:58.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.121+0000 7fc629517700 1 -- 172.21.15.47:0/738218286 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc62406ea30 msgr2=0x7fc62406ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:58.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.121+0000 7fc629517700 1 --2- 172.21.15.47:0/738218286 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc62406ea30 0x7fc62406ee40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc614004940 tx=0x7fc614009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:58.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.123+0000 7fc629517700 1 -- 172.21.15.47:0/738218286 shutdown_connections 2024-02-07T12:24:58.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.123+0000 7fc629517700 1 --2- 172.21.15.47:0/738218286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc62406f410 0x7fc624109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.123+0000 7fc629517700 1 --2- 172.21.15.47:0/738218286 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc62406ea30 0x7fc62406ee40 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc614004940 tx=0x7fc614009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:58.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.123+0000 7fc629517700 1 -- 172.21.15.47:0/738218286 >> 172.21.15.47:0/738218286 conn(0x7fc62406a2c0 msgr2=0x7fc62406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:58.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.125+0000 7fc629517700 1 -- 172.21.15.47:0/738218286 shutdown_connections 2024-02-07T12:24:58.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.125+0000 7fc629517700 1 -- 172.21.15.47:0/738218286 wait complete. 2024-02-07T12:24:58.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.126+0000 7fc629517700 1 Processor -- start 2024-02-07T12:24:58.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.127+0000 7fc629517700 1 -- start start 2024-02-07T12:24:58.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.127+0000 7fc629517700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc624114130 0x7fc624114540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:58.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.127+0000 7fc629517700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc624114a80 0x7fc6241187f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:58.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.127+0000 7fc629517700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc624118d80 con 0x7fc624114130 2024-02-07T12:24:58.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.127+0000 7fc629517700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc624118ef0 con 0x7fc624114a80 2024-02-07T12:24:58.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.130+0000 7fc6227fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc624114a80 0x7fc6241187f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:58.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.130+0000 7fc6227fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc624114a80 0x7fc6241187f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.47:36606/0 (socket says 172.21.15.47:36606) 2024-02-07T12:24:58.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.130+0000 7fc6227fc700 1 -- 172.21.15.47:0/2805900851 learned_addr learned my addr 172.21.15.47:0/2805900851 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:24:58.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.131+0000 7fc622ffd700 1 --2- 172.21.15.47:0/2805900851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc624114130 0x7fc624114540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:58.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.131+0000 7fc6227fc700 1 -- 172.21.15.47:0/2805900851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc624114130 msgr2=0x7fc624114540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:58.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.131+0000 7fc6227fc700 1 --2- 172.21.15.47:0/2805900851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc624114130 0x7fc624114540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.131+0000 7fc6227fc700 1 -- 172.21.15.47:0/2805900851 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc614005040 con 0x7fc624114a80 2024-02-07T12:24:58.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.132+0000 7fc6227fc700 1 --2- 172.21.15.47:0/2805900851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc624114a80 0x7fc6241187f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc61800c830 tx=0x7fc618004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:58.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.133+0000 7fc60b7fe700 1 -- 172.21.15.47:0/2805900851 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6180106f0 con 0x7fc624114a80 2024-02-07T12:24:58.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.134+0000 7fc60b7fe700 1 -- 172.21.15.47:0/2805900851 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc618010d20 con 0x7fc624114a80 2024-02-07T12:24:58.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.134+0000 7fc60b7fe700 1 -- 172.21.15.47:0/2805900851 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6180113a0 con 0x7fc624114a80 2024-02-07T12:24:58.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.134+0000 7fc629517700 1 -- 172.21.15.47:0/2805900851 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6241191d0 con 0x7fc624114a80 2024-02-07T12:24:58.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.134+0000 7fc629517700 1 -- 172.21.15.47:0/2805900851 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6241158d0 con 0x7fc624114a80 2024-02-07T12:24:58.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.136+0000 7fc629517700 1 -- 172.21.15.47:0/2805900851 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62404bed0 con 0x7fc624114a80 2024-02-07T12:24:58.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.137+0000 7fc60b7fe700 1 -- 172.21.15.47:0/2805900851 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc618012400 con 0x7fc624114a80 2024-02-07T12:24:58.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.137+0000 7fc60b7fe700 1 --2- 172.21.15.47:0/2805900851 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fc60c068fb0 0x7fc60c06b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:58.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.137+0000 7fc60b7fe700 1 -- 172.21.15.47:0/2805900851 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc618086e40 con 0x7fc624114a80 2024-02-07T12:24:58.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.138+0000 7fc622ffd700 1 --2- 172.21.15.47:0/2805900851 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fc60c068fb0 0x7fc60c06b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:58.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.140+0000 7fc622ffd700 1 --2- 172.21.15.47:0/2805900851 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fc60c068fb0 0x7fc60c06b460 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc614004890 tx=0x7fc614009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:58.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.148+0000 7fc60b7fe700 1 -- 172.21.15.47:0/2805900851 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc618053220 con 0x7fc624114a80 2024-02-07T12:24:58.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:57 smithi138 ceph-mon[35528]: pgmap v240: 65 pgs: 65 active+clean; 8.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 620 KiB/s rd, 688 KiB/s wr, 5 op/s 2024-02-07T12:24:58.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:57 smithi047 ceph-mon[28972]: pgmap v240: 65 pgs: 65 active+clean; 8.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 620 KiB/s rd, 688 KiB/s wr, 5 op/s 2024-02-07T12:24:58.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.481+0000 7fc629517700 1 -- 172.21.15.47:0/2805900851 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc62406f410 con 0x7fc60c068fb0 2024-02-07T12:24:58.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.483+0000 7fc60b7fe700 1 -- 172.21.15.47:0/2805900851 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fc62406f410 con 0x7fc60c068fb0 2024-02-07T12:24:58.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.484+0000 7fc629517700 1 -- 172.21.15.47:0/2805900851 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fc60c068fb0 msgr2=0x7fc60c06b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:58.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.484+0000 7fc629517700 1 --2- 172.21.15.47:0/2805900851 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fc60c068fb0 0x7fc60c06b460 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc614004890 tx=0x7fc614009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:58.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.484+0000 7fc629517700 1 -- 172.21.15.47:0/2805900851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc624114a80 msgr2=0x7fc6241187f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:58.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.484+0000 7fc629517700 1 --2- 172.21.15.47:0/2805900851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc624114a80 0x7fc6241187f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc61800c830 tx=0x7fc618004470 comp rx=0 tx=0).stop 2024-02-07T12:24:58.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.485+0000 7fc629517700 1 -- 172.21.15.47:0/2805900851 shutdown_connections 2024-02-07T12:24:58.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.485+0000 7fc629517700 1 --2- 172.21.15.47:0/2805900851 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fc60c068fb0 0x7fc60c06b460 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.485+0000 7fc629517700 1 --2- 172.21.15.47:0/2805900851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc624114130 0x7fc624114540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.485+0000 7fc629517700 1 --2- 172.21.15.47:0/2805900851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc624114a80 0x7fc6241187f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.485+0000 7fc629517700 1 -- 172.21.15.47:0/2805900851 >> 172.21.15.47:0/2805900851 conn(0x7fc62406a2c0 msgr2=0x7fc62406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:58.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.485+0000 7fc629517700 1 -- 172.21.15.47:0/2805900851 shutdown_connections 2024-02-07T12:24:58.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.485+0000 7fc629517700 1 -- 172.21.15.47:0/2805900851 wait complete. 2024-02-07T12:24:58.501 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:24:58.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.616+0000 7f24b9d11700 1 -- 172.21.15.47:0/3661081585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24b40fcfb0 msgr2=0x7f24b40fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:58.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.616+0000 7f24b9d11700 1 --2- 172.21.15.47:0/3661081585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24b40fcfb0 0x7f24b40fd420 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f24a8004940 tx=0x7f24a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:58.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.616+0000 7f24b9d11700 1 -- 172.21.15.47:0/3661081585 shutdown_connections 2024-02-07T12:24:58.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.616+0000 7f24b9d11700 1 --2- 172.21.15.47:0/3661081585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24b40fcfb0 0x7f24b40fd420 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.616+0000 7f24b9d11700 1 --2- 172.21.15.47:0/3661081585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24b40fbe40 0x7f24b40fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.616+0000 7f24b9d11700 1 -- 172.21.15.47:0/3661081585 >> 172.21.15.47:0/3661081585 conn(0x7f24b40f74e0 msgr2=0x7f24b40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:58.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.617+0000 7f24b9d11700 1 -- 172.21.15.47:0/3661081585 shutdown_connections 2024-02-07T12:24:58.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.617+0000 7f24b9d11700 1 -- 172.21.15.47:0/3661081585 wait complete. 2024-02-07T12:24:58.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.617+0000 7f24b9d11700 1 Processor -- start 2024-02-07T12:24:58.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.617+0000 7f24b9d11700 1 -- start start 2024-02-07T12:24:58.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f24b9d11700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24b40fbe40 0x7f24b410d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:58.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f24b9d11700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24b40fcfb0 0x7f24b410dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f24b9d11700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b410e4a0 con 0x7f24b40fbe40 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f24b9d11700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b410ed40 con 0x7f24b40fcfb0 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f24b37fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24b40fbe40 0x7f24b410d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f24b37fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24b40fbe40 0x7f24b410d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45962/0 (socket says 172.21.15.47:45962) 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f24b37fe700 1 -- 172.21.15.47:0/3278225642 learned_addr learned my addr 172.21.15.47:0/3278225642 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f24b2ffd700 1 --2- 172.21.15.47:0/3278225642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24b40fcfb0 0x7f24b410dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f24b37fe700 1 -- 172.21.15.47:0/3278225642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24b40fcfb0 msgr2=0x7f24b410dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f24b37fe700 1 --2- 172.21.15.47:0/3278225642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24b40fcfb0 0x7f24b410dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f24b37fe700 1 -- 172.21.15.47:0/3278225642 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a8005040 con 0x7f24b40fbe40 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f24b2ffd700 1 --2- 172.21.15.47:0/3278225642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24b40fcfb0 0x7f24b410dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f24b37fe700 1 --2- 172.21.15.47:0/3278225642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24b40fbe40 0x7f24b410d960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f24a4002a50 tx=0x7f24a40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.618+0000 7f249bfff700 1 -- 172.21.15.47:0/3278225642 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24a4007cc0 con 0x7f24b40fbe40 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.619+0000 7f249bfff700 1 -- 172.21.15.47:0/3278225642 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24a400f040 con 0x7f24b40fbe40 2024-02-07T12:24:58.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.619+0000 7f24b9d11700 1 -- 172.21.15.47:0/3278225642 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b410f020 con 0x7f24b40fbe40 2024-02-07T12:24:58.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.619+0000 7f249bfff700 1 -- 172.21.15.47:0/3278225642 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24a400da30 con 0x7f24b40fbe40 2024-02-07T12:24:58.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.619+0000 7f24b9d11700 1 -- 172.21.15.47:0/3278225642 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b410f560 con 0x7f24b40fbe40 2024-02-07T12:24:58.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.620+0000 7f24b9d11700 1 -- 172.21.15.47:0/3278225642 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b404bed0 con 0x7f24b40fbe40 2024-02-07T12:24:58.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.620+0000 7f249bfff700 1 -- 172.21.15.47:0/3278225642 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f24a400dbb0 con 0x7f24b40fbe40 2024-02-07T12:24:58.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.621+0000 7f249bfff700 1 --2- 172.21.15.47:0/3278225642 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f249c068f70 0x7f249c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:58.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.621+0000 7f249bfff700 1 -- 172.21.15.47:0/3278225642 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f24a4086b90 con 0x7f24b40fbe40 2024-02-07T12:24:58.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.621+0000 7f24b2ffd700 1 --2- 172.21.15.47:0/3278225642 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f249c068f70 0x7f249c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:58.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.621+0000 7f24b2ffd700 1 --2- 172.21.15.47:0/3278225642 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f249c068f70 0x7f249c06b420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f24a800b7a0 tx=0x7f24a8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:58.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.625+0000 7f249bfff700 1 -- 172.21.15.47:0/3278225642 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f24a4056a20 con 0x7f24b40fbe40 2024-02-07T12:24:58.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.867+0000 7f24b9d11700 1 -- 172.21.15.47:0/3278225642 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24b4065dd0 con 0x7f249c068f70 2024-02-07T12:24:58.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.868+0000 7f249bfff700 1 -- 172.21.15.47:0/3278225642 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f24b4065dd0 con 0x7f249c068f70 2024-02-07T12:24:58.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.871+0000 7f24b9d11700 1 -- 172.21.15.47:0/3278225642 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f249c068f70 msgr2=0x7f249c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:58.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.871+0000 7f24b9d11700 1 --2- 172.21.15.47:0/3278225642 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f249c068f70 0x7f249c06b420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f24a800b7a0 tx=0x7f24a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:58.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.871+0000 7f24b9d11700 1 -- 172.21.15.47:0/3278225642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24b40fbe40 msgr2=0x7f24b410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:58.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.871+0000 7f24b9d11700 1 --2- 172.21.15.47:0/3278225642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24b40fbe40 0x7f24b410d960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f24a4002a50 tx=0x7f24a40046b0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.871+0000 7f24b9d11700 1 -- 172.21.15.47:0/3278225642 shutdown_connections 2024-02-07T12:24:58.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.871+0000 7f24b9d11700 1 --2- 172.21.15.47:0/3278225642 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f249c068f70 0x7f249c06b420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.871+0000 7f24b9d11700 1 --2- 172.21.15.47:0/3278225642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24b40fbe40 0x7f24b410d960 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.871+0000 7f24b9d11700 1 --2- 172.21.15.47:0/3278225642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24b40fcfb0 0x7f24b410dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.871+0000 7f24b9d11700 1 -- 172.21.15.47:0/3278225642 >> 172.21.15.47:0/3278225642 conn(0x7f24b40f74e0 msgr2=0x7f24b40656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:58.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.871+0000 7f24b9d11700 1 -- 172.21.15.47:0/3278225642 shutdown_connections 2024-02-07T12:24:58.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.871+0000 7f24b9d11700 1 -- 172.21.15.47:0/3278225642 wait complete. 2024-02-07T12:24:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.983+0000 7f663c373700 1 -- 172.21.15.47:0/904981845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66340fcef0 msgr2=0x7f66340fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.983+0000 7f663c373700 1 --2- 172.21.15.47:0/904981845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66340fcef0 0x7f66340fd320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6624009ce0 tx=0x7f6624004d10 comp rx=0 tx=0).stop 2024-02-07T12:24:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.984+0000 7f663c373700 1 -- 172.21.15.47:0/904981845 shutdown_connections 2024-02-07T12:24:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.984+0000 7f663c373700 1 --2- 172.21.15.47:0/904981845 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66340fe0e0 0x7f66340fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.984+0000 7f663c373700 1 --2- 172.21.15.47:0/904981845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66340fcef0 0x7f66340fd320 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.984+0000 7f663c373700 1 -- 172.21.15.47:0/904981845 >> 172.21.15.47:0/904981845 conn(0x7f66340f8620 msgr2=0x7f66340faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.984+0000 7f663c373700 1 -- 172.21.15.47:0/904981845 shutdown_connections 2024-02-07T12:24:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.984+0000 7f663c373700 1 -- 172.21.15.47:0/904981845 wait complete. 2024-02-07T12:24:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.984+0000 7f663c373700 1 Processor -- start 2024-02-07T12:24:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.984+0000 7f663c373700 1 -- start start 2024-02-07T12:24:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.984+0000 7f663c373700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66340fcef0 0x7f663410fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.984+0000 7f663c373700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66340fe0e0 0x7f66341100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.984+0000 7f663c373700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66341106d0 con 0x7f66340fe0e0 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.984+0000 7f663c373700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6634110f70 con 0x7f66340fcef0 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.985+0000 7f663990e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66340fe0e0 0x7f66341100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.985+0000 7f663990e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66340fe0e0 0x7f66341100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45976/0 (socket says 172.21.15.47:45976) 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.985+0000 7f663990e700 1 -- 172.21.15.47:0/4280807037 learned_addr learned my addr 172.21.15.47:0/4280807037 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.985+0000 7f663a10f700 1 --2- 172.21.15.47:0/4280807037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66340fcef0 0x7f663410fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.985+0000 7f663990e700 1 -- 172.21.15.47:0/4280807037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66340fcef0 msgr2=0x7f663410fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.985+0000 7f663990e700 1 --2- 172.21.15.47:0/4280807037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66340fcef0 0x7f663410fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.985+0000 7f663990e700 1 -- 172.21.15.47:0/4280807037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624009940 con 0x7f66340fe0e0 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.985+0000 7f663990e700 1 --2- 172.21.15.47:0/4280807037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66340fe0e0 0x7f66341100d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f662800eb40 tx=0x7f662800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.985+0000 7f6632ffd700 1 -- 172.21.15.47:0/4280807037 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6628007cc0 con 0x7f66340fe0e0 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.985+0000 7f6632ffd700 1 -- 172.21.15.47:0/4280807037 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f662800f040 con 0x7f66340fe0e0 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.985+0000 7f663c373700 1 -- 172.21.15.47:0/4280807037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66341111f0 con 0x7f66340fe0e0 2024-02-07T12:24:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.985+0000 7f6632ffd700 1 -- 172.21.15.47:0/4280807037 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f662800ca10 con 0x7f66340fe0e0 2024-02-07T12:24:58.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.985+0000 7f663c373700 1 -- 172.21.15.47:0/4280807037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6634111730 con 0x7f66340fe0e0 2024-02-07T12:24:58.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.987+0000 7f663c373700 1 -- 172.21.15.47:0/4280807037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6634102210 con 0x7f66340fe0e0 2024-02-07T12:24:58.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.987+0000 7f6632ffd700 1 -- 172.21.15.47:0/4280807037 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f662800cc80 con 0x7f66340fe0e0 2024-02-07T12:24:58.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.988+0000 7f6632ffd700 1 --2- 172.21.15.47:0/4280807037 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f661c068f60 0x7f661c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:58.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.988+0000 7f6632ffd700 1 -- 172.21.15.47:0/4280807037 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f66280869e0 con 0x7f66340fe0e0 2024-02-07T12:24:58.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.988+0000 7f663a10f700 1 --2- 172.21.15.47:0/4280807037 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f661c068f60 0x7f661c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:58.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.988+0000 7f663a10f700 1 --2- 172.21.15.47:0/4280807037 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f661c068f60 0x7f661c06b410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6624009460 tx=0x7f6624004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:58.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:58.994+0000 7f6632ffd700 1 -- 172.21.15.47:0/4280807037 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f662804da00 con 0x7f66340fe0e0 2024-02-07T12:24:59.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.204+0000 7f663c373700 1 -- 172.21.15.47:0/4280807037 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f663402b310 con 0x7f661c068f60 2024-02-07T12:24:59.207 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:24:59 smithi047 ceph-mon[28972]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:24:59.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.214+0000 7f6632ffd700 1 -- 172.21.15.47:0/4280807037 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f663402b310 con 0x7f661c068f60 2024-02-07T12:24:59.221 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:24:59.221 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (6m) 98s ago 7m 26.9M - 0.25.0 c8568f914cd2 edd19ce884c8 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (7m) 98s ago 7m 6660k - 17.2.7-491-gf2462625 4ad3622d1b31 bca7317ed169 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (6m) 102s ago 6m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 110c84c6624b 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (5m) 98s ago 7m 82.8M - 9.4.7 954c08fa6188 5b93631efbfc 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (116s) 98s ago 115s 16.7M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (2m) 98s ago 2m 14.7M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (113s) 102s ago 113s 14.8M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (118s) 102s ago 118s 11.3M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:9283 running (8m) 98s ago 8m 481M - 17.2.7-491-gf2462625 4ad3622d1b31 f3b25479d84e 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283 running (6m) 102s ago 6m 435M - 17.2.7-491-gf2462625 4ad3622d1b31 ad543214819c 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (8m) 98s ago 8m 42.4M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 105826d9ef9a 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (6m) 102s ago 6m 36.3M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 02dfa0b8d573 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (7m) 98s ago 7m 16.2M - 1.5.0 0da6a335fe13 ba35c488ed6d 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (6m) 102s ago 6m 15.2M - 1.5.0 0da6a335fe13 8823dad6f717 2024-02-07T12:24:59.222 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (5m) 98s ago 5m 47.6M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 4f37918f583a 2024-02-07T12:24:59.223 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (5m) 98s ago 5m 46.3M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 1c6e3c603ed3 2024-02-07T12:24:59.223 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (4m) 98s ago 4m 44.7M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:24:59.223 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (4m) 102s ago 4m 48.0M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:24:59.223 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (3m) 102s ago 3m 41.9M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:24:59.223 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (3m) 102s ago 3m 44.7M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:24:59.223 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (5m) 98s ago 7m 55.1M - 2.43.0 a07b618ecd1d e41b94b0d167 2024-02-07T12:24:59.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.216+0000 7f663c373700 1 -- 172.21.15.47:0/4280807037 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f661c068f60 msgr2=0x7f661c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:59.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.216+0000 7f663c373700 1 --2- 172.21.15.47:0/4280807037 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f661c068f60 0x7f661c06b410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6624009460 tx=0x7f6624004d10 comp rx=0 tx=0).stop 2024-02-07T12:24:59.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.216+0000 7f663c373700 1 -- 172.21.15.47:0/4280807037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66340fe0e0 msgr2=0x7f66341100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:59.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.216+0000 7f663c373700 1 --2- 172.21.15.47:0/4280807037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66340fe0e0 0x7f66341100d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f662800eb40 tx=0x7f662800b040 comp rx=0 tx=0).stop 2024-02-07T12:24:59.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.216+0000 7f663c373700 1 -- 172.21.15.47:0/4280807037 shutdown_connections 2024-02-07T12:24:59.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.216+0000 7f663c373700 1 --2- 172.21.15.47:0/4280807037 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f661c068f60 0x7f661c06b410 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:59.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.216+0000 7f663c373700 1 --2- 172.21.15.47:0/4280807037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66340fcef0 0x7f663410fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:59.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.216+0000 7f663c373700 1 --2- 172.21.15.47:0/4280807037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66340fe0e0 0x7f66341100d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:59.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.216+0000 7f663c373700 1 -- 172.21.15.47:0/4280807037 >> 172.21.15.47:0/4280807037 conn(0x7f66340f8620 msgr2=0x7f66340ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:59.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.216+0000 7f663c373700 1 -- 172.21.15.47:0/4280807037 shutdown_connections 2024-02-07T12:24:59.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.216+0000 7f663c373700 1 -- 172.21.15.47:0/4280807037 wait complete. 2024-02-07T12:24:59.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:24:59 smithi138 ceph-mon[35528]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:24:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.322+0000 7f6ca7a34700 1 -- 172.21.15.47:0/351746348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ca00fbe40 msgr2=0x7f6ca00fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.322+0000 7f6ca7a34700 1 --2- 172.21.15.47:0/351746348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ca00fbe40 0x7f6ca00fc250 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6c98004940 tx=0x7f6c98009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.322+0000 7f6ca7a34700 1 -- 172.21.15.47:0/351746348 shutdown_connections 2024-02-07T12:24:59.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.322+0000 7f6ca7a34700 1 --2- 172.21.15.47:0/351746348 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca00fcfb0 0x7f6ca00fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:59.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.322+0000 7f6ca7a34700 1 --2- 172.21.15.47:0/351746348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ca00fbe40 0x7f6ca00fc250 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:59.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.322+0000 7f6ca7a34700 1 -- 172.21.15.47:0/351746348 >> 172.21.15.47:0/351746348 conn(0x7f6ca00f74e0 msgr2=0x7f6ca00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:59.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.322+0000 7f6ca7a34700 1 -- 172.21.15.47:0/351746348 shutdown_connections 2024-02-07T12:24:59.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.322+0000 7f6ca7a34700 1 -- 172.21.15.47:0/351746348 wait complete. 2024-02-07T12:24:59.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.323+0000 7f6ca7a34700 1 Processor -- start 2024-02-07T12:24:59.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.323+0000 7f6ca7a34700 1 -- start start 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.323+0000 7f6ca7a34700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca00fbe40 0x7f6ca00fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.323+0000 7f6ca7a34700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ca00fcfb0 0x7f6ca00fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.323+0000 7f6ca7a34700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00fe980 con 0x7f6ca00fcfb0 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.323+0000 7f6ca7a34700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00feaf0 con 0x7f6ca00fbe40 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.323+0000 7f6ca4fcf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ca00fcfb0 0x7f6ca00fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.323+0000 7f6ca4fcf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ca00fcfb0 0x7f6ca00fe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46006/0 (socket says 172.21.15.47:46006) 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.323+0000 7f6ca4fcf700 1 -- 172.21.15.47:0/1789798077 learned_addr learned my addr 172.21.15.47:0/1789798077 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.323+0000 7f6ca57d0700 1 --2- 172.21.15.47:0/1789798077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca00fbe40 0x7f6ca00fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.323+0000 7f6ca4fcf700 1 -- 172.21.15.47:0/1789798077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca00fbe40 msgr2=0x7f6ca00fff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.323+0000 7f6ca4fcf700 1 --2- 172.21.15.47:0/1789798077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca00fbe40 0x7f6ca00fff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.323+0000 7f6ca4fcf700 1 -- 172.21.15.47:0/1789798077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c98005040 con 0x7f6ca00fcfb0 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.324+0000 7f6ca4fcf700 1 --2- 172.21.15.47:0/1789798077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ca00fcfb0 0x7f6ca00fe380 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400eb40 tx=0x7f6c9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.324+0000 7f6c9dffb700 1 -- 172.21.15.47:0/1789798077 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c94007cc0 con 0x7f6ca00fcfb0 2024-02-07T12:24:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.324+0000 7f6ca7a34700 1 -- 172.21.15.47:0/1789798077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca00fed70 con 0x7f6ca00fcfb0 2024-02-07T12:24:59.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.324+0000 7f6c9dffb700 1 -- 172.21.15.47:0/1789798077 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c9400f040 con 0x7f6ca00fcfb0 2024-02-07T12:24:59.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.324+0000 7f6c9dffb700 1 -- 172.21.15.47:0/1789798077 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c9400ca10 con 0x7f6ca00fcfb0 2024-02-07T12:24:59.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.324+0000 7f6ca7a34700 1 -- 172.21.15.47:0/1789798077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca01158e0 con 0x7f6ca00fcfb0 2024-02-07T12:24:59.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.325+0000 7f6ca7a34700 1 -- 172.21.15.47:0/1789798077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca004bed0 con 0x7f6ca00fcfb0 2024-02-07T12:24:59.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.326+0000 7f6c9dffb700 1 -- 172.21.15.47:0/1789798077 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6c9400cb70 con 0x7f6ca00fcfb0 2024-02-07T12:24:59.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.326+0000 7f6c9dffb700 1 --2- 172.21.15.47:0/1789798077 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f6c88068f60 0x7f6c8806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:59.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.326+0000 7f6c9dffb700 1 -- 172.21.15.47:0/1789798077 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6c94086910 con 0x7f6ca00fcfb0 2024-02-07T12:24:59.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.326+0000 7f6ca57d0700 1 --2- 172.21.15.47:0/1789798077 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f6c88068f60 0x7f6c8806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:59.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.327+0000 7f6ca57d0700 1 --2- 172.21.15.47:0/1789798077 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f6c88068f60 0x7f6c8806b410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c98000c00 tx=0x7f6c98009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:59.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.335+0000 7f6c9dffb700 1 -- 172.21.15.47:0/1789798077 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6c9404da00 con 0x7f6ca00fcfb0 2024-02-07T12:24:59.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.636+0000 7f6ca7a34700 1 -- 172.21.15.47:0/1789798077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ca0104930 con 0x7f6ca00fcfb0 2024-02-07T12:24:59.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.636+0000 7f6c9dffb700 1 -- 172.21.15.47:0/1789798077 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f6c940568d0 con 0x7f6ca00fcfb0 2024-02-07T12:24:59.640 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:24:59.640 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:24:59.640 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2 2024-02-07T12:24:59.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:24:59.640 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:24:59.640 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2 2024-02-07T12:24:59.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:24:59.640 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:24:59.640 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 6 2024-02-07T12:24:59.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:24:59.641 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:24:59.641 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:24:59.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:24:59.641 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:24:59.641 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 14 2024-02-07T12:24:59.641 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:24:59.641 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:24:59.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.640+0000 7f6ca7a34700 1 -- 172.21.15.47:0/1789798077 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f6c88068f60 msgr2=0x7f6c8806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:59.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.640+0000 7f6ca7a34700 1 --2- 172.21.15.47:0/1789798077 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f6c88068f60 0x7f6c8806b410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c98000c00 tx=0x7f6c98009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:59.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.640+0000 7f6ca7a34700 1 -- 172.21.15.47:0/1789798077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ca00fcfb0 msgr2=0x7f6ca00fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:59.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.640+0000 7f6ca7a34700 1 --2- 172.21.15.47:0/1789798077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ca00fcfb0 0x7f6ca00fe380 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400eb40 tx=0x7f6c9400b040 comp rx=0 tx=0).stop 2024-02-07T12:24:59.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.640+0000 7f6ca7a34700 1 -- 172.21.15.47:0/1789798077 shutdown_connections 2024-02-07T12:24:59.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.640+0000 7f6ca7a34700 1 --2- 172.21.15.47:0/1789798077 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f6c88068f60 0x7f6c8806b410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:59.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.640+0000 7f6ca7a34700 1 --2- 172.21.15.47:0/1789798077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca00fbe40 0x7f6ca00fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:59.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.640+0000 7f6ca7a34700 1 --2- 172.21.15.47:0/1789798077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ca00fcfb0 0x7f6ca00fe380 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:59.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.640+0000 7f6ca7a34700 1 -- 172.21.15.47:0/1789798077 >> 172.21.15.47:0/1789798077 conn(0x7f6ca00f74e0 msgr2=0x7f6ca00656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:59.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.640+0000 7f6ca7a34700 1 -- 172.21.15.47:0/1789798077 shutdown_connections 2024-02-07T12:24:59.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.640+0000 7f6ca7a34700 1 -- 172.21.15.47:0/1789798077 wait complete. 2024-02-07T12:24:59.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.753+0000 7f75aff8f700 1 -- 172.21.15.47:0/1809661183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75a80fcef0 msgr2=0x7f75a80fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:59.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.753+0000 7f75aff8f700 1 --2- 172.21.15.47:0/1809661183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75a80fcef0 0x7f75a80fd320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f75a4004940 tx=0x7f75a4009e30 comp rx=0 tx=0).stop 2024-02-07T12:24:59.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.753+0000 7f75aff8f700 1 -- 172.21.15.47:0/1809661183 shutdown_connections 2024-02-07T12:24:59.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.753+0000 7f75aff8f700 1 --2- 172.21.15.47:0/1809661183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75a80fe0e0 0x7f75a80fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:59.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.753+0000 7f75aff8f700 1 --2- 172.21.15.47:0/1809661183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75a80fcef0 0x7f75a80fd320 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:59.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.753+0000 7f75aff8f700 1 -- 172.21.15.47:0/1809661183 >> 172.21.15.47:0/1809661183 conn(0x7f75a80f8620 msgr2=0x7f75a80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:24:59.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.753+0000 7f75aff8f700 1 -- 172.21.15.47:0/1809661183 shutdown_connections 2024-02-07T12:24:59.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.753+0000 7f75aff8f700 1 -- 172.21.15.47:0/1809661183 wait complete. 2024-02-07T12:24:59.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.754+0000 7f75aff8f700 1 Processor -- start 2024-02-07T12:24:59.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.754+0000 7f75aff8f700 1 -- start start 2024-02-07T12:24:59.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.754+0000 7f75aff8f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75a80fcef0 0x7f75a810d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:59.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.754+0000 7f75aff8f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75a80fe0e0 0x7f75a810de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:59.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.754+0000 7f75aff8f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a810e420 con 0x7f75a80fcef0 2024-02-07T12:24:59.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.754+0000 7f75aff8f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a810ecc0 con 0x7f75a80fe0e0 2024-02-07T12:24:59.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.754+0000 7f75add2b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75a80fcef0 0x7f75a810d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:59.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.754+0000 7f75add2b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75a80fcef0 0x7f75a810d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44386/0 (socket says 172.21.15.47:44386) 2024-02-07T12:24:59.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.754+0000 7f75add2b700 1 -- 172.21.15.47:0/3626040668 learned_addr learned my addr 172.21.15.47:0/3626040668 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:24:59.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.754+0000 7f75ad52a700 1 --2- 172.21.15.47:0/3626040668 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75a80fe0e0 0x7f75a810de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:59.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.755+0000 7f75add2b700 1 -- 172.21.15.47:0/3626040668 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75a80fe0e0 msgr2=0x7f75a810de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:24:59.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.755+0000 7f75add2b700 1 --2- 172.21.15.47:0/3626040668 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75a80fe0e0 0x7f75a810de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:24:59.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.755+0000 7f75add2b700 1 -- 172.21.15.47:0/3626040668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4005040 con 0x7f75a80fcef0 2024-02-07T12:24:59.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.755+0000 7f75add2b700 1 --2- 172.21.15.47:0/3626040668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75a80fcef0 0x7f75a810d8e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f75a4000c00 tx=0x7f75a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:59.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.755+0000 7f759e7fc700 1 -- 172.21.15.47:0/3626040668 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a400e070 con 0x7f75a80fcef0 2024-02-07T12:24:59.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.755+0000 7f759e7fc700 1 -- 172.21.15.47:0/3626040668 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75a401c400 con 0x7f75a80fcef0 2024-02-07T12:24:59.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.755+0000 7f75aff8f700 1 -- 172.21.15.47:0/3626040668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a810ef40 con 0x7f75a80fcef0 2024-02-07T12:24:59.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.755+0000 7f75aff8f700 1 -- 172.21.15.47:0/3626040668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a810f420 con 0x7f75a80fcef0 2024-02-07T12:24:59.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.755+0000 7f759e7fc700 1 -- 172.21.15.47:0/3626040668 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a400b670 con 0x7f75a80fcef0 2024-02-07T12:24:59.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.756+0000 7f75aff8f700 1 -- 172.21.15.47:0/3626040668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a804bed0 con 0x7f75a80fcef0 2024-02-07T12:24:59.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.757+0000 7f759e7fc700 1 -- 172.21.15.47:0/3626040668 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f75a401c9e0 con 0x7f75a80fcef0 2024-02-07T12:24:59.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.757+0000 7f759e7fc700 1 --2- 172.21.15.47:0/3626040668 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7594068f60 0x7f759406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:24:59.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.757+0000 7f759e7fc700 1 -- 172.21.15.47:0/3626040668 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f75a4088440 con 0x7f75a80fcef0 2024-02-07T12:24:59.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.757+0000 7f75ad52a700 1 --2- 172.21.15.47:0/3626040668 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7594068f60 0x7f759406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:24:59.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.758+0000 7f75ad52a700 1 --2- 172.21.15.47:0/3626040668 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7594068f60 0x7f759406b410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7598009b80 tx=0x7f759800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:24:59.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:24:59.762+0000 7f759e7fc700 1 -- 172.21.15.47:0/3626040668 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f75a4058330 con 0x7f75a80fcef0 2024-02-07T12:25:00.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.049+0000 7f75aff8f700 1 -- 172.21.15.47:0/3626040668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f75a810fa70 con 0x7f75a80fcef0 2024-02-07T12:25:00.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.049+0000 7f759e7fc700 1 -- 172.21.15.47:0/3626040668 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f75a4054020 con 0x7f75a80fcef0 2024-02-07T12:25:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:e19 2024-02-07T12:25:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:25:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:25:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:25:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:25:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:25:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:25:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 19 2024-02-07T12:25:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:25:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:25:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:24:57.983373+0000 2024-02-07T12:25:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:25:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:25:00.055 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:25:00.055 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:25:00.055 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:25:00.055 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:25:00.055 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 export targets 1 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:25:00.055 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:25:00.055 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:25:00.055 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:25:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:25:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:25:00.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.052+0000 7f75aff8f700 1 -- 172.21.15.47:0/3626040668 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7594068f60 msgr2=0x7f759406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:00.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.052+0000 7f75aff8f700 1 --2- 172.21.15.47:0/3626040668 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7594068f60 0x7f759406b410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7598009b80 tx=0x7f759800b040 comp rx=0 tx=0).stop 2024-02-07T12:25:00.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.052+0000 7f75aff8f700 1 -- 172.21.15.47:0/3626040668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75a80fcef0 msgr2=0x7f75a810d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:00.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.052+0000 7f75aff8f700 1 --2- 172.21.15.47:0/3626040668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75a80fcef0 0x7f75a810d8e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f75a4000c00 tx=0x7f75a4009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:00.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.052+0000 7f75aff8f700 1 -- 172.21.15.47:0/3626040668 shutdown_connections 2024-02-07T12:25:00.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.052+0000 7f75aff8f700 1 --2- 172.21.15.47:0/3626040668 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f7594068f60 0x7f759406b410 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.052+0000 7f75aff8f700 1 --2- 172.21.15.47:0/3626040668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75a80fcef0 0x7f75a810d8e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.052+0000 7f75aff8f700 1 --2- 172.21.15.47:0/3626040668 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75a80fe0e0 0x7f75a810de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.052+0000 7f75aff8f700 1 -- 172.21.15.47:0/3626040668 >> 172.21.15.47:0/3626040668 conn(0x7f75a80f8620 msgr2=0x7f75a81013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:00.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.052+0000 7f75aff8f700 1 -- 172.21.15.47:0/3626040668 shutdown_connections 2024-02-07T12:25:00.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.052+0000 7f75aff8f700 1 -- 172.21.15.47:0/3626040668 wait complete. 2024-02-07T12:25:00.057 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-02-07T12:25:00.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.160+0000 7fde1f434700 1 -- 172.21.15.47:0/3364363606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde180fcef0 msgr2=0x7fde180fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:00.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.160+0000 7fde1f434700 1 --2- 172.21.15.47:0/3364363606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde180fcef0 0x7fde180fd320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fde08009ce0 tx=0x7fde08004d10 comp rx=0 tx=0).stop 2024-02-07T12:25:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.160+0000 7fde1f434700 1 -- 172.21.15.47:0/3364363606 shutdown_connections 2024-02-07T12:25:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.160+0000 7fde1f434700 1 --2- 172.21.15.47:0/3364363606 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde180fe0e0 0x7fde180fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.160+0000 7fde1f434700 1 --2- 172.21.15.47:0/3364363606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde180fcef0 0x7fde180fd320 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.160+0000 7fde1f434700 1 -- 172.21.15.47:0/3364363606 >> 172.21.15.47:0/3364363606 conn(0x7fde180f8620 msgr2=0x7fde180faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.160+0000 7fde1f434700 1 -- 172.21.15.47:0/3364363606 shutdown_connections 2024-02-07T12:25:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.160+0000 7fde1f434700 1 -- 172.21.15.47:0/3364363606 wait complete. 2024-02-07T12:25:00.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.161+0000 7fde1f434700 1 Processor -- start 2024-02-07T12:25:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.161+0000 7fde1f434700 1 -- start start 2024-02-07T12:25:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.161+0000 7fde1f434700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde180fcef0 0x7fde18071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.161+0000 7fde1f434700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde180fe0e0 0x7fde180702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.161+0000 7fde1f434700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde180708e0 con 0x7fde180fe0e0 2024-02-07T12:25:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.161+0000 7fde1f434700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde18070a50 con 0x7fde180fcef0 2024-02-07T12:25:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.161+0000 7fde1c9cf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde180fe0e0 0x7fde180702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.161+0000 7fde1c9cf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde180fe0e0 0x7fde180702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44396/0 (socket says 172.21.15.47:44396) 2024-02-07T12:25:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.161+0000 7fde1c9cf700 1 -- 172.21.15.47:0/1202424258 learned_addr learned my addr 172.21.15.47:0/1202424258 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:25:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.161+0000 7fde1d1d0700 1 --2- 172.21.15.47:0/1202424258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde180fcef0 0x7fde18071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.162+0000 7fde1c9cf700 1 -- 172.21.15.47:0/1202424258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde180fcef0 msgr2=0x7fde18071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.162+0000 7fde1c9cf700 1 --2- 172.21.15.47:0/1202424258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde180fcef0 0x7fde18071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.162+0000 7fde1c9cf700 1 -- 172.21.15.47:0/1202424258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde08009940 con 0x7fde180fe0e0 2024-02-07T12:25:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.162+0000 7fde1c9cf700 1 --2- 172.21.15.47:0/1202424258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde180fe0e0 0x7fde180702e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fde0c002a80 tx=0x7fde0c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:00.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.162+0000 7fde15ffb700 1 -- 172.21.15.47:0/1202424258 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde0c007cc0 con 0x7fde180fe0e0 2024-02-07T12:25:00.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.162+0000 7fde15ffb700 1 -- 172.21.15.47:0/1202424258 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde0c00f040 con 0x7fde180fe0e0 2024-02-07T12:25:00.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.162+0000 7fde1f434700 1 -- 172.21.15.47:0/1202424258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde18070d30 con 0x7fde180fe0e0 2024-02-07T12:25:00.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.162+0000 7fde15ffb700 1 -- 172.21.15.47:0/1202424258 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde0c00dac0 con 0x7fde180fe0e0 2024-02-07T12:25:00.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.162+0000 7fde1f434700 1 -- 172.21.15.47:0/1202424258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde18115a80 con 0x7fde180fe0e0 2024-02-07T12:25:00.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.163+0000 7fde1f434700 1 -- 172.21.15.47:0/1202424258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1804bed0 con 0x7fde180fe0e0 2024-02-07T12:25:00.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.164+0000 7fde15ffb700 1 -- 172.21.15.47:0/1202424258 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fde0c00dc20 con 0x7fde180fe0e0 2024-02-07T12:25:00.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.164+0000 7fde15ffb700 1 --2- 172.21.15.47:0/1202424258 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fde00068f60 0x7fde0006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:00.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.165+0000 7fde15ffb700 1 -- 172.21.15.47:0/1202424258 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fde0c086a50 con 0x7fde180fe0e0 2024-02-07T12:25:00.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.165+0000 7fde1d1d0700 1 --2- 172.21.15.47:0/1202424258 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fde00068f60 0x7fde0006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:00.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.165+0000 7fde1d1d0700 1 --2- 172.21.15.47:0/1202424258 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fde00068f60 0x7fde0006b410 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fde18071bf0 tx=0x7fde08004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.169+0000 7fde15ffb700 1 -- 172.21.15.47:0/1202424258 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fde0c0568e0 con 0x7fde180fe0e0 2024-02-07T12:25:00.264 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:00 smithi138 ceph-mon[35528]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:00.264 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:00 smithi138 ceph-mon[35528]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:00.264 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:00 smithi138 ceph-mon[35528]: pgmap v241: 65 pgs: 65 active+clean; 10 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 620 KiB/s rd, 868 KiB/s wr, 43 op/s 2024-02-07T12:25:00.265 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:00 smithi138 ceph-mon[35528]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:00.265 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:00 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/1789798077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:25:00.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:00 smithi047 ceph-mon[28972]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:00.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:00 smithi047 ceph-mon[28972]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:00.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:00 smithi047 ceph-mon[28972]: pgmap v241: 65 pgs: 65 active+clean; 10 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 620 KiB/s rd, 868 KiB/s wr, 43 op/s 2024-02-07T12:25:00.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:00 smithi047 ceph-mon[28972]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:00.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:00 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1789798077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:25:00.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.408+0000 7fde1f434700 1 -- 172.21.15.47:0/1202424258 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde18102ac0 con 0x7fde00068f60 2024-02-07T12:25:00.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.409+0000 7fde15ffb700 1 -- 172.21.15.47:0/1202424258 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fde18102ac0 con 0x7fde00068f60 2024-02-07T12:25:00.413 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:25:00.413 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:25:00.413 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:25:00.413 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:25:00.413 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [], 2024-02-07T12:25:00.413 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "0/21 daemons upgraded", 2024-02-07T12:25:00.413 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe image on host smithi138", 2024-02-07T12:25:00.413 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:25:00.413 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:25:00.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.411+0000 7fde1f434700 1 -- 172.21.15.47:0/1202424258 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fde00068f60 msgr2=0x7fde0006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:00.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.411+0000 7fde1f434700 1 --2- 172.21.15.47:0/1202424258 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fde00068f60 0x7fde0006b410 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fde18071bf0 tx=0x7fde08004d10 comp rx=0 tx=0).stop 2024-02-07T12:25:00.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.411+0000 7fde1f434700 1 -- 172.21.15.47:0/1202424258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde180fe0e0 msgr2=0x7fde180702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:00.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.411+0000 7fde1f434700 1 --2- 172.21.15.47:0/1202424258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde180fe0e0 0x7fde180702e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fde0c002a80 tx=0x7fde0c0046b0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.411+0000 7fde1f434700 1 -- 172.21.15.47:0/1202424258 shutdown_connections 2024-02-07T12:25:00.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.411+0000 7fde1f434700 1 --2- 172.21.15.47:0/1202424258 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7fde00068f60 0x7fde0006b410 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.411+0000 7fde1f434700 1 --2- 172.21.15.47:0/1202424258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde180fcef0 0x7fde18071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.411+0000 7fde1f434700 1 --2- 172.21.15.47:0/1202424258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde180fe0e0 0x7fde180702e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.411+0000 7fde1f434700 1 -- 172.21.15.47:0/1202424258 >> 172.21.15.47:0/1202424258 conn(0x7fde180f8620 msgr2=0x7fde181013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:00.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.412+0000 7fde1f434700 1 -- 172.21.15.47:0/1202424258 shutdown_connections 2024-02-07T12:25:00.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.412+0000 7fde1f434700 1 -- 172.21.15.47:0/1202424258 wait complete. 2024-02-07T12:25:00.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.529+0000 7f8adf3e3700 1 -- 172.21.15.47:0/1307530504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ad80fe2b0 msgr2=0x7f8ad80fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:00.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.529+0000 7f8adf3e3700 1 --2- 172.21.15.47:0/1307530504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ad80fe2b0 0x7f8ad80fe700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8004940 tx=0x7f8ac8009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:00.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.529+0000 7f8adf3e3700 1 -- 172.21.15.47:0/1307530504 shutdown_connections 2024-02-07T12:25:00.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.529+0000 7f8adf3e3700 1 --2- 172.21.15.47:0/1307530504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ad80fe2b0 0x7f8ad80fe700 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.529+0000 7f8adf3e3700 1 --2- 172.21.15.47:0/1307530504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad80fb220 0x7f8ad80fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.529+0000 7f8adf3e3700 1 -- 172.21.15.47:0/1307530504 >> 172.21.15.47:0/1307530504 conn(0x7f8ad80f6ca0 msgr2=0x7f8ad80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:00.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.529+0000 7f8adf3e3700 1 -- 172.21.15.47:0/1307530504 shutdown_connections 2024-02-07T12:25:00.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.529+0000 7f8adf3e3700 1 -- 172.21.15.47:0/1307530504 wait complete. 2024-02-07T12:25:00.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.530+0000 7f8adf3e3700 1 Processor -- start 2024-02-07T12:25:00.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.530+0000 7f8adf3e3700 1 -- start start 2024-02-07T12:25:00.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.530+0000 7f8adf3e3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ad80fb220 0x7f8ad80fdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:00.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.530+0000 7f8adf3e3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad80fe2b0 0x7f8ad80fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:00.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.530+0000 7f8adf3e3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad8111660 con 0x7f8ad80fb220 2024-02-07T12:25:00.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.530+0000 7f8adf3e3700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81117d0 con 0x7f8ad80fe2b0 2024-02-07T12:25:00.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.530+0000 7f8adc97e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad80fe2b0 0x7f8ad80fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.530+0000 7f8adc97e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad80fe2b0 0x7f8ad80fc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.47:43608/0 (socket says 172.21.15.47:43608) 2024-02-07T12:25:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.530+0000 7f8adc97e700 1 -- 172.21.15.47:0/4196840793 learned_addr learned my addr 172.21.15.47:0/4196840793 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:25:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.531+0000 7f8add17f700 1 --2- 172.21.15.47:0/4196840793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ad80fb220 0x7f8ad80fdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.531+0000 7f8adc97e700 1 -- 172.21.15.47:0/4196840793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ad80fb220 msgr2=0x7f8ad80fdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.531+0000 7f8adc97e700 1 --2- 172.21.15.47:0/4196840793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ad80fb220 0x7f8ad80fdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.531+0000 7f8adc97e700 1 -- 172.21.15.47:0/4196840793 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac8005040 con 0x7f8ad80fe2b0 2024-02-07T12:25:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.531+0000 7f8add17f700 1 --2- 172.21.15.47:0/4196840793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ad80fb220 0x7f8ad80fdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:25:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.531+0000 7f8adc97e700 1 --2- 172.21.15.47:0/4196840793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad80fe2b0 0x7f8ad80fc1c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009b30 tx=0x7f8ac8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.531+0000 7f8acdffb700 1 -- 172.21.15.47:0/4196840793 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ac8021070 con 0x7f8ad80fe2b0 2024-02-07T12:25:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.531+0000 7f8acdffb700 1 -- 172.21.15.47:0/4196840793 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ac801c400 con 0x7f8ad80fe2b0 2024-02-07T12:25:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.531+0000 7f8adf3e3700 1 -- 172.21.15.47:0/4196840793 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad8111a50 con 0x7f8ad80fe2b0 2024-02-07T12:25:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.531+0000 7f8acdffb700 1 -- 172.21.15.47:0/4196840793 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ac800e070 con 0x7f8ad80fe2b0 2024-02-07T12:25:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.532+0000 7f8adf3e3700 1 -- 172.21.15.47:0/4196840793 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad8111f90 con 0x7f8ad80fe2b0 2024-02-07T12:25:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.532+0000 7f8adf3e3700 1 -- 172.21.15.47:0/4196840793 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad804bed0 con 0x7f8ad80fe2b0 2024-02-07T12:25:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.533+0000 7f8acdffb700 1 -- 172.21.15.47:0/4196840793 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8ac8013af0 con 0x7f8ad80fe2b0 2024-02-07T12:25:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.533+0000 7f8acdffb700 1 --2- 172.21.15.47:0/4196840793 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8ac4068f60 0x7f8ac406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.533+0000 7f8acdffb700 1 -- 172.21.15.47:0/4196840793 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8ac80881b0 con 0x7f8ad80fe2b0 2024-02-07T12:25:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.534+0000 7f8add17f700 1 --2- 172.21.15.47:0/4196840793 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8ac4068f60 0x7f8ac406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.534+0000 7f8add17f700 1 --2- 172.21.15.47:0/4196840793 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8ac4068f60 0x7f8ac406b410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80fdad0 tx=0x7f8ad400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:00.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.538+0000 7f8acdffb700 1 -- 172.21.15.47:0/4196840793 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8ac8058020 con 0x7f8ad80fe2b0 2024-02-07T12:25:00.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.850+0000 7f8adf3e3700 1 -- 172.21.15.47:0/4196840793 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8ad8105a40 con 0x7f8ad80fe2b0 2024-02-07T12:25:00.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.851+0000 7f8acdffb700 1 -- 172.21.15.47:0/4196840793 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8ac8052e60 con 0x7f8ad80fe2b0 2024-02-07T12:25:00.854 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:25:00.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.853+0000 7f8adf3e3700 1 -- 172.21.15.47:0/4196840793 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8ac4068f60 msgr2=0x7f8ac406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:00.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.853+0000 7f8adf3e3700 1 --2- 172.21.15.47:0/4196840793 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8ac4068f60 0x7f8ac406b410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80fdad0 tx=0x7f8ad400b040 comp rx=0 tx=0).stop 2024-02-07T12:25:00.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.853+0000 7f8adf3e3700 1 -- 172.21.15.47:0/4196840793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad80fe2b0 msgr2=0x7f8ad80fc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:00.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.853+0000 7f8adf3e3700 1 --2- 172.21.15.47:0/4196840793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad80fe2b0 0x7f8ad80fc1c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009b30 tx=0x7f8ac8009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:00.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.853+0000 7f8adf3e3700 1 -- 172.21.15.47:0/4196840793 shutdown_connections 2024-02-07T12:25:00.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.853+0000 7f8adf3e3700 1 --2- 172.21.15.47:0/4196840793 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f8ac4068f60 0x7f8ac406b410 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.853+0000 7f8adf3e3700 1 --2- 172.21.15.47:0/4196840793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ad80fb220 0x7f8ad80fdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.853+0000 7f8adf3e3700 1 --2- 172.21.15.47:0/4196840793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad80fe2b0 0x7f8ad80fc1c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:00.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.853+0000 7f8adf3e3700 1 -- 172.21.15.47:0/4196840793 >> 172.21.15.47:0/4196840793 conn(0x7f8ad80f6ca0 msgr2=0x7f8ad81014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:00.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.853+0000 7f8adf3e3700 1 -- 172.21.15.47:0/4196840793 shutdown_connections 2024-02-07T12:25:00.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:00.853+0000 7f8adf3e3700 1 -- 172.21.15.47:0/4196840793 wait complete. 2024-02-07T12:25:01.185 INFO:tasks.workunit.client.0.smithi047.stderr:+ tar xzf ltp-full.tgz 2024-02-07T12:25:01.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:01 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3626040668' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:25:01.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:01 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/4196840793' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:25:01.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:01 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3626040668' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:25:01.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:01 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/4196840793' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:25:02.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:02 smithi138 ceph-mon[35528]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:02.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:02 smithi138 ceph-mon[35528]: pgmap v242: 65 pgs: 65 active+clean; 38 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 389 op/s 2024-02-07T12:25:02.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:02 smithi047 ceph-mon[28972]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:02.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:02 smithi047 ceph-mon[28972]: pgmap v242: 65 pgs: 65 active+clean; 38 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 389 op/s 2024-02-07T12:25:03.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:03 smithi138 ceph-mon[35528]: Upgrade: Updating mgr.smithi138.fiugmj 2024-02-07T12:25:03.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:03 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:03.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:03 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.fiugmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:25:03.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:03 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:25:03.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:03 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:25:03.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:03 smithi138 ceph-mon[35528]: Deploying daemon mgr.smithi138.fiugmj on smithi138 2024-02-07T12:25:03.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:03 smithi047 ceph-mon[28972]: Upgrade: Updating mgr.smithi138.fiugmj 2024-02-07T12:25:03.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:03 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:03.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:03 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.fiugmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:25:03.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:03 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:25:03.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:03 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:25:03.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:03 smithi047 ceph-mon[28972]: Deploying daemon mgr.smithi138.fiugmj on smithi138 2024-02-07T12:25:04.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:04 smithi138 ceph-mon[35528]: pgmap v243: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 5.0 MiB/s wr, 539 op/s 2024-02-07T12:25:04.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:04 smithi047 ceph-mon[28972]: pgmap v243: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 5.0 MiB/s wr, 539 op/s 2024-02-07T12:25:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:06 smithi138 ceph-mon[35528]: pgmap v244: 65 pgs: 65 active+clean; 74 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 577 op/s 2024-02-07T12:25:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:06 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:06 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:06 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:25:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:06 smithi047 ceph-mon[28972]: pgmap v244: 65 pgs: 65 active+clean; 74 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 577 op/s 2024-02-07T12:25:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:06 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:25:07.257 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:07 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:25:07.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:07 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:25:08.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:08 smithi138 ceph-mon[35528]: pgmap v245: 65 pgs: 65 active+clean; 80 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 592 op/s 2024-02-07T12:25:08.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:08 smithi047 ceph-mon[28972]: pgmap v245: 65 pgs: 65 active+clean; 80 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 592 op/s 2024-02-07T12:25:10.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:10 smithi138 ceph-mon[35528]: pgmap v246: 65 pgs: 65 active+clean; 87 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.9 MiB/s wr, 600 op/s 2024-02-07T12:25:10.385 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:10 smithi047 ceph-mon[28972]: pgmap v246: 65 pgs: 65 active+clean; 87 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.9 MiB/s wr, 600 op/s 2024-02-07T12:25:11.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:11 smithi138 ceph-mon[35528]: pgmap v247: 65 pgs: 65 active+clean; 100 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 7.9 MiB/s wr, 691 op/s 2024-02-07T12:25:11.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:11 smithi047 ceph-mon[28972]: pgmap v247: 65 pgs: 65 active+clean; 100 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 7.9 MiB/s wr, 691 op/s 2024-02-07T12:25:14.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:13 smithi138 ceph-mon[35528]: pgmap v248: 65 pgs: 65 active+clean; 112 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.5 MiB/s wr, 451 op/s 2024-02-07T12:25:14.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:13 smithi138 ceph-mon[35528]: Standby manager daemon smithi138.fiugmj restarted 2024-02-07T12:25:14.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:13 smithi138 ceph-mon[35528]: Standby manager daemon smithi138.fiugmj started 2024-02-07T12:25:14.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:13 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/crt"}]: dispatch 2024-02-07T12:25:14.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:13 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:25:14.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:13 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/key"}]: dispatch 2024-02-07T12:25:14.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:13 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:25:14.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:13 smithi047 ceph-mon[28972]: pgmap v248: 65 pgs: 65 active+clean; 112 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.5 MiB/s wr, 451 op/s 2024-02-07T12:25:14.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:13 smithi047 ceph-mon[28972]: Standby manager daemon smithi138.fiugmj restarted 2024-02-07T12:25:14.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:13 smithi047 ceph-mon[28972]: Standby manager daemon smithi138.fiugmj started 2024-02-07T12:25:14.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:13 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/crt"}]: dispatch 2024-02-07T12:25:14.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:13 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:25:14.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:13 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/key"}]: dispatch 2024-02-07T12:25:14.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:13 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:25:15.281 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:15 smithi138 ceph-mon[35528]: mgrmap e20: smithi047.zhgnrm(active, since 7m), standbys: smithi138.fiugmj 2024-02-07T12:25:15.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:15 smithi047 ceph-mon[28972]: mgrmap e20: smithi047.zhgnrm(active, since 7m), standbys: smithi138.fiugmj 2024-02-07T12:25:16.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:16 smithi138 ceph-mon[35528]: pgmap v249: 65 pgs: 65 active+clean; 139 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 523 op/s 2024-02-07T12:25:16.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:16 smithi047 ceph-mon[28972]: pgmap v249: 65 pgs: 65 active+clean; 139 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 523 op/s 2024-02-07T12:25:18.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:18 smithi138 ceph-mon[35528]: pgmap v250: 65 pgs: 65 active+clean; 147 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.5 MiB/s wr, 557 op/s 2024-02-07T12:25:18.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:18 smithi047 ceph-mon[28972]: pgmap v250: 65 pgs: 65 active+clean; 147 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.5 MiB/s wr, 557 op/s 2024-02-07T12:25:18.410 INFO:tasks.workunit.client.1.smithi138.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-07T12:25:18.410 INFO:tasks.workunit.client.1.smithi138.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-07T12:25:18.411 INFO:tasks.workunit.client.1.smithi138.stderr:+ make 2024-02-07T12:25:18.606 INFO:tasks.workunit.client.1.smithi138.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-07T12:25:20.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:20 smithi138 ceph-mon[35528]: pgmap v251: 65 pgs: 65 active+clean; 152 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 6.3 MiB/s wr, 587 op/s 2024-02-07T12:25:20.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:20 smithi047 ceph-mon[28972]: pgmap v251: 65 pgs: 65 active+clean; 152 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 6.3 MiB/s wr, 587 op/s 2024-02-07T12:25:21.779 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:21 smithi138 ceph-mon[35528]: pgmap v252: 65 pgs: 65 active+clean; 159 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 6.3 MiB/s wr, 592 op/s 2024-02-07T12:25:21.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:21 smithi047 ceph-mon[28972]: pgmap v252: 65 pgs: 65 active+clean; 159 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 6.3 MiB/s wr, 592 op/s 2024-02-07T12:25:22.210 INFO:tasks.workunit.client.1.smithi138.stderr:++ readlink -f fsstress 2024-02-07T12:25:22.210 INFO:tasks.workunit.client.1.smithi138.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-07T12:25:22.210 INFO:tasks.workunit.client.1.smithi138.stderr:+ popd 2024-02-07T12:25:22.211 INFO:tasks.workunit.client.1.smithi138.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-07T12:25:22.212 INFO:tasks.workunit.client.1.smithi138.stderr:+ popd 2024-02-07T12:25:22.212 INFO:tasks.workunit.client.1.smithi138.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-07T12:25:22.212 INFO:tasks.workunit.client.1.smithi138.stderr:++ mktemp -d -p . 2024-02-07T12:25:22.213 INFO:tasks.workunit.client.1.smithi138.stderr:+ T=./tmp.RReK0I1Z38 2024-02-07T12:25:22.214 INFO:tasks.workunit.client.1.smithi138.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.RReK0I1Z38 -l 1 -n 1000 -p 10 -v 2024-02-07T12:25:22.215 INFO:tasks.workunit.client.1.smithi138.stdout:seed = 1707094690 2024-02-07T12:25:22.217 INFO:tasks.workunit.client.1.smithi138.stdout:1/0: unlink - no file 2024-02-07T12:25:22.218 INFO:tasks.workunit.client.1.smithi138.stdout:1/1: chown . 164 1 2024-02-07T12:25:22.218 INFO:tasks.workunit.client.1.smithi138.stdout:1/2: dwrite - no filename 2024-02-07T12:25:22.218 INFO:tasks.workunit.client.1.smithi138.stdout:1/3: chown . 273387608 1 2024-02-07T12:25:22.218 INFO:tasks.workunit.client.1.smithi138.stdout:1/4: link - no file 2024-02-07T12:25:22.219 INFO:tasks.workunit.client.1.smithi138.stdout:1/5: truncate - no filename 2024-02-07T12:25:22.219 INFO:tasks.workunit.client.1.smithi138.stdout:2/0: write - no filename 2024-02-07T12:25:22.219 INFO:tasks.workunit.client.1.smithi138.stdout:2/1: dwrite - no filename 2024-02-07T12:25:22.219 INFO:tasks.workunit.client.1.smithi138.stdout:2/2: chown . 71440007 1 2024-02-07T12:25:22.219 INFO:tasks.workunit.client.1.smithi138.stdout:2/3: readlink - no filename 2024-02-07T12:25:22.219 INFO:tasks.workunit.client.1.smithi138.stdout:1/6: mknod c0 0 2024-02-07T12:25:22.219 INFO:tasks.workunit.client.1.smithi138.stdout:3/0: getdents . 0 2024-02-07T12:25:22.220 INFO:tasks.workunit.client.1.smithi138.stdout:3/1: unlink - no file 2024-02-07T12:25:22.220 INFO:tasks.workunit.client.1.smithi138.stdout:2/4: creat f0 x:0 0 0 2024-02-07T12:25:22.220 INFO:tasks.workunit.client.1.smithi138.stdout:2/5: creat f1 x:0 0 0 2024-02-07T12:25:22.221 INFO:tasks.workunit.client.1.smithi138.stdout:1/7: creat f1 x:0 0 0 2024-02-07T12:25:22.221 INFO:tasks.workunit.client.1.smithi138.stdout:1/8: dread - f1 zero size 2024-02-07T12:25:22.221 INFO:tasks.workunit.client.1.smithi138.stdout:4/0: truncate - no filename 2024-02-07T12:25:22.221 INFO:tasks.workunit.client.1.smithi138.stdout:4/1: dwrite - no filename 2024-02-07T12:25:22.222 INFO:tasks.workunit.client.1.smithi138.stdout:3/2: symlink l0 0 2024-02-07T12:25:22.222 INFO:tasks.workunit.client.1.smithi138.stdout:3/3: fsync - no filename 2024-02-07T12:25:22.222 INFO:tasks.workunit.client.1.smithi138.stdout:3/4: chown l0 8 1 2024-02-07T12:25:22.222 INFO:tasks.workunit.client.1.smithi138.stdout:3/5: dwrite - no filename 2024-02-07T12:25:22.222 INFO:tasks.workunit.client.1.smithi138.stdout:3/6: read - no filename 2024-02-07T12:25:22.222 INFO:tasks.workunit.client.1.smithi138.stdout:3/7: chown l0 2 1 2024-02-07T12:25:22.222 INFO:tasks.workunit.client.1.smithi138.stdout:3/8: readlink l0 0 2024-02-07T12:25:22.223 INFO:tasks.workunit.client.1.smithi138.stdout:2/6: symlink l2 0 2024-02-07T12:25:22.223 INFO:tasks.workunit.client.1.smithi138.stdout:3/9: creat f1 x:0 0 0 2024-02-07T12:25:22.223 INFO:tasks.workunit.client.1.smithi138.stdout:3/10: creat f2 x:0 0 0 2024-02-07T12:25:22.223 INFO:tasks.workunit.client.1.smithi138.stdout:3/11: creat f3 x:0 0 0 2024-02-07T12:25:22.224 INFO:tasks.workunit.client.1.smithi138.stdout:3/12: creat f4 x:0 0 0 2024-02-07T12:25:22.224 INFO:tasks.workunit.client.1.smithi138.stdout:2/7: mkdir d3 0 2024-02-07T12:25:22.224 INFO:tasks.workunit.client.1.smithi138.stdout:2/8: readlink l2 0 2024-02-07T12:25:22.229 INFO:tasks.workunit.client.1.smithi138.stdout:2/9: mkdir d3/d4 0 2024-02-07T12:25:22.229 INFO:tasks.workunit.client.1.smithi138.stdout:2/10: write f1 [678117,129552] 0 2024-02-07T12:25:22.453 INFO:tasks.workunit.client.1.smithi138.stdout:3/13: getdents . 0 2024-02-07T12:25:22.453 INFO:tasks.workunit.client.1.smithi138.stdout:3/14: write f1 [628214,116910] 0 2024-02-07T12:25:22.462 INFO:tasks.workunit.client.1.smithi138.stdout:2/11: dread f1 [0,4194304] 0 2024-02-07T12:25:22.463 INFO:tasks.workunit.client.1.smithi138.stdout:6/0: unlink - no file 2024-02-07T12:25:22.463 INFO:tasks.workunit.client.1.smithi138.stdout:7/0: dwrite - no filename 2024-02-07T12:25:22.463 INFO:tasks.workunit.client.1.smithi138.stdout:9/0: dread - no filename 2024-02-07T12:25:22.463 INFO:tasks.workunit.client.1.smithi138.stdout:9/1: write - no filename 2024-02-07T12:25:22.463 INFO:tasks.workunit.client.1.smithi138.stdout:9/2: dread - no filename 2024-02-07T12:25:22.463 INFO:tasks.workunit.client.1.smithi138.stdout:9/3: rename - no filename 2024-02-07T12:25:22.463 INFO:tasks.workunit.client.1.smithi138.stdout:9/4: truncate - no filename 2024-02-07T12:25:22.463 INFO:tasks.workunit.client.1.smithi138.stdout:9/5: write - no filename 2024-02-07T12:25:22.463 INFO:tasks.workunit.client.1.smithi138.stdout:9/6: write - no filename 2024-02-07T12:25:22.463 INFO:tasks.workunit.client.1.smithi138.stdout:9/7: rmdir - no directory 2024-02-07T12:25:22.463 INFO:tasks.workunit.client.1.smithi138.stdout:9/8: read - no filename 2024-02-07T12:25:22.463 INFO:tasks.workunit.client.1.smithi138.stdout:9/9: fsync - no filename 2024-02-07T12:25:22.463 INFO:tasks.workunit.client.1.smithi138.stdout:9/10: dread - no filename 2024-02-07T12:25:22.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:22 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:25:22.809 INFO:tasks.workunit.client.1.smithi138.stdout:3/15: mkdir d5 0 2024-02-07T12:25:22.822 INFO:tasks.workunit.client.1.smithi138.stdout:2/12: rename d3/d4 to d3/d5 0 2024-02-07T12:25:22.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:22 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:25:22.825 INFO:tasks.workunit.client.1.smithi138.stdout:5/0: symlink l0 0 2024-02-07T12:25:22.826 INFO:tasks.workunit.client.1.smithi138.stdout:8/0: creat f0 x:0 0 0 2024-02-07T12:25:22.826 INFO:tasks.workunit.client.1.smithi138.stdout:8/1: truncate f0 194070 0 2024-02-07T12:25:22.826 INFO:tasks.workunit.client.1.smithi138.stdout:6/1: creat f0 x:0 0 0 2024-02-07T12:25:22.827 INFO:tasks.workunit.client.1.smithi138.stdout:7/1: mkdir d0 0 2024-02-07T12:25:22.827 INFO:tasks.workunit.client.1.smithi138.stdout:7/2: chown d0 1 1 2024-02-07T12:25:22.827 INFO:tasks.workunit.client.1.smithi138.stdout:7/3: chown d0 875779 1 2024-02-07T12:25:22.827 INFO:tasks.workunit.client.1.smithi138.stdout:9/11: mkdir d0 0 2024-02-07T12:25:22.838 INFO:tasks.workunit.client.1.smithi138.stdout:8/2: dwrite f0 [0,4194304] 0 2024-02-07T12:25:22.929 INFO:tasks.workunit.client.1.smithi138.stdout:3/16: creat d5/f6 x:0 0 0 2024-02-07T12:25:22.929 INFO:tasks.workunit.client.1.smithi138.stdout:2/13: symlink d3/l6 0 2024-02-07T12:25:22.931 INFO:tasks.workunit.client.1.smithi138.stdout:5/1: rename l0 to l1 0 2024-02-07T12:25:22.933 INFO:tasks.workunit.client.1.smithi138.stdout:6/2: unlink f0 0 2024-02-07T12:25:22.933 INFO:tasks.workunit.client.1.smithi138.stdout:6/3: dread - no filename 2024-02-07T12:25:22.933 INFO:tasks.workunit.client.1.smithi138.stdout:6/4: rename - no filename 2024-02-07T12:25:22.933 INFO:tasks.workunit.client.1.smithi138.stdout:6/5: chown . 263284 1 2024-02-07T12:25:22.933 INFO:tasks.workunit.client.1.smithi138.stdout:6/6: creat f1 x:0 0 0 2024-02-07T12:25:22.933 INFO:tasks.workunit.client.1.smithi138.stdout:6/7: readlink - no filename 2024-02-07T12:25:22.933 INFO:tasks.workunit.client.1.smithi138.stdout:6/8: creat f2 x:0 0 0 2024-02-07T12:25:22.934 INFO:tasks.workunit.client.1.smithi138.stdout:6/9: chown f1 11329300 1 2024-02-07T12:25:22.934 INFO:tasks.workunit.client.1.smithi138.stdout:6/10: fdatasync f2 0 2024-02-07T12:25:22.934 INFO:tasks.workunit.client.1.smithi138.stdout:6/11: stat f2 0 2024-02-07T12:25:22.934 INFO:tasks.workunit.client.1.smithi138.stdout:6/12: chown f2 56589 1 2024-02-07T12:25:22.934 INFO:tasks.workunit.client.1.smithi138.stdout:7/4: creat d0/f1 x:0 0 0 2024-02-07T12:25:22.934 INFO:tasks.workunit.client.1.smithi138.stdout:7/5: read - d0/f1 zero size 2024-02-07T12:25:22.937 INFO:tasks.workunit.client.1.smithi138.stdout:9/12: creat d0/f1 x:0 0 0 2024-02-07T12:25:22.937 INFO:tasks.workunit.client.1.smithi138.stdout:9/13: read - d0/f1 zero size 2024-02-07T12:25:22.937 INFO:tasks.workunit.client.1.smithi138.stdout:9/14: creat d0/f2 x:0 0 0 2024-02-07T12:25:22.941 INFO:tasks.workunit.client.1.smithi138.stdout:8/3: mkdir d1 0 2024-02-07T12:25:22.941 INFO:tasks.workunit.client.1.smithi138.stdout:8/4: getdents d1 0 2024-02-07T12:25:22.943 INFO:tasks.workunit.client.1.smithi138.stdout:3/17: unlink d5/f6 0 2024-02-07T12:25:22.947 INFO:tasks.workunit.client.1.smithi138.stdout:6/13: mknod c3 0 2024-02-07T12:25:22.947 INFO:tasks.workunit.client.1.smithi138.stdout:7/6: link d0/f1 d0/f2 0 2024-02-07T12:25:22.947 INFO:tasks.workunit.client.1.smithi138.stdout:7/7: stat d0/f1 0 2024-02-07T12:25:22.947 INFO:tasks.workunit.client.1.smithi138.stdout:7/8: truncate d0/f2 41962 0 2024-02-07T12:25:22.947 INFO:tasks.workunit.client.1.smithi138.stdout:7/9: truncate d0/f2 78378 0 2024-02-07T12:25:22.947 INFO:tasks.workunit.client.1.smithi138.stdout:7/10: chown d0 456624157 1 2024-02-07T12:25:22.948 INFO:tasks.workunit.client.1.smithi138.stdout:7/11: truncate d0/f1 1050935 0 2024-02-07T12:25:22.948 INFO:tasks.workunit.client.1.smithi138.stdout:7/12: dread d0/f2 [0,4194304] 0 2024-02-07T12:25:22.948 INFO:tasks.workunit.client.1.smithi138.stdout:7/13: stat d0 0 2024-02-07T12:25:22.949 INFO:tasks.workunit.client.1.smithi138.stdout:9/15: link d0/f1 d0/f3 0 2024-02-07T12:25:22.951 INFO:tasks.workunit.client.1.smithi138.stdout:8/5: mknod d1/c2 0 2024-02-07T12:25:22.951 INFO:tasks.workunit.client.1.smithi138.stdout:3/18: mkdir d5/d7 0 2024-02-07T12:25:22.951 INFO:tasks.workunit.client.1.smithi138.stdout:2/14: dwrite f0 [0,4194304] 0 2024-02-07T12:25:22.951 INFO:tasks.workunit.client.1.smithi138.stdout:2/15: readlink l2 0 2024-02-07T12:25:22.954 INFO:tasks.workunit.client.1.smithi138.stdout:8/6: creat d1/f3 x:0 0 0 2024-02-07T12:25:22.954 INFO:tasks.workunit.client.1.smithi138.stdout:8/7: chown f0 79 1 2024-02-07T12:25:22.954 INFO:tasks.workunit.client.1.smithi138.stdout:8/8: fdatasync d1/f3 0 2024-02-07T12:25:22.958 INFO:tasks.workunit.client.1.smithi138.stdout:8/9: unlink d1/f3 0 2024-02-07T12:25:22.971 INFO:tasks.workunit.client.1.smithi138.stdout:3/19: fdatasync f1 0 2024-02-07T12:25:22.971 INFO:tasks.workunit.client.1.smithi138.stdout:3/20: write f4 [921073,74849] 0 2024-02-07T12:25:22.971 INFO:tasks.workunit.client.1.smithi138.stdout:3/21: chown d5/d7 92 1 2024-02-07T12:25:22.971 INFO:tasks.workunit.client.1.smithi138.stdout:7/14: dwrite d0/f2 [0,4194304] 0 2024-02-07T12:25:22.973 INFO:tasks.workunit.client.1.smithi138.stdout:3/22: rmdir d5/d7 0 2024-02-07T12:25:22.973 INFO:tasks.workunit.client.1.smithi138.stdout:3/23: dread - f3 zero size 2024-02-07T12:25:22.973 INFO:tasks.workunit.client.1.smithi138.stdout:3/24: dread - f3 zero size 2024-02-07T12:25:22.983 INFO:tasks.workunit.client.1.smithi138.stdout:7/15: dread d0/f2 [0,4194304] 0 2024-02-07T12:25:22.983 INFO:tasks.workunit.client.1.smithi138.stdout:7/16: creat d0/f3 x:0 0 0 2024-02-07T12:25:22.986 INFO:tasks.workunit.client.1.smithi138.stdout:7/17: dread d0/f2 [0,4194304] 0 2024-02-07T12:25:22.987 INFO:tasks.workunit.client.1.smithi138.stdout:7/18: truncate d0/f3 115694 0 2024-02-07T12:25:22.987 INFO:tasks.workunit.client.1.smithi138.stdout:7/19: creat d0/f4 x:0 0 0 2024-02-07T12:25:22.987 INFO:tasks.workunit.client.1.smithi138.stdout:2/16: dwrite f1 [0,4194304] 0 2024-02-07T12:25:22.987 INFO:tasks.workunit.client.1.smithi138.stdout:8/10: dwrite f0 [0,4194304] 0 2024-02-07T12:25:22.995 INFO:tasks.workunit.client.1.smithi138.stdout:8/11: dread f0 [0,4194304] 0 2024-02-07T12:25:22.995 INFO:tasks.workunit.client.1.smithi138.stdout:8/12: creat d1/f4 x:0 0 0 2024-02-07T12:25:22.995 INFO:tasks.workunit.client.1.smithi138.stdout:8/13: read - d1/f4 zero size 2024-02-07T12:25:23.006 INFO:tasks.workunit.client.1.smithi138.stdout:2/17: dwrite f0 [0,4194304] 0 2024-02-07T12:25:23.014 INFO:tasks.workunit.client.1.smithi138.stdout:8/14: dwrite d1/f4 [0,4194304] 0 2024-02-07T12:25:23.017 INFO:tasks.workunit.client.1.smithi138.stdout:8/15: dread f0 [0,4194304] 0 2024-02-07T12:25:23.357 INFO:tasks.workunit.client.1.smithi138.stdout:2/18: getdents d3 0 2024-02-07T12:25:23.359 INFO:tasks.workunit.client.1.smithi138.stdout:5/2: link l1 l2 0 2024-02-07T12:25:23.361 INFO:tasks.workunit.client.1.smithi138.stdout:5/3: rename l1 to l3 0 2024-02-07T12:25:23.361 INFO:tasks.workunit.client.1.smithi138.stdout:5/4: write - no filename 2024-02-07T12:25:23.361 INFO:tasks.workunit.client.1.smithi138.stdout:5/5: chown l2 170 1 2024-02-07T12:25:23.362 INFO:tasks.workunit.client.1.smithi138.stdout:5/6: write - no filename 2024-02-07T12:25:23.362 INFO:tasks.workunit.client.1.smithi138.stdout:5/7: dwrite - no filename 2024-02-07T12:25:23.362 INFO:tasks.workunit.client.1.smithi138.stdout:5/8: readlink l3 0 2024-02-07T12:25:23.363 INFO:tasks.workunit.client.1.smithi138.stdout:5/9: rename l2 to l4 0 2024-02-07T12:25:23.364 INFO:tasks.workunit.client.1.smithi138.stdout:2/19: write f1 [2196543,74962] 0 2024-02-07T12:25:23.364 INFO:tasks.workunit.client.1.smithi138.stdout:5/10: mknod c5 0 2024-02-07T12:25:23.364 INFO:tasks.workunit.client.1.smithi138.stdout:5/11: fdatasync - no filename 2024-02-07T12:25:23.364 INFO:tasks.workunit.client.1.smithi138.stdout:5/12: truncate - no filename 2024-02-07T12:25:23.366 INFO:tasks.workunit.client.1.smithi138.stdout:2/20: rename l2 to d3/d5/l7 0 2024-02-07T12:25:23.369 INFO:tasks.workunit.client.1.smithi138.stdout:6/14: fsync f2 0 2024-02-07T12:25:23.371 INFO:tasks.workunit.client.1.smithi138.stdout:9/16: getdents d0 0 2024-02-07T12:25:23.373 INFO:tasks.workunit.client.1.smithi138.stdout:9/17: creat d0/f4 x:0 0 0 2024-02-07T12:25:23.376 INFO:tasks.workunit.client.1.smithi138.stdout:9/18: mkdir d0/d5 0 2024-02-07T12:25:23.376 INFO:tasks.workunit.client.1.smithi138.stdout:9/19: read - d0/f4 zero size 2024-02-07T12:25:23.378 INFO:tasks.workunit.client.1.smithi138.stdout:9/20: mkdir d0/d6 0 2024-02-07T12:25:23.379 INFO:tasks.workunit.client.1.smithi138.stdout:9/21: rename d0/d6 to d0/d6/d7 22 2024-02-07T12:25:23.379 INFO:tasks.workunit.client.1.smithi138.stdout:9/22: stat d0/d6 0 2024-02-07T12:25:23.379 INFO:tasks.workunit.client.1.smithi138.stdout:9/23: chown d0/f4 39017204 1 2024-02-07T12:25:23.380 INFO:tasks.workunit.client.1.smithi138.stdout:9/24: dread - d0/f1 zero size 2024-02-07T12:25:23.381 INFO:tasks.workunit.client.1.smithi138.stdout:3/25: getdents d5 0 2024-02-07T12:25:23.384 INFO:tasks.workunit.client.1.smithi138.stdout:6/15: dwrite f1 [0,4194304] 0 2024-02-07T12:25:23.384 INFO:tasks.workunit.client.1.smithi138.stdout:6/16: fsync f1 0 2024-02-07T12:25:23.384 INFO:tasks.workunit.client.1.smithi138.stdout:6/17: fsync f1 0 2024-02-07T12:25:23.385 INFO:tasks.workunit.client.1.smithi138.stdout:7/20: getdents d0 0 2024-02-07T12:25:23.385 INFO:tasks.workunit.client.1.smithi138.stdout:7/21: rename d0 to d0/d5 22 2024-02-07T12:25:23.385 INFO:tasks.workunit.client.1.smithi138.stdout:7/22: truncate d0/f4 397837 0 2024-02-07T12:25:23.386 INFO:tasks.workunit.client.1.smithi138.stdout:2/21: write f1 [4926175,10502] 0 2024-02-07T12:25:23.386 INFO:tasks.workunit.client.1.smithi138.stdout:2/22: fsync f0 0 2024-02-07T12:25:23.389 INFO:tasks.workunit.client.1.smithi138.stdout:8/16: getdents d1 0 2024-02-07T12:25:23.389 INFO:tasks.workunit.client.1.smithi138.stdout:8/17: chown d1 334 1 2024-02-07T12:25:23.391 INFO:tasks.workunit.client.1.smithi138.stdout:7/23: mkdir d0/d6 0 2024-02-07T12:25:23.391 INFO:tasks.workunit.client.1.smithi138.stdout:7/24: fsync d0/f2 0 2024-02-07T12:25:23.391 INFO:tasks.workunit.client.1.smithi138.stdout:7/25: chown d0 8007548 1 2024-02-07T12:25:23.392 INFO:tasks.workunit.client.1.smithi138.stdout:2/23: symlink d3/d5/l8 0 2024-02-07T12:25:23.397 INFO:tasks.workunit.client.1.smithi138.stdout:7/26: symlink d0/l7 0 2024-02-07T12:25:23.397 INFO:tasks.workunit.client.1.smithi138.stdout:7/27: write d0/f3 [502616,101262] 0 2024-02-07T12:25:23.399 INFO:tasks.workunit.client.1.smithi138.stdout:2/24: mkdir d3/d9 0 2024-02-07T12:25:23.400 INFO:tasks.workunit.client.1.smithi138.stdout:8/18: link d1/f4 d1/f5 0 2024-02-07T12:25:23.401 INFO:tasks.workunit.client.1.smithi138.stdout:7/28: mkdir d0/d8 0 2024-02-07T12:25:23.402 INFO:tasks.workunit.client.1.smithi138.stdout:3/26: dwrite f2 [0,4194304] 0 2024-02-07T12:25:23.403 INFO:tasks.workunit.client.1.smithi138.stdout:9/25: dwrite d0/f3 [0,4194304] 0 2024-02-07T12:25:23.403 INFO:tasks.workunit.client.1.smithi138.stdout:7/29: mkdir d0/d9 0 2024-02-07T12:25:23.405 INFO:tasks.workunit.client.1.smithi138.stdout:3/27: dread f4 [0,4194304] 0 2024-02-07T12:25:23.405 INFO:tasks.workunit.client.1.smithi138.stdout:3/28: fsync f1 0 2024-02-07T12:25:23.407 INFO:tasks.workunit.client.1.smithi138.stdout:6/18: dwrite f2 [0,4194304] 0 2024-02-07T12:25:23.410 INFO:tasks.workunit.client.1.smithi138.stdout:9/26: write d0/f2 [415907,29304] 0 2024-02-07T12:25:23.411 INFO:tasks.workunit.client.1.smithi138.stdout:7/30: rename d0/f3 to d0/d6/fa 0 2024-02-07T12:25:23.412 INFO:tasks.workunit.client.1.smithi138.stdout:7/31: stat d0 0 2024-02-07T12:25:23.412 INFO:tasks.workunit.client.1.smithi138.stdout:7/32: chown d0/d9 4642 1 2024-02-07T12:25:23.413 INFO:tasks.workunit.client.1.smithi138.stdout:3/29: mknod d5/c8 0 2024-02-07T12:25:23.413 INFO:tasks.workunit.client.1.smithi138.stdout:3/30: write f3 [945471,71083] 0 2024-02-07T12:25:23.413 INFO:tasks.workunit.client.1.smithi138.stdout:3/31: truncate f1 1287008 0 2024-02-07T12:25:23.417 INFO:tasks.workunit.client.1.smithi138.stdout:2/25: dread f0 [0,4194304] 0 2024-02-07T12:25:23.417 INFO:tasks.workunit.client.1.smithi138.stdout:6/19: link c3 c4 0 2024-02-07T12:25:23.419 INFO:tasks.workunit.client.1.smithi138.stdout:9/27: mkdir d0/d6/d8 0 2024-02-07T12:25:23.419 INFO:tasks.workunit.client.1.smithi138.stdout:7/33: dread d0/d6/fa [0,4194304] 0 2024-02-07T12:25:23.422 INFO:tasks.workunit.client.1.smithi138.stdout:7/34: read d0/f1 [1679755,17389] 0 2024-02-07T12:25:23.425 INFO:tasks.workunit.client.1.smithi138.stdout:7/35: link d0/l7 d0/d8/lb 0 2024-02-07T12:25:23.425 INFO:tasks.workunit.client.1.smithi138.stdout:7/36: fdatasync d0/f4 0 2024-02-07T12:25:23.426 INFO:tasks.workunit.client.1.smithi138.stdout:6/20: read f2 [818332,96942] 0 2024-02-07T12:25:23.428 INFO:tasks.workunit.client.1.smithi138.stdout:2/26: dread f1 [4194304,4194304] 0 2024-02-07T12:25:23.428 INFO:tasks.workunit.client.1.smithi138.stdout:3/32: dwrite f4 [0,4194304] 0 2024-02-07T12:25:23.429 INFO:tasks.workunit.client.1.smithi138.stdout:7/37: rename d0/d8/lb to d0/d9/lc 0 2024-02-07T12:25:23.429 INFO:tasks.workunit.client.1.smithi138.stdout:7/38: truncate d0/f2 4409222 0 2024-02-07T12:25:23.429 INFO:tasks.workunit.client.1.smithi138.stdout:7/39: read d0/f1 [1216601,117394] 0 2024-02-07T12:25:23.429 INFO:tasks.workunit.client.1.smithi138.stdout:7/40: dread d0/f4 [0,4194304] 0 2024-02-07T12:25:23.430 INFO:tasks.workunit.client.1.smithi138.stdout:2/27: rmdir d3/d5 39 2024-02-07T12:25:23.431 INFO:tasks.workunit.client.1.smithi138.stdout:3/33: dread f1 [0,4194304] 0 2024-02-07T12:25:23.439 INFO:tasks.workunit.client.1.smithi138.stdout:3/34: dread f3 [0,4194304] 0 2024-02-07T12:25:23.442 INFO:tasks.workunit.client.1.smithi138.stdout:3/35: unlink l0 0 2024-02-07T12:25:23.443 INFO:tasks.workunit.client.1.smithi138.stdout:3/36: creat d5/f9 x:0 0 0 2024-02-07T12:25:23.445 INFO:tasks.workunit.client.1.smithi138.stdout:3/37: symlink d5/la 0 2024-02-07T12:25:23.445 INFO:tasks.workunit.client.1.smithi138.stdout:3/38: fdatasync f3 0 2024-02-07T12:25:23.445 INFO:tasks.workunit.client.1.smithi138.stdout:3/39: stat d5 0 2024-02-07T12:25:23.445 INFO:tasks.workunit.client.1.smithi138.stdout:3/40: chown d5/f9 1497 1 2024-02-07T12:25:23.446 INFO:tasks.workunit.client.1.smithi138.stdout:2/28: dwrite f0 [0,4194304] 0 2024-02-07T12:25:23.450 INFO:tasks.workunit.client.1.smithi138.stdout:5/13: rename l3 to l6 0 2024-02-07T12:25:23.454 INFO:tasks.workunit.client.1.smithi138.stdout:9/28: getdents d0 0 2024-02-07T12:25:23.455 INFO:tasks.workunit.client.1.smithi138.stdout:6/21: write f1 [5051134,88550] 0 2024-02-07T12:25:23.458 INFO:tasks.workunit.client.1.smithi138.stdout:8/19: fsync d1/f4 0 2024-02-07T12:25:23.461 INFO:tasks.workunit.client.1.smithi138.stdout:8/20: dread f0 [0,4194304] 0 2024-02-07T12:25:23.461 INFO:tasks.workunit.client.1.smithi138.stdout:8/21: write f0 [4508431,61472] 0 2024-02-07T12:25:23.461 INFO:tasks.workunit.client.1.smithi138.stdout:8/22: truncate f0 4996482 0 2024-02-07T12:25:23.462 INFO:tasks.workunit.client.1.smithi138.stdout:6/22: truncate f2 1286132 0 2024-02-07T12:25:23.462 INFO:tasks.workunit.client.1.smithi138.stdout:3/41: dwrite f4 [0,4194304] 0 2024-02-07T12:25:23.462 INFO:tasks.workunit.client.1.smithi138.stdout:3/42: fdatasync f3 0 2024-02-07T12:25:23.462 INFO:tasks.workunit.client.1.smithi138.stdout:3/43: dread - d5/f9 zero size 2024-02-07T12:25:23.464 INFO:tasks.workunit.client.1.smithi138.stdout:8/23: mkdir d1/d6 0 2024-02-07T12:25:23.464 INFO:tasks.workunit.client.1.smithi138.stdout:8/24: chown d1/f4 112697328 1 2024-02-07T12:25:23.465 INFO:tasks.workunit.client.1.smithi138.stdout:3/44: symlink d5/lb 0 2024-02-07T12:25:23.466 INFO:tasks.workunit.client.1.smithi138.stdout:9/29: dread d0/f1 [0,4194304] 0 2024-02-07T12:25:23.466 INFO:tasks.workunit.client.1.smithi138.stdout:9/30: truncate d0/f4 507105 0 2024-02-07T12:25:23.467 INFO:tasks.workunit.client.1.smithi138.stdout:7/41: rename d0/d9 to d0/d6/dd 0 2024-02-07T12:25:23.467 INFO:tasks.workunit.client.1.smithi138.stdout:2/29: rename d3/d5 to d3/d5/da 22 2024-02-07T12:25:23.467 INFO:tasks.workunit.client.1.smithi138.stdout:7/42: write d0/f2 [3353890,84385] 0 2024-02-07T12:25:23.468 INFO:tasks.workunit.client.1.smithi138.stdout:7/43: dread d0/f4 [0,4194304] 0 2024-02-07T12:25:23.468 INFO:tasks.workunit.client.1.smithi138.stdout:7/44: write d0/f2 [3546765,59362] 0 2024-02-07T12:25:23.469 INFO:tasks.workunit.client.1.smithi138.stdout:3/45: unlink f4 0 2024-02-07T12:25:23.469 INFO:tasks.workunit.client.1.smithi138.stdout:3/46: creat d5/fc x:0 0 0 2024-02-07T12:25:23.469 INFO:tasks.workunit.client.1.smithi138.stdout:3/47: creat d5/fd x:0 0 0 2024-02-07T12:25:23.470 INFO:tasks.workunit.client.1.smithi138.stdout:9/31: truncate d0/f1 1825605 0 2024-02-07T12:25:23.471 INFO:tasks.workunit.client.1.smithi138.stdout:7/45: fsync d0/f2 0 2024-02-07T12:25:23.472 INFO:tasks.workunit.client.1.smithi138.stdout:8/25: write d1/f4 [261039,98820] 0 2024-02-07T12:25:23.475 INFO:tasks.workunit.client.1.smithi138.stdout:3/48: symlink d5/le 0 2024-02-07T12:25:23.475 INFO:tasks.workunit.client.1.smithi138.stdout:8/26: fsync f0 0 2024-02-07T12:25:23.478 INFO:tasks.workunit.client.1.smithi138.stdout:5/14: link l6 l7 0 2024-02-07T12:25:23.480 INFO:tasks.workunit.client.1.smithi138.stdout:6/23: truncate f2 1455017 0 2024-02-07T12:25:23.481 INFO:tasks.workunit.client.1.smithi138.stdout:7/46: mknod d0/ce 0 2024-02-07T12:25:23.482 INFO:tasks.workunit.client.1.smithi138.stdout:7/47: chown d0/f2 111 1 2024-02-07T12:25:23.482 INFO:tasks.workunit.client.1.smithi138.stdout:7/48: readlink d0/d6/dd/lc 0 2024-02-07T12:25:23.483 INFO:tasks.workunit.client.1.smithi138.stdout:3/49: dread f2 [0,4194304] 0 2024-02-07T12:25:23.483 INFO:tasks.workunit.client.1.smithi138.stdout:3/50: dread - d5/fd zero size 2024-02-07T12:25:23.483 INFO:tasks.workunit.client.1.smithi138.stdout:3/51: chown d5/c8 21945 1 2024-02-07T12:25:23.484 INFO:tasks.workunit.client.1.smithi138.stdout:3/52: dread - d5/fd zero size 2024-02-07T12:25:23.485 INFO:tasks.workunit.client.1.smithi138.stdout:3/53: dread f1 [0,4194304] 0 2024-02-07T12:25:23.485 INFO:tasks.workunit.client.1.smithi138.stdout:3/54: dread - d5/f9 zero size 2024-02-07T12:25:23.485 INFO:tasks.workunit.client.1.smithi138.stdout:6/24: symlink l5 0 2024-02-07T12:25:23.486 INFO:tasks.workunit.client.1.smithi138.stdout:7/49: creat d0/d6/dd/ff x:0 0 0 2024-02-07T12:25:23.488 INFO:tasks.workunit.client.1.smithi138.stdout:8/27: symlink d1/l7 0 2024-02-07T12:25:23.491 INFO:tasks.workunit.client.1.smithi138.stdout:3/55: rename d5/fc to d5/ff 0 2024-02-07T12:25:23.491 INFO:tasks.workunit.client.1.smithi138.stdout:3/56: creat d5/f10 x:0 0 0 2024-02-07T12:25:23.491 INFO:tasks.workunit.client.1.smithi138.stdout:3/57: creat d5/f11 x:0 0 0 2024-02-07T12:25:23.491 INFO:tasks.workunit.client.1.smithi138.stdout:3/58: write f1 [1455034,3502] 0 2024-02-07T12:25:23.491 INFO:tasks.workunit.client.1.smithi138.stdout:9/32: write d0/f1 [1334524,117600] 0 2024-02-07T12:25:23.491 INFO:tasks.workunit.client.1.smithi138.stdout:2/30: truncate f0 2314014 0 2024-02-07T12:25:23.493 INFO:tasks.workunit.client.1.smithi138.stdout:5/15: getdents . 0 2024-02-07T12:25:23.493 INFO:tasks.workunit.client.1.smithi138.stdout:5/16: fdatasync - no filename 2024-02-07T12:25:23.493 INFO:tasks.workunit.client.1.smithi138.stdout:5/17: chown l6 22217 1 2024-02-07T12:25:23.493 INFO:tasks.workunit.client.1.smithi138.stdout:5/18: dwrite - no filename 2024-02-07T12:25:23.496 INFO:tasks.workunit.client.1.smithi138.stdout:3/59: symlink d5/l12 0 2024-02-07T12:25:23.496 INFO:tasks.workunit.client.1.smithi138.stdout:3/60: dread - d5/f11 zero size 2024-02-07T12:25:23.496 INFO:tasks.workunit.client.1.smithi138.stdout:3/61: truncate f3 1068327 0 2024-02-07T12:25:23.496 INFO:tasks.workunit.client.1.smithi138.stdout:8/28: dread f0 [0,4194304] 0 2024-02-07T12:25:23.496 INFO:tasks.workunit.client.1.smithi138.stdout:6/25: write f2 [80583,124493] 0 2024-02-07T12:25:23.498 INFO:tasks.workunit.client.1.smithi138.stdout:2/31: creat d3/d5/fb x:0 0 0 2024-02-07T12:25:23.498 INFO:tasks.workunit.client.1.smithi138.stdout:2/32: write d3/d5/fb [273955,41205] 0 2024-02-07T12:25:23.500 INFO:tasks.workunit.client.1.smithi138.stdout:5/19: creat f8 x:0 0 0 2024-02-07T12:25:23.502 INFO:tasks.workunit.client.1.smithi138.stdout:7/50: dwrite d0/f1 [0,4194304] 0 2024-02-07T12:25:23.502 INFO:tasks.workunit.client.1.smithi138.stdout:8/29: link f0 d1/d6/f8 0 2024-02-07T12:25:23.505 INFO:tasks.workunit.client.1.smithi138.stdout:5/20: stat l7 0 2024-02-07T12:25:23.507 INFO:tasks.workunit.client.1.smithi138.stdout:5/21: stat l4 0 2024-02-07T12:25:23.516 INFO:tasks.workunit.client.1.smithi138.stdout:5/22: link l6 l9 0 2024-02-07T12:25:23.518 INFO:tasks.workunit.client.1.smithi138.stdout:9/33: truncate d0/f3 237387 0 2024-02-07T12:25:23.518 INFO:tasks.workunit.client.1.smithi138.stdout:9/34: chown d0/f1 2685 1 2024-02-07T12:25:23.519 INFO:tasks.workunit.client.1.smithi138.stdout:5/23: stat l4 0 2024-02-07T12:25:23.525 INFO:tasks.workunit.client.1.smithi138.stdout:5/24: mkdir da 0 2024-02-07T12:25:23.529 INFO:tasks.workunit.client.1.smithi138.stdout:7/51: dwrite d0/f1 [0,4194304] 0 2024-02-07T12:25:23.535 INFO:tasks.workunit.client.1.smithi138.stdout:6/26: dwrite f2 [0,4194304] 0 2024-02-07T12:25:23.535 INFO:tasks.workunit.client.1.smithi138.stdout:6/27: creat f6 x:0 0 0 2024-02-07T12:25:23.536 INFO:tasks.workunit.client.1.smithi138.stdout:3/62: dwrite f1 [0,4194304] 0 2024-02-07T12:25:23.546 INFO:tasks.workunit.client.1.smithi138.stdout:9/35: dread d0/f2 [0,4194304] 0 2024-02-07T12:25:23.547 INFO:tasks.workunit.client.1.smithi138.stdout:9/36: write d0/f2 [209382,47275] 0 2024-02-07T12:25:23.549 INFO:tasks.workunit.client.1.smithi138.stdout:8/30: dwrite d1/d6/f8 [0,4194304] 0 2024-02-07T12:25:23.550 INFO:tasks.workunit.client.1.smithi138.stdout:2/33: dwrite d3/d5/fb [0,4194304] 0 2024-02-07T12:25:23.550 INFO:tasks.workunit.client.1.smithi138.stdout:5/25: dwrite f8 [0,4194304] 0 2024-02-07T12:25:23.551 INFO:tasks.workunit.client.1.smithi138.stdout:7/52: dwrite d0/f2 [0,4194304] 0 2024-02-07T12:25:23.552 INFO:tasks.workunit.client.1.smithi138.stdout:6/28: symlink l7 0 2024-02-07T12:25:23.552 INFO:tasks.workunit.client.1.smithi138.stdout:6/29: fdatasync f6 0 2024-02-07T12:25:23.552 INFO:tasks.workunit.client.1.smithi138.stdout:6/30: creat f8 x:0 0 0 2024-02-07T12:25:23.557 INFO:tasks.workunit.client.1.smithi138.stdout:3/63: mknod d5/c13 0 2024-02-07T12:25:23.557 INFO:tasks.workunit.client.1.smithi138.stdout:3/64: chown d5/la 2041 1 2024-02-07T12:25:23.564 INFO:tasks.workunit.client.1.smithi138.stdout:2/34: mknod d3/d5/cc 0 2024-02-07T12:25:23.580 INFO:tasks.workunit.client.1.smithi138.stdout:7/53: creat d0/d6/f10 x:0 0 0 2024-02-07T12:25:23.580 INFO:tasks.workunit.client.1.smithi138.stdout:7/54: dread d0/f4 [0,4194304] 0 2024-02-07T12:25:23.580 INFO:tasks.workunit.client.1.smithi138.stdout:6/31: rename f2 to f9 0 2024-02-07T12:25:23.580 INFO:tasks.workunit.client.1.smithi138.stdout:6/32: fdatasync f8 0 2024-02-07T12:25:23.581 INFO:tasks.workunit.client.1.smithi138.stdout:3/65: rename d5/la to d5/l14 0 2024-02-07T12:25:23.583 INFO:tasks.workunit.client.1.smithi138.stdout:9/37: rename d0/f3 to d0/f9 0 2024-02-07T12:25:23.584 INFO:tasks.workunit.client.1.smithi138.stdout:9/38: dread d0/f1 [0,4194304] 0 2024-02-07T12:25:23.584 INFO:tasks.workunit.client.1.smithi138.stdout:9/39: read d0/f1 [10176,30936] 0 2024-02-07T12:25:23.584 INFO:tasks.workunit.client.1.smithi138.stdout:9/40: write d0/f9 [539223,76626] 0 2024-02-07T12:25:23.584 INFO:tasks.workunit.client.1.smithi138.stdout:8/31: link d1/l7 d1/l9 0 2024-02-07T12:25:23.585 INFO:tasks.workunit.client.1.smithi138.stdout:7/55: mkdir d0/d8/d11 0 2024-02-07T12:25:23.585 INFO:tasks.workunit.client.1.smithi138.stdout:7/56: creat d0/d6/f12 x:0 0 0 2024-02-07T12:25:23.586 INFO:tasks.workunit.client.1.smithi138.stdout:7/57: fsync d0/d6/fa 0 2024-02-07T12:25:23.586 INFO:tasks.workunit.client.1.smithi138.stdout:7/58: fdatasync d0/f4 0 2024-02-07T12:25:23.587 INFO:tasks.workunit.client.1.smithi138.stdout:6/33: mknod ca 0 2024-02-07T12:25:23.587 INFO:tasks.workunit.client.1.smithi138.stdout:6/34: creat fb x:0 0 0 2024-02-07T12:25:23.588 INFO:tasks.workunit.client.1.smithi138.stdout:2/35: dwrite d3/d5/fb [0,4194304] 0 2024-02-07T12:25:23.592 INFO:tasks.workunit.client.1.smithi138.stdout:9/41: creat d0/fa x:0 0 0 2024-02-07T12:25:23.593 INFO:tasks.workunit.client.1.smithi138.stdout:8/32: stat d1/l9 0 2024-02-07T12:25:23.593 INFO:tasks.workunit.client.1.smithi138.stdout:9/42: dread - d0/fa zero size 2024-02-07T12:25:23.594 INFO:tasks.workunit.client.1.smithi138.stdout:7/59: mknod d0/d6/c13 0 2024-02-07T12:25:23.594 INFO:tasks.workunit.client.1.smithi138.stdout:7/60: chown d0 3 1 2024-02-07T12:25:23.597 INFO:tasks.workunit.client.1.smithi138.stdout:6/35: mkdir dc 0 2024-02-07T12:25:23.597 INFO:tasks.workunit.client.1.smithi138.stdout:6/36: truncate fb 42746 0 2024-02-07T12:25:23.602 INFO:tasks.workunit.client.1.smithi138.stdout:9/43: creat d0/d6/fb x:0 0 0 2024-02-07T12:25:23.602 INFO:tasks.workunit.client.1.smithi138.stdout:7/61: creat d0/f14 x:0 0 0 2024-02-07T12:25:23.604 INFO:tasks.workunit.client.1.smithi138.stdout:8/33: truncate f0 4137744 0 2024-02-07T12:25:23.610 INFO:tasks.workunit.client.1.smithi138.stdout:5/26: truncate f8 29481 0 2024-02-07T12:25:23.612 INFO:tasks.workunit.client.1.smithi138.stdout:8/34: symlink d1/la 0 2024-02-07T12:25:23.614 INFO:tasks.workunit.client.1.smithi138.stdout:5/27: creat da/fb x:0 0 0 2024-02-07T12:25:23.614 INFO:tasks.workunit.client.1.smithi138.stdout:5/28: dread - da/fb zero size 2024-02-07T12:25:23.614 INFO:tasks.workunit.client.1.smithi138.stdout:5/29: creat da/fc x:0 0 0 2024-02-07T12:25:23.615 INFO:tasks.workunit.client.1.smithi138.stdout:7/62: rename d0/d6/dd to d0/d8/d15 0 2024-02-07T12:25:23.615 INFO:tasks.workunit.client.1.smithi138.stdout:7/63: chown d0/d6/f12 3722393 1 2024-02-07T12:25:23.615 INFO:tasks.workunit.client.1.smithi138.stdout:7/64: creat d0/d6/f16 x:0 0 0 2024-02-07T12:25:23.616 INFO:tasks.workunit.client.1.smithi138.stdout:6/37: dwrite f9 [0,4194304] 0 2024-02-07T12:25:23.617 INFO:tasks.workunit.client.1.smithi138.stdout:8/35: rename d1/f5 to d1/d6/fb 0 2024-02-07T12:25:23.619 INFO:tasks.workunit.client.1.smithi138.stdout:6/38: stat c4 0 2024-02-07T12:25:23.619 INFO:tasks.workunit.client.1.smithi138.stdout:2/36: dwrite d3/d5/fb [0,4194304] 0 2024-02-07T12:25:23.620 INFO:tasks.workunit.client.1.smithi138.stdout:2/37: write f1 [266459,30883] 0 2024-02-07T12:25:23.621 INFO:tasks.workunit.client.1.smithi138.stdout:7/65: rename d0/d6/f10 to d0/f17 0 2024-02-07T12:25:23.622 INFO:tasks.workunit.client.1.smithi138.stdout:6/39: creat dc/fd x:0 0 0 2024-02-07T12:25:23.622 INFO:tasks.workunit.client.1.smithi138.stdout:6/40: fdatasync dc/fd 0 2024-02-07T12:25:23.622 INFO:tasks.workunit.client.1.smithi138.stdout:6/41: dread - f8 zero size 2024-02-07T12:25:23.624 INFO:tasks.workunit.client.1.smithi138.stdout:3/66: rmdir d5 39 2024-02-07T12:25:23.626 INFO:tasks.workunit.client.1.smithi138.stdout:2/38: mkdir d3/dd 0 2024-02-07T12:25:23.628 INFO:tasks.workunit.client.1.smithi138.stdout:7/66: creat d0/d8/d15/f18 x:0 0 0 2024-02-07T12:25:23.630 INFO:tasks.workunit.client.1.smithi138.stdout:8/36: link d1/la d1/lc 0 2024-02-07T12:25:23.631 INFO:tasks.workunit.client.1.smithi138.stdout:6/42: write f9 [2516916,12237] 0 2024-02-07T12:25:23.631 INFO:tasks.workunit.client.1.smithi138.stdout:6/43: write f8 [24568,17100] 0 2024-02-07T12:25:23.631 INFO:tasks.workunit.client.1.smithi138.stdout:3/67: mkdir d5/d15 0 2024-02-07T12:25:23.632 INFO:tasks.workunit.client.1.smithi138.stdout:2/39: mkdir d3/d9/de 0 2024-02-07T12:25:23.635 INFO:tasks.workunit.client.1.smithi138.stdout:4/2: sync 2024-02-07T12:25:23.635 INFO:tasks.workunit.client.1.smithi138.stdout:1/9: sync 2024-02-07T12:25:23.635 INFO:tasks.workunit.client.1.smithi138.stdout:0/0: sync 2024-02-07T12:25:23.635 INFO:tasks.workunit.client.1.smithi138.stdout:0/1: write - no filename 2024-02-07T12:25:23.635 INFO:tasks.workunit.client.1.smithi138.stdout:0/2: read - no filename 2024-02-07T12:25:23.636 INFO:tasks.workunit.client.1.smithi138.stdout:1/10: chown f1 5879 1 2024-02-07T12:25:23.636 INFO:tasks.workunit.client.1.smithi138.stdout:0/3: chown . 331470 1 2024-02-07T12:25:23.636 INFO:tasks.workunit.client.1.smithi138.stdout:0/4: chown . 111 1 2024-02-07T12:25:23.636 INFO:tasks.workunit.client.1.smithi138.stdout:0/5: chown . 148 1 2024-02-07T12:25:23.636 INFO:tasks.workunit.client.1.smithi138.stdout:6/44: mknod dc/ce 0 2024-02-07T12:25:23.636 INFO:tasks.workunit.client.1.smithi138.stdout:6/45: fsync f1 0 2024-02-07T12:25:23.636 INFO:tasks.workunit.client.1.smithi138.stdout:6/46: creat dc/ff x:0 0 0 2024-02-07T12:25:23.636 INFO:tasks.workunit.client.1.smithi138.stdout:3/68: creat d5/d15/f16 x:0 0 0 2024-02-07T12:25:23.637 INFO:tasks.workunit.client.1.smithi138.stdout:2/40: truncate f0 1945086 0 2024-02-07T12:25:23.638 INFO:tasks.workunit.client.1.smithi138.stdout:1/11: symlink l2 0 2024-02-07T12:25:23.640 INFO:tasks.workunit.client.1.smithi138.stdout:4/3: symlink l0 0 2024-02-07T12:25:23.640 INFO:tasks.workunit.client.1.smithi138.stdout:4/4: readlink l0 0 2024-02-07T12:25:23.641 INFO:tasks.workunit.client.1.smithi138.stdout:0/6: mknod c0 0 2024-02-07T12:25:23.644 INFO:tasks.workunit.client.1.smithi138.stdout:6/47: unlink dc/ce 0 2024-02-07T12:25:23.648 INFO:tasks.workunit.client.1.smithi138.stdout:3/69: rename f2 to d5/d15/f17 0 2024-02-07T12:25:23.648 INFO:tasks.workunit.client.1.smithi138.stdout:3/70: stat d5 0 2024-02-07T12:25:23.648 INFO:tasks.workunit.client.1.smithi138.stdout:3/71: chown d5/d15 506 1 2024-02-07T12:25:23.648 INFO:tasks.workunit.client.1.smithi138.stdout:3/72: creat d5/d15/f18 x:0 0 0 2024-02-07T12:25:23.648 INFO:tasks.workunit.client.1.smithi138.stdout:3/73: creat d5/d15/f19 x:0 0 0 2024-02-07T12:25:23.650 INFO:tasks.workunit.client.1.smithi138.stdout:1/12: rename f1 to f3 0 2024-02-07T12:25:23.650 INFO:tasks.workunit.client.1.smithi138.stdout:1/13: chown c0 119090258 1 2024-02-07T12:25:23.651 INFO:tasks.workunit.client.1.smithi138.stdout:1/14: creat f4 x:0 0 0 2024-02-07T12:25:23.651 INFO:tasks.workunit.client.1.smithi138.stdout:1/15: dread - f3 zero size 2024-02-07T12:25:23.652 INFO:tasks.workunit.client.1.smithi138.stdout:4/5: mknod c1 0 2024-02-07T12:25:23.654 INFO:tasks.workunit.client.1.smithi138.stdout:0/7: creat f1 x:0 0 0 2024-02-07T12:25:23.654 INFO:tasks.workunit.client.1.smithi138.stdout:0/8: write f1 [765550,109348] 0 2024-02-07T12:25:23.654 INFO:tasks.workunit.client.1.smithi138.stdout:0/9: creat f2 x:0 0 0 2024-02-07T12:25:23.654 INFO:tasks.workunit.client.1.smithi138.stdout:0/10: creat f3 x:0 0 0 2024-02-07T12:25:23.655 INFO:tasks.workunit.client.1.smithi138.stdout:8/37: getdents d1/d6 0 2024-02-07T12:25:23.657 INFO:tasks.workunit.client.1.smithi138.stdout:5/30: dwrite f8 [0,4194304] 0 2024-02-07T12:25:23.661 INFO:tasks.workunit.client.1.smithi138.stdout:7/67: unlink d0/f17 0 2024-02-07T12:25:23.663 INFO:tasks.workunit.client.1.smithi138.stdout:1/16: mkdir d5 0 2024-02-07T12:25:23.663 INFO:tasks.workunit.client.1.smithi138.stdout:1/17: stat f4 0 2024-02-07T12:25:23.665 INFO:tasks.workunit.client.1.smithi138.stdout:4/6: rename c1 to c2 0 2024-02-07T12:25:23.665 INFO:tasks.workunit.client.1.smithi138.stdout:4/7: fsync - no filename 2024-02-07T12:25:23.665 INFO:tasks.workunit.client.1.smithi138.stdout:4/8: dread - no filename 2024-02-07T12:25:23.665 INFO:tasks.workunit.client.1.smithi138.stdout:4/9: write - no filename 2024-02-07T12:25:23.670 INFO:tasks.workunit.client.1.smithi138.stdout:0/11: mkdir d4 0 2024-02-07T12:25:23.671 INFO:tasks.workunit.client.1.smithi138.stdout:8/38: stat d1/c2 0 2024-02-07T12:25:23.671 INFO:tasks.workunit.client.1.smithi138.stdout:8/39: chown d1/l9 2228662 1 2024-02-07T12:25:23.671 INFO:tasks.workunit.client.1.smithi138.stdout:3/74: dwrite f1 [0,4194304] 0 2024-02-07T12:25:23.673 INFO:tasks.workunit.client.1.smithi138.stdout:7/68: truncate d0/f2 3175811 0 2024-02-07T12:25:23.674 INFO:tasks.workunit.client.1.smithi138.stdout:1/18: symlink d5/l6 0 2024-02-07T12:25:23.674 INFO:tasks.workunit.client.1.smithi138.stdout:1/19: write f3 [430801,52810] 0 2024-02-07T12:25:23.675 INFO:tasks.workunit.client.1.smithi138.stdout:1/20: truncate f3 1382826 0 2024-02-07T12:25:23.675 INFO:tasks.workunit.client.1.smithi138.stdout:5/31: dwrite da/fb [0,4194304] 0 2024-02-07T12:25:23.676 INFO:tasks.workunit.client.1.smithi138.stdout:4/10: creat f3 x:0 0 0 2024-02-07T12:25:23.676 INFO:tasks.workunit.client.1.smithi138.stdout:4/11: readlink l0 0 2024-02-07T12:25:23.676 INFO:tasks.workunit.client.1.smithi138.stdout:4/12: write f3 [1045562,2695] 0 2024-02-07T12:25:23.681 INFO:tasks.workunit.client.1.smithi138.stdout:7/69: mkdir d0/d6/d19 0 2024-02-07T12:25:23.684 INFO:tasks.workunit.client.1.smithi138.stdout:0/12: dread f1 [0,4194304] 0 2024-02-07T12:25:23.684 INFO:tasks.workunit.client.1.smithi138.stdout:8/40: mkdir d1/dd 0 2024-02-07T12:25:23.688 INFO:tasks.workunit.client.1.smithi138.stdout:7/70: mkdir d0/d8/d11/d1a 0 2024-02-07T12:25:23.690 INFO:tasks.workunit.client.1.smithi138.stdout:0/13: creat d4/f5 x:0 0 0 2024-02-07T12:25:23.690 INFO:tasks.workunit.client.1.smithi138.stdout:0/14: dread - d4/f5 zero size 2024-02-07T12:25:23.696 INFO:tasks.workunit.client.1.smithi138.stdout:7/71: link d0/d8/d15/f18 d0/d8/d11/f1b 0 2024-02-07T12:25:23.696 INFO:tasks.workunit.client.1.smithi138.stdout:7/72: readlink d0/l7 0 2024-02-07T12:25:23.699 INFO:tasks.workunit.client.1.smithi138.stdout:3/75: unlink d5/d15/f17 0 2024-02-07T12:25:23.699 INFO:tasks.workunit.client.1.smithi138.stdout:3/76: stat d5/c8 0 2024-02-07T12:25:23.699 INFO:tasks.workunit.client.1.smithi138.stdout:3/77: creat d5/d15/f1a x:0 0 0 2024-02-07T12:25:23.699 INFO:tasks.workunit.client.1.smithi138.stdout:3/78: write d5/f9 [160912,16141] 0 2024-02-07T12:25:23.701 INFO:tasks.workunit.client.1.smithi138.stdout:8/41: mkdir d1/de 0 2024-02-07T12:25:23.701 INFO:tasks.workunit.client.1.smithi138.stdout:2/41: dwrite f0 [0,4194304] 0 2024-02-07T12:25:23.701 INFO:tasks.workunit.client.1.smithi138.stdout:2/42: fdatasync f1 0 2024-02-07T12:25:23.701 INFO:tasks.workunit.client.1.smithi138.stdout:2/43: chown f1 4586 1 2024-02-07T12:25:23.701 INFO:tasks.workunit.client.1.smithi138.stdout:1/21: dwrite f4 [0,4194304] 0 2024-02-07T12:25:23.701 INFO:tasks.workunit.client.1.smithi138.stdout:5/32: dwrite da/fc [0,4194304] 0 2024-02-07T12:25:23.703 INFO:tasks.workunit.client.1.smithi138.stdout:7/73: symlink d0/d8/d11/l1c 0 2024-02-07T12:25:23.703 INFO:tasks.workunit.client.1.smithi138.stdout:7/74: chown d0/f14 28813 1 2024-02-07T12:25:23.703 INFO:tasks.workunit.client.1.smithi138.stdout:7/75: write d0/d8/d11/f1b [548620,17623] 0 2024-02-07T12:25:23.706 INFO:tasks.workunit.client.1.smithi138.stdout:3/79: rename d5/l12 to d5/l1b 0 2024-02-07T12:25:23.706 INFO:tasks.workunit.client.1.smithi138.stdout:3/80: chown d5/c8 581289 1 2024-02-07T12:25:23.707 INFO:tasks.workunit.client.1.smithi138.stdout:8/42: truncate d1/d6/fb 3330638 0 2024-02-07T12:25:23.708 INFO:tasks.workunit.client.1.smithi138.stdout:0/15: dwrite f3 [0,4194304] 0 2024-02-07T12:25:23.711 INFO:tasks.workunit.client.1.smithi138.stdout:4/13: dwrite f3 [0,4194304] 0 2024-02-07T12:25:23.711 INFO:tasks.workunit.client.1.smithi138.stdout:4/14: chown l0 3658 1 2024-02-07T12:25:23.713 INFO:tasks.workunit.client.1.smithi138.stdout:5/33: dread f8 [0,4194304] 0 2024-02-07T12:25:23.713 INFO:tasks.workunit.client.1.smithi138.stdout:1/22: rmdir d5 39 2024-02-07T12:25:23.713 INFO:tasks.workunit.client.1.smithi138.stdout:1/23: readlink l2 0 2024-02-07T12:25:23.718 INFO:tasks.workunit.client.1.smithi138.stdout:7/76: mkdir d0/d6/d1d 0 2024-02-07T12:25:23.718 INFO:tasks.workunit.client.1.smithi138.stdout:7/77: write d0/d8/d15/ff [520241,54622] 0 2024-02-07T12:25:23.718 INFO:tasks.workunit.client.1.smithi138.stdout:7/78: dread - d0/d6/f16 zero size 2024-02-07T12:25:23.720 INFO:tasks.workunit.client.1.smithi138.stdout:8/43: creat d1/de/ff x:0 0 0 2024-02-07T12:25:23.725 INFO:tasks.workunit.client.1.smithi138.stdout:2/44: rmdir d3/d5 39 2024-02-07T12:25:23.725 INFO:tasks.workunit.client.1.smithi138.stdout:2/45: chown d3/d5/l7 270625198 1 2024-02-07T12:25:23.728 INFO:tasks.workunit.client.1.smithi138.stdout:1/24: creat d5/f7 x:0 0 0 2024-02-07T12:25:23.728 INFO:tasks.workunit.client.1.smithi138.stdout:1/25: read - d5/f7 zero size 2024-02-07T12:25:23.728 INFO:tasks.workunit.client.1.smithi138.stdout:1/26: write f3 [2084501,19889] 0 2024-02-07T12:25:23.732 INFO:tasks.workunit.client.1.smithi138.stdout:8/44: rename d1/l9 to d1/d6/l10 0 2024-02-07T12:25:23.734 INFO:tasks.workunit.client.1.smithi138.stdout:0/16: link f2 d4/f6 0 2024-02-07T12:25:23.734 INFO:tasks.workunit.client.1.smithi138.stdout:0/17: fdatasync f2 0 2024-02-07T12:25:23.734 INFO:tasks.workunit.client.1.smithi138.stdout:2/46: dread d3/d5/fb [0,4194304] 0 2024-02-07T12:25:23.735 INFO:tasks.workunit.client.1.smithi138.stdout:5/34: getdents da 0 2024-02-07T12:25:23.736 INFO:tasks.workunit.client.1.smithi138.stdout:1/27: mkdir d5/d8 0 2024-02-07T12:25:23.737 INFO:tasks.workunit.client.1.smithi138.stdout:1/28: creat d5/f9 x:0 0 0 2024-02-07T12:25:23.739 INFO:tasks.workunit.client.1.smithi138.stdout:2/47: creat d3/d5/ff x:0 0 0 2024-02-07T12:25:23.739 INFO:tasks.workunit.client.1.smithi138.stdout:2/48: chown d3/l6 30 1 2024-02-07T12:25:23.741 INFO:tasks.workunit.client.1.smithi138.stdout:8/45: dread d1/d6/f8 [0,4194304] 0 2024-02-07T12:25:23.743 INFO:tasks.workunit.client.1.smithi138.stdout:2/49: link d3/d5/l7 d3/dd/l10 0 2024-02-07T12:25:23.749 INFO:tasks.workunit.client.1.smithi138.stdout:2/50: mknod d3/d9/c11 0 2024-02-07T12:25:23.750 INFO:tasks.workunit.client.1.smithi138.stdout:2/51: creat d3/f12 x:0 0 0 2024-02-07T12:25:23.750 INFO:tasks.workunit.client.1.smithi138.stdout:3/81: rmdir d5/d15 39 2024-02-07T12:25:23.752 INFO:tasks.workunit.client.1.smithi138.stdout:2/52: mkdir d3/d9/de/d13 0 2024-02-07T12:25:23.754 INFO:tasks.workunit.client.1.smithi138.stdout:3/82: mknod d5/c1c 0 2024-02-07T12:25:23.754 INFO:tasks.workunit.client.1.smithi138.stdout:3/83: readlink d5/lb 0 2024-02-07T12:25:23.755 INFO:tasks.workunit.client.1.smithi138.stdout:2/53: mkdir d3/dd/d14 0 2024-02-07T12:25:23.755 INFO:tasks.workunit.client.1.smithi138.stdout:2/54: write f0 [4578240,108771] 0 2024-02-07T12:25:23.756 INFO:tasks.workunit.client.1.smithi138.stdout:5/35: dwrite da/fb [0,4194304] 0 2024-02-07T12:25:23.757 INFO:tasks.workunit.client.1.smithi138.stdout:8/46: dwrite d1/d6/f8 [0,4194304] 0 2024-02-07T12:25:23.761 INFO:tasks.workunit.client.1.smithi138.stdout:8/47: rename d1/dd to d1/de/d11 0 2024-02-07T12:25:23.761 INFO:tasks.workunit.client.1.smithi138.stdout:8/48: getdents d1/de/d11 0 2024-02-07T12:25:23.761 INFO:tasks.workunit.client.1.smithi138.stdout:8/49: fsync f0 0 2024-02-07T12:25:23.763 INFO:tasks.workunit.client.1.smithi138.stdout:8/50: mknod d1/d6/c12 0 2024-02-07T12:25:23.765 INFO:tasks.workunit.client.1.smithi138.stdout:8/51: creat d1/f13 x:0 0 0 2024-02-07T12:25:23.765 INFO:tasks.workunit.client.1.smithi138.stdout:8/52: chown d1/f13 111 1 2024-02-07T12:25:23.766 INFO:tasks.workunit.client.1.smithi138.stdout:8/53: symlink d1/de/d11/l14 0 2024-02-07T12:25:23.766 INFO:tasks.workunit.client.1.smithi138.stdout:5/36: read da/fb [26831,64977] 0 2024-02-07T12:25:23.767 INFO:tasks.workunit.client.1.smithi138.stdout:8/54: creat d1/f15 x:0 0 0 2024-02-07T12:25:23.768 INFO:tasks.workunit.client.1.smithi138.stdout:5/37: chown c5 3185 1 2024-02-07T12:25:23.768 INFO:tasks.workunit.client.1.smithi138.stdout:5/38: fdatasync f8 0 2024-02-07T12:25:23.768 INFO:tasks.workunit.client.1.smithi138.stdout:3/84: dwrite d5/f11 [0,4194304] 0 2024-02-07T12:25:23.770 INFO:tasks.workunit.client.1.smithi138.stdout:5/39: link f8 da/fd 0 2024-02-07T12:25:23.773 INFO:tasks.workunit.client.1.smithi138.stdout:0/18: getdents d4 0 2024-02-07T12:25:23.773 INFO:tasks.workunit.client.1.smithi138.stdout:0/19: fsync f1 0 2024-02-07T12:25:23.776 INFO:tasks.workunit.client.1.smithi138.stdout:3/85: mknod d5/d15/c1d 0 2024-02-07T12:25:23.776 INFO:tasks.workunit.client.1.smithi138.stdout:3/86: dread - d5/f10 zero size 2024-02-07T12:25:23.776 INFO:tasks.workunit.client.1.smithi138.stdout:3/87: dread - d5/d15/f1a zero size 2024-02-07T12:25:23.776 INFO:tasks.workunit.client.1.smithi138.stdout:2/55: dread f0 [0,4194304] 0 2024-02-07T12:25:23.776 INFO:tasks.workunit.client.1.smithi138.stdout:2/56: creat d3/d5/f15 x:0 0 0 2024-02-07T12:25:23.777 INFO:tasks.workunit.client.1.smithi138.stdout:5/40: truncate da/fd 3147854 0 2024-02-07T12:25:23.777 INFO:tasks.workunit.client.1.smithi138.stdout:5/41: fdatasync f8 0 2024-02-07T12:25:23.779 INFO:tasks.workunit.client.1.smithi138.stdout:3/88: symlink d5/d15/l1e 0 2024-02-07T12:25:23.783 INFO:tasks.workunit.client.1.smithi138.stdout:3/89: write d5/f9 [103514,36844] 0 2024-02-07T12:25:23.784 INFO:tasks.workunit.client.1.smithi138.stdout:3/90: dread - d5/fd zero size 2024-02-07T12:25:23.784 INFO:tasks.workunit.client.1.smithi138.stdout:3/91: write d5/d15/f18 [405269,81782] 0 2024-02-07T12:25:23.784 INFO:tasks.workunit.client.1.smithi138.stdout:2/57: truncate f1 4403007 0 2024-02-07T12:25:23.784 INFO:tasks.workunit.client.1.smithi138.stdout:2/58: chown d3/d5/fb 1678 1 2024-02-07T12:25:23.784 INFO:tasks.workunit.client.1.smithi138.stdout:2/59: chown f1 39931669 1 2024-02-07T12:25:23.784 INFO:tasks.workunit.client.1.smithi138.stdout:3/92: rename d5/lb to d5/d15/l1f 0 2024-02-07T12:25:23.784 INFO:tasks.workunit.client.1.smithi138.stdout:3/93: chown d5/f11 1254552 1 2024-02-07T12:25:23.785 INFO:tasks.workunit.client.1.smithi138.stdout:3/94: chown d5/ff 7 1 2024-02-07T12:25:23.785 INFO:tasks.workunit.client.1.smithi138.stdout:3/95: truncate d5/f10 764200 0 2024-02-07T12:25:23.787 INFO:tasks.workunit.client.1.smithi138.stdout:2/60: mknod d3/d9/de/c16 0 2024-02-07T12:25:23.787 INFO:tasks.workunit.client.1.smithi138.stdout:2/61: creat d3/d5/f17 x:0 0 0 2024-02-07T12:25:23.793 INFO:tasks.workunit.client.1.smithi138.stdout:0/20: dwrite f3 [0,4194304] 0 2024-02-07T12:25:23.793 INFO:tasks.workunit.client.1.smithi138.stdout:8/55: getdents d1 0 2024-02-07T12:25:23.794 INFO:tasks.workunit.client.1.smithi138.stdout:2/62: dread f0 [0,4194304] 0 2024-02-07T12:25:23.794 INFO:tasks.workunit.client.1.smithi138.stdout:2/63: write d3/d5/f17 [892564,107604] 0 2024-02-07T12:25:23.794 INFO:tasks.workunit.client.1.smithi138.stdout:8/56: write d1/de/ff [977012,72972] 0 2024-02-07T12:25:23.794 INFO:tasks.workunit.client.1.smithi138.stdout:2/64: fdatasync d3/d5/f15 0 2024-02-07T12:25:23.795 INFO:tasks.workunit.client.1.smithi138.stdout:3/96: dread d5/d15/f18 [0,4194304] 0 2024-02-07T12:25:23.797 INFO:tasks.workunit.client.1.smithi138.stdout:8/57: mknod d1/de/d11/c16 0 2024-02-07T12:25:23.797 INFO:tasks.workunit.client.1.smithi138.stdout:8/58: chown d1/lc 24200 1 2024-02-07T12:25:23.797 INFO:tasks.workunit.client.1.smithi138.stdout:5/42: dwrite da/fc [4194304,4194304] 0 2024-02-07T12:25:23.798 INFO:tasks.workunit.client.1.smithi138.stdout:2/65: creat d3/dd/f18 x:0 0 0 2024-02-07T12:25:23.798 INFO:tasks.workunit.client.1.smithi138.stdout:2/66: truncate d3/d5/f17 1503413 0 2024-02-07T12:25:23.798 INFO:tasks.workunit.client.1.smithi138.stdout:2/67: dread - d3/d5/ff zero size 2024-02-07T12:25:23.803 INFO:tasks.workunit.client.1.smithi138.stdout:5/43: mknod da/ce 0 2024-02-07T12:25:23.806 INFO:tasks.workunit.client.1.smithi138.stdout:5/44: read f8 [135458,73986] 0 2024-02-07T12:25:23.806 INFO:tasks.workunit.client.1.smithi138.stdout:5/45: stat da/fc 0 2024-02-07T12:25:23.808 INFO:tasks.workunit.client.1.smithi138.stdout:3/97: rename d5/f11 to d5/f20 0 2024-02-07T12:25:23.808 INFO:tasks.workunit.client.1.smithi138.stdout:3/98: read - d5/d15/f16 zero size 2024-02-07T12:25:23.809 INFO:tasks.workunit.client.1.smithi138.stdout:3/99: dread d5/f9 [0,4194304] 0 2024-02-07T12:25:23.809 INFO:tasks.workunit.client.1.smithi138.stdout:3/100: chown d5/d15/f19 47169068 1 2024-02-07T12:25:23.809 INFO:tasks.workunit.client.1.smithi138.stdout:3/101: readlink d5/d15/l1e 0 2024-02-07T12:25:23.810 INFO:tasks.workunit.client.1.smithi138.stdout:5/46: mkdir da/df 0 2024-02-07T12:25:23.810 INFO:tasks.workunit.client.1.smithi138.stdout:8/59: dwrite f0 [0,4194304] 0 2024-02-07T12:25:23.811 INFO:tasks.workunit.client.1.smithi138.stdout:8/60: dread - d1/f13 zero size 2024-02-07T12:25:23.811 INFO:tasks.workunit.client.1.smithi138.stdout:8/61: write d1/f15 [1032245,74706] 0 2024-02-07T12:25:23.811 INFO:tasks.workunit.client.1.smithi138.stdout:8/62: stat d1/f15 0 2024-02-07T12:25:23.812 INFO:tasks.workunit.client.1.smithi138.stdout:3/102: symlink d5/l21 0 2024-02-07T12:25:23.814 INFO:tasks.workunit.client.1.smithi138.stdout:5/47: creat da/df/f10 x:0 0 0 2024-02-07T12:25:23.814 INFO:tasks.workunit.client.1.smithi138.stdout:5/48: creat da/df/f11 x:0 0 0 2024-02-07T12:25:23.814 INFO:tasks.workunit.client.1.smithi138.stdout:5/49: write da/df/f10 [354991,93512] 0 2024-02-07T12:25:23.815 INFO:tasks.workunit.client.1.smithi138.stdout:8/63: mkdir d1/de/d11/d17 0 2024-02-07T12:25:23.817 INFO:tasks.workunit.client.1.smithi138.stdout:3/103: creat d5/d15/f22 x:0 0 0 2024-02-07T12:25:23.817 INFO:tasks.workunit.client.1.smithi138.stdout:3/104: chown d5/f10 200879926 1 2024-02-07T12:25:23.818 INFO:tasks.workunit.client.1.smithi138.stdout:2/68: rename d3/d5 to d3/dd/d19 0 2024-02-07T12:25:23.819 INFO:tasks.workunit.client.1.smithi138.stdout:2/69: rename d3 to d3/d1a 22 2024-02-07T12:25:23.821 INFO:tasks.workunit.client.1.smithi138.stdout:3/105: rmdir d5 39 2024-02-07T12:25:23.821 INFO:tasks.workunit.client.1.smithi138.stdout:3/106: dread - d5/d15/f16 zero size 2024-02-07T12:25:23.823 INFO:tasks.workunit.client.1.smithi138.stdout:2/70: rename d3/dd/d19/fb to d3/d9/f1b 0 2024-02-07T12:25:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:23 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:23 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:23 smithi047 ceph-mon[28972]: pgmap v253: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 486 op/s 2024-02-07T12:25:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:23 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:23 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:23.826 INFO:tasks.workunit.client.1.smithi138.stdout:2/71: mknod d3/d9/de/d13/c1c 0 2024-02-07T12:25:23.828 INFO:tasks.workunit.client.1.smithi138.stdout:2/72: link d3/d9/de/c16 d3/dd/d14/c1d 0 2024-02-07T12:25:23.832 INFO:tasks.workunit.client.1.smithi138.stdout:3/107: getdents d5 0 2024-02-07T12:25:23.833 INFO:tasks.workunit.client.1.smithi138.stdout:5/50: dwrite da/df/f10 [0,4194304] 0 2024-02-07T12:25:23.835 INFO:tasks.workunit.client.1.smithi138.stdout:3/108: creat d5/f23 x:0 0 0 2024-02-07T12:25:23.837 INFO:tasks.workunit.client.1.smithi138.stdout:5/51: mknod da/c12 0 2024-02-07T12:25:23.837 INFO:tasks.workunit.client.1.smithi138.stdout:5/52: write da/fd [4120079,32989] 0 2024-02-07T12:25:23.841 INFO:tasks.workunit.client.1.smithi138.stdout:2/73: dwrite d3/dd/d19/f15 [0,4194304] 0 2024-02-07T12:25:23.842 INFO:tasks.workunit.client.1.smithi138.stdout:8/64: truncate f0 2041122 0 2024-02-07T12:25:23.842 INFO:tasks.workunit.client.1.smithi138.stdout:8/65: stat d1/f15 0 2024-02-07T12:25:23.842 INFO:tasks.workunit.client.1.smithi138.stdout:8/66: write d1/f15 [1282336,79415] 0 2024-02-07T12:25:23.846 INFO:tasks.workunit.client.1.smithi138.stdout:2/74: getdents d3/d9/de/d13 0 2024-02-07T12:25:23.846 INFO:tasks.workunit.client.1.smithi138.stdout:2/75: stat d3/d9/f1b 0 2024-02-07T12:25:23.846 INFO:tasks.workunit.client.1.smithi138.stdout:8/67: dread d1/d6/fb [0,4194304] 0 2024-02-07T12:25:23.847 INFO:tasks.workunit.client.1.smithi138.stdout:3/109: getdents d5 0 2024-02-07T12:25:23.850 INFO:tasks.workunit.client.1.smithi138.stdout:2/76: symlink d3/d9/de/l1e 0 2024-02-07T12:25:23.851 INFO:tasks.workunit.client.1.smithi138.stdout:8/68: creat d1/de/d11/f18 x:0 0 0 2024-02-07T12:25:23.852 INFO:tasks.workunit.client.1.smithi138.stdout:8/69: write d1/f15 [1397493,20875] 0 2024-02-07T12:25:23.853 INFO:tasks.workunit.client.1.smithi138.stdout:3/110: creat d5/f24 x:0 0 0 2024-02-07T12:25:23.855 INFO:tasks.workunit.client.1.smithi138.stdout:2/77: getdents d3/d9 0 2024-02-07T12:25:23.855 INFO:tasks.workunit.client.1.smithi138.stdout:2/78: truncate d3/dd/f18 2944 0 2024-02-07T12:25:23.856 INFO:tasks.workunit.client.1.smithi138.stdout:5/53: truncate da/df/f10 1024054 0 2024-02-07T12:25:23.856 INFO:tasks.workunit.client.1.smithi138.stdout:3/111: stat d5/d15/f18 0 2024-02-07T12:25:23.856 INFO:tasks.workunit.client.1.smithi138.stdout:3/112: write d5/d15/f1a [605259,2431] 0 2024-02-07T12:25:23.859 INFO:tasks.workunit.client.1.smithi138.stdout:2/79: rename d3/d9/de/d13 to d3/dd/d19/d1f 0 2024-02-07T12:25:23.859 INFO:tasks.workunit.client.1.smithi138.stdout:2/80: fdatasync f1 0 2024-02-07T12:25:23.861 INFO:tasks.workunit.client.1.smithi138.stdout:5/54: link da/fb da/df/f13 0 2024-02-07T12:25:23.865 INFO:tasks.workunit.client.1.smithi138.stdout:2/81: mknod d3/dd/d19/c20 0 2024-02-07T12:25:23.865 INFO:tasks.workunit.client.1.smithi138.stdout:5/55: mknod da/df/c14 0 2024-02-07T12:25:23.869 INFO:tasks.workunit.client.1.smithi138.stdout:2/82: getdents d3 0 2024-02-07T12:25:23.870 INFO:tasks.workunit.client.1.smithi138.stdout:3/113: write d5/f20 [50744,40596] 0 2024-02-07T12:25:23.870 INFO:tasks.workunit.client.1.smithi138.stdout:8/70: truncate d1/de/ff 221395 0 2024-02-07T12:25:23.872 INFO:tasks.workunit.client.1.smithi138.stdout:3/114: dread f3 [0,4194304] 0 2024-02-07T12:25:23.873 INFO:tasks.workunit.client.1.smithi138.stdout:2/83: link d3/l6 d3/dd/d19/l21 0 2024-02-07T12:25:23.877 INFO:tasks.workunit.client.1.smithi138.stdout:8/71: creat d1/d6/f19 x:0 0 0 2024-02-07T12:25:23.877 INFO:tasks.workunit.client.1.smithi138.stdout:8/72: write d1/f15 [2310461,102145] 0 2024-02-07T12:25:23.877 INFO:tasks.workunit.client.1.smithi138.stdout:8/73: read d1/f4 [64427,123313] 0 2024-02-07T12:25:23.880 INFO:tasks.workunit.client.1.smithi138.stdout:2/84: write d3/dd/d19/f15 [308215,2499] 0 2024-02-07T12:25:23.881 INFO:tasks.workunit.client.1.smithi138.stdout:8/74: creat d1/de/d11/f1a x:0 0 0 2024-02-07T12:25:23.881 INFO:tasks.workunit.client.1.smithi138.stdout:8/75: read - d1/d6/f19 zero size 2024-02-07T12:25:23.881 INFO:tasks.workunit.client.1.smithi138.stdout:8/76: rename d1 to d1/d6/d1b 22 2024-02-07T12:25:23.881 INFO:tasks.workunit.client.1.smithi138.stdout:8/77: write d1/d6/f19 [698845,4989] 0 2024-02-07T12:25:23.883 INFO:tasks.workunit.client.1.smithi138.stdout:2/85: creat d3/dd/d14/f22 x:0 0 0 2024-02-07T12:25:23.883 INFO:tasks.workunit.client.1.smithi138.stdout:2/86: chown d3/dd/d14/c1d 3189401 1 2024-02-07T12:25:23.885 INFO:tasks.workunit.client.1.smithi138.stdout:8/78: symlink d1/de/l1c 0 2024-02-07T12:25:23.887 INFO:tasks.workunit.client.1.smithi138.stdout:3/115: link d5/fd d5/f25 0 2024-02-07T12:25:23.888 INFO:tasks.workunit.client.1.smithi138.stdout:2/87: mknod d3/dd/d19/d1f/c23 0 2024-02-07T12:25:23.888 INFO:tasks.workunit.client.1.smithi138.stdout:2/88: write d3/dd/d19/ff [431461,111338] 0 2024-02-07T12:25:23.890 INFO:tasks.workunit.client.1.smithi138.stdout:2/89: symlink d3/d9/l24 0 2024-02-07T12:25:23.892 INFO:tasks.workunit.client.1.smithi138.stdout:3/116: mkdir d5/d26 0 2024-02-07T12:25:23.894 INFO:tasks.workunit.client.1.smithi138.stdout:2/90: rename d3/d9/de to d3/d9/d25 0 2024-02-07T12:25:23.894 INFO:tasks.workunit.client.1.smithi138.stdout:2/91: write d3/f12 [77087,30035] 0 2024-02-07T12:25:23.899 INFO:tasks.workunit.client.1.smithi138.stdout:8/79: dwrite d1/d6/f8 [0,4194304] 0 2024-02-07T12:25:23.900 INFO:tasks.workunit.client.1.smithi138.stdout:8/80: read d1/d6/f19 [583525,98989] 0 2024-02-07T12:25:23.903 INFO:tasks.workunit.client.1.smithi138.stdout:8/81: link f0 d1/de/d11/f1d 0 2024-02-07T12:25:23.907 INFO:tasks.workunit.client.1.smithi138.stdout:8/82: dread d1/f15 [0,4194304] 0 2024-02-07T12:25:23.907 INFO:tasks.workunit.client.1.smithi138.stdout:8/83: write d1/de/d11/f1d [5164388,83677] 0 2024-02-07T12:25:23.908 INFO:tasks.workunit.client.1.smithi138.stdout:8/84: dread d1/d6/f19 [0,4194304] 0 2024-02-07T12:25:23.908 INFO:tasks.workunit.client.1.smithi138.stdout:8/85: chown d1/d6/f8 213 1 2024-02-07T12:25:23.909 INFO:tasks.workunit.client.1.smithi138.stdout:3/117: dwrite d5/d15/f19 [0,4194304] 0 2024-02-07T12:25:23.910 INFO:tasks.workunit.client.1.smithi138.stdout:8/86: unlink d1/l7 0 2024-02-07T12:25:23.914 INFO:tasks.workunit.client.1.smithi138.stdout:3/118: unlink d5/d15/f22 0 2024-02-07T12:25:23.916 INFO:tasks.workunit.client.1.smithi138.stdout:8/87: creat d1/de/d11/f1e x:0 0 0 2024-02-07T12:25:23.918 INFO:tasks.workunit.client.1.smithi138.stdout:8/88: creat d1/de/d11/d17/f1f x:0 0 0 2024-02-07T12:25:23.920 INFO:tasks.workunit.client.1.smithi138.stdout:8/89: rmdir d1/d6 39 2024-02-07T12:25:23.920 INFO:tasks.workunit.client.1.smithi138.stdout:8/90: creat d1/de/d11/d17/f20 x:0 0 0 2024-02-07T12:25:23.920 INFO:tasks.workunit.client.1.smithi138.stdout:8/91: dread - d1/de/d11/f1e zero size 2024-02-07T12:25:23.920 INFO:tasks.workunit.client.1.smithi138.stdout:8/92: creat d1/de/d11/d17/f21 x:0 0 0 2024-02-07T12:25:23.920 INFO:tasks.workunit.client.1.smithi138.stdout:3/119: dread d5/d15/f19 [0,4194304] 0 2024-02-07T12:25:23.924 INFO:tasks.workunit.client.1.smithi138.stdout:8/93: link d1/de/ff d1/f22 0 2024-02-07T12:25:23.925 INFO:tasks.workunit.client.1.smithi138.stdout:8/94: creat d1/f23 x:0 0 0 2024-02-07T12:25:23.925 INFO:tasks.workunit.client.1.smithi138.stdout:8/95: chown d1/de/l1c 3 1 2024-02-07T12:25:23.934 INFO:tasks.workunit.client.1.smithi138.stdout:3/120: dwrite d5/f20 [0,4194304] 0 2024-02-07T12:25:23.935 INFO:tasks.workunit.client.1.smithi138.stdout:8/96: fsync d1/de/d11/d17/f20 0 2024-02-07T12:25:23.940 INFO:tasks.workunit.client.1.smithi138.stdout:8/97: dread d1/f15 [0,4194304] 0 2024-02-07T12:25:23.940 INFO:tasks.workunit.client.1.smithi138.stdout:8/98: creat d1/de/d11/d17/f24 x:0 0 0 2024-02-07T12:25:23.940 INFO:tasks.workunit.client.1.smithi138.stdout:8/99: creat d1/de/d11/d17/f25 x:0 0 0 2024-02-07T12:25:23.944 INFO:tasks.workunit.client.1.smithi138.stdout:8/100: fdatasync d1/d6/f19 0 2024-02-07T12:25:23.944 INFO:tasks.workunit.client.1.smithi138.stdout:8/101: fdatasync d1/de/d11/f1e 0 2024-02-07T12:25:23.944 INFO:tasks.workunit.client.1.smithi138.stdout:8/102: creat d1/f26 x:0 0 0 2024-02-07T12:25:23.944 INFO:tasks.workunit.client.1.smithi138.stdout:8/103: fsync d1/f22 0 2024-02-07T12:25:23.944 INFO:tasks.workunit.client.1.smithi138.stdout:8/104: fdatasync d1/f15 0 2024-02-07T12:25:23.947 INFO:tasks.workunit.client.1.smithi138.stdout:8/105: link d1/de/d11/f18 d1/de/d11/f27 0 2024-02-07T12:25:23.949 INFO:tasks.workunit.client.1.smithi138.stdout:8/106: unlink d1/de/d11/d17/f1f 0 2024-02-07T12:25:23.957 INFO:tasks.workunit.client.1.smithi138.stdout:3/121: dwrite d5/f9 [0,4194304] 0 2024-02-07T12:25:23.968 INFO:tasks.workunit.client.1.smithi138.stdout:3/122: dread f1 [0,4194304] 0 2024-02-07T12:25:23.969 INFO:tasks.workunit.client.1.smithi138.stdout:9/44: sync 2024-02-07T12:25:23.970 INFO:tasks.workunit.client.1.smithi138.stdout:9/45: readlink - no filename 2024-02-07T12:25:23.971 INFO:tasks.workunit.client.1.smithi138.stdout:8/107: dwrite d1/d6/f8 [0,4194304] 0 2024-02-07T12:25:23.972 INFO:tasks.workunit.client.1.smithi138.stdout:9/46: rename d0/f1 to d0/d5/fc 0 2024-02-07T12:25:23.973 INFO:tasks.workunit.client.1.smithi138.stdout:8/108: creat d1/d6/f28 x:0 0 0 2024-02-07T12:25:23.973 INFO:tasks.workunit.client.1.smithi138.stdout:8/109: truncate d1/f22 541151 0 2024-02-07T12:25:23.973 INFO:tasks.workunit.client.1.smithi138.stdout:8/110: chown d1/f15 2610950 1 2024-02-07T12:25:23.975 INFO:tasks.workunit.client.1.smithi138.stdout:8/111: getdents d1/de/d11/d17 0 2024-02-07T12:25:23.975 INFO:tasks.workunit.client.1.smithi138.stdout:8/112: dread - d1/d6/f28 zero size 2024-02-07T12:25:23.975 INFO:tasks.workunit.client.1.smithi138.stdout:8/113: stat d1/de/d11/d17/f20 0 2024-02-07T12:25:23.976 INFO:tasks.workunit.client.1.smithi138.stdout:8/114: chown d1/f26 0 1 2024-02-07T12:25:23.976 INFO:tasks.workunit.client.1.smithi138.stdout:8/115: fdatasync d1/f23 0 2024-02-07T12:25:23.976 INFO:tasks.workunit.client.1.smithi138.stdout:8/116: chown d1/de/d11/d17/f21 1252876 1 2024-02-07T12:25:23.976 INFO:tasks.workunit.client.1.smithi138.stdout:8/117: readlink d1/de/l1c 0 2024-02-07T12:25:23.977 INFO:tasks.workunit.client.1.smithi138.stdout:8/118: getdents d1/de 0 2024-02-07T12:25:23.986 INFO:tasks.workunit.client.1.smithi138.stdout:3/123: dwrite d5/fd [0,4194304] 0 2024-02-07T12:25:23.987 INFO:tasks.workunit.client.1.smithi138.stdout:9/47: dwrite d0/f4 [0,4194304] 0 2024-02-07T12:25:23.992 INFO:tasks.workunit.client.1.smithi138.stdout:9/48: mkdir d0/d5/dd 0 2024-02-07T12:25:23.993 INFO:tasks.workunit.client.1.smithi138.stdout:9/49: chown d0/d5/dd 245497 1 2024-02-07T12:25:23.993 INFO:tasks.workunit.client.1.smithi138.stdout:9/50: write d0/d6/fb [996658,42219] 0 2024-02-07T12:25:23.993 INFO:tasks.workunit.client.1.smithi138.stdout:3/124: mkdir d5/d27 0 2024-02-07T12:25:23.993 INFO:tasks.workunit.client.1.smithi138.stdout:3/125: dread - d5/f24 zero size 2024-02-07T12:25:23.993 INFO:tasks.workunit.client.1.smithi138.stdout:3/126: chown d5/d15/f18 657838120 1 2024-02-07T12:25:23.995 INFO:tasks.workunit.client.1.smithi138.stdout:8/119: dwrite d1/de/d11/d17/f24 [0,4194304] 0 2024-02-07T12:25:23.995 INFO:tasks.workunit.client.1.smithi138.stdout:9/51: symlink d0/d5/le 0 2024-02-07T12:25:23.995 INFO:tasks.workunit.client.1.smithi138.stdout:9/52: creat d0/ff x:0 0 0 2024-02-07T12:25:23.995 INFO:tasks.workunit.client.1.smithi138.stdout:9/53: dread - d0/ff zero size 2024-02-07T12:25:23.997 INFO:tasks.workunit.client.1.smithi138.stdout:8/120: creat d1/d6/f29 x:0 0 0 2024-02-07T12:25:23.999 INFO:tasks.workunit.client.1.smithi138.stdout:8/121: stat d1/lc 0 2024-02-07T12:25:23.999 INFO:tasks.workunit.client.1.smithi138.stdout:8/122: dread - d1/d6/f29 zero size 2024-02-07T12:25:24.007 INFO:tasks.workunit.client.1.smithi138.stdout:3/127: dwrite d5/fd [0,4194304] 0 2024-02-07T12:25:24.009 INFO:tasks.workunit.client.1.smithi138.stdout:3/128: getdents d5 0 2024-02-07T12:25:24.010 INFO:tasks.workunit.client.1.smithi138.stdout:3/129: mkdir d5/d26/d28 0 2024-02-07T12:25:24.010 INFO:tasks.workunit.client.1.smithi138.stdout:3/130: write d5/f10 [1046964,49895] 0 2024-02-07T12:25:24.012 INFO:tasks.workunit.client.1.smithi138.stdout:9/54: dwrite d0/d6/fb [0,4194304] 0 2024-02-07T12:25:24.012 INFO:tasks.workunit.client.1.smithi138.stdout:9/55: fsync d0/fa 0 2024-02-07T12:25:24.015 INFO:tasks.workunit.client.1.smithi138.stdout:9/56: getdents d0 0 2024-02-07T12:25:24.015 INFO:tasks.workunit.client.1.smithi138.stdout:3/131: write f1 [2801194,52938] 0 2024-02-07T12:25:24.018 INFO:tasks.workunit.client.1.smithi138.stdout:3/132: rename d5/f25 to d5/d27/f29 0 2024-02-07T12:25:24.019 INFO:tasks.workunit.client.1.smithi138.stdout:3/133: rmdir d5/d27 39 2024-02-07T12:25:24.020 INFO:tasks.workunit.client.1.smithi138.stdout:3/134: rmdir d5 39 2024-02-07T12:25:24.020 INFO:tasks.workunit.client.1.smithi138.stdout:3/135: fdatasync d5/f23 0 2024-02-07T12:25:24.021 INFO:tasks.workunit.client.1.smithi138.stdout:3/136: write d5/f23 [587208,69692] 0 2024-02-07T12:25:24.021 INFO:tasks.workunit.client.1.smithi138.stdout:9/57: write d0/f4 [1351635,6453] 0 2024-02-07T12:25:24.021 INFO:tasks.workunit.client.1.smithi138.stdout:3/137: mknod d5/d27/c2a 0 2024-02-07T12:25:24.023 INFO:tasks.workunit.client.1.smithi138.stdout:3/138: creat d5/d26/d28/f2b x:0 0 0 2024-02-07T12:25:24.026 INFO:tasks.workunit.client.1.smithi138.stdout:3/139: dread f3 [0,4194304] 0 2024-02-07T12:25:24.028 INFO:tasks.workunit.client.1.smithi138.stdout:3/140: rename d5/d15/f1a to d5/d26/f2c 0 2024-02-07T12:25:24.030 INFO:tasks.workunit.client.1.smithi138.stdout:3/141: mknod d5/c2d 0 2024-02-07T12:25:24.032 INFO:tasks.workunit.client.1.smithi138.stdout:9/58: dwrite d0/d5/fc [0,4194304] 0 2024-02-07T12:25:24.032 INFO:tasks.workunit.client.1.smithi138.stdout:3/142: creat d5/d26/f2e x:0 0 0 2024-02-07T12:25:24.032 INFO:tasks.workunit.client.1.smithi138.stdout:3/143: truncate d5/d26/d28/f2b 1042876 0 2024-02-07T12:25:24.033 INFO:tasks.workunit.client.1.smithi138.stdout:3/144: dread d5/d15/f18 [0,4194304] 0 2024-02-07T12:25:24.034 INFO:tasks.workunit.client.1.smithi138.stdout:3/145: write d5/d15/f18 [210858,47234] 0 2024-02-07T12:25:24.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:23 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:24.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:23 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:24.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:23 smithi138 ceph-mon[35528]: pgmap v253: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 486 op/s 2024-02-07T12:25:24.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:23 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:24.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:23 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:24.039 INFO:tasks.workunit.client.1.smithi138.stdout:3/146: link d5/d26/f2c d5/f2f 0 2024-02-07T12:25:24.040 INFO:tasks.workunit.client.1.smithi138.stdout:9/59: read d0/d5/fc [2851399,91034] 0 2024-02-07T12:25:24.042 INFO:tasks.workunit.client.1.smithi138.stdout:9/60: mknod d0/d6/c10 0 2024-02-07T12:25:24.042 INFO:tasks.workunit.client.1.smithi138.stdout:9/61: chown d0/d5/dd 13 1 2024-02-07T12:25:24.042 INFO:tasks.workunit.client.1.smithi138.stdout:3/147: dread d5/d15/f19 [0,4194304] 0 2024-02-07T12:25:24.044 INFO:tasks.workunit.client.1.smithi138.stdout:3/148: unlink d5/d15/f19 0 2024-02-07T12:25:24.045 INFO:tasks.workunit.client.1.smithi138.stdout:9/62: dread d0/f9 [0,4194304] 0 2024-02-07T12:25:24.045 INFO:tasks.workunit.client.1.smithi138.stdout:9/63: truncate d0/ff 126334 0 2024-02-07T12:25:24.064 INFO:tasks.workunit.client.1.smithi138.stdout:3/149: dwrite d5/d26/d28/f2b [0,4194304] 0 2024-02-07T12:25:24.065 INFO:tasks.workunit.client.1.smithi138.stdout:3/150: fdatasync d5/f20 0 2024-02-07T12:25:24.065 INFO:tasks.workunit.client.1.smithi138.stdout:3/151: chown d5/d15 12566464 1 2024-02-07T12:25:24.065 INFO:tasks.workunit.client.1.smithi138.stdout:9/64: dwrite d0/f4 [0,4194304] 0 2024-02-07T12:25:24.066 INFO:tasks.workunit.client.1.smithi138.stdout:3/152: symlink d5/d15/l30 0 2024-02-07T12:25:24.081 INFO:tasks.workunit.client.1.smithi138.stdout:9/65: truncate d0/f9 951688 0 2024-02-07T12:25:24.084 INFO:tasks.workunit.client.1.smithi138.stdout:9/66: write d0/d5/fc [760840,124363] 0 2024-02-07T12:25:24.084 INFO:tasks.workunit.client.1.smithi138.stdout:9/67: write d0/f2 [1399349,10940] 0 2024-02-07T12:25:24.086 INFO:tasks.workunit.client.1.smithi138.stdout:9/68: getdents d0/d6 0 2024-02-07T12:25:24.087 INFO:tasks.workunit.client.1.smithi138.stdout:9/69: stat d0 0 2024-02-07T12:25:24.098 INFO:tasks.workunit.client.1.smithi138.stdout:3/153: dwrite d5/f9 [0,4194304] 0 2024-02-07T12:25:24.100 INFO:tasks.workunit.client.1.smithi138.stdout:3/154: symlink d5/d15/l31 0 2024-02-07T12:25:24.100 INFO:tasks.workunit.client.1.smithi138.stdout:9/70: write d0/f4 [2563253,12465] 0 2024-02-07T12:25:24.101 INFO:tasks.workunit.client.1.smithi138.stdout:3/155: mkdir d5/d15/d32 0 2024-02-07T12:25:24.101 INFO:tasks.workunit.client.1.smithi138.stdout:9/71: mknod d0/d6/d8/c11 0 2024-02-07T12:25:24.103 INFO:tasks.workunit.client.1.smithi138.stdout:9/72: link d0/ff d0/d6/f12 0 2024-02-07T12:25:24.103 INFO:tasks.workunit.client.1.smithi138.stdout:3/156: symlink d5/l33 0 2024-02-07T12:25:24.104 INFO:tasks.workunit.client.1.smithi138.stdout:9/73: symlink d0/d5/l13 0 2024-02-07T12:25:24.106 INFO:tasks.workunit.client.1.smithi138.stdout:9/74: rename d0/f9 to d0/d5/dd/f14 0 2024-02-07T12:25:24.106 INFO:tasks.workunit.client.1.smithi138.stdout:9/75: write d0/d5/fc [1083722,27694] 0 2024-02-07T12:25:24.106 INFO:tasks.workunit.client.1.smithi138.stdout:9/76: chown d0/d5/l13 1192555318 1 2024-02-07T12:25:24.106 INFO:tasks.workunit.client.1.smithi138.stdout:9/77: creat d0/d6/f15 x:0 0 0 2024-02-07T12:25:24.108 INFO:tasks.workunit.client.1.smithi138.stdout:9/78: mknod d0/d6/d8/c16 0 2024-02-07T12:25:24.109 INFO:tasks.workunit.client.1.smithi138.stdout:9/79: link d0/d6/d8/c16 d0/d6/c17 0 2024-02-07T12:25:24.111 INFO:tasks.workunit.client.1.smithi138.stdout:9/80: creat d0/d5/dd/f18 x:0 0 0 2024-02-07T12:25:24.118 INFO:tasks.workunit.client.1.smithi138.stdout:3/157: dwrite d5/f24 [0,4194304] 0 2024-02-07T12:25:24.119 INFO:tasks.workunit.client.1.smithi138.stdout:9/81: rmdir d0/d6 39 2024-02-07T12:25:24.119 INFO:tasks.workunit.client.1.smithi138.stdout:9/82: readlink d0/d5/le 0 2024-02-07T12:25:24.122 INFO:tasks.workunit.client.1.smithi138.stdout:9/83: mkdir d0/d6/d8/d19 0 2024-02-07T12:25:24.122 INFO:tasks.workunit.client.1.smithi138.stdout:9/84: fdatasync d0/ff 0 2024-02-07T12:25:24.122 INFO:tasks.workunit.client.1.smithi138.stdout:3/158: mkdir d5/d34 0 2024-02-07T12:25:24.123 INFO:tasks.workunit.client.1.smithi138.stdout:9/85: rename d0/f4 to d0/d6/d8/d19/f1a 0 2024-02-07T12:25:24.124 INFO:tasks.workunit.client.1.smithi138.stdout:3/159: mkdir d5/d27/d35 0 2024-02-07T12:25:24.126 INFO:tasks.workunit.client.1.smithi138.stdout:3/160: dread f3 [0,4194304] 0 2024-02-07T12:25:24.129 INFO:tasks.workunit.client.1.smithi138.stdout:4/15: sync 2024-02-07T12:25:24.129 INFO:tasks.workunit.client.1.smithi138.stdout:6/48: sync 2024-02-07T12:25:24.129 INFO:tasks.workunit.client.1.smithi138.stdout:9/86: dread d0/d5/dd/f14 [0,4194304] 0 2024-02-07T12:25:24.129 INFO:tasks.workunit.client.1.smithi138.stdout:6/49: write fb [324372,5805] 0 2024-02-07T12:25:24.130 INFO:tasks.workunit.client.1.smithi138.stdout:4/16: symlink l4 0 2024-02-07T12:25:24.134 INFO:tasks.workunit.client.1.smithi138.stdout:6/50: dread fb [0,4194304] 0 2024-02-07T12:25:24.136 INFO:tasks.workunit.client.1.smithi138.stdout:6/51: unlink dc/ff 0 2024-02-07T12:25:24.136 INFO:tasks.workunit.client.1.smithi138.stdout:6/52: write f9 [4950441,25793] 0 2024-02-07T12:25:24.137 INFO:tasks.workunit.client.1.smithi138.stdout:6/53: dread f8 [0,4194304] 0 2024-02-07T12:25:24.138 INFO:tasks.workunit.client.1.smithi138.stdout:6/54: truncate f1 492939 0 2024-02-07T12:25:24.138 INFO:tasks.workunit.client.1.smithi138.stdout:6/55: fdatasync f6 0 2024-02-07T12:25:24.139 INFO:tasks.workunit.client.1.smithi138.stdout:9/87: getdents d0/d6/d8/d19 0 2024-02-07T12:25:24.141 INFO:tasks.workunit.client.1.smithi138.stdout:4/17: read f3 [1216403,59128] 0 2024-02-07T12:25:24.141 INFO:tasks.workunit.client.1.smithi138.stdout:4/18: chown l4 92 1 2024-02-07T12:25:24.141 INFO:tasks.workunit.client.1.smithi138.stdout:4/19: write f3 [4701155,115393] 0 2024-02-07T12:25:24.141 INFO:tasks.workunit.client.1.smithi138.stdout:4/20: write f3 [3467547,50385] 0 2024-02-07T12:25:24.141 INFO:tasks.workunit.client.1.smithi138.stdout:6/56: rename f9 to dc/f10 0 2024-02-07T12:25:24.144 INFO:tasks.workunit.client.1.smithi138.stdout:9/88: unlink d0/fa 0 2024-02-07T12:25:24.144 INFO:tasks.workunit.client.1.smithi138.stdout:3/161: dwrite d5/d15/f18 [0,4194304] 0 2024-02-07T12:25:24.152 INFO:tasks.workunit.client.1.smithi138.stdout:9/89: read d0/d6/fb [1967514,104026] 0 2024-02-07T12:25:24.153 INFO:tasks.workunit.client.1.smithi138.stdout:9/90: write d0/f2 [1749315,124222] 0 2024-02-07T12:25:24.157 INFO:tasks.workunit.client.1.smithi138.stdout:9/91: rename d0/d5/dd/f14 to d0/d6/d8/d19/f1b 0 2024-02-07T12:25:24.171 INFO:tasks.workunit.client.1.smithi138.stdout:3/162: dwrite f1 [0,4194304] 0 2024-02-07T12:25:24.171 INFO:tasks.workunit.client.1.smithi138.stdout:4/21: dwrite f3 [0,4194304] 0 2024-02-07T12:25:24.171 INFO:tasks.workunit.client.1.smithi138.stdout:3/163: creat d5/d15/f36 x:0 0 0 2024-02-07T12:25:24.173 INFO:tasks.workunit.client.1.smithi138.stdout:4/22: link l4 l5 0 2024-02-07T12:25:24.174 INFO:tasks.workunit.client.1.smithi138.stdout:3/164: mknod d5/d15/d32/c37 0 2024-02-07T12:25:24.176 INFO:tasks.workunit.client.1.smithi138.stdout:4/23: rename c2 to c6 0 2024-02-07T12:25:24.187 INFO:tasks.workunit.client.1.smithi138.stdout:4/24: dread f3 [4194304,4194304] 0 2024-02-07T12:25:24.188 INFO:tasks.workunit.client.1.smithi138.stdout:4/25: creat f7 x:0 0 0 2024-02-07T12:25:24.188 INFO:tasks.workunit.client.1.smithi138.stdout:4/26: creat f8 x:0 0 0 2024-02-07T12:25:24.188 INFO:tasks.workunit.client.1.smithi138.stdout:4/27: truncate f7 1003052 0 2024-02-07T12:25:24.188 INFO:tasks.workunit.client.1.smithi138.stdout:6/57: dwrite f1 [0,4194304] 0 2024-02-07T12:25:24.189 INFO:tasks.workunit.client.1.smithi138.stdout:9/92: dwrite d0/d5/dd/f18 [0,4194304] 0 2024-02-07T12:25:24.192 INFO:tasks.workunit.client.1.smithi138.stdout:6/58: mknod dc/c11 0 2024-02-07T12:25:24.192 INFO:tasks.workunit.client.1.smithi138.stdout:6/59: rename dc to dc/d12 22 2024-02-07T12:25:24.194 INFO:tasks.workunit.client.1.smithi138.stdout:9/93: unlink d0/ff 0 2024-02-07T12:25:24.195 INFO:tasks.workunit.client.1.smithi138.stdout:6/60: mkdir dc/d13 0 2024-02-07T12:25:24.197 INFO:tasks.workunit.client.1.smithi138.stdout:6/61: creat dc/d13/f14 x:0 0 0 2024-02-07T12:25:24.197 INFO:tasks.workunit.client.1.smithi138.stdout:6/62: chown dc/d13/f14 447 1 2024-02-07T12:25:24.198 INFO:tasks.workunit.client.1.smithi138.stdout:6/63: dread f8 [0,4194304] 0 2024-02-07T12:25:24.198 INFO:tasks.workunit.client.1.smithi138.stdout:6/64: chown c4 710 1 2024-02-07T12:25:24.199 INFO:tasks.workunit.client.1.smithi138.stdout:6/65: mknod dc/c15 0 2024-02-07T12:25:24.199 INFO:tasks.workunit.client.1.smithi138.stdout:9/94: dread d0/d6/d8/d19/f1a [0,4194304] 0 2024-02-07T12:25:24.200 INFO:tasks.workunit.client.1.smithi138.stdout:9/95: creat d0/d5/f1c x:0 0 0 2024-02-07T12:25:24.205 INFO:tasks.workunit.client.1.smithi138.stdout:3/165: dwrite d5/ff [0,4194304] 0 2024-02-07T12:25:24.209 INFO:tasks.workunit.client.1.smithi138.stdout:4/28: dwrite f8 [0,4194304] 0 2024-02-07T12:25:24.210 INFO:tasks.workunit.client.1.smithi138.stdout:4/29: dread f7 [0,4194304] 0 2024-02-07T12:25:24.213 INFO:tasks.workunit.client.1.smithi138.stdout:4/30: mknod c9 0 2024-02-07T12:25:24.213 INFO:tasks.workunit.client.1.smithi138.stdout:4/31: rmdir - no directory 2024-02-07T12:25:24.213 INFO:tasks.workunit.client.1.smithi138.stdout:4/32: creat fa x:0 0 0 2024-02-07T12:25:24.213 INFO:tasks.workunit.client.1.smithi138.stdout:4/33: truncate f3 5810971 0 2024-02-07T12:25:24.213 INFO:tasks.workunit.client.1.smithi138.stdout:4/34: creat fb x:0 0 0 2024-02-07T12:25:24.213 INFO:tasks.workunit.client.1.smithi138.stdout:4/35: chown fa 114010263 1 2024-02-07T12:25:24.214 INFO:tasks.workunit.client.1.smithi138.stdout:3/166: dread d5/d27/f29 [0,4194304] 0 2024-02-07T12:25:24.214 INFO:tasks.workunit.client.1.smithi138.stdout:6/66: dwrite f6 [0,4194304] 0 2024-02-07T12:25:24.216 INFO:tasks.workunit.client.1.smithi138.stdout:4/36: link l0 lc 0 2024-02-07T12:25:24.216 INFO:tasks.workunit.client.1.smithi138.stdout:4/37: truncate f7 1944183 0 2024-02-07T12:25:24.217 INFO:tasks.workunit.client.1.smithi138.stdout:3/167: symlink d5/d27/d35/l38 0 2024-02-07T12:25:24.230 INFO:tasks.workunit.client.1.smithi138.stdout:4/38: rename fa to fd 0 2024-02-07T12:25:24.230 INFO:tasks.workunit.client.1.smithi138.stdout:3/168: dwrite d5/fd [0,4194304] 0 2024-02-07T12:25:24.230 INFO:tasks.workunit.client.1.smithi138.stdout:3/169: readlink d5/l1b 0 2024-02-07T12:25:24.230 INFO:tasks.workunit.client.1.smithi138.stdout:3/170: creat d5/d26/d28/f39 x:0 0 0 2024-02-07T12:25:24.236 INFO:tasks.workunit.client.1.smithi138.stdout:9/96: rename d0/d5 to d0/d6/d8/d1d 0 2024-02-07T12:25:24.238 INFO:tasks.workunit.client.1.smithi138.stdout:4/39: mknod ce 0 2024-02-07T12:25:24.240 INFO:tasks.workunit.client.1.smithi138.stdout:3/171: creat d5/f3a x:0 0 0 2024-02-07T12:25:24.244 INFO:tasks.workunit.client.1.smithi138.stdout:9/97: chown d0/d6/f12 51979551 1 2024-02-07T12:25:24.244 INFO:tasks.workunit.client.1.smithi138.stdout:9/98: write d0/f2 [1840065,120781] 0 2024-02-07T12:25:24.245 INFO:tasks.workunit.client.1.smithi138.stdout:7/79: sync 2024-02-07T12:25:24.246 INFO:tasks.workunit.client.1.smithi138.stdout:0/21: sync 2024-02-07T12:25:24.246 INFO:tasks.workunit.client.1.smithi138.stdout:2/92: sync 2024-02-07T12:25:24.246 INFO:tasks.workunit.client.1.smithi138.stdout:1/29: sync 2024-02-07T12:25:24.246 INFO:tasks.workunit.client.1.smithi138.stdout:8/123: sync 2024-02-07T12:25:24.246 INFO:tasks.workunit.client.1.smithi138.stdout:5/56: sync 2024-02-07T12:25:24.246 INFO:tasks.workunit.client.1.smithi138.stdout:0/22: readlink - no filename 2024-02-07T12:25:24.246 INFO:tasks.workunit.client.1.smithi138.stdout:2/93: chown d3/dd/d19/l8 46129139 1 2024-02-07T12:25:24.246 INFO:tasks.workunit.client.1.smithi138.stdout:8/124: truncate d1/d6/f29 371410 0 2024-02-07T12:25:24.246 INFO:tasks.workunit.client.1.smithi138.stdout:2/94: chown f0 228470733 1 2024-02-07T12:25:24.246 INFO:tasks.workunit.client.1.smithi138.stdout:0/23: write d4/f5 [716411,8951] 0 2024-02-07T12:25:24.246 INFO:tasks.workunit.client.1.smithi138.stdout:8/125: fdatasync d1/de/d11/f1e 0 2024-02-07T12:25:24.246 INFO:tasks.workunit.client.1.smithi138.stdout:8/126: truncate d1/f22 730314 0 2024-02-07T12:25:24.246 INFO:tasks.workunit.client.1.smithi138.stdout:7/80: write d0/d6/f16 [389218,130503] 0 2024-02-07T12:25:24.247 INFO:tasks.workunit.client.1.smithi138.stdout:2/95: write d3/dd/d19/f17 [566126,10206] 0 2024-02-07T12:25:24.247 INFO:tasks.workunit.client.1.smithi138.stdout:2/96: write d3/dd/f18 [217869,90422] 0 2024-02-07T12:25:24.247 INFO:tasks.workunit.client.1.smithi138.stdout:2/97: write d3/dd/d19/f17 [1498079,81295] 0 2024-02-07T12:25:24.247 INFO:tasks.workunit.client.1.smithi138.stdout:9/99: creat d0/d6/f1e x:0 0 0 2024-02-07T12:25:24.249 INFO:tasks.workunit.client.1.smithi138.stdout:5/57: link da/df/f10 da/f15 0 2024-02-07T12:25:24.250 INFO:tasks.workunit.client.1.smithi138.stdout:0/24: symlink d4/l7 0 2024-02-07T12:25:24.251 INFO:tasks.workunit.client.1.smithi138.stdout:7/81: creat d0/d8/d15/f1e x:0 0 0 2024-02-07T12:25:24.252 INFO:tasks.workunit.client.1.smithi138.stdout:7/82: read d0/d8/d15/ff [13881,14747] 0 2024-02-07T12:25:24.252 INFO:tasks.workunit.client.1.smithi138.stdout:2/98: rename d3/dd/f18 to d3/dd/d14/f26 0 2024-02-07T12:25:24.253 INFO:tasks.workunit.client.1.smithi138.stdout:5/58: dread da/fb [0,4194304] 0 2024-02-07T12:25:24.254 INFO:tasks.workunit.client.1.smithi138.stdout:8/127: unlink d1/d6/l10 0 2024-02-07T12:25:24.254 INFO:tasks.workunit.client.1.smithi138.stdout:0/25: symlink d4/l8 0 2024-02-07T12:25:24.255 INFO:tasks.workunit.client.1.smithi138.stdout:4/40: dwrite f8 [0,4194304] 0 2024-02-07T12:25:24.255 INFO:tasks.workunit.client.1.smithi138.stdout:1/30: write f4 [2766541,113544] 0 2024-02-07T12:25:24.256 INFO:tasks.workunit.client.1.smithi138.stdout:7/83: mkdir d0/d8/d11/d1f 0 2024-02-07T12:25:24.257 INFO:tasks.workunit.client.1.smithi138.stdout:2/99: mknod d3/d9/d25/c27 0 2024-02-07T12:25:24.257 INFO:tasks.workunit.client.1.smithi138.stdout:7/84: read d0/d8/d11/f1b [121138,130451] 0 2024-02-07T12:25:24.258 INFO:tasks.workunit.client.1.smithi138.stdout:5/59: mknod da/c16 0 2024-02-07T12:25:24.258 INFO:tasks.workunit.client.1.smithi138.stdout:2/100: fdatasync d3/dd/d19/f17 0 2024-02-07T12:25:24.258 INFO:tasks.workunit.client.1.smithi138.stdout:2/101: stat d3/dd/d19/f15 0 2024-02-07T12:25:24.258 INFO:tasks.workunit.client.1.smithi138.stdout:9/100: rmdir d0/d6/d8/d19 39 2024-02-07T12:25:24.259 INFO:tasks.workunit.client.1.smithi138.stdout:7/85: dread d0/d8/d11/f1b [0,4194304] 0 2024-02-07T12:25:24.259 INFO:tasks.workunit.client.1.smithi138.stdout:8/128: creat d1/de/f2a x:0 0 0 2024-02-07T12:25:24.259 INFO:tasks.workunit.client.1.smithi138.stdout:1/31: dread f3 [0,4194304] 0 2024-02-07T12:25:24.260 INFO:tasks.workunit.client.1.smithi138.stdout:1/32: fdatasync d5/f9 0 2024-02-07T12:25:24.261 INFO:tasks.workunit.client.1.smithi138.stdout:1/33: write f3 [1632989,53235] 0 2024-02-07T12:25:24.261 INFO:tasks.workunit.client.1.smithi138.stdout:1/34: truncate d5/f9 517980 0 2024-02-07T12:25:24.261 INFO:tasks.workunit.client.1.smithi138.stdout:2/102: symlink d3/l28 0 2024-02-07T12:25:24.262 INFO:tasks.workunit.client.1.smithi138.stdout:9/101: getdents d0/d6/d8 0 2024-02-07T12:25:24.263 INFO:tasks.workunit.client.1.smithi138.stdout:7/86: creat d0/d6/d1d/f20 x:0 0 0 2024-02-07T12:25:24.265 INFO:tasks.workunit.client.1.smithi138.stdout:4/41: dread f3 [0,4194304] 0 2024-02-07T12:25:24.265 INFO:tasks.workunit.client.1.smithi138.stdout:4/42: dread - fb zero size 2024-02-07T12:25:24.266 INFO:tasks.workunit.client.1.smithi138.stdout:2/103: mkdir d3/d9/d29 0 2024-02-07T12:25:24.268 INFO:tasks.workunit.client.1.smithi138.stdout:9/102: rename d0/d6/d8/d19 to d0/d6/d8/d1d/dd/d1f 0 2024-02-07T12:25:24.269 INFO:tasks.workunit.client.1.smithi138.stdout:1/35: getdents d5 0 2024-02-07T12:25:24.269 INFO:tasks.workunit.client.1.smithi138.stdout:1/36: write f3 [2862850,113728] 0 2024-02-07T12:25:24.271 INFO:tasks.workunit.client.1.smithi138.stdout:2/104: mknod d3/d9/c2a 0 2024-02-07T12:25:24.274 INFO:tasks.workunit.client.1.smithi138.stdout:1/37: fsync f3 0 2024-02-07T12:25:24.276 INFO:tasks.workunit.client.1.smithi138.stdout:4/43: getdents . 0 2024-02-07T12:25:24.276 INFO:tasks.workunit.client.1.smithi138.stdout:4/44: getdents . 0 2024-02-07T12:25:24.280 INFO:tasks.workunit.client.1.smithi138.stdout:5/60: dwrite da/df/f13 [4194304,4194304] 0 2024-02-07T12:25:24.280 INFO:tasks.workunit.client.1.smithi138.stdout:5/61: creat da/df/f17 x:0 0 0 2024-02-07T12:25:24.282 INFO:tasks.workunit.client.1.smithi138.stdout:4/45: dread f7 [0,4194304] 0 2024-02-07T12:25:24.287 INFO:tasks.workunit.client.1.smithi138.stdout:2/105: dread f0 [0,4194304] 0 2024-02-07T12:25:24.287 INFO:tasks.workunit.client.1.smithi138.stdout:2/106: write d3/dd/d19/ff [596082,55094] 0 2024-02-07T12:25:24.287 INFO:tasks.workunit.client.1.smithi138.stdout:2/107: fsync f0 0 2024-02-07T12:25:24.287 INFO:tasks.workunit.client.1.smithi138.stdout:9/103: rename d0/d6/fb to d0/d6/d8/d1d/dd/f20 0 2024-02-07T12:25:24.315 INFO:tasks.workunit.client.0.smithi047.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-07T12:25:24.315 INFO:tasks.workunit.client.0.smithi047.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-07T12:25:24.315 INFO:tasks.workunit.client.0.smithi047.stderr:+ make 2024-02-07T12:25:24.348 INFO:tasks.workunit.client.1.smithi138.stdout:7/87: dwrite d0/d6/f16 [0,4194304] 0 2024-02-07T12:25:24.350 INFO:tasks.workunit.client.1.smithi138.stdout:7/88: symlink d0/d8/d11/d1f/l21 0 2024-02-07T12:25:24.350 INFO:tasks.workunit.client.1.smithi138.stdout:7/89: truncate d0/d8/d11/f1b 1142276 0 2024-02-07T12:25:24.350 INFO:tasks.workunit.client.1.smithi138.stdout:7/90: chown d0/d8/d15 1410726057 1 2024-02-07T12:25:24.352 INFO:tasks.workunit.client.1.smithi138.stdout:7/91: mkdir d0/d22 0 2024-02-07T12:25:24.352 INFO:tasks.workunit.client.1.smithi138.stdout:7/92: stat d0/d6/f12 0 2024-02-07T12:25:24.354 INFO:tasks.workunit.client.1.smithi138.stdout:7/93: rmdir d0/d8/d15 39 2024-02-07T12:25:24.391 INFO:tasks.workunit.client.1.smithi138.stdout:8/129: dwrite d1/f15 [0,4194304] 0 2024-02-07T12:25:24.392 INFO:tasks.workunit.client.1.smithi138.stdout:8/130: chown d1/f4 28 1 2024-02-07T12:25:24.392 INFO:tasks.workunit.client.1.smithi138.stdout:8/131: mknod d1/c2b 0 2024-02-07T12:25:24.403 INFO:tasks.workunit.client.1.smithi138.stdout:9/104: write d0/f2 [1472672,28330] 0 2024-02-07T12:25:24.403 INFO:tasks.workunit.client.1.smithi138.stdout:9/105: fsync d0/d6/d8/d1d/dd/f18 0 2024-02-07T12:25:24.405 INFO:tasks.workunit.client.1.smithi138.stdout:9/106: symlink d0/d6/d8/d1d/dd/d1f/l21 0 2024-02-07T12:25:24.408 INFO:tasks.workunit.client.1.smithi138.stdout:9/107: symlink d0/d6/d8/l22 0 2024-02-07T12:25:24.411 INFO:tasks.workunit.client.1.smithi138.stdout:9/108: write d0/d6/f12 [387041,75751] 0 2024-02-07T12:25:24.418 INFO:tasks.workunit.client.1.smithi138.stdout:1/38: dwrite d5/f9 [0,4194304] 0 2024-02-07T12:25:24.425 INFO:tasks.workunit.client.1.smithi138.stdout:1/39: mkdir d5/d8/da 0 2024-02-07T12:25:24.428 INFO:tasks.workunit.client.1.smithi138.stdout:2/108: dwrite d3/f12 [0,4194304] 0 2024-02-07T12:25:24.435 INFO:tasks.workunit.client.1.smithi138.stdout:5/62: dwrite f8 [0,4194304] 0 2024-02-07T12:25:24.438 INFO:tasks.workunit.client.1.smithi138.stdout:8/132: dread d1/d6/f29 [0,4194304] 0 2024-02-07T12:25:24.438 INFO:tasks.workunit.client.1.smithi138.stdout:8/133: write d1/de/d11/f18 [525012,31023] 0 2024-02-07T12:25:24.448 INFO:tasks.workunit.client.1.smithi138.stdout:8/134: symlink d1/d6/l2c 0 2024-02-07T12:25:24.476 INFO:tasks.workunit.client.1.smithi138.stdout:4/46: dwrite f7 [0,4194304] 0 2024-02-07T12:25:24.476 INFO:tasks.workunit.client.1.smithi138.stdout:4/47: chown ce 107 1 2024-02-07T12:25:24.616 INFO:tasks.workunit.client.1.smithi138.stdout:4/48: dwrite f3 [0,4194304] 0 2024-02-07T12:25:24.677 INFO:tasks.workunit.client.1.smithi138.stdout:5/63: dwrite f8 [0,4194304] 0 2024-02-07T12:25:24.678 INFO:tasks.workunit.client.1.smithi138.stdout:2/109: dwrite d3/dd/d19/f17 [0,4194304] 0 2024-02-07T12:25:24.678 INFO:tasks.workunit.client.1.smithi138.stdout:2/110: fdatasync f0 0 2024-02-07T12:25:24.678 INFO:tasks.workunit.client.1.smithi138.stdout:2/111: readlink d3/dd/d19/l7 0 2024-02-07T12:25:24.711 INFO:tasks.workunit.client.1.smithi138.stdout:8/135: dwrite d1/f13 [0,4194304] 0 2024-02-07T12:25:24.719 INFO:tasks.workunit.client.1.smithi138.stdout:8/136: rmdir d1/de/d11/d17 39 2024-02-07T12:25:24.719 INFO:tasks.workunit.client.1.smithi138.stdout:8/137: stat d1/de/d11/c16 0 2024-02-07T12:25:24.719 INFO:tasks.workunit.client.1.smithi138.stdout:8/138: dread - d1/de/d11/d17/f20 zero size 2024-02-07T12:25:24.732 INFO:tasks.workunit.client.1.smithi138.stdout:8/139: dread d1/d6/f19 [0,4194304] 0 2024-02-07T12:25:24.732 INFO:tasks.workunit.client.1.smithi138.stdout:8/140: dread - d1/de/d11/f1a zero size 2024-02-07T12:25:24.743 INFO:tasks.workunit.client.1.smithi138.stdout:8/141: rename d1/d6/fb to d1/de/d11/d17/f2d 0 2024-02-07T12:25:24.785 INFO:tasks.workunit.client.1.smithi138.stdout:1/40: dread f3 [0,4194304] 0 2024-02-07T12:25:24.789 INFO:tasks.workunit.client.1.smithi138.stdout:1/41: mknod d5/d8/cb 0 2024-02-07T12:25:24.797 INFO:tasks.workunit.client.1.smithi138.stdout:1/42: unlink c0 0 2024-02-07T12:25:24.813 INFO:tasks.workunit.client.1.smithi138.stdout:1/43: write d5/f9 [288927,111912] 0 2024-02-07T12:25:24.813 INFO:tasks.workunit.client.1.smithi138.stdout:1/44: chown d5/l6 7694 1 2024-02-07T12:25:24.813 INFO:tasks.workunit.client.1.smithi138.stdout:1/45: stat d5/f9 0 2024-02-07T12:25:24.813 INFO:tasks.workunit.client.1.smithi138.stdout:1/46: truncate f3 3126403 0 2024-02-07T12:25:24.880 INFO:tasks.workunit.client.1.smithi138.stdout:5/64: rmdir da/df 39 2024-02-07T12:25:24.934 INFO:tasks.workunit.client.1.smithi138.stdout:4/49: truncate f3 2401794 0 2024-02-07T12:25:24.937 INFO:tasks.workunit.client.1.smithi138.stdout:4/50: link lc lf 0 2024-02-07T12:25:24.937 INFO:tasks.workunit.client.1.smithi138.stdout:4/51: stat f8 0 2024-02-07T12:25:24.971 INFO:tasks.workunit.client.1.smithi138.stdout:9/109: dread d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:24.976 INFO:tasks.workunit.client.1.smithi138.stdout:9/110: symlink d0/d6/d8/d1d/dd/l23 0 2024-02-07T12:25:24.976 INFO:tasks.workunit.client.1.smithi138.stdout:9/111: truncate d0/d6/d8/d1d/f1c 858012 0 2024-02-07T12:25:24.980 INFO:tasks.workunit.client.1.smithi138.stdout:9/112: write d0/d6/f15 [1043391,14929] 0 2024-02-07T12:25:25.065 INFO:tasks.workunit.client.1.smithi138.stdout:2/112: dwrite d3/dd/d19/f15 [0,4194304] 0 2024-02-07T12:25:25.070 INFO:tasks.workunit.client.1.smithi138.stdout:2/113: mknod d3/dd/c2b 0 2024-02-07T12:25:25.071 INFO:tasks.workunit.client.1.smithi138.stdout:2/114: creat d3/dd/d14/f2c x:0 0 0 2024-02-07T12:25:25.081 INFO:tasks.workunit.client.1.smithi138.stdout:2/115: mkdir d3/d2d 0 2024-02-07T12:25:25.082 INFO:tasks.workunit.client.1.smithi138.stdout:2/116: creat d3/dd/f2e x:0 0 0 2024-02-07T12:25:25.090 INFO:tasks.workunit.client.1.smithi138.stdout:2/117: symlink d3/dd/d19/l2f 0 2024-02-07T12:25:25.118 INFO:tasks.workunit.client.1.smithi138.stdout:8/142: dread d1/de/d11/f1d [0,4194304] 0 2024-02-07T12:25:25.118 INFO:tasks.workunit.client.1.smithi138.stdout:8/143: truncate d1/f23 265719 0 2024-02-07T12:25:25.125 INFO:tasks.workunit.client.1.smithi138.stdout:8/144: mkdir d1/de/d11/d17/d2e 0 2024-02-07T12:25:25.130 INFO:tasks.workunit.client.1.smithi138.stdout:8/145: rename d1 to d1/d6/d2f 22 2024-02-07T12:25:25.130 INFO:tasks.workunit.client.1.smithi138.stdout:8/146: chown d1/de/d11/d17/f21 412214904 1 2024-02-07T12:25:25.130 INFO:tasks.workunit.client.1.smithi138.stdout:8/147: stat d1/f13 0 2024-02-07T12:25:25.130 INFO:tasks.workunit.client.1.smithi138.stdout:8/148: readlink d1/de/l1c 0 2024-02-07T12:25:25.130 INFO:tasks.workunit.client.1.smithi138.stdout:8/149: fdatasync d1/d6/f8 0 2024-02-07T12:25:25.137 INFO:tasks.workunit.client.1.smithi138.stdout:8/150: rename d1/de/f2a to d1/de/d11/f30 0 2024-02-07T12:25:25.137 INFO:tasks.workunit.client.1.smithi138.stdout:8/151: dread - d1/de/d11/d17/f20 zero size 2024-02-07T12:25:25.138 INFO:tasks.workunit.client.1.smithi138.stdout:8/152: read d1/f23 [34775,72659] 0 2024-02-07T12:25:25.143 INFO:tasks.workunit.client.1.smithi138.stdout:8/153: rmdir d1/d6 39 2024-02-07T12:25:25.145 INFO:tasks.workunit.client.1.smithi138.stdout:8/154: creat d1/de/d11/f31 x:0 0 0 2024-02-07T12:25:25.145 INFO:tasks.workunit.client.1.smithi138.stdout:8/155: stat d1/la 0 2024-02-07T12:25:25.145 INFO:tasks.workunit.client.1.smithi138.stdout:8/156: fdatasync d1/de/d11/f1a 0 2024-02-07T12:25:25.165 INFO:tasks.workunit.client.1.smithi138.stdout:1/47: dread d5/f9 [0,4194304] 0 2024-02-07T12:25:25.167 INFO:tasks.workunit.client.1.smithi138.stdout:1/48: creat d5/d8/da/fc x:0 0 0 2024-02-07T12:25:25.198 INFO:tasks.workunit.client.1.smithi138.stdout:6/67: sync 2024-02-07T12:25:25.200 INFO:tasks.workunit.client.1.smithi138.stdout:6/68: truncate f6 86555 0 2024-02-07T12:25:25.200 INFO:tasks.workunit.client.1.smithi138.stdout:6/69: write dc/d13/f14 [876550,117678] 0 2024-02-07T12:25:25.201 INFO:tasks.workunit.client.1.smithi138.stdout:6/70: symlink dc/l16 0 2024-02-07T12:25:25.235 INFO:tasks.workunit.client.1.smithi138.stdout:0/26: sync 2024-02-07T12:25:25.236 INFO:tasks.workunit.client.1.smithi138.stdout:0/27: read - d4/f6 zero size 2024-02-07T12:25:25.236 INFO:tasks.workunit.client.1.smithi138.stdout:7/94: sync 2024-02-07T12:25:25.236 INFO:tasks.workunit.client.1.smithi138.stdout:7/95: creat d0/f23 x:0 0 0 2024-02-07T12:25:25.236 INFO:tasks.workunit.client.1.smithi138.stdout:3/172: sync 2024-02-07T12:25:25.237 INFO:tasks.workunit.client.1.smithi138.stdout:0/28: mkdir d4/d9 0 2024-02-07T12:25:25.239 INFO:tasks.workunit.client.1.smithi138.stdout:3/173: symlink d5/d15/d32/l3b 0 2024-02-07T12:25:25.239 INFO:tasks.workunit.client.1.smithi138.stdout:3/174: creat d5/d26/f3c x:0 0 0 2024-02-07T12:25:25.239 INFO:tasks.workunit.client.1.smithi138.stdout:3/175: chown d5/l33 469849943 1 2024-02-07T12:25:25.239 INFO:tasks.workunit.client.1.smithi138.stdout:3/176: stat d5/d26/f2e 0 2024-02-07T12:25:25.242 INFO:tasks.workunit.client.1.smithi138.stdout:3/177: creat d5/d27/f3d x:0 0 0 2024-02-07T12:25:25.265 INFO:tasks.workunit.client.1.smithi138.stdout:6/71: getdents dc 0 2024-02-07T12:25:25.307 INFO:tasks.workunit.client.1.smithi138.stdout:0/29: dwrite d4/f5 [0,4194304] 0 2024-02-07T12:25:25.307 INFO:tasks.workunit.client.1.smithi138.stdout:0/30: fdatasync f2 0 2024-02-07T12:25:25.307 INFO:tasks.workunit.client.1.smithi138.stdout:0/31: getdents d4/d9 0 2024-02-07T12:25:25.319 INFO:tasks.workunit.client.1.smithi138.stdout:4/52: dread f8 [0,4194304] 0 2024-02-07T12:25:25.320 INFO:tasks.workunit.client.1.smithi138.stdout:4/53: readlink l4 0 2024-02-07T12:25:25.330 INFO:tasks.workunit.client.1.smithi138.stdout:3/178: dwrite d5/f2f [0,4194304] 0 2024-02-07T12:25:25.330 INFO:tasks.workunit.client.1.smithi138.stdout:3/179: truncate d5/f24 4324930 0 2024-02-07T12:25:25.334 INFO:tasks.workunit.client.1.smithi138.stdout:3/180: link d5/d27/d35/l38 d5/d34/l3e 0 2024-02-07T12:25:25.335 INFO:tasks.workunit.client.1.smithi138.stdout:3/181: readlink d5/d34/l3e 0 2024-02-07T12:25:25.346 INFO:tasks.workunit.client.1.smithi138.stdout:9/113: dwrite d0/d6/d8/d1d/dd/d1f/f1a [4194304,4194304] 0 2024-02-07T12:25:25.348 INFO:tasks.workunit.client.1.smithi138.stdout:9/114: stat d0/d6/c17 0 2024-02-07T12:25:25.410 INFO:tasks.workunit.client.1.smithi138.stdout:6/72: dwrite f8 [0,4194304] 0 2024-02-07T12:25:25.413 INFO:tasks.workunit.client.1.smithi138.stdout:6/73: rename dc/c15 to dc/d13/c17 0 2024-02-07T12:25:25.416 INFO:tasks.workunit.client.1.smithi138.stdout:3/182: dwrite d5/ff [0,4194304] 0 2024-02-07T12:25:25.416 INFO:tasks.workunit.client.1.smithi138.stdout:3/183: readlink d5/d15/l31 0 2024-02-07T12:25:25.431 INFO:tasks.workunit.client.1.smithi138.stdout:6/74: dread dc/f10 [0,4194304] 0 2024-02-07T12:25:25.473 INFO:tasks.workunit.client.1.smithi138.stdout:2/118: dwrite d3/dd/d19/f15 [4194304,4194304] 0 2024-02-07T12:25:25.476 INFO:tasks.workunit.client.1.smithi138.stdout:2/119: mknod d3/d9/d25/c30 0 2024-02-07T12:25:25.476 INFO:tasks.workunit.client.1.smithi138.stdout:2/120: rename d3/d9/d29 to d3/d9/d29/d31 22 2024-02-07T12:25:25.479 INFO:tasks.workunit.client.1.smithi138.stdout:2/121: symlink d3/d9/d29/l32 0 2024-02-07T12:25:25.480 INFO:tasks.workunit.client.1.smithi138.stdout:2/122: fdatasync d3/dd/d19/f17 0 2024-02-07T12:25:25.482 INFO:tasks.workunit.client.1.smithi138.stdout:6/75: dread f1 [0,4194304] 0 2024-02-07T12:25:25.482 INFO:tasks.workunit.client.1.smithi138.stdout:3/184: dwrite d5/d27/f3d [0,4194304] 0 2024-02-07T12:25:25.487 INFO:tasks.workunit.client.1.smithi138.stdout:2/123: link d3/d9/d25/l1e d3/d9/d29/l33 0 2024-02-07T12:25:25.490 INFO:tasks.workunit.client.1.smithi138.stdout:8/157: dread d1/de/d11/f1d [0,4194304] 0 2024-02-07T12:25:25.497 INFO:tasks.workunit.client.1.smithi138.stdout:6/76: link l5 dc/l18 0 2024-02-07T12:25:25.497 INFO:tasks.workunit.client.1.smithi138.stdout:6/77: fsync fb 0 2024-02-07T12:25:25.498 INFO:tasks.workunit.client.1.smithi138.stdout:3/185: symlink d5/d27/d35/l3f 0 2024-02-07T12:25:25.499 INFO:tasks.workunit.client.1.smithi138.stdout:2/124: creat d3/dd/d19/d1f/f34 x:0 0 0 2024-02-07T12:25:25.499 INFO:tasks.workunit.client.1.smithi138.stdout:2/125: write f1 [5436709,124523] 0 2024-02-07T12:25:25.499 INFO:tasks.workunit.client.1.smithi138.stdout:2/126: stat d3/d9/l24 0 2024-02-07T12:25:25.502 INFO:tasks.workunit.client.1.smithi138.stdout:2/127: creat d3/dd/d19/f35 x:0 0 0 2024-02-07T12:25:25.507 INFO:tasks.workunit.client.1.smithi138.stdout:2/128: symlink d3/l36 0 2024-02-07T12:25:25.508 INFO:tasks.workunit.client.1.smithi138.stdout:2/129: fdatasync d3/dd/d14/f2c 0 2024-02-07T12:25:25.509 INFO:tasks.workunit.client.1.smithi138.stdout:2/130: mkdir d3/dd/d19/d1f/d37 0 2024-02-07T12:25:25.511 INFO:tasks.workunit.client.1.smithi138.stdout:2/131: link d3/dd/d19/l21 d3/dd/d19/d1f/d37/l38 0 2024-02-07T12:25:25.514 INFO:tasks.workunit.client.1.smithi138.stdout:2/132: rmdir d3/d2d 0 2024-02-07T12:25:25.520 INFO:tasks.workunit.client.1.smithi138.stdout:2/133: unlink d3/l28 0 2024-02-07T12:25:25.524 INFO:tasks.workunit.client.1.smithi138.stdout:2/134: mknod d3/dd/d19/d1f/c39 0 2024-02-07T12:25:25.535 INFO:tasks.workunit.client.1.smithi138.stdout:3/186: read f3 [55718,22881] 0 2024-02-07T12:25:25.538 INFO:tasks.workunit.client.1.smithi138.stdout:3/187: link d5/d26/d28/f39 d5/d27/f40 0 2024-02-07T12:25:25.538 INFO:tasks.workunit.client.1.smithi138.stdout:3/188: creat d5/d15/f41 x:0 0 0 2024-02-07T12:25:25.538 INFO:tasks.workunit.client.1.smithi138.stdout:3/189: write d5/f3a [259940,43176] 0 2024-02-07T12:25:25.553 INFO:tasks.workunit.client.1.smithi138.stdout:7/96: write d0/f1 [7767,121626] 0 2024-02-07T12:25:25.553 INFO:tasks.workunit.client.1.smithi138.stdout:7/97: chown d0/d8/d11/f1b 24506 1 2024-02-07T12:25:25.557 INFO:tasks.workunit.client.1.smithi138.stdout:7/98: stat d0/d8/d15/lc 0 2024-02-07T12:25:25.557 INFO:tasks.workunit.client.1.smithi138.stdout:7/99: chown d0/d8/d15/lc 77496231 1 2024-02-07T12:25:25.559 INFO:tasks.workunit.client.1.smithi138.stdout:7/100: mkdir d0/d6/d1d/d24 0 2024-02-07T12:25:25.565 INFO:tasks.workunit.client.1.smithi138.stdout:9/115: dread d0/d6/d8/d1d/fc [0,4194304] 0 2024-02-07T12:25:25.573 INFO:tasks.workunit.client.1.smithi138.stdout:9/116: symlink d0/l24 0 2024-02-07T12:25:25.585 INFO:tasks.workunit.client.1.smithi138.stdout:4/54: dread f8 [0,4194304] 0 2024-02-07T12:25:25.585 INFO:tasks.workunit.client.1.smithi138.stdout:4/55: dread - fd zero size 2024-02-07T12:25:25.586 INFO:tasks.workunit.client.1.smithi138.stdout:4/56: truncate fd 987243 0 2024-02-07T12:25:25.587 INFO:tasks.workunit.client.1.smithi138.stdout:4/57: creat f10 x:0 0 0 2024-02-07T12:25:25.591 INFO:tasks.workunit.client.1.smithi138.stdout:1/49: dwrite d5/f7 [0,4194304] 0 2024-02-07T12:25:25.591 INFO:tasks.workunit.client.1.smithi138.stdout:1/50: stat d5/d8/da/fc 0 2024-02-07T12:25:25.593 INFO:tasks.workunit.client.1.smithi138.stdout:1/51: getdents d5/d8 0 2024-02-07T12:25:25.600 INFO:tasks.workunit.client.1.smithi138.stdout:1/52: rmdir d5/d8/da 39 2024-02-07T12:25:25.623 INFO:tasks.workunit.client.1.smithi138.stdout:3/190: dread d5/f10 [0,4194304] 0 2024-02-07T12:25:25.623 INFO:tasks.workunit.client.1.smithi138.stdout:9/117: dwrite d0/d6/d8/d1d/dd/f20 [0,4194304] 0 2024-02-07T12:25:25.627 INFO:tasks.workunit.client.1.smithi138.stdout:9/118: mkdir d0/d6/d8/d1d/dd/d25 0 2024-02-07T12:25:25.627 INFO:tasks.workunit.client.1.smithi138.stdout:9/119: chown d0/d6/d8/d1d/dd/d25 445699 1 2024-02-07T12:25:25.628 INFO:tasks.workunit.client.1.smithi138.stdout:3/191: dread d5/f3a [0,4194304] 0 2024-02-07T12:25:25.638 INFO:tasks.workunit.client.1.smithi138.stdout:3/192: getdents d5 0 2024-02-07T12:25:25.675 INFO:tasks.workunit.client.1.smithi138.stdout:0/32: dwrite f1 [0,4194304] 0 2024-02-07T12:25:25.679 INFO:tasks.workunit.client.1.smithi138.stdout:8/158: dwrite d1/de/d11/d17/f24 [0,4194304] 0 2024-02-07T12:25:25.679 INFO:tasks.workunit.client.1.smithi138.stdout:8/159: stat d1/de/d11/l14 0 2024-02-07T12:25:25.681 INFO:tasks.workunit.client.1.smithi138.stdout:8/160: symlink d1/de/d11/d17/d2e/l32 0 2024-02-07T12:25:25.686 INFO:tasks.workunit.client.1.smithi138.stdout:6/78: dwrite f6 [0,4194304] 0 2024-02-07T12:25:25.690 INFO:tasks.workunit.client.1.smithi138.stdout:6/79: rename dc/f10 to dc/d13/f19 0 2024-02-07T12:25:25.690 INFO:tasks.workunit.client.1.smithi138.stdout:6/80: chown dc 0 1 2024-02-07T12:25:25.695 INFO:tasks.workunit.client.1.smithi138.stdout:8/161: write d1/d6/f8 [909459,57667] 0 2024-02-07T12:25:25.697 INFO:tasks.workunit.client.1.smithi138.stdout:8/162: mknod d1/de/d11/c33 0 2024-02-07T12:25:25.700 INFO:tasks.workunit.client.1.smithi138.stdout:8/163: unlink d1/d6/f28 0 2024-02-07T12:25:25.703 INFO:tasks.workunit.client.1.smithi138.stdout:8/164: symlink d1/de/d11/d17/l34 0 2024-02-07T12:25:25.704 INFO:tasks.workunit.client.1.smithi138.stdout:7/101: rmdir d0/d6/d1d 39 2024-02-07T12:25:25.706 INFO:tasks.workunit.client.1.smithi138.stdout:8/165: link d1/lc d1/de/d11/l35 0 2024-02-07T12:25:25.706 INFO:tasks.workunit.client.1.smithi138.stdout:8/166: truncate d1/de/d11/d17/f25 297165 0 2024-02-07T12:25:25.709 INFO:tasks.workunit.client.1.smithi138.stdout:7/102: creat d0/d8/f25 x:0 0 0 2024-02-07T12:25:25.713 INFO:tasks.workunit.client.1.smithi138.stdout:8/167: getdents d1 0 2024-02-07T12:25:25.713 INFO:tasks.workunit.client.1.smithi138.stdout:8/168: dread - d1/de/d11/d17/f21 zero size 2024-02-07T12:25:25.713 INFO:tasks.workunit.client.1.smithi138.stdout:8/169: dread - d1/de/d11/f31 zero size 2024-02-07T12:25:25.715 INFO:tasks.workunit.client.1.smithi138.stdout:8/170: creat d1/de/d11/f36 x:0 0 0 2024-02-07T12:25:25.716 INFO:tasks.workunit.client.1.smithi138.stdout:0/33: dwrite d4/f6 [0,4194304] 0 2024-02-07T12:25:25.716 INFO:tasks.workunit.client.1.smithi138.stdout:6/81: dwrite fb [0,4194304] 0 2024-02-07T12:25:25.717 INFO:tasks.workunit.client.1.smithi138.stdout:8/171: dread d1/f22 [0,4194304] 0 2024-02-07T12:25:25.717 INFO:tasks.workunit.client.1.smithi138.stdout:9/120: dwrite d0/d6/d8/d1d/f1c [0,4194304] 0 2024-02-07T12:25:25.717 INFO:tasks.workunit.client.1.smithi138.stdout:9/121: chown d0/d6/d8/d1d 85043580 1 2024-02-07T12:25:25.722 INFO:tasks.workunit.client.1.smithi138.stdout:6/82: link dc/fd dc/d13/f1a 0 2024-02-07T12:25:25.724 INFO:tasks.workunit.client.1.smithi138.stdout:3/193: dwrite d5/f9 [0,4194304] 0 2024-02-07T12:25:25.725 INFO:tasks.workunit.client.1.smithi138.stdout:9/122: unlink d0/d6/d8/d1d/fc 0 2024-02-07T12:25:25.726 INFO:tasks.workunit.client.1.smithi138.stdout:3/194: mknod d5/d27/d35/c42 0 2024-02-07T12:25:25.732 INFO:tasks.workunit.client.1.smithi138.stdout:0/34: read d4/f6 [3370832,112482] 0 2024-02-07T12:25:25.732 INFO:tasks.workunit.client.1.smithi138.stdout:4/58: dwrite f3 [0,4194304] 0 2024-02-07T12:25:25.732 INFO:tasks.workunit.client.1.smithi138.stdout:4/59: creat f11 x:0 0 0 2024-02-07T12:25:25.734 INFO:tasks.workunit.client.1.smithi138.stdout:9/123: dread d0/f2 [0,4194304] 0 2024-02-07T12:25:25.734 INFO:tasks.workunit.client.1.smithi138.stdout:9/124: rename d0 to d0/d6/d8/d1d/dd/d25/d26 22 2024-02-07T12:25:25.734 INFO:tasks.workunit.client.1.smithi138.stdout:0/35: creat d4/d9/fa x:0 0 0 2024-02-07T12:25:25.736 INFO:tasks.workunit.client.1.smithi138.stdout:4/60: stat lf 0 2024-02-07T12:25:25.737 INFO:tasks.workunit.client.1.smithi138.stdout:9/125: creat d0/d6/f27 x:0 0 0 2024-02-07T12:25:25.738 INFO:tasks.workunit.client.1.smithi138.stdout:0/36: mkdir d4/d9/db 0 2024-02-07T12:25:25.740 INFO:tasks.workunit.client.1.smithi138.stdout:4/61: symlink l12 0 2024-02-07T12:25:25.740 INFO:tasks.workunit.client.1.smithi138.stdout:3/195: dread d5/fd [0,4194304] 0 2024-02-07T12:25:25.740 INFO:tasks.workunit.client.1.smithi138.stdout:3/196: stat d5/d15 0 2024-02-07T12:25:25.742 INFO:tasks.workunit.client.1.smithi138.stdout:9/126: unlink d0/f2 0 2024-02-07T12:25:25.742 INFO:tasks.workunit.client.1.smithi138.stdout:9/127: rename d0/d6/d8/d1d to d0/d6/d8/d1d/dd/d1f/d28 22 2024-02-07T12:25:25.745 INFO:tasks.workunit.client.1.smithi138.stdout:0/37: creat d4/fc x:0 0 0 2024-02-07T12:25:25.745 INFO:tasks.workunit.client.1.smithi138.stdout:0/38: dread - d4/fc zero size 2024-02-07T12:25:25.748 INFO:tasks.workunit.client.1.smithi138.stdout:4/62: rename f7 to f13 0 2024-02-07T12:25:25.748 INFO:tasks.workunit.client.1.smithi138.stdout:4/63: truncate fb 228130 0 2024-02-07T12:25:25.748 INFO:tasks.workunit.client.1.smithi138.stdout:4/64: rmdir - no directory 2024-02-07T12:25:25.754 INFO:tasks.workunit.client.1.smithi138.stdout:3/197: write d5/f24 [3321710,41999] 0 2024-02-07T12:25:25.758 INFO:tasks.workunit.client.1.smithi138.stdout:9/128: read d0/d6/d8/d1d/dd/d1f/f1a [6512984,39692] 0 2024-02-07T12:25:25.758 INFO:tasks.workunit.client.1.smithi138.stdout:3/198: creat d5/d15/d32/f43 x:0 0 0 2024-02-07T12:25:25.758 INFO:tasks.workunit.client.1.smithi138.stdout:1/53: dwrite d5/f7 [4194304,4194304] 0 2024-02-07T12:25:25.758 INFO:tasks.workunit.client.1.smithi138.stdout:7/103: dwrite d0/f4 [0,4194304] 0 2024-02-07T12:25:25.760 INFO:tasks.workunit.client.1.smithi138.stdout:5/65: dread da/fc [4194304,4194304] 0 2024-02-07T12:25:25.763 INFO:tasks.workunit.client.1.smithi138.stdout:6/83: dwrite f6 [0,4194304] 0 2024-02-07T12:25:25.763 INFO:tasks.workunit.client.1.smithi138.stdout:6/84: write dc/d13/f14 [1715645,93722] 0 2024-02-07T12:25:25.764 INFO:tasks.workunit.client.1.smithi138.stdout:6/85: creat dc/d13/f1b x:0 0 0 2024-02-07T12:25:25.764 INFO:tasks.workunit.client.1.smithi138.stdout:6/86: fdatasync f1 0 2024-02-07T12:25:25.764 INFO:tasks.workunit.client.1.smithi138.stdout:6/87: chown c4 1042482 1 2024-02-07T12:25:25.764 INFO:tasks.workunit.client.1.smithi138.stdout:6/88: dread - dc/fd zero size 2024-02-07T12:25:25.764 INFO:tasks.workunit.client.1.smithi138.stdout:6/89: fdatasync dc/d13/f1a 0 2024-02-07T12:25:25.764 INFO:tasks.workunit.client.1.smithi138.stdout:6/90: dread - dc/fd zero size 2024-02-07T12:25:25.764 INFO:tasks.workunit.client.1.smithi138.stdout:6/91: readlink l7 0 2024-02-07T12:25:25.764 INFO:tasks.workunit.client.1.smithi138.stdout:6/92: dread - dc/fd zero size 2024-02-07T12:25:25.766 INFO:tasks.workunit.client.1.smithi138.stdout:3/199: dread d5/fd [0,4194304] 0 2024-02-07T12:25:25.766 INFO:tasks.workunit.client.1.smithi138.stdout:3/200: dread - d5/d15/f16 zero size 2024-02-07T12:25:25.767 INFO:tasks.workunit.client.1.smithi138.stdout:8/172: dwrite d1/de/d11/f18 [0,4194304] 0 2024-02-07T12:25:25.770 INFO:tasks.workunit.client.1.smithi138.stdout:4/65: dwrite f10 [0,4194304] 0 2024-02-07T12:25:25.770 INFO:tasks.workunit.client.1.smithi138.stdout:4/66: creat f14 x:0 0 0 2024-02-07T12:25:25.771 INFO:tasks.workunit.client.1.smithi138.stdout:7/104: mkdir d0/d8/d11/d26 0 2024-02-07T12:25:25.771 INFO:tasks.workunit.client.1.smithi138.stdout:4/67: write fb [178275,84470] 0 2024-02-07T12:25:25.771 INFO:tasks.workunit.client.1.smithi138.stdout:4/68: dread - f11 zero size 2024-02-07T12:25:25.774 INFO:tasks.workunit.client.1.smithi138.stdout:3/201: symlink d5/d15/d32/l44 0 2024-02-07T12:25:25.774 INFO:tasks.workunit.client.1.smithi138.stdout:3/202: chown d5/d27 4682921 1 2024-02-07T12:25:25.780 INFO:tasks.workunit.client.1.smithi138.stdout:8/173: getdents d1/de/d11/d17 0 2024-02-07T12:25:25.782 INFO:tasks.workunit.client.1.smithi138.stdout:1/54: link f4 d5/d8/fd 0 2024-02-07T12:25:25.787 INFO:tasks.workunit.client.1.smithi138.stdout:0/39: dwrite d4/d9/fa [0,4194304] 0 2024-02-07T12:25:25.787 INFO:tasks.workunit.client.1.smithi138.stdout:0/40: creat d4/fd x:0 0 0 2024-02-07T12:25:25.787 INFO:tasks.workunit.client.1.smithi138.stdout:7/105: symlink d0/d8/d11/d1f/l27 0 2024-02-07T12:25:25.789 INFO:tasks.workunit.client.1.smithi138.stdout:9/129: dwrite d0/d6/d8/d1d/dd/d1f/f1a [8388608,4194304] 0 2024-02-07T12:25:25.795 INFO:tasks.workunit.client.1.smithi138.stdout:8/174: rename d1/f4 to d1/de/d11/f37 0 2024-02-07T12:25:25.796 INFO:tasks.workunit.client.1.smithi138.stdout:5/66: dwrite f8 [0,4194304] 0 2024-02-07T12:25:25.796 INFO:tasks.workunit.client.1.smithi138.stdout:5/67: readlink l9 0 2024-02-07T12:25:25.804 INFO:tasks.workunit.client.1.smithi138.stdout:0/41: mkdir d4/d9/de 0 2024-02-07T12:25:25.804 INFO:tasks.workunit.client.1.smithi138.stdout:0/42: getdents d4/d9/de 0 2024-02-07T12:25:25.804 INFO:tasks.workunit.client.1.smithi138.stdout:0/43: truncate d4/fc 376424 0 2024-02-07T12:25:25.804 INFO:tasks.workunit.client.1.smithi138.stdout:0/44: chown f2 3 1 2024-02-07T12:25:25.804 INFO:tasks.workunit.client.1.smithi138.stdout:0/45: rename d4/d9/de to d4/d9/de/df 22 2024-02-07T12:25:25.805 INFO:tasks.workunit.client.1.smithi138.stdout:0/46: read d4/fc [57261,53096] 0 2024-02-07T12:25:25.805 INFO:tasks.workunit.client.1.smithi138.stdout:0/47: getdents d4/d9/db 0 2024-02-07T12:25:25.805 INFO:tasks.workunit.client.1.smithi138.stdout:1/55: dwrite f4 [4194304,4194304] 0 2024-02-07T12:25:25.807 INFO:tasks.workunit.client.1.smithi138.stdout:7/106: getdents d0/d8/d11/d1f 0 2024-02-07T12:25:25.810 INFO:tasks.workunit.client.1.smithi138.stdout:9/130: dwrite d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:25.811 INFO:tasks.workunit.client.1.smithi138.stdout:3/203: getdents d5/d27 0 2024-02-07T12:25:25.814 INFO:tasks.workunit.client.1.smithi138.stdout:4/69: dwrite f11 [0,4194304] 0 2024-02-07T12:25:25.815 INFO:tasks.workunit.client.1.smithi138.stdout:0/48: truncate f1 152563 0 2024-02-07T12:25:25.816 INFO:tasks.workunit.client.1.smithi138.stdout:0/49: chown d4/f6 86 1 2024-02-07T12:25:25.816 INFO:tasks.workunit.client.1.smithi138.stdout:3/204: read d5/fd [1778651,47741] 0 2024-02-07T12:25:25.816 INFO:tasks.workunit.client.1.smithi138.stdout:5/68: symlink da/l18 0 2024-02-07T12:25:25.817 INFO:tasks.workunit.client.1.smithi138.stdout:6/93: dwrite f8 [0,4194304] 0 2024-02-07T12:25:25.825 INFO:tasks.workunit.client.1.smithi138.stdout:0/50: symlink d4/d9/db/l10 0 2024-02-07T12:25:25.826 INFO:tasks.workunit.client.1.smithi138.stdout:3/205: symlink d5/d27/d35/l45 0 2024-02-07T12:25:25.826 INFO:tasks.workunit.client.1.smithi138.stdout:5/69: rmdir da/df 39 2024-02-07T12:25:25.826 INFO:tasks.workunit.client.1.smithi138.stdout:5/70: chown da/df 4302 1 2024-02-07T12:25:25.828 INFO:tasks.workunit.client.1.smithi138.stdout:6/94: rename dc/l16 to dc/l1c 0 2024-02-07T12:25:25.828 INFO:tasks.workunit.client.1.smithi138.stdout:6/95: readlink dc/l18 0 2024-02-07T12:25:25.828 INFO:tasks.workunit.client.1.smithi138.stdout:6/96: readlink l5 0 2024-02-07T12:25:25.828 INFO:tasks.workunit.client.1.smithi138.stdout:9/131: rmdir d0/d6/d8/d1d 39 2024-02-07T12:25:25.829 INFO:tasks.workunit.client.1.smithi138.stdout:3/206: rmdir d5/d34 39 2024-02-07T12:25:25.829 INFO:tasks.workunit.client.1.smithi138.stdout:0/51: dread f2 [0,4194304] 0 2024-02-07T12:25:25.830 INFO:tasks.workunit.client.1.smithi138.stdout:5/71: rmdir da/df 39 2024-02-07T12:25:25.831 INFO:tasks.workunit.client.1.smithi138.stdout:6/97: unlink dc/c11 0 2024-02-07T12:25:25.833 INFO:tasks.workunit.client.1.smithi138.stdout:0/52: dread f2 [0,4194304] 0 2024-02-07T12:25:25.833 INFO:tasks.workunit.client.1.smithi138.stdout:5/72: creat da/f19 x:0 0 0 2024-02-07T12:25:25.835 INFO:tasks.workunit.client.1.smithi138.stdout:9/132: mknod d0/d6/d8/c29 0 2024-02-07T12:25:25.839 INFO:tasks.workunit.client.1.smithi138.stdout:5/73: mknod da/df/c1a 0 2024-02-07T12:25:25.840 INFO:tasks.workunit.client.1.smithi138.stdout:5/74: chown l9 50784 1 2024-02-07T12:25:25.840 INFO:tasks.workunit.client.1.smithi138.stdout:5/75: chown da/df/f10 4 1 2024-02-07T12:25:25.840 INFO:tasks.workunit.client.1.smithi138.stdout:1/56: dwrite f4 [0,4194304] 0 2024-02-07T12:25:25.842 INFO:tasks.workunit.client.1.smithi138.stdout:3/207: dread f1 [0,4194304] 0 2024-02-07T12:25:25.842 INFO:tasks.workunit.client.1.smithi138.stdout:5/76: mknod da/df/c1b 0 2024-02-07T12:25:25.842 INFO:tasks.workunit.client.1.smithi138.stdout:5/77: write da/df/f11 [614802,96855] 0 2024-02-07T12:25:25.843 INFO:tasks.workunit.client.1.smithi138.stdout:5/78: creat da/f1c x:0 0 0 2024-02-07T12:25:25.843 INFO:tasks.workunit.client.1.smithi138.stdout:5/79: creat da/f1d x:0 0 0 2024-02-07T12:25:25.843 INFO:tasks.workunit.client.1.smithi138.stdout:9/133: getdents d0/d6 0 2024-02-07T12:25:25.846 INFO:tasks.workunit.client.1.smithi138.stdout:3/208: mknod d5/d26/c46 0 2024-02-07T12:25:25.848 INFO:tasks.workunit.client.1.smithi138.stdout:1/57: dread d5/f7 [4194304,4194304] 0 2024-02-07T12:25:25.849 INFO:tasks.workunit.client.1.smithi138.stdout:7/107: dwrite d0/f23 [0,4194304] 0 2024-02-07T12:25:25.851 INFO:tasks.workunit.client.1.smithi138.stdout:8/175: truncate f0 3659117 0 2024-02-07T12:25:25.851 INFO:tasks.workunit.client.1.smithi138.stdout:8/176: write d1/de/d11/f36 [951519,126299] 0 2024-02-07T12:25:25.852 INFO:tasks.workunit.client.1.smithi138.stdout:7/108: dread d0/d8/d15/ff [0,4194304] 0 2024-02-07T12:25:25.854 INFO:tasks.workunit.client.1.smithi138.stdout:9/134: dread d0/d6/d8/d1d/dd/f18 [0,4194304] 0 2024-02-07T12:25:25.854 INFO:tasks.workunit.client.1.smithi138.stdout:9/135: dread - d0/d6/f27 zero size 2024-02-07T12:25:25.854 INFO:tasks.workunit.client.1.smithi138.stdout:5/80: unlink da/fd 0 2024-02-07T12:25:25.858 INFO:tasks.workunit.client.1.smithi138.stdout:4/70: dwrite f3 [0,4194304] 0 2024-02-07T12:25:25.858 INFO:tasks.workunit.client.1.smithi138.stdout:3/209: unlink d5/ff 0 2024-02-07T12:25:25.858 INFO:tasks.workunit.client.1.smithi138.stdout:3/210: creat d5/d15/d32/f47 x:0 0 0 2024-02-07T12:25:25.861 INFO:tasks.workunit.client.1.smithi138.stdout:7/109: unlink d0/f4 0 2024-02-07T12:25:25.861 INFO:tasks.workunit.client.1.smithi138.stdout:7/110: readlink d0/l7 0 2024-02-07T12:25:25.862 INFO:tasks.workunit.client.1.smithi138.stdout:7/111: truncate d0/d8/f25 1024810 0 2024-02-07T12:25:25.862 INFO:tasks.workunit.client.1.smithi138.stdout:8/177: dread d1/de/d11/f37 [0,4194304] 0 2024-02-07T12:25:25.863 INFO:tasks.workunit.client.1.smithi138.stdout:9/136: creat d0/d6/d8/f2a x:0 0 0 2024-02-07T12:25:25.863 INFO:tasks.workunit.client.1.smithi138.stdout:7/112: dread d0/d8/d11/f1b [0,4194304] 0 2024-02-07T12:25:25.864 INFO:tasks.workunit.client.1.smithi138.stdout:5/81: truncate da/df/f13 5297777 0 2024-02-07T12:25:25.867 INFO:tasks.workunit.client.1.smithi138.stdout:4/71: rename f10 to f15 0 2024-02-07T12:25:25.867 INFO:tasks.workunit.client.1.smithi138.stdout:4/72: rmdir - no directory 2024-02-07T12:25:25.875 INFO:tasks.workunit.client.1.smithi138.stdout:1/58: creat d5/d8/da/fe x:0 0 0 2024-02-07T12:25:25.880 INFO:tasks.workunit.client.1.smithi138.stdout:8/178: dread d1/de/d11/d17/f24 [0,4194304] 0 2024-02-07T12:25:25.881 INFO:tasks.workunit.client.1.smithi138.stdout:3/211: unlink d5/l1b 0 2024-02-07T12:25:25.881 INFO:tasks.workunit.client.1.smithi138.stdout:3/212: creat d5/d15/f48 x:0 0 0 2024-02-07T12:25:25.883 INFO:tasks.workunit.client.1.smithi138.stdout:9/137: truncate d0/d6/f15 1041491 0 2024-02-07T12:25:25.887 INFO:tasks.workunit.client.1.smithi138.stdout:1/59: write f4 [7777737,6819] 0 2024-02-07T12:25:25.889 INFO:tasks.workunit.client.1.smithi138.stdout:4/73: dwrite fd [0,4194304] 0 2024-02-07T12:25:25.894 INFO:tasks.workunit.client.1.smithi138.stdout:7/113: rename d0/f23 to d0/d8/d11/f28 0 2024-02-07T12:25:25.895 INFO:tasks.workunit.client.1.smithi138.stdout:7/114: fdatasync d0/d8/f25 0 2024-02-07T12:25:25.895 INFO:tasks.workunit.client.1.smithi138.stdout:8/179: mkdir d1/de/d11/d17/d2e/d38 0 2024-02-07T12:25:25.901 INFO:tasks.workunit.client.1.smithi138.stdout:9/138: chown d0/d6/d8/d1d/dd/d1f/l21 0 1 2024-02-07T12:25:25.908 INFO:tasks.workunit.client.1.smithi138.stdout:7/115: rmdir d0/d8/d15 39 2024-02-07T12:25:25.910 INFO:tasks.workunit.client.1.smithi138.stdout:1/60: dwrite d5/d8/da/fc [0,4194304] 0 2024-02-07T12:25:25.913 INFO:tasks.workunit.client.1.smithi138.stdout:5/82: rename l9 to da/l1e 0 2024-02-07T12:25:25.915 INFO:tasks.workunit.client.1.smithi138.stdout:8/180: creat d1/d6/f39 x:0 0 0 2024-02-07T12:25:25.917 INFO:tasks.workunit.client.1.smithi138.stdout:9/139: creat d0/d6/d8/d1d/dd/f2b x:0 0 0 2024-02-07T12:25:25.920 INFO:tasks.workunit.client.1.smithi138.stdout:0/53: dread d4/d9/fa [0,4194304] 0 2024-02-07T12:25:25.921 INFO:tasks.workunit.client.1.smithi138.stdout:0/54: creat d4/d9/f11 x:0 0 0 2024-02-07T12:25:25.921 INFO:tasks.workunit.client.1.smithi138.stdout:0/55: creat d4/d9/f12 x:0 0 0 2024-02-07T12:25:25.924 INFO:tasks.workunit.client.1.smithi138.stdout:3/213: dwrite d5/f24 [0,4194304] 0 2024-02-07T12:25:25.927 INFO:tasks.workunit.client.1.smithi138.stdout:1/61: creat d5/d8/ff x:0 0 0 2024-02-07T12:25:25.928 INFO:tasks.workunit.client.1.smithi138.stdout:1/62: dread - d5/d8/da/fe zero size 2024-02-07T12:25:25.931 INFO:tasks.workunit.client.1.smithi138.stdout:2/135: dwrite d3/dd/d19/ff [0,4194304] 0 2024-02-07T12:25:25.931 INFO:tasks.workunit.client.1.smithi138.stdout:2/136: chown d3/dd/d19/f35 15961999 1 2024-02-07T12:25:25.931 INFO:tasks.workunit.client.1.smithi138.stdout:2/137: readlink d3/dd/d19/l7 0 2024-02-07T12:25:25.931 INFO:tasks.workunit.client.1.smithi138.stdout:2/138: stat d3/d9/d29 0 2024-02-07T12:25:25.931 INFO:tasks.workunit.client.1.smithi138.stdout:2/139: truncate d3/dd/d19/d1f/f34 950953 0 2024-02-07T12:25:25.933 INFO:tasks.workunit.client.1.smithi138.stdout:9/140: rmdir d0/d6/d8/d1d 39 2024-02-07T12:25:25.941 INFO:tasks.workunit.client.1.smithi138.stdout:0/56: mknod d4/d9/c13 0 2024-02-07T12:25:25.942 INFO:tasks.workunit.client.1.smithi138.stdout:0/57: rename d4 to d4/d14 22 2024-02-07T12:25:25.943 INFO:tasks.workunit.client.1.smithi138.stdout:7/116: rmdir d0 39 2024-02-07T12:25:25.947 INFO:tasks.workunit.client.1.smithi138.stdout:3/214: creat d5/d27/f49 x:0 0 0 2024-02-07T12:25:25.948 INFO:tasks.workunit.client.1.smithi138.stdout:3/215: creat d5/d26/d28/f4a x:0 0 0 2024-02-07T12:25:25.948 INFO:tasks.workunit.client.1.smithi138.stdout:5/83: dwrite da/fb [0,4194304] 0 2024-02-07T12:25:25.948 INFO:tasks.workunit.client.1.smithi138.stdout:5/84: read - da/f19 zero size 2024-02-07T12:25:25.948 INFO:tasks.workunit.client.1.smithi138.stdout:5/85: creat da/f1f x:0 0 0 2024-02-07T12:25:25.948 INFO:tasks.workunit.client.1.smithi138.stdout:8/181: dwrite d1/de/d11/f18 [4194304,4194304] 0 2024-02-07T12:25:25.948 INFO:tasks.workunit.client.1.smithi138.stdout:8/182: fsync d1/de/d11/f1e 0 2024-02-07T12:25:25.957 INFO:tasks.workunit.client.1.smithi138.stdout:9/141: link d0/d6/d8/d1d/dd/f18 d0/f2c 0 2024-02-07T12:25:25.959 INFO:tasks.workunit.client.1.smithi138.stdout:0/58: rmdir d4/d9/db 39 2024-02-07T12:25:25.960 INFO:tasks.workunit.client.1.smithi138.stdout:7/117: truncate d0/d8/d11/f1b 1026237 0 2024-02-07T12:25:25.964 INFO:tasks.workunit.client.1.smithi138.stdout:9/142: dread d0/f2c [0,4194304] 0 2024-02-07T12:25:25.965 INFO:tasks.workunit.client.1.smithi138.stdout:5/86: rename da/f1c to da/df/f20 0 2024-02-07T12:25:25.965 INFO:tasks.workunit.client.1.smithi138.stdout:5/87: truncate da/f1f 511514 0 2024-02-07T12:25:25.966 INFO:tasks.workunit.client.1.smithi138.stdout:5/88: chown c5 90 1 2024-02-07T12:25:25.966 INFO:tasks.workunit.client.1.smithi138.stdout:5/89: chown f8 22249284 1 2024-02-07T12:25:25.967 INFO:tasks.workunit.client.1.smithi138.stdout:1/63: rmdir d5/d8/da 39 2024-02-07T12:25:25.967 INFO:tasks.workunit.client.1.smithi138.stdout:6/98: truncate dc/d13/f14 400905 0 2024-02-07T12:25:25.968 INFO:tasks.workunit.client.1.smithi138.stdout:3/216: dwrite d5/d27/f3d [0,4194304] 0 2024-02-07T12:25:25.968 INFO:tasks.workunit.client.1.smithi138.stdout:3/217: creat d5/d26/d28/f4b x:0 0 0 2024-02-07T12:25:25.969 INFO:tasks.workunit.client.1.smithi138.stdout:8/183: mkdir d1/de/d11/d17/d2e/d3a 0 2024-02-07T12:25:25.969 INFO:tasks.workunit.client.1.smithi138.stdout:8/184: dread - d1/de/d11/d17/f20 zero size 2024-02-07T12:25:25.970 INFO:tasks.workunit.client.1.smithi138.stdout:0/59: truncate d4/d9/fa 3761341 0 2024-02-07T12:25:25.972 INFO:tasks.workunit.client.1.smithi138.stdout:7/118: creat d0/d6/d19/f29 x:0 0 0 2024-02-07T12:25:25.974 INFO:tasks.workunit.client.1.smithi138.stdout:9/143: creat d0/d6/d8/d1d/dd/d25/f2d x:0 0 0 2024-02-07T12:25:25.975 INFO:tasks.workunit.client.1.smithi138.stdout:5/90: mknod da/c21 0 2024-02-07T12:25:25.980 INFO:tasks.workunit.client.1.smithi138.stdout:0/60: rename d4/fc to d4/d9/db/f15 0 2024-02-07T12:25:25.983 INFO:tasks.workunit.client.1.smithi138.stdout:9/144: symlink d0/d6/d8/d1d/dd/l2e 0 2024-02-07T12:25:25.983 INFO:tasks.workunit.client.1.smithi138.stdout:9/145: truncate d0/d6/d8/d1d/dd/f18 4540502 0 2024-02-07T12:25:25.986 INFO:tasks.workunit.client.1.smithi138.stdout:6/99: getdents dc 0 2024-02-07T12:25:25.989 INFO:tasks.workunit.client.1.smithi138.stdout:9/146: mknod d0/d6/d8/c2f 0 2024-02-07T12:25:25.989 INFO:tasks.workunit.client.1.smithi138.stdout:9/147: stat d0/d6/c17 0 2024-02-07T12:25:25.991 INFO:tasks.workunit.client.1.smithi138.stdout:6/100: getdents dc/d13 0 2024-02-07T12:25:25.991 INFO:tasks.workunit.client.1.smithi138.stdout:6/101: chown dc/d13/f1b 622607967 1 2024-02-07T12:25:25.991 INFO:tasks.workunit.client.1.smithi138.stdout:6/102: chown f1 91 1 2024-02-07T12:25:25.991 INFO:tasks.workunit.client.1.smithi138.stdout:6/103: write dc/d13/f14 [1216008,25791] 0 2024-02-07T12:25:25.991 INFO:tasks.workunit.client.1.smithi138.stdout:6/104: dread - dc/d13/f1a zero size 2024-02-07T12:25:25.992 INFO:tasks.workunit.client.1.smithi138.stdout:6/105: readlink dc/l1c 0 2024-02-07T12:25:25.994 INFO:tasks.workunit.client.1.smithi138.stdout:6/106: creat dc/d13/f1d x:0 0 0 2024-02-07T12:25:25.994 INFO:tasks.workunit.client.1.smithi138.stdout:6/107: fdatasync f6 0 2024-02-07T12:25:25.994 INFO:tasks.workunit.client.1.smithi138.stdout:9/148: rmdir d0/d6/d8/d1d/dd/d25 39 2024-02-07T12:25:25.997 INFO:tasks.workunit.client.1.smithi138.stdout:9/149: symlink d0/d6/d8/d1d/dd/l30 0 2024-02-07T12:25:25.997 INFO:tasks.workunit.client.1.smithi138.stdout:9/150: creat d0/d6/d8/d1d/dd/f31 x:0 0 0 2024-02-07T12:25:25.999 INFO:tasks.workunit.client.1.smithi138.stdout:8/185: dwrite f0 [0,4194304] 0 2024-02-07T12:25:26.000 INFO:tasks.workunit.client.1.smithi138.stdout:8/186: dread d1/f22 [0,4194304] 0 2024-02-07T12:25:26.001 INFO:tasks.workunit.client.1.smithi138.stdout:8/187: readlink d1/de/d11/d17/d2e/l32 0 2024-02-07T12:25:26.002 INFO:tasks.workunit.client.1.smithi138.stdout:8/188: mknod d1/de/d11/c3b 0 2024-02-07T12:25:26.004 INFO:tasks.workunit.client.1.smithi138.stdout:0/61: dwrite f2 [0,4194304] 0 2024-02-07T12:25:26.004 INFO:tasks.workunit.client.1.smithi138.stdout:0/62: readlink d4/l7 0 2024-02-07T12:25:26.004 INFO:tasks.workunit.client.1.smithi138.stdout:0/63: stat d4/d9/fa 0 2024-02-07T12:25:26.004 INFO:tasks.workunit.client.1.smithi138.stdout:0/64: getdents d4/d9/de 0 2024-02-07T12:25:26.004 INFO:tasks.workunit.client.1.smithi138.stdout:0/65: fsync d4/d9/fa 0 2024-02-07T12:25:26.004 INFO:tasks.workunit.client.1.smithi138.stdout:7/119: dwrite d0/d6/f16 [0,4194304] 0 2024-02-07T12:25:26.005 INFO:tasks.workunit.client.1.smithi138.stdout:6/108: write f1 [2940808,24455] 0 2024-02-07T12:25:26.005 INFO:tasks.workunit.client.1.smithi138.stdout:3/218: dwrite d5/f2f [0,4194304] 0 2024-02-07T12:25:26.005 INFO:tasks.workunit.client.1.smithi138.stdout:8/189: symlink d1/de/d11/d17/d2e/d3a/l3c 0 2024-02-07T12:25:26.007 INFO:tasks.workunit.client.1.smithi138.stdout:5/91: dwrite da/df/f10 [0,4194304] 0 2024-02-07T12:25:26.008 INFO:tasks.workunit.client.1.smithi138.stdout:5/92: write da/f19 [1007838,121328] 0 2024-02-07T12:25:26.008 INFO:tasks.workunit.client.1.smithi138.stdout:5/93: chown da/l18 4398712 1 2024-02-07T12:25:26.008 INFO:tasks.workunit.client.1.smithi138.stdout:0/66: link d4/f6 d4/f16 0 2024-02-07T12:25:26.010 INFO:tasks.workunit.client.1.smithi138.stdout:6/109: stat l5 0 2024-02-07T12:25:26.010 INFO:tasks.workunit.client.1.smithi138.stdout:6/110: write dc/d13/f1d [850186,8840] 0 2024-02-07T12:25:26.010 INFO:tasks.workunit.client.1.smithi138.stdout:6/111: stat dc/d13/f19 0 2024-02-07T12:25:26.011 INFO:tasks.workunit.client.1.smithi138.stdout:3/219: mknod d5/d26/d28/c4c 0 2024-02-07T12:25:26.012 INFO:tasks.workunit.client.1.smithi138.stdout:8/190: creat d1/d6/f3d x:0 0 0 2024-02-07T12:25:26.012 INFO:tasks.workunit.client.1.smithi138.stdout:8/191: chown d1/de/d11/f1a 63194923 1 2024-02-07T12:25:26.013 INFO:tasks.workunit.client.1.smithi138.stdout:5/94: mkdir da/d22 0 2024-02-07T12:25:26.013 INFO:tasks.workunit.client.1.smithi138.stdout:0/67: symlink d4/d9/de/l17 0 2024-02-07T12:25:26.016 INFO:tasks.workunit.client.1.smithi138.stdout:6/112: mkdir dc/d13/d1e 0 2024-02-07T12:25:26.016 INFO:tasks.workunit.client.1.smithi138.stdout:6/113: fsync fb 0 2024-02-07T12:25:26.016 INFO:tasks.workunit.client.1.smithi138.stdout:6/114: dread - dc/d13/f1a zero size 2024-02-07T12:25:26.016 INFO:tasks.workunit.client.1.smithi138.stdout:6/115: read - dc/d13/f1a zero size 2024-02-07T12:25:26.016 INFO:tasks.workunit.client.1.smithi138.stdout:6/116: readlink l5 0 2024-02-07T12:25:26.016 INFO:tasks.workunit.client.1.smithi138.stdout:6/117: getdents dc 0 2024-02-07T12:25:26.017 INFO:tasks.workunit.client.1.smithi138.stdout:5/95: symlink da/l23 0 2024-02-07T12:25:26.017 INFO:tasks.workunit.client.1.smithi138.stdout:5/96: fdatasync da/f1d 0 2024-02-07T12:25:26.018 INFO:tasks.workunit.client.1.smithi138.stdout:5/97: creat da/f24 x:0 0 0 2024-02-07T12:25:26.018 INFO:tasks.workunit.client.1.smithi138.stdout:0/68: getdents d4/d9/db 0 2024-02-07T12:25:26.018 INFO:tasks.workunit.client.1.smithi138.stdout:0/69: write d4/d9/db/f15 [1336772,10775] 0 2024-02-07T12:25:26.023 INFO:tasks.workunit.client.1.smithi138.stdout:5/98: truncate da/fc 5009540 0 2024-02-07T12:25:26.023 INFO:tasks.workunit.client.1.smithi138.stdout:5/99: readlink l6 0 2024-02-07T12:25:26.023 INFO:tasks.workunit.client.1.smithi138.stdout:5/100: truncate da/df/f10 4241691 0 2024-02-07T12:25:26.023 INFO:tasks.workunit.client.1.smithi138.stdout:6/118: dread dc/d13/f1d [0,4194304] 0 2024-02-07T12:25:26.023 INFO:tasks.workunit.client.1.smithi138.stdout:6/119: chown ca 42360232 1 2024-02-07T12:25:26.023 INFO:tasks.workunit.client.1.smithi138.stdout:6/120: write f6 [4983965,91740] 0 2024-02-07T12:25:26.023 INFO:tasks.workunit.client.1.smithi138.stdout:6/121: chown dc/d13/f1b 310216930 1 2024-02-07T12:25:26.023 INFO:tasks.workunit.client.1.smithi138.stdout:6/122: truncate dc/d13/f1d 1307225 0 2024-02-07T12:25:26.024 INFO:tasks.workunit.client.1.smithi138.stdout:5/101: rmdir da/df 39 2024-02-07T12:25:26.026 INFO:tasks.workunit.client.1.smithi138.stdout:0/70: dread d4/d9/db/f15 [0,4194304] 0 2024-02-07T12:25:26.026 INFO:tasks.workunit.client.1.smithi138.stdout:7/120: dwrite d0/d8/d15/f1e [0,4194304] 0 2024-02-07T12:25:26.029 INFO:tasks.workunit.client.1.smithi138.stdout:0/71: link d4/f6 d4/d9/f18 0 2024-02-07T12:25:26.029 INFO:tasks.workunit.client.1.smithi138.stdout:0/72: stat c0 0 2024-02-07T12:25:26.031 INFO:tasks.workunit.client.1.smithi138.stdout:8/192: dwrite d1/de/d11/f30 [0,4194304] 0 2024-02-07T12:25:26.031 INFO:tasks.workunit.client.1.smithi138.stdout:8/193: truncate d1/de/d11/d17/f20 245228 0 2024-02-07T12:25:26.031 INFO:tasks.workunit.client.1.smithi138.stdout:7/121: rmdir d0/d22 0 2024-02-07T12:25:26.032 INFO:tasks.workunit.client.1.smithi138.stdout:6/123: truncate dc/d13/f14 1174901 0 2024-02-07T12:25:26.037 INFO:tasks.workunit.client.1.smithi138.stdout:8/194: mkdir d1/de/d11/d17/d3e 0 2024-02-07T12:25:26.037 INFO:tasks.workunit.client.1.smithi138.stdout:8/195: chown d1/de/d11/f1e 156 1 2024-02-07T12:25:26.039 INFO:tasks.workunit.client.1.smithi138.stdout:7/122: unlink d0/d8/d15/lc 0 2024-02-07T12:25:26.044 INFO:tasks.workunit.client.1.smithi138.stdout:8/196: rename d1/de/d11/f27 to d1/f3f 0 2024-02-07T12:25:26.045 INFO:tasks.workunit.client.1.smithi138.stdout:8/197: dread d1/de/d11/d17/f25 [0,4194304] 0 2024-02-07T12:25:26.045 INFO:tasks.workunit.client.1.smithi138.stdout:7/123: rmdir d0/d6 39 2024-02-07T12:25:26.045 INFO:tasks.workunit.client.1.smithi138.stdout:7/124: dread - d0/d6/f12 zero size 2024-02-07T12:25:26.050 INFO:tasks.workunit.client.1.smithi138.stdout:8/198: creat d1/de/d11/d17/d2e/d3a/f40 x:0 0 0 2024-02-07T12:25:26.050 INFO:tasks.workunit.client.1.smithi138.stdout:8/199: creat d1/de/d11/d17/d2e/d3a/f41 x:0 0 0 2024-02-07T12:25:26.056 INFO:tasks.workunit.client.1.smithi138.stdout:5/102: truncate da/f1f 316537 0 2024-02-07T12:25:26.059 INFO:tasks.workunit.client.1.smithi138.stdout:0/73: getdents d4/d9 0 2024-02-07T12:25:26.060 INFO:tasks.workunit.client.1.smithi138.stdout:0/74: unlink c0 0 2024-02-07T12:25:26.060 INFO:tasks.workunit.client.1.smithi138.stdout:0/75: write d4/f16 [4321176,43758] 0 2024-02-07T12:25:26.063 INFO:tasks.workunit.client.1.smithi138.stdout:7/125: dwrite d0/d6/f16 [0,4194304] 0 2024-02-07T12:25:26.064 INFO:tasks.workunit.client.1.smithi138.stdout:6/124: rmdir dc/d13 39 2024-02-07T12:25:26.075 INFO:tasks.workunit.client.1.smithi138.stdout:8/200: dwrite d1/de/d11/f30 [0,4194304] 0 2024-02-07T12:25:26.075 INFO:tasks.workunit.client.1.smithi138.stdout:8/201: read - d1/f26 zero size 2024-02-07T12:25:26.078 INFO:tasks.workunit.client.1.smithi138.stdout:8/202: symlink d1/d6/l42 0 2024-02-07T12:25:26.078 INFO:tasks.workunit.client.1.smithi138.stdout:5/103: dwrite da/fc [0,4194304] 0 2024-02-07T12:25:26.079 INFO:tasks.workunit.client.1.smithi138.stdout:5/104: truncate da/fc 5303481 0 2024-02-07T12:25:26.080 INFO:tasks.workunit.client.1.smithi138.stdout:5/105: mkdir da/d22/d25 0 2024-02-07T12:25:26.081 INFO:tasks.workunit.client.1.smithi138.stdout:5/106: stat c5 0 2024-02-07T12:25:26.082 INFO:tasks.workunit.client.1.smithi138.stdout:5/107: rmdir da/d22 39 2024-02-07T12:25:26.083 INFO:tasks.workunit.client.1.smithi138.stdout:8/203: getdents d1/d6 0 2024-02-07T12:25:26.083 INFO:tasks.workunit.client.1.smithi138.stdout:8/204: chown d1/d6/l2c 150287 1 2024-02-07T12:25:26.084 INFO:tasks.workunit.client.1.smithi138.stdout:8/205: truncate d1/de/d11/d17/f2d 1584064 0 2024-02-07T12:25:26.084 INFO:tasks.workunit.client.1.smithi138.stdout:8/206: fdatasync d1/f15 0 2024-02-07T12:25:26.085 INFO:tasks.workunit.client.1.smithi138.stdout:5/108: write da/df/f13 [5116836,48974] 0 2024-02-07T12:25:26.086 INFO:tasks.workunit.client.1.smithi138.stdout:8/207: creat d1/de/d11/f43 x:0 0 0 2024-02-07T12:25:26.086 INFO:tasks.workunit.client.1.smithi138.stdout:8/208: dread - d1/de/d11/f43 zero size 2024-02-07T12:25:26.086 INFO:tasks.workunit.client.1.smithi138.stdout:8/209: write d1/d6/f39 [467881,23998] 0 2024-02-07T12:25:26.087 INFO:tasks.workunit.client.1.smithi138.stdout:5/109: creat da/d22/f26 x:0 0 0 2024-02-07T12:25:26.093 INFO:tasks.workunit.client.1.smithi138.stdout:7/126: dwrite d0/d8/d15/ff [0,4194304] 0 2024-02-07T12:25:26.093 INFO:tasks.workunit.client.1.smithi138.stdout:0/76: dwrite d4/f6 [0,4194304] 0 2024-02-07T12:25:26.093 INFO:tasks.workunit.client.1.smithi138.stdout:0/77: readlink d4/d9/de/l17 0 2024-02-07T12:25:26.093 INFO:tasks.workunit.client.1.smithi138.stdout:6/125: dwrite f6 [0,4194304] 0 2024-02-07T12:25:26.095 INFO:tasks.workunit.client.1.smithi138.stdout:8/210: write d1/f13 [2130414,6790] 0 2024-02-07T12:25:26.095 INFO:tasks.workunit.client.1.smithi138.stdout:8/211: write d1/de/d11/d17/f2d [1293847,630] 0 2024-02-07T12:25:26.096 INFO:tasks.workunit.client.1.smithi138.stdout:8/212: write d1/de/d11/f36 [1170618,112770] 0 2024-02-07T12:25:26.096 INFO:tasks.workunit.client.1.smithi138.stdout:7/127: mkdir d0/d6/d2a 0 2024-02-07T12:25:26.096 INFO:tasks.workunit.client.1.smithi138.stdout:7/128: fsync d0/d6/d1d/f20 0 2024-02-07T12:25:26.097 INFO:tasks.workunit.client.1.smithi138.stdout:6/126: creat dc/f1f x:0 0 0 2024-02-07T12:25:26.097 INFO:tasks.workunit.client.1.smithi138.stdout:6/127: stat dc/d13/f14 0 2024-02-07T12:25:26.097 INFO:tasks.workunit.client.1.smithi138.stdout:5/110: write da/f15 [2249883,87393] 0 2024-02-07T12:25:26.099 INFO:tasks.workunit.client.1.smithi138.stdout:8/213: creat d1/f44 x:0 0 0 2024-02-07T12:25:26.099 INFO:tasks.workunit.client.1.smithi138.stdout:8/214: readlink d1/lc 0 2024-02-07T12:25:26.099 INFO:tasks.workunit.client.1.smithi138.stdout:6/128: dread dc/d13/f1d [0,4194304] 0 2024-02-07T12:25:26.099 INFO:tasks.workunit.client.1.smithi138.stdout:6/129: chown dc/d13/f1a 442391 1 2024-02-07T12:25:26.099 INFO:tasks.workunit.client.1.smithi138.stdout:6/130: write dc/d13/f19 [2576007,24573] 0 2024-02-07T12:25:26.100 INFO:tasks.workunit.client.1.smithi138.stdout:7/129: unlink d0/d8/d11/f1b 0 2024-02-07T12:25:26.102 INFO:tasks.workunit.client.1.smithi138.stdout:5/111: mkdir da/df/d27 0 2024-02-07T12:25:26.104 INFO:tasks.workunit.client.1.smithi138.stdout:7/130: symlink d0/d8/d11/d1a/l2b 0 2024-02-07T12:25:26.104 INFO:tasks.workunit.client.1.smithi138.stdout:7/131: truncate d0/d6/d1d/f20 1027258 0 2024-02-07T12:25:26.106 INFO:tasks.workunit.client.1.smithi138.stdout:7/132: rename d0/d6/f16 to d0/d6/d1d/d24/f2c 0 2024-02-07T12:25:26.111 INFO:tasks.workunit.client.1.smithi138.stdout:6/131: rmdir dc 39 2024-02-07T12:25:26.113 INFO:tasks.workunit.client.1.smithi138.stdout:6/132: symlink dc/d13/l20 0 2024-02-07T12:25:26.113 INFO:tasks.workunit.client.1.smithi138.stdout:6/133: write dc/d13/f1d [2080390,54618] 0 2024-02-07T12:25:26.115 INFO:tasks.workunit.client.1.smithi138.stdout:6/134: mknod dc/d13/d1e/c21 0 2024-02-07T12:25:26.115 INFO:tasks.workunit.client.1.smithi138.stdout:6/135: truncate dc/d13/f19 5613732 0 2024-02-07T12:25:26.116 INFO:tasks.workunit.client.1.smithi138.stdout:6/136: creat dc/d13/d1e/f22 x:0 0 0 2024-02-07T12:25:26.121 INFO:tasks.workunit.client.1.smithi138.stdout:5/112: dwrite da/df/f13 [0,4194304] 0 2024-02-07T12:25:26.122 INFO:tasks.workunit.client.1.smithi138.stdout:5/113: creat da/df/d27/f28 x:0 0 0 2024-02-07T12:25:26.124 INFO:tasks.workunit.client.1.smithi138.stdout:5/114: link f8 da/f29 0 2024-02-07T12:25:26.124 INFO:tasks.workunit.client.1.smithi138.stdout:5/115: mknod da/c2a 0 2024-02-07T12:25:26.124 INFO:tasks.workunit.client.1.smithi138.stdout:5/116: fdatasync da/fc 0 2024-02-07T12:25:26.127 INFO:tasks.workunit.client.1.smithi138.stdout:7/133: dwrite d0/d8/d15/ff [0,4194304] 0 2024-02-07T12:25:26.127 INFO:tasks.workunit.client.1.smithi138.stdout:7/134: chown d0/d6/d1d/f20 7 1 2024-02-07T12:25:26.127 INFO:tasks.workunit.client.1.smithi138.stdout:8/215: dwrite d1/de/d11/f36 [0,4194304] 0 2024-02-07T12:25:26.128 INFO:tasks.workunit.client.1.smithi138.stdout:7/135: read d0/d8/d15/f18 [45035,57639] 0 2024-02-07T12:25:26.129 INFO:tasks.workunit.client.1.smithi138.stdout:7/136: chown d0/d8/d15/f1e 54063 1 2024-02-07T12:25:26.133 INFO:tasks.workunit.client.1.smithi138.stdout:5/117: truncate da/df/f13 2907233 0 2024-02-07T12:25:26.135 INFO:tasks.workunit.client.1.smithi138.stdout:7/137: creat d0/d8/d11/f2d x:0 0 0 2024-02-07T12:25:26.137 INFO:tasks.workunit.client.1.smithi138.stdout:7/138: mknod d0/d8/d11/c2e 0 2024-02-07T12:25:26.137 INFO:tasks.workunit.client.1.smithi138.stdout:7/139: readlink d0/d8/d11/l1c 0 2024-02-07T12:25:26.140 INFO:tasks.workunit.client.1.smithi138.stdout:7/140: symlink d0/d8/d11/d1f/l2f 0 2024-02-07T12:25:26.140 INFO:tasks.workunit.client.1.smithi138.stdout:7/141: readlink d0/d8/d11/l1c 0 2024-02-07T12:25:26.141 INFO:tasks.workunit.client.1.smithi138.stdout:8/216: dwrite d1/d6/f8 [0,4194304] 0 2024-02-07T12:25:26.141 INFO:tasks.workunit.client.1.smithi138.stdout:8/217: readlink d1/de/d11/d17/d2e/l32 0 2024-02-07T12:25:26.142 INFO:tasks.workunit.client.1.smithi138.stdout:8/218: read d1/f22 [312162,60385] 0 2024-02-07T12:25:26.142 INFO:tasks.workunit.client.1.smithi138.stdout:8/219: chown d1/de/d11/c16 16012004 1 2024-02-07T12:25:26.143 INFO:tasks.workunit.client.1.smithi138.stdout:7/142: link d0/f1 d0/d8/f30 0 2024-02-07T12:25:26.143 INFO:tasks.workunit.client.1.smithi138.stdout:8/220: dread d1/f22 [0,4194304] 0 2024-02-07T12:25:26.145 INFO:tasks.workunit.client.1.smithi138.stdout:7/143: mknod d0/d6/d19/c31 0 2024-02-07T12:25:26.145 INFO:tasks.workunit.client.1.smithi138.stdout:7/144: write d0/d8/f25 [1102766,38832] 0 2024-02-07T12:25:26.146 INFO:tasks.workunit.client.1.smithi138.stdout:8/221: symlink d1/de/d11/l45 0 2024-02-07T12:25:26.146 INFO:tasks.workunit.client.1.smithi138.stdout:8/222: fsync d1/de/d11/f43 0 2024-02-07T12:25:26.148 INFO:tasks.workunit.client.1.smithi138.stdout:7/145: mknod d0/d8/d15/c32 0 2024-02-07T12:25:26.158 INFO:tasks.workunit.client.1.smithi138.stdout:5/118: dwrite da/df/d27/f28 [0,4194304] 0 2024-02-07T12:25:26.158 INFO:tasks.workunit.client.1.smithi138.stdout:5/119: fdatasync da/f29 0 2024-02-07T12:25:26.159 INFO:tasks.workunit.client.1.smithi138.stdout:8/223: write f0 [2317127,119439] 0 2024-02-07T12:25:26.159 INFO:tasks.workunit.client.1.smithi138.stdout:8/224: chown d1/d6/c12 395143517 1 2024-02-07T12:25:26.159 INFO:tasks.workunit.client.1.smithi138.stdout:5/120: mkdir da/d22/d25/d2b 0 2024-02-07T12:25:26.160 INFO:tasks.workunit.client.1.smithi138.stdout:8/225: mknod d1/de/d11/d17/d3e/c46 0 2024-02-07T12:25:26.160 INFO:tasks.workunit.client.1.smithi138.stdout:8/226: creat d1/f47 x:0 0 0 2024-02-07T12:25:26.161 INFO:tasks.workunit.client.1.smithi138.stdout:5/121: creat da/d22/d25/f2c x:0 0 0 2024-02-07T12:25:26.162 INFO:tasks.workunit.client.1.smithi138.stdout:5/122: chown l7 1660143 1 2024-02-07T12:25:26.167 INFO:tasks.workunit.client.1.smithi138.stdout:7/146: dwrite d0/d8/d15/f1e [0,4194304] 0 2024-02-07T12:25:26.167 INFO:tasks.workunit.client.1.smithi138.stdout:7/147: write d0/d8/d15/f18 [1581343,36110] 0 2024-02-07T12:25:26.167 INFO:tasks.workunit.client.1.smithi138.stdout:7/148: chown d0 4024035 1 2024-02-07T12:25:26.169 INFO:tasks.workunit.client.1.smithi138.stdout:7/149: unlink d0/d8/d11/d1a/l2b 0 2024-02-07T12:25:26.169 INFO:tasks.workunit.client.1.smithi138.stdout:7/150: read - d0/f14 zero size 2024-02-07T12:25:26.170 INFO:tasks.workunit.client.1.smithi138.stdout:7/151: creat d0/d8/d11/d26/f33 x:0 0 0 2024-02-07T12:25:26.170 INFO:tasks.workunit.client.1.smithi138.stdout:7/152: truncate d0/d6/d1d/f20 2045268 0 2024-02-07T12:25:26.171 INFO:tasks.workunit.client.1.smithi138.stdout:7/153: symlink d0/d6/d1d/d24/l34 0 2024-02-07T12:25:26.173 INFO:tasks.workunit.client.1.smithi138.stdout:7/154: creat d0/d6/d1d/d24/f35 x:0 0 0 2024-02-07T12:25:26.190 INFO:tasks.workunit.client.1.smithi138.stdout:7/155: dwrite d0/d6/fa [0,4194304] 0 2024-02-07T12:25:26.190 INFO:tasks.workunit.client.1.smithi138.stdout:8/227: dwrite d1/de/d11/f1d [4194304,4194304] 0 2024-02-07T12:25:26.194 INFO:tasks.workunit.client.1.smithi138.stdout:7/156: unlink d0/d6/c13 0 2024-02-07T12:25:26.194 INFO:tasks.workunit.client.1.smithi138.stdout:7/157: dread - d0/d6/f12 zero size 2024-02-07T12:25:26.194 INFO:tasks.workunit.client.1.smithi138.stdout:7/158: chown d0/d8/d11/c2e 3618 1 2024-02-07T12:25:26.195 INFO:tasks.workunit.client.1.smithi138.stdout:8/228: symlink d1/de/d11/d17/d3e/l48 0 2024-02-07T12:25:26.197 INFO:tasks.workunit.client.1.smithi138.stdout:8/229: rename d1/d6 to d1/de/d11/d17/d2e/d49 0 2024-02-07T12:25:26.205 INFO:tasks.workunit.client.1.smithi138.stdout:8/230: write d1/de/d11/f1d [7310481,70473] 0 2024-02-07T12:25:26.214 INFO:tasks.workunit.client.1.smithi138.stdout:7/159: dwrite d0/d8/d15/f18 [0,4194304] 0 2024-02-07T12:25:26.214 INFO:tasks.workunit.client.1.smithi138.stdout:7/160: readlink d0/d6/d1d/d24/l34 0 2024-02-07T12:25:26.217 INFO:tasks.workunit.client.1.smithi138.stdout:8/231: dwrite d1/f26 [0,4194304] 0 2024-02-07T12:25:26.217 INFO:tasks.workunit.client.1.smithi138.stdout:8/232: chown d1/de/d11/f18 22426 1 2024-02-07T12:25:26.219 INFO:tasks.workunit.client.1.smithi138.stdout:8/233: symlink d1/de/d11/d17/l4a 0 2024-02-07T12:25:26.219 INFO:tasks.workunit.client.1.smithi138.stdout:8/234: truncate d1/de/d11/d17/d2e/d49/f19 1627405 0 2024-02-07T12:25:26.221 INFO:tasks.workunit.client.1.smithi138.stdout:7/161: rmdir d0/d8/d11/d1a 0 2024-02-07T12:25:26.223 INFO:tasks.workunit.client.1.smithi138.stdout:8/235: getdents d1/de/d11/d17/d2e/d3a 0 2024-02-07T12:25:26.231 INFO:tasks.workunit.client.1.smithi138.stdout:8/236: read d1/f26 [1840761,40999] 0 2024-02-07T12:25:26.234 INFO:tasks.workunit.client.1.smithi138.stdout:7/162: dwrite d0/d6/d19/f29 [0,4194304] 0 2024-02-07T12:25:26.237 INFO:tasks.workunit.client.1.smithi138.stdout:7/163: rename d0/d8/f30 to d0/d6/d1d/d24/f36 0 2024-02-07T12:25:26.240 INFO:tasks.workunit.client.1.smithi138.stdout:7/164: rmdir d0/d6/d2a 0 2024-02-07T12:25:26.240 INFO:tasks.workunit.client.1.smithi138.stdout:7/165: creat d0/d6/d1d/d24/f37 x:0 0 0 2024-02-07T12:25:26.248 INFO:tasks.workunit.client.1.smithi138.stdout:7/166: write d0/d8/d11/f28 [2917512,524] 0 2024-02-07T12:25:26.248 INFO:tasks.workunit.client.1.smithi138.stdout:7/167: fdatasync d0/d8/d15/f18 0 2024-02-07T12:25:26.253 INFO:tasks.workunit.client.1.smithi138.stdout:7/168: dread d0/d8/d15/ff [0,4194304] 0 2024-02-07T12:25:26.256 INFO:tasks.workunit.client.1.smithi138.stdout:7/169: fsync d0/f2 0 2024-02-07T12:25:26.257 INFO:tasks.workunit.client.1.smithi138.stdout:7/170: mkdir d0/d6/d1d/d38 0 2024-02-07T12:25:26.257 INFO:tasks.workunit.client.1.smithi138.stdout:7/171: chown d0/d8/d11/d26 3269989 1 2024-02-07T12:25:26.259 INFO:tasks.workunit.client.1.smithi138.stdout:7/172: mkdir d0/d39 0 2024-02-07T12:25:26.265 INFO:tasks.workunit.client.1.smithi138.stdout:7/173: write d0/d6/d19/f29 [522018,51058] 0 2024-02-07T12:25:26.265 INFO:tasks.workunit.client.1.smithi138.stdout:7/174: write d0/d8/d15/ff [4380881,33345] 0 2024-02-07T12:25:26.266 INFO:tasks.workunit.client.1.smithi138.stdout:7/175: write d0/d8/f25 [893036,40676] 0 2024-02-07T12:25:26.266 INFO:tasks.workunit.client.1.smithi138.stdout:7/176: write d0/d8/d11/f28 [343793,15403] 0 2024-02-07T12:25:26.267 INFO:tasks.workunit.client.1.smithi138.stdout:7/177: mknod d0/d6/d1d/c3a 0 2024-02-07T12:25:26.271 INFO:tasks.workunit.client.1.smithi138.stdout:7/178: rmdir d0/d6 39 2024-02-07T12:25:26.272 INFO:tasks.workunit.client.1.smithi138.stdout:7/179: mknod d0/d6/d1d/c3b 0 2024-02-07T12:25:26.272 INFO:tasks.workunit.client.1.smithi138.stdout:7/180: chown d0/d8/d11/d26/f33 398657673 1 2024-02-07T12:25:26.275 INFO:tasks.workunit.client.1.smithi138.stdout:7/181: write d0/d8/d15/ff [2320193,45085] 0 2024-02-07T12:25:26.275 INFO:tasks.workunit.client.1.smithi138.stdout:7/182: write d0/f1 [1901140,13841] 0 2024-02-07T12:25:26.283 INFO:tasks.workunit.client.1.smithi138.stdout:7/183: dread d0/d6/d1d/d24/f2c [0,4194304] 0 2024-02-07T12:25:26.283 INFO:tasks.workunit.client.1.smithi138.stdout:7/184: truncate d0/d8/d11/f28 4382941 0 2024-02-07T12:25:26.284 INFO:tasks.workunit.client.1.smithi138.stdout:7/185: creat d0/d6/d1d/d24/f3c x:0 0 0 2024-02-07T12:25:26.284 INFO:tasks.workunit.client.1.smithi138.stdout:7/186: stat d0/f14 0 2024-02-07T12:25:26.284 INFO:tasks.workunit.client.1.smithi138.stdout:7/187: chown d0/d6/d1d/d24/f2c 270055005 1 2024-02-07T12:25:26.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:26 smithi138 ceph-mon[35528]: pgmap v254: 65 pgs: 65 active+clean; 267 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 19 MiB/s wr, 466 op/s 2024-02-07T12:25:26.299 INFO:tasks.workunit.client.1.smithi138.stdout:7/188: dwrite d0/d8/d15/ff [0,4194304] 0 2024-02-07T12:25:26.299 INFO:tasks.workunit.client.1.smithi138.stdout:7/189: chown d0/d8/d11 71007577 1 2024-02-07T12:25:26.300 INFO:tasks.workunit.client.1.smithi138.stdout:7/190: fdatasync d0/d8/f25 0 2024-02-07T12:25:26.301 INFO:tasks.workunit.client.1.smithi138.stdout:7/191: symlink d0/l3d 0 2024-02-07T12:25:26.301 INFO:tasks.workunit.client.1.smithi138.stdout:7/192: write d0/d6/d1d/d24/f36 [426788,23454] 0 2024-02-07T12:25:26.302 INFO:tasks.workunit.client.1.smithi138.stdout:7/193: mkdir d0/d6/d3e 0 2024-02-07T12:25:26.302 INFO:tasks.workunit.client.1.smithi138.stdout:7/194: dread - d0/d8/d11/d26/f33 zero size 2024-02-07T12:25:26.302 INFO:tasks.workunit.client.1.smithi138.stdout:7/195: stat d0/d6/d1d 0 2024-02-07T12:25:26.304 INFO:tasks.workunit.client.1.smithi138.stdout:7/196: rename d0/d8/d11/f28 to d0/d6/d3e/f3f 0 2024-02-07T12:25:26.304 INFO:tasks.workunit.client.1.smithi138.stdout:7/197: dread - d0/d6/d1d/d24/f35 zero size 2024-02-07T12:25:26.305 INFO:tasks.workunit.client.1.smithi138.stdout:7/198: symlink d0/d6/d19/l40 0 2024-02-07T12:25:26.324 INFO:tasks.workunit.client.1.smithi138.stdout:7/199: dwrite d0/f14 [0,4194304] 0 2024-02-07T12:25:26.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:26 smithi047 ceph-mon[28972]: pgmap v254: 65 pgs: 65 active+clean; 267 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 19 MiB/s wr, 466 op/s 2024-02-07T12:25:26.336 INFO:tasks.workunit.client.1.smithi138.stdout:7/200: dwrite d0/d8/d15/f18 [0,4194304] 0 2024-02-07T12:25:26.336 INFO:tasks.workunit.client.1.smithi138.stdout:7/201: write d0/d6/d19/f29 [2601978,109332] 0 2024-02-07T12:25:26.336 INFO:tasks.workunit.client.1.smithi138.stdout:7/202: write d0/d6/d3e/f3f [1116316,116700] 0 2024-02-07T12:25:26.337 INFO:tasks.workunit.client.1.smithi138.stdout:7/203: rmdir d0/d6 39 2024-02-07T12:25:26.337 INFO:tasks.workunit.client.1.smithi138.stdout:7/204: chown d0/d8/f25 208543 1 2024-02-07T12:25:26.337 INFO:tasks.workunit.client.1.smithi138.stdout:7/205: write d0/d6/d1d/f20 [2568941,12450] 0 2024-02-07T12:25:26.339 INFO:tasks.workunit.client.1.smithi138.stdout:7/206: creat d0/d6/d1d/f41 x:0 0 0 2024-02-07T12:25:26.340 INFO:tasks.workunit.client.1.smithi138.stdout:7/207: creat d0/d8/d11/d1f/f42 x:0 0 0 2024-02-07T12:25:26.340 INFO:tasks.workunit.client.1.smithi138.stdout:7/208: fsync d0/d6/d1d/d24/f35 0 2024-02-07T12:25:26.341 INFO:tasks.workunit.client.1.smithi138.stdout:7/209: symlink d0/d8/l43 0 2024-02-07T12:25:26.357 INFO:tasks.workunit.client.1.smithi138.stdout:7/210: dwrite d0/f1 [0,4194304] 0 2024-02-07T12:25:26.359 INFO:tasks.workunit.client.1.smithi138.stdout:7/211: unlink d0/f1 0 2024-02-07T12:25:26.361 INFO:tasks.workunit.client.1.smithi138.stdout:7/212: creat d0/d6/d3e/f44 x:0 0 0 2024-02-07T12:25:26.361 INFO:tasks.workunit.client.1.smithi138.stdout:7/213: readlink d0/l3d 0 2024-02-07T12:25:26.378 INFO:tasks.workunit.client.1.smithi138.stdout:7/214: dwrite d0/d8/d15/f1e [0,4194304] 0 2024-02-07T12:25:26.378 INFO:tasks.workunit.client.1.smithi138.stdout:7/215: readlink d0/l3d 0 2024-02-07T12:25:26.381 INFO:tasks.workunit.client.1.smithi138.stdout:7/216: link d0/d8/d15/f1e d0/d8/d11/d1f/f45 0 2024-02-07T12:25:26.392 INFO:tasks.workunit.client.1.smithi138.stdout:7/217: write d0/f2 [545748,52772] 0 2024-02-07T12:25:26.399 INFO:tasks.workunit.client.1.smithi138.stdout:7/218: dread d0/d6/d1d/f20 [0,4194304] 0 2024-02-07T12:25:26.400 INFO:tasks.workunit.client.1.smithi138.stdout:7/219: creat d0/d39/f46 x:0 0 0 2024-02-07T12:25:26.402 INFO:tasks.workunit.client.1.smithi138.stdout:7/220: creat d0/d8/d15/f47 x:0 0 0 2024-02-07T12:25:26.408 INFO:tasks.workunit.client.1.smithi138.stdout:7/221: dread d0/d8/d15/ff [0,4194304] 0 2024-02-07T12:25:26.408 INFO:tasks.workunit.client.1.smithi138.stdout:7/222: creat d0/d6/d3e/f48 x:0 0 0 2024-02-07T12:25:26.408 INFO:tasks.workunit.client.1.smithi138.stdout:7/223: stat d0/d6/f12 0 2024-02-07T12:25:26.408 INFO:tasks.workunit.client.1.smithi138.stdout:7/224: write d0/d8/f25 [799628,52844] 0 2024-02-07T12:25:26.410 INFO:tasks.workunit.client.1.smithi138.stdout:7/225: rename d0/d6/d1d/d24/f3c to d0/d8/d11/d26/f49 0 2024-02-07T12:25:26.426 INFO:tasks.workunit.client.1.smithi138.stdout:7/226: dwrite d0/d39/f46 [0,4194304] 0 2024-02-07T12:25:26.435 INFO:tasks.workunit.client.1.smithi138.stdout:7/227: write d0/d39/f46 [2734969,93170] 0 2024-02-07T12:25:26.435 INFO:tasks.workunit.client.1.smithi138.stdout:7/228: write d0/d6/d3e/f3f [1604316,97444] 0 2024-02-07T12:25:26.435 INFO:tasks.workunit.client.1.smithi138.stdout:7/229: chown d0/d8 6 1 2024-02-07T12:25:26.436 INFO:tasks.workunit.client.1.smithi138.stdout:7/230: symlink d0/d6/d3e/l4a 0 2024-02-07T12:25:26.442 INFO:tasks.workunit.client.1.smithi138.stdout:7/231: dread d0/d6/d19/f29 [0,4194304] 0 2024-02-07T12:25:26.442 INFO:tasks.workunit.client.1.smithi138.stdout:7/232: chown d0/f14 386728 1 2024-02-07T12:25:26.443 INFO:tasks.workunit.client.1.smithi138.stdout:7/233: truncate d0/d6/fa 2201789 0 2024-02-07T12:25:26.451 INFO:tasks.workunit.client.1.smithi138.stdout:7/234: dread d0/d8/d15/f1e [0,4194304] 0 2024-02-07T12:25:26.452 INFO:tasks.workunit.client.1.smithi138.stdout:7/235: write d0/d8/d15/f1e [3460315,32593] 0 2024-02-07T12:25:26.453 INFO:tasks.workunit.client.1.smithi138.stdout:7/236: mknod d0/c4b 0 2024-02-07T12:25:26.459 INFO:tasks.workunit.client.1.smithi138.stdout:7/237: dread d0/d8/d11/d1f/f45 [0,4194304] 0 2024-02-07T12:25:26.549 INFO:tasks.workunit.client.1.smithi138.stdout:7/238: dwrite d0/d8/d15/f1e [0,4194304] 0 2024-02-07T12:25:26.550 INFO:tasks.workunit.client.1.smithi138.stdout:7/239: mknod d0/d8/d15/c4c 0 2024-02-07T12:25:26.561 INFO:tasks.workunit.client.1.smithi138.stdout:7/240: dwrite d0/d8/d15/f18 [0,4194304] 0 2024-02-07T12:25:26.562 INFO:tasks.workunit.client.1.smithi138.stdout:7/241: creat d0/d6/f4d x:0 0 0 2024-02-07T12:25:26.563 INFO:tasks.workunit.client.1.smithi138.stdout:7/242: chown d0/d6/d1d/f41 18620 1 2024-02-07T12:25:26.563 INFO:tasks.workunit.client.1.smithi138.stdout:7/243: write d0/d6/d1d/d24/f37 [475226,72774] 0 2024-02-07T12:25:26.564 INFO:tasks.workunit.client.1.smithi138.stdout:7/244: mkdir d0/d6/d19/d4e 0 2024-02-07T12:25:26.566 INFO:tasks.workunit.client.1.smithi138.stdout:7/245: link d0/d8/d15/f1e d0/d6/d1d/d24/f4f 0 2024-02-07T12:25:26.566 INFO:tasks.workunit.client.1.smithi138.stdout:7/246: read - d0/d6/d3e/f44 zero size 2024-02-07T12:25:26.566 INFO:tasks.workunit.client.1.smithi138.stdout:7/247: fsync d0/d6/d1d/f20 0 2024-02-07T12:25:26.566 INFO:tasks.workunit.client.1.smithi138.stdout:7/248: fdatasync d0/d8/d15/f47 0 2024-02-07T12:25:26.566 INFO:tasks.workunit.client.1.smithi138.stdout:7/249: chown d0/d39/f46 61 1 2024-02-07T12:25:26.577 INFO:tasks.workunit.client.1.smithi138.stdout:7/250: dread d0/d6/d3e/f3f [0,4194304] 0 2024-02-07T12:25:26.577 INFO:tasks.workunit.client.1.smithi138.stdout:7/251: fdatasync d0/d8/d11/f2d 0 2024-02-07T12:25:26.577 INFO:tasks.workunit.client.1.smithi138.stdout:7/252: chown d0/l3d 2 1 2024-02-07T12:25:26.577 INFO:tasks.workunit.client.1.smithi138.stdout:7/253: mknod d0/d39/c50 0 2024-02-07T12:25:26.578 INFO:tasks.workunit.client.1.smithi138.stdout:7/254: link d0/d8/d11/d1f/f42 d0/d6/d3e/f51 0 2024-02-07T12:25:26.579 INFO:tasks.workunit.client.1.smithi138.stdout:7/255: write d0/d6/d3e/f51 [771432,98339] 0 2024-02-07T12:25:26.579 INFO:tasks.workunit.client.1.smithi138.stdout:7/256: creat d0/d39/f52 x:0 0 0 2024-02-07T12:25:26.580 INFO:tasks.workunit.client.1.smithi138.stdout:7/257: mkdir d0/d8/d11/d1f/d53 0 2024-02-07T12:25:26.580 INFO:tasks.workunit.client.1.smithi138.stdout:7/258: mknod d0/d8/d11/c54 0 2024-02-07T12:25:26.581 INFO:tasks.workunit.client.1.smithi138.stdout:7/259: symlink d0/d8/l55 0 2024-02-07T12:25:26.588 INFO:tasks.workunit.client.1.smithi138.stdout:7/260: dread d0/d8/d11/d1f/f45 [0,4194304] 0 2024-02-07T12:25:26.588 INFO:tasks.workunit.client.1.smithi138.stdout:7/261: stat d0/d8/d15/c4c 0 2024-02-07T12:25:26.591 INFO:tasks.workunit.client.1.smithi138.stdout:7/262: dread d0/d6/d3e/f3f [0,4194304] 0 2024-02-07T12:25:26.592 INFO:tasks.workunit.client.1.smithi138.stdout:7/263: creat d0/d8/d11/d1f/f56 x:0 0 0 2024-02-07T12:25:26.593 INFO:tasks.workunit.client.1.smithi138.stdout:7/264: creat d0/d8/d11/d1f/d53/f57 x:0 0 0 2024-02-07T12:25:26.594 INFO:tasks.workunit.client.1.smithi138.stdout:7/265: getdents d0/d8/d11/d26 0 2024-02-07T12:25:26.595 INFO:tasks.workunit.client.1.smithi138.stdout:7/266: stat d0/d6/d1d/d24/f35 0 2024-02-07T12:25:26.595 INFO:tasks.workunit.client.1.smithi138.stdout:7/267: write d0/d6/d3e/f48 [265849,117288] 0 2024-02-07T12:25:26.597 INFO:tasks.workunit.client.1.smithi138.stdout:7/268: mknod d0/d6/d3e/c58 0 2024-02-07T12:25:26.597 INFO:tasks.workunit.client.1.smithi138.stdout:7/269: fdatasync d0/d8/d15/f47 0 2024-02-07T12:25:26.598 INFO:tasks.workunit.client.1.smithi138.stdout:7/270: mknod d0/d6/c59 0 2024-02-07T12:25:26.599 INFO:tasks.workunit.client.1.smithi138.stdout:7/271: dread - d0/d39/f52 zero size 2024-02-07T12:25:26.614 INFO:tasks.workunit.client.1.smithi138.stdout:7/272: dwrite d0/d6/d1d/d24/f2c [0,4194304] 0 2024-02-07T12:25:26.637 INFO:tasks.workunit.client.1.smithi138.stdout:7/273: dwrite d0/d6/d1d/d24/f36 [0,4194304] 0 2024-02-07T12:25:26.641 INFO:tasks.workunit.client.1.smithi138.stdout:7/274: truncate d0/d8/d15/f18 2992642 0 2024-02-07T12:25:26.641 INFO:tasks.workunit.client.1.smithi138.stdout:7/275: write d0/d6/d3e/f44 [263967,3965] 0 2024-02-07T12:25:26.642 INFO:tasks.workunit.client.1.smithi138.stdout:7/276: link d0/d6/d3e/f51 d0/d8/d11/f5a 0 2024-02-07T12:25:26.646 INFO:tasks.workunit.client.1.smithi138.stdout:7/277: dread d0/d8/d15/f1e [0,4194304] 0 2024-02-07T12:25:26.646 INFO:tasks.workunit.client.1.smithi138.stdout:7/278: fsync d0/d8/d15/f1e 0 2024-02-07T12:25:26.648 INFO:tasks.workunit.client.1.smithi138.stdout:7/279: mknod d0/d6/d1d/c5b 0 2024-02-07T12:25:26.649 INFO:tasks.workunit.client.1.smithi138.stdout:7/280: creat d0/d6/d1d/d38/f5c x:0 0 0 2024-02-07T12:25:26.649 INFO:tasks.workunit.client.1.smithi138.stdout:7/281: fsync d0/d8/d11/d26/f33 0 2024-02-07T12:25:26.649 INFO:tasks.workunit.client.1.smithi138.stdout:7/282: stat d0/d8/d11/d1f/l21 0 2024-02-07T12:25:26.650 INFO:tasks.workunit.client.1.smithi138.stdout:7/283: creat d0/d6/d19/f5d x:0 0 0 2024-02-07T12:25:26.651 INFO:tasks.workunit.client.1.smithi138.stdout:7/284: mkdir d0/d6/d3e/d5e 0 2024-02-07T12:25:26.652 INFO:tasks.workunit.client.1.smithi138.stdout:7/285: mkdir d0/d8/d11/d5f 0 2024-02-07T12:25:26.652 INFO:tasks.workunit.client.1.smithi138.stdout:7/286: write d0/d6/d1d/d24/f35 [1027804,35040] 0 2024-02-07T12:25:26.655 INFO:tasks.workunit.client.1.smithi138.stdout:7/287: rmdir d0/d6/d1d 39 2024-02-07T12:25:26.657 INFO:tasks.workunit.client.1.smithi138.stdout:7/288: mknod d0/d6/d1d/d24/c60 0 2024-02-07T12:25:26.658 INFO:tasks.workunit.client.1.smithi138.stdout:7/289: rmdir d0/d6/d3e/d5e 0 2024-02-07T12:25:26.660 INFO:tasks.workunit.client.1.smithi138.stdout:7/290: mkdir d0/d6/d19/d61 0 2024-02-07T12:25:26.660 INFO:tasks.workunit.client.1.smithi138.stdout:7/291: write d0/d6/d1d/d24/f35 [1190639,6593] 0 2024-02-07T12:25:26.660 INFO:tasks.workunit.client.1.smithi138.stdout:7/292: symlink d0/d6/d1d/l62 0 2024-02-07T12:25:26.663 INFO:tasks.workunit.client.1.smithi138.stdout:7/293: dread d0/d8/d15/f1e [0,4194304] 0 2024-02-07T12:25:26.663 INFO:tasks.workunit.client.1.smithi138.stdout:7/294: readlink d0/d8/d11/d1f/l21 0 2024-02-07T12:25:26.664 INFO:tasks.workunit.client.1.smithi138.stdout:7/295: mkdir d0/d8/d11/d63 0 2024-02-07T12:25:26.664 INFO:tasks.workunit.client.1.smithi138.stdout:7/296: dread - d0/d8/d11/d26/f49 zero size 2024-02-07T12:25:26.664 INFO:tasks.workunit.client.1.smithi138.stdout:7/297: mknod d0/d6/d1d/d38/c64 0 2024-02-07T12:25:26.665 INFO:tasks.workunit.client.1.smithi138.stdout:7/298: symlink d0/d8/d11/d26/l65 0 2024-02-07T12:25:26.665 INFO:tasks.workunit.client.1.smithi138.stdout:7/299: write d0/d6/d1d/d38/f5c [317371,11965] 0 2024-02-07T12:25:26.665 INFO:tasks.workunit.client.1.smithi138.stdout:7/300: chown d0/d8/d11/d1f/d53/f57 33654181 1 2024-02-07T12:25:26.677 INFO:tasks.workunit.client.1.smithi138.stdout:7/301: dwrite d0/d8/d11/d1f/d53/f57 [0,4194304] 0 2024-02-07T12:25:26.677 INFO:tasks.workunit.client.1.smithi138.stdout:7/302: chown d0/d6/fa 18 1 2024-02-07T12:25:26.680 INFO:tasks.workunit.client.1.smithi138.stdout:7/303: rename d0/d8/d11/d1f/l27 to d0/d6/d1d/d24/l66 0 2024-02-07T12:25:26.680 INFO:tasks.workunit.client.1.smithi138.stdout:7/304: truncate d0/d8/d15/f47 58861 0 2024-02-07T12:25:26.688 INFO:tasks.workunit.client.1.smithi138.stdout:7/305: write d0/f14 [3097339,102637] 0 2024-02-07T12:25:26.689 INFO:tasks.workunit.client.1.smithi138.stdout:7/306: dread d0/d8/d11/d1f/f45 [0,4194304] 0 2024-02-07T12:25:26.689 INFO:tasks.workunit.client.1.smithi138.stdout:7/307: write d0/d6/d3e/f51 [1410891,20146] 0 2024-02-07T12:25:27.444 INFO:tasks.workunit.client.1.smithi138.stdout:4/74: sync 2024-02-07T12:25:27.444 INFO:tasks.workunit.client.1.smithi138.stdout:2/140: sync 2024-02-07T12:25:27.445 INFO:tasks.workunit.client.1.smithi138.stdout:4/75: truncate f15 1210879 0 2024-02-07T12:25:27.445 INFO:tasks.workunit.client.1.smithi138.stdout:4/76: creat f16 x:0 0 0 2024-02-07T12:25:27.446 INFO:tasks.workunit.client.1.smithi138.stdout:2/141: symlink d3/dd/d14/l3a 0 2024-02-07T12:25:27.449 INFO:tasks.workunit.client.1.smithi138.stdout:4/77: rename l4 to l17 0 2024-02-07T12:25:27.449 INFO:tasks.workunit.client.1.smithi138.stdout:4/78: rmdir - no directory 2024-02-07T12:25:27.453 INFO:tasks.workunit.client.1.smithi138.stdout:2/142: dread f0 [0,4194304] 0 2024-02-07T12:25:27.455 INFO:tasks.workunit.client.1.smithi138.stdout:2/143: creat d3/dd/d19/d1f/d37/f3b x:0 0 0 2024-02-07T12:25:27.456 INFO:tasks.workunit.client.1.smithi138.stdout:2/144: symlink d3/l3c 0 2024-02-07T12:25:27.458 INFO:tasks.workunit.client.1.smithi138.stdout:2/145: mkdir d3/d9/d25/d3d 0 2024-02-07T12:25:27.458 INFO:tasks.workunit.client.1.smithi138.stdout:2/146: stat f0 0 2024-02-07T12:25:27.464 INFO:tasks.workunit.client.1.smithi138.stdout:4/79: dwrite fb [0,4194304] 0 2024-02-07T12:25:27.473 INFO:tasks.workunit.client.1.smithi138.stdout:4/80: dread f13 [0,4194304] 0 2024-02-07T12:25:27.474 INFO:tasks.workunit.client.1.smithi138.stdout:2/147: dwrite f0 [0,4194304] 0 2024-02-07T12:25:27.474 INFO:tasks.workunit.client.1.smithi138.stdout:4/81: symlink l18 0 2024-02-07T12:25:27.478 INFO:tasks.workunit.client.1.smithi138.stdout:2/148: truncate f0 1563589 0 2024-02-07T12:25:27.480 INFO:tasks.workunit.client.1.smithi138.stdout:2/149: getdents d3/dd/d19/d1f 0 2024-02-07T12:25:27.487 INFO:tasks.workunit.client.1.smithi138.stdout:2/150: dread d3/d9/f1b [0,4194304] 0 2024-02-07T12:25:27.488 INFO:tasks.workunit.client.1.smithi138.stdout:2/151: creat d3/d9/d25/d3d/f3e x:0 0 0 2024-02-07T12:25:27.488 INFO:tasks.workunit.client.1.smithi138.stdout:2/152: stat d3/l6 0 2024-02-07T12:25:27.488 INFO:tasks.workunit.client.1.smithi138.stdout:2/153: write d3/d9/f1b [5022413,53582] 0 2024-02-07T12:25:27.489 INFO:tasks.workunit.client.1.smithi138.stdout:2/154: unlink d3/dd/d19/ff 0 2024-02-07T12:25:27.489 INFO:tasks.workunit.client.1.smithi138.stdout:2/155: fsync d3/dd/d14/f26 0 2024-02-07T12:25:27.490 INFO:tasks.workunit.client.1.smithi138.stdout:2/156: rmdir d3/d9/d25 39 2024-02-07T12:25:27.502 INFO:tasks.workunit.client.1.smithi138.stdout:2/157: dwrite d3/dd/d19/f15 [0,4194304] 0 2024-02-07T12:25:27.503 INFO:tasks.workunit.client.1.smithi138.stdout:2/158: unlink d3/d9/c11 0 2024-02-07T12:25:27.511 INFO:tasks.workunit.client.1.smithi138.stdout:2/159: dread d3/d9/f1b [0,4194304] 0 2024-02-07T12:25:27.511 INFO:tasks.workunit.client.1.smithi138.stdout:2/160: dread - d3/dd/f2e zero size 2024-02-07T12:25:27.512 INFO:tasks.workunit.client.1.smithi138.stdout:2/161: mknod d3/dd/c3f 0 2024-02-07T12:25:27.512 INFO:tasks.workunit.client.1.smithi138.stdout:2/162: dread - d3/dd/d19/d1f/d37/f3b zero size 2024-02-07T12:25:27.512 INFO:tasks.workunit.client.1.smithi138.stdout:2/163: chown d3/l36 5305481 1 2024-02-07T12:25:27.512 INFO:tasks.workunit.client.1.smithi138.stdout:2/164: fsync d3/dd/d14/f22 0 2024-02-07T12:25:27.514 INFO:tasks.workunit.client.1.smithi138.stdout:2/165: mknod d3/dd/d19/d1f/c40 0 2024-02-07T12:25:27.562 INFO:tasks.workunit.client.1.smithi138.stdout:9/151: sync 2024-02-07T12:25:27.562 INFO:tasks.workunit.client.1.smithi138.stdout:3/220: sync 2024-02-07T12:25:27.562 INFO:tasks.workunit.client.1.smithi138.stdout:1/64: sync 2024-02-07T12:25:27.564 INFO:tasks.workunit.client.1.smithi138.stdout:3/221: rename d5/d26/f2e to d5/d26/d28/f4d 0 2024-02-07T12:25:27.565 INFO:tasks.workunit.client.1.smithi138.stdout:3/222: write d5/d15/d32/f43 [974096,83164] 0 2024-02-07T12:25:27.566 INFO:tasks.workunit.client.1.smithi138.stdout:1/65: mknod d5/d8/c10 0 2024-02-07T12:25:27.566 INFO:tasks.workunit.client.1.smithi138.stdout:3/223: stat d5/d15/l1f 0 2024-02-07T12:25:27.567 INFO:tasks.workunit.client.1.smithi138.stdout:9/152: getdents d0/d6/d8/d1d/dd 0 2024-02-07T12:25:27.569 INFO:tasks.workunit.client.1.smithi138.stdout:1/66: link f4 d5/d8/da/f11 0 2024-02-07T12:25:27.569 INFO:tasks.workunit.client.1.smithi138.stdout:1/67: chown d5/d8/c10 7848 1 2024-02-07T12:25:27.569 INFO:tasks.workunit.client.1.smithi138.stdout:1/68: stat f4 0 2024-02-07T12:25:27.569 INFO:tasks.workunit.client.1.smithi138.stdout:1/69: getdents d5 0 2024-02-07T12:25:27.569 INFO:tasks.workunit.client.1.smithi138.stdout:1/70: chown f3 0 1 2024-02-07T12:25:27.570 INFO:tasks.workunit.client.1.smithi138.stdout:1/71: readlink l2 0 2024-02-07T12:25:27.570 INFO:tasks.workunit.client.1.smithi138.stdout:1/72: write d5/d8/fd [5090624,87791] 0 2024-02-07T12:25:27.570 INFO:tasks.workunit.client.1.smithi138.stdout:2/166: dwrite d3/dd/d19/f15 [0,4194304] 0 2024-02-07T12:25:27.571 INFO:tasks.workunit.client.1.smithi138.stdout:9/153: rename d0/d6/d8/l22 to d0/d6/d8/l32 0 2024-02-07T12:25:27.574 INFO:tasks.workunit.client.1.smithi138.stdout:9/154: rename d0/d6/d8/d1d/dd/f2b to d0/f33 0 2024-02-07T12:25:27.578 INFO:tasks.workunit.client.1.smithi138.stdout:9/155: mkdir d0/d34 0 2024-02-07T12:25:27.578 INFO:tasks.workunit.client.1.smithi138.stdout:9/156: fsync d0/d6/d8/d1d/dd/d25/f2d 0 2024-02-07T12:25:27.579 INFO:tasks.workunit.client.1.smithi138.stdout:9/157: symlink d0/d6/d8/d1d/dd/d25/l35 0 2024-02-07T12:25:27.581 INFO:tasks.workunit.client.1.smithi138.stdout:2/167: dread d3/f12 [0,4194304] 0 2024-02-07T12:25:27.582 INFO:tasks.workunit.client.1.smithi138.stdout:2/168: creat d3/d9/f41 x:0 0 0 2024-02-07T12:25:27.584 INFO:tasks.workunit.client.1.smithi138.stdout:9/158: dread d0/f2c [0,4194304] 0 2024-02-07T12:25:27.586 INFO:tasks.workunit.client.1.smithi138.stdout:3/224: dwrite d5/d27/f49 [0,4194304] 0 2024-02-07T12:25:27.589 INFO:tasks.workunit.client.1.smithi138.stdout:3/225: mkdir d5/d26/d4e 0 2024-02-07T12:25:27.589 INFO:tasks.workunit.client.1.smithi138.stdout:3/226: write d5/d15/f48 [829017,12169] 0 2024-02-07T12:25:27.589 INFO:tasks.workunit.client.1.smithi138.stdout:3/227: chown d5/fd 772375641 1 2024-02-07T12:25:27.592 INFO:tasks.workunit.client.1.smithi138.stdout:9/159: getdents d0/d6/d8/d1d/dd/d25 0 2024-02-07T12:25:27.592 INFO:tasks.workunit.client.1.smithi138.stdout:9/160: dread - d0/d6/d8/d1d/dd/f31 zero size 2024-02-07T12:25:27.598 INFO:tasks.workunit.client.1.smithi138.stdout:3/228: dread d5/f2f [0,4194304] 0 2024-02-07T12:25:27.599 INFO:tasks.workunit.client.1.smithi138.stdout:3/229: chown d5/fd 25529 1 2024-02-07T12:25:27.599 INFO:tasks.workunit.client.1.smithi138.stdout:3/230: symlink d5/d26/d28/l4f 0 2024-02-07T12:25:27.600 INFO:tasks.workunit.client.1.smithi138.stdout:3/231: dread d5/f3a [0,4194304] 0 2024-02-07T12:25:27.602 INFO:tasks.workunit.client.1.smithi138.stdout:9/161: dread d0/d6/d8/d1d/f1c [0,4194304] 0 2024-02-07T12:25:27.602 INFO:tasks.workunit.client.1.smithi138.stdout:2/169: dwrite d3/d9/d25/d3d/f3e [0,4194304] 0 2024-02-07T12:25:27.605 INFO:tasks.workunit.client.1.smithi138.stdout:2/170: rmdir d3/dd/d19/d1f 39 2024-02-07T12:25:27.605 INFO:tasks.workunit.client.1.smithi138.stdout:2/171: dread - d3/dd/d14/f2c zero size 2024-02-07T12:25:27.605 INFO:tasks.workunit.client.1.smithi138.stdout:3/232: dread f1 [0,4194304] 0 2024-02-07T12:25:27.606 INFO:tasks.workunit.client.1.smithi138.stdout:9/162: rename d0/d6/c17 to d0/d6/d8/c36 0 2024-02-07T12:25:27.607 INFO:tasks.workunit.client.1.smithi138.stdout:2/172: write f1 [5264059,67584] 0 2024-02-07T12:25:27.607 INFO:tasks.workunit.client.1.smithi138.stdout:2/173: chown d3/dd/d14/f22 85 1 2024-02-07T12:25:27.609 INFO:tasks.workunit.client.1.smithi138.stdout:3/233: rmdir d5/d15/d32 39 2024-02-07T12:25:27.611 INFO:tasks.workunit.client.1.smithi138.stdout:9/163: rename d0/d6/d8/c36 to d0/d6/d8/d1d/c37 0 2024-02-07T12:25:27.612 INFO:tasks.workunit.client.1.smithi138.stdout:9/164: write d0/d6/d8/d1d/dd/f18 [4355441,102597] 0 2024-02-07T12:25:27.613 INFO:tasks.workunit.client.1.smithi138.stdout:3/234: truncate d5/f23 207710 0 2024-02-07T12:25:27.615 INFO:tasks.workunit.client.1.smithi138.stdout:2/174: rmdir d3/dd 39 2024-02-07T12:25:27.617 INFO:tasks.workunit.client.1.smithi138.stdout:9/165: creat d0/f38 x:0 0 0 2024-02-07T12:25:27.619 INFO:tasks.workunit.client.1.smithi138.stdout:3/235: stat d5/l21 0 2024-02-07T12:25:27.621 INFO:tasks.workunit.client.1.smithi138.stdout:3/236: rename d5/d15/d32/f43 to d5/d27/d35/f50 0 2024-02-07T12:25:27.634 INFO:tasks.workunit.client.1.smithi138.stdout:2/175: dwrite d3/dd/d19/d1f/d37/f3b [0,4194304] 0 2024-02-07T12:25:27.637 INFO:tasks.workunit.client.1.smithi138.stdout:2/176: creat d3/dd/d19/f42 x:0 0 0 2024-02-07T12:25:27.637 INFO:tasks.workunit.client.1.smithi138.stdout:2/177: truncate d3/dd/d14/f2c 391908 0 2024-02-07T12:25:27.639 INFO:tasks.workunit.client.1.smithi138.stdout:2/178: rename d3/dd/d19/d1f/f34 to d3/dd/d19/d1f/d37/f43 0 2024-02-07T12:25:27.640 INFO:tasks.workunit.client.1.smithi138.stdout:9/166: dwrite d0/d6/d8/d1d/dd/d25/f2d [0,4194304] 0 2024-02-07T12:25:27.641 INFO:tasks.workunit.client.1.smithi138.stdout:3/237: dwrite d5/d15/f48 [0,4194304] 0 2024-02-07T12:25:27.641 INFO:tasks.workunit.client.1.smithi138.stdout:3/238: creat d5/d15/f51 x:0 0 0 2024-02-07T12:25:27.641 INFO:tasks.workunit.client.1.smithi138.stdout:3/239: chown d5/d15/d32/c37 483482365 1 2024-02-07T12:25:27.641 INFO:tasks.workunit.client.1.smithi138.stdout:3/240: chown d5/d15/d32/l44 0 1 2024-02-07T12:25:27.641 INFO:tasks.workunit.client.1.smithi138.stdout:3/241: chown d5/d27/d35/l38 0 1 2024-02-07T12:25:27.641 INFO:tasks.workunit.client.1.smithi138.stdout:3/242: creat d5/d26/d28/f52 x:0 0 0 2024-02-07T12:25:27.641 INFO:tasks.workunit.client.1.smithi138.stdout:2/179: dread d3/dd/d14/f26 [0,4194304] 0 2024-02-07T12:25:27.642 INFO:tasks.workunit.client.1.smithi138.stdout:2/180: dread - d3/dd/d14/f22 zero size 2024-02-07T12:25:27.642 INFO:tasks.workunit.client.1.smithi138.stdout:2/181: dread d3/dd/d14/f2c [0,4194304] 0 2024-02-07T12:25:27.642 INFO:tasks.workunit.client.1.smithi138.stdout:9/167: symlink d0/d6/d8/d1d/l39 0 2024-02-07T12:25:27.651 INFO:tasks.workunit.client.1.smithi138.stdout:3/243: creat d5/d27/d35/f53 x:0 0 0 2024-02-07T12:25:27.651 INFO:tasks.workunit.client.1.smithi138.stdout:3/244: dread - d5/d26/d28/f4d zero size 2024-02-07T12:25:27.652 INFO:tasks.workunit.client.1.smithi138.stdout:2/182: mkdir d3/dd/d19/d44 0 2024-02-07T12:25:27.653 INFO:tasks.workunit.client.1.smithi138.stdout:2/183: chown d3/d9/d29/l33 57 1 2024-02-07T12:25:27.653 INFO:tasks.workunit.client.1.smithi138.stdout:2/184: truncate d3/dd/d19/f42 76634 0 2024-02-07T12:25:27.658 INFO:tasks.workunit.client.1.smithi138.stdout:9/168: dwrite d0/f38 [0,4194304] 0 2024-02-07T12:25:27.658 INFO:tasks.workunit.client.1.smithi138.stdout:9/169: truncate d0/d6/f27 575355 0 2024-02-07T12:25:27.660 INFO:tasks.workunit.client.1.smithi138.stdout:3/245: dread d5/d15/f18 [0,4194304] 0 2024-02-07T12:25:27.663 INFO:tasks.workunit.client.1.smithi138.stdout:3/246: mknod d5/d26/d28/c54 0 2024-02-07T12:25:27.663 INFO:tasks.workunit.client.1.smithi138.stdout:9/170: dread d0/d6/d8/d1d/dd/d1f/f1b [0,4194304] 0 2024-02-07T12:25:27.663 INFO:tasks.workunit.client.1.smithi138.stdout:9/171: write d0/d6/d8/f2a [325891,80851] 0 2024-02-07T12:25:27.664 INFO:tasks.workunit.client.1.smithi138.stdout:9/172: truncate d0/d6/f27 789532 0 2024-02-07T12:25:27.664 INFO:tasks.workunit.client.1.smithi138.stdout:9/173: readlink d0/d6/d8/l32 0 2024-02-07T12:25:27.664 INFO:tasks.workunit.client.1.smithi138.stdout:3/247: mknod d5/d15/c55 0 2024-02-07T12:25:27.666 INFO:tasks.workunit.client.1.smithi138.stdout:3/248: creat d5/f56 x:0 0 0 2024-02-07T12:25:27.668 INFO:tasks.workunit.client.1.smithi138.stdout:9/174: mknod d0/d6/d8/c3a 0 2024-02-07T12:25:27.669 INFO:tasks.workunit.client.1.smithi138.stdout:3/249: getdents d5/d34 0 2024-02-07T12:25:27.669 INFO:tasks.workunit.client.1.smithi138.stdout:3/250: truncate d5/d27/f40 1047938 0 2024-02-07T12:25:27.669 INFO:tasks.workunit.client.1.smithi138.stdout:2/185: dwrite d3/dd/d19/f35 [0,4194304] 0 2024-02-07T12:25:27.670 INFO:tasks.workunit.client.1.smithi138.stdout:9/175: mknod d0/d6/d8/d1d/dd/c3b 0 2024-02-07T12:25:27.673 INFO:tasks.workunit.client.1.smithi138.stdout:9/176: creat d0/d6/f3c x:0 0 0 2024-02-07T12:25:27.673 INFO:tasks.workunit.client.1.smithi138.stdout:9/177: chown d0/d6/d8/d1d/l13 135619471 1 2024-02-07T12:25:27.679 INFO:tasks.workunit.client.1.smithi138.stdout:9/178: write d0/d6/f12 [3749080,103215] 0 2024-02-07T12:25:27.680 INFO:tasks.workunit.client.1.smithi138.stdout:9/179: stat d0/d6/c10 0 2024-02-07T12:25:27.681 INFO:tasks.workunit.client.1.smithi138.stdout:2/186: dread d3/d9/d25/d3d/f3e [0,4194304] 0 2024-02-07T12:25:27.681 INFO:tasks.workunit.client.1.smithi138.stdout:2/187: creat d3/d9/d25/d3d/f45 x:0 0 0 2024-02-07T12:25:27.683 INFO:tasks.workunit.client.1.smithi138.stdout:2/188: mkdir d3/dd/d19/d1f/d46 0 2024-02-07T12:25:27.685 INFO:tasks.workunit.client.1.smithi138.stdout:2/189: creat d3/dd/d19/d1f/f47 x:0 0 0 2024-02-07T12:25:27.685 INFO:tasks.workunit.client.1.smithi138.stdout:2/190: truncate d3/dd/d19/d1f/f47 704363 0 2024-02-07T12:25:27.685 INFO:tasks.workunit.client.1.smithi138.stdout:2/191: write d3/dd/d19/f35 [4309505,119326] 0 2024-02-07T12:25:27.685 INFO:tasks.workunit.client.1.smithi138.stdout:2/192: write f1 [5526055,28229] 0 2024-02-07T12:25:27.686 INFO:tasks.workunit.client.1.smithi138.stdout:2/193: creat d3/dd/d19/d1f/d46/f48 x:0 0 0 2024-02-07T12:25:27.687 INFO:tasks.workunit.client.1.smithi138.stdout:2/194: readlink d3/d9/l24 0 2024-02-07T12:25:27.689 INFO:tasks.workunit.client.1.smithi138.stdout:3/251: dwrite d5/d27/f3d [0,4194304] 0 2024-02-07T12:25:27.700 INFO:tasks.workunit.client.1.smithi138.stdout:2/195: rename d3/d9 to d3/dd/d14/d49 0 2024-02-07T12:25:27.701 INFO:tasks.workunit.client.1.smithi138.stdout:3/252: getdents d5/d26/d28 0 2024-02-07T12:25:27.701 INFO:tasks.workunit.client.1.smithi138.stdout:3/253: read f3 [46555,105922] 0 2024-02-07T12:25:27.701 INFO:tasks.workunit.client.1.smithi138.stdout:3/254: creat d5/d27/f57 x:0 0 0 2024-02-07T12:25:27.704 INFO:tasks.workunit.client.1.smithi138.stdout:9/180: dwrite d0/f2c [0,4194304] 0 2024-02-07T12:25:27.705 INFO:tasks.workunit.client.1.smithi138.stdout:3/255: creat d5/d26/d4e/f58 x:0 0 0 2024-02-07T12:25:27.705 INFO:tasks.workunit.client.1.smithi138.stdout:3/256: read - d5/d26/d28/f4b zero size 2024-02-07T12:25:27.705 INFO:tasks.workunit.client.1.smithi138.stdout:2/196: rename d3/dd/d14/d49/l24 to d3/dd/d19/d44/l4a 0 2024-02-07T12:25:27.705 INFO:tasks.workunit.client.1.smithi138.stdout:3/257: write d5/d26/d28/f2b [4617817,72233] 0 2024-02-07T12:25:27.707 INFO:tasks.workunit.client.1.smithi138.stdout:9/181: creat d0/d6/d8/d1d/f3d x:0 0 0 2024-02-07T12:25:27.707 INFO:tasks.workunit.client.1.smithi138.stdout:9/182: write d0/d6/f3c [319266,125716] 0 2024-02-07T12:25:27.712 INFO:tasks.workunit.client.1.smithi138.stdout:3/258: link d5/fd d5/d26/d28/f59 0 2024-02-07T12:25:27.712 INFO:tasks.workunit.client.1.smithi138.stdout:3/259: creat d5/d26/d4e/f5a x:0 0 0 2024-02-07T12:25:27.713 INFO:tasks.workunit.client.1.smithi138.stdout:9/183: stat d0/d6/d8/d1d/c37 0 2024-02-07T12:25:27.716 INFO:tasks.workunit.client.1.smithi138.stdout:3/260: truncate d5/d27/f3d 522599 0 2024-02-07T12:25:27.717 INFO:tasks.workunit.client.1.smithi138.stdout:9/184: mkdir d0/d6/d8/d3e 0 2024-02-07T12:25:27.719 INFO:tasks.workunit.client.1.smithi138.stdout:2/197: dwrite d3/dd/d19/d1f/f47 [0,4194304] 0 2024-02-07T12:25:27.719 INFO:tasks.workunit.client.1.smithi138.stdout:2/198: chown d3/l36 113 1 2024-02-07T12:25:27.719 INFO:tasks.workunit.client.1.smithi138.stdout:0/78: sync 2024-02-07T12:25:27.719 INFO:tasks.workunit.client.1.smithi138.stdout:6/137: sync 2024-02-07T12:25:27.719 INFO:tasks.workunit.client.1.smithi138.stdout:8/237: sync 2024-02-07T12:25:27.719 INFO:tasks.workunit.client.1.smithi138.stdout:5/123: sync 2024-02-07T12:25:27.719 INFO:tasks.workunit.client.1.smithi138.stdout:4/82: sync 2024-02-07T12:25:27.719 INFO:tasks.workunit.client.1.smithi138.stdout:6/138: fdatasync fb 0 2024-02-07T12:25:27.719 INFO:tasks.workunit.client.1.smithi138.stdout:1/73: sync 2024-02-07T12:25:27.719 INFO:tasks.workunit.client.1.smithi138.stdout:7/308: sync 2024-02-07T12:25:27.719 INFO:tasks.workunit.client.1.smithi138.stdout:4/83: creat f19 x:0 0 0 2024-02-07T12:25:27.719 INFO:tasks.workunit.client.1.smithi138.stdout:4/84: creat f1a x:0 0 0 2024-02-07T12:25:27.719 INFO:tasks.workunit.client.1.smithi138.stdout:4/85: chown l17 21138 1 2024-02-07T12:25:27.720 INFO:tasks.workunit.client.1.smithi138.stdout:7/309: write d0/d8/d11/f5a [2217095,83243] 0 2024-02-07T12:25:27.720 INFO:tasks.workunit.client.1.smithi138.stdout:7/310: dread d0/d6/d3e/f44 [0,4194304] 0 2024-02-07T12:25:27.723 INFO:tasks.workunit.client.1.smithi138.stdout:2/199: link d3/dd/f2e d3/dd/f4b 0 2024-02-07T12:25:27.723 INFO:tasks.workunit.client.1.smithi138.stdout:3/261: write d5/d27/f3d [966749,34773] 0 2024-02-07T12:25:27.726 INFO:tasks.workunit.client.1.smithi138.stdout:0/79: mkdir d4/d19 0 2024-02-07T12:25:27.727 INFO:tasks.workunit.client.1.smithi138.stdout:0/80: write f1 [660993,70316] 0 2024-02-07T12:25:27.728 INFO:tasks.workunit.client.1.smithi138.stdout:1/74: chown d5/d8/cb 112094 1 2024-02-07T12:25:27.731 INFO:tasks.workunit.client.1.smithi138.stdout:8/238: creat d1/de/d11/d17/d2e/d38/f4b x:0 0 0 2024-02-07T12:25:27.733 INFO:tasks.workunit.client.1.smithi138.stdout:4/86: symlink l1b 0 2024-02-07T12:25:27.733 INFO:tasks.workunit.client.1.smithi138.stdout:4/87: creat f1c x:0 0 0 2024-02-07T12:25:27.733 INFO:tasks.workunit.client.1.smithi138.stdout:4/88: rmdir - no directory 2024-02-07T12:25:27.733 INFO:tasks.workunit.client.1.smithi138.stdout:4/89: chown l1b 3859 1 2024-02-07T12:25:27.733 INFO:tasks.workunit.client.1.smithi138.stdout:4/90: creat f1d x:0 0 0 2024-02-07T12:25:27.733 INFO:tasks.workunit.client.1.smithi138.stdout:4/91: write f14 [739015,99809] 0 2024-02-07T12:25:27.734 INFO:tasks.workunit.client.1.smithi138.stdout:4/92: chown c9 5 1 2024-02-07T12:25:27.735 INFO:tasks.workunit.client.1.smithi138.stdout:7/311: creat d0/d8/d11/d63/f67 x:0 0 0 2024-02-07T12:25:27.735 INFO:tasks.workunit.client.1.smithi138.stdout:6/139: dwrite dc/f1f [0,4194304] 0 2024-02-07T12:25:27.735 INFO:tasks.workunit.client.1.smithi138.stdout:6/140: write dc/fd [780388,115896] 0 2024-02-07T12:25:27.735 INFO:tasks.workunit.client.1.smithi138.stdout:6/141: chown c3 67356 1 2024-02-07T12:25:27.735 INFO:tasks.workunit.client.1.smithi138.stdout:2/200: link d3/dd/d19/d1f/c1c d3/c4c 0 2024-02-07T12:25:27.735 INFO:tasks.workunit.client.1.smithi138.stdout:3/262: mknod d5/d27/d35/c5b 0 2024-02-07T12:25:27.735 INFO:tasks.workunit.client.1.smithi138.stdout:3/263: chown d5/f2f 890097 1 2024-02-07T12:25:27.736 INFO:tasks.workunit.client.1.smithi138.stdout:3/264: readlink d5/d15/l31 0 2024-02-07T12:25:27.736 INFO:tasks.workunit.client.1.smithi138.stdout:3/265: chown d5/d15/l31 1491 1 2024-02-07T12:25:27.736 INFO:tasks.workunit.client.1.smithi138.stdout:3/266: chown f3 2548 1 2024-02-07T12:25:27.736 INFO:tasks.workunit.client.1.smithi138.stdout:3/267: readlink d5/d15/d32/l44 0 2024-02-07T12:25:27.736 INFO:tasks.workunit.client.1.smithi138.stdout:5/124: dread da/df/d27/f28 [0,4194304] 0 2024-02-07T12:25:27.736 INFO:tasks.workunit.client.1.smithi138.stdout:0/81: symlink d4/d19/l1a 0 2024-02-07T12:25:27.736 INFO:tasks.workunit.client.1.smithi138.stdout:1/75: creat d5/f12 x:0 0 0 2024-02-07T12:25:27.737 INFO:tasks.workunit.client.1.smithi138.stdout:8/239: mkdir d1/de/d11/d17/d2e/d49/d4c 0 2024-02-07T12:25:27.738 INFO:tasks.workunit.client.1.smithi138.stdout:8/240: write d1/de/d11/d17/d2e/d49/f29 [1092007,104987] 0 2024-02-07T12:25:27.739 INFO:tasks.workunit.client.1.smithi138.stdout:4/93: mknod c1e 0 2024-02-07T12:25:27.743 INFO:tasks.workunit.client.1.smithi138.stdout:6/142: mknod dc/d13/d1e/c23 0 2024-02-07T12:25:27.744 INFO:tasks.workunit.client.1.smithi138.stdout:3/268: getdents d5/d15/d32 0 2024-02-07T12:25:27.744 INFO:tasks.workunit.client.1.smithi138.stdout:5/125: write da/fc [2912816,118457] 0 2024-02-07T12:25:27.746 INFO:tasks.workunit.client.1.smithi138.stdout:0/82: mknod d4/d19/c1b 0 2024-02-07T12:25:27.749 INFO:tasks.workunit.client.1.smithi138.stdout:8/241: rename d1/la to d1/de/d11/d17/l4d 0 2024-02-07T12:25:27.749 INFO:tasks.workunit.client.1.smithi138.stdout:8/242: stat d1/de/d11/d17/d2e/d49/f3d 0 2024-02-07T12:25:27.750 INFO:tasks.workunit.client.1.smithi138.stdout:9/185: dwrite d0/d6/d8/d1d/f1c [0,4194304] 0 2024-02-07T12:25:27.751 INFO:tasks.workunit.client.1.smithi138.stdout:7/312: rmdir d0/d8/d11/d1f/d53 39 2024-02-07T12:25:27.753 INFO:tasks.workunit.client.1.smithi138.stdout:6/143: mkdir dc/d13/d1e/d24 0 2024-02-07T12:25:27.753 INFO:tasks.workunit.client.1.smithi138.stdout:6/144: fsync f6 0 2024-02-07T12:25:27.753 INFO:tasks.workunit.client.1.smithi138.stdout:6/145: creat dc/d13/d1e/f25 x:0 0 0 2024-02-07T12:25:27.756 INFO:tasks.workunit.client.1.smithi138.stdout:0/83: creat d4/d9/de/f1c x:0 0 0 2024-02-07T12:25:27.757 INFO:tasks.workunit.client.1.smithi138.stdout:1/76: link d5/d8/c10 d5/d8/c13 0 2024-02-07T12:25:27.759 INFO:tasks.workunit.client.1.smithi138.stdout:8/243: rename d1/de/d11/d17/f21 to d1/de/d11/d17/d3e/f4e 0 2024-02-07T12:25:27.761 INFO:tasks.workunit.client.1.smithi138.stdout:9/186: read d0/f38 [878862,44777] 0 2024-02-07T12:25:27.762 INFO:tasks.workunit.client.1.smithi138.stdout:6/146: creat dc/d13/d1e/d24/f26 x:0 0 0 2024-02-07T12:25:27.764 INFO:tasks.workunit.client.1.smithi138.stdout:0/84: mkdir d4/d9/de/d1d 0 2024-02-07T12:25:27.766 INFO:tasks.workunit.client.1.smithi138.stdout:8/244: truncate f0 7993837 0 2024-02-07T12:25:27.767 INFO:tasks.workunit.client.1.smithi138.stdout:8/245: dread - d1/de/d11/f43 zero size 2024-02-07T12:25:27.768 INFO:tasks.workunit.client.1.smithi138.stdout:0/85: symlink d4/d9/de/l1e 0 2024-02-07T12:25:27.770 INFO:tasks.workunit.client.1.smithi138.stdout:1/77: link d5/f7 d5/d8/f14 0 2024-02-07T12:25:27.771 INFO:tasks.workunit.client.1.smithi138.stdout:8/246: dread d1/de/d11/d17/d2e/d49/f29 [0,4194304] 0 2024-02-07T12:25:27.772 INFO:tasks.workunit.client.1.smithi138.stdout:1/78: mkdir d5/d8/da/d15 0 2024-02-07T12:25:27.772 INFO:tasks.workunit.client.1.smithi138.stdout:8/247: dread d1/de/ff [0,4194304] 0 2024-02-07T12:25:27.777 INFO:tasks.workunit.client.1.smithi138.stdout:4/94: dwrite fb [0,4194304] 0 2024-02-07T12:25:27.777 INFO:tasks.workunit.client.1.smithi138.stdout:7/313: fsync d0/d6/d3e/f51 0 2024-02-07T12:25:27.777 INFO:tasks.workunit.client.1.smithi138.stdout:7/314: stat d0/d6/d3e/l4a 0 2024-02-07T12:25:27.781 INFO:tasks.workunit.client.1.smithi138.stdout:0/86: write d4/f16 [81241,75783] 0 2024-02-07T12:25:27.781 INFO:tasks.workunit.client.1.smithi138.stdout:2/201: dwrite d3/dd/d14/f22 [0,4194304] 0 2024-02-07T12:25:27.781 INFO:tasks.workunit.client.1.smithi138.stdout:5/126: dwrite da/df/f17 [0,4194304] 0 2024-02-07T12:25:27.781 INFO:tasks.workunit.client.1.smithi138.stdout:2/202: chown d3/dd/d19/d1f/d46 29116 1 2024-02-07T12:25:27.781 INFO:tasks.workunit.client.1.smithi138.stdout:5/127: fsync da/df/f10 0 2024-02-07T12:25:27.783 INFO:tasks.workunit.client.1.smithi138.stdout:3/269: dwrite d5/d27/d35/f53 [0,4194304] 0 2024-02-07T12:25:27.783 INFO:tasks.workunit.client.1.smithi138.stdout:0/87: fsync d4/f16 0 2024-02-07T12:25:27.788 INFO:tasks.workunit.client.1.smithi138.stdout:1/79: write d5/d8/da/f11 [1254122,72046] 0 2024-02-07T12:25:27.788 INFO:tasks.workunit.client.1.smithi138.stdout:1/80: creat d5/f16 x:0 0 0 2024-02-07T12:25:27.788 INFO:tasks.workunit.client.1.smithi138.stdout:6/147: dread dc/fd [0,4194304] 0 2024-02-07T12:25:27.788 INFO:tasks.workunit.client.1.smithi138.stdout:6/148: truncate dc/d13/d1e/f22 521574 0 2024-02-07T12:25:27.788 INFO:tasks.workunit.client.1.smithi138.stdout:7/315: getdents d0/d6/d19 0 2024-02-07T12:25:27.788 INFO:tasks.workunit.client.1.smithi138.stdout:7/316: truncate d0/d6/f12 151839 0 2024-02-07T12:25:27.789 INFO:tasks.workunit.client.1.smithi138.stdout:2/203: creat d3/dd/d14/f4d x:0 0 0 2024-02-07T12:25:27.792 INFO:tasks.workunit.client.1.smithi138.stdout:3/270: truncate d5/fd 3489482 0 2024-02-07T12:25:27.793 INFO:tasks.workunit.client.1.smithi138.stdout:4/95: read f3 [1416666,7482] 0 2024-02-07T12:25:27.796 INFO:tasks.workunit.client.1.smithi138.stdout:6/149: symlink dc/d13/d1e/d24/l27 0 2024-02-07T12:25:27.797 INFO:tasks.workunit.client.1.smithi138.stdout:2/204: mkdir d3/d4e 0 2024-02-07T12:25:27.797 INFO:tasks.workunit.client.1.smithi138.stdout:2/205: truncate d3/dd/d19/d1f/d37/f43 990243 0 2024-02-07T12:25:27.798 INFO:tasks.workunit.client.1.smithi138.stdout:3/271: symlink d5/d15/d32/l5c 0 2024-02-07T12:25:27.798 INFO:tasks.workunit.client.1.smithi138.stdout:3/272: truncate d5/f24 5264833 0 2024-02-07T12:25:27.799 INFO:tasks.workunit.client.1.smithi138.stdout:2/206: dread d3/dd/d19/d1f/d37/f43 [0,4194304] 0 2024-02-07T12:25:27.804 INFO:tasks.workunit.client.1.smithi138.stdout:4/96: getdents . 0 2024-02-07T12:25:27.804 INFO:tasks.workunit.client.1.smithi138.stdout:4/97: rmdir - no directory 2024-02-07T12:25:27.804 INFO:tasks.workunit.client.1.smithi138.stdout:4/98: truncate f15 1867576 0 2024-02-07T12:25:27.805 INFO:tasks.workunit.client.1.smithi138.stdout:2/207: read d3/dd/d14/d49/f1b [3575950,123194] 0 2024-02-07T12:25:27.806 INFO:tasks.workunit.client.1.smithi138.stdout:3/273: link d5/d27/f29 d5/d26/d28/f5d 0 2024-02-07T12:25:27.807 INFO:tasks.workunit.client.1.smithi138.stdout:7/317: dread d0/d6/d1d/d24/f36 [0,4194304] 0 2024-02-07T12:25:27.807 INFO:tasks.workunit.client.1.smithi138.stdout:7/318: truncate d0/d6/f4d 544994 0 2024-02-07T12:25:27.807 INFO:tasks.workunit.client.1.smithi138.stdout:7/319: creat d0/d6/d3e/f68 x:0 0 0 2024-02-07T12:25:27.808 INFO:tasks.workunit.client.1.smithi138.stdout:7/320: creat d0/d6/f69 x:0 0 0 2024-02-07T12:25:27.808 INFO:tasks.workunit.client.1.smithi138.stdout:7/321: fdatasync d0/d6/fa 0 2024-02-07T12:25:27.808 INFO:tasks.workunit.client.1.smithi138.stdout:2/208: mkdir d3/dd/d14/d49/d25/d3d/d4f 0 2024-02-07T12:25:27.808 INFO:tasks.workunit.client.1.smithi138.stdout:6/150: rmdir dc/d13/d1e/d24 39 2024-02-07T12:25:27.809 INFO:tasks.workunit.client.1.smithi138.stdout:6/151: chown dc 20186 1 2024-02-07T12:25:27.810 INFO:tasks.workunit.client.1.smithi138.stdout:3/274: mkdir d5/d26/d5e 0 2024-02-07T12:25:27.810 INFO:tasks.workunit.client.1.smithi138.stdout:3/275: write d5/d26/d28/f4b [1028254,7247] 0 2024-02-07T12:25:27.812 INFO:tasks.workunit.client.1.smithi138.stdout:3/276: dread d5/f3a [0,4194304] 0 2024-02-07T12:25:27.814 INFO:tasks.workunit.client.1.smithi138.stdout:7/322: rmdir d0/d6/d19/d61 0 2024-02-07T12:25:27.815 INFO:tasks.workunit.client.1.smithi138.stdout:2/209: creat d3/d4e/f50 x:0 0 0 2024-02-07T12:25:27.816 INFO:tasks.workunit.client.1.smithi138.stdout:7/323: link d0/d8/d15/c4c d0/c6a 0 2024-02-07T12:25:27.824 INFO:tasks.workunit.client.1.smithi138.stdout:0/88: dread d4/f5 [0,4194304] 0 2024-02-07T12:25:27.824 INFO:tasks.workunit.client.1.smithi138.stdout:0/89: creat d4/f1f x:0 0 0 2024-02-07T12:25:27.824 INFO:tasks.workunit.client.1.smithi138.stdout:0/90: write d4/d9/f11 [40593,118038] 0 2024-02-07T12:25:27.826 INFO:tasks.workunit.client.1.smithi138.stdout:0/91: creat d4/d9/db/f20 x:0 0 0 2024-02-07T12:25:27.832 INFO:tasks.workunit.client.1.smithi138.stdout:8/248: dwrite d1/f23 [0,4194304] 0 2024-02-07T12:25:27.832 INFO:tasks.workunit.client.1.smithi138.stdout:8/249: chown d1/de/d11/d17/l4d 3871333 1 2024-02-07T12:25:27.832 INFO:tasks.workunit.client.1.smithi138.stdout:8/250: readlink d1/de/l1c 0 2024-02-07T12:25:27.835 INFO:tasks.workunit.client.1.smithi138.stdout:8/251: symlink d1/l4f 0 2024-02-07T12:25:27.841 INFO:tasks.workunit.client.1.smithi138.stdout:8/252: rename d1/de/d11/d17/d2e/d38 to d1/de/d11/d17/d2e/d3a/d50 0 2024-02-07T12:25:27.842 INFO:tasks.workunit.client.1.smithi138.stdout:8/253: creat d1/de/d11/d17/d2e/d49/d4c/f51 x:0 0 0 2024-02-07T12:25:27.844 INFO:tasks.workunit.client.1.smithi138.stdout:8/254: creat d1/de/d11/d17/d2e/f52 x:0 0 0 2024-02-07T12:25:27.844 INFO:tasks.workunit.client.1.smithi138.stdout:8/255: fdatasync f0 0 2024-02-07T12:25:27.844 INFO:tasks.workunit.client.1.smithi138.stdout:8/256: readlink d1/de/l1c 0 2024-02-07T12:25:27.844 INFO:tasks.workunit.client.1.smithi138.stdout:8/257: creat d1/de/f53 x:0 0 0 2024-02-07T12:25:27.846 INFO:tasks.workunit.client.1.smithi138.stdout:7/324: dwrite d0/d8/d15/f47 [0,4194304] 0 2024-02-07T12:25:27.853 INFO:tasks.workunit.client.1.smithi138.stdout:7/325: rename d0/d8/d11/d1f/f45 to d0/d8/d15/f6b 0 2024-02-07T12:25:27.856 INFO:tasks.workunit.client.1.smithi138.stdout:6/152: dwrite dc/f1f [0,4194304] 0 2024-02-07T12:25:27.856 INFO:tasks.workunit.client.1.smithi138.stdout:6/153: chown dc/d13/f1d 34660462 1 2024-02-07T12:25:27.856 INFO:tasks.workunit.client.1.smithi138.stdout:2/210: dwrite d3/dd/f4b [0,4194304] 0 2024-02-07T12:25:27.856 INFO:tasks.workunit.client.1.smithi138.stdout:9/187: dwrite d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:27.856 INFO:tasks.workunit.client.1.smithi138.stdout:4/99: dwrite f11 [4194304,4194304] 0 2024-02-07T12:25:27.857 INFO:tasks.workunit.client.1.smithi138.stdout:4/100: chown f3 83 1 2024-02-07T12:25:27.857 INFO:tasks.workunit.client.1.smithi138.stdout:1/81: dwrite d5/f12 [0,4194304] 0 2024-02-07T12:25:27.857 INFO:tasks.workunit.client.1.smithi138.stdout:1/82: chown d5/d8/da/fe 16474259 1 2024-02-07T12:25:27.857 INFO:tasks.workunit.client.1.smithi138.stdout:3/277: dwrite d5/d26/d28/f52 [0,4194304] 0 2024-02-07T12:25:27.857 INFO:tasks.workunit.client.1.smithi138.stdout:5/128: dwrite da/f19 [0,4194304] 0 2024-02-07T12:25:27.857 INFO:tasks.workunit.client.1.smithi138.stdout:3/278: chown d5/d26/d28/f5d 1166 1 2024-02-07T12:25:27.857 INFO:tasks.workunit.client.1.smithi138.stdout:6/154: mknod dc/c28 0 2024-02-07T12:25:27.859 INFO:tasks.workunit.client.1.smithi138.stdout:0/92: dread f1 [0,4194304] 0 2024-02-07T12:25:27.860 INFO:tasks.workunit.client.1.smithi138.stdout:8/258: dwrite d1/de/d11/d17/d2e/d49/f3d [0,4194304] 0 2024-02-07T12:25:27.863 INFO:tasks.workunit.client.1.smithi138.stdout:2/211: rename d3/dd/d19/d1f/d37/f43 to d3/dd/d14/d49/d29/f51 0 2024-02-07T12:25:27.865 INFO:tasks.workunit.client.1.smithi138.stdout:9/188: mknod d0/d6/d8/d1d/c3f 0 2024-02-07T12:25:27.881 INFO:tasks.workunit.client.1.smithi138.stdout:7/326: dwrite d0/d8/d11/d26/f49 [0,4194304] 0 2024-02-07T12:25:27.881 INFO:tasks.workunit.client.1.smithi138.stdout:7/327: readlink d0/d6/d19/l40 0 2024-02-07T12:25:27.883 INFO:tasks.workunit.client.1.smithi138.stdout:0/93: dwrite d4/d9/f11 [0,4194304] 0 2024-02-07T12:25:27.883 INFO:tasks.workunit.client.1.smithi138.stdout:0/94: dread - d4/fd zero size 2024-02-07T12:25:27.884 INFO:tasks.workunit.client.1.smithi138.stdout:4/101: mknod c1f 0 2024-02-07T12:25:27.884 INFO:tasks.workunit.client.1.smithi138.stdout:5/129: symlink da/d22/d25/d2b/l2d 0 2024-02-07T12:25:27.888 INFO:tasks.workunit.client.1.smithi138.stdout:6/155: dwrite dc/d13/f1d [0,4194304] 0 2024-02-07T12:25:27.888 INFO:tasks.workunit.client.1.smithi138.stdout:8/259: truncate d1/f26 2211632 0 2024-02-07T12:25:27.888 INFO:tasks.workunit.client.1.smithi138.stdout:3/279: rename d5/d15/f18 to d5/d26/f5f 0 2024-02-07T12:25:27.896 INFO:tasks.workunit.client.1.smithi138.stdout:0/95: mkdir d4/d9/de/d1d/d21 0 2024-02-07T12:25:27.897 INFO:tasks.workunit.client.1.smithi138.stdout:3/280: dread d5/f2f [0,4194304] 0 2024-02-07T12:25:27.897 INFO:tasks.workunit.client.1.smithi138.stdout:3/281: chown d5/d27/f57 6063111 1 2024-02-07T12:25:27.897 INFO:tasks.workunit.client.1.smithi138.stdout:3/282: write f3 [939094,66225] 0 2024-02-07T12:25:27.897 INFO:tasks.workunit.client.1.smithi138.stdout:3/283: creat d5/d26/f60 x:0 0 0 2024-02-07T12:25:27.897 INFO:tasks.workunit.client.1.smithi138.stdout:3/284: chown d5/d26/d4e/f5a 3 1 2024-02-07T12:25:27.897 INFO:tasks.workunit.client.1.smithi138.stdout:3/285: getdents d5/d34 0 2024-02-07T12:25:27.898 INFO:tasks.workunit.client.1.smithi138.stdout:2/212: dwrite d3/dd/d19/f35 [0,4194304] 0 2024-02-07T12:25:27.898 INFO:tasks.workunit.client.1.smithi138.stdout:4/102: mkdir d20 0 2024-02-07T12:25:27.898 INFO:tasks.workunit.client.1.smithi138.stdout:1/83: rmdir d5 39 2024-02-07T12:25:27.902 INFO:tasks.workunit.client.1.smithi138.stdout:5/130: mkdir da/df/d27/d2e 0 2024-02-07T12:25:27.902 INFO:tasks.workunit.client.1.smithi138.stdout:6/156: symlink dc/d13/d1e/l29 0 2024-02-07T12:25:27.902 INFO:tasks.workunit.client.1.smithi138.stdout:5/131: chown da/fc 4088705 1 2024-02-07T12:25:27.903 INFO:tasks.workunit.client.1.smithi138.stdout:5/132: write da/fb [3154360,100009] 0 2024-02-07T12:25:27.904 INFO:tasks.workunit.client.1.smithi138.stdout:8/260: truncate d1/de/d11/f1d 90599 0 2024-02-07T12:25:27.907 INFO:tasks.workunit.client.1.smithi138.stdout:3/286: mknod d5/d15/d32/c61 0 2024-02-07T12:25:27.907 INFO:tasks.workunit.client.1.smithi138.stdout:3/287: chown d5/d27/d35/l38 152355 1 2024-02-07T12:25:27.907 INFO:tasks.workunit.client.1.smithi138.stdout:3/288: truncate d5/d27/f57 535478 0 2024-02-07T12:25:27.907 INFO:tasks.workunit.client.1.smithi138.stdout:3/289: write d5/f9 [5027836,46691] 0 2024-02-07T12:25:27.908 INFO:tasks.workunit.client.1.smithi138.stdout:2/213: creat d3/dd/d14/d49/d25/d3d/f52 x:0 0 0 2024-02-07T12:25:27.908 INFO:tasks.workunit.client.1.smithi138.stdout:4/103: creat d20/f21 x:0 0 0 2024-02-07T12:25:27.913 INFO:tasks.workunit.client.1.smithi138.stdout:8/261: mknod d1/de/c54 0 2024-02-07T12:25:27.916 INFO:tasks.workunit.client.1.smithi138.stdout:9/189: rename d0/d6/d8/d1d/l39 to d0/d6/d8/l40 0 2024-02-07T12:25:27.916 INFO:tasks.workunit.client.1.smithi138.stdout:5/133: read da/df/d27/f28 [184911,66799] 0 2024-02-07T12:25:27.916 INFO:tasks.workunit.client.1.smithi138.stdout:5/134: chown da/d22 307523143 1 2024-02-07T12:25:27.916 INFO:tasks.workunit.client.1.smithi138.stdout:5/135: write da/f24 [751059,108842] 0 2024-02-07T12:25:27.920 INFO:tasks.workunit.client.1.smithi138.stdout:3/290: mknod d5/d26/d28/c62 0 2024-02-07T12:25:27.920 INFO:tasks.workunit.client.1.smithi138.stdout:3/291: fsync d5/d27/f49 0 2024-02-07T12:25:27.922 INFO:tasks.workunit.client.1.smithi138.stdout:6/157: dwrite dc/d13/f1b [0,4194304] 0 2024-02-07T12:25:27.922 INFO:tasks.workunit.client.1.smithi138.stdout:2/214: creat d3/f53 x:0 0 0 2024-02-07T12:25:27.923 INFO:tasks.workunit.client.1.smithi138.stdout:4/104: symlink d20/l22 0 2024-02-07T12:25:27.929 INFO:tasks.workunit.client.1.smithi138.stdout:6/158: dread dc/d13/f19 [0,4194304] 0 2024-02-07T12:25:27.929 INFO:tasks.workunit.client.1.smithi138.stdout:6/159: creat dc/d13/d1e/f2a x:0 0 0 2024-02-07T12:25:27.929 INFO:tasks.workunit.client.1.smithi138.stdout:6/160: creat dc/d13/d1e/f2b x:0 0 0 2024-02-07T12:25:27.942 INFO:tasks.workunit.client.1.smithi138.stdout:4/105: dwrite fd [0,4194304] 0 2024-02-07T12:25:27.943 INFO:tasks.workunit.client.1.smithi138.stdout:8/262: getdents d1/de/d11/d17/d2e/d3a 0 2024-02-07T12:25:27.946 INFO:tasks.workunit.client.1.smithi138.stdout:7/328: rename d0/d8/d11/d63/f67 to d0/f6c 0 2024-02-07T12:25:27.947 INFO:tasks.workunit.client.1.smithi138.stdout:9/190: mkdir d0/d6/d8/d1d/dd/d41 0 2024-02-07T12:25:27.948 INFO:tasks.workunit.client.1.smithi138.stdout:5/136: creat da/df/d27/d2e/f2f x:0 0 0 2024-02-07T12:25:27.948 INFO:tasks.workunit.client.1.smithi138.stdout:5/137: creat da/d22/d25/f30 x:0 0 0 2024-02-07T12:25:27.949 INFO:tasks.workunit.client.1.smithi138.stdout:7/329: write d0/d8/d15/f1e [1275707,59699] 0 2024-02-07T12:25:27.954 INFO:tasks.workunit.client.1.smithi138.stdout:5/138: read da/fb [2017065,8903] 0 2024-02-07T12:25:27.954 INFO:tasks.workunit.client.1.smithi138.stdout:5/139: truncate da/d22/d25/f2c 509558 0 2024-02-07T12:25:27.955 INFO:tasks.workunit.client.1.smithi138.stdout:6/161: unlink l7 0 2024-02-07T12:25:27.956 INFO:tasks.workunit.client.1.smithi138.stdout:7/330: dread d0/f14 [0,4194304] 0 2024-02-07T12:25:27.958 INFO:tasks.workunit.client.1.smithi138.stdout:4/106: symlink d20/l23 0 2024-02-07T12:25:27.959 INFO:tasks.workunit.client.1.smithi138.stdout:8/263: mknod d1/c55 0 2024-02-07T12:25:27.959 INFO:tasks.workunit.client.1.smithi138.stdout:8/264: fsync d1/de/d11/f43 0 2024-02-07T12:25:27.959 INFO:tasks.workunit.client.1.smithi138.stdout:8/265: write d1/f3f [9136770,63359] 0 2024-02-07T12:25:27.962 INFO:tasks.workunit.client.1.smithi138.stdout:0/96: rename f2 to d4/d9/f22 0 2024-02-07T12:25:27.964 INFO:tasks.workunit.client.1.smithi138.stdout:0/97: read d4/d9/f18 [4205505,89276] 0 2024-02-07T12:25:27.964 INFO:tasks.workunit.client.1.smithi138.stdout:0/98: dread - d4/fd zero size 2024-02-07T12:25:27.964 INFO:tasks.workunit.client.1.smithi138.stdout:9/191: symlink d0/d6/d8/d1d/dd/l42 0 2024-02-07T12:25:27.971 INFO:tasks.workunit.client.1.smithi138.stdout:4/107: link d20/f21 d20/f24 0 2024-02-07T12:25:27.971 INFO:tasks.workunit.client.1.smithi138.stdout:4/108: creat d20/f25 x:0 0 0 2024-02-07T12:25:27.971 INFO:tasks.workunit.client.1.smithi138.stdout:4/109: fdatasync f14 0 2024-02-07T12:25:27.973 INFO:tasks.workunit.client.1.smithi138.stdout:3/292: rename d5/d15/f51 to d5/d26/d4e/f63 0 2024-02-07T12:25:27.973 INFO:tasks.workunit.client.1.smithi138.stdout:3/293: fsync d5/f9 0 2024-02-07T12:25:27.974 INFO:tasks.workunit.client.1.smithi138.stdout:0/99: symlink d4/d9/de/l23 0 2024-02-07T12:25:27.975 INFO:tasks.workunit.client.1.smithi138.stdout:0/100: dread - d4/d9/db/f20 zero size 2024-02-07T12:25:27.975 INFO:tasks.workunit.client.1.smithi138.stdout:0/101: dread - d4/fd zero size 2024-02-07T12:25:27.977 INFO:tasks.workunit.client.1.smithi138.stdout:4/110: link d20/f21 d20/f26 0 2024-02-07T12:25:27.980 INFO:tasks.workunit.client.1.smithi138.stdout:5/140: dwrite da/d22/d25/f30 [0,4194304] 0 2024-02-07T12:25:27.980 INFO:tasks.workunit.client.1.smithi138.stdout:5/141: write da/df/f13 [3753433,117736] 0 2024-02-07T12:25:27.980 INFO:tasks.workunit.client.1.smithi138.stdout:5/142: write da/f24 [1808814,40832] 0 2024-02-07T12:25:27.980 INFO:tasks.workunit.client.1.smithi138.stdout:2/215: rename d3/dd/d19/f17 to d3/dd/d19/d44/f54 0 2024-02-07T12:25:27.980 INFO:tasks.workunit.client.1.smithi138.stdout:2/216: readlink d3/l3c 0 2024-02-07T12:25:27.980 INFO:tasks.workunit.client.1.smithi138.stdout:2/217: write d3/dd/d14/d49/d25/d3d/f52 [586363,86720] 0 2024-02-07T12:25:27.980 INFO:tasks.workunit.client.1.smithi138.stdout:0/102: rmdir d4/d19 39 2024-02-07T12:25:27.980 INFO:tasks.workunit.client.1.smithi138.stdout:0/103: chown d4/fd 7745698 1 2024-02-07T12:25:27.980 INFO:tasks.workunit.client.1.smithi138.stdout:0/104: creat d4/d9/de/f24 x:0 0 0 2024-02-07T12:25:27.980 INFO:tasks.workunit.client.1.smithi138.stdout:0/105: stat d4/l8 0 2024-02-07T12:25:27.981 INFO:tasks.workunit.client.1.smithi138.stdout:7/331: dwrite d0/d6/d3e/f68 [0,4194304] 0 2024-02-07T12:25:27.981 INFO:tasks.workunit.client.1.smithi138.stdout:7/332: creat d0/d8/d11/f6d x:0 0 0 2024-02-07T12:25:27.981 INFO:tasks.workunit.client.1.smithi138.stdout:3/294: read d5/f20 [1278010,130138] 0 2024-02-07T12:25:27.981 INFO:tasks.workunit.client.1.smithi138.stdout:6/162: dwrite f8 [0,4194304] 0 2024-02-07T12:25:27.983 INFO:tasks.workunit.client.1.smithi138.stdout:4/111: mknod d20/c27 0 2024-02-07T12:25:27.986 INFO:tasks.workunit.client.1.smithi138.stdout:5/143: truncate f8 235790 0 2024-02-07T12:25:27.992 INFO:tasks.workunit.client.1.smithi138.stdout:3/295: dread d5/d26/f2c [0,4194304] 0 2024-02-07T12:25:27.994 INFO:tasks.workunit.client.1.smithi138.stdout:6/163: link dc/d13/f1a dc/d13/d1e/d24/f2c 0 2024-02-07T12:25:27.994 INFO:tasks.workunit.client.1.smithi138.stdout:6/164: write dc/d13/d1e/f22 [1298394,88101] 0 2024-02-07T12:25:27.999 INFO:tasks.workunit.client.1.smithi138.stdout:5/144: rename da/df/f10 to da/d22/d25/d2b/f31 0 2024-02-07T12:25:27.999 INFO:tasks.workunit.client.1.smithi138.stdout:5/145: write da/f19 [4807937,33445] 0 2024-02-07T12:25:27.999 INFO:tasks.workunit.client.1.smithi138.stdout:5/146: truncate da/df/f20 316790 0 2024-02-07T12:25:27.999 INFO:tasks.workunit.client.1.smithi138.stdout:5/147: rename da/df to da/df/d27/d2e/d32 22 2024-02-07T12:25:28.000 INFO:tasks.workunit.client.1.smithi138.stdout:0/106: getdents d4/d19 0 2024-02-07T12:25:28.000 INFO:tasks.workunit.client.1.smithi138.stdout:0/107: write d4/d9/f11 [5048790,96663] 0 2024-02-07T12:25:28.000 INFO:tasks.workunit.client.1.smithi138.stdout:0/108: fdatasync d4/d9/de/f24 0 2024-02-07T12:25:28.001 INFO:tasks.workunit.client.1.smithi138.stdout:3/296: dread d5/d27/f49 [0,4194304] 0 2024-02-07T12:25:28.002 INFO:tasks.workunit.client.1.smithi138.stdout:2/218: dwrite d3/dd/d14/d49/f1b [0,4194304] 0 2024-02-07T12:25:28.002 INFO:tasks.workunit.client.1.smithi138.stdout:2/219: creat d3/dd/d14/d49/d25/d3d/f55 x:0 0 0 2024-02-07T12:25:28.004 INFO:tasks.workunit.client.1.smithi138.stdout:6/165: rename dc/d13/l20 to dc/d13/l2d 0 2024-02-07T12:25:28.004 INFO:tasks.workunit.client.1.smithi138.stdout:5/148: dread da/f19 [4194304,4194304] 0 2024-02-07T12:25:28.006 INFO:tasks.workunit.client.1.smithi138.stdout:0/109: mknod d4/d9/de/d1d/c25 0 2024-02-07T12:25:28.007 INFO:tasks.workunit.client.1.smithi138.stdout:0/110: dread - d4/d9/de/f24 zero size 2024-02-07T12:25:28.007 INFO:tasks.workunit.client.1.smithi138.stdout:0/111: stat d4/d9/db 0 2024-02-07T12:25:28.009 INFO:tasks.workunit.client.1.smithi138.stdout:3/297: mkdir d5/d26/d64 0 2024-02-07T12:25:28.013 INFO:tasks.workunit.client.1.smithi138.stdout:2/220: mknod d3/dd/d19/d1f/d46/c56 0 2024-02-07T12:25:28.017 INFO:tasks.workunit.client.1.smithi138.stdout:6/166: rename dc/c28 to dc/d13/d1e/c2e 0 2024-02-07T12:25:28.017 INFO:tasks.workunit.client.1.smithi138.stdout:6/167: fsync dc/d13/d1e/f2a 0 2024-02-07T12:25:28.017 INFO:tasks.workunit.client.1.smithi138.stdout:6/168: truncate f8 4831850 0 2024-02-07T12:25:28.021 INFO:tasks.workunit.client.1.smithi138.stdout:2/221: creat d3/dd/d19/d44/f57 x:0 0 0 2024-02-07T12:25:28.022 INFO:tasks.workunit.client.1.smithi138.stdout:2/222: fsync d3/dd/d14/f4d 0 2024-02-07T12:25:28.022 INFO:tasks.workunit.client.1.smithi138.stdout:2/223: fdatasync d3/dd/d14/f22 0 2024-02-07T12:25:28.022 INFO:tasks.workunit.client.1.smithi138.stdout:2/224: stat d3/dd/c3f 0 2024-02-07T12:25:28.022 INFO:tasks.workunit.client.1.smithi138.stdout:3/298: dread d5/d26/d28/f52 [0,4194304] 0 2024-02-07T12:25:28.022 INFO:tasks.workunit.client.1.smithi138.stdout:5/149: dwrite da/df/f17 [0,4194304] 0 2024-02-07T12:25:28.022 INFO:tasks.workunit.client.1.smithi138.stdout:5/150: creat da/df/d27/f33 x:0 0 0 2024-02-07T12:25:28.023 INFO:tasks.workunit.client.1.smithi138.stdout:2/225: truncate d3/f12 470891 0 2024-02-07T12:25:28.026 INFO:tasks.workunit.client.1.smithi138.stdout:0/112: dwrite d4/d9/fa [0,4194304] 0 2024-02-07T12:25:28.027 INFO:tasks.workunit.client.1.smithi138.stdout:4/112: rmdir d20 39 2024-02-07T12:25:28.028 INFO:tasks.workunit.client.1.smithi138.stdout:4/113: write f14 [139723,129737] 0 2024-02-07T12:25:28.029 INFO:tasks.workunit.client.1.smithi138.stdout:3/299: truncate f1 2312290 0 2024-02-07T12:25:28.030 INFO:tasks.workunit.client.1.smithi138.stdout:0/113: dread d4/f16 [0,4194304] 0 2024-02-07T12:25:28.030 INFO:tasks.workunit.client.1.smithi138.stdout:0/114: creat d4/f26 x:0 0 0 2024-02-07T12:25:28.033 INFO:tasks.workunit.client.1.smithi138.stdout:2/226: symlink d3/dd/d14/d49/d25/l58 0 2024-02-07T12:25:28.035 INFO:tasks.workunit.client.1.smithi138.stdout:7/333: rmdir d0/d8/d11 39 2024-02-07T12:25:28.039 INFO:tasks.workunit.client.1.smithi138.stdout:4/114: unlink c9 0 2024-02-07T12:25:28.042 INFO:tasks.workunit.client.1.smithi138.stdout:0/115: truncate d4/d9/f18 1440738 0 2024-02-07T12:25:28.044 INFO:tasks.workunit.client.1.smithi138.stdout:5/151: getdents da/d22/d25 0 2024-02-07T12:25:28.047 INFO:tasks.workunit.client.1.smithi138.stdout:4/115: creat d20/f28 x:0 0 0 2024-02-07T12:25:28.047 INFO:tasks.workunit.client.1.smithi138.stdout:4/116: creat d20/f29 x:0 0 0 2024-02-07T12:25:28.047 INFO:tasks.workunit.client.1.smithi138.stdout:4/117: write f15 [2299378,86375] 0 2024-02-07T12:25:28.047 INFO:tasks.workunit.client.1.smithi138.stdout:0/116: symlink d4/d9/l27 0 2024-02-07T12:25:28.047 INFO:tasks.workunit.client.1.smithi138.stdout:0/117: fsync d4/d9/de/f24 0 2024-02-07T12:25:28.048 INFO:tasks.workunit.client.1.smithi138.stdout:5/152: mkdir da/d34 0 2024-02-07T12:25:28.049 INFO:tasks.workunit.client.1.smithi138.stdout:7/334: write d0/f2 [3456315,81229] 0 2024-02-07T12:25:28.049 INFO:tasks.workunit.client.1.smithi138.stdout:7/335: chown d0/d6/d1d/d38/c64 18 1 2024-02-07T12:25:28.049 INFO:tasks.workunit.client.1.smithi138.stdout:2/227: dwrite d3/dd/d19/f15 [4194304,4194304] 0 2024-02-07T12:25:28.050 INFO:tasks.workunit.client.1.smithi138.stdout:4/118: symlink d20/l2a 0 2024-02-07T12:25:28.051 INFO:tasks.workunit.client.1.smithi138.stdout:4/119: truncate d20/f21 1028157 0 2024-02-07T12:25:28.051 INFO:tasks.workunit.client.1.smithi138.stdout:4/120: write d20/f21 [240211,82053] 0 2024-02-07T12:25:28.052 INFO:tasks.workunit.client.1.smithi138.stdout:0/118: creat d4/d19/f28 x:0 0 0 2024-02-07T12:25:28.052 INFO:tasks.workunit.client.1.smithi138.stdout:0/119: chown d4/d9/f18 23887922 1 2024-02-07T12:25:28.053 INFO:tasks.workunit.client.1.smithi138.stdout:5/153: mkdir da/d22/d25/d2b/d35 0 2024-02-07T12:25:28.056 INFO:tasks.workunit.client.1.smithi138.stdout:7/336: rename d0/d6/d1d/c3b to d0/d8/d15/c6e 0 2024-02-07T12:25:28.057 INFO:tasks.workunit.client.1.smithi138.stdout:6/169: truncate f8 352028 0 2024-02-07T12:25:28.058 INFO:tasks.workunit.client.1.smithi138.stdout:2/228: truncate d3/dd/d19/d44/f54 3515923 0 2024-02-07T12:25:28.058 INFO:tasks.workunit.client.1.smithi138.stdout:2/229: truncate d3/dd/d14/d49/f1b 5915449 0 2024-02-07T12:25:28.060 INFO:tasks.workunit.client.1.smithi138.stdout:0/120: link d4/d19/l1a d4/d9/db/l29 0 2024-02-07T12:25:28.062 INFO:tasks.workunit.client.1.smithi138.stdout:0/121: dread - d4/d9/de/f1c zero size 2024-02-07T12:25:28.062 INFO:tasks.workunit.client.1.smithi138.stdout:0/122: stat d4/d9/f18 0 2024-02-07T12:25:28.062 INFO:tasks.workunit.client.1.smithi138.stdout:7/337: mknod d0/d8/c6f 0 2024-02-07T12:25:28.065 INFO:tasks.workunit.client.1.smithi138.stdout:6/170: rename dc/d13/d1e/d24/f26 to dc/d13/d1e/f2f 0 2024-02-07T12:25:28.065 INFO:tasks.workunit.client.1.smithi138.stdout:6/171: chown dc/d13/f19 417 1 2024-02-07T12:25:28.065 INFO:tasks.workunit.client.1.smithi138.stdout:7/338: mknod d0/d8/d11/d1f/c70 0 2024-02-07T12:25:28.068 INFO:tasks.workunit.client.1.smithi138.stdout:6/172: rmdir dc 39 2024-02-07T12:25:28.069 INFO:tasks.workunit.client.1.smithi138.stdout:4/121: dwrite f16 [0,4194304] 0 2024-02-07T12:25:28.069 INFO:tasks.workunit.client.1.smithi138.stdout:4/122: stat f1c 0 2024-02-07T12:25:28.070 INFO:tasks.workunit.client.1.smithi138.stdout:7/339: mknod d0/c71 0 2024-02-07T12:25:28.074 INFO:tasks.workunit.client.1.smithi138.stdout:4/123: symlink d20/l2b 0 2024-02-07T12:25:28.075 INFO:tasks.workunit.client.1.smithi138.stdout:7/340: creat d0/d6/d1d/d24/f72 x:0 0 0 2024-02-07T12:25:28.076 INFO:tasks.workunit.client.1.smithi138.stdout:2/230: dwrite d3/dd/d14/d49/d25/d3d/f45 [0,4194304] 0 2024-02-07T12:25:28.077 INFO:tasks.workunit.client.1.smithi138.stdout:2/231: fdatasync d3/d4e/f50 0 2024-02-07T12:25:28.077 INFO:tasks.workunit.client.1.smithi138.stdout:2/232: write d3/f53 [229945,68749] 0 2024-02-07T12:25:28.077 INFO:tasks.workunit.client.1.smithi138.stdout:5/154: dwrite da/d22/d25/d2b/f31 [4194304,4194304] 0 2024-02-07T12:25:28.081 INFO:tasks.workunit.client.1.smithi138.stdout:2/233: mknod d3/dd/d14/c59 0 2024-02-07T12:25:28.081 INFO:tasks.workunit.client.1.smithi138.stdout:2/234: creat d3/dd/d14/f5a x:0 0 0 2024-02-07T12:25:28.086 INFO:tasks.workunit.client.1.smithi138.stdout:5/155: dread da/f15 [4194304,4194304] 0 2024-02-07T12:25:28.086 INFO:tasks.workunit.client.1.smithi138.stdout:5/156: stat f8 0 2024-02-07T12:25:28.086 INFO:tasks.workunit.client.1.smithi138.stdout:5/157: truncate da/f29 998278 0 2024-02-07T12:25:28.086 INFO:tasks.workunit.client.1.smithi138.stdout:5/158: dread - da/f1d zero size 2024-02-07T12:25:28.087 INFO:tasks.workunit.client.1.smithi138.stdout:5/159: readlink da/l1e 0 2024-02-07T12:25:28.093 INFO:tasks.workunit.client.1.smithi138.stdout:0/123: rename d4/f16 to d4/d9/de/f2a 0 2024-02-07T12:25:28.099 INFO:tasks.workunit.client.1.smithi138.stdout:7/341: dwrite d0/d6/d1d/d24/f4f [0,4194304] 0 2024-02-07T12:25:28.099 INFO:tasks.workunit.client.1.smithi138.stdout:2/235: mkdir d3/dd/d14/d49/d29/d5b 0 2024-02-07T12:25:28.099 INFO:tasks.workunit.client.1.smithi138.stdout:2/236: creat d3/dd/d19/d1f/f5c x:0 0 0 2024-02-07T12:25:28.101 INFO:tasks.workunit.client.1.smithi138.stdout:6/173: rename f1 to dc/d13/d1e/f30 0 2024-02-07T12:25:28.102 INFO:tasks.workunit.client.1.smithi138.stdout:7/342: mkdir d0/d6/d73 0 2024-02-07T12:25:28.102 INFO:tasks.workunit.client.1.smithi138.stdout:5/160: dwrite da/df/f11 [0,4194304] 0 2024-02-07T12:25:28.105 INFO:tasks.workunit.client.1.smithi138.stdout:2/237: link d3/dd/d14/d49/d29/f51 d3/dd/d19/d1f/f5d 0 2024-02-07T12:25:28.108 INFO:tasks.workunit.client.1.smithi138.stdout:4/124: rename l17 to d20/l2c 0 2024-02-07T12:25:28.108 INFO:tasks.workunit.client.1.smithi138.stdout:5/161: dread da/f15 [4194304,4194304] 0 2024-02-07T12:25:28.109 INFO:tasks.workunit.client.1.smithi138.stdout:6/174: mkdir dc/d31 0 2024-02-07T12:25:28.109 INFO:tasks.workunit.client.1.smithi138.stdout:6/175: chown l5 433980 1 2024-02-07T12:25:28.114 INFO:tasks.workunit.client.1.smithi138.stdout:4/125: stat d20/l2c 0 2024-02-07T12:25:28.115 INFO:tasks.workunit.client.1.smithi138.stdout:5/162: creat da/d22/d25/d2b/f36 x:0 0 0 2024-02-07T12:25:28.117 INFO:tasks.workunit.client.1.smithi138.stdout:6/176: mknod dc/c32 0 2024-02-07T12:25:28.120 INFO:tasks.workunit.client.1.smithi138.stdout:4/126: link c1f d20/c2d 0 2024-02-07T12:25:28.120 INFO:tasks.workunit.client.1.smithi138.stdout:4/127: creat d20/f2e x:0 0 0 2024-02-07T12:25:28.122 INFO:tasks.workunit.client.1.smithi138.stdout:5/163: mkdir da/d22/d37 0 2024-02-07T12:25:28.122 INFO:tasks.workunit.client.1.smithi138.stdout:5/164: write da/f1d [229317,4665] 0 2024-02-07T12:25:28.122 INFO:tasks.workunit.client.1.smithi138.stdout:6/177: getdents dc/d13 0 2024-02-07T12:25:28.124 INFO:tasks.workunit.client.1.smithi138.stdout:0/124: rename d4/d19 to d4/d9/de/d1d/d21/d2b 0 2024-02-07T12:25:28.126 INFO:tasks.workunit.client.1.smithi138.stdout:5/165: mknod da/d22/d25/d2b/c38 0 2024-02-07T12:25:28.126 INFO:tasks.workunit.client.1.smithi138.stdout:5/166: write da/fb [1879548,80448] 0 2024-02-07T12:25:28.127 INFO:tasks.workunit.client.1.smithi138.stdout:6/178: symlink dc/d13/d1e/d24/l33 0 2024-02-07T12:25:28.129 INFO:tasks.workunit.client.1.smithi138.stdout:7/343: rename d0/d8/f25 to d0/f74 0 2024-02-07T12:25:28.129 INFO:tasks.workunit.client.1.smithi138.stdout:7/344: fdatasync d0/d8/d11/f6d 0 2024-02-07T12:25:28.129 INFO:tasks.workunit.client.1.smithi138.stdout:7/345: fdatasync d0/d6/d3e/f48 0 2024-02-07T12:25:28.130 INFO:tasks.workunit.client.1.smithi138.stdout:5/167: symlink da/d34/l39 0 2024-02-07T12:25:28.131 INFO:tasks.workunit.client.1.smithi138.stdout:5/168: fdatasync da/f29 0 2024-02-07T12:25:28.132 INFO:tasks.workunit.client.1.smithi138.stdout:6/179: link dc/d13/f1d dc/d13/f34 0 2024-02-07T12:25:28.134 INFO:tasks.workunit.client.1.smithi138.stdout:7/346: creat d0/d6/d73/f75 x:0 0 0 2024-02-07T12:25:28.135 INFO:tasks.workunit.client.1.smithi138.stdout:5/169: read da/f29 [934840,32272] 0 2024-02-07T12:25:28.135 INFO:tasks.workunit.client.1.smithi138.stdout:6/180: mkdir dc/d13/d1e/d35 0 2024-02-07T12:25:28.137 INFO:tasks.workunit.client.1.smithi138.stdout:2/238: dwrite d3/dd/d14/d49/f1b [0,4194304] 0 2024-02-07T12:25:28.137 INFO:tasks.workunit.client.1.smithi138.stdout:2/239: truncate d3/dd/d14/d49/f41 228375 0 2024-02-07T12:25:28.137 INFO:tasks.workunit.client.1.smithi138.stdout:7/347: unlink d0/d8/d11/d1f/l2f 0 2024-02-07T12:25:28.138 INFO:tasks.workunit.client.1.smithi138.stdout:6/181: creat dc/d13/d1e/d35/f36 x:0 0 0 2024-02-07T12:25:28.140 INFO:tasks.workunit.client.1.smithi138.stdout:7/348: mkdir d0/d6/d76 0 2024-02-07T12:25:28.145 INFO:tasks.workunit.client.1.smithi138.stdout:4/128: dwrite f14 [0,4194304] 0 2024-02-07T12:25:28.146 INFO:tasks.workunit.client.1.smithi138.stdout:0/125: dwrite d4/d9/db/f20 [0,4194304] 0 2024-02-07T12:25:28.146 INFO:tasks.workunit.client.1.smithi138.stdout:0/126: write d4/d9/de/d1d/d21/d2b/f28 [1026945,85745] 0 2024-02-07T12:25:28.149 INFO:tasks.workunit.client.1.smithi138.stdout:2/240: dread d3/dd/d19/d1f/d37/f3b [0,4194304] 0 2024-02-07T12:25:28.149 INFO:tasks.workunit.client.1.smithi138.stdout:0/127: symlink d4/d9/db/l2c 0 2024-02-07T12:25:28.152 INFO:tasks.workunit.client.1.smithi138.stdout:0/128: creat d4/d9/de/d1d/d21/d2b/f2d x:0 0 0 2024-02-07T12:25:28.153 INFO:tasks.workunit.client.1.smithi138.stdout:4/129: dread fb [0,4194304] 0 2024-02-07T12:25:28.153 INFO:tasks.workunit.client.1.smithi138.stdout:4/130: creat d20/f2f x:0 0 0 2024-02-07T12:25:28.154 INFO:tasks.workunit.client.1.smithi138.stdout:0/129: rename f3 to d4/d9/de/d1d/d21/d2b/f2e 0 2024-02-07T12:25:28.158 INFO:tasks.workunit.client.1.smithi138.stdout:2/241: dread d3/dd/d14/d49/d25/d3d/f45 [0,4194304] 0 2024-02-07T12:25:28.158 INFO:tasks.workunit.client.1.smithi138.stdout:0/130: creat d4/d9/f2f x:0 0 0 2024-02-07T12:25:28.159 INFO:tasks.workunit.client.1.smithi138.stdout:6/182: dwrite dc/d13/f1a [0,4194304] 0 2024-02-07T12:25:28.160 INFO:tasks.workunit.client.1.smithi138.stdout:0/131: mknod d4/d9/c30 0 2024-02-07T12:25:28.162 INFO:tasks.workunit.client.1.smithi138.stdout:2/242: getdents d3/dd/d19/d1f 0 2024-02-07T12:25:28.162 INFO:tasks.workunit.client.1.smithi138.stdout:4/131: write f14 [1307139,89017] 0 2024-02-07T12:25:28.165 INFO:tasks.workunit.client.1.smithi138.stdout:4/132: dread d20/f21 [0,4194304] 0 2024-02-07T12:25:28.165 INFO:tasks.workunit.client.1.smithi138.stdout:4/133: write d20/f21 [321069,28812] 0 2024-02-07T12:25:28.165 INFO:tasks.workunit.client.1.smithi138.stdout:4/134: truncate f1c 459819 0 2024-02-07T12:25:28.168 INFO:tasks.workunit.client.1.smithi138.stdout:2/243: write d3/dd/d19/d44/f54 [2477121,104856] 0 2024-02-07T12:25:28.168 INFO:tasks.workunit.client.1.smithi138.stdout:4/135: dread f15 [0,4194304] 0 2024-02-07T12:25:28.168 INFO:tasks.workunit.client.1.smithi138.stdout:4/136: readlink l5 0 2024-02-07T12:25:28.168 INFO:tasks.workunit.client.1.smithi138.stdout:4/137: dread - d20/f28 zero size 2024-02-07T12:25:28.172 INFO:tasks.workunit.client.1.smithi138.stdout:6/183: creat dc/d31/f37 x:0 0 0 2024-02-07T12:25:28.175 INFO:tasks.workunit.client.1.smithi138.stdout:2/244: mknod d3/dd/d14/d49/d25/d3d/d4f/c5e 0 2024-02-07T12:25:28.179 INFO:tasks.workunit.client.1.smithi138.stdout:2/245: mkdir d3/dd/d14/d49/d25/d3d/d5f 0 2024-02-07T12:25:28.180 INFO:tasks.workunit.client.1.smithi138.stdout:2/246: dread d3/dd/d19/f42 [0,4194304] 0 2024-02-07T12:25:28.180 INFO:tasks.workunit.client.1.smithi138.stdout:2/247: fdatasync d3/dd/f2e 0 2024-02-07T12:25:28.180 INFO:tasks.workunit.client.1.smithi138.stdout:2/248: write f1 [3367311,86454] 0 2024-02-07T12:25:28.182 INFO:tasks.workunit.client.1.smithi138.stdout:0/132: rmdir d4/d9/de 39 2024-02-07T12:25:28.184 INFO:tasks.workunit.client.1.smithi138.stdout:0/133: fsync d4/d9/f2f 0 2024-02-07T12:25:28.184 INFO:tasks.workunit.client.1.smithi138.stdout:4/138: rmdir d20 39 2024-02-07T12:25:28.184 INFO:tasks.workunit.client.1.smithi138.stdout:4/139: chown ce 25 1 2024-02-07T12:25:28.184 INFO:tasks.workunit.client.1.smithi138.stdout:4/140: fdatasync f8 0 2024-02-07T12:25:28.184 INFO:tasks.workunit.client.1.smithi138.stdout:4/141: chown d20/c27 963319561 1 2024-02-07T12:25:28.186 INFO:tasks.workunit.client.1.smithi138.stdout:0/134: link d4/f6 d4/d9/de/d1d/d21/f31 0 2024-02-07T12:25:28.186 INFO:tasks.workunit.client.1.smithi138.stdout:0/135: write d4/d9/de/d1d/d21/f31 [505710,105840] 0 2024-02-07T12:25:28.186 INFO:tasks.workunit.client.1.smithi138.stdout:0/136: stat d4/d9/c30 0 2024-02-07T12:25:28.187 INFO:tasks.workunit.client.1.smithi138.stdout:2/249: read d3/dd/d19/d1f/f47 [816664,4893] 0 2024-02-07T12:25:28.187 INFO:tasks.workunit.client.1.smithi138.stdout:4/142: creat d20/f30 x:0 0 0 2024-02-07T12:25:28.189 INFO:tasks.workunit.client.1.smithi138.stdout:2/250: symlink d3/dd/d14/l60 0 2024-02-07T12:25:28.189 INFO:tasks.workunit.client.1.smithi138.stdout:2/251: write d3/f53 [712044,20360] 0 2024-02-07T12:25:28.189 INFO:tasks.workunit.client.1.smithi138.stdout:2/252: readlink d3/dd/d19/d44/l4a 0 2024-02-07T12:25:28.190 INFO:tasks.workunit.client.1.smithi138.stdout:4/143: link f3 d20/f31 0 2024-02-07T12:25:28.191 INFO:tasks.workunit.client.1.smithi138.stdout:6/184: dwrite dc/d13/d1e/f30 [0,4194304] 0 2024-02-07T12:25:28.192 INFO:tasks.workunit.client.1.smithi138.stdout:4/144: truncate f11 185959 0 2024-02-07T12:25:28.192 INFO:tasks.workunit.client.1.smithi138.stdout:1/84: sync 2024-02-07T12:25:28.194 INFO:tasks.workunit.client.1.smithi138.stdout:0/137: dread d4/d9/de/f2a [0,4194304] 0 2024-02-07T12:25:28.194 INFO:tasks.workunit.client.1.smithi138.stdout:0/138: write d4/d9/f12 [715879,74294] 0 2024-02-07T12:25:28.196 INFO:tasks.workunit.client.1.smithi138.stdout:0/139: mknod d4/d9/de/d1d/d21/d2b/c32 0 2024-02-07T12:25:28.199 INFO:tasks.workunit.client.1.smithi138.stdout:2/253: dread d3/dd/d14/d49/f1b [0,4194304] 0 2024-02-07T12:25:28.199 INFO:tasks.workunit.client.1.smithi138.stdout:2/254: creat d3/dd/d19/d1f/d46/f61 x:0 0 0 2024-02-07T12:25:28.202 INFO:tasks.workunit.client.1.smithi138.stdout:6/185: dread dc/d13/f1d [0,4194304] 0 2024-02-07T12:25:28.204 INFO:tasks.workunit.client.1.smithi138.stdout:2/255: truncate d3/dd/d19/d1f/f47 2046976 0 2024-02-07T12:25:28.205 INFO:tasks.workunit.client.1.smithi138.stdout:6/186: mkdir dc/d31/d38 0 2024-02-07T12:25:28.207 INFO:tasks.workunit.client.1.smithi138.stdout:2/256: mknod d3/dd/d14/c62 0 2024-02-07T12:25:28.209 INFO:tasks.workunit.client.1.smithi138.stdout:2/257: rmdir d3/dd/d14/d49/d29 39 2024-02-07T12:25:28.212 INFO:tasks.workunit.client.1.smithi138.stdout:2/258: unlink d3/dd/d14/d49/f41 0 2024-02-07T12:25:28.212 INFO:tasks.workunit.client.1.smithi138.stdout:1/85: dwrite d5/d8/da/f11 [8388608,4194304] 0 2024-02-07T12:25:28.213 INFO:tasks.workunit.client.1.smithi138.stdout:2/259: symlink d3/dd/d19/d44/l63 0 2024-02-07T12:25:28.216 INFO:tasks.workunit.client.1.smithi138.stdout:1/86: creat d5/f17 x:0 0 0 2024-02-07T12:25:28.216 INFO:tasks.workunit.client.1.smithi138.stdout:1/87: fdatasync f3 0 2024-02-07T12:25:28.216 INFO:tasks.workunit.client.1.smithi138.stdout:4/145: dwrite d20/f25 [0,4194304] 0 2024-02-07T12:25:28.216 INFO:tasks.workunit.client.1.smithi138.stdout:4/146: chown d20/f21 24371 1 2024-02-07T12:25:28.217 INFO:tasks.workunit.client.1.smithi138.stdout:4/147: creat d20/f32 x:0 0 0 2024-02-07T12:25:28.217 INFO:tasks.workunit.client.1.smithi138.stdout:4/148: write f19 [487806,73688] 0 2024-02-07T12:25:28.219 INFO:tasks.workunit.client.1.smithi138.stdout:4/149: dread f15 [0,4194304] 0 2024-02-07T12:25:28.219 INFO:tasks.workunit.client.1.smithi138.stdout:4/150: chown lc 15121 1 2024-02-07T12:25:28.219 INFO:tasks.workunit.client.1.smithi138.stdout:4/151: creat d20/f33 x:0 0 0 2024-02-07T12:25:28.219 INFO:tasks.workunit.client.1.smithi138.stdout:4/152: chown d20/f33 418 1 2024-02-07T12:25:28.220 INFO:tasks.workunit.client.1.smithi138.stdout:0/140: dwrite d4/d9/de/d1d/d21/d2b/f28 [0,4194304] 0 2024-02-07T12:25:28.221 INFO:tasks.workunit.client.1.smithi138.stdout:4/153: mkdir d20/d34 0 2024-02-07T12:25:28.226 INFO:tasks.workunit.client.1.smithi138.stdout:2/260: dread d3/dd/d14/d49/d25/d3d/f3e [0,4194304] 0 2024-02-07T12:25:28.226 INFO:tasks.workunit.client.1.smithi138.stdout:4/154: link d20/l2a d20/d34/l35 0 2024-02-07T12:25:28.227 INFO:tasks.workunit.client.1.smithi138.stdout:4/155: mkdir d20/d34/d36 0 2024-02-07T12:25:28.227 INFO:tasks.workunit.client.1.smithi138.stdout:1/88: write d5/d8/da/fc [1795897,86324] 0 2024-02-07T12:25:28.230 INFO:tasks.workunit.client.1.smithi138.stdout:4/156: creat d20/d34/f37 x:0 0 0 2024-02-07T12:25:28.242 INFO:tasks.workunit.client.1.smithi138.stdout:4/157: read f16 [1429809,115734] 0 2024-02-07T12:25:28.244 INFO:tasks.workunit.client.1.smithi138.stdout:4/158: creat d20/d34/d36/f38 x:0 0 0 2024-02-07T12:25:28.244 INFO:tasks.workunit.client.1.smithi138.stdout:4/159: chown d20/f28 4975 1 2024-02-07T12:25:28.248 INFO:tasks.workunit.client.1.smithi138.stdout:1/89: dwrite d5/f9 [4194304,4194304] 0 2024-02-07T12:25:28.248 INFO:tasks.workunit.client.1.smithi138.stdout:1/90: dread - d5/f16 zero size 2024-02-07T12:25:28.248 INFO:tasks.workunit.client.1.smithi138.stdout:1/91: truncate d5/f17 490029 0 2024-02-07T12:25:28.248 INFO:tasks.workunit.client.1.smithi138.stdout:1/92: stat d5/d8/ff 0 2024-02-07T12:25:28.248 INFO:tasks.workunit.client.1.smithi138.stdout:1/93: write d5/f12 [4841289,72403] 0 2024-02-07T12:25:28.249 INFO:tasks.workunit.client.1.smithi138.stdout:1/94: truncate d5/f12 5166414 0 2024-02-07T12:25:28.249 INFO:tasks.workunit.client.1.smithi138.stdout:6/187: dwrite dc/d13/d1e/d35/f36 [0,4194304] 0 2024-02-07T12:25:28.249 INFO:tasks.workunit.client.1.smithi138.stdout:6/188: dread - dc/d31/f37 zero size 2024-02-07T12:25:28.250 INFO:tasks.workunit.client.1.smithi138.stdout:6/189: write dc/d13/f19 [2134930,90220] 0 2024-02-07T12:25:28.250 INFO:tasks.workunit.client.1.smithi138.stdout:6/190: chown dc/fd 453 1 2024-02-07T12:25:28.250 INFO:tasks.workunit.client.1.smithi138.stdout:6/191: chown dc/d13/d1e/c21 12 1 2024-02-07T12:25:28.250 INFO:tasks.workunit.client.1.smithi138.stdout:6/192: fdatasync dc/d13/f34 0 2024-02-07T12:25:28.251 INFO:tasks.workunit.client.1.smithi138.stdout:1/95: rmdir d5/d8 39 2024-02-07T12:25:28.251 INFO:tasks.workunit.client.1.smithi138.stdout:1/96: write f4 [12661668,25187] 0 2024-02-07T12:25:28.252 INFO:tasks.workunit.client.1.smithi138.stdout:0/141: dwrite f1 [0,4194304] 0 2024-02-07T12:25:28.252 INFO:tasks.workunit.client.1.smithi138.stdout:2/261: dwrite d3/dd/d14/f26 [0,4194304] 0 2024-02-07T12:25:28.254 INFO:tasks.workunit.client.1.smithi138.stdout:4/160: getdents d20/d34/d36 0 2024-02-07T12:25:28.254 INFO:tasks.workunit.client.1.smithi138.stdout:4/161: chown c1f 35 1 2024-02-07T12:25:28.254 INFO:tasks.workunit.client.1.smithi138.stdout:4/162: creat d20/f39 x:0 0 0 2024-02-07T12:25:28.256 INFO:tasks.workunit.client.1.smithi138.stdout:6/193: creat dc/d13/f39 x:0 0 0 2024-02-07T12:25:28.257 INFO:tasks.workunit.client.1.smithi138.stdout:1/97: mknod d5/d8/da/d15/c18 0 2024-02-07T12:25:28.257 INFO:tasks.workunit.client.1.smithi138.stdout:1/98: fdatasync f3 0 2024-02-07T12:25:28.262 INFO:tasks.workunit.client.1.smithi138.stdout:2/262: rename d3/dd/d19/d1f/d46/f61 to d3/dd/d14/d49/d25/d3d/d5f/f64 0 2024-02-07T12:25:28.263 INFO:tasks.workunit.client.1.smithi138.stdout:2/263: dread d3/dd/d19/f42 [0,4194304] 0 2024-02-07T12:25:28.263 INFO:tasks.workunit.client.1.smithi138.stdout:2/264: chown d3/dd/d14/d49/f1b 346975234 1 2024-02-07T12:25:28.264 INFO:tasks.workunit.client.1.smithi138.stdout:2/265: dread d3/dd/d14/f2c [0,4194304] 0 2024-02-07T12:25:28.265 INFO:tasks.workunit.client.1.smithi138.stdout:4/163: creat d20/d34/d36/f3a x:0 0 0 2024-02-07T12:25:28.265 INFO:tasks.workunit.client.1.smithi138.stdout:4/164: dread - d20/f33 zero size 2024-02-07T12:25:28.265 INFO:tasks.workunit.client.1.smithi138.stdout:4/165: chown d20/d34 408 1 2024-02-07T12:25:28.265 INFO:tasks.workunit.client.1.smithi138.stdout:4/166: write d20/d34/d36/f3a [803108,51160] 0 2024-02-07T12:25:28.266 INFO:tasks.workunit.client.1.smithi138.stdout:6/194: link dc/d13/f1b dc/d31/d38/f3a 0 2024-02-07T12:25:28.266 INFO:tasks.workunit.client.1.smithi138.stdout:6/195: fdatasync f6 0 2024-02-07T12:25:28.267 INFO:tasks.workunit.client.1.smithi138.stdout:1/99: symlink d5/d8/da/d15/l19 0 2024-02-07T12:25:28.268 INFO:tasks.workunit.client.1.smithi138.stdout:0/142: dwrite d4/f6 [0,4194304] 0 2024-02-07T12:25:28.272 INFO:tasks.workunit.client.1.smithi138.stdout:0/143: dread d4/d9/f12 [0,4194304] 0 2024-02-07T12:25:28.272 INFO:tasks.workunit.client.1.smithi138.stdout:0/144: readlink d4/d9/de/l1e 0 2024-02-07T12:25:28.275 INFO:tasks.workunit.client.1.smithi138.stdout:6/196: write dc/fd [1345970,13678] 0 2024-02-07T12:25:28.276 INFO:tasks.workunit.client.1.smithi138.stdout:2/266: mknod d3/dd/d14/d49/c65 0 2024-02-07T12:25:28.277 INFO:tasks.workunit.client.1.smithi138.stdout:4/167: symlink d20/d34/l3b 0 2024-02-07T12:25:28.279 INFO:tasks.workunit.client.1.smithi138.stdout:0/145: dread d4/d9/de/d1d/d21/d2b/f28 [0,4194304] 0 2024-02-07T12:25:28.279 INFO:tasks.workunit.client.1.smithi138.stdout:0/146: fdatasync d4/d9/de/f1c 0 2024-02-07T12:25:28.280 INFO:tasks.workunit.client.1.smithi138.stdout:4/168: dread fb [0,4194304] 0 2024-02-07T12:25:28.282 INFO:tasks.workunit.client.1.smithi138.stdout:0/147: write d4/f5 [1881587,42656] 0 2024-02-07T12:25:28.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:28 smithi138 ceph-mon[35528]: pgmap v255: 65 pgs: 65 active+clean; 331 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 26 MiB/s wr, 405 op/s 2024-02-07T12:25:28.288 INFO:tasks.workunit.client.1.smithi138.stdout:6/197: rename dc/d13/d1e/f25 to dc/d31/d38/f3b 0 2024-02-07T12:25:28.289 INFO:tasks.workunit.client.1.smithi138.stdout:2/267: mknod d3/dd/d19/d44/c66 0 2024-02-07T12:25:28.289 INFO:tasks.workunit.client.1.smithi138.stdout:2/268: chown d3/dd/d19/l8 3 1 2024-02-07T12:25:28.291 INFO:tasks.workunit.client.1.smithi138.stdout:1/100: rmdir d5 39 2024-02-07T12:25:28.291 INFO:tasks.workunit.client.1.smithi138.stdout:1/101: chown d5/d8/f14 1350070685 1 2024-02-07T12:25:28.291 INFO:tasks.workunit.client.1.smithi138.stdout:1/102: fsync f4 0 2024-02-07T12:25:28.291 INFO:tasks.workunit.client.1.smithi138.stdout:1/103: write f4 [2680602,73832] 0 2024-02-07T12:25:28.294 INFO:tasks.workunit.client.1.smithi138.stdout:4/169: link d20/f32 d20/d34/d36/f3c 0 2024-02-07T12:25:28.294 INFO:tasks.workunit.client.1.smithi138.stdout:4/170: creat d20/f3d x:0 0 0 2024-02-07T12:25:28.296 INFO:tasks.workunit.client.1.smithi138.stdout:6/198: creat dc/d13/d1e/d24/f3c x:0 0 0 2024-02-07T12:25:28.299 INFO:tasks.workunit.client.1.smithi138.stdout:1/104: rename d5/f7 to d5/f1a 0 2024-02-07T12:25:28.304 INFO:tasks.workunit.client.1.smithi138.stdout:6/199: creat dc/d31/d38/f3d x:0 0 0 2024-02-07T12:25:28.304 INFO:tasks.workunit.client.1.smithi138.stdout:6/200: creat dc/d31/f3e x:0 0 0 2024-02-07T12:25:28.304 INFO:tasks.workunit.client.1.smithi138.stdout:2/269: dwrite d3/dd/d14/f22 [4194304,4194304] 0 2024-02-07T12:25:28.305 INFO:tasks.workunit.client.1.smithi138.stdout:6/201: mkdir dc/d31/d3f 0 2024-02-07T12:25:28.305 INFO:tasks.workunit.client.1.smithi138.stdout:6/202: truncate dc/d31/d38/f3d 1029376 0 2024-02-07T12:25:28.307 INFO:tasks.workunit.client.1.smithi138.stdout:2/270: symlink d3/dd/d19/d1f/d46/l67 0 2024-02-07T12:25:28.309 INFO:tasks.workunit.client.1.smithi138.stdout:1/105: dread d5/f9 [4194304,4194304] 0 2024-02-07T12:25:28.309 INFO:tasks.workunit.client.1.smithi138.stdout:1/106: fdatasync f3 0 2024-02-07T12:25:28.309 INFO:tasks.workunit.client.1.smithi138.stdout:0/148: dwrite d4/d9/f2f [0,4194304] 0 2024-02-07T12:25:28.309 INFO:tasks.workunit.client.1.smithi138.stdout:0/149: write d4/f1f [876494,43145] 0 2024-02-07T12:25:28.313 INFO:tasks.workunit.client.1.smithi138.stdout:2/271: write d3/dd/d14/d49/f1b [407352,82136] 0 2024-02-07T12:25:28.313 INFO:tasks.workunit.client.1.smithi138.stdout:2/272: truncate d3/dd/d19/d1f/f5c 296106 0 2024-02-07T12:25:28.313 INFO:tasks.workunit.client.1.smithi138.stdout:2/273: fsync d3/dd/d14/d49/d25/d3d/d5f/f64 0 2024-02-07T12:25:28.313 INFO:tasks.workunit.client.1.smithi138.stdout:4/171: rmdir d20/d34/d36 39 2024-02-07T12:25:28.313 INFO:tasks.workunit.client.1.smithi138.stdout:4/172: write f15 [2403748,129905] 0 2024-02-07T12:25:28.314 INFO:tasks.workunit.client.1.smithi138.stdout:4/173: chown f19 20 1 2024-02-07T12:25:28.315 INFO:tasks.workunit.client.1.smithi138.stdout:6/203: rmdir dc/d13/d1e/d24 39 2024-02-07T12:25:28.315 INFO:tasks.workunit.client.1.smithi138.stdout:6/204: chown dc/d13/d1e 81790674 1 2024-02-07T12:25:28.319 INFO:tasks.workunit.client.1.smithi138.stdout:1/107: truncate d5/d8/f14 5448598 0 2024-02-07T12:25:28.320 INFO:tasks.workunit.client.1.smithi138.stdout:0/150: getdents d4/d9/de/d1d/d21/d2b 0 2024-02-07T12:25:28.321 INFO:tasks.workunit.client.1.smithi138.stdout:2/274: rmdir d3/dd/d19/d1f/d37 39 2024-02-07T12:25:28.322 INFO:tasks.workunit.client.1.smithi138.stdout:2/275: readlink d3/dd/d14/d49/d25/l58 0 2024-02-07T12:25:28.323 INFO:tasks.workunit.client.1.smithi138.stdout:4/174: mknod d20/c3e 0 2024-02-07T12:25:28.323 INFO:tasks.workunit.client.1.smithi138.stdout:4/175: creat d20/f3f x:0 0 0 2024-02-07T12:25:28.323 INFO:tasks.workunit.client.1.smithi138.stdout:4/176: creat d20/f40 x:0 0 0 2024-02-07T12:25:28.323 INFO:tasks.workunit.client.1.smithi138.stdout:4/177: truncate d20/f3d 321887 0 2024-02-07T12:25:28.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:28 smithi047 ceph-mon[28972]: pgmap v255: 65 pgs: 65 active+clean; 331 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 26 MiB/s wr, 405 op/s 2024-02-07T12:25:28.331 INFO:tasks.workunit.client.1.smithi138.stdout:4/178: unlink d20/f29 0 2024-02-07T12:25:28.331 INFO:tasks.workunit.client.1.smithi138.stdout:8/266: sync 2024-02-07T12:25:28.331 INFO:tasks.workunit.client.1.smithi138.stdout:9/192: sync 2024-02-07T12:25:28.332 INFO:tasks.workunit.client.1.smithi138.stdout:6/205: getdents dc/d13/d1e 0 2024-02-07T12:25:28.334 INFO:tasks.workunit.client.1.smithi138.stdout:0/151: getdents d4/d9 0 2024-02-07T12:25:28.337 INFO:tasks.workunit.client.1.smithi138.stdout:2/276: rename d3/dd/d14/f22 to d3/dd/d14/d49/d25/d3d/d4f/f68 0 2024-02-07T12:25:28.338 INFO:tasks.workunit.client.1.smithi138.stdout:0/152: fdatasync d4/f1f 0 2024-02-07T12:25:28.338 INFO:tasks.workunit.client.1.smithi138.stdout:1/108: dwrite d5/d8/fd [12582912,4194304] 0 2024-02-07T12:25:28.338 INFO:tasks.workunit.client.1.smithi138.stdout:6/206: write dc/d13/f34 [3799900,111943] 0 2024-02-07T12:25:28.338 INFO:tasks.workunit.client.1.smithi138.stdout:6/207: fdatasync dc/d13/d1e/f30 0 2024-02-07T12:25:28.338 INFO:tasks.workunit.client.1.smithi138.stdout:6/208: creat dc/d13/d1e/d35/f40 x:0 0 0 2024-02-07T12:25:28.338 INFO:tasks.workunit.client.1.smithi138.stdout:6/209: read dc/d13/f34 [4078534,85509] 0 2024-02-07T12:25:28.338 INFO:tasks.workunit.client.1.smithi138.stdout:4/179: creat d20/d34/d36/f41 x:0 0 0 2024-02-07T12:25:28.339 INFO:tasks.workunit.client.1.smithi138.stdout:8/267: creat d1/de/d11/d17/d2e/d49/f56 x:0 0 0 2024-02-07T12:25:28.339 INFO:tasks.workunit.client.1.smithi138.stdout:8/268: read - d1/de/d11/d17/d2e/d3a/f41 zero size 2024-02-07T12:25:28.340 INFO:tasks.workunit.client.1.smithi138.stdout:8/269: dread d1/de/d11/d17/d2e/d49/f19 [0,4194304] 0 2024-02-07T12:25:28.346 INFO:tasks.workunit.client.1.smithi138.stdout:0/153: dread d4/d9/fa [0,4194304] 0 2024-02-07T12:25:28.346 INFO:tasks.workunit.client.1.smithi138.stdout:0/154: readlink d4/l8 0 2024-02-07T12:25:28.346 INFO:tasks.workunit.client.1.smithi138.stdout:0/155: write d4/d9/de/f24 [718069,96895] 0 2024-02-07T12:25:28.349 INFO:tasks.workunit.client.1.smithi138.stdout:4/180: link lf d20/l42 0 2024-02-07T12:25:28.349 INFO:tasks.workunit.client.1.smithi138.stdout:4/181: fdatasync d20/d34/d36/f41 0 2024-02-07T12:25:28.351 INFO:tasks.workunit.client.1.smithi138.stdout:4/182: dread d20/d34/d36/f3a [0,4194304] 0 2024-02-07T12:25:28.351 INFO:tasks.workunit.client.1.smithi138.stdout:9/193: rename d0/d6/d8/d1d/dd/d1f/f1a to d0/d6/d8/d3e/f43 0 2024-02-07T12:25:28.351 INFO:tasks.workunit.client.1.smithi138.stdout:9/194: write d0/d6/f3c [1435822,67596] 0 2024-02-07T12:25:28.353 INFO:tasks.workunit.client.1.smithi138.stdout:2/277: getdents d3/dd/d14/d49 0 2024-02-07T12:25:28.355 INFO:tasks.workunit.client.1.smithi138.stdout:8/270: mkdir d1/de/d11/d17/d2e/d49/d4c/d57 0 2024-02-07T12:25:28.356 INFO:tasks.workunit.client.1.smithi138.stdout:0/156: mkdir d4/d9/d33 0 2024-02-07T12:25:28.358 INFO:tasks.workunit.client.1.smithi138.stdout:2/278: dread d3/dd/d14/d49/f1b [4194304,4194304] 0 2024-02-07T12:25:28.359 INFO:tasks.workunit.client.1.smithi138.stdout:4/183: link f1c d20/d34/d36/f43 0 2024-02-07T12:25:28.359 INFO:tasks.workunit.client.1.smithi138.stdout:4/184: dread - d20/f3f zero size 2024-02-07T12:25:28.361 INFO:tasks.workunit.client.1.smithi138.stdout:1/109: rename d5/l6 to d5/d8/da/d15/l1b 0 2024-02-07T12:25:28.361 INFO:tasks.workunit.client.1.smithi138.stdout:1/110: fsync d5/d8/ff 0 2024-02-07T12:25:28.364 INFO:tasks.workunit.client.1.smithi138.stdout:8/271: dread d1/de/d11/d17/d2e/d49/f3d [0,4194304] 0 2024-02-07T12:25:28.364 INFO:tasks.workunit.client.1.smithi138.stdout:8/272: chown d1/de/d11 16 1 2024-02-07T12:25:28.364 INFO:tasks.workunit.client.1.smithi138.stdout:8/273: write d1/de/d11/f43 [880703,25078] 0 2024-02-07T12:25:28.364 INFO:tasks.workunit.client.1.smithi138.stdout:8/274: chown d1/f44 3192 1 2024-02-07T12:25:28.364 INFO:tasks.workunit.client.1.smithi138.stdout:8/275: chown d1/de/d11/d17/d3e/c46 246 1 2024-02-07T12:25:28.364 INFO:tasks.workunit.client.1.smithi138.stdout:0/157: creat d4/d9/de/d1d/d21/d2b/f34 x:0 0 0 2024-02-07T12:25:28.366 INFO:tasks.workunit.client.1.smithi138.stdout:2/279: rename d3/dd/d19/d44/f54 to d3/dd/d19/d44/f69 0 2024-02-07T12:25:28.366 INFO:tasks.workunit.client.1.smithi138.stdout:2/280: creat d3/f6a x:0 0 0 2024-02-07T12:25:28.366 INFO:tasks.workunit.client.1.smithi138.stdout:2/281: write d3/dd/d19/d1f/f5c [618144,26463] 0 2024-02-07T12:25:28.366 INFO:tasks.workunit.client.1.smithi138.stdout:2/282: truncate f0 2082410 0 2024-02-07T12:25:28.367 INFO:tasks.workunit.client.1.smithi138.stdout:4/185: unlink l5 0 2024-02-07T12:25:28.369 INFO:tasks.workunit.client.1.smithi138.stdout:6/210: rename dc/d13/d1e/f2a to dc/d31/d3f/f41 0 2024-02-07T12:25:28.369 INFO:tasks.workunit.client.1.smithi138.stdout:1/111: rmdir d5/d8/da/d15 39 2024-02-07T12:25:28.370 INFO:tasks.workunit.client.1.smithi138.stdout:8/276: mkdir d1/de/d11/d17/d58 0 2024-02-07T12:25:28.371 INFO:tasks.workunit.client.1.smithi138.stdout:8/277: truncate d1/de/d11/d17/d2e/d49/d4c/f51 602094 0 2024-02-07T12:25:28.371 INFO:tasks.workunit.client.1.smithi138.stdout:8/278: readlink d1/de/d11/l14 0 2024-02-07T12:25:28.371 INFO:tasks.workunit.client.1.smithi138.stdout:1/112: dread d5/f17 [0,4194304] 0 2024-02-07T12:25:28.371 INFO:tasks.workunit.client.1.smithi138.stdout:0/158: symlink d4/l35 0 2024-02-07T12:25:28.373 INFO:tasks.workunit.client.1.smithi138.stdout:2/283: rename d3/dd/f4b to d3/dd/d14/d49/d25/d3d/f6b 0 2024-02-07T12:25:28.374 INFO:tasks.workunit.client.1.smithi138.stdout:8/279: mkdir d1/de/d59 0 2024-02-07T12:25:28.375 INFO:tasks.workunit.client.1.smithi138.stdout:1/113: creat d5/d8/f1c x:0 0 0 2024-02-07T12:25:28.376 INFO:tasks.workunit.client.1.smithi138.stdout:6/211: write f6 [652614,95352] 0 2024-02-07T12:25:28.376 INFO:tasks.workunit.client.1.smithi138.stdout:0/159: creat d4/d9/de/d1d/f36 x:0 0 0 2024-02-07T12:25:28.378 INFO:tasks.workunit.client.1.smithi138.stdout:3/300: sync 2024-02-07T12:25:28.378 INFO:tasks.workunit.client.1.smithi138.stdout:8/280: creat d1/de/d11/d17/d3e/f5a x:0 0 0 2024-02-07T12:25:28.378 INFO:tasks.workunit.client.1.smithi138.stdout:3/301: write d5/d26/d28/f5d [4332235,46862] 0 2024-02-07T12:25:28.381 INFO:tasks.workunit.client.1.smithi138.stdout:8/281: link d1/f13 d1/de/d11/f5b 0 2024-02-07T12:25:28.382 INFO:tasks.workunit.client.1.smithi138.stdout:8/282: creat d1/de/d11/d17/d2e/d3a/d50/f5c x:0 0 0 2024-02-07T12:25:28.382 INFO:tasks.workunit.client.1.smithi138.stdout:8/283: fsync f0 0 2024-02-07T12:25:28.385 INFO:tasks.workunit.client.1.smithi138.stdout:4/186: dwrite d20/f25 [0,4194304] 0 2024-02-07T12:25:28.385 INFO:tasks.workunit.client.1.smithi138.stdout:8/284: unlink d1/de/d11/l45 0 2024-02-07T12:25:28.385 INFO:tasks.workunit.client.1.smithi138.stdout:0/160: dread d4/d9/de/f2a [0,4194304] 0 2024-02-07T12:25:28.387 INFO:tasks.workunit.client.1.smithi138.stdout:6/212: dread dc/d13/d1e/d35/f36 [0,4194304] 0 2024-02-07T12:25:28.389 INFO:tasks.workunit.client.1.smithi138.stdout:8/285: unlink d1/de/d11/d17/d2e/d3a/f41 0 2024-02-07T12:25:28.389 INFO:tasks.workunit.client.1.smithi138.stdout:0/161: rmdir d4/d9 39 2024-02-07T12:25:28.389 INFO:tasks.workunit.client.1.smithi138.stdout:8/286: write d1/de/d11/d17/f24 [5081200,52055] 0 2024-02-07T12:25:28.389 INFO:tasks.workunit.client.1.smithi138.stdout:8/287: readlink d1/l4f 0 2024-02-07T12:25:28.391 INFO:tasks.workunit.client.1.smithi138.stdout:6/213: unlink dc/d13/d1e/d35/f36 0 2024-02-07T12:25:28.391 INFO:tasks.workunit.client.1.smithi138.stdout:6/214: write dc/d31/d3f/f41 [402899,124933] 0 2024-02-07T12:25:28.391 INFO:tasks.workunit.client.1.smithi138.stdout:6/215: creat dc/d13/f42 x:0 0 0 2024-02-07T12:25:28.392 INFO:tasks.workunit.client.1.smithi138.stdout:0/162: mkdir d4/d9/d37 0 2024-02-07T12:25:28.392 INFO:tasks.workunit.client.1.smithi138.stdout:8/288: symlink d1/de/d11/d17/d2e/d3a/l5d 0 2024-02-07T12:25:28.393 INFO:tasks.workunit.client.1.smithi138.stdout:3/302: read d5/d26/d28/f2b [1082871,80616] 0 2024-02-07T12:25:28.394 INFO:tasks.workunit.client.1.smithi138.stdout:2/284: dwrite d3/dd/d14/d49/d25/d3d/f6b [0,4194304] 0 2024-02-07T12:25:28.394 INFO:tasks.workunit.client.1.smithi138.stdout:2/285: chown d3/dd/f2e 17 1 2024-02-07T12:25:28.394 INFO:tasks.workunit.client.1.smithi138.stdout:0/163: truncate f1 1452237 0 2024-02-07T12:25:28.395 INFO:tasks.workunit.client.1.smithi138.stdout:0/164: chown d4/d9 27384 1 2024-02-07T12:25:28.395 INFO:tasks.workunit.client.1.smithi138.stdout:8/289: mknod d1/de/d11/c5e 0 2024-02-07T12:25:28.396 INFO:tasks.workunit.client.1.smithi138.stdout:8/290: creat d1/de/d11/d17/d2e/d3a/d50/f5f x:0 0 0 2024-02-07T12:25:28.396 INFO:tasks.workunit.client.1.smithi138.stdout:8/291: fsync d1/de/d11/d17/d2e/d49/f56 0 2024-02-07T12:25:28.397 INFO:tasks.workunit.client.1.smithi138.stdout:3/303: link d5/d15/d32/c37 d5/d26/d28/c65 0 2024-02-07T12:25:28.397 INFO:tasks.workunit.client.1.smithi138.stdout:3/304: stat d5/d15/c1d 0 2024-02-07T12:25:28.400 INFO:tasks.workunit.client.1.smithi138.stdout:0/165: link d4/d9/f12 d4/d9/de/d1d/d21/d2b/f38 0 2024-02-07T12:25:28.400 INFO:tasks.workunit.client.1.smithi138.stdout:0/166: chown d4/d9/fa 30643003 1 2024-02-07T12:25:28.400 INFO:tasks.workunit.client.1.smithi138.stdout:0/167: fsync d4/d9/db/f15 0 2024-02-07T12:25:28.401 INFO:tasks.workunit.client.1.smithi138.stdout:8/292: creat d1/de/d11/d17/d58/f60 x:0 0 0 2024-02-07T12:25:28.401 INFO:tasks.workunit.client.1.smithi138.stdout:8/293: write d1/de/d11/d17/d2e/d49/f39 [597903,78945] 0 2024-02-07T12:25:28.401 INFO:tasks.workunit.client.1.smithi138.stdout:2/286: write d3/dd/d14/f26 [1839247,21981] 0 2024-02-07T12:25:28.402 INFO:tasks.workunit.client.1.smithi138.stdout:8/294: dread d1/f22 [0,4194304] 0 2024-02-07T12:25:28.402 INFO:tasks.workunit.client.1.smithi138.stdout:8/295: write d1/de/d11/d17/d2e/d49/f19 [2487254,116334] 0 2024-02-07T12:25:28.403 INFO:tasks.workunit.client.1.smithi138.stdout:0/168: mkdir d4/d9/db/d39 0 2024-02-07T12:25:28.406 INFO:tasks.workunit.client.1.smithi138.stdout:2/287: getdents d3/dd/d14/d49/d25/d3d/d4f 0 2024-02-07T12:25:28.408 INFO:tasks.workunit.client.1.smithi138.stdout:0/169: creat d4/d9/d37/f3a x:0 0 0 2024-02-07T12:25:28.409 INFO:tasks.workunit.client.1.smithi138.stdout:6/216: dwrite dc/d13/f1d [0,4194304] 0 2024-02-07T12:25:28.409 INFO:tasks.workunit.client.1.smithi138.stdout:6/217: fsync dc/d13/d1e/d24/f3c 0 2024-02-07T12:25:28.412 INFO:tasks.workunit.client.1.smithi138.stdout:0/170: write d4/d9/de/d1d/d21/d2b/f28 [285469,94807] 0 2024-02-07T12:25:28.413 INFO:tasks.workunit.client.1.smithi138.stdout:6/218: mknod dc/d31/d38/c43 0 2024-02-07T12:25:28.413 INFO:tasks.workunit.client.1.smithi138.stdout:6/219: readlink dc/l1c 0 2024-02-07T12:25:28.414 INFO:tasks.workunit.client.1.smithi138.stdout:2/288: getdents d3/d4e 0 2024-02-07T12:25:28.417 INFO:tasks.workunit.client.1.smithi138.stdout:6/220: symlink dc/d13/d1e/d24/l44 0 2024-02-07T12:25:28.417 INFO:tasks.workunit.client.1.smithi138.stdout:6/221: fdatasync dc/d13/d1e/f2f 0 2024-02-07T12:25:28.418 INFO:tasks.workunit.client.1.smithi138.stdout:2/289: creat d3/dd/d14/d49/d25/f6c x:0 0 0 2024-02-07T12:25:28.419 INFO:tasks.workunit.client.1.smithi138.stdout:2/290: fdatasync d3/dd/d14/d49/d25/d3d/f3e 0 2024-02-07T12:25:28.421 INFO:tasks.workunit.client.1.smithi138.stdout:2/291: unlink d3/dd/d14/d49/f1b 0 2024-02-07T12:25:28.422 INFO:tasks.workunit.client.1.smithi138.stdout:2/292: mknod d3/dd/d19/d44/c6d 0 2024-02-07T12:25:28.422 INFO:tasks.workunit.client.1.smithi138.stdout:2/293: dread - d3/dd/d14/d49/d25/f6c zero size 2024-02-07T12:25:28.424 INFO:tasks.workunit.client.1.smithi138.stdout:2/294: creat d3/d4e/f6e x:0 0 0 2024-02-07T12:25:28.425 INFO:tasks.workunit.client.1.smithi138.stdout:2/295: rmdir d3/dd/d19/d1f/d37 39 2024-02-07T12:25:28.426 INFO:tasks.workunit.client.1.smithi138.stdout:6/222: write dc/d31/d38/f3a [1404352,101514] 0 2024-02-07T12:25:28.427 INFO:tasks.workunit.client.1.smithi138.stdout:2/296: mkdir d3/dd/d6f 0 2024-02-07T12:25:28.427 INFO:tasks.workunit.client.1.smithi138.stdout:2/297: chown d3/dd/d14/d49/d25/d3d/f6b 0 1 2024-02-07T12:25:28.428 INFO:tasks.workunit.client.1.smithi138.stdout:6/223: fdatasync dc/d13/f1b 0 2024-02-07T12:25:28.428 INFO:tasks.workunit.client.1.smithi138.stdout:6/224: truncate dc/d13/d1e/f2b 881501 0 2024-02-07T12:25:28.430 INFO:tasks.workunit.client.1.smithi138.stdout:2/298: rename d3/dd/c3f to d3/dd/d19/d1f/d46/c70 0 2024-02-07T12:25:28.432 INFO:tasks.workunit.client.1.smithi138.stdout:8/296: fsync d1/f13 0 2024-02-07T12:25:28.432 INFO:tasks.workunit.client.1.smithi138.stdout:8/297: chown d1/de/d11/d17/d2e 3 1 2024-02-07T12:25:28.444 INFO:tasks.workunit.client.1.smithi138.stdout:2/299: mkdir d3/dd/d19/d1f/d46/d71 0 2024-02-07T12:25:28.444 INFO:tasks.workunit.client.1.smithi138.stdout:2/300: readlink d3/l3c 0 2024-02-07T12:25:28.447 INFO:tasks.workunit.client.1.smithi138.stdout:2/301: getdents d3/dd/d14/d49/d25/d3d 0 2024-02-07T12:25:28.448 INFO:tasks.workunit.client.1.smithi138.stdout:2/302: creat d3/dd/d19/f72 x:0 0 0 2024-02-07T12:25:28.450 INFO:tasks.workunit.client.1.smithi138.stdout:2/303: dread d3/dd/d19/d1f/f5c [0,4194304] 0 2024-02-07T12:25:28.450 INFO:tasks.workunit.client.1.smithi138.stdout:2/304: write d3/d4e/f50 [198989,51981] 0 2024-02-07T12:25:28.451 INFO:tasks.workunit.client.1.smithi138.stdout:2/305: mkdir d3/dd/d14/d49/d25/d3d/d4f/d73 0 2024-02-07T12:25:28.452 INFO:tasks.workunit.client.1.smithi138.stdout:2/306: rmdir d3/dd/d14/d49/d25/d3d 39 2024-02-07T12:25:28.452 INFO:tasks.workunit.client.1.smithi138.stdout:2/307: write d3/f53 [712911,14630] 0 2024-02-07T12:25:28.453 INFO:tasks.workunit.client.1.smithi138.stdout:6/225: dwrite dc/d13/d1e/f2b [0,4194304] 0 2024-02-07T12:25:28.453 INFO:tasks.workunit.client.1.smithi138.stdout:0/171: getdents d4/d9/d37 0 2024-02-07T12:25:28.453 INFO:tasks.workunit.client.1.smithi138.stdout:8/298: dwrite d1/de/d11/d17/d3e/f4e [0,4194304] 0 2024-02-07T12:25:28.454 INFO:tasks.workunit.client.1.smithi138.stdout:8/299: stat d1/f23 0 2024-02-07T12:25:28.457 INFO:tasks.workunit.client.1.smithi138.stdout:2/308: dread d3/dd/d14/d49/d25/d3d/f3e [0,4194304] 0 2024-02-07T12:25:28.460 INFO:tasks.workunit.client.1.smithi138.stdout:0/172: truncate d4/f6 3686607 0 2024-02-07T12:25:28.460 INFO:tasks.workunit.client.1.smithi138.stdout:0/173: fsync d4/fd 0 2024-02-07T12:25:28.460 INFO:tasks.workunit.client.1.smithi138.stdout:0/174: dread - d4/d9/de/d1d/d21/d2b/f2d zero size 2024-02-07T12:25:28.462 INFO:tasks.workunit.client.1.smithi138.stdout:8/300: creat d1/de/d11/d17/d2e/d3a/f61 x:0 0 0 2024-02-07T12:25:28.464 INFO:tasks.workunit.client.1.smithi138.stdout:2/309: symlink d3/dd/d14/d49/d25/d3d/d4f/l74 0 2024-02-07T12:25:28.468 INFO:tasks.workunit.client.1.smithi138.stdout:0/175: creat d4/d9/de/d1d/d21/f3b x:0 0 0 2024-02-07T12:25:28.468 INFO:tasks.workunit.client.1.smithi138.stdout:2/310: dread f0 [0,4194304] 0 2024-02-07T12:25:28.468 INFO:tasks.workunit.client.1.smithi138.stdout:8/301: mkdir d1/de/d11/d17/d2e/d49/d4c/d62 0 2024-02-07T12:25:28.471 INFO:tasks.workunit.client.1.smithi138.stdout:2/311: dread d3/dd/d14/d49/d25/d3d/f45 [0,4194304] 0 2024-02-07T12:25:28.471 INFO:tasks.workunit.client.1.smithi138.stdout:2/312: truncate d3/dd/d19/d1f/f5c 1172835 0 2024-02-07T12:25:28.474 INFO:tasks.workunit.client.1.smithi138.stdout:2/313: truncate f0 370366 0 2024-02-07T12:25:28.475 INFO:tasks.workunit.client.1.smithi138.stdout:2/314: truncate d3/dd/d19/f72 231761 0 2024-02-07T12:25:28.475 INFO:tasks.workunit.client.1.smithi138.stdout:5/170: sync 2024-02-07T12:25:28.475 INFO:tasks.workunit.client.1.smithi138.stdout:7/349: sync 2024-02-07T12:25:28.477 INFO:tasks.workunit.client.1.smithi138.stdout:5/171: mknod da/d22/d25/c3a 0 2024-02-07T12:25:28.479 INFO:tasks.workunit.client.1.smithi138.stdout:5/172: truncate da/fb 1123165 0 2024-02-07T12:25:28.483 INFO:tasks.workunit.client.1.smithi138.stdout:8/302: getdents d1/de/d11/d17/d2e/d3a 0 2024-02-07T12:25:28.485 INFO:tasks.workunit.client.1.smithi138.stdout:2/315: fsync f0 0 2024-02-07T12:25:28.485 INFO:tasks.workunit.client.1.smithi138.stdout:2/316: truncate d3/d4e/f50 432996 0 2024-02-07T12:25:28.486 INFO:tasks.workunit.client.1.smithi138.stdout:2/317: write d3/dd/d14/d49/d29/f51 [502341,119830] 0 2024-02-07T12:25:28.486 INFO:tasks.workunit.client.1.smithi138.stdout:2/318: write d3/dd/d19/f42 [341702,71997] 0 2024-02-07T12:25:28.488 INFO:tasks.workunit.client.1.smithi138.stdout:2/319: creat d3/dd/d19/d1f/d37/f75 x:0 0 0 2024-02-07T12:25:28.491 INFO:tasks.workunit.client.1.smithi138.stdout:2/320: rename d3/dd/d19/cc to d3/dd/d14/d49/d25/d3d/d5f/c76 0 2024-02-07T12:25:28.491 INFO:tasks.workunit.client.1.smithi138.stdout:2/321: write d3/dd/d14/f2c [923929,9746] 0 2024-02-07T12:25:28.495 INFO:tasks.workunit.client.1.smithi138.stdout:2/322: rename d3/dd/d19/d44/c66 to d3/d4e/c77 0 2024-02-07T12:25:28.497 INFO:tasks.workunit.client.1.smithi138.stdout:2/323: symlink d3/dd/d14/d49/d25/l78 0 2024-02-07T12:25:28.499 INFO:tasks.workunit.client.1.smithi138.stdout:2/324: symlink d3/dd/d19/d1f/d37/l79 0 2024-02-07T12:25:28.500 INFO:tasks.workunit.client.1.smithi138.stdout:2/325: mknod d3/dd/d19/d1f/d46/d71/c7a 0 2024-02-07T12:25:28.500 INFO:tasks.workunit.client.1.smithi138.stdout:2/326: write d3/d4e/f6e [14828,40483] 0 2024-02-07T12:25:28.502 INFO:tasks.workunit.client.1.smithi138.stdout:7/350: dwrite d0/d6/d1d/d24/f4f [0,4194304] 0 2024-02-07T12:25:28.502 INFO:tasks.workunit.client.1.smithi138.stdout:7/351: chown d0/d6/d1d/d24/l66 3009 1 2024-02-07T12:25:28.502 INFO:tasks.workunit.client.1.smithi138.stdout:2/327: rename d3/dd/d19/d44/c6d to d3/dd/d19/d1f/d37/c7b 0 2024-02-07T12:25:28.508 INFO:tasks.workunit.client.1.smithi138.stdout:8/303: dwrite d1/de/d11/d17/d2e/d49/f8 [0,4194304] 0 2024-02-07T12:25:28.508 INFO:tasks.workunit.client.1.smithi138.stdout:8/304: mknod d1/de/d11/d17/d2e/d49/c63 0 2024-02-07T12:25:28.508 INFO:tasks.workunit.client.1.smithi138.stdout:8/305: dread - d1/de/d11/d17/d2e/f52 zero size 2024-02-07T12:25:28.508 INFO:tasks.workunit.client.1.smithi138.stdout:8/306: readlink d1/de/d11/d17/d2e/d49/l42 0 2024-02-07T12:25:28.508 INFO:tasks.workunit.client.1.smithi138.stdout:5/173: dwrite da/df/f11 [0,4194304] 0 2024-02-07T12:25:28.508 INFO:tasks.workunit.client.1.smithi138.stdout:5/174: chown da/df/d27/d2e 25470 1 2024-02-07T12:25:28.510 INFO:tasks.workunit.client.1.smithi138.stdout:5/175: symlink da/l3b 0 2024-02-07T12:25:28.515 INFO:tasks.workunit.client.1.smithi138.stdout:5/176: rename da/c21 to da/c3c 0 2024-02-07T12:25:28.515 INFO:tasks.workunit.client.1.smithi138.stdout:5/177: write da/d22/f26 [845787,127796] 0 2024-02-07T12:25:28.519 INFO:tasks.workunit.client.1.smithi138.stdout:8/307: dwrite d1/de/d11/d17/d2e/d3a/d50/f5f [0,4194304] 0 2024-02-07T12:25:28.520 INFO:tasks.workunit.client.1.smithi138.stdout:7/352: truncate d0/d8/d15/f6b 4000413 0 2024-02-07T12:25:28.523 INFO:tasks.workunit.client.1.smithi138.stdout:5/178: write da/d22/d25/d2b/f31 [7749992,8969] 0 2024-02-07T12:25:28.524 INFO:tasks.workunit.client.1.smithi138.stdout:5/179: dread da/fc [4194304,4194304] 0 2024-02-07T12:25:28.524 INFO:tasks.workunit.client.1.smithi138.stdout:8/308: rename d1/de/d11/d17/d2e/d3a/l5d to d1/de/d11/d17/l64 0 2024-02-07T12:25:28.527 INFO:tasks.workunit.client.1.smithi138.stdout:5/180: rmdir da/d22/d37 0 2024-02-07T12:25:28.527 INFO:tasks.workunit.client.1.smithi138.stdout:5/181: truncate da/df/d27/d2e/f2f 814286 0 2024-02-07T12:25:28.527 INFO:tasks.workunit.client.1.smithi138.stdout:5/182: write da/f1f [934804,107139] 0 2024-02-07T12:25:28.529 INFO:tasks.workunit.client.1.smithi138.stdout:5/183: unlink da/ce 0 2024-02-07T12:25:28.542 INFO:tasks.workunit.client.1.smithi138.stdout:5/184: mknod da/df/d27/c3d 0 2024-02-07T12:25:28.564 INFO:tasks.workunit.client.1.smithi138.stdout:5/185: dwrite da/df/f20 [0,4194304] 0 2024-02-07T12:25:28.573 INFO:tasks.workunit.client.1.smithi138.stdout:7/353: truncate d0/d6/d1d/d24/f4f 2055224 0 2024-02-07T12:25:28.577 INFO:tasks.workunit.client.1.smithi138.stdout:5/186: dwrite da/df/f13 [0,4194304] 0 2024-02-07T12:25:28.577 INFO:tasks.workunit.client.1.smithi138.stdout:5/187: write da/d22/f26 [844144,63635] 0 2024-02-07T12:25:28.581 INFO:tasks.workunit.client.1.smithi138.stdout:7/354: creat d0/d8/d11/d1f/f77 x:0 0 0 2024-02-07T12:25:28.581 INFO:tasks.workunit.client.1.smithi138.stdout:7/355: readlink d0/d8/d11/d1f/l21 0 2024-02-07T12:25:28.581 INFO:tasks.workunit.client.1.smithi138.stdout:7/356: read - d0/d8/d11/d1f/f77 zero size 2024-02-07T12:25:28.581 INFO:tasks.workunit.client.1.smithi138.stdout:7/357: dread - d0/d6/d1d/d24/f72 zero size 2024-02-07T12:25:28.594 INFO:tasks.workunit.client.1.smithi138.stdout:5/188: dwrite da/f19 [0,4194304] 0 2024-02-07T12:25:28.600 INFO:tasks.workunit.client.1.smithi138.stdout:7/358: dwrite d0/d6/d1d/d38/f5c [0,4194304] 0 2024-02-07T12:25:28.611 INFO:tasks.workunit.client.1.smithi138.stdout:5/189: dwrite da/f19 [4194304,4194304] 0 2024-02-07T12:25:28.611 INFO:tasks.workunit.client.1.smithi138.stdout:5/190: write da/d22/d25/d2b/f36 [985143,15164] 0 2024-02-07T12:25:28.613 INFO:tasks.workunit.client.1.smithi138.stdout:5/191: rename da/df/f11 to da/d22/d25/f3e 0 2024-02-07T12:25:28.621 INFO:tasks.workunit.client.1.smithi138.stdout:5/192: write da/df/f17 [593344,5970] 0 2024-02-07T12:25:28.622 INFO:tasks.workunit.client.1.smithi138.stdout:5/193: symlink da/df/d27/d2e/l3f 0 2024-02-07T12:25:28.624 INFO:tasks.workunit.client.1.smithi138.stdout:5/194: rmdir da/d34 39 2024-02-07T12:25:28.625 INFO:tasks.workunit.client.1.smithi138.stdout:5/195: fsync da/f19 0 2024-02-07T12:25:28.630 INFO:tasks.workunit.client.1.smithi138.stdout:5/196: write da/f19 [2535747,62554] 0 2024-02-07T12:25:28.630 INFO:tasks.workunit.client.1.smithi138.stdout:5/197: chown da/d22/d25/d2b/f31 37895581 1 2024-02-07T12:25:28.630 INFO:tasks.workunit.client.1.smithi138.stdout:5/198: chown da/d22/d25/d2b/l2d 883 1 2024-02-07T12:25:28.631 INFO:tasks.workunit.client.1.smithi138.stdout:5/199: mkdir da/d22/d25/d2b/d35/d40 0 2024-02-07T12:25:28.631 INFO:tasks.workunit.client.1.smithi138.stdout:5/200: write da/f1d [706268,28582] 0 2024-02-07T12:25:28.632 INFO:tasks.workunit.client.1.smithi138.stdout:5/201: write da/d22/d25/f2c [160058,31745] 0 2024-02-07T12:25:28.633 INFO:tasks.workunit.client.1.smithi138.stdout:5/202: symlink da/d22/d25/d2b/d35/l41 0 2024-02-07T12:25:28.702 INFO:tasks.workunit.client.1.smithi138.stdout:9/195: sync 2024-02-07T12:25:28.708 INFO:tasks.workunit.client.1.smithi138.stdout:9/196: dread d0/d6/f15 [0,4194304] 0 2024-02-07T12:25:28.708 INFO:tasks.workunit.client.1.smithi138.stdout:9/197: link d0/d6/d8/d1d/dd/d1f/l21 d0/d6/l44 0 2024-02-07T12:25:28.708 INFO:tasks.workunit.client.1.smithi138.stdout:9/198: write d0/d6/f27 [1209739,82296] 0 2024-02-07T12:25:28.709 INFO:tasks.workunit.client.1.smithi138.stdout:9/199: rmdir d0/d6/d8/d1d 39 2024-02-07T12:25:28.711 INFO:tasks.workunit.client.1.smithi138.stdout:9/200: rename d0/d6/d8/d3e to d0/d34/d45 0 2024-02-07T12:25:28.712 INFO:tasks.workunit.client.1.smithi138.stdout:9/201: mknod d0/d6/d8/d1d/c46 0 2024-02-07T12:25:28.714 INFO:tasks.workunit.client.1.smithi138.stdout:9/202: creat d0/d6/d8/d1d/dd/d1f/f47 x:0 0 0 2024-02-07T12:25:28.715 INFO:tasks.workunit.client.1.smithi138.stdout:9/203: mknod d0/d6/c48 0 2024-02-07T12:25:28.716 INFO:tasks.workunit.client.1.smithi138.stdout:9/204: truncate d0/d6/d8/d1d/dd/f20 2759567 0 2024-02-07T12:25:28.718 INFO:tasks.workunit.client.1.smithi138.stdout:9/205: mknod d0/d6/d8/c49 0 2024-02-07T12:25:28.720 INFO:tasks.workunit.client.1.smithi138.stdout:9/206: symlink d0/d6/l4a 0 2024-02-07T12:25:28.721 INFO:tasks.workunit.client.1.smithi138.stdout:9/207: chown d0/d6/c10 15066 1 2024-02-07T12:25:28.725 INFO:tasks.workunit.client.1.smithi138.stdout:9/208: dread d0/d34/d45/f43 [4194304,4194304] 0 2024-02-07T12:25:28.739 INFO:tasks.workunit.client.1.smithi138.stdout:9/209: dwrite d0/d6/f27 [0,4194304] 0 2024-02-07T12:25:28.739 INFO:tasks.workunit.client.1.smithi138.stdout:9/210: creat d0/d6/f4b x:0 0 0 2024-02-07T12:25:28.742 INFO:tasks.workunit.client.1.smithi138.stdout:9/211: rename d0/l24 to d0/d6/d8/d1d/dd/d25/l4c 0 2024-02-07T12:25:28.742 INFO:tasks.workunit.client.1.smithi138.stdout:9/212: readlink d0/d6/d8/d1d/l13 0 2024-02-07T12:25:28.743 INFO:tasks.workunit.client.1.smithi138.stdout:9/213: truncate d0/d6/f3c 544557 0 2024-02-07T12:25:28.743 INFO:tasks.workunit.client.1.smithi138.stdout:9/214: stat d0/d6/f1e 0 2024-02-07T12:25:28.756 INFO:tasks.workunit.client.1.smithi138.stdout:9/215: dwrite d0/d6/d8/f2a [0,4194304] 0 2024-02-07T12:25:28.757 INFO:tasks.workunit.client.1.smithi138.stdout:9/216: rmdir d0/d6/d8/d1d 39 2024-02-07T12:25:28.760 INFO:tasks.workunit.client.1.smithi138.stdout:9/217: getdents d0/d6/d8 0 2024-02-07T12:25:28.760 INFO:tasks.workunit.client.1.smithi138.stdout:9/218: fdatasync d0/d6/d8/d1d/f3d 0 2024-02-07T12:25:28.762 INFO:tasks.workunit.client.1.smithi138.stdout:9/219: unlink d0/d6/d8/l40 0 2024-02-07T12:25:28.762 INFO:tasks.workunit.client.1.smithi138.stdout:9/220: fdatasync d0/d34/d45/f43 0 2024-02-07T12:25:28.778 INFO:tasks.workunit.client.1.smithi138.stdout:9/221: dwrite d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:28.787 INFO:tasks.workunit.client.1.smithi138.stdout:6/226: sync 2024-02-07T12:25:28.788 INFO:tasks.workunit.client.1.smithi138.stdout:4/187: sync 2024-02-07T12:25:28.788 INFO:tasks.workunit.client.1.smithi138.stdout:1/114: sync 2024-02-07T12:25:28.788 INFO:tasks.workunit.client.1.smithi138.stdout:5/203: sync 2024-02-07T12:25:28.788 INFO:tasks.workunit.client.1.smithi138.stdout:8/309: sync 2024-02-07T12:25:28.788 INFO:tasks.workunit.client.1.smithi138.stdout:7/359: sync 2024-02-07T12:25:28.788 INFO:tasks.workunit.client.1.smithi138.stdout:0/176: sync 2024-02-07T12:25:28.788 INFO:tasks.workunit.client.1.smithi138.stdout:3/305: sync 2024-02-07T12:25:28.788 INFO:tasks.workunit.client.1.smithi138.stdout:2/328: sync 2024-02-07T12:25:28.788 INFO:tasks.workunit.client.1.smithi138.stdout:3/306: chown d5/d15/d32/c61 19 1 2024-02-07T12:25:28.788 INFO:tasks.workunit.client.1.smithi138.stdout:2/329: creat d3/dd/d19/d1f/d37/f7c x:0 0 0 2024-02-07T12:25:28.790 INFO:tasks.workunit.client.1.smithi138.stdout:0/177: mknod d4/d9/d33/c3c 0 2024-02-07T12:25:28.791 INFO:tasks.workunit.client.1.smithi138.stdout:6/227: link dc/d13/d1e/c23 dc/d13/d1e/d35/c45 0 2024-02-07T12:25:28.791 INFO:tasks.workunit.client.1.smithi138.stdout:6/228: fsync dc/d31/d38/f3d 0 2024-02-07T12:25:28.793 INFO:tasks.workunit.client.1.smithi138.stdout:2/330: mkdir d3/dd/d19/d44/d7d 0 2024-02-07T12:25:28.793 INFO:tasks.workunit.client.1.smithi138.stdout:2/331: write d3/dd/d19/d1f/d37/f7c [166016,65779] 0 2024-02-07T12:25:28.794 INFO:tasks.workunit.client.1.smithi138.stdout:4/188: write fb [44522,39114] 0 2024-02-07T12:25:28.798 INFO:tasks.workunit.client.1.smithi138.stdout:2/332: rename d3/dd/d6f to d3/dd/d19/d1f/d46/d71/d7e 0 2024-02-07T12:25:28.798 INFO:tasks.workunit.client.1.smithi138.stdout:2/333: dread - d3/dd/d19/d1f/d46/f48 zero size 2024-02-07T12:25:28.800 INFO:tasks.workunit.client.1.smithi138.stdout:1/115: dread d5/d8/fd [12582912,4194304] 0 2024-02-07T12:25:28.800 INFO:tasks.workunit.client.1.smithi138.stdout:4/189: unlink l1b 0 2024-02-07T12:25:28.803 INFO:tasks.workunit.client.1.smithi138.stdout:2/334: creat d3/dd/d14/d49/d29/d5b/f7f x:0 0 0 2024-02-07T12:25:28.804 INFO:tasks.workunit.client.1.smithi138.stdout:2/335: readlink d3/dd/d14/d49/d25/l78 0 2024-02-07T12:25:28.805 INFO:tasks.workunit.client.1.smithi138.stdout:1/116: rename d5/d8/da/fc to d5/d8/da/f1d 0 2024-02-07T12:25:28.807 INFO:tasks.workunit.client.1.smithi138.stdout:2/336: mkdir d3/dd/d14/d49/d25/d3d/d4f/d73/d80 0 2024-02-07T12:25:28.809 INFO:tasks.workunit.client.1.smithi138.stdout:8/310: dwrite d1/de/d11/d17/d2e/d49/f29 [0,4194304] 0 2024-02-07T12:25:28.809 INFO:tasks.workunit.client.1.smithi138.stdout:1/117: creat d5/f1e x:0 0 0 2024-02-07T12:25:28.809 INFO:tasks.workunit.client.1.smithi138.stdout:1/118: dread - d5/d8/f1c zero size 2024-02-07T12:25:28.809 INFO:tasks.workunit.client.1.smithi138.stdout:1/119: write d5/d8/da/fe [871241,70524] 0 2024-02-07T12:25:28.809 INFO:tasks.workunit.client.1.smithi138.stdout:2/337: symlink d3/dd/d14/d49/d25/d3d/d4f/l81 0 2024-02-07T12:25:28.810 INFO:tasks.workunit.client.1.smithi138.stdout:2/338: fsync d3/dd/d19/d1f/d37/f3b 0 2024-02-07T12:25:28.810 INFO:tasks.workunit.client.1.smithi138.stdout:2/339: stat d3/d4e 0 2024-02-07T12:25:28.818 INFO:tasks.workunit.client.1.smithi138.stdout:8/311: rmdir d1/de/d11/d17/d2e/d3a/d50 39 2024-02-07T12:25:28.818 INFO:tasks.workunit.client.1.smithi138.stdout:2/340: mkdir d3/dd/d14/d82 0 2024-02-07T12:25:28.822 INFO:tasks.workunit.client.1.smithi138.stdout:8/312: getdents d1 0 2024-02-07T12:25:28.823 INFO:tasks.workunit.client.1.smithi138.stdout:2/341: mknod d3/dd/d14/d49/d25/d3d/c83 0 2024-02-07T12:25:28.824 INFO:tasks.workunit.client.1.smithi138.stdout:2/342: mknod d3/dd/d14/d82/c84 0 2024-02-07T12:25:28.825 INFO:tasks.workunit.client.1.smithi138.stdout:2/343: truncate d3/dd/d19/f35 5318307 0 2024-02-07T12:25:28.825 INFO:tasks.workunit.client.1.smithi138.stdout:6/229: write dc/d13/f34 [1213249,70055] 0 2024-02-07T12:25:28.825 INFO:tasks.workunit.client.1.smithi138.stdout:6/230: creat dc/d13/d1e/d35/f46 x:0 0 0 2024-02-07T12:25:28.825 INFO:tasks.workunit.client.1.smithi138.stdout:6/231: creat dc/d31/f47 x:0 0 0 2024-02-07T12:25:28.826 INFO:tasks.workunit.client.1.smithi138.stdout:5/204: dwrite da/df/d27/f33 [0,4194304] 0 2024-02-07T12:25:28.827 INFO:tasks.workunit.client.1.smithi138.stdout:2/344: rename d3/dd/d14/d49/d25/d3d/f6b to d3/dd/d14/d49/d25/d3d/d4f/d73/d80/f85 0 2024-02-07T12:25:28.827 INFO:tasks.workunit.client.1.smithi138.stdout:0/178: dwrite d4/d9/f12 [0,4194304] 0 2024-02-07T12:25:28.831 INFO:tasks.workunit.client.1.smithi138.stdout:6/232: getdents dc 0 2024-02-07T12:25:28.831 INFO:tasks.workunit.client.1.smithi138.stdout:6/233: fsync dc/d13/f42 0 2024-02-07T12:25:28.831 INFO:tasks.workunit.client.1.smithi138.stdout:6/234: chown dc/l1c 78 1 2024-02-07T12:25:28.832 INFO:tasks.workunit.client.1.smithi138.stdout:7/360: dwrite d0/d6/d1d/d24/f2c [0,4194304] 0 2024-02-07T12:25:28.832 INFO:tasks.workunit.client.1.smithi138.stdout:7/361: dread - d0/d6/d19/f5d zero size 2024-02-07T12:25:28.832 INFO:tasks.workunit.client.1.smithi138.stdout:3/307: dwrite d5/d27/d35/f53 [4194304,4194304] 0 2024-02-07T12:25:28.832 INFO:tasks.workunit.client.1.smithi138.stdout:3/308: readlink d5/d15/l30 0 2024-02-07T12:25:28.832 INFO:tasks.workunit.client.1.smithi138.stdout:3/309: truncate d5/d27/f3d 1222726 0 2024-02-07T12:25:28.835 INFO:tasks.workunit.client.1.smithi138.stdout:5/205: symlink da/l42 0 2024-02-07T12:25:28.838 INFO:tasks.workunit.client.1.smithi138.stdout:0/179: dread d4/d9/de/d1d/d21/d2b/f38 [0,4194304] 0 2024-02-07T12:25:28.838 INFO:tasks.workunit.client.1.smithi138.stdout:0/180: chown d4/d9/f2f 26673 1 2024-02-07T12:25:28.838 INFO:tasks.workunit.client.1.smithi138.stdout:0/181: chown d4/d9/f12 1606738637 1 2024-02-07T12:25:28.839 INFO:tasks.workunit.client.1.smithi138.stdout:1/120: getdents d5 0 2024-02-07T12:25:28.841 INFO:tasks.workunit.client.1.smithi138.stdout:6/235: link dc/d13/f42 dc/d31/f48 0 2024-02-07T12:25:28.843 INFO:tasks.workunit.client.1.smithi138.stdout:4/190: dwrite d20/d34/d36/f38 [0,4194304] 0 2024-02-07T12:25:28.843 INFO:tasks.workunit.client.1.smithi138.stdout:4/191: chown f1d 18951789 1 2024-02-07T12:25:28.844 INFO:tasks.workunit.client.1.smithi138.stdout:7/362: symlink d0/d6/d1d/d38/l78 0 2024-02-07T12:25:28.844 INFO:tasks.workunit.client.1.smithi138.stdout:4/192: dread d20/f3d [0,4194304] 0 2024-02-07T12:25:28.844 INFO:tasks.workunit.client.1.smithi138.stdout:2/345: dwrite d3/dd/d14/f5a [0,4194304] 0 2024-02-07T12:25:28.844 INFO:tasks.workunit.client.1.smithi138.stdout:2/346: write d3/dd/d19/f42 [508393,14658] 0 2024-02-07T12:25:28.846 INFO:tasks.workunit.client.1.smithi138.stdout:3/310: rename f3 to d5/d27/d35/f66 0 2024-02-07T12:25:28.851 INFO:tasks.workunit.client.1.smithi138.stdout:5/206: unlink da/d22/d25/d2b/f31 0 2024-02-07T12:25:28.851 INFO:tasks.workunit.client.1.smithi138.stdout:5/207: truncate da/f1d 1318626 0 2024-02-07T12:25:28.852 INFO:tasks.workunit.client.1.smithi138.stdout:0/182: mkdir d4/d9/d37/d3d 0 2024-02-07T12:25:28.853 INFO:tasks.workunit.client.1.smithi138.stdout:1/121: unlink d5/d8/f1c 0 2024-02-07T12:25:28.854 INFO:tasks.workunit.client.1.smithi138.stdout:1/122: readlink l2 0 2024-02-07T12:25:28.854 INFO:tasks.workunit.client.1.smithi138.stdout:1/123: write f4 [17492500,102052] 0 2024-02-07T12:25:28.855 INFO:tasks.workunit.client.1.smithi138.stdout:6/236: mkdir dc/d31/d38/d49 0 2024-02-07T12:25:28.855 INFO:tasks.workunit.client.1.smithi138.stdout:0/183: dread d4/d9/de/d1d/d21/d2b/f38 [0,4194304] 0 2024-02-07T12:25:28.855 INFO:tasks.workunit.client.1.smithi138.stdout:0/184: dread - d4/fd zero size 2024-02-07T12:25:28.855 INFO:tasks.workunit.client.1.smithi138.stdout:0/185: truncate d4/d9/de/d1d/d21/d2b/f2e 4795302 0 2024-02-07T12:25:28.857 INFO:tasks.workunit.client.1.smithi138.stdout:7/363: creat d0/d8/d11/f79 x:0 0 0 2024-02-07T12:25:28.858 INFO:tasks.workunit.client.1.smithi138.stdout:4/193: truncate d20/f25 1948712 0 2024-02-07T12:25:28.858 INFO:tasks.workunit.client.1.smithi138.stdout:4/194: creat d20/d34/d36/f44 x:0 0 0 2024-02-07T12:25:28.859 INFO:tasks.workunit.client.1.smithi138.stdout:4/195: dread - d20/f28 zero size 2024-02-07T12:25:28.860 INFO:tasks.workunit.client.1.smithi138.stdout:4/196: dread f16 [0,4194304] 0 2024-02-07T12:25:28.862 INFO:tasks.workunit.client.1.smithi138.stdout:3/311: symlink d5/d15/d32/l67 0 2024-02-07T12:25:28.862 INFO:tasks.workunit.client.1.smithi138.stdout:3/312: fsync d5/f3a 0 2024-02-07T12:25:28.865 INFO:tasks.workunit.client.1.smithi138.stdout:5/208: mkdir da/d43 0 2024-02-07T12:25:28.866 INFO:tasks.workunit.client.1.smithi138.stdout:1/124: mkdir d5/d8/da/d1f 0 2024-02-07T12:25:28.866 INFO:tasks.workunit.client.1.smithi138.stdout:1/125: truncate d5/f1e 179666 0 2024-02-07T12:25:28.869 INFO:tasks.workunit.client.1.smithi138.stdout:6/237: rmdir dc/d31/d38/d49 0 2024-02-07T12:25:28.869 INFO:tasks.workunit.client.1.smithi138.stdout:6/238: truncate dc/d13/d1e/f2f 240343 0 2024-02-07T12:25:28.871 INFO:tasks.workunit.client.1.smithi138.stdout:0/186: creat d4/d9/f3e x:0 0 0 2024-02-07T12:25:28.876 INFO:tasks.workunit.client.1.smithi138.stdout:7/364: link d0/d6/d1d/d24/f4f d0/d8/d11/d63/f7a 0 2024-02-07T12:25:28.876 INFO:tasks.workunit.client.1.smithi138.stdout:7/365: write d0/d6/d19/f29 [4643585,121863] 0 2024-02-07T12:25:28.876 INFO:tasks.workunit.client.1.smithi138.stdout:7/366: stat d0/d6/d1d 0 2024-02-07T12:25:28.876 INFO:tasks.workunit.client.1.smithi138.stdout:7/367: fdatasync d0/d6/f69 0 2024-02-07T12:25:28.876 INFO:tasks.workunit.client.1.smithi138.stdout:4/197: symlink d20/d34/d36/l45 0 2024-02-07T12:25:28.877 INFO:tasks.workunit.client.1.smithi138.stdout:4/198: dread - d20/f2e zero size 2024-02-07T12:25:28.877 INFO:tasks.workunit.client.1.smithi138.stdout:4/199: read - d20/d34/d36/f3c zero size 2024-02-07T12:25:28.878 INFO:tasks.workunit.client.1.smithi138.stdout:3/313: creat d5/d15/d32/f68 x:0 0 0 2024-02-07T12:25:28.881 INFO:tasks.workunit.client.1.smithi138.stdout:5/209: truncate da/df/f17 345143 0 2024-02-07T12:25:28.881 INFO:tasks.workunit.client.1.smithi138.stdout:5/210: chown da 2145 1 2024-02-07T12:25:28.882 INFO:tasks.workunit.client.1.smithi138.stdout:1/126: mkdir d5/d8/da/d20 0 2024-02-07T12:25:28.883 INFO:tasks.workunit.client.1.smithi138.stdout:7/368: dread d0/d8/d15/f47 [0,4194304] 0 2024-02-07T12:25:28.883 INFO:tasks.workunit.client.1.smithi138.stdout:7/369: chown d0/d8 4682 1 2024-02-07T12:25:28.885 INFO:tasks.workunit.client.1.smithi138.stdout:0/187: mkdir d4/d9/de/d1d/d21/d2b/d3f 0 2024-02-07T12:25:28.885 INFO:tasks.workunit.client.1.smithi138.stdout:1/127: dread d5/f1a [4194304,4194304] 0 2024-02-07T12:25:28.886 INFO:tasks.workunit.client.1.smithi138.stdout:3/314: creat d5/d26/d5e/f69 x:0 0 0 2024-02-07T12:25:28.893 INFO:tasks.workunit.client.1.smithi138.stdout:4/200: dwrite d20/d34/d36/f3c [0,4194304] 0 2024-02-07T12:25:28.893 INFO:tasks.workunit.client.1.smithi138.stdout:4/201: creat d20/d34/d36/f46 x:0 0 0 2024-02-07T12:25:28.893 INFO:tasks.workunit.client.1.smithi138.stdout:4/202: fsync d20/f26 0 2024-02-07T12:25:28.893 INFO:tasks.workunit.client.1.smithi138.stdout:4/203: stat fb 0 2024-02-07T12:25:28.893 INFO:tasks.workunit.client.1.smithi138.stdout:4/204: chown fb 6 1 2024-02-07T12:25:28.893 INFO:tasks.workunit.client.1.smithi138.stdout:1/128: creat d5/d8/da/d20/f21 x:0 0 0 2024-02-07T12:25:28.908 INFO:tasks.workunit.client.1.smithi138.stdout:0/188: dwrite d4/d9/d37/f3a [0,4194304] 0 2024-02-07T12:25:28.908 INFO:tasks.workunit.client.1.smithi138.stdout:0/189: write d4/f5 [2154211,107838] 0 2024-02-07T12:25:28.909 INFO:tasks.workunit.client.1.smithi138.stdout:1/129: link l2 d5/d8/da/d20/l22 0 2024-02-07T12:25:28.910 INFO:tasks.workunit.client.1.smithi138.stdout:7/370: dwrite d0/d6/d1d/f20 [0,4194304] 0 2024-02-07T12:25:28.910 INFO:tasks.workunit.client.1.smithi138.stdout:7/371: fdatasync d0/d6/d3e/f3f 0 2024-02-07T12:25:28.917 INFO:tasks.workunit.client.1.smithi138.stdout:3/315: dwrite f1 [0,4194304] 0 2024-02-07T12:25:28.917 INFO:tasks.workunit.client.1.smithi138.stdout:3/316: stat d5/d15/d32/l67 0 2024-02-07T12:25:28.917 INFO:tasks.workunit.client.1.smithi138.stdout:0/190: dread d4/d9/de/d1d/d21/d2b/f28 [0,4194304] 0 2024-02-07T12:25:28.917 INFO:tasks.workunit.client.1.smithi138.stdout:0/191: creat d4/d9/f40 x:0 0 0 2024-02-07T12:25:28.917 INFO:tasks.workunit.client.1.smithi138.stdout:0/192: creat d4/d9/de/d1d/f41 x:0 0 0 2024-02-07T12:25:28.917 INFO:tasks.workunit.client.1.smithi138.stdout:0/193: creat d4/d9/de/d1d/f42 x:0 0 0 2024-02-07T12:25:28.917 INFO:tasks.workunit.client.1.smithi138.stdout:0/194: dread - d4/d9/de/d1d/d21/d2b/f2d zero size 2024-02-07T12:25:28.917 INFO:tasks.workunit.client.1.smithi138.stdout:0/195: stat d4/d9/de/d1d/d21/d2b/f38 0 2024-02-07T12:25:28.918 INFO:tasks.workunit.client.1.smithi138.stdout:0/196: creat d4/d9/de/d1d/d21/f43 x:0 0 0 2024-02-07T12:25:28.918 INFO:tasks.workunit.client.1.smithi138.stdout:0/197: readlink d4/d9/db/l10 0 2024-02-07T12:25:28.918 INFO:tasks.workunit.client.1.smithi138.stdout:0/198: creat d4/d9/de/d1d/d21/d2b/f44 x:0 0 0 2024-02-07T12:25:28.918 INFO:tasks.workunit.client.1.smithi138.stdout:5/211: dwrite da/d22/d25/f3e [0,4194304] 0 2024-02-07T12:25:28.926 INFO:tasks.workunit.client.1.smithi138.stdout:1/130: truncate d5/f12 5129909 0 2024-02-07T12:25:28.927 INFO:tasks.workunit.client.1.smithi138.stdout:7/372: getdents d0/d6 0 2024-02-07T12:25:28.927 INFO:tasks.workunit.client.1.smithi138.stdout:7/373: readlink d0/d6/d3e/l4a 0 2024-02-07T12:25:28.927 INFO:tasks.workunit.client.1.smithi138.stdout:7/374: fsync d0/d8/d11/f2d 0 2024-02-07T12:25:28.928 INFO:tasks.workunit.client.1.smithi138.stdout:7/375: read d0/d8/d11/d1f/f42 [343115,83733] 0 2024-02-07T12:25:28.929 INFO:tasks.workunit.client.1.smithi138.stdout:3/317: dwrite d5/d15/f16 [0,4194304] 0 2024-02-07T12:25:28.935 INFO:tasks.workunit.client.1.smithi138.stdout:1/131: symlink d5/d8/da/d1f/l23 0 2024-02-07T12:25:28.936 INFO:tasks.workunit.client.1.smithi138.stdout:5/212: dread da/f1f [0,4194304] 0 2024-02-07T12:25:28.937 INFO:tasks.workunit.client.1.smithi138.stdout:7/376: rename d0/d6/d3e/l4a to d0/d8/l7b 0 2024-02-07T12:25:28.940 INFO:tasks.workunit.client.1.smithi138.stdout:0/199: link d4/d9/d37/f3a d4/d9/de/f45 0 2024-02-07T12:25:28.941 INFO:tasks.workunit.client.1.smithi138.stdout:1/132: truncate d5/f9 976871 0 2024-02-07T12:25:28.942 INFO:tasks.workunit.client.1.smithi138.stdout:1/133: chown f3 2093753902 1 2024-02-07T12:25:28.942 INFO:tasks.workunit.client.1.smithi138.stdout:1/134: readlink d5/d8/da/d15/l1b 0 2024-02-07T12:25:28.942 INFO:tasks.workunit.client.1.smithi138.stdout:1/135: stat d5/d8/da/fe 0 2024-02-07T12:25:28.942 INFO:tasks.workunit.client.1.smithi138.stdout:7/377: symlink d0/d6/d1d/d38/l7c 0 2024-02-07T12:25:28.944 INFO:tasks.workunit.client.1.smithi138.stdout:1/136: link d5/d8/f14 d5/d8/da/d15/f24 0 2024-02-07T12:25:28.946 INFO:tasks.workunit.client.1.smithi138.stdout:3/318: dwrite d5/d26/d28/f59 [4194304,4194304] 0 2024-02-07T12:25:28.947 INFO:tasks.workunit.client.1.smithi138.stdout:7/378: write d0/d6/d1d/d24/f4f [1678893,69838] 0 2024-02-07T12:25:28.947 INFO:tasks.workunit.client.1.smithi138.stdout:5/213: dread da/d22/d25/f30 [0,4194304] 0 2024-02-07T12:25:28.948 INFO:tasks.workunit.client.1.smithi138.stdout:3/319: write d5/d27/f3d [317454,104030] 0 2024-02-07T12:25:28.948 INFO:tasks.workunit.client.1.smithi138.stdout:3/320: fsync d5/d15/f16 0 2024-02-07T12:25:28.949 INFO:tasks.workunit.client.1.smithi138.stdout:7/379: creat d0/d6/d1d/d24/f7d x:0 0 0 2024-02-07T12:25:28.949 INFO:tasks.workunit.client.1.smithi138.stdout:5/214: readlink da/l42 0 2024-02-07T12:25:28.953 INFO:tasks.workunit.client.1.smithi138.stdout:3/321: creat d5/d26/d28/f6a x:0 0 0 2024-02-07T12:25:28.953 INFO:tasks.workunit.client.1.smithi138.stdout:3/322: readlink d5/d15/d32/l3b 0 2024-02-07T12:25:28.953 INFO:tasks.workunit.client.1.smithi138.stdout:3/323: stat d5/d27/d35/c5b 0 2024-02-07T12:25:28.953 INFO:tasks.workunit.client.1.smithi138.stdout:3/324: creat d5/d27/f6b x:0 0 0 2024-02-07T12:25:28.954 INFO:tasks.workunit.client.1.smithi138.stdout:5/215: mkdir da/d22/d44 0 2024-02-07T12:25:28.959 INFO:tasks.workunit.client.1.smithi138.stdout:3/325: symlink d5/l6c 0 2024-02-07T12:25:28.960 INFO:tasks.workunit.client.1.smithi138.stdout:3/326: creat d5/d15/f6d x:0 0 0 2024-02-07T12:25:28.960 INFO:tasks.workunit.client.1.smithi138.stdout:3/327: write d5/d26/f3c [126100,34342] 0 2024-02-07T12:25:28.962 INFO:tasks.workunit.client.1.smithi138.stdout:1/137: dwrite d5/d8/da/fe [0,4194304] 0 2024-02-07T12:25:28.963 INFO:tasks.workunit.client.1.smithi138.stdout:5/216: rmdir da/df/d27 39 2024-02-07T12:25:28.963 INFO:tasks.workunit.client.1.smithi138.stdout:5/217: readlink da/df/d27/d2e/l3f 0 2024-02-07T12:25:28.963 INFO:tasks.workunit.client.1.smithi138.stdout:5/218: write f8 [527835,88910] 0 2024-02-07T12:25:28.967 INFO:tasks.workunit.client.1.smithi138.stdout:5/219: creat da/d22/d25/d2b/d35/d40/f45 x:0 0 0 2024-02-07T12:25:28.968 INFO:tasks.workunit.client.1.smithi138.stdout:3/328: write d5/d27/d35/f53 [5457171,87090] 0 2024-02-07T12:25:28.968 INFO:tasks.workunit.client.1.smithi138.stdout:3/329: creat d5/d26/d5e/f6e x:0 0 0 2024-02-07T12:25:28.968 INFO:tasks.workunit.client.1.smithi138.stdout:7/380: dwrite d0/d6/d3e/f44 [0,4194304] 0 2024-02-07T12:25:28.970 INFO:tasks.workunit.client.1.smithi138.stdout:1/138: rmdir d5/d8 39 2024-02-07T12:25:28.971 INFO:tasks.workunit.client.1.smithi138.stdout:5/220: fdatasync da/fb 0 2024-02-07T12:25:28.972 INFO:tasks.workunit.client.1.smithi138.stdout:5/221: readlink l7 0 2024-02-07T12:25:28.977 INFO:tasks.workunit.client.1.smithi138.stdout:7/381: rmdir d0/d8/d11/d26 39 2024-02-07T12:25:28.978 INFO:tasks.workunit.client.1.smithi138.stdout:7/382: dread d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:28.979 INFO:tasks.workunit.client.1.smithi138.stdout:1/139: rename d5/f17 to d5/d8/da/d1f/f25 0 2024-02-07T12:25:28.981 INFO:tasks.workunit.client.1.smithi138.stdout:5/222: dread da/f1d [0,4194304] 0 2024-02-07T12:25:28.985 INFO:tasks.workunit.client.1.smithi138.stdout:3/330: getdents d5/d27/d35 0 2024-02-07T12:25:28.989 INFO:tasks.workunit.client.1.smithi138.stdout:7/383: creat d0/f7e x:0 0 0 2024-02-07T12:25:28.989 INFO:tasks.workunit.client.1.smithi138.stdout:1/140: mknod d5/d8/da/c26 0 2024-02-07T12:25:28.990 INFO:tasks.workunit.client.1.smithi138.stdout:5/223: getdents da/df/d27/d2e 0 2024-02-07T12:25:28.992 INFO:tasks.workunit.client.1.smithi138.stdout:5/224: truncate da/f19 8139865 0 2024-02-07T12:25:28.993 INFO:tasks.workunit.client.1.smithi138.stdout:1/141: dread d5/d8/da/f1d [0,4194304] 0 2024-02-07T12:25:28.994 INFO:tasks.workunit.client.1.smithi138.stdout:3/331: write d5/d26/d28/f59 [6254056,29173] 0 2024-02-07T12:25:28.994 INFO:tasks.workunit.client.1.smithi138.stdout:5/225: rename da/df/c1a to da/d22/d25/d2b/d35/c46 0 2024-02-07T12:25:28.995 INFO:tasks.workunit.client.1.smithi138.stdout:1/142: mkdir d5/d8/da/d1f/d27 0 2024-02-07T12:25:28.999 INFO:tasks.workunit.client.1.smithi138.stdout:3/332: rename d5/f10 to d5/d27/d35/f6f 0 2024-02-07T12:25:28.999 INFO:tasks.workunit.client.1.smithi138.stdout:3/333: creat d5/d26/d5e/f70 x:0 0 0 2024-02-07T12:25:29.000 INFO:tasks.workunit.client.1.smithi138.stdout:5/226: truncate da/d22/d25/f30 2808196 0 2024-02-07T12:25:29.000 INFO:tasks.workunit.client.1.smithi138.stdout:5/227: fsync f8 0 2024-02-07T12:25:29.001 INFO:tasks.workunit.client.1.smithi138.stdout:1/143: mknod d5/c28 0 2024-02-07T12:25:29.006 INFO:tasks.workunit.client.1.smithi138.stdout:1/144: unlink d5/c28 0 2024-02-07T12:25:29.006 INFO:tasks.workunit.client.1.smithi138.stdout:1/145: dread - d5/d8/ff zero size 2024-02-07T12:25:29.007 INFO:tasks.workunit.client.1.smithi138.stdout:1/146: rmdir d5/d8/da/d15 39 2024-02-07T12:25:29.007 INFO:tasks.workunit.client.1.smithi138.stdout:5/228: dread da/f24 [0,4194304] 0 2024-02-07T12:25:29.007 INFO:tasks.workunit.client.1.smithi138.stdout:5/229: write da/d22/d25/f2c [329484,76321] 0 2024-02-07T12:25:29.008 INFO:tasks.workunit.client.1.smithi138.stdout:1/147: rmdir d5/d8/da 39 2024-02-07T12:25:29.012 INFO:tasks.workunit.client.1.smithi138.stdout:1/148: rename d5/f12 to d5/d8/da/f29 0 2024-02-07T12:25:29.014 INFO:tasks.workunit.client.1.smithi138.stdout:5/230: truncate da/f15 1227289 0 2024-02-07T12:25:29.015 INFO:tasks.workunit.client.1.smithi138.stdout:1/149: rename d5/f16 to d5/f2a 0 2024-02-07T12:25:29.016 INFO:tasks.workunit.client.1.smithi138.stdout:5/231: write da/f24 [1872,17754] 0 2024-02-07T12:25:29.016 INFO:tasks.workunit.client.1.smithi138.stdout:5/232: fsync f8 0 2024-02-07T12:25:29.017 INFO:tasks.workunit.client.1.smithi138.stdout:1/150: symlink d5/d8/da/d15/l2b 0 2024-02-07T12:25:29.018 INFO:tasks.workunit.client.1.smithi138.stdout:5/233: symlink da/df/d27/l47 0 2024-02-07T12:25:29.019 INFO:tasks.workunit.client.1.smithi138.stdout:1/151: creat d5/d8/da/d15/f2c x:0 0 0 2024-02-07T12:25:29.022 INFO:tasks.workunit.client.1.smithi138.stdout:1/152: getdents d5/d8/da 0 2024-02-07T12:25:29.023 INFO:tasks.workunit.client.1.smithi138.stdout:1/153: mknod d5/d8/c2d 0 2024-02-07T12:25:29.026 INFO:tasks.workunit.client.1.smithi138.stdout:1/154: link d5/d8/c2d d5/d8/da/d1f/d27/c2e 0 2024-02-07T12:25:29.028 INFO:tasks.workunit.client.1.smithi138.stdout:5/234: getdents da/df/d27 0 2024-02-07T12:25:29.029 INFO:tasks.workunit.client.1.smithi138.stdout:5/235: creat da/d22/d25/d2b/d35/f48 x:0 0 0 2024-02-07T12:25:29.032 INFO:tasks.workunit.client.1.smithi138.stdout:5/236: write da/d22/f26 [297637,54517] 0 2024-02-07T12:25:29.034 INFO:tasks.workunit.client.1.smithi138.stdout:5/237: dread f8 [0,4194304] 0 2024-02-07T12:25:29.035 INFO:tasks.workunit.client.1.smithi138.stdout:5/238: fdatasync da/fc 0 2024-02-07T12:25:29.035 INFO:tasks.workunit.client.1.smithi138.stdout:5/239: creat da/d22/d25/d2b/d35/d40/f49 x:0 0 0 2024-02-07T12:25:29.037 INFO:tasks.workunit.client.1.smithi138.stdout:5/240: mkdir da/d43/d4a 0 2024-02-07T12:25:29.039 INFO:tasks.workunit.client.1.smithi138.stdout:5/241: write da/f24 [1346360,113601] 0 2024-02-07T12:25:29.039 INFO:tasks.workunit.client.1.smithi138.stdout:5/242: chown da/d22/d25/d2b 162 1 2024-02-07T12:25:29.040 INFO:tasks.workunit.client.1.smithi138.stdout:5/243: dread f8 [0,4194304] 0 2024-02-07T12:25:29.040 INFO:tasks.workunit.client.1.smithi138.stdout:1/155: dwrite d5/d8/da/f11 [8388608,4194304] 0 2024-02-07T12:25:29.048 INFO:tasks.workunit.client.1.smithi138.stdout:1/156: dread d5/d8/da/d15/f24 [0,4194304] 0 2024-02-07T12:25:29.048 INFO:tasks.workunit.client.1.smithi138.stdout:1/157: chown l2 607896 1 2024-02-07T12:25:29.048 INFO:tasks.workunit.client.1.smithi138.stdout:1/158: stat d5/d8/cb 0 2024-02-07T12:25:29.049 INFO:tasks.workunit.client.1.smithi138.stdout:1/159: chown f4 3064 1 2024-02-07T12:25:29.049 INFO:tasks.workunit.client.1.smithi138.stdout:5/244: dread da/f24 [0,4194304] 0 2024-02-07T12:25:29.050 INFO:tasks.workunit.client.1.smithi138.stdout:5/245: write da/f29 [591908,21295] 0 2024-02-07T12:25:29.051 INFO:tasks.workunit.client.1.smithi138.stdout:5/246: symlink da/d22/l4b 0 2024-02-07T12:25:29.053 INFO:tasks.workunit.client.1.smithi138.stdout:5/247: rename l4 to da/l4c 0 2024-02-07T12:25:29.055 INFO:tasks.workunit.client.1.smithi138.stdout:1/160: write d5/d8/da/f29 [3470964,64248] 0 2024-02-07T12:25:29.056 INFO:tasks.workunit.client.1.smithi138.stdout:5/248: mknod da/d43/c4d 0 2024-02-07T12:25:29.056 INFO:tasks.workunit.client.1.smithi138.stdout:1/161: creat d5/d8/da/f2f x:0 0 0 2024-02-07T12:25:29.058 INFO:tasks.workunit.client.1.smithi138.stdout:1/162: creat d5/d8/da/d20/f30 x:0 0 0 2024-02-07T12:25:29.059 INFO:tasks.workunit.client.1.smithi138.stdout:5/249: getdents da/d22/d25/d2b 0 2024-02-07T12:25:29.060 INFO:tasks.workunit.client.1.smithi138.stdout:5/250: write da/f1d [1179961,14678] 0 2024-02-07T12:25:29.061 INFO:tasks.workunit.client.1.smithi138.stdout:1/163: link d5/d8/da/d20/l22 d5/d8/da/d15/l31 0 2024-02-07T12:25:29.063 INFO:tasks.workunit.client.1.smithi138.stdout:1/164: creat d5/f32 x:0 0 0 2024-02-07T12:25:29.066 INFO:tasks.workunit.client.1.smithi138.stdout:1/165: mknod d5/d8/da/d1f/d27/c33 0 2024-02-07T12:25:29.066 INFO:tasks.workunit.client.1.smithi138.stdout:1/166: chown d5/d8/fd 18417871 1 2024-02-07T12:25:29.066 INFO:tasks.workunit.client.1.smithi138.stdout:1/167: write d5/d8/da/d20/f30 [841830,80245] 0 2024-02-07T12:25:29.067 INFO:tasks.workunit.client.1.smithi138.stdout:1/168: mknod d5/d8/da/d1f/c34 0 2024-02-07T12:25:29.068 INFO:tasks.workunit.client.1.smithi138.stdout:1/169: creat d5/d8/f35 x:0 0 0 2024-02-07T12:25:29.070 INFO:tasks.workunit.client.1.smithi138.stdout:1/170: rename l2 to d5/d8/da/d15/l36 0 2024-02-07T12:25:29.070 INFO:tasks.workunit.client.1.smithi138.stdout:1/171: write d5/d8/da/f2f [245468,108426] 0 2024-02-07T12:25:29.082 INFO:tasks.workunit.client.1.smithi138.stdout:1/172: dwrite d5/f2a [0,4194304] 0 2024-02-07T12:25:29.085 INFO:tasks.workunit.client.1.smithi138.stdout:1/173: symlink d5/d8/da/d15/l37 0 2024-02-07T12:25:29.094 INFO:tasks.workunit.client.1.smithi138.stdout:9/222: sync 2024-02-07T12:25:29.099 INFO:tasks.workunit.client.1.smithi138.stdout:1/174: dwrite d5/d8/da/d15/f24 [0,4194304] 0 2024-02-07T12:25:29.099 INFO:tasks.workunit.client.1.smithi138.stdout:1/175: dread - d5/f32 zero size 2024-02-07T12:25:29.102 INFO:tasks.workunit.client.1.smithi138.stdout:9/223: write d0/d6/d8/d1d/dd/f20 [1809700,49794] 0 2024-02-07T12:25:29.102 INFO:tasks.workunit.client.1.smithi138.stdout:9/224: write d0/d6/f1e [462704,57439] 0 2024-02-07T12:25:29.103 INFO:tasks.workunit.client.1.smithi138.stdout:1/176: dread d5/d8/da/f29 [4194304,4194304] 0 2024-02-07T12:25:29.104 INFO:tasks.workunit.client.1.smithi138.stdout:9/225: mknod d0/d6/d8/d1d/dd/d1f/c4d 0 2024-02-07T12:25:29.104 INFO:tasks.workunit.client.1.smithi138.stdout:9/226: stat d0/f33 0 2024-02-07T12:25:29.105 INFO:tasks.workunit.client.1.smithi138.stdout:1/177: mkdir d5/d38 0 2024-02-07T12:25:29.106 INFO:tasks.workunit.client.1.smithi138.stdout:1/178: mknod d5/d8/da/d1f/c39 0 2024-02-07T12:25:29.107 INFO:tasks.workunit.client.1.smithi138.stdout:1/179: mkdir d5/d8/da/d20/d3a 0 2024-02-07T12:25:29.108 INFO:tasks.workunit.client.1.smithi138.stdout:1/180: truncate d5/d8/da/f1d 1374302 0 2024-02-07T12:25:29.109 INFO:tasks.workunit.client.1.smithi138.stdout:1/181: creat d5/d8/f3b x:0 0 0 2024-02-07T12:25:29.112 INFO:tasks.workunit.client.1.smithi138.stdout:9/227: write d0/d6/d8/f2a [4162191,37113] 0 2024-02-07T12:25:29.112 INFO:tasks.workunit.client.1.smithi138.stdout:9/228: chown d0/d6/d8/d1d/dd/d25/l35 1 1 2024-02-07T12:25:29.116 INFO:tasks.workunit.client.1.smithi138.stdout:1/182: write d5/d8/da/d15/f24 [1375011,20059] 0 2024-02-07T12:25:29.118 INFO:tasks.workunit.client.1.smithi138.stdout:1/183: mkdir d5/d8/da/d1f/d3c 0 2024-02-07T12:25:29.118 INFO:tasks.workunit.client.1.smithi138.stdout:1/184: dread - d5/d8/ff zero size 2024-02-07T12:25:29.118 INFO:tasks.workunit.client.1.smithi138.stdout:1/185: creat d5/d8/da/d15/f3d x:0 0 0 2024-02-07T12:25:29.120 INFO:tasks.workunit.client.1.smithi138.stdout:1/186: mkdir d5/d8/da/d1f/d27/d3e 0 2024-02-07T12:25:29.120 INFO:tasks.workunit.client.1.smithi138.stdout:1/187: truncate d5/d8/ff 1045363 0 2024-02-07T12:25:29.120 INFO:tasks.workunit.client.1.smithi138.stdout:1/188: fsync d5/f32 0 2024-02-07T12:25:29.122 INFO:tasks.workunit.client.1.smithi138.stdout:1/189: rmdir d5/d8/da/d20/d3a 0 2024-02-07T12:25:29.122 INFO:tasks.workunit.client.1.smithi138.stdout:1/190: chown d5/d8/da/f2f 4558133 1 2024-02-07T12:25:29.122 INFO:tasks.workunit.client.1.smithi138.stdout:1/191: fdatasync d5/d8/da/f1d 0 2024-02-07T12:25:29.123 INFO:tasks.workunit.client.1.smithi138.stdout:1/192: write f3 [2803654,45724] 0 2024-02-07T12:25:29.123 INFO:tasks.workunit.client.1.smithi138.stdout:9/229: read d0/d6/d8/d1d/dd/d25/f2d [1765189,99413] 0 2024-02-07T12:25:29.125 INFO:tasks.workunit.client.1.smithi138.stdout:9/230: rename d0/d6/d8/d1d/dd/l42 to d0/d6/d8/d1d/l4e 0 2024-02-07T12:25:29.155 INFO:tasks.workunit.client.1.smithi138.stdout:9/231: dwrite d0/f38 [0,4194304] 0 2024-02-07T12:25:29.156 INFO:tasks.workunit.client.1.smithi138.stdout:1/193: dwrite d5/f1a [0,4194304] 0 2024-02-07T12:25:29.156 INFO:tasks.workunit.client.1.smithi138.stdout:1/194: readlink d5/d8/da/d1f/l23 0 2024-02-07T12:25:29.156 INFO:tasks.workunit.client.1.smithi138.stdout:1/195: chown d5/d38 616991 1 2024-02-07T12:25:29.157 INFO:tasks.workunit.client.1.smithi138.stdout:9/232: write d0/d6/f3c [456023,111875] 0 2024-02-07T12:25:29.162 INFO:tasks.workunit.client.1.smithi138.stdout:1/196: symlink d5/d8/da/l3f 0 2024-02-07T12:25:29.162 INFO:tasks.workunit.client.1.smithi138.stdout:1/197: write d5/f9 [742218,63883] 0 2024-02-07T12:25:29.162 INFO:tasks.workunit.client.1.smithi138.stdout:1/198: chown d5/d8/f3b 0 1 2024-02-07T12:25:29.162 INFO:tasks.workunit.client.1.smithi138.stdout:1/199: chown d5/d8/da/d1f/f25 0 1 2024-02-07T12:25:29.162 INFO:tasks.workunit.client.1.smithi138.stdout:1/200: write d5/f1e [658751,65876] 0 2024-02-07T12:25:29.163 INFO:tasks.workunit.client.1.smithi138.stdout:9/233: creat d0/f4f x:0 0 0 2024-02-07T12:25:29.165 INFO:tasks.workunit.client.1.smithi138.stdout:1/201: mknod d5/d8/da/c40 0 2024-02-07T12:25:29.167 INFO:tasks.workunit.client.1.smithi138.stdout:1/202: link d5/d8/da/d20/f30 d5/d8/da/d20/f41 0 2024-02-07T12:25:29.171 INFO:tasks.workunit.client.1.smithi138.stdout:9/234: dread d0/d6/f27 [0,4194304] 0 2024-02-07T12:25:29.172 INFO:tasks.workunit.client.1.smithi138.stdout:9/235: creat d0/d6/d8/d1d/dd/d41/f50 x:0 0 0 2024-02-07T12:25:29.176 INFO:tasks.workunit.client.1.smithi138.stdout:2/347: sync 2024-02-07T12:25:29.179 INFO:tasks.workunit.client.1.smithi138.stdout:8/313: sync 2024-02-07T12:25:29.179 INFO:tasks.workunit.client.1.smithi138.stdout:6/239: sync 2024-02-07T12:25:29.179 INFO:tasks.workunit.client.1.smithi138.stdout:4/205: sync 2024-02-07T12:25:29.180 INFO:tasks.workunit.client.1.smithi138.stdout:4/206: truncate f8 1457560 0 2024-02-07T12:25:29.182 INFO:tasks.workunit.client.1.smithi138.stdout:6/240: symlink dc/d13/d1e/d35/l4a 0 2024-02-07T12:25:29.182 INFO:tasks.workunit.client.1.smithi138.stdout:6/241: read dc/d13/f1a [2630371,9948] 0 2024-02-07T12:25:29.182 INFO:tasks.workunit.client.1.smithi138.stdout:6/242: chown dc/d31/d3f 691 1 2024-02-07T12:25:29.182 INFO:tasks.workunit.client.1.smithi138.stdout:6/243: write dc/d13/f39 [369382,22627] 0 2024-02-07T12:25:29.182 INFO:tasks.workunit.client.1.smithi138.stdout:6/244: readlink dc/d13/d1e/d24/l44 0 2024-02-07T12:25:29.182 INFO:tasks.workunit.client.1.smithi138.stdout:6/245: chown dc/d13/d1e/d24/l44 5 1 2024-02-07T12:25:29.183 INFO:tasks.workunit.client.1.smithi138.stdout:4/207: unlink d20/d34/d36/l45 0 2024-02-07T12:25:29.184 INFO:tasks.workunit.client.1.smithi138.stdout:4/208: write d20/f25 [2357299,25807] 0 2024-02-07T12:25:29.185 INFO:tasks.workunit.client.1.smithi138.stdout:6/246: creat dc/f4b x:0 0 0 2024-02-07T12:25:29.185 INFO:tasks.workunit.client.1.smithi138.stdout:6/247: read - dc/f4b zero size 2024-02-07T12:25:29.187 INFO:tasks.workunit.client.1.smithi138.stdout:4/209: mkdir d20/d47 0 2024-02-07T12:25:29.189 INFO:tasks.workunit.client.1.smithi138.stdout:2/348: dread d3/dd/f2e [0,4194304] 0 2024-02-07T12:25:29.189 INFO:tasks.workunit.client.1.smithi138.stdout:2/349: fdatasync d3/dd/d19/d44/f69 0 2024-02-07T12:25:29.193 INFO:tasks.workunit.client.1.smithi138.stdout:2/350: dread d3/dd/d19/f35 [4194304,4194304] 0 2024-02-07T12:25:29.193 INFO:tasks.workunit.client.1.smithi138.stdout:2/351: write d3/dd/d19/d44/f69 [2396905,26239] 0 2024-02-07T12:25:29.195 INFO:tasks.workunit.client.1.smithi138.stdout:1/203: dwrite d5/f1e [0,4194304] 0 2024-02-07T12:25:29.196 INFO:tasks.workunit.client.1.smithi138.stdout:2/352: mkdir d3/dd/d14/d86 0 2024-02-07T12:25:29.197 INFO:tasks.workunit.client.1.smithi138.stdout:9/236: dwrite d0/d6/f27 [0,4194304] 0 2024-02-07T12:25:29.199 INFO:tasks.workunit.client.1.smithi138.stdout:8/314: dwrite d1/de/d11/d17/d2e/d49/f3d [0,4194304] 0 2024-02-07T12:25:29.199 INFO:tasks.workunit.client.1.smithi138.stdout:2/353: mknod d3/dd/d14/d49/d25/d3d/d4f/d73/d80/c87 0 2024-02-07T12:25:29.199 INFO:tasks.workunit.client.1.smithi138.stdout:8/315: chown d1/c2b 265958676 1 2024-02-07T12:25:29.199 INFO:tasks.workunit.client.1.smithi138.stdout:8/316: chown d1/de/d11/d17/d3e 110936 1 2024-02-07T12:25:29.206 INFO:tasks.workunit.client.1.smithi138.stdout:9/237: creat d0/d34/f51 x:0 0 0 2024-02-07T12:25:29.217 INFO:tasks.workunit.client.1.smithi138.stdout:4/210: dwrite f1d [0,4194304] 0 2024-02-07T12:25:29.217 INFO:tasks.workunit.client.1.smithi138.stdout:4/211: readlink d20/d34/l35 0 2024-02-07T12:25:29.217 INFO:tasks.workunit.client.1.smithi138.stdout:4/212: dread - d20/f33 zero size 2024-02-07T12:25:29.217 INFO:tasks.workunit.client.1.smithi138.stdout:4/213: creat d20/d34/d36/f48 x:0 0 0 2024-02-07T12:25:29.218 INFO:tasks.workunit.client.1.smithi138.stdout:7/384: sync 2024-02-07T12:25:29.218 INFO:tasks.workunit.client.1.smithi138.stdout:3/334: sync 2024-02-07T12:25:29.218 INFO:tasks.workunit.client.1.smithi138.stdout:0/200: sync 2024-02-07T12:25:29.219 INFO:tasks.workunit.client.1.smithi138.stdout:6/248: dwrite f8 [0,4194304] 0 2024-02-07T12:25:29.220 INFO:tasks.workunit.client.1.smithi138.stdout:6/249: write dc/d13/f1b [3735969,47928] 0 2024-02-07T12:25:29.221 INFO:tasks.workunit.client.1.smithi138.stdout:6/250: read f6 [4395226,90928] 0 2024-02-07T12:25:29.221 INFO:tasks.workunit.client.1.smithi138.stdout:6/251: chown dc/d31/d3f 3 1 2024-02-07T12:25:29.223 INFO:tasks.workunit.client.1.smithi138.stdout:3/335: link d5/d15/f6d d5/d27/f71 0 2024-02-07T12:25:29.223 INFO:tasks.workunit.client.1.smithi138.stdout:8/317: dwrite d1/de/d11/d17/d2e/d49/f39 [0,4194304] 0 2024-02-07T12:25:29.223 INFO:tasks.workunit.client.1.smithi138.stdout:8/318: chown d1/de/d11/d17/d2e/d3a/l3c 443120 1 2024-02-07T12:25:29.223 INFO:tasks.workunit.client.1.smithi138.stdout:8/319: creat d1/de/d11/d17/d2e/d49/d4c/f65 x:0 0 0 2024-02-07T12:25:29.223 INFO:tasks.workunit.client.1.smithi138.stdout:2/354: dwrite d3/dd/d19/d44/f57 [0,4194304] 0 2024-02-07T12:25:29.223 INFO:tasks.workunit.client.1.smithi138.stdout:2/355: creat d3/d4e/f88 x:0 0 0 2024-02-07T12:25:29.224 INFO:tasks.workunit.client.1.smithi138.stdout:7/385: rename d0/d8/d15/f1e to d0/d8/d11/d1f/d53/f7f 0 2024-02-07T12:25:29.225 INFO:tasks.workunit.client.1.smithi138.stdout:0/201: symlink d4/d9/d37/d3d/l46 0 2024-02-07T12:25:29.226 INFO:tasks.workunit.client.1.smithi138.stdout:0/202: truncate d4/d9/db/f15 1552617 0 2024-02-07T12:25:29.226 INFO:tasks.workunit.client.1.smithi138.stdout:0/203: write d4/f5 [1545759,95947] 0 2024-02-07T12:25:29.229 INFO:tasks.workunit.client.1.smithi138.stdout:9/238: dwrite d0/d34/f51 [0,4194304] 0 2024-02-07T12:25:29.229 INFO:tasks.workunit.client.1.smithi138.stdout:9/239: chown d0/d6/d8/f2a 899757 1 2024-02-07T12:25:29.230 INFO:tasks.workunit.client.1.smithi138.stdout:6/252: write f8 [2108825,122804] 0 2024-02-07T12:25:29.230 INFO:tasks.workunit.client.1.smithi138.stdout:8/320: creat d1/de/d11/d17/d2e/d3a/f66 x:0 0 0 2024-02-07T12:25:29.232 INFO:tasks.workunit.client.1.smithi138.stdout:2/356: mknod d3/dd/d14/d49/d25/d3d/d4f/d73/d80/c89 0 2024-02-07T12:25:29.232 INFO:tasks.workunit.client.1.smithi138.stdout:2/357: dread - d3/dd/d14/d49/d29/d5b/f7f zero size 2024-02-07T12:25:29.233 INFO:tasks.workunit.client.1.smithi138.stdout:7/386: creat d0/d6/d1d/d24/f80 x:0 0 0 2024-02-07T12:25:29.233 INFO:tasks.workunit.client.1.smithi138.stdout:0/204: getdents d4/d9/d37 0 2024-02-07T12:25:29.240 INFO:tasks.workunit.client.1.smithi138.stdout:7/387: dread d0/d6/d3e/f3f [0,4194304] 0 2024-02-07T12:25:29.240 INFO:tasks.workunit.client.1.smithi138.stdout:6/253: read dc/f1f [1057623,59768] 0 2024-02-07T12:25:29.240 INFO:tasks.workunit.client.1.smithi138.stdout:6/254: truncate dc/d13/d1e/d35/f40 813805 0 2024-02-07T12:25:29.240 INFO:tasks.workunit.client.1.smithi138.stdout:6/255: creat dc/d13/d1e/d35/f4c x:0 0 0 2024-02-07T12:25:29.241 INFO:tasks.workunit.client.1.smithi138.stdout:8/321: write d1/de/d11/d17/f24 [774491,28313] 0 2024-02-07T12:25:29.241 INFO:tasks.workunit.client.1.smithi138.stdout:8/322: chown d1/de/d11/d17/d2e/d49 4846 1 2024-02-07T12:25:29.242 INFO:tasks.workunit.client.1.smithi138.stdout:0/205: unlink d4/d9/c13 0 2024-02-07T12:25:29.242 INFO:tasks.workunit.client.1.smithi138.stdout:0/206: write d4/d9/de/d1d/f41 [206859,15459] 0 2024-02-07T12:25:29.242 INFO:tasks.workunit.client.1.smithi138.stdout:2/358: write d3/dd/d14/d49/d25/d3d/f3e [1714316,7566] 0 2024-02-07T12:25:29.243 INFO:tasks.workunit.client.1.smithi138.stdout:3/336: dwrite d5/d26/d5e/f69 [0,4194304] 0 2024-02-07T12:25:29.243 INFO:tasks.workunit.client.1.smithi138.stdout:2/359: chown d3/dd/d19/d1f/d37/f7c 0 1 2024-02-07T12:25:29.243 INFO:tasks.workunit.client.1.smithi138.stdout:2/360: dread - d3/dd/d14/f4d zero size 2024-02-07T12:25:29.243 INFO:tasks.workunit.client.1.smithi138.stdout:7/388: symlink d0/d8/d11/d1f/l81 0 2024-02-07T12:25:29.245 INFO:tasks.workunit.client.1.smithi138.stdout:8/323: symlink d1/de/d11/d17/l67 0 2024-02-07T12:25:29.245 INFO:tasks.workunit.client.1.smithi138.stdout:8/324: chown d1/de/d11/d17/d2e/d49/d4c 776 1 2024-02-07T12:25:29.245 INFO:tasks.workunit.client.1.smithi138.stdout:8/325: dread - d1/de/d11/d17/d2e/d3a/d50/f5c zero size 2024-02-07T12:25:29.246 INFO:tasks.workunit.client.1.smithi138.stdout:0/207: read d4/d9/f12 [3472291,5137] 0 2024-02-07T12:25:29.246 INFO:tasks.workunit.client.1.smithi138.stdout:0/208: stat d4/d9/db/f15 0 2024-02-07T12:25:29.246 INFO:tasks.workunit.client.1.smithi138.stdout:0/209: fsync d4/d9/de/f1c 0 2024-02-07T12:25:29.246 INFO:tasks.workunit.client.1.smithi138.stdout:0/210: dread - d4/d9/de/d1d/d21/f43 zero size 2024-02-07T12:25:29.246 INFO:tasks.workunit.client.1.smithi138.stdout:6/256: dread dc/d13/d1e/d24/f2c [0,4194304] 0 2024-02-07T12:25:29.248 INFO:tasks.workunit.client.1.smithi138.stdout:3/337: symlink d5/d26/d5e/l72 0 2024-02-07T12:25:29.253 INFO:tasks.workunit.client.1.smithi138.stdout:7/389: mknod d0/d8/d11/d1f/d53/c82 0 2024-02-07T12:25:29.254 INFO:tasks.workunit.client.1.smithi138.stdout:7/390: truncate d0/f7e 550811 0 2024-02-07T12:25:29.254 INFO:tasks.workunit.client.1.smithi138.stdout:8/326: creat d1/de/d11/d17/d2e/d49/d4c/d62/f68 x:0 0 0 2024-02-07T12:25:29.254 INFO:tasks.workunit.client.1.smithi138.stdout:0/211: truncate d4/d9/fa 1497868 0 2024-02-07T12:25:29.255 INFO:tasks.workunit.client.1.smithi138.stdout:6/257: mkdir dc/d13/d1e/d4d 0 2024-02-07T12:25:29.255 INFO:tasks.workunit.client.1.smithi138.stdout:6/258: chown dc/f1f 723151607 1 2024-02-07T12:25:29.258 INFO:tasks.workunit.client.1.smithi138.stdout:6/259: mknod dc/d31/d38/c4e 0 2024-02-07T12:25:29.261 INFO:tasks.workunit.client.1.smithi138.stdout:7/391: rename d0/d8/d11/d26/l65 to d0/d6/d1d/d24/l83 0 2024-02-07T12:25:29.261 INFO:tasks.workunit.client.1.smithi138.stdout:7/392: write d0/d6/d1d/d24/f35 [1749359,55225] 0 2024-02-07T12:25:29.262 INFO:tasks.workunit.client.1.smithi138.stdout:3/338: dwrite d5/d15/f48 [0,4194304] 0 2024-02-07T12:25:29.262 INFO:tasks.workunit.client.1.smithi138.stdout:3/339: write d5/d27/f6b [586659,61027] 0 2024-02-07T12:25:29.262 INFO:tasks.workunit.client.1.smithi138.stdout:6/260: symlink dc/d13/d1e/l4f 0 2024-02-07T12:25:29.262 INFO:tasks.workunit.client.1.smithi138.stdout:6/261: write dc/d13/f1b [3827962,90885] 0 2024-02-07T12:25:29.262 INFO:tasks.workunit.client.1.smithi138.stdout:6/262: chown f8 2852443 1 2024-02-07T12:25:29.263 INFO:tasks.workunit.client.1.smithi138.stdout:6/263: write dc/d31/f3e [942548,19189] 0 2024-02-07T12:25:29.263 INFO:tasks.workunit.client.1.smithi138.stdout:8/327: dread d1/de/d11/d17/d2e/d49/f3d [0,4194304] 0 2024-02-07T12:25:29.263 INFO:tasks.workunit.client.1.smithi138.stdout:7/393: mkdir d0/d6/d84 0 2024-02-07T12:25:29.264 INFO:tasks.workunit.client.1.smithi138.stdout:7/394: stat d0/d6/d19/l40 0 2024-02-07T12:25:29.264 INFO:tasks.workunit.client.1.smithi138.stdout:7/395: write d0/f6c [843031,64865] 0 2024-02-07T12:25:29.264 INFO:tasks.workunit.client.1.smithi138.stdout:7/396: stat d0/d8/l43 0 2024-02-07T12:25:29.265 INFO:tasks.workunit.client.1.smithi138.stdout:3/340: link d5/d26/d28/c54 d5/d26/d28/c73 0 2024-02-07T12:25:29.267 INFO:tasks.workunit.client.1.smithi138.stdout:6/264: symlink dc/d13/d1e/d35/l50 0 2024-02-07T12:25:29.269 INFO:tasks.workunit.client.1.smithi138.stdout:8/328: rename d1/de/d11/d17/l4a to d1/de/d11/d17/d2e/l69 0 2024-02-07T12:25:29.270 INFO:tasks.workunit.client.1.smithi138.stdout:7/397: creat d0/d6/d1d/d24/f85 x:0 0 0 2024-02-07T12:25:29.271 INFO:tasks.workunit.client.1.smithi138.stdout:7/398: chown d0/d8/d11/d1f/d53/f7f 189955 1 2024-02-07T12:25:29.272 INFO:tasks.workunit.client.1.smithi138.stdout:3/341: unlink d5/d26/d5e/l72 0 2024-02-07T12:25:29.274 INFO:tasks.workunit.client.1.smithi138.stdout:6/265: symlink dc/d13/d1e/d4d/l51 0 2024-02-07T12:25:29.274 INFO:tasks.workunit.client.1.smithi138.stdout:7/399: dread d0/d8/d11/d63/f7a [0,4194304] 0 2024-02-07T12:25:29.274 INFO:tasks.workunit.client.1.smithi138.stdout:0/212: fsync d4/d9/fa 0 2024-02-07T12:25:29.277 INFO:tasks.workunit.client.1.smithi138.stdout:8/329: creat d1/de/d11/d17/d2e/d49/d4c/d57/f6a x:0 0 0 2024-02-07T12:25:29.279 INFO:tasks.workunit.client.1.smithi138.stdout:3/342: rename d5/d34/l3e to d5/d15/d32/l74 0 2024-02-07T12:25:29.284 INFO:tasks.workunit.client.1.smithi138.stdout:7/400: mkdir d0/d8/d11/d5f/d86 0 2024-02-07T12:25:29.285 INFO:tasks.workunit.client.1.smithi138.stdout:2/361: truncate d3/dd/d14/d49/d25/d3d/f3e 635363 0 2024-02-07T12:25:29.287 INFO:tasks.workunit.client.1.smithi138.stdout:8/330: link d1/de/d11/d17/d2e/d49/c12 d1/de/d11/d17/d2e/c6b 0 2024-02-07T12:25:29.290 INFO:tasks.workunit.client.1.smithi138.stdout:7/401: dread d0/d6/d1d/d24/f37 [0,4194304] 0 2024-02-07T12:25:29.290 INFO:tasks.workunit.client.1.smithi138.stdout:3/343: creat d5/f75 x:0 0 0 2024-02-07T12:25:29.294 INFO:tasks.workunit.client.1.smithi138.stdout:7/402: dread d0/d6/d3e/f3f [0,4194304] 0 2024-02-07T12:25:29.294 INFO:tasks.workunit.client.1.smithi138.stdout:7/403: write d0/d6/d1d/d24/f85 [327951,34575] 0 2024-02-07T12:25:29.295 INFO:tasks.workunit.client.1.smithi138.stdout:6/266: dwrite dc/d13/d1e/f2f [0,4194304] 0 2024-02-07T12:25:29.295 INFO:tasks.workunit.client.1.smithi138.stdout:8/331: dread d1/de/d11/d17/d2e/d49/f3d [0,4194304] 0 2024-02-07T12:25:29.296 INFO:tasks.workunit.client.1.smithi138.stdout:3/344: mknod d5/d15/c76 0 2024-02-07T12:25:29.298 INFO:tasks.workunit.client.1.smithi138.stdout:7/404: rename d0/d6/d1d/d24/f80 to d0/d8/f87 0 2024-02-07T12:25:29.298 INFO:tasks.workunit.client.1.smithi138.stdout:7/405: truncate d0/d8/f87 312307 0 2024-02-07T12:25:29.304 INFO:tasks.workunit.client.1.smithi138.stdout:7/406: symlink d0/d8/d11/d1f/d53/l88 0 2024-02-07T12:25:29.305 INFO:tasks.workunit.client.1.smithi138.stdout:2/362: dwrite d3/dd/d14/d49/d25/d3d/d4f/f68 [8388608,4194304] 0 2024-02-07T12:25:29.305 INFO:tasks.workunit.client.1.smithi138.stdout:2/363: fdatasync d3/dd/d19/d44/f57 0 2024-02-07T12:25:29.306 INFO:tasks.workunit.client.1.smithi138.stdout:0/213: dwrite d4/d9/de/f45 [0,4194304] 0 2024-02-07T12:25:29.306 INFO:tasks.workunit.client.1.smithi138.stdout:0/214: fsync d4/d9/de/f24 0 2024-02-07T12:25:29.306 INFO:tasks.workunit.client.1.smithi138.stdout:8/332: fdatasync d1/de/d11/d17/f24 0 2024-02-07T12:25:29.306 INFO:tasks.workunit.client.1.smithi138.stdout:6/267: rmdir dc/d13/d1e/d35 39 2024-02-07T12:25:29.308 INFO:tasks.workunit.client.1.smithi138.stdout:3/345: getdents d5/d15/d32 0 2024-02-07T12:25:29.311 INFO:tasks.workunit.client.1.smithi138.stdout:2/364: rename d3/dd/d19/c20 to d3/dd/d14/d49/d29/d5b/c8a 0 2024-02-07T12:25:29.311 INFO:tasks.workunit.client.1.smithi138.stdout:2/365: stat d3/dd/d14/d49/d25/c27 0 2024-02-07T12:25:29.312 INFO:tasks.workunit.client.1.smithi138.stdout:7/407: write d0/d6/d1d/f20 [2781001,7624] 0 2024-02-07T12:25:29.312 INFO:tasks.workunit.client.1.smithi138.stdout:7/408: fdatasync d0/d8/d11/d1f/d53/f7f 0 2024-02-07T12:25:29.312 INFO:tasks.workunit.client.1.smithi138.stdout:7/409: write d0/d6/fa [3119724,78970] 0 2024-02-07T12:25:29.321 INFO:tasks.workunit.client.1.smithi138.stdout:0/215: mknod d4/d9/d33/c47 0 2024-02-07T12:25:29.323 INFO:tasks.workunit.client.1.smithi138.stdout:8/333: creat d1/de/d11/f6c x:0 0 0 2024-02-07T12:25:29.328 INFO:tasks.workunit.client.1.smithi138.stdout:6/268: creat dc/d31/d3f/f52 x:0 0 0 2024-02-07T12:25:29.328 INFO:tasks.workunit.client.1.smithi138.stdout:0/216: dread d4/d9/f22 [0,4194304] 0 2024-02-07T12:25:29.328 INFO:tasks.workunit.client.1.smithi138.stdout:0/217: chown d4/d9/l27 136280 1 2024-02-07T12:25:29.328 INFO:tasks.workunit.client.1.smithi138.stdout:0/218: fsync d4/fd 0 2024-02-07T12:25:29.329 INFO:tasks.workunit.client.1.smithi138.stdout:3/346: mkdir d5/d26/d5e/d77 0 2024-02-07T12:25:29.329 INFO:tasks.workunit.client.1.smithi138.stdout:3/347: creat d5/d26/d28/f78 x:0 0 0 2024-02-07T12:25:29.329 INFO:tasks.workunit.client.1.smithi138.stdout:7/410: dwrite d0/d8/d15/f47 [0,4194304] 0 2024-02-07T12:25:29.329 INFO:tasks.workunit.client.1.smithi138.stdout:2/366: mknod d3/dd/d19/d1f/d46/d71/d7e/c8b 0 2024-02-07T12:25:29.331 INFO:tasks.workunit.client.1.smithi138.stdout:8/334: symlink d1/de/d11/d17/d2e/d49/l6d 0 2024-02-07T12:25:29.331 INFO:tasks.workunit.client.1.smithi138.stdout:8/335: read - d1/de/d11/d17/d2e/d3a/f61 zero size 2024-02-07T12:25:29.333 INFO:tasks.workunit.client.1.smithi138.stdout:0/219: symlink d4/d9/d37/d3d/l48 0 2024-02-07T12:25:29.333 INFO:tasks.workunit.client.1.smithi138.stdout:0/220: chown d4/d9/f3e 472 1 2024-02-07T12:25:29.333 INFO:tasks.workunit.client.1.smithi138.stdout:0/221: creat d4/d9/de/d1d/f49 x:0 0 0 2024-02-07T12:25:29.337 INFO:tasks.workunit.client.1.smithi138.stdout:0/222: dread d4/d9/de/d1d/d21/d2b/f28 [0,4194304] 0 2024-02-07T12:25:29.337 INFO:tasks.workunit.client.1.smithi138.stdout:0/223: dread - d4/fd zero size 2024-02-07T12:25:29.337 INFO:tasks.workunit.client.1.smithi138.stdout:0/224: creat d4/d9/f4a x:0 0 0 2024-02-07T12:25:29.337 INFO:tasks.workunit.client.1.smithi138.stdout:3/348: dread d5/d26/d28/f52 [0,4194304] 0 2024-02-07T12:25:29.339 INFO:tasks.workunit.client.1.smithi138.stdout:8/336: rmdir d1/de/d59 0 2024-02-07T12:25:29.339 INFO:tasks.workunit.client.1.smithi138.stdout:8/337: stat d1/de/d11/c16 0 2024-02-07T12:25:29.343 INFO:tasks.workunit.client.1.smithi138.stdout:5/251: sync 2024-02-07T12:25:29.343 INFO:tasks.workunit.client.1.smithi138.stdout:5/252: stat da/d22/d44 0 2024-02-07T12:25:29.344 INFO:tasks.workunit.client.1.smithi138.stdout:3/349: rmdir d5/d26/d64 0 2024-02-07T12:25:29.344 INFO:tasks.workunit.client.1.smithi138.stdout:3/350: write d5/d26/d4e/f63 [208388,96710] 0 2024-02-07T12:25:29.345 INFO:tasks.workunit.client.1.smithi138.stdout:5/253: dread da/f1f [0,4194304] 0 2024-02-07T12:25:29.345 INFO:tasks.workunit.client.1.smithi138.stdout:2/367: getdents d3/dd/d14/d49/d29/d5b 0 2024-02-07T12:25:29.345 INFO:tasks.workunit.client.1.smithi138.stdout:2/368: write d3/dd/d14/d49/d25/d3d/d5f/f64 [381237,20252] 0 2024-02-07T12:25:29.346 INFO:tasks.workunit.client.1.smithi138.stdout:6/269: fsync dc/d31/d3f/f52 0 2024-02-07T12:25:29.346 INFO:tasks.workunit.client.1.smithi138.stdout:7/411: dwrite d0/d8/f87 [0,4194304] 0 2024-02-07T12:25:29.346 INFO:tasks.workunit.client.1.smithi138.stdout:6/270: creat dc/d31/d38/f53 x:0 0 0 2024-02-07T12:25:29.347 INFO:tasks.workunit.client.1.smithi138.stdout:8/338: mknod d1/de/d11/d17/c6e 0 2024-02-07T12:25:29.348 INFO:tasks.workunit.client.1.smithi138.stdout:0/225: getdents d4/d9/db 0 2024-02-07T12:25:29.348 INFO:tasks.workunit.client.1.smithi138.stdout:0/226: chown d4/d9/de/l1e 840466277 1 2024-02-07T12:25:29.348 INFO:tasks.workunit.client.1.smithi138.stdout:0/227: write d4/d9/db/f15 [1679319,41064] 0 2024-02-07T12:25:29.348 INFO:tasks.workunit.client.1.smithi138.stdout:0/228: fsync d4/d9/f40 0 2024-02-07T12:25:29.350 INFO:tasks.workunit.client.1.smithi138.stdout:3/351: mkdir d5/d34/d79 0 2024-02-07T12:25:29.352 INFO:tasks.workunit.client.1.smithi138.stdout:5/254: creat da/df/f4e x:0 0 0 2024-02-07T12:25:29.355 INFO:tasks.workunit.client.1.smithi138.stdout:2/369: symlink d3/dd/d14/d49/d25/d3d/d4f/d73/d80/l8c 0 2024-02-07T12:25:29.358 INFO:tasks.workunit.client.1.smithi138.stdout:1/204: sync 2024-02-07T12:25:29.366 INFO:tasks.workunit.client.1.smithi138.stdout:7/412: creat d0/d8/d11/d63/f89 x:0 0 0 2024-02-07T12:25:29.367 INFO:tasks.workunit.client.1.smithi138.stdout:6/271: mkdir dc/d31/d54 0 2024-02-07T12:25:29.370 INFO:tasks.workunit.client.1.smithi138.stdout:2/370: rename d3/dd/d19/d1f/d46/f48 to d3/dd/d14/d49/d29/d5b/f8d 0 2024-02-07T12:25:29.371 INFO:tasks.workunit.client.1.smithi138.stdout:6/272: mkdir dc/d31/d3f/d55 0 2024-02-07T12:25:29.371 INFO:tasks.workunit.client.1.smithi138.stdout:6/273: dread - dc/d13/f42 zero size 2024-02-07T12:25:29.371 INFO:tasks.workunit.client.1.smithi138.stdout:9/240: sync 2024-02-07T12:25:29.371 INFO:tasks.workunit.client.1.smithi138.stdout:4/214: sync 2024-02-07T12:25:29.372 INFO:tasks.workunit.client.1.smithi138.stdout:6/274: write dc/d13/f19 [4887370,25974] 0 2024-02-07T12:25:29.373 INFO:tasks.workunit.client.1.smithi138.stdout:1/205: rename d5/d8/da/d1f/d27/c2e to d5/d8/da/d1f/d27/d3e/c42 0 2024-02-07T12:25:29.373 INFO:tasks.workunit.client.1.smithi138.stdout:5/255: dwrite da/f29 [0,4194304] 0 2024-02-07T12:25:29.373 INFO:tasks.workunit.client.1.smithi138.stdout:8/339: dwrite d1/de/d11/d17/d2e/d3a/f61 [0,4194304] 0 2024-02-07T12:25:29.375 INFO:tasks.workunit.client.1.smithi138.stdout:2/371: link d3/dd/d14/d49/d29/l32 d3/d4e/l8e 0 2024-02-07T12:25:29.376 INFO:tasks.workunit.client.1.smithi138.stdout:6/275: symlink dc/d13/d1e/l56 0 2024-02-07T12:25:29.377 INFO:tasks.workunit.client.1.smithi138.stdout:7/413: dread d0/d6/d1d/d24/f36 [0,4194304] 0 2024-02-07T12:25:29.379 INFO:tasks.workunit.client.1.smithi138.stdout:1/206: getdents d5/d8/da/d1f 0 2024-02-07T12:25:29.380 INFO:tasks.workunit.client.1.smithi138.stdout:6/276: mknod dc/d13/d1e/d24/c57 0 2024-02-07T12:25:29.383 INFO:tasks.workunit.client.1.smithi138.stdout:9/241: rename d0/d6/f4b to d0/d6/d8/f52 0 2024-02-07T12:25:29.386 INFO:tasks.workunit.client.1.smithi138.stdout:7/414: mkdir d0/d39/d8a 0 2024-02-07T12:25:29.386 INFO:tasks.workunit.client.1.smithi138.stdout:7/415: creat d0/f8b x:0 0 0 2024-02-07T12:25:29.386 INFO:tasks.workunit.client.1.smithi138.stdout:7/416: creat d0/f8c x:0 0 0 2024-02-07T12:25:29.386 INFO:tasks.workunit.client.1.smithi138.stdout:7/417: dread - d0/f8b zero size 2024-02-07T12:25:29.386 INFO:tasks.workunit.client.1.smithi138.stdout:4/215: dwrite d20/f24 [0,4194304] 0 2024-02-07T12:25:29.387 INFO:tasks.workunit.client.1.smithi138.stdout:1/207: mkdir d5/d43 0 2024-02-07T12:25:29.387 INFO:tasks.workunit.client.1.smithi138.stdout:6/277: symlink dc/l58 0 2024-02-07T12:25:29.390 INFO:tasks.workunit.client.1.smithi138.stdout:9/242: creat d0/d6/d8/d1d/f53 x:0 0 0 2024-02-07T12:25:29.390 INFO:tasks.workunit.client.1.smithi138.stdout:1/208: dread d5/d8/f14 [4194304,4194304] 0 2024-02-07T12:25:29.392 INFO:tasks.workunit.client.1.smithi138.stdout:7/418: creat d0/d6/d1d/d38/f8d x:0 0 0 2024-02-07T12:25:29.392 INFO:tasks.workunit.client.1.smithi138.stdout:7/419: chown d0/d6/f4d 0 1 2024-02-07T12:25:29.397 INFO:tasks.workunit.client.1.smithi138.stdout:6/278: mknod dc/d13/d1e/d24/c59 0 2024-02-07T12:25:29.398 INFO:tasks.workunit.client.1.smithi138.stdout:5/256: rename da/d22/d25 to da/df/d27/d2e/d4f 0 2024-02-07T12:25:29.399 INFO:tasks.workunit.client.1.smithi138.stdout:9/243: symlink d0/d6/d8/d1d/l54 0 2024-02-07T12:25:29.401 INFO:tasks.workunit.client.1.smithi138.stdout:7/420: getdents d0/d8/d11/d5f 0 2024-02-07T12:25:29.401 INFO:tasks.workunit.client.1.smithi138.stdout:7/421: fdatasync d0/d6/d3e/f44 0 2024-02-07T12:25:29.402 INFO:tasks.workunit.client.1.smithi138.stdout:2/372: rename d3/dd/d14/d49/d25/d3d/d4f to d3/dd/d14/d8f 0 2024-02-07T12:25:29.404 INFO:tasks.workunit.client.1.smithi138.stdout:9/244: link d0/d6/d8/d1d/c46 d0/d34/d45/c55 0 2024-02-07T12:25:29.405 INFO:tasks.workunit.client.1.smithi138.stdout:7/422: unlink d0/d6/d1d/d24/f35 0 2024-02-07T12:25:29.408 INFO:tasks.workunit.client.1.smithi138.stdout:9/245: mknod d0/c56 0 2024-02-07T12:25:29.408 INFO:tasks.workunit.client.1.smithi138.stdout:2/373: rmdir d3/dd/d19/d1f/d46 39 2024-02-07T12:25:29.409 INFO:tasks.workunit.client.1.smithi138.stdout:9/246: truncate d0/d34/d45/f43 2389856 0 2024-02-07T12:25:29.409 INFO:tasks.workunit.client.1.smithi138.stdout:9/247: dread - d0/d6/d8/f52 zero size 2024-02-07T12:25:29.409 INFO:tasks.workunit.client.1.smithi138.stdout:9/248: write d0/d6/d8/d1d/dd/f20 [167825,42161] 0 2024-02-07T12:25:29.410 INFO:tasks.workunit.client.1.smithi138.stdout:9/249: chown d0/d6/d8/d1d/l4e 564844 1 2024-02-07T12:25:29.411 INFO:tasks.workunit.client.1.smithi138.stdout:2/374: dread d3/dd/d14/d49/d25/d3d/f52 [0,4194304] 0 2024-02-07T12:25:29.419 INFO:tasks.workunit.client.1.smithi138.stdout:7/423: dread d0/d6/d3e/f68 [0,4194304] 0 2024-02-07T12:25:29.421 INFO:tasks.workunit.client.1.smithi138.stdout:7/424: creat d0/d8/d11/d5f/d86/f8e x:0 0 0 2024-02-07T12:25:29.421 INFO:tasks.workunit.client.1.smithi138.stdout:7/425: write d0/f8b [44218,46466] 0 2024-02-07T12:25:29.432 INFO:tasks.workunit.client.1.smithi138.stdout:4/216: dwrite f15 [0,4194304] 0 2024-02-07T12:25:29.441 INFO:tasks.workunit.client.1.smithi138.stdout:4/217: dread d20/f32 [0,4194304] 0 2024-02-07T12:25:29.441 INFO:tasks.workunit.client.1.smithi138.stdout:4/218: fdatasync fb 0 2024-02-07T12:25:29.445 INFO:tasks.workunit.client.1.smithi138.stdout:1/209: dwrite d5/d8/f35 [0,4194304] 0 2024-02-07T12:25:29.446 INFO:tasks.workunit.client.1.smithi138.stdout:5/257: dwrite da/fb [0,4194304] 0 2024-02-07T12:25:29.446 INFO:tasks.workunit.client.1.smithi138.stdout:2/375: dwrite d3/d4e/f50 [0,4194304] 0 2024-02-07T12:25:29.446 INFO:tasks.workunit.client.1.smithi138.stdout:5/258: chown da/df/c14 7759 1 2024-02-07T12:25:29.446 INFO:tasks.workunit.client.1.smithi138.stdout:6/279: dwrite dc/d13/d1e/d35/f4c [0,4194304] 0 2024-02-07T12:25:29.451 INFO:tasks.workunit.client.1.smithi138.stdout:9/250: dread d0/d6/d8/d1d/dd/f20 [0,4194304] 0 2024-02-07T12:25:29.456 INFO:tasks.workunit.client.1.smithi138.stdout:4/219: dwrite d20/f39 [0,4194304] 0 2024-02-07T12:25:29.459 INFO:tasks.workunit.client.1.smithi138.stdout:6/280: dread dc/d13/f1b [0,4194304] 0 2024-02-07T12:25:29.463 INFO:tasks.workunit.client.1.smithi138.stdout:1/210: rmdir d5/d8 39 2024-02-07T12:25:29.464 INFO:tasks.workunit.client.1.smithi138.stdout:5/259: dwrite da/df/d27/d2e/d4f/f2c [0,4194304] 0 2024-02-07T12:25:29.466 INFO:tasks.workunit.client.1.smithi138.stdout:4/220: symlink d20/d34/d36/l49 0 2024-02-07T12:25:29.467 INFO:tasks.workunit.client.1.smithi138.stdout:6/281: symlink dc/d13/d1e/d4d/l5a 0 2024-02-07T12:25:29.467 INFO:tasks.workunit.client.1.smithi138.stdout:6/282: chown dc/d13/d1e/d4d/l51 6378914 1 2024-02-07T12:25:29.467 INFO:tasks.workunit.client.1.smithi138.stdout:6/283: chown dc/d13/f19 30 1 2024-02-07T12:25:29.467 INFO:tasks.workunit.client.1.smithi138.stdout:6/284: write dc/d31/f47 [69875,71251] 0 2024-02-07T12:25:29.470 INFO:tasks.workunit.client.1.smithi138.stdout:6/285: symlink dc/d13/d1e/l5b 0 2024-02-07T12:25:29.470 INFO:tasks.workunit.client.1.smithi138.stdout:6/286: chown dc/d31/d38/c4e 3 1 2024-02-07T12:25:29.470 INFO:tasks.workunit.client.1.smithi138.stdout:6/287: fdatasync dc/d13/f1a 0 2024-02-07T12:25:29.471 INFO:tasks.workunit.client.1.smithi138.stdout:1/211: link d5/d8/da/c40 d5/d8/c44 0 2024-02-07T12:25:29.475 INFO:tasks.workunit.client.1.smithi138.stdout:4/221: write f1d [887870,75586] 0 2024-02-07T12:25:29.482 INFO:tasks.workunit.client.1.smithi138.stdout:6/288: write dc/d13/d1e/f2b [3440916,6695] 0 2024-02-07T12:25:29.483 INFO:tasks.workunit.client.1.smithi138.stdout:9/251: dwrite d0/d6/f1e [0,4194304] 0 2024-02-07T12:25:29.483 INFO:tasks.workunit.client.1.smithi138.stdout:5/260: dwrite da/f24 [0,4194304] 0 2024-02-07T12:25:29.491 INFO:tasks.workunit.client.1.smithi138.stdout:9/252: mknod d0/d6/d8/d1d/dd/c57 0 2024-02-07T12:25:29.491 INFO:tasks.workunit.client.1.smithi138.stdout:5/261: dread da/df/d27/d2e/d4f/f30 [0,4194304] 0 2024-02-07T12:25:29.491 INFO:tasks.workunit.client.1.smithi138.stdout:6/289: rename dc/d13/d1e/f22 to dc/d31/d54/f5c 0 2024-02-07T12:25:29.491 INFO:tasks.workunit.client.1.smithi138.stdout:5/262: readlink da/df/d27/d2e/d4f/d2b/d35/l41 0 2024-02-07T12:25:29.493 INFO:tasks.workunit.client.1.smithi138.stdout:4/222: dwrite f13 [0,4194304] 0 2024-02-07T12:25:29.493 INFO:tasks.workunit.client.1.smithi138.stdout:4/223: fdatasync fb 0 2024-02-07T12:25:29.494 INFO:tasks.workunit.client.1.smithi138.stdout:4/224: creat d20/d34/f4a x:0 0 0 2024-02-07T12:25:29.494 INFO:tasks.workunit.client.1.smithi138.stdout:6/290: creat dc/d13/d1e/d4d/f5d x:0 0 0 2024-02-07T12:25:29.498 INFO:tasks.workunit.client.1.smithi138.stdout:4/225: truncate fd 3959513 0 2024-02-07T12:25:29.498 INFO:tasks.workunit.client.1.smithi138.stdout:4/226: readlink l12 0 2024-02-07T12:25:29.499 INFO:tasks.workunit.client.1.smithi138.stdout:5/263: dread da/df/f20 [0,4194304] 0 2024-02-07T12:25:29.499 INFO:tasks.workunit.client.1.smithi138.stdout:6/291: creat dc/d31/d3f/d55/f5e x:0 0 0 2024-02-07T12:25:29.501 INFO:tasks.workunit.client.1.smithi138.stdout:4/227: creat d20/d47/f4b x:0 0 0 2024-02-07T12:25:29.502 INFO:tasks.workunit.client.1.smithi138.stdout:6/292: creat dc/d13/d1e/f5f x:0 0 0 2024-02-07T12:25:29.502 INFO:tasks.workunit.client.1.smithi138.stdout:5/264: dread da/df/d27/d2e/d4f/f30 [0,4194304] 0 2024-02-07T12:25:29.503 INFO:tasks.workunit.client.1.smithi138.stdout:4/228: rename d20/d34/f37 to d20/d34/f4c 0 2024-02-07T12:25:29.503 INFO:tasks.workunit.client.1.smithi138.stdout:4/229: chown f1c 0 1 2024-02-07T12:25:29.504 INFO:tasks.workunit.client.1.smithi138.stdout:6/293: mknod dc/d13/d1e/c60 0 2024-02-07T12:25:29.505 INFO:tasks.workunit.client.1.smithi138.stdout:6/294: truncate dc/d13/d1e/d35/f46 214562 0 2024-02-07T12:25:29.505 INFO:tasks.workunit.client.1.smithi138.stdout:6/295: readlink dc/d13/d1e/d24/l27 0 2024-02-07T12:25:29.505 INFO:tasks.workunit.client.1.smithi138.stdout:0/229: sync 2024-02-07T12:25:29.507 INFO:tasks.workunit.client.1.smithi138.stdout:4/230: dread f8 [0,4194304] 0 2024-02-07T12:25:29.522 INFO:tasks.workunit.client.1.smithi138.stdout:0/230: dwrite d4/d9/db/f20 [0,4194304] 0 2024-02-07T12:25:29.522 INFO:tasks.workunit.client.1.smithi138.stdout:6/296: dwrite dc/d13/f14 [0,4194304] 0 2024-02-07T12:25:29.524 INFO:tasks.workunit.client.1.smithi138.stdout:6/297: creat dc/d31/d54/f61 x:0 0 0 2024-02-07T12:25:29.526 INFO:tasks.workunit.client.1.smithi138.stdout:6/298: getdents dc/d31/d3f 0 2024-02-07T12:25:29.526 INFO:tasks.workunit.client.1.smithi138.stdout:6/299: fsync dc/d31/d3f/f41 0 2024-02-07T12:25:29.528 INFO:tasks.workunit.client.1.smithi138.stdout:6/300: mknod dc/d13/d1e/d35/c62 0 2024-02-07T12:25:29.537 INFO:tasks.workunit.client.1.smithi138.stdout:0/231: dwrite d4/d9/de/d1d/d21/d2b/f38 [0,4194304] 0 2024-02-07T12:25:29.537 INFO:tasks.workunit.client.1.smithi138.stdout:0/232: chown d4/d9/de/l23 21554 1 2024-02-07T12:25:29.548 INFO:tasks.workunit.client.1.smithi138.stdout:0/233: write d4/d9/de/d1d/d21/d2b/f2e [498543,37266] 0 2024-02-07T12:25:29.548 INFO:tasks.workunit.client.1.smithi138.stdout:0/234: chown d4/d9/de/d1d/d21/d2b/l1a 38438959 1 2024-02-07T12:25:29.549 INFO:tasks.workunit.client.1.smithi138.stdout:0/235: truncate d4/d9/db/f20 1176489 0 2024-02-07T12:25:29.549 INFO:tasks.workunit.client.1.smithi138.stdout:0/236: write d4/d9/de/f45 [4904050,25015] 0 2024-02-07T12:25:29.550 INFO:tasks.workunit.client.1.smithi138.stdout:0/237: mkdir d4/d9/db/d39/d4b 0 2024-02-07T12:25:29.551 INFO:tasks.workunit.client.1.smithi138.stdout:0/238: unlink d4/d9/de/d1d/d21/d2b/f28 0 2024-02-07T12:25:29.553 INFO:tasks.workunit.client.1.smithi138.stdout:0/239: creat d4/d9/d33/f4c x:0 0 0 2024-02-07T12:25:29.554 INFO:tasks.workunit.client.1.smithi138.stdout:0/240: link d4/d9/de/d1d/d21/f3b d4/f4d 0 2024-02-07T12:25:29.556 INFO:tasks.workunit.client.1.smithi138.stdout:0/241: dread d4/d9/de/d1d/f41 [0,4194304] 0 2024-02-07T12:25:29.562 INFO:tasks.workunit.client.1.smithi138.stdout:0/242: write d4/d9/de/d1d/d21/d2b/f38 [811349,77142] 0 2024-02-07T12:25:29.562 INFO:tasks.workunit.client.1.smithi138.stdout:0/243: fsync d4/f6 0 2024-02-07T12:25:29.563 INFO:tasks.workunit.client.1.smithi138.stdout:0/244: chown d4/d9/de/d1d/d21 190884 1 2024-02-07T12:25:29.563 INFO:tasks.workunit.client.1.smithi138.stdout:0/245: creat d4/d9/de/d1d/d21/f4e x:0 0 0 2024-02-07T12:25:29.563 INFO:tasks.workunit.client.1.smithi138.stdout:0/246: symlink d4/d9/d33/l4f 0 2024-02-07T12:25:29.564 INFO:tasks.workunit.client.1.smithi138.stdout:0/247: link d4/d9/f12 d4/d9/db/d39/f50 0 2024-02-07T12:25:29.564 INFO:tasks.workunit.client.1.smithi138.stdout:0/248: chown d4/d9/de/f1c 1 1 2024-02-07T12:25:29.565 INFO:tasks.workunit.client.1.smithi138.stdout:0/249: creat d4/d9/d37/d3d/f51 x:0 0 0 2024-02-07T12:25:29.568 INFO:tasks.workunit.client.1.smithi138.stdout:0/250: rename d4/d9/de/d1d/d21/d2b to d4/d52 0 2024-02-07T12:25:29.569 INFO:tasks.workunit.client.1.smithi138.stdout:0/251: symlink d4/d52/l53 0 2024-02-07T12:25:29.572 INFO:tasks.workunit.client.1.smithi138.stdout:0/252: rmdir d4/d52 39 2024-02-07T12:25:29.573 INFO:tasks.workunit.client.1.smithi138.stdout:0/253: dread - d4/d9/de/d1d/d21/f3b zero size 2024-02-07T12:25:29.580 INFO:tasks.workunit.client.1.smithi138.stdout:3/352: sync 2024-02-07T12:25:29.580 INFO:tasks.workunit.client.1.smithi138.stdout:8/340: sync 2024-02-07T12:25:29.580 INFO:tasks.workunit.client.1.smithi138.stdout:7/426: sync 2024-02-07T12:25:29.580 INFO:tasks.workunit.client.1.smithi138.stdout:8/341: chown d1/de/d11/d17/l67 0 1 2024-02-07T12:25:29.580 INFO:tasks.workunit.client.1.smithi138.stdout:7/427: dread - d0/f8c zero size 2024-02-07T12:25:29.580 INFO:tasks.workunit.client.1.smithi138.stdout:8/342: write d1/de/d11/d17/f25 [1124978,91207] 0 2024-02-07T12:25:29.580 INFO:tasks.workunit.client.1.smithi138.stdout:8/343: read - d1/de/d11/d17/d2e/d3a/d50/f4b zero size 2024-02-07T12:25:29.580 INFO:tasks.workunit.client.1.smithi138.stdout:7/428: write d0/d6/f12 [1114992,96966] 0 2024-02-07T12:25:29.581 INFO:tasks.workunit.client.1.smithi138.stdout:3/353: rename d5/d15/d32/f47 to d5/d34/d79/f7a 0 2024-02-07T12:25:29.583 INFO:tasks.workunit.client.1.smithi138.stdout:7/429: unlink d0/d8/d11/f2d 0 2024-02-07T12:25:29.584 INFO:tasks.workunit.client.1.smithi138.stdout:8/344: creat d1/f6f x:0 0 0 2024-02-07T12:25:29.584 INFO:tasks.workunit.client.1.smithi138.stdout:8/345: write d1/de/d11/f1e [109347,86457] 0 2024-02-07T12:25:29.585 INFO:tasks.workunit.client.1.smithi138.stdout:3/354: rename d5/d26/d5e/f70 to d5/d34/d79/f7b 0 2024-02-07T12:25:29.587 INFO:tasks.workunit.client.1.smithi138.stdout:7/430: dread d0/d8/d11/d63/f7a [0,4194304] 0 2024-02-07T12:25:29.588 INFO:tasks.workunit.client.1.smithi138.stdout:3/355: mkdir d5/d27/d35/d7c 0 2024-02-07T12:25:29.588 INFO:tasks.workunit.client.1.smithi138.stdout:3/356: dread - d5/d34/d79/f7b zero size 2024-02-07T12:25:29.588 INFO:tasks.workunit.client.1.smithi138.stdout:3/357: creat d5/d27/f7d x:0 0 0 2024-02-07T12:25:29.588 INFO:tasks.workunit.client.1.smithi138.stdout:3/358: creat d5/d26/d4e/f7e x:0 0 0 2024-02-07T12:25:29.588 INFO:tasks.workunit.client.1.smithi138.stdout:3/359: write d5/d26/d28/f78 [792948,40244] 0 2024-02-07T12:25:29.590 INFO:tasks.workunit.client.1.smithi138.stdout:0/254: dwrite d4/d9/de/f24 [0,4194304] 0 2024-02-07T12:25:29.608 INFO:tasks.workunit.client.1.smithi138.stdout:8/346: dwrite d1/f22 [0,4194304] 0 2024-02-07T12:25:29.608 INFO:tasks.workunit.client.1.smithi138.stdout:8/347: dread - d1/de/d11/d17/d58/f60 zero size 2024-02-07T12:25:29.611 INFO:tasks.workunit.client.1.smithi138.stdout:8/348: link d1/de/d11/d17/l67 d1/de/d11/d17/d2e/d3a/d50/l70 0 2024-02-07T12:25:29.612 INFO:tasks.workunit.client.1.smithi138.stdout:8/349: symlink d1/de/d11/d17/d3e/l71 0 2024-02-07T12:25:29.613 INFO:tasks.workunit.client.1.smithi138.stdout:8/350: mkdir d1/de/d11/d17/d3e/d72 0 2024-02-07T12:25:29.613 INFO:tasks.workunit.client.1.smithi138.stdout:8/351: fdatasync d1/f47 0 2024-02-07T12:25:29.616 INFO:tasks.workunit.client.1.smithi138.stdout:3/360: dwrite d5/f2f [0,4194304] 0 2024-02-07T12:25:29.616 INFO:tasks.workunit.client.1.smithi138.stdout:3/361: truncate d5/d26/d4e/f63 1015110 0 2024-02-07T12:25:29.616 INFO:tasks.workunit.client.1.smithi138.stdout:3/362: fsync d5/d27/f49 0 2024-02-07T12:25:29.616 INFO:tasks.workunit.client.1.smithi138.stdout:3/363: dread - d5/d27/f71 zero size 2024-02-07T12:25:29.616 INFO:tasks.workunit.client.1.smithi138.stdout:3/364: chown d5/d26/d28/f39 15605 1 2024-02-07T12:25:29.616 INFO:tasks.workunit.client.1.smithi138.stdout:7/431: dwrite d0/d8/d11/d26/f33 [0,4194304] 0 2024-02-07T12:25:29.616 INFO:tasks.workunit.client.1.smithi138.stdout:0/255: dwrite d4/d9/de/d1d/d21/f31 [0,4194304] 0 2024-02-07T12:25:29.617 INFO:tasks.workunit.client.1.smithi138.stdout:0/256: fdatasync d4/d9/f4a 0 2024-02-07T12:25:29.617 INFO:tasks.workunit.client.1.smithi138.stdout:3/365: symlink d5/d15/l7f 0 2024-02-07T12:25:29.620 INFO:tasks.workunit.client.1.smithi138.stdout:7/432: mknod d0/d8/d11/d5f/c8f 0 2024-02-07T12:25:29.620 INFO:tasks.workunit.client.1.smithi138.stdout:7/433: chown d0/f74 36503 1 2024-02-07T12:25:29.620 INFO:tasks.workunit.client.1.smithi138.stdout:7/434: truncate d0/d6/f69 675706 0 2024-02-07T12:25:29.621 INFO:tasks.workunit.client.1.smithi138.stdout:0/257: getdents d4/d9/d33 0 2024-02-07T12:25:29.622 INFO:tasks.workunit.client.1.smithi138.stdout:0/258: truncate d4/d9/f2f 4894643 0 2024-02-07T12:25:29.622 INFO:tasks.workunit.client.1.smithi138.stdout:7/435: dread d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:29.624 INFO:tasks.workunit.client.1.smithi138.stdout:7/436: write d0/f6c [84453,27966] 0 2024-02-07T12:25:29.624 INFO:tasks.workunit.client.1.smithi138.stdout:7/437: chown d0/d8/d11/d1f/c70 1858623 1 2024-02-07T12:25:29.624 INFO:tasks.workunit.client.1.smithi138.stdout:7/438: write d0/d6/d1d/d24/f4f [1369776,92362] 0 2024-02-07T12:25:29.624 INFO:tasks.workunit.client.1.smithi138.stdout:0/259: link d4/d9/f18 d4/d9/de/d1d/f54 0 2024-02-07T12:25:29.626 INFO:tasks.workunit.client.1.smithi138.stdout:3/366: write d5/d26/f5f [3243419,127812] 0 2024-02-07T12:25:29.626 INFO:tasks.workunit.client.1.smithi138.stdout:3/367: creat d5/d27/f80 x:0 0 0 2024-02-07T12:25:29.626 INFO:tasks.workunit.client.1.smithi138.stdout:3/368: dread - d5/d15/f41 zero size 2024-02-07T12:25:29.626 INFO:tasks.workunit.client.1.smithi138.stdout:3/369: stat d5/d27/f71 0 2024-02-07T12:25:29.632 INFO:tasks.workunit.client.1.smithi138.stdout:3/370: symlink d5/d26/l81 0 2024-02-07T12:25:29.632 INFO:tasks.workunit.client.1.smithi138.stdout:3/371: chown d5/f23 106060797 1 2024-02-07T12:25:29.634 INFO:tasks.workunit.client.1.smithi138.stdout:7/439: rename d0/d6/d1d/d24 to d0/d8/d11/d26/d90 0 2024-02-07T12:25:29.634 INFO:tasks.workunit.client.1.smithi138.stdout:7/440: dread - d0/d8/d11/d1f/f56 zero size 2024-02-07T12:25:29.634 INFO:tasks.workunit.client.1.smithi138.stdout:8/352: dwrite d1/de/d11/f5b [0,4194304] 0 2024-02-07T12:25:29.634 INFO:tasks.workunit.client.1.smithi138.stdout:8/353: stat d1/de/d11/d17/d58 0 2024-02-07T12:25:29.634 INFO:tasks.workunit.client.1.smithi138.stdout:8/354: creat d1/de/d11/d17/d2e/d49/d4c/d62/f73 x:0 0 0 2024-02-07T12:25:29.634 INFO:tasks.workunit.client.1.smithi138.stdout:8/355: chown d1/c55 60897 1 2024-02-07T12:25:29.637 INFO:tasks.workunit.client.1.smithi138.stdout:0/260: truncate d4/d9/f22 1301108 0 2024-02-07T12:25:29.645 INFO:tasks.workunit.client.1.smithi138.stdout:7/441: dread d0/d39/f46 [0,4194304] 0 2024-02-07T12:25:29.646 INFO:tasks.workunit.client.1.smithi138.stdout:0/261: fsync d4/d9/f18 0 2024-02-07T12:25:29.646 INFO:tasks.workunit.client.1.smithi138.stdout:0/262: chown d4/d9/d33/c47 38890 1 2024-02-07T12:25:29.646 INFO:tasks.workunit.client.1.smithi138.stdout:8/356: dread d1/de/d11/d17/d3e/f4e [0,4194304] 0 2024-02-07T12:25:29.648 INFO:tasks.workunit.client.1.smithi138.stdout:3/372: mknod d5/c82 0 2024-02-07T12:25:29.648 INFO:tasks.workunit.client.1.smithi138.stdout:3/373: creat d5/d26/d28/f83 x:0 0 0 2024-02-07T12:25:29.651 INFO:tasks.workunit.client.1.smithi138.stdout:0/263: symlink d4/d9/l55 0 2024-02-07T12:25:29.651 INFO:tasks.workunit.client.1.smithi138.stdout:0/264: dread - d4/d9/de/d1d/f49 zero size 2024-02-07T12:25:29.652 INFO:tasks.workunit.client.1.smithi138.stdout:0/265: mknod d4/d9/de/c56 0 2024-02-07T12:25:29.652 INFO:tasks.workunit.client.1.smithi138.stdout:0/266: write d4/d9/de/d1d/f42 [543606,54693] 0 2024-02-07T12:25:29.654 INFO:tasks.workunit.client.1.smithi138.stdout:0/267: creat d4/d9/db/d39/f57 x:0 0 0 2024-02-07T12:25:29.656 INFO:tasks.workunit.client.1.smithi138.stdout:0/268: truncate d4/d9/d37/f3a 2177273 0 2024-02-07T12:25:29.656 INFO:tasks.workunit.client.1.smithi138.stdout:1/212: sync 2024-02-07T12:25:29.658 INFO:tasks.workunit.client.1.smithi138.stdout:0/269: mknod d4/d9/de/d1d/c58 0 2024-02-07T12:25:29.658 INFO:tasks.workunit.client.1.smithi138.stdout:2/376: sync 2024-02-07T12:25:29.658 INFO:tasks.workunit.client.1.smithi138.stdout:0/270: dread - d4/d52/f2d zero size 2024-02-07T12:25:29.658 INFO:tasks.workunit.client.1.smithi138.stdout:0/271: write d4/d9/de/f1c [21515,98796] 0 2024-02-07T12:25:29.658 INFO:tasks.workunit.client.1.smithi138.stdout:1/213: mknod d5/d8/da/d1f/d3c/c45 0 2024-02-07T12:25:29.664 INFO:tasks.workunit.client.1.smithi138.stdout:0/272: rename d4/d9/fa to d4/d9/de/d1d/d21/f59 0 2024-02-07T12:25:29.666 INFO:tasks.workunit.client.1.smithi138.stdout:1/214: creat d5/d8/da/d1f/f46 x:0 0 0 2024-02-07T12:25:29.667 INFO:tasks.workunit.client.1.smithi138.stdout:0/273: symlink d4/d52/d3f/l5a 0 2024-02-07T12:25:29.667 INFO:tasks.workunit.client.1.smithi138.stdout:0/274: write d4/d9/de/d1d/d21/f4e [521207,54186] 0 2024-02-07T12:25:29.667 INFO:tasks.workunit.client.1.smithi138.stdout:0/275: dread - d4/d9/d37/d3d/f51 zero size 2024-02-07T12:25:29.668 INFO:tasks.workunit.client.1.smithi138.stdout:1/215: creat d5/d8/da/f47 x:0 0 0 2024-02-07T12:25:29.670 INFO:tasks.workunit.client.1.smithi138.stdout:1/216: mknod d5/d8/da/d1f/d3c/c48 0 2024-02-07T12:25:29.670 INFO:tasks.workunit.client.1.smithi138.stdout:3/374: dwrite d5/f20 [0,4194304] 0 2024-02-07T12:25:29.670 INFO:tasks.workunit.client.1.smithi138.stdout:3/375: creat d5/d26/d4e/f84 x:0 0 0 2024-02-07T12:25:29.671 INFO:tasks.workunit.client.1.smithi138.stdout:1/217: creat d5/d8/f49 x:0 0 0 2024-02-07T12:25:29.672 INFO:tasks.workunit.client.1.smithi138.stdout:1/218: write d5/d8/da/d20/f30 [1287656,59434] 0 2024-02-07T12:25:29.672 INFO:tasks.workunit.client.1.smithi138.stdout:1/219: truncate d5/d8/ff 1091448 0 2024-02-07T12:25:29.672 INFO:tasks.workunit.client.1.smithi138.stdout:0/276: write d4/d9/de/f45 [3209917,104175] 0 2024-02-07T12:25:29.672 INFO:tasks.workunit.client.1.smithi138.stdout:0/277: creat d4/d9/d37/d3d/f5b x:0 0 0 2024-02-07T12:25:29.672 INFO:tasks.workunit.client.1.smithi138.stdout:0/278: creat d4/d9/db/d39/f5c x:0 0 0 2024-02-07T12:25:29.678 INFO:tasks.workunit.client.1.smithi138.stdout:0/279: link d4/d9/l55 d4/d9/de/d1d/l5d 0 2024-02-07T12:25:29.679 INFO:tasks.workunit.client.1.smithi138.stdout:0/280: mknod d4/d9/db/d39/d4b/c5e 0 2024-02-07T12:25:29.679 INFO:tasks.workunit.client.1.smithi138.stdout:0/281: write d4/d9/de/d1d/f36 [739019,60304] 0 2024-02-07T12:25:29.679 INFO:tasks.workunit.client.1.smithi138.stdout:0/282: rmdir d4/d52/d3f 39 2024-02-07T12:25:29.680 INFO:tasks.workunit.client.1.smithi138.stdout:0/283: creat d4/d9/db/f5f x:0 0 0 2024-02-07T12:25:29.680 INFO:tasks.workunit.client.1.smithi138.stdout:0/284: truncate d4/d9/db/d39/f57 515956 0 2024-02-07T12:25:29.680 INFO:tasks.workunit.client.1.smithi138.stdout:0/285: readlink d4/d9/db/l10 0 2024-02-07T12:25:29.681 INFO:tasks.workunit.client.1.smithi138.stdout:8/357: dwrite d1/de/d11/f1e [0,4194304] 0 2024-02-07T12:25:29.682 INFO:tasks.workunit.client.1.smithi138.stdout:0/286: creat d4/d9/d37/f60 x:0 0 0 2024-02-07T12:25:29.682 INFO:tasks.workunit.client.1.smithi138.stdout:2/377: dwrite d3/dd/d14/d49/d25/f6c [0,4194304] 0 2024-02-07T12:25:29.682 INFO:tasks.workunit.client.1.smithi138.stdout:1/220: dread d5/d8/f35 [0,4194304] 0 2024-02-07T12:25:29.682 INFO:tasks.workunit.client.1.smithi138.stdout:2/378: chown d3/dd/d19/d1f/d37 9095 1 2024-02-07T12:25:29.687 INFO:tasks.workunit.client.1.smithi138.stdout:0/287: mknod d4/d9/de/d1d/c61 0 2024-02-07T12:25:29.687 INFO:tasks.workunit.client.1.smithi138.stdout:0/288: creat d4/d9/de/d1d/d21/f62 x:0 0 0 2024-02-07T12:25:29.691 INFO:tasks.workunit.client.1.smithi138.stdout:1/221: mkdir d5/d8/da/d4a 0 2024-02-07T12:25:29.695 INFO:tasks.workunit.client.1.smithi138.stdout:0/289: creat d4/d52/d3f/f63 x:0 0 0 2024-02-07T12:25:29.695 INFO:tasks.workunit.client.1.smithi138.stdout:0/290: chown d4/d52/c1b 49 1 2024-02-07T12:25:29.697 INFO:tasks.workunit.client.1.smithi138.stdout:8/358: dwrite d1/de/d11/d17/f2d [0,4194304] 0 2024-02-07T12:25:29.697 INFO:tasks.workunit.client.1.smithi138.stdout:8/359: creat d1/de/d11/d17/d2e/f74 x:0 0 0 2024-02-07T12:25:29.697 INFO:tasks.workunit.client.1.smithi138.stdout:8/360: stat d1/de/d11/d17/d2e/d49/d4c/d57/f6a 0 2024-02-07T12:25:29.697 INFO:tasks.workunit.client.1.smithi138.stdout:8/361: write d1/de/d11/f43 [1799722,69412] 0 2024-02-07T12:25:29.697 INFO:tasks.workunit.client.1.smithi138.stdout:8/362: dread - d1/de/d11/d17/d2e/d49/f56 zero size 2024-02-07T12:25:29.698 INFO:tasks.workunit.client.1.smithi138.stdout:8/363: fdatasync d1/de/d11/d17/d2e/d49/f3d 0 2024-02-07T12:25:29.698 INFO:tasks.workunit.client.1.smithi138.stdout:8/364: chown d1/f44 1 1 2024-02-07T12:25:29.698 INFO:tasks.workunit.client.1.smithi138.stdout:8/365: fsync d1/de/f53 0 2024-02-07T12:25:29.698 INFO:tasks.workunit.client.1.smithi138.stdout:8/366: chown d1/f6f 461213 1 2024-02-07T12:25:29.698 INFO:tasks.workunit.client.1.smithi138.stdout:8/367: fdatasync d1/de/d11/d17/d3e/f4e 0 2024-02-07T12:25:29.698 INFO:tasks.workunit.client.1.smithi138.stdout:8/368: creat d1/de/d11/d17/d2e/d49/d4c/f75 x:0 0 0 2024-02-07T12:25:29.698 INFO:tasks.workunit.client.1.smithi138.stdout:1/222: mkdir d5/d4b 0 2024-02-07T12:25:29.698 INFO:tasks.workunit.client.1.smithi138.stdout:2/379: getdents d3/dd/d14/d49 0 2024-02-07T12:25:29.703 INFO:tasks.workunit.client.1.smithi138.stdout:8/369: getdents d1/de/d11/d17 0 2024-02-07T12:25:29.705 INFO:tasks.workunit.client.1.smithi138.stdout:0/291: dread d4/d9/d37/f3a [0,4194304] 0 2024-02-07T12:25:29.705 INFO:tasks.workunit.client.1.smithi138.stdout:0/292: fdatasync d4/d9/de/d1d/f42 0 2024-02-07T12:25:29.705 INFO:tasks.workunit.client.1.smithi138.stdout:0/293: truncate d4/d9/db/d39/f50 5015371 0 2024-02-07T12:25:29.706 INFO:tasks.workunit.client.1.smithi138.stdout:2/380: unlink d3/dd/d14/d49/d25/c16 0 2024-02-07T12:25:29.706 INFO:tasks.workunit.client.1.smithi138.stdout:2/381: chown d3/dd/d14/l3a 9 1 2024-02-07T12:25:29.706 INFO:tasks.workunit.client.1.smithi138.stdout:2/382: write d3/dd/d19/d1f/f5c [1141041,93387] 0 2024-02-07T12:25:29.706 INFO:tasks.workunit.client.1.smithi138.stdout:2/383: chown d3/dd/d14/d49/d25/l58 33296401 1 2024-02-07T12:25:29.707 INFO:tasks.workunit.client.1.smithi138.stdout:0/294: mkdir d4/d9/d37/d64 0 2024-02-07T12:25:29.708 INFO:tasks.workunit.client.1.smithi138.stdout:2/384: getdents d3/dd/d14/d82 0 2024-02-07T12:25:29.709 INFO:tasks.workunit.client.1.smithi138.stdout:2/385: rmdir d3/dd/d14/d8f 39 2024-02-07T12:25:29.711 INFO:tasks.workunit.client.1.smithi138.stdout:2/386: symlink d3/dd/d19/d44/d7d/l90 0 2024-02-07T12:25:29.711 INFO:tasks.workunit.client.1.smithi138.stdout:2/387: chown d3/dd/d19/d44/d7d 57009443 1 2024-02-07T12:25:29.713 INFO:tasks.workunit.client.1.smithi138.stdout:8/370: dread d1/f3f [4194304,4194304] 0 2024-02-07T12:25:29.713 INFO:tasks.workunit.client.1.smithi138.stdout:8/371: chown d1/l4f 5355278 1 2024-02-07T12:25:29.713 INFO:tasks.workunit.client.1.smithi138.stdout:8/372: creat d1/de/d11/d17/d2e/d49/f76 x:0 0 0 2024-02-07T12:25:29.714 INFO:tasks.workunit.client.1.smithi138.stdout:2/388: dread d3/dd/d14/d49/d25/d3d/d5f/f64 [0,4194304] 0 2024-02-07T12:25:29.714 INFO:tasks.workunit.client.1.smithi138.stdout:1/223: dwrite d5/d8/da/d20/f41 [0,4194304] 0 2024-02-07T12:25:29.716 INFO:tasks.workunit.client.1.smithi138.stdout:1/224: dread d5/f1a [4194304,4194304] 0 2024-02-07T12:25:29.717 INFO:tasks.workunit.client.1.smithi138.stdout:2/389: creat d3/dd/d19/d44/d7d/f91 x:0 0 0 2024-02-07T12:25:29.720 INFO:tasks.workunit.client.1.smithi138.stdout:2/390: rename d3/dd/d19/l21 to d3/dd/d14/d49/d25/l92 0 2024-02-07T12:25:29.721 INFO:tasks.workunit.client.1.smithi138.stdout:2/391: unlink d3/dd/d14/d49/d25/c30 0 2024-02-07T12:25:29.723 INFO:tasks.workunit.client.1.smithi138.stdout:0/295: dwrite d4/d9/f40 [0,4194304] 0 2024-02-07T12:25:29.724 INFO:tasks.workunit.client.1.smithi138.stdout:2/392: symlink d3/dd/d14/d49/d29/d5b/l93 0 2024-02-07T12:25:29.727 INFO:tasks.workunit.client.1.smithi138.stdout:8/373: dread d1/de/d11/d17/d2e/d49/f8 [0,4194304] 0 2024-02-07T12:25:29.730 INFO:tasks.workunit.client.1.smithi138.stdout:8/374: symlink d1/de/d11/d17/d2e/d49/d4c/l77 0 2024-02-07T12:25:29.730 INFO:tasks.workunit.client.1.smithi138.stdout:8/375: dread - d1/de/d11/d17/d3e/f5a zero size 2024-02-07T12:25:29.744 INFO:tasks.workunit.client.1.smithi138.stdout:1/225: dwrite d5/d8/da/d1f/f46 [0,4194304] 0 2024-02-07T12:25:29.745 INFO:tasks.workunit.client.1.smithi138.stdout:0/296: dwrite d4/d9/f11 [4194304,4194304] 0 2024-02-07T12:25:29.745 INFO:tasks.workunit.client.1.smithi138.stdout:0/297: stat d4/d52/d3f 0 2024-02-07T12:25:29.745 INFO:tasks.workunit.client.1.smithi138.stdout:2/393: dwrite d3/dd/d14/d49/d25/f6c [0,4194304] 0 2024-02-07T12:25:29.745 INFO:tasks.workunit.client.1.smithi138.stdout:0/298: chown d4/d9/db/f15 6653340 1 2024-02-07T12:25:29.745 INFO:tasks.workunit.client.1.smithi138.stdout:2/394: chown d3/dd/d19/d44/l4a 47209909 1 2024-02-07T12:25:29.745 INFO:tasks.workunit.client.1.smithi138.stdout:0/299: write d4/d9/db/f15 [1725264,100791] 0 2024-02-07T12:25:29.746 INFO:tasks.workunit.client.1.smithi138.stdout:0/300: fsync d4/f5 0 2024-02-07T12:25:29.747 INFO:tasks.workunit.client.1.smithi138.stdout:2/395: fsync d3/dd/d14/d8f/d73/d80/f85 0 2024-02-07T12:25:29.748 INFO:tasks.workunit.client.1.smithi138.stdout:0/301: symlink d4/d9/de/d1d/d21/l65 0 2024-02-07T12:25:29.752 INFO:tasks.workunit.client.1.smithi138.stdout:0/302: dread d4/d9/f12 [0,4194304] 0 2024-02-07T12:25:29.754 INFO:tasks.workunit.client.1.smithi138.stdout:8/376: dwrite d1/f15 [0,4194304] 0 2024-02-07T12:25:29.754 INFO:tasks.workunit.client.1.smithi138.stdout:0/303: symlink d4/d9/db/d39/d4b/l66 0 2024-02-07T12:25:29.755 INFO:tasks.workunit.client.1.smithi138.stdout:2/396: dread d3/dd/d19/f35 [0,4194304] 0 2024-02-07T12:25:29.758 INFO:tasks.workunit.client.1.smithi138.stdout:1/226: dread d5/f1e [0,4194304] 0 2024-02-07T12:25:29.758 INFO:tasks.workunit.client.1.smithi138.stdout:1/227: dread - d5/d8/f3b zero size 2024-02-07T12:25:29.758 INFO:tasks.workunit.client.1.smithi138.stdout:1/228: write d5/d8/da/d15/f3d [167907,130631] 0 2024-02-07T12:25:29.758 INFO:tasks.workunit.client.1.smithi138.stdout:1/229: getdents d5/d38 0 2024-02-07T12:25:29.758 INFO:tasks.workunit.client.1.smithi138.stdout:1/230: chown d5/d8 81 1 2024-02-07T12:25:29.767 INFO:tasks.workunit.client.1.smithi138.stdout:0/304: rename d4/d9/d37/d3d/f51 to d4/f67 0 2024-02-07T12:25:29.767 INFO:tasks.workunit.client.1.smithi138.stdout:2/397: dread - d3/dd/d14/d49/d29/d5b/f8d zero size 2024-02-07T12:25:29.768 INFO:tasks.workunit.client.1.smithi138.stdout:8/377: rmdir d1/de/d11/d17/d2e/d49/d4c/d62 39 2024-02-07T12:25:29.769 INFO:tasks.workunit.client.1.smithi138.stdout:2/398: dread d3/dd/d19/d1f/f5d [0,4194304] 0 2024-02-07T12:25:29.771 INFO:tasks.workunit.client.1.smithi138.stdout:0/305: write f1 [125592,45676] 0 2024-02-07T12:25:29.771 INFO:tasks.workunit.client.1.smithi138.stdout:0/306: stat d4/d9/db/d39/d4b 0 2024-02-07T12:25:29.771 INFO:tasks.workunit.client.1.smithi138.stdout:0/307: chown d4/d9/de/d1d/d21/f43 125692 1 2024-02-07T12:25:29.771 INFO:tasks.workunit.client.1.smithi138.stdout:0/308: fdatasync d4/d9/de/d1d/d21/f43 0 2024-02-07T12:25:29.773 INFO:tasks.workunit.client.1.smithi138.stdout:1/231: rename d5/d8/da/d15/l36 to d5/d8/l4c 0 2024-02-07T12:25:29.773 INFO:tasks.workunit.client.1.smithi138.stdout:1/232: read d5/d8/da/f1d [359126,115888] 0 2024-02-07T12:25:29.778 INFO:tasks.workunit.client.1.smithi138.stdout:8/378: rmdir d1/de 39 2024-02-07T12:25:29.778 INFO:tasks.workunit.client.1.smithi138.stdout:8/379: chown d1/c55 759 1 2024-02-07T12:25:29.779 INFO:tasks.workunit.client.1.smithi138.stdout:1/233: mknod d5/d8/da/d1f/c4d 0 2024-02-07T12:25:29.779 INFO:tasks.workunit.client.1.smithi138.stdout:1/234: write f4 [2957704,107506] 0 2024-02-07T12:25:29.779 INFO:tasks.workunit.client.1.smithi138.stdout:2/399: write d3/dd/d14/d8f/f68 [10038718,92757] 0 2024-02-07T12:25:29.779 INFO:tasks.workunit.client.1.smithi138.stdout:1/235: chown d5/d8/c44 41754 1 2024-02-07T12:25:29.779 INFO:tasks.workunit.client.1.smithi138.stdout:1/236: dread - d5/d8/da/d20/f21 zero size 2024-02-07T12:25:29.781 INFO:tasks.workunit.client.1.smithi138.stdout:8/380: unlink d1/f47 0 2024-02-07T12:25:29.781 INFO:tasks.workunit.client.1.smithi138.stdout:1/237: link d5/d8/f14 d5/d8/da/d15/f4e 0 2024-02-07T12:25:29.782 INFO:tasks.workunit.client.1.smithi138.stdout:8/381: truncate d1/de/d11/f18 2136753 0 2024-02-07T12:25:29.782 INFO:tasks.workunit.client.1.smithi138.stdout:8/382: truncate d1/de/d11/d17/f2d 4481761 0 2024-02-07T12:25:29.782 INFO:tasks.workunit.client.1.smithi138.stdout:8/383: chown d1/de/d11/d17/d2e/d49/d4c/d62 2 1 2024-02-07T12:25:29.783 INFO:tasks.workunit.client.1.smithi138.stdout:2/400: dread d3/dd/d14/f2c [0,4194304] 0 2024-02-07T12:25:29.784 INFO:tasks.workunit.client.1.smithi138.stdout:1/238: rename d5/d8/c10 to d5/d43/c4f 0 2024-02-07T12:25:29.785 INFO:tasks.workunit.client.1.smithi138.stdout:0/309: dwrite d4/d9/de/f1c [0,4194304] 0 2024-02-07T12:25:29.785 INFO:tasks.workunit.client.1.smithi138.stdout:0/310: creat d4/d9/d37/d3d/f68 x:0 0 0 2024-02-07T12:25:29.785 INFO:tasks.workunit.client.1.smithi138.stdout:8/384: creat d1/de/d11/d17/d2e/f78 x:0 0 0 2024-02-07T12:25:29.785 INFO:tasks.workunit.client.1.smithi138.stdout:8/385: fsync d1/de/ff 0 2024-02-07T12:25:29.785 INFO:tasks.workunit.client.1.smithi138.stdout:8/386: dread - d1/de/d11/d17/d2e/d49/d4c/f65 zero size 2024-02-07T12:25:29.785 INFO:tasks.workunit.client.1.smithi138.stdout:8/387: creat d1/de/d11/d17/d2e/f79 x:0 0 0 2024-02-07T12:25:29.785 INFO:tasks.workunit.client.1.smithi138.stdout:8/388: write d1/de/d11/d17/d2e/d49/f19 [3418456,23331] 0 2024-02-07T12:25:29.787 INFO:tasks.workunit.client.1.smithi138.stdout:2/401: symlink d3/dd/d19/d1f/d37/l94 0 2024-02-07T12:25:29.789 INFO:tasks.workunit.client.1.smithi138.stdout:1/239: rename d5/d8/c13 to d5/d8/da/c50 0 2024-02-07T12:25:29.793 INFO:tasks.workunit.client.1.smithi138.stdout:6/301: sync 2024-02-07T12:25:29.793 INFO:tasks.workunit.client.1.smithi138.stdout:6/302: write dc/d13/f34 [1453642,49369] 0 2024-02-07T12:25:29.793 INFO:tasks.workunit.client.1.smithi138.stdout:5/265: sync 2024-02-07T12:25:29.794 INFO:tasks.workunit.client.1.smithi138.stdout:9/253: sync 2024-02-07T12:25:29.794 INFO:tasks.workunit.client.1.smithi138.stdout:4/231: sync 2024-02-07T12:25:29.795 INFO:tasks.workunit.client.1.smithi138.stdout:8/389: read d1/f22 [1060005,30988] 0 2024-02-07T12:25:29.796 INFO:tasks.workunit.client.1.smithi138.stdout:0/311: mkdir d4/d69 0 2024-02-07T12:25:29.801 INFO:tasks.workunit.client.1.smithi138.stdout:1/240: link f3 d5/d8/da/d1f/f51 0 2024-02-07T12:25:29.802 INFO:tasks.workunit.client.1.smithi138.stdout:4/232: dread f13 [0,4194304] 0 2024-02-07T12:25:29.803 INFO:tasks.workunit.client.1.smithi138.stdout:6/303: link dc/d13/d1e/d35/f46 dc/d31/d38/f63 0 2024-02-07T12:25:29.803 INFO:tasks.workunit.client.1.smithi138.stdout:6/304: stat c3 0 2024-02-07T12:25:29.804 INFO:tasks.workunit.client.1.smithi138.stdout:6/305: fsync dc/d31/d3f/f41 0 2024-02-07T12:25:29.805 INFO:tasks.workunit.client.1.smithi138.stdout:9/254: mknod d0/d6/d8/d1d/dd/c58 0 2024-02-07T12:25:29.807 INFO:tasks.workunit.client.1.smithi138.stdout:8/390: symlink d1/de/l7a 0 2024-02-07T12:25:29.807 INFO:tasks.workunit.client.1.smithi138.stdout:8/391: write d1/de/d11/f36 [4946302,59697] 0 2024-02-07T12:25:29.810 INFO:tasks.workunit.client.1.smithi138.stdout:0/312: symlink d4/d9/db/d39/d4b/l6a 0 2024-02-07T12:25:29.811 INFO:tasks.workunit.client.1.smithi138.stdout:6/306: dread dc/d31/d38/f3a [0,4194304] 0 2024-02-07T12:25:29.812 INFO:tasks.workunit.client.1.smithi138.stdout:6/307: write dc/d31/d38/f3b [733525,126763] 0 2024-02-07T12:25:29.812 INFO:tasks.workunit.client.1.smithi138.stdout:1/241: unlink d5/d8/da/d20/l22 0 2024-02-07T12:25:29.813 INFO:tasks.workunit.client.1.smithi138.stdout:5/266: mkdir da/d50 0 2024-02-07T12:25:29.815 INFO:tasks.workunit.client.1.smithi138.stdout:5/267: dread da/f1d [0,4194304] 0 2024-02-07T12:25:29.816 INFO:tasks.workunit.client.1.smithi138.stdout:9/255: mknod d0/d6/d8/d1d/dd/c59 0 2024-02-07T12:25:29.816 INFO:tasks.workunit.client.1.smithi138.stdout:9/256: write d0/d6/f3c [631034,104452] 0 2024-02-07T12:25:29.817 INFO:tasks.workunit.client.1.smithi138.stdout:0/313: mkdir d4/d9/d37/d6b 0 2024-02-07T12:25:29.818 INFO:tasks.workunit.client.1.smithi138.stdout:1/242: symlink d5/d8/da/d1f/l52 0 2024-02-07T12:25:29.818 INFO:tasks.workunit.client.1.smithi138.stdout:1/243: rename d5/d8/da/d1f/d27/d3e to d5/d8/da/d1f/d27/d3e/d53 22 2024-02-07T12:25:29.818 INFO:tasks.workunit.client.1.smithi138.stdout:1/244: read d5/f9 [329092,76368] 0 2024-02-07T12:25:29.818 INFO:tasks.workunit.client.1.smithi138.stdout:1/245: readlink d5/d8/da/l3f 0 2024-02-07T12:25:29.819 INFO:tasks.workunit.client.1.smithi138.stdout:9/257: link d0/d6/d8/d1d/dd/l2e d0/d6/l5a 0 2024-02-07T12:25:29.820 INFO:tasks.workunit.client.1.smithi138.stdout:0/314: mkdir d4/d9/db/d39/d4b/d6c 0 2024-02-07T12:25:29.822 INFO:tasks.workunit.client.1.smithi138.stdout:8/392: dwrite d1/f26 [0,4194304] 0 2024-02-07T12:25:29.823 INFO:tasks.workunit.client.1.smithi138.stdout:9/258: creat d0/d6/d8/d1d/dd/d25/f5b x:0 0 0 2024-02-07T12:25:29.826 INFO:tasks.workunit.client.1.smithi138.stdout:1/246: symlink d5/d8/l54 0 2024-02-07T12:25:29.827 INFO:tasks.workunit.client.1.smithi138.stdout:8/393: write f0 [3156143,81826] 0 2024-02-07T12:25:29.828 INFO:tasks.workunit.client.1.smithi138.stdout:1/247: getdents d5/d8/da/d1f/d27/d3e 0 2024-02-07T12:25:29.830 INFO:tasks.workunit.client.1.smithi138.stdout:8/394: creat d1/de/d11/f7b x:0 0 0 2024-02-07T12:25:29.830 INFO:tasks.workunit.client.1.smithi138.stdout:1/248: creat d5/d38/f55 x:0 0 0 2024-02-07T12:25:29.840 INFO:tasks.workunit.client.1.smithi138.stdout:8/395: read d1/f26 [2273757,73067] 0 2024-02-07T12:25:29.840 INFO:tasks.workunit.client.1.smithi138.stdout:8/396: chown d1/lc 389 1 2024-02-07T12:25:29.842 INFO:tasks.workunit.client.1.smithi138.stdout:8/397: rename d1/de/d11/d17/l64 to d1/de/d11/d17/d2e/d49/d4c/d62/l7c 0 2024-02-07T12:25:29.843 INFO:tasks.workunit.client.1.smithi138.stdout:8/398: creat d1/de/d11/d17/d2e/d49/d4c/d57/f7d x:0 0 0 2024-02-07T12:25:29.845 INFO:tasks.workunit.client.1.smithi138.stdout:8/399: rename d1/c2 to d1/de/d11/d17/d2e/d49/d4c/d62/c7e 0 2024-02-07T12:25:29.845 INFO:tasks.workunit.client.1.smithi138.stdout:8/400: fdatasync d1/de/f53 0 2024-02-07T12:25:29.845 INFO:tasks.workunit.client.1.smithi138.stdout:8/401: write d1/de/d11/f31 [189121,15553] 0 2024-02-07T12:25:29.845 INFO:tasks.workunit.client.1.smithi138.stdout:8/402: dread - d1/de/d11/d17/d2e/d49/f56 zero size 2024-02-07T12:25:29.846 INFO:tasks.workunit.client.1.smithi138.stdout:8/403: link d1/de/d11/d17/d2e/d49/l2c d1/de/d11/d17/d2e/d49/d4c/l7f 0 2024-02-07T12:25:29.846 INFO:tasks.workunit.client.1.smithi138.stdout:8/404: readlink d1/de/d11/d17/d2e/d49/l2c 0 2024-02-07T12:25:29.846 INFO:tasks.workunit.client.1.smithi138.stdout:8/405: mknod d1/de/d11/d17/d58/c80 0 2024-02-07T12:25:29.847 INFO:tasks.workunit.client.1.smithi138.stdout:8/406: rmdir d1/de/d11/d17/d2e/d49 39 2024-02-07T12:25:29.849 INFO:tasks.workunit.client.1.smithi138.stdout:1/249: dread d5/d8/f14 [0,4194304] 0 2024-02-07T12:25:29.849 INFO:tasks.workunit.client.1.smithi138.stdout:1/250: dread - d5/d8/f3b zero size 2024-02-07T12:25:29.849 INFO:tasks.workunit.client.1.smithi138.stdout:8/407: unlink d1/de/d11/d17/d2e/d3a/f40 0 2024-02-07T12:25:29.849 INFO:tasks.workunit.client.1.smithi138.stdout:8/408: write d1/de/d11/d17/f20 [866223,116436] 0 2024-02-07T12:25:29.849 INFO:tasks.workunit.client.1.smithi138.stdout:8/409: fsync d1/de/d11/d17/d2e/d3a/d50/f4b 0 2024-02-07T12:25:29.849 INFO:tasks.workunit.client.1.smithi138.stdout:5/268: dwrite da/f1d [0,4194304] 0 2024-02-07T12:25:29.849 INFO:tasks.workunit.client.1.smithi138.stdout:0/315: dwrite d4/d9/de/d1d/f54 [0,4194304] 0 2024-02-07T12:25:29.850 INFO:tasks.workunit.client.1.smithi138.stdout:8/410: rename d1/de/d11/d17/d2e/d3a/l3c to d1/l81 0 2024-02-07T12:25:29.852 INFO:tasks.workunit.client.1.smithi138.stdout:1/251: dread d5/d8/da/d1f/f51 [0,4194304] 0 2024-02-07T12:25:29.852 INFO:tasks.workunit.client.1.smithi138.stdout:5/269: creat da/f51 x:0 0 0 2024-02-07T12:25:29.853 INFO:tasks.workunit.client.1.smithi138.stdout:1/252: symlink d5/d8/da/d4a/l56 0 2024-02-07T12:25:29.853 INFO:tasks.workunit.client.1.smithi138.stdout:0/316: dread d4/d9/db/f20 [0,4194304] 0 2024-02-07T12:25:29.854 INFO:tasks.workunit.client.1.smithi138.stdout:1/253: creat d5/d8/da/d1f/d27/d3e/f57 x:0 0 0 2024-02-07T12:25:29.855 INFO:tasks.workunit.client.1.smithi138.stdout:0/317: truncate d4/d9/f40 1896577 0 2024-02-07T12:25:29.857 INFO:tasks.workunit.client.1.smithi138.stdout:1/254: mkdir d5/d8/da/d1f/d27/d58 0 2024-02-07T12:25:29.858 INFO:tasks.workunit.client.1.smithi138.stdout:8/411: dread d1/de/d11/d17/f24 [0,4194304] 0 2024-02-07T12:25:29.858 INFO:tasks.workunit.client.1.smithi138.stdout:0/318: symlink d4/d9/db/d39/d4b/d6c/l6d 0 2024-02-07T12:25:29.858 INFO:tasks.workunit.client.1.smithi138.stdout:0/319: stat d4/f67 0 2024-02-07T12:25:29.858 INFO:tasks.workunit.client.1.smithi138.stdout:8/412: dread d1/de/d11/d17/d2e/d49/d4c/f51 [0,4194304] 0 2024-02-07T12:25:29.860 INFO:tasks.workunit.client.1.smithi138.stdout:0/320: symlink d4/d9/d37/d64/l6e 0 2024-02-07T12:25:29.860 INFO:tasks.workunit.client.1.smithi138.stdout:5/270: read da/fb [3258088,52896] 0 2024-02-07T12:25:29.860 INFO:tasks.workunit.client.1.smithi138.stdout:5/271: dread - da/df/d27/d2e/d4f/d2b/d35/d40/f45 zero size 2024-02-07T12:25:29.861 INFO:tasks.workunit.client.1.smithi138.stdout:8/413: mknod d1/de/d11/c82 0 2024-02-07T12:25:29.862 INFO:tasks.workunit.client.1.smithi138.stdout:8/414: chown d1/de/c54 13919057 1 2024-02-07T12:25:29.862 INFO:tasks.workunit.client.1.smithi138.stdout:8/415: readlink d1/lc 0 2024-02-07T12:25:29.862 INFO:tasks.workunit.client.1.smithi138.stdout:8/416: truncate d1/de/d11/d17/d2e/d49/d4c/d57/f7d 12789 0 2024-02-07T12:25:29.862 INFO:tasks.workunit.client.1.smithi138.stdout:8/417: readlink d1/de/d11/d17/l34 0 2024-02-07T12:25:29.862 INFO:tasks.workunit.client.1.smithi138.stdout:8/418: truncate d1/de/d11/d17/d2e/f78 818759 0 2024-02-07T12:25:29.862 INFO:tasks.workunit.client.1.smithi138.stdout:8/419: chown d1/de/d11/d17/d2e/d49 162946390 1 2024-02-07T12:25:29.862 INFO:tasks.workunit.client.1.smithi138.stdout:8/420: write d1/de/d11/d17/d2e/d49/d4c/d62/f68 [136711,77070] 0 2024-02-07T12:25:29.866 INFO:tasks.workunit.client.1.smithi138.stdout:5/272: rename da/l3b to da/l52 0 2024-02-07T12:25:29.866 INFO:tasks.workunit.client.1.smithi138.stdout:8/421: write d1/de/d11/f18 [1704569,58108] 0 2024-02-07T12:25:29.870 INFO:tasks.workunit.client.1.smithi138.stdout:1/255: getdents d5/d38 0 2024-02-07T12:25:29.880 INFO:tasks.workunit.client.1.smithi138.stdout:5/273: read da/df/d27/f33 [3106319,46395] 0 2024-02-07T12:25:29.882 INFO:tasks.workunit.client.1.smithi138.stdout:5/274: unlink da/df/d27/d2e/d4f/d2b/d35/l41 0 2024-02-07T12:25:29.885 INFO:tasks.workunit.client.1.smithi138.stdout:5/275: rmdir da/d22/d44 0 2024-02-07T12:25:29.886 INFO:tasks.workunit.client.1.smithi138.stdout:5/276: chown da/df/d27/d2e/d4f/d2b/d35/f48 3712 1 2024-02-07T12:25:29.886 INFO:tasks.workunit.client.1.smithi138.stdout:5/277: symlink da/df/d27/d2e/d4f/d2b/d35/d40/l53 0 2024-02-07T12:25:29.888 INFO:tasks.workunit.client.1.smithi138.stdout:5/278: rename da/df/d27/d2e/d4f/d2b/l2d to da/df/l54 0 2024-02-07T12:25:29.888 INFO:tasks.workunit.client.1.smithi138.stdout:5/279: truncate da/f15 2241590 0 2024-02-07T12:25:29.888 INFO:tasks.workunit.client.1.smithi138.stdout:5/280: chown da/d22/l4b 17 1 2024-02-07T12:25:29.888 INFO:tasks.workunit.client.1.smithi138.stdout:5/281: chown da/df/d27/d2e/d4f/d2b/f36 0 1 2024-02-07T12:25:29.889 INFO:tasks.workunit.client.1.smithi138.stdout:5/282: chown da/l18 275032 1 2024-02-07T12:25:29.890 INFO:tasks.workunit.client.1.smithi138.stdout:0/321: dwrite d4/d9/f12 [0,4194304] 0 2024-02-07T12:25:29.890 INFO:tasks.workunit.client.1.smithi138.stdout:0/322: chown d4/d9/l27 64385 1 2024-02-07T12:25:29.890 INFO:tasks.workunit.client.1.smithi138.stdout:8/422: dwrite d1/de/ff [0,4194304] 0 2024-02-07T12:25:29.890 INFO:tasks.workunit.client.1.smithi138.stdout:5/283: symlink da/df/d27/d2e/d4f/l55 0 2024-02-07T12:25:29.891 INFO:tasks.workunit.client.1.smithi138.stdout:1/256: dwrite d5/d8/da/d15/f4e [4194304,4194304] 0 2024-02-07T12:25:29.892 INFO:tasks.workunit.client.1.smithi138.stdout:0/323: mknod d4/d9/db/d39/c6f 0 2024-02-07T12:25:29.894 INFO:tasks.workunit.client.1.smithi138.stdout:8/423: rename d1/de/d11/f37 to d1/de/d11/d17/d2e/d3a/f83 0 2024-02-07T12:25:29.896 INFO:tasks.workunit.client.1.smithi138.stdout:5/284: creat da/d50/f56 x:0 0 0 2024-02-07T12:25:29.899 INFO:tasks.workunit.client.1.smithi138.stdout:1/257: rename d5/d38 to d5/d8/da/d1f/d3c/d59 0 2024-02-07T12:25:29.903 INFO:tasks.workunit.client.1.smithi138.stdout:8/424: unlink d1/de/d11/d17/d2e/d49/d4c/f75 0 2024-02-07T12:25:29.909 INFO:tasks.workunit.client.1.smithi138.stdout:8/425: creat d1/de/d11/d17/d3e/f84 x:0 0 0 2024-02-07T12:25:29.909 INFO:tasks.workunit.client.1.smithi138.stdout:8/426: write d1/de/d11/f6c [379321,6910] 0 2024-02-07T12:25:29.909 INFO:tasks.workunit.client.1.smithi138.stdout:8/427: readlink d1/de/d11/l14 0 2024-02-07T12:25:29.910 INFO:tasks.workunit.client.1.smithi138.stdout:0/324: dwrite d4/d9/f4a [0,4194304] 0 2024-02-07T12:25:29.914 INFO:tasks.workunit.client.1.smithi138.stdout:8/428: dread f0 [0,4194304] 0 2024-02-07T12:25:29.917 INFO:tasks.workunit.client.1.smithi138.stdout:0/325: read d4/d9/de/f24 [274058,112731] 0 2024-02-07T12:25:29.922 INFO:tasks.workunit.client.1.smithi138.stdout:5/285: rename da/c12 to da/df/d27/d2e/d4f/d2b/d35/c57 0 2024-02-07T12:25:29.923 INFO:tasks.workunit.client.1.smithi138.stdout:8/429: dread d1/de/d11/f5b [0,4194304] 0 2024-02-07T12:25:29.923 INFO:tasks.workunit.client.1.smithi138.stdout:8/430: creat d1/f85 x:0 0 0 2024-02-07T12:25:29.923 INFO:tasks.workunit.client.1.smithi138.stdout:5/286: mkdir da/df/d58 0 2024-02-07T12:25:29.927 INFO:tasks.workunit.client.1.smithi138.stdout:8/431: symlink d1/de/l86 0 2024-02-07T12:25:29.928 INFO:tasks.workunit.client.1.smithi138.stdout:5/287: truncate da/fc 3414069 0 2024-02-07T12:25:29.930 INFO:tasks.workunit.client.1.smithi138.stdout:8/432: mknod d1/de/d11/d17/d2e/d49/c87 0 2024-02-07T12:25:29.930 INFO:tasks.workunit.client.1.smithi138.stdout:8/433: chown d1/de/d11/d17/d2e/d3a/f61 5 1 2024-02-07T12:25:29.931 INFO:tasks.workunit.client.1.smithi138.stdout:0/326: dwrite d4/d9/f40 [0,4194304] 0 2024-02-07T12:25:29.936 INFO:tasks.workunit.client.1.smithi138.stdout:5/288: getdents da/d34 0 2024-02-07T12:25:29.936 INFO:tasks.workunit.client.1.smithi138.stdout:0/327: dread d4/d9/de/f45 [0,4194304] 0 2024-02-07T12:25:29.936 INFO:tasks.workunit.client.1.smithi138.stdout:0/328: fsync d4/d9/de/f1c 0 2024-02-07T12:25:29.937 INFO:tasks.workunit.client.1.smithi138.stdout:0/329: rename d4/d9/db/d39/d4b/d6c to d4/d9/db/d39/d4b/d6c/d70 22 2024-02-07T12:25:29.937 INFO:tasks.workunit.client.1.smithi138.stdout:0/330: fdatasync d4/d52/f38 0 2024-02-07T12:25:29.937 INFO:tasks.workunit.client.1.smithi138.stdout:0/331: write d4/d9/db/f15 [2571559,37537] 0 2024-02-07T12:25:29.940 INFO:tasks.workunit.client.1.smithi138.stdout:5/289: mkdir da/df/d27/d2e/d4f/d2b/d59 0 2024-02-07T12:25:29.942 INFO:tasks.workunit.client.1.smithi138.stdout:0/332: unlink d4/d9/de/d1d/d21/l65 0 2024-02-07T12:25:29.942 INFO:tasks.workunit.client.1.smithi138.stdout:5/290: dread da/f1f [0,4194304] 0 2024-02-07T12:25:29.944 INFO:tasks.workunit.client.1.smithi138.stdout:7/442: sync 2024-02-07T12:25:29.944 INFO:tasks.workunit.client.1.smithi138.stdout:7/443: write d0/d8/d11/d26/d90/f36 [2466081,89718] 0 2024-02-07T12:25:29.944 INFO:tasks.workunit.client.1.smithi138.stdout:7/444: read - d0/d8/d11/d26/d90/f7d zero size 2024-02-07T12:25:29.944 INFO:tasks.workunit.client.1.smithi138.stdout:7/445: write d0/d6/f12 [1375874,88425] 0 2024-02-07T12:25:29.947 INFO:tasks.workunit.client.1.smithi138.stdout:7/446: creat d0/d6/d19/d4e/f91 x:0 0 0 2024-02-07T12:25:29.948 INFO:tasks.workunit.client.1.smithi138.stdout:7/447: creat d0/d8/d11/d5f/d86/f92 x:0 0 0 2024-02-07T12:25:29.948 INFO:tasks.workunit.client.1.smithi138.stdout:7/448: rename d0/d8/d11/d1f/d53 to d0/d6/d76/d93 0 2024-02-07T12:25:29.948 INFO:tasks.workunit.client.1.smithi138.stdout:7/449: chown d0/d6/d1d/d38 160711235 1 2024-02-07T12:25:29.948 INFO:tasks.workunit.client.1.smithi138.stdout:5/291: dread da/df/d27/d2e/d4f/f30 [0,4194304] 0 2024-02-07T12:25:29.949 INFO:tasks.workunit.client.1.smithi138.stdout:7/450: write d0/d8/d11/d1f/f56 [843151,78664] 0 2024-02-07T12:25:29.950 INFO:tasks.workunit.client.1.smithi138.stdout:0/333: write d4/d9/de/f2a [373487,34628] 0 2024-02-07T12:25:29.950 INFO:tasks.workunit.client.1.smithi138.stdout:0/334: read - d4/d9/d37/d3d/f5b zero size 2024-02-07T12:25:29.951 INFO:tasks.workunit.client.1.smithi138.stdout:8/434: rmdir d1/de/d11 39 2024-02-07T12:25:29.953 INFO:tasks.workunit.client.1.smithi138.stdout:8/435: truncate d1/de/d11/d17/f2d 3567102 0 2024-02-07T12:25:29.953 INFO:tasks.workunit.client.1.smithi138.stdout:8/436: chown d1/de/d11/c16 40626 1 2024-02-07T12:25:29.953 INFO:tasks.workunit.client.1.smithi138.stdout:8/437: readlink d1/l4f 0 2024-02-07T12:25:29.954 INFO:tasks.workunit.client.1.smithi138.stdout:8/438: creat d1/de/d11/d17/d3e/d72/f88 x:0 0 0 2024-02-07T12:25:29.956 INFO:tasks.workunit.client.1.smithi138.stdout:8/439: unlink d1/de/d11/f6c 0 2024-02-07T12:25:29.958 INFO:tasks.workunit.client.1.smithi138.stdout:7/451: dread d0/d8/d11/d26/f33 [0,4194304] 0 2024-02-07T12:25:29.960 INFO:tasks.workunit.client.1.smithi138.stdout:7/452: symlink d0/d6/d84/l94 0 2024-02-07T12:25:29.966 INFO:tasks.workunit.client.1.smithi138.stdout:8/440: dread d1/de/d11/d17/d2e/d49/f3d [0,4194304] 0 2024-02-07T12:25:29.967 INFO:tasks.workunit.client.1.smithi138.stdout:8/441: mkdir d1/de/d11/d17/d3e/d89 0 2024-02-07T12:25:29.967 INFO:tasks.workunit.client.1.smithi138.stdout:8/442: rmdir d1/de/d11/d17/d2e 39 2024-02-07T12:25:29.967 INFO:tasks.workunit.client.1.smithi138.stdout:8/443: stat d1/de/d11/d17/d3e 0 2024-02-07T12:25:29.968 INFO:tasks.workunit.client.1.smithi138.stdout:0/335: dread d4/d52/f38 [0,4194304] 0 2024-02-07T12:25:29.968 INFO:tasks.workunit.client.1.smithi138.stdout:0/336: dread - d4/f67 zero size 2024-02-07T12:25:29.968 INFO:tasks.workunit.client.1.smithi138.stdout:0/337: truncate d4/d9/d33/f4c 653980 0 2024-02-07T12:25:29.968 INFO:tasks.workunit.client.1.smithi138.stdout:8/444: unlink d1/de/d11/d17/d2e/d49/l2c 0 2024-02-07T12:25:29.970 INFO:tasks.workunit.client.1.smithi138.stdout:0/338: mkdir d4/d9/db/d71 0 2024-02-07T12:25:29.970 INFO:tasks.workunit.client.1.smithi138.stdout:0/339: readlink d4/d9/db/d39/d4b/d6c/l6d 0 2024-02-07T12:25:29.970 INFO:tasks.workunit.client.1.smithi138.stdout:0/340: dread - d4/d9/f3e zero size 2024-02-07T12:25:29.972 INFO:tasks.workunit.client.1.smithi138.stdout:8/445: unlink d1/de/l86 0 2024-02-07T12:25:29.972 INFO:tasks.workunit.client.1.smithi138.stdout:8/446: truncate d1/de/d11/f36 5200349 0 2024-02-07T12:25:29.972 INFO:tasks.workunit.client.1.smithi138.stdout:8/447: truncate d1/de/d11/f31 958744 0 2024-02-07T12:25:29.972 INFO:tasks.workunit.client.1.smithi138.stdout:8/448: write d1/de/d11/d17/f24 [3776774,66137] 0 2024-02-07T12:25:29.973 INFO:tasks.workunit.client.1.smithi138.stdout:0/341: getdents d4/d9/d37 0 2024-02-07T12:25:29.973 INFO:tasks.workunit.client.1.smithi138.stdout:0/342: write d4/d9/de/f24 [3270347,35750] 0 2024-02-07T12:25:29.975 INFO:tasks.workunit.client.1.smithi138.stdout:0/343: getdents d4/d9/db/d39 0 2024-02-07T12:25:29.976 INFO:tasks.workunit.client.1.smithi138.stdout:0/344: creat d4/d9/de/f72 x:0 0 0 2024-02-07T12:25:29.977 INFO:tasks.workunit.client.1.smithi138.stdout:0/345: creat d4/d69/f73 x:0 0 0 2024-02-07T12:25:29.981 INFO:tasks.workunit.client.1.smithi138.stdout:5/292: dwrite da/df/f20 [0,4194304] 0 2024-02-07T12:25:29.981 INFO:tasks.workunit.client.1.smithi138.stdout:5/293: chown da/d22 8664 1 2024-02-07T12:25:29.981 INFO:tasks.workunit.client.1.smithi138.stdout:0/346: dread d4/d9/de/d1d/d21/f4e [0,4194304] 0 2024-02-07T12:25:29.981 INFO:tasks.workunit.client.1.smithi138.stdout:0/347: readlink d4/d9/db/l10 0 2024-02-07T12:25:29.981 INFO:tasks.workunit.client.1.smithi138.stdout:0/348: dread - d4/d9/de/d1d/d21/f3b zero size 2024-02-07T12:25:29.981 INFO:tasks.workunit.client.1.smithi138.stdout:7/453: dwrite d0/d8/d11/d26/d90/f36 [4194304,4194304] 0 2024-02-07T12:25:29.983 INFO:tasks.workunit.client.1.smithi138.stdout:5/294: rename da/df/d27/d2e/d4f/f2c to da/df/f5a 0 2024-02-07T12:25:29.984 INFO:tasks.workunit.client.1.smithi138.stdout:0/349: mkdir d4/d52/d74 0 2024-02-07T12:25:29.987 INFO:tasks.workunit.client.1.smithi138.stdout:0/350: fsync d4/d9/de/f2a 0 2024-02-07T12:25:29.987 INFO:tasks.workunit.client.1.smithi138.stdout:8/449: dwrite d1/de/f53 [0,4194304] 0 2024-02-07T12:25:29.987 INFO:tasks.workunit.client.1.smithi138.stdout:7/454: creat d0/d8/d11/d5f/f95 x:0 0 0 2024-02-07T12:25:29.994 INFO:tasks.workunit.client.1.smithi138.stdout:8/450: dread d1/de/d11/d17/d2e/d49/f19 [0,4194304] 0 2024-02-07T12:25:29.996 INFO:tasks.workunit.client.1.smithi138.stdout:8/451: mkdir d1/de/d11/d17/d8a 0 2024-02-07T12:25:29.998 INFO:tasks.workunit.client.1.smithi138.stdout:8/452: mkdir d1/d8b 0 2024-02-07T12:25:30.000 INFO:tasks.workunit.client.1.smithi138.stdout:8/453: creat d1/de/d11/d17/f8c x:0 0 0 2024-02-07T12:25:30.001 INFO:tasks.workunit.client.1.smithi138.stdout:8/454: mkdir d1/de/d11/d17/d8a/d8d 0 2024-02-07T12:25:30.002 INFO:tasks.workunit.client.1.smithi138.stdout:8/455: mkdir d1/d8e 0 2024-02-07T12:25:30.003 INFO:tasks.workunit.client.1.smithi138.stdout:8/456: getdents d1/de/d11/d17/d2e 0 2024-02-07T12:25:30.003 INFO:tasks.workunit.client.1.smithi138.stdout:8/457: truncate d1/de/d11/d17/d2e/f74 549468 0 2024-02-07T12:25:30.021 INFO:tasks.workunit.client.1.smithi138.stdout:5/295: dwrite da/df/f5a [4194304,4194304] 0 2024-02-07T12:25:30.022 INFO:tasks.workunit.client.1.smithi138.stdout:0/351: dwrite d4/d9/d37/d3d/f5b [0,4194304] 0 2024-02-07T12:25:30.022 INFO:tasks.workunit.client.1.smithi138.stdout:0/352: chown d4/fd 5486 1 2024-02-07T12:25:30.022 INFO:tasks.workunit.client.1.smithi138.stdout:0/353: stat d4/d9/d33/l4f 0 2024-02-07T12:25:30.024 INFO:tasks.workunit.client.1.smithi138.stdout:5/296: symlink da/df/l5b 0 2024-02-07T12:25:30.024 INFO:tasks.workunit.client.1.smithi138.stdout:7/455: dwrite d0/d6/d3e/f68 [0,4194304] 0 2024-02-07T12:25:30.024 INFO:tasks.workunit.client.1.smithi138.stdout:8/458: dwrite d1/de/d11/d17/d2e/d49/f39 [0,4194304] 0 2024-02-07T12:25:30.025 INFO:tasks.workunit.client.1.smithi138.stdout:5/297: write da/df/d27/d2e/f2f [626262,71509] 0 2024-02-07T12:25:30.035 INFO:tasks.workunit.client.1.smithi138.stdout:7/456: mknod d0/d6/d1d/d38/c96 0 2024-02-07T12:25:30.035 INFO:tasks.workunit.client.1.smithi138.stdout:7/457: stat d0/d6/d76/d93/c82 0 2024-02-07T12:25:30.035 INFO:tasks.workunit.client.1.smithi138.stdout:7/458: write d0/d8/d11/f6d [568616,77864] 0 2024-02-07T12:25:30.042 INFO:tasks.workunit.client.1.smithi138.stdout:5/298: getdents da/df/d27/d2e 0 2024-02-07T12:25:30.044 INFO:tasks.workunit.client.1.smithi138.stdout:7/459: rename d0/d6/d1d/d38/f5c to d0/d6/d73/f97 0 2024-02-07T12:25:30.044 INFO:tasks.workunit.client.1.smithi138.stdout:7/460: fdatasync d0/d8/d11/d26/d90/f7d 0 2024-02-07T12:25:30.050 INFO:tasks.workunit.client.1.smithi138.stdout:3/376: sync 2024-02-07T12:25:30.050 INFO:tasks.workunit.client.1.smithi138.stdout:5/299: dread da/f19 [4194304,4194304] 0 2024-02-07T12:25:30.052 INFO:tasks.workunit.client.1.smithi138.stdout:3/377: truncate d5/d26/d28/f4b 874975 0 2024-02-07T12:25:30.054 INFO:tasks.workunit.client.1.smithi138.stdout:3/378: truncate d5/d26/d28/f59 179954 0 2024-02-07T12:25:30.054 INFO:tasks.workunit.client.1.smithi138.stdout:3/379: readlink d5/l21 0 2024-02-07T12:25:30.054 INFO:tasks.workunit.client.1.smithi138.stdout:3/380: truncate d5/d26/d28/f39 1080939 0 2024-02-07T12:25:30.054 INFO:tasks.workunit.client.1.smithi138.stdout:3/381: creat d5/d15/f85 x:0 0 0 2024-02-07T12:25:30.055 INFO:tasks.workunit.client.1.smithi138.stdout:3/382: mkdir d5/d26/d5e/d86 0 2024-02-07T12:25:30.058 INFO:tasks.workunit.client.1.smithi138.stdout:7/461: dwrite d0/d8/d15/ff [0,4194304] 0 2024-02-07T12:25:30.060 INFO:tasks.workunit.client.1.smithi138.stdout:5/300: dread da/df/d27/d2e/d4f/f3e [0,4194304] 0 2024-02-07T12:25:30.062 INFO:tasks.workunit.client.1.smithi138.stdout:5/301: mknod da/df/d58/c5c 0 2024-02-07T12:25:30.066 INFO:tasks.workunit.client.1.smithi138.stdout:7/462: dread d0/d6/d19/f29 [0,4194304] 0 2024-02-07T12:25:30.067 INFO:tasks.workunit.client.1.smithi138.stdout:5/302: dread da/f15 [0,4194304] 0 2024-02-07T12:25:30.067 INFO:tasks.workunit.client.1.smithi138.stdout:5/303: chown da/fc 6169 1 2024-02-07T12:25:30.068 INFO:tasks.workunit.client.1.smithi138.stdout:5/304: dread da/df/d27/d2e/d4f/d2b/f36 [0,4194304] 0 2024-02-07T12:25:30.075 INFO:tasks.workunit.client.1.smithi138.stdout:3/383: dwrite d5/d27/f3d [0,4194304] 0 2024-02-07T12:25:30.075 INFO:tasks.workunit.client.1.smithi138.stdout:5/305: dread f8 [0,4194304] 0 2024-02-07T12:25:30.095 INFO:tasks.workunit.client.1.smithi138.stdout:5/306: dwrite da/df/d27/f28 [0,4194304] 0 2024-02-07T12:25:30.096 INFO:tasks.workunit.client.1.smithi138.stdout:3/384: dwrite d5/d15/f48 [0,4194304] 0 2024-02-07T12:25:30.096 INFO:tasks.workunit.client.1.smithi138.stdout:3/385: readlink d5/l6c 0 2024-02-07T12:25:30.096 INFO:tasks.workunit.client.1.smithi138.stdout:3/386: dread - d5/d26/d4e/f84 zero size 2024-02-07T12:25:30.097 INFO:tasks.workunit.client.1.smithi138.stdout:5/307: unlink da/fb 0 2024-02-07T12:25:30.097 INFO:tasks.workunit.client.1.smithi138.stdout:3/387: mknod d5/d34/d79/c87 0 2024-02-07T12:25:30.097 INFO:tasks.workunit.client.1.smithi138.stdout:3/388: creat d5/d27/f88 x:0 0 0 2024-02-07T12:25:30.098 INFO:tasks.workunit.client.1.smithi138.stdout:5/308: dread da/f1f [0,4194304] 0 2024-02-07T12:25:30.100 INFO:tasks.workunit.client.1.smithi138.stdout:3/389: link d5/d26/d28/f4d d5/d34/d79/f89 0 2024-02-07T12:25:30.100 INFO:tasks.workunit.client.1.smithi138.stdout:3/390: creat d5/d26/d5e/f8a x:0 0 0 2024-02-07T12:25:30.101 INFO:tasks.workunit.client.1.smithi138.stdout:3/391: creat d5/d26/d28/f8b x:0 0 0 2024-02-07T12:25:30.101 INFO:tasks.workunit.client.1.smithi138.stdout:3/392: dread - d5/d15/f41 zero size 2024-02-07T12:25:30.102 INFO:tasks.workunit.client.1.smithi138.stdout:5/309: rmdir da/d34 39 2024-02-07T12:25:30.102 INFO:tasks.workunit.client.1.smithi138.stdout:5/310: write da/df/d27/d2e/d4f/d2b/d35/d40/f45 [676469,37572] 0 2024-02-07T12:25:30.105 INFO:tasks.workunit.client.1.smithi138.stdout:5/311: mkdir da/df/d27/d2e/d4f/d2b/d35/d5d 0 2024-02-07T12:25:30.112 INFO:tasks.workunit.client.1.smithi138.stdout:5/312: truncate da/df/f5a 248331 0 2024-02-07T12:25:30.115 INFO:tasks.workunit.client.1.smithi138.stdout:5/313: rename da/df/d27/d2e/d4f/f3e to da/df/d27/d2e/d4f/d2b/d35/d40/f5e 0 2024-02-07T12:25:30.115 INFO:tasks.workunit.client.1.smithi138.stdout:5/314: getdents da/df/d27/d2e/d4f/d2b/d35/d5d 0 2024-02-07T12:25:30.116 INFO:tasks.workunit.client.1.smithi138.stdout:3/393: dwrite d5/d26/d4e/f5a [0,4194304] 0 2024-02-07T12:25:30.116 INFO:tasks.workunit.client.1.smithi138.stdout:3/394: write d5/d26/d5e/f8a [701762,4628] 0 2024-02-07T12:25:30.116 INFO:tasks.workunit.client.1.smithi138.stdout:3/395: fsync d5/d15/f36 0 2024-02-07T12:25:30.118 INFO:tasks.workunit.client.1.smithi138.stdout:3/396: dread d5/d26/d28/f5d [0,4194304] 0 2024-02-07T12:25:30.118 INFO:tasks.workunit.client.1.smithi138.stdout:3/397: truncate d5/d27/f88 851472 0 2024-02-07T12:25:30.118 INFO:tasks.workunit.client.1.smithi138.stdout:3/398: dread - d5/d34/d79/f7b zero size 2024-02-07T12:25:30.118 INFO:tasks.workunit.client.1.smithi138.stdout:2/402: sync 2024-02-07T12:25:30.120 INFO:tasks.workunit.client.1.smithi138.stdout:5/315: symlink da/df/d58/l5f 0 2024-02-07T12:25:30.121 INFO:tasks.workunit.client.1.smithi138.stdout:3/399: link d5/d34/d79/f89 d5/d26/d4e/f8c 0 2024-02-07T12:25:30.124 INFO:tasks.workunit.client.1.smithi138.stdout:3/400: creat d5/f8d x:0 0 0 2024-02-07T12:25:30.125 INFO:tasks.workunit.client.1.smithi138.stdout:5/316: getdents da/d50 0 2024-02-07T12:25:30.142 INFO:tasks.workunit.client.1.smithi138.stdout:5/317: write da/df/d27/f28 [899219,24893] 0 2024-02-07T12:25:30.145 INFO:tasks.workunit.client.1.smithi138.stdout:5/318: write f8 [523890,74827] 0 2024-02-07T12:25:30.146 INFO:tasks.workunit.client.1.smithi138.stdout:5/319: creat da/df/d27/f60 x:0 0 0 2024-02-07T12:25:30.146 INFO:tasks.workunit.client.1.smithi138.stdout:5/320: read da/df/d27/d2e/f2f [289646,13027] 0 2024-02-07T12:25:30.147 INFO:tasks.workunit.client.1.smithi138.stdout:5/321: mknod da/d43/c61 0 2024-02-07T12:25:30.147 INFO:tasks.workunit.client.1.smithi138.stdout:5/322: creat da/d22/f62 x:0 0 0 2024-02-07T12:25:30.148 INFO:tasks.workunit.client.1.smithi138.stdout:5/323: write da/df/d27/d2e/d4f/d2b/f36 [469345,71484] 0 2024-02-07T12:25:30.149 INFO:tasks.workunit.client.1.smithi138.stdout:5/324: truncate da/f19 5174805 0 2024-02-07T12:25:30.151 INFO:tasks.workunit.client.1.smithi138.stdout:5/325: rename da/df/c14 to da/df/d27/d2e/d4f/d2b/d35/d5d/c63 0 2024-02-07T12:25:30.152 INFO:tasks.workunit.client.1.smithi138.stdout:5/326: truncate da/df/f4e 780569 0 2024-02-07T12:25:30.153 INFO:tasks.workunit.client.1.smithi138.stdout:5/327: rename da/d22/l4b to da/df/d27/d2e/d4f/l64 0 2024-02-07T12:25:30.177 INFO:tasks.workunit.client.1.smithi138.stdout:3/401: dwrite d5/d26/d28/f2b [4194304,4194304] 0 2024-02-07T12:25:30.179 INFO:tasks.workunit.client.1.smithi138.stdout:3/402: creat d5/d26/d5e/d77/f8e x:0 0 0 2024-02-07T12:25:30.185 INFO:tasks.workunit.client.1.smithi138.stdout:5/328: dwrite da/df/d27/f33 [0,4194304] 0 2024-02-07T12:25:30.188 INFO:tasks.workunit.client.1.smithi138.stdout:5/329: readlink da/df/l54 0 2024-02-07T12:25:30.189 INFO:tasks.workunit.client.1.smithi138.stdout:5/330: mkdir da/df/d27/d2e/d4f/d2b/d59/d65 0 2024-02-07T12:25:30.190 INFO:tasks.workunit.client.1.smithi138.stdout:5/331: chown da/df/d58/l5f 13809 1 2024-02-07T12:25:30.192 INFO:tasks.workunit.client.1.smithi138.stdout:3/403: write d5/d27/f40 [1529287,69614] 0 2024-02-07T12:25:30.205 INFO:tasks.workunit.client.1.smithi138.stdout:3/404: dwrite d5/f9 [4194304,4194304] 0 2024-02-07T12:25:30.205 INFO:tasks.workunit.client.1.smithi138.stdout:3/405: write d5/d26/d4e/f58 [191800,84455] 0 2024-02-07T12:25:30.206 INFO:tasks.workunit.client.1.smithi138.stdout:3/406: creat d5/d34/f8f x:0 0 0 2024-02-07T12:25:30.208 INFO:tasks.workunit.client.1.smithi138.stdout:3/407: mkdir d5/d26/d90 0 2024-02-07T12:25:30.208 INFO:tasks.workunit.client.1.smithi138.stdout:3/408: truncate d5/f3a 800977 0 2024-02-07T12:25:30.210 INFO:tasks.workunit.client.1.smithi138.stdout:9/259: sync 2024-02-07T12:25:30.210 INFO:tasks.workunit.client.1.smithi138.stdout:0/354: sync 2024-02-07T12:25:30.210 INFO:tasks.workunit.client.1.smithi138.stdout:4/233: sync 2024-02-07T12:25:30.210 INFO:tasks.workunit.client.1.smithi138.stdout:6/308: sync 2024-02-07T12:25:30.210 INFO:tasks.workunit.client.1.smithi138.stdout:1/258: sync 2024-02-07T12:25:30.210 INFO:tasks.workunit.client.1.smithi138.stdout:6/309: fdatasync dc/d13/f39 0 2024-02-07T12:25:30.210 INFO:tasks.workunit.client.1.smithi138.stdout:9/260: write d0/d6/d8/f52 [784919,34546] 0 2024-02-07T12:25:30.210 INFO:tasks.workunit.client.1.smithi138.stdout:6/310: creat dc/d31/d38/f64 x:0 0 0 2024-02-07T12:25:30.210 INFO:tasks.workunit.client.1.smithi138.stdout:6/311: dread - dc/d13/f42 zero size 2024-02-07T12:25:30.210 INFO:tasks.workunit.client.1.smithi138.stdout:6/312: write dc/d13/f1b [2737940,78431] 0 2024-02-07T12:25:30.211 INFO:tasks.workunit.client.1.smithi138.stdout:3/409: creat d5/d27/d35/f91 x:0 0 0 2024-02-07T12:25:30.212 INFO:tasks.workunit.client.1.smithi138.stdout:6/313: fdatasync dc/d13/f1b 0 2024-02-07T12:25:30.213 INFO:tasks.workunit.client.1.smithi138.stdout:4/234: mkdir d20/d4d 0 2024-02-07T12:25:30.214 INFO:tasks.workunit.client.1.smithi138.stdout:4/235: write f8 [1643904,127924] 0 2024-02-07T12:25:30.214 INFO:tasks.workunit.client.1.smithi138.stdout:4/236: read d20/f31 [534318,47620] 0 2024-02-07T12:25:30.214 INFO:tasks.workunit.client.1.smithi138.stdout:4/237: write d20/d34/f4c [223347,2114] 0 2024-02-07T12:25:30.214 INFO:tasks.workunit.client.1.smithi138.stdout:4/238: fsync f15 0 2024-02-07T12:25:30.216 INFO:tasks.workunit.client.1.smithi138.stdout:3/410: symlink d5/d26/d4e/l92 0 2024-02-07T12:25:30.216 INFO:tasks.workunit.client.1.smithi138.stdout:1/259: write d5/f1a [2071979,13716] 0 2024-02-07T12:25:30.219 INFO:tasks.workunit.client.1.smithi138.stdout:3/411: symlink d5/d34/d79/l93 0 2024-02-07T12:25:30.223 INFO:tasks.workunit.client.1.smithi138.stdout:1/260: dread d5/d8/da/d1f/f51 [0,4194304] 0 2024-02-07T12:25:30.224 INFO:tasks.workunit.client.1.smithi138.stdout:3/412: link d5/d26/d5e/d77/f8e d5/f94 0 2024-02-07T12:25:30.225 INFO:tasks.workunit.client.1.smithi138.stdout:1/261: rmdir d5/d8/da/d15 39 2024-02-07T12:25:30.226 INFO:tasks.workunit.client.1.smithi138.stdout:3/413: mkdir d5/d26/d5e/d86/d95 0 2024-02-07T12:25:30.226 INFO:tasks.workunit.client.1.smithi138.stdout:3/414: chown d5/d15/c76 2 1 2024-02-07T12:25:30.227 INFO:tasks.workunit.client.1.smithi138.stdout:1/262: creat d5/d8/f5a x:0 0 0 2024-02-07T12:25:30.232 INFO:tasks.workunit.client.1.smithi138.stdout:3/415: rmdir d5/d26/d5e/d86/d95 0 2024-02-07T12:25:30.232 INFO:tasks.workunit.client.1.smithi138.stdout:3/416: fdatasync d5/d34/d79/f7b 0 2024-02-07T12:25:30.232 INFO:tasks.workunit.client.1.smithi138.stdout:3/417: readlink d5/d15/l1e 0 2024-02-07T12:25:30.232 INFO:tasks.workunit.client.1.smithi138.stdout:3/418: fdatasync d5/f56 0 2024-02-07T12:25:30.232 INFO:tasks.workunit.client.1.smithi138.stdout:3/419: write d5/f75 [732393,70215] 0 2024-02-07T12:25:30.234 INFO:tasks.workunit.client.1.smithi138.stdout:1/263: getdents d5/d8/da/d1f 0 2024-02-07T12:25:30.234 INFO:tasks.workunit.client.1.smithi138.stdout:1/264: write d5/f1a [3164166,94072] 0 2024-02-07T12:25:30.235 INFO:tasks.workunit.client.1.smithi138.stdout:1/265: getdents d5/d43 0 2024-02-07T12:25:30.235 INFO:tasks.workunit.client.1.smithi138.stdout:1/266: stat d5/d8/cb 0 2024-02-07T12:25:30.242 INFO:tasks.workunit.client.1.smithi138.stdout:0/355: dwrite d4/d9/de/f2a [0,4194304] 0 2024-02-07T12:25:30.243 INFO:tasks.workunit.client.1.smithi138.stdout:9/261: dwrite d0/d6/d8/f2a [0,4194304] 0 2024-02-07T12:25:30.243 INFO:tasks.workunit.client.1.smithi138.stdout:9/262: creat d0/d6/d8/d1d/dd/d41/f5c x:0 0 0 2024-02-07T12:25:30.245 INFO:tasks.workunit.client.1.smithi138.stdout:6/314: dwrite dc/f1f [0,4194304] 0 2024-02-07T12:25:30.247 INFO:tasks.workunit.client.1.smithi138.stdout:9/263: rename d0/d6/d8/d1d/dd/d1f to d0/d6/d8/d1d/dd/d1f/d5d 22 2024-02-07T12:25:30.247 INFO:tasks.workunit.client.1.smithi138.stdout:9/264: dread - d0/d6/d8/d1d/dd/d25/f5b zero size 2024-02-07T12:25:30.248 INFO:tasks.workunit.client.1.smithi138.stdout:6/315: mknod dc/d13/d1e/d4d/c65 0 2024-02-07T12:25:30.250 INFO:tasks.workunit.client.1.smithi138.stdout:4/239: rmdir d20 39 2024-02-07T12:25:30.250 INFO:tasks.workunit.client.1.smithi138.stdout:4/240: fdatasync f16 0 2024-02-07T12:25:30.251 INFO:tasks.workunit.client.1.smithi138.stdout:4/241: mknod d20/d47/c4e 0 2024-02-07T12:25:30.251 INFO:tasks.workunit.client.1.smithi138.stdout:4/242: fdatasync f1a 0 2024-02-07T12:25:30.251 INFO:tasks.workunit.client.1.smithi138.stdout:4/243: write d20/f3f [731461,122420] 0 2024-02-07T12:25:30.252 INFO:tasks.workunit.client.1.smithi138.stdout:4/244: dread d20/f3d [0,4194304] 0 2024-02-07T12:25:30.256 INFO:tasks.workunit.client.1.smithi138.stdout:4/245: symlink d20/l4f 0 2024-02-07T12:25:30.256 INFO:tasks.workunit.client.1.smithi138.stdout:4/246: write d20/d34/d36/f43 [1055215,14820] 0 2024-02-07T12:25:30.258 INFO:tasks.workunit.client.1.smithi138.stdout:4/247: rmdir d20/d47 39 2024-02-07T12:25:30.258 INFO:tasks.workunit.client.1.smithi138.stdout:4/248: chown d20/l23 63 1 2024-02-07T12:25:30.259 INFO:tasks.workunit.client.1.smithi138.stdout:9/265: write d0/d6/d8/d1d/dd/f18 [4017511,119657] 0 2024-02-07T12:25:30.259 INFO:tasks.workunit.client.1.smithi138.stdout:9/266: fsync d0/f38 0 2024-02-07T12:25:30.259 INFO:tasks.workunit.client.1.smithi138.stdout:9/267: fsync d0/d6/f12 0 2024-02-07T12:25:30.259 INFO:tasks.workunit.client.1.smithi138.stdout:9/268: read d0/d6/d8/d1d/dd/f20 [1380421,130758] 0 2024-02-07T12:25:30.278 INFO:tasks.workunit.client.1.smithi138.stdout:1/267: dwrite d5/d8/da/d1f/d3c/d59/f55 [0,4194304] 0 2024-02-07T12:25:30.280 INFO:tasks.workunit.client.1.smithi138.stdout:4/249: dread f1d [0,4194304] 0 2024-02-07T12:25:30.281 INFO:tasks.workunit.client.1.smithi138.stdout:3/420: dwrite d5/d26/d4e/f84 [0,4194304] 0 2024-02-07T12:25:30.281 INFO:tasks.workunit.client.1.smithi138.stdout:0/356: dwrite d4/d9/de/f2a [0,4194304] 0 2024-02-07T12:25:30.285 INFO:tasks.workunit.client.1.smithi138.stdout:6/316: dwrite dc/d13/d1e/d35/f4c [0,4194304] 0 2024-02-07T12:25:30.285 INFO:tasks.workunit.client.1.smithi138.stdout:4/250: creat d20/f50 x:0 0 0 2024-02-07T12:25:30.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:30 smithi138 ceph-mon[35528]: pgmap v256: 65 pgs: 65 active+clean; 412 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 23 MiB/s rd, 35 MiB/s wr, 444 op/s 2024-02-07T12:25:30.289 INFO:tasks.workunit.client.1.smithi138.stdout:9/269: rmdir d0/d6/d8/d1d/dd/d41 39 2024-02-07T12:25:30.291 INFO:tasks.workunit.client.1.smithi138.stdout:3/421: rmdir d5/d27/d35 39 2024-02-07T12:25:30.291 INFO:tasks.workunit.client.1.smithi138.stdout:3/422: fsync d5/d27/f40 0 2024-02-07T12:25:30.291 INFO:tasks.workunit.client.1.smithi138.stdout:3/423: chown d5/d27/d35/l3f 179050122 1 2024-02-07T12:25:30.293 INFO:tasks.workunit.client.1.smithi138.stdout:9/270: mkdir d0/d6/d8/d1d/dd/d41/d5e 0 2024-02-07T12:25:30.293 INFO:tasks.workunit.client.1.smithi138.stdout:9/271: readlink d0/d6/l4a 0 2024-02-07T12:25:30.293 INFO:tasks.workunit.client.1.smithi138.stdout:9/272: write d0/f33 [20595,29158] 0 2024-02-07T12:25:30.294 INFO:tasks.workunit.client.1.smithi138.stdout:3/424: mkdir d5/d15/d96 0 2024-02-07T12:25:30.296 INFO:tasks.workunit.client.1.smithi138.stdout:9/273: mknod d0/d6/d8/d1d/dd/d25/c5f 0 2024-02-07T12:25:30.296 INFO:tasks.workunit.client.1.smithi138.stdout:9/274: readlink d0/d6/d8/d1d/l54 0 2024-02-07T12:25:30.296 INFO:tasks.workunit.client.1.smithi138.stdout:9/275: dread - d0/f4f zero size 2024-02-07T12:25:30.299 INFO:tasks.workunit.client.1.smithi138.stdout:9/276: unlink d0/d6/d8/d1d/dd/d25/l35 0 2024-02-07T12:25:30.300 INFO:tasks.workunit.client.1.smithi138.stdout:9/277: write d0/d6/f15 [497385,23731] 0 2024-02-07T12:25:30.300 INFO:tasks.workunit.client.1.smithi138.stdout:9/278: write d0/d6/d8/d1d/dd/d25/f2d [1092879,25070] 0 2024-02-07T12:25:30.300 INFO:tasks.workunit.client.1.smithi138.stdout:3/425: getdents d5/d26 0 2024-02-07T12:25:30.303 INFO:tasks.workunit.client.1.smithi138.stdout:3/426: link d5/d15/c55 d5/d26/c97 0 2024-02-07T12:25:30.305 INFO:tasks.workunit.client.1.smithi138.stdout:9/279: unlink d0/d6/d8/c3a 0 2024-02-07T12:25:30.306 INFO:tasks.workunit.client.1.smithi138.stdout:9/280: creat d0/d6/d8/d1d/dd/d41/f60 x:0 0 0 2024-02-07T12:25:30.306 INFO:tasks.workunit.client.1.smithi138.stdout:9/281: write d0/d6/d8/d1d/dd/d1f/f47 [605593,99016] 0 2024-02-07T12:25:30.312 INFO:tasks.workunit.client.1.smithi138.stdout:3/427: read d5/f2f [3313509,26709] 0 2024-02-07T12:25:30.312 INFO:tasks.workunit.client.1.smithi138.stdout:1/268: dwrite d5/d8/da/f1d [0,4194304] 0 2024-02-07T12:25:30.313 INFO:tasks.workunit.client.1.smithi138.stdout:3/428: chown d5/d26/f3c 217860418 1 2024-02-07T12:25:30.318 INFO:tasks.workunit.client.1.smithi138.stdout:9/282: dread d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:30.319 INFO:tasks.workunit.client.1.smithi138.stdout:3/429: mknod d5/d26/d4e/c98 0 2024-02-07T12:25:30.319 INFO:tasks.workunit.client.1.smithi138.stdout:3/430: read d5/d27/f57 [80248,50990] 0 2024-02-07T12:25:30.321 INFO:tasks.workunit.client.1.smithi138.stdout:3/431: symlink d5/d27/d35/d7c/l99 0 2024-02-07T12:25:30.321 INFO:tasks.workunit.client.1.smithi138.stdout:3/432: dread - d5/d26/d4e/f8c zero size 2024-02-07T12:25:30.321 INFO:tasks.workunit.client.1.smithi138.stdout:6/317: dwrite dc/d31/d3f/d55/f5e [0,4194304] 0 2024-02-07T12:25:30.321 INFO:tasks.workunit.client.1.smithi138.stdout:6/318: chown dc 317383 1 2024-02-07T12:25:30.321 INFO:tasks.workunit.client.1.smithi138.stdout:0/357: dwrite d4/d9/db/f5f [0,4194304] 0 2024-02-07T12:25:30.321 INFO:tasks.workunit.client.1.smithi138.stdout:4/251: dwrite d20/d34/d36/f44 [0,4194304] 0 2024-02-07T12:25:30.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:30 smithi047 ceph-mon[28972]: pgmap v256: 65 pgs: 65 active+clean; 412 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 23 MiB/s rd, 35 MiB/s wr, 444 op/s 2024-02-07T12:25:30.325 INFO:tasks.workunit.client.1.smithi138.stdout:6/319: symlink dc/l66 0 2024-02-07T12:25:30.326 INFO:tasks.workunit.client.1.smithi138.stdout:6/320: stat f6 0 2024-02-07T12:25:30.326 INFO:tasks.workunit.client.1.smithi138.stdout:6/321: chown dc/f4b 164 1 2024-02-07T12:25:30.326 INFO:tasks.workunit.client.1.smithi138.stdout:6/322: fdatasync dc/d13/d1e/d35/f46 0 2024-02-07T12:25:30.328 INFO:tasks.workunit.client.1.smithi138.stdout:9/283: read d0/d6/d8/d1d/f1c [1922169,100418] 0 2024-02-07T12:25:30.329 INFO:tasks.workunit.client.1.smithi138.stdout:8/459: sync 2024-02-07T12:25:30.330 INFO:tasks.workunit.client.1.smithi138.stdout:4/252: mkdir d20/d4d/d51 0 2024-02-07T12:25:30.330 INFO:tasks.workunit.client.1.smithi138.stdout:4/253: dread - d20/f2f zero size 2024-02-07T12:25:30.333 INFO:tasks.workunit.client.1.smithi138.stdout:3/433: mkdir d5/d26/d9a 0 2024-02-07T12:25:30.333 INFO:tasks.workunit.client.1.smithi138.stdout:3/434: stat d5/d27/f80 0 2024-02-07T12:25:30.334 INFO:tasks.workunit.client.1.smithi138.stdout:8/460: rename d1/f44 to d1/d8e/f8f 0 2024-02-07T12:25:30.337 INFO:tasks.workunit.client.1.smithi138.stdout:9/284: dread d0/d6/d8/d1d/dd/f18 [0,4194304] 0 2024-02-07T12:25:30.338 INFO:tasks.workunit.client.1.smithi138.stdout:8/461: mknod d1/de/d11/d17/d3e/d89/c90 0 2024-02-07T12:25:30.340 INFO:tasks.workunit.client.1.smithi138.stdout:3/435: mkdir d5/d26/d9b 0 2024-02-07T12:25:30.342 INFO:tasks.workunit.client.1.smithi138.stdout:9/285: rename d0/d6/d8/d1d/dd/f18 to d0/d6/d8/d1d/f61 0 2024-02-07T12:25:30.343 INFO:tasks.workunit.client.1.smithi138.stdout:9/286: dread - d0/d6/d8/d1d/dd/d41/f50 zero size 2024-02-07T12:25:30.344 INFO:tasks.workunit.client.1.smithi138.stdout:8/462: creat d1/d8e/f91 x:0 0 0 2024-02-07T12:25:30.347 INFO:tasks.workunit.client.1.smithi138.stdout:3/436: mkdir d5/d26/d5e/d86/d9c 0 2024-02-07T12:25:30.347 INFO:tasks.workunit.client.1.smithi138.stdout:2/403: sync 2024-02-07T12:25:30.347 INFO:tasks.workunit.client.1.smithi138.stdout:5/332: sync 2024-02-07T12:25:30.347 INFO:tasks.workunit.client.1.smithi138.stdout:7/463: sync 2024-02-07T12:25:30.348 INFO:tasks.workunit.client.1.smithi138.stdout:5/333: rmdir da/df/d27/d2e/d4f 39 2024-02-07T12:25:30.349 INFO:tasks.workunit.client.1.smithi138.stdout:7/464: unlink d0/d6/d1d/l62 0 2024-02-07T12:25:30.350 INFO:tasks.workunit.client.1.smithi138.stdout:2/404: symlink d3/dd/d19/d44/d7d/l95 0 2024-02-07T12:25:30.350 INFO:tasks.workunit.client.1.smithi138.stdout:2/405: write d3/d4e/f88 [664127,76489] 0 2024-02-07T12:25:30.351 INFO:tasks.workunit.client.1.smithi138.stdout:5/334: mknod da/d43/d4a/c66 0 2024-02-07T12:25:30.351 INFO:tasks.workunit.client.1.smithi138.stdout:2/406: rmdir d3/dd/d14/d49/d29 39 2024-02-07T12:25:30.352 INFO:tasks.workunit.client.1.smithi138.stdout:7/465: dread d0/d8/d11/d63/f7a [0,4194304] 0 2024-02-07T12:25:30.352 INFO:tasks.workunit.client.1.smithi138.stdout:6/323: dwrite f8 [0,4194304] 0 2024-02-07T12:25:30.352 INFO:tasks.workunit.client.1.smithi138.stdout:6/324: readlink dc/d13/l2d 0 2024-02-07T12:25:30.352 INFO:tasks.workunit.client.1.smithi138.stdout:6/325: creat dc/d31/d3f/d55/f67 x:0 0 0 2024-02-07T12:25:30.353 INFO:tasks.workunit.client.1.smithi138.stdout:2/407: rename d3/dd/d14/d49/d25/d3d/d5f/f64 to d3/dd/d19/d1f/d37/f96 0 2024-02-07T12:25:30.353 INFO:tasks.workunit.client.1.smithi138.stdout:2/408: stat d3/dd/d19/d1f/d37/l79 0 2024-02-07T12:25:30.355 INFO:tasks.workunit.client.1.smithi138.stdout:6/326: rename dc/d13/d1e/l4f to dc/d13/l68 0 2024-02-07T12:25:30.355 INFO:tasks.workunit.client.1.smithi138.stdout:7/466: mkdir d0/d8/d11/d26/d90/d98 0 2024-02-07T12:25:30.356 INFO:tasks.workunit.client.1.smithi138.stdout:7/467: unlink d0/d6/f69 0 2024-02-07T12:25:30.357 INFO:tasks.workunit.client.1.smithi138.stdout:7/468: write d0/d8/d11/d5f/d86/f92 [703862,12324] 0 2024-02-07T12:25:30.360 INFO:tasks.workunit.client.1.smithi138.stdout:2/409: write d3/dd/f2e [1962702,103622] 0 2024-02-07T12:25:30.360 INFO:tasks.workunit.client.1.smithi138.stdout:2/410: read - d3/dd/d19/d44/d7d/f91 zero size 2024-02-07T12:25:30.362 INFO:tasks.workunit.client.1.smithi138.stdout:2/411: unlink d3/f6a 0 2024-02-07T12:25:30.362 INFO:tasks.workunit.client.1.smithi138.stdout:2/412: truncate d3/dd/d14/d49/d25/d3d/f52 1464613 0 2024-02-07T12:25:30.362 INFO:tasks.workunit.client.1.smithi138.stdout:2/413: write d3/dd/d14/d49/d25/d3d/f52 [1578809,24928] 0 2024-02-07T12:25:30.362 INFO:tasks.workunit.client.1.smithi138.stdout:2/414: chown d3/dd/d19/d1f/d37/c7b 214535 1 2024-02-07T12:25:30.363 INFO:tasks.workunit.client.1.smithi138.stdout:2/415: rmdir d3/dd/d14/d49/d25/d3d 39 2024-02-07T12:25:30.363 INFO:tasks.workunit.client.1.smithi138.stdout:2/416: mkdir d3/dd/d19/d44/d7d/d97 0 2024-02-07T12:25:30.363 INFO:tasks.workunit.client.1.smithi138.stdout:2/417: dread - d3/dd/d19/d44/d7d/f91 zero size 2024-02-07T12:25:30.365 INFO:tasks.workunit.client.1.smithi138.stdout:2/418: creat d3/dd/d14/d49/f98 x:0 0 0 2024-02-07T12:25:30.365 INFO:tasks.workunit.client.1.smithi138.stdout:2/419: write d3/dd/f2e [4236126,77307] 0 2024-02-07T12:25:30.365 INFO:tasks.workunit.client.1.smithi138.stdout:2/420: stat f1 0 2024-02-07T12:25:30.365 INFO:tasks.workunit.client.1.smithi138.stdout:2/421: creat d3/d4e/f99 x:0 0 0 2024-02-07T12:25:30.365 INFO:tasks.workunit.client.1.smithi138.stdout:2/422: dread d3/dd/d19/d1f/f5d [0,4194304] 0 2024-02-07T12:25:30.366 INFO:tasks.workunit.client.1.smithi138.stdout:2/423: mknod d3/c9a 0 2024-02-07T12:25:30.368 INFO:tasks.workunit.client.1.smithi138.stdout:2/424: mknod d3/dd/d14/d8f/d73/d80/c9b 0 2024-02-07T12:25:30.369 INFO:tasks.workunit.client.1.smithi138.stdout:2/425: creat d3/dd/f9c x:0 0 0 2024-02-07T12:25:30.371 INFO:tasks.workunit.client.1.smithi138.stdout:2/426: rename d3/dd/d19/d1f/c39 to d3/dd/d14/d49/d29/c9d 0 2024-02-07T12:25:30.373 INFO:tasks.workunit.client.1.smithi138.stdout:2/427: creat d3/dd/d14/d49/d29/d5b/f9e x:0 0 0 2024-02-07T12:25:30.373 INFO:tasks.workunit.client.1.smithi138.stdout:2/428: readlink d3/dd/d19/l8 0 2024-02-07T12:25:30.373 INFO:tasks.workunit.client.1.smithi138.stdout:2/429: readlink d3/dd/d19/l8 0 2024-02-07T12:25:30.374 INFO:tasks.workunit.client.1.smithi138.stdout:2/430: read d3/dd/d14/d49/d25/d3d/f52 [315781,22586] 0 2024-02-07T12:25:30.376 INFO:tasks.workunit.client.1.smithi138.stdout:2/431: rename d3/dd/d19/d44/l4a to d3/dd/d19/d1f/d46/d71/l9f 0 2024-02-07T12:25:30.379 INFO:tasks.workunit.client.1.smithi138.stdout:2/432: unlink d3/dd/d14/d49/d25/d3d/d5f/c76 0 2024-02-07T12:25:30.380 INFO:tasks.workunit.client.1.smithi138.stdout:2/433: fdatasync d3/dd/d14/d49/d25/d3d/f52 0 2024-02-07T12:25:30.380 INFO:tasks.workunit.client.1.smithi138.stdout:2/434: read d3/dd/d19/d44/f69 [2072371,42159] 0 2024-02-07T12:25:30.392 INFO:tasks.workunit.client.1.smithi138.stdout:8/463: getdents d1/de/d11/d17/d3e/d89 0 2024-02-07T12:25:30.393 INFO:tasks.workunit.client.1.smithi138.stdout:8/464: mknod d1/de/d11/d17/d3e/d89/c92 0 2024-02-07T12:25:30.394 INFO:tasks.workunit.client.1.smithi138.stdout:8/465: write d1/de/d11/d17/d2e/d49/d4c/d57/f6a [767999,20507] 0 2024-02-07T12:25:30.394 INFO:tasks.workunit.client.1.smithi138.stdout:8/466: fdatasync d1/de/d11/d17/f2d 0 2024-02-07T12:25:30.394 INFO:tasks.workunit.client.1.smithi138.stdout:6/327: dread dc/d13/d1e/d35/f4c [0,4194304] 0 2024-02-07T12:25:30.396 INFO:tasks.workunit.client.1.smithi138.stdout:8/467: mknod d1/de/d11/d17/d2e/d49/c93 0 2024-02-07T12:25:30.398 INFO:tasks.workunit.client.1.smithi138.stdout:8/468: symlink d1/de/d11/d17/d2e/d49/l94 0 2024-02-07T12:25:30.399 INFO:tasks.workunit.client.1.smithi138.stdout:8/469: mkdir d1/de/d11/d17/d3e/d72/d95 0 2024-02-07T12:25:30.404 INFO:tasks.workunit.client.1.smithi138.stdout:0/358: dwrite d4/d9/de/d1d/d21/f43 [0,4194304] 0 2024-02-07T12:25:30.404 INFO:tasks.workunit.client.1.smithi138.stdout:0/359: read - d4/d9/de/d1d/d21/f62 zero size 2024-02-07T12:25:30.405 INFO:tasks.workunit.client.1.smithi138.stdout:7/469: dwrite d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:30.405 INFO:tasks.workunit.client.1.smithi138.stdout:4/254: dwrite d20/d47/f4b [0,4194304] 0 2024-02-07T12:25:30.405 INFO:tasks.workunit.client.1.smithi138.stdout:4/255: readlink d20/l42 0 2024-02-07T12:25:30.406 INFO:tasks.workunit.client.1.smithi138.stdout:3/437: dwrite d5/d26/d28/f4d [0,4194304] 0 2024-02-07T12:25:30.409 INFO:tasks.workunit.client.1.smithi138.stdout:7/470: mknod d0/d8/c99 0 2024-02-07T12:25:30.415 INFO:tasks.workunit.client.1.smithi138.stdout:3/438: mkdir d5/d26/d9d 0 2024-02-07T12:25:30.416 INFO:tasks.workunit.client.1.smithi138.stdout:7/471: dread d0/f8b [0,4194304] 0 2024-02-07T12:25:30.416 INFO:tasks.workunit.client.1.smithi138.stdout:7/472: truncate d0/d8/d11/f79 269145 0 2024-02-07T12:25:30.420 INFO:tasks.workunit.client.1.smithi138.stdout:7/473: unlink d0/d8/d11/d5f/d86/f8e 0 2024-02-07T12:25:30.424 INFO:tasks.workunit.client.1.smithi138.stdout:7/474: dread d0/f6c [0,4194304] 0 2024-02-07T12:25:30.424 INFO:tasks.workunit.client.1.smithi138.stdout:7/475: write d0/d8/d11/d5f/f95 [227008,87763] 0 2024-02-07T12:25:30.432 INFO:tasks.workunit.client.1.smithi138.stdout:8/470: dwrite d1/de/ff [0,4194304] 0 2024-02-07T12:25:30.433 INFO:tasks.workunit.client.1.smithi138.stdout:6/328: dwrite dc/d13/d1e/d24/f2c [0,4194304] 0 2024-02-07T12:25:30.433 INFO:tasks.workunit.client.1.smithi138.stdout:0/360: dwrite d4/d9/db/f20 [0,4194304] 0 2024-02-07T12:25:30.434 INFO:tasks.workunit.client.1.smithi138.stdout:0/361: chown d4/d9/de/l23 24 1 2024-02-07T12:25:30.434 INFO:tasks.workunit.client.1.smithi138.stdout:8/471: mkdir d1/de/d11/d96 0 2024-02-07T12:25:30.436 INFO:tasks.workunit.client.1.smithi138.stdout:4/256: dwrite d20/f24 [0,4194304] 0 2024-02-07T12:25:30.438 INFO:tasks.workunit.client.1.smithi138.stdout:0/362: mkdir d4/d9/d75 0 2024-02-07T12:25:30.441 INFO:tasks.workunit.client.1.smithi138.stdout:4/257: mknod d20/c52 0 2024-02-07T12:25:30.443 INFO:tasks.workunit.client.1.smithi138.stdout:4/258: rmdir d20/d4d 39 2024-02-07T12:25:30.445 INFO:tasks.workunit.client.1.smithi138.stdout:4/259: mkdir d20/d53 0 2024-02-07T12:25:30.449 INFO:tasks.workunit.client.1.smithi138.stdout:6/329: rename dc/d31/d3f/d55 to dc/d69 0 2024-02-07T12:25:30.449 INFO:tasks.workunit.client.1.smithi138.stdout:6/330: fdatasync dc/d13/f1b 0 2024-02-07T12:25:30.452 INFO:tasks.workunit.client.1.smithi138.stdout:0/363: write d4/d9/f40 [3503192,6790] 0 2024-02-07T12:25:30.453 INFO:tasks.workunit.client.1.smithi138.stdout:0/364: write d4/d52/f44 [620019,49156] 0 2024-02-07T12:25:30.453 INFO:tasks.workunit.client.1.smithi138.stdout:0/365: stat d4/d9/de/d1d/c61 0 2024-02-07T12:25:30.453 INFO:tasks.workunit.client.1.smithi138.stdout:0/366: mkdir d4/d9/db/d71/d76 0 2024-02-07T12:25:30.456 INFO:tasks.workunit.client.1.smithi138.stdout:0/367: rename d4/d9/db/d71/d76 to d4/d9/de/d1d/d77 0 2024-02-07T12:25:30.463 INFO:tasks.workunit.client.1.smithi138.stdout:7/476: dwrite d0/d8/d11/d5f/f95 [0,4194304] 0 2024-02-07T12:25:30.465 INFO:tasks.workunit.client.1.smithi138.stdout:8/472: dwrite d1/de/d11/d17/f24 [4194304,4194304] 0 2024-02-07T12:25:30.465 INFO:tasks.workunit.client.1.smithi138.stdout:3/439: dwrite d5/d26/f3c [0,4194304] 0 2024-02-07T12:25:30.466 INFO:tasks.workunit.client.1.smithi138.stdout:6/331: dwrite dc/d13/d1e/f30 [4194304,4194304] 0 2024-02-07T12:25:30.467 INFO:tasks.workunit.client.1.smithi138.stdout:4/260: dwrite fd [0,4194304] 0 2024-02-07T12:25:30.467 INFO:tasks.workunit.client.1.smithi138.stdout:4/261: chown lf 18369589 1 2024-02-07T12:25:30.469 INFO:tasks.workunit.client.1.smithi138.stdout:7/477: dread d0/f74 [0,4194304] 0 2024-02-07T12:25:30.469 INFO:tasks.workunit.client.1.smithi138.stdout:7/478: dread - d0/d6/d19/d4e/f91 zero size 2024-02-07T12:25:30.470 INFO:tasks.workunit.client.1.smithi138.stdout:7/479: truncate d0/d6/d19/d4e/f91 421491 0 2024-02-07T12:25:30.475 INFO:tasks.workunit.client.1.smithi138.stdout:8/473: dread d1/de/d11/f30 [0,4194304] 0 2024-02-07T12:25:30.475 INFO:tasks.workunit.client.1.smithi138.stdout:8/474: truncate d1/de/d11/d17/d2e/f52 614329 0 2024-02-07T12:25:30.478 INFO:tasks.workunit.client.1.smithi138.stdout:6/332: write dc/d13/d1e/f30 [7845293,24642] 0 2024-02-07T12:25:30.478 INFO:tasks.workunit.client.1.smithi138.stdout:6/333: fdatasync dc/d13/d1e/d24/f2c 0 2024-02-07T12:25:30.478 INFO:tasks.workunit.client.1.smithi138.stdout:3/440: read d5/d26/d28/f4d [1328313,16264] 0 2024-02-07T12:25:30.478 INFO:tasks.workunit.client.1.smithi138.stdout:3/441: dread - d5/d34/d79/f7a zero size 2024-02-07T12:25:30.480 INFO:tasks.workunit.client.1.smithi138.stdout:7/480: dread d0/d6/d76/d93/f57 [0,4194304] 0 2024-02-07T12:25:30.480 INFO:tasks.workunit.client.1.smithi138.stdout:7/481: truncate d0/d6/f4d 561107 0 2024-02-07T12:25:30.483 INFO:tasks.workunit.client.1.smithi138.stdout:4/262: dwrite d20/d34/f4a [0,4194304] 0 2024-02-07T12:25:30.489 INFO:tasks.workunit.client.1.smithi138.stdout:0/368: rmdir d4/d9/db 39 2024-02-07T12:25:30.493 INFO:tasks.workunit.client.1.smithi138.stdout:6/334: rename dc/l1c to dc/d31/d54/l6a 0 2024-02-07T12:25:30.493 INFO:tasks.workunit.client.1.smithi138.stdout:6/335: write dc/d31/d3f/f52 [51036,86990] 0 2024-02-07T12:25:30.495 INFO:tasks.workunit.client.1.smithi138.stdout:7/482: getdents d0/d6/d76/d93 0 2024-02-07T12:25:30.496 INFO:tasks.workunit.client.1.smithi138.stdout:0/369: write d4/d9/de/d1d/d21/f43 [2713340,68264] 0 2024-02-07T12:25:30.496 INFO:tasks.workunit.client.1.smithi138.stdout:0/370: creat d4/d9/d37/d3d/f78 x:0 0 0 2024-02-07T12:25:30.496 INFO:tasks.workunit.client.1.smithi138.stdout:7/483: read d0/d8/d11/d5f/d86/f92 [334114,128140] 0 2024-02-07T12:25:30.496 INFO:tasks.workunit.client.1.smithi138.stdout:7/484: fdatasync d0/d6/d19/f5d 0 2024-02-07T12:25:30.499 INFO:tasks.workunit.client.1.smithi138.stdout:4/263: rmdir d20/d4d/d51 0 2024-02-07T12:25:30.501 INFO:tasks.workunit.client.1.smithi138.stdout:3/442: rename d5/d26/d4e/f7e to d5/d26/d28/f9e 0 2024-02-07T12:25:30.501 INFO:tasks.workunit.client.1.smithi138.stdout:3/443: fdatasync d5/d34/d79/f89 0 2024-02-07T12:25:30.502 INFO:tasks.workunit.client.1.smithi138.stdout:6/336: getdents dc/d69 0 2024-02-07T12:25:30.503 INFO:tasks.workunit.client.1.smithi138.stdout:6/337: write dc/d31/f3e [1633472,79273] 0 2024-02-07T12:25:30.506 INFO:tasks.workunit.client.1.smithi138.stdout:0/371: truncate d4/d9/de/d1d/f54 3979776 0 2024-02-07T12:25:30.506 INFO:tasks.workunit.client.1.smithi138.stdout:4/264: write d20/d34/d36/f44 [4053456,129942] 0 2024-02-07T12:25:30.506 INFO:tasks.workunit.client.1.smithi138.stdout:4/265: creat d20/f54 x:0 0 0 2024-02-07T12:25:30.507 INFO:tasks.workunit.client.1.smithi138.stdout:7/485: creat d0/d8/d11/d26/f9a x:0 0 0 2024-02-07T12:25:30.507 INFO:tasks.workunit.client.1.smithi138.stdout:7/486: creat d0/d8/d11/d1f/f9b x:0 0 0 2024-02-07T12:25:30.510 INFO:tasks.workunit.client.1.smithi138.stdout:8/475: rename d1/de/d11/d17/d2e/d49/d4c/d62/f73 to d1/de/d11/d17/d58/f97 0 2024-02-07T12:25:30.513 INFO:tasks.workunit.client.1.smithi138.stdout:0/372: symlink d4/d9/d37/l79 0 2024-02-07T12:25:30.513 INFO:tasks.workunit.client.1.smithi138.stdout:0/373: chown d4/d52/d3f/l5a 1420180 1 2024-02-07T12:25:30.516 INFO:tasks.workunit.client.1.smithi138.stdout:4/266: rmdir d20/d34 39 2024-02-07T12:25:30.516 INFO:tasks.workunit.client.1.smithi138.stdout:4/267: dread - f1a zero size 2024-02-07T12:25:30.516 INFO:tasks.workunit.client.1.smithi138.stdout:3/444: dwrite d5/d27/d35/f66 [0,4194304] 0 2024-02-07T12:25:30.516 INFO:tasks.workunit.client.1.smithi138.stdout:3/445: fsync d5/fd 0 2024-02-07T12:25:30.517 INFO:tasks.workunit.client.1.smithi138.stdout:7/487: read d0/d8/d11/d26/f49 [3586447,127644] 0 2024-02-07T12:25:30.517 INFO:tasks.workunit.client.1.smithi138.stdout:8/476: write d1/de/d11/d17/d2e/d49/f39 [2768369,88741] 0 2024-02-07T12:25:30.519 INFO:tasks.workunit.client.1.smithi138.stdout:7/488: dread d0/d8/d11/d26/d90/f37 [0,4194304] 0 2024-02-07T12:25:30.519 INFO:tasks.workunit.client.1.smithi138.stdout:7/489: creat d0/d39/f9c x:0 0 0 2024-02-07T12:25:30.519 INFO:tasks.workunit.client.1.smithi138.stdout:7/490: write d0/d8/d11/d63/f89 [460809,86789] 0 2024-02-07T12:25:30.519 INFO:tasks.workunit.client.1.smithi138.stdout:6/338: rmdir dc/d13 39 2024-02-07T12:25:30.519 INFO:tasks.workunit.client.1.smithi138.stdout:6/339: chown dc/d13/d1e/d4d/l5a 32105 1 2024-02-07T12:25:30.520 INFO:tasks.workunit.client.1.smithi138.stdout:8/477: dread d1/de/d11/d17/d2e/d49/d4c/d62/f68 [0,4194304] 0 2024-02-07T12:25:30.520 INFO:tasks.workunit.client.1.smithi138.stdout:8/478: fsync d1/de/d11/d17/d2e/d49/f56 0 2024-02-07T12:25:30.521 INFO:tasks.workunit.client.1.smithi138.stdout:0/374: symlink d4/d9/de/d1d/l7a 0 2024-02-07T12:25:30.522 INFO:tasks.workunit.client.1.smithi138.stdout:4/268: mkdir d20/d34/d36/d55 0 2024-02-07T12:25:30.522 INFO:tasks.workunit.client.1.smithi138.stdout:4/269: fdatasync f15 0 2024-02-07T12:25:30.523 INFO:tasks.workunit.client.1.smithi138.stdout:8/479: dread d1/de/d11/d17/d2e/d49/d4c/d57/f7d [0,4194304] 0 2024-02-07T12:25:30.528 INFO:tasks.workunit.client.1.smithi138.stdout:0/375: fsync d4/d9/de/d1d/d21/f31 0 2024-02-07T12:25:30.529 INFO:tasks.workunit.client.1.smithi138.stdout:8/480: dread d1/de/d11/d17/d3e/f4e [0,4194304] 0 2024-02-07T12:25:30.530 INFO:tasks.workunit.client.1.smithi138.stdout:7/491: unlink d0/d6/d1d/c3a 0 2024-02-07T12:25:30.530 INFO:tasks.workunit.client.1.smithi138.stdout:7/492: chown d0/d6/d76/d93/f7f 45024464 1 2024-02-07T12:25:30.532 INFO:tasks.workunit.client.1.smithi138.stdout:4/270: symlink d20/d53/l56 0 2024-02-07T12:25:30.534 INFO:tasks.workunit.client.1.smithi138.stdout:8/481: creat d1/de/d11/d17/d2e/d3a/f98 x:0 0 0 2024-02-07T12:25:30.543 INFO:tasks.workunit.client.1.smithi138.stdout:0/376: write d4/d9/f12 [3430654,30615] 0 2024-02-07T12:25:30.545 INFO:tasks.workunit.client.1.smithi138.stdout:8/482: dread d1/de/f53 [0,4194304] 0 2024-02-07T12:25:30.545 INFO:tasks.workunit.client.1.smithi138.stdout:8/483: stat d1/de/d11/d17/d58 0 2024-02-07T12:25:30.545 INFO:tasks.workunit.client.1.smithi138.stdout:8/484: write d1/de/d11/d17/d2e/d49/d4c/d57/f7d [1026277,107274] 0 2024-02-07T12:25:30.545 INFO:tasks.workunit.client.1.smithi138.stdout:0/377: getdents d4 0 2024-02-07T12:25:30.548 INFO:tasks.workunit.client.1.smithi138.stdout:0/378: rename d4/l7 to d4/d9/l7b 0 2024-02-07T12:25:30.551 INFO:tasks.workunit.client.1.smithi138.stdout:0/379: creat d4/d9/db/d71/f7c x:0 0 0 2024-02-07T12:25:30.551 INFO:tasks.workunit.client.1.smithi138.stdout:0/380: fsync d4/d9/d37/d3d/f78 0 2024-02-07T12:25:30.551 INFO:tasks.workunit.client.1.smithi138.stdout:0/381: truncate d4/d9/de/d1d/f36 891917 0 2024-02-07T12:25:30.551 INFO:tasks.workunit.client.1.smithi138.stdout:0/382: chown d4/d9/db/l29 4469 1 2024-02-07T12:25:30.552 INFO:tasks.workunit.client.1.smithi138.stdout:0/383: truncate d4/f4d 484470 0 2024-02-07T12:25:30.553 INFO:tasks.workunit.client.1.smithi138.stdout:0/384: chown d4/d9/de/d1d 1864063 1 2024-02-07T12:25:30.553 INFO:tasks.workunit.client.1.smithi138.stdout:4/271: dwrite d20/f2e [0,4194304] 0 2024-02-07T12:25:30.553 INFO:tasks.workunit.client.1.smithi138.stdout:3/446: dwrite d5/d26/d4e/f58 [0,4194304] 0 2024-02-07T12:25:30.553 INFO:tasks.workunit.client.1.smithi138.stdout:3/447: chown d5/d27/d35/f66 510232 1 2024-02-07T12:25:30.553 INFO:tasks.workunit.client.1.smithi138.stdout:6/340: dwrite dc/d31/f47 [0,4194304] 0 2024-02-07T12:25:30.554 INFO:tasks.workunit.client.1.smithi138.stdout:7/493: dwrite d0/d8/d11/f6d [0,4194304] 0 2024-02-07T12:25:30.554 INFO:tasks.workunit.client.1.smithi138.stdout:7/494: creat d0/d8/d11/d5f/d86/f9d x:0 0 0 2024-02-07T12:25:30.555 INFO:tasks.workunit.client.1.smithi138.stdout:4/272: creat d20/d34/d36/d55/f57 x:0 0 0 2024-02-07T12:25:30.555 INFO:tasks.workunit.client.1.smithi138.stdout:4/273: dread - d20/f33 zero size 2024-02-07T12:25:30.556 INFO:tasks.workunit.client.1.smithi138.stdout:4/274: creat d20/d34/d36/d55/f58 x:0 0 0 2024-02-07T12:25:30.562 INFO:tasks.workunit.client.1.smithi138.stdout:0/385: dread d4/d9/de/d1d/f54 [0,4194304] 0 2024-02-07T12:25:30.562 INFO:tasks.workunit.client.1.smithi138.stdout:0/386: read d4/d9/db/f15 [127394,107023] 0 2024-02-07T12:25:30.563 INFO:tasks.workunit.client.1.smithi138.stdout:8/485: dwrite d1/de/d11/d17/d2e/d49/f76 [0,4194304] 0 2024-02-07T12:25:30.568 INFO:tasks.workunit.client.1.smithi138.stdout:3/448: dwrite d5/d27/f71 [0,4194304] 0 2024-02-07T12:25:30.573 INFO:tasks.workunit.client.1.smithi138.stdout:6/341: symlink dc/d13/l6b 0 2024-02-07T12:25:30.577 INFO:tasks.workunit.client.1.smithi138.stdout:7/495: creat d0/d8/d11/d26/d90/f9e x:0 0 0 2024-02-07T12:25:30.583 INFO:tasks.workunit.client.1.smithi138.stdout:3/449: symlink d5/d26/d4e/l9f 0 2024-02-07T12:25:30.583 INFO:tasks.workunit.client.1.smithi138.stdout:3/450: chown d5/d27/f88 326030 1 2024-02-07T12:25:30.583 INFO:tasks.workunit.client.1.smithi138.stdout:6/342: truncate dc/d13/d1e/d35/f4c 3284315 0 2024-02-07T12:25:30.585 INFO:tasks.workunit.client.1.smithi138.stdout:7/496: symlink d0/d8/d11/d5f/l9f 0 2024-02-07T12:25:30.585 INFO:tasks.workunit.client.1.smithi138.stdout:7/497: write d0/d8/d15/f47 [4196767,79464] 0 2024-02-07T12:25:30.585 INFO:tasks.workunit.client.1.smithi138.stdout:7/498: chown d0/d8 3 1 2024-02-07T12:25:30.586 INFO:tasks.workunit.client.1.smithi138.stdout:9/287: sync 2024-02-07T12:25:30.586 INFO:tasks.workunit.client.1.smithi138.stdout:9/288: fdatasync d0/d6/d8/d1d/dd/f20 0 2024-02-07T12:25:30.586 INFO:tasks.workunit.client.1.smithi138.stdout:1/269: sync 2024-02-07T12:25:30.586 INFO:tasks.workunit.client.1.smithi138.stdout:2/435: sync 2024-02-07T12:25:30.586 INFO:tasks.workunit.client.1.smithi138.stdout:5/335: sync 2024-02-07T12:25:30.587 INFO:tasks.workunit.client.1.smithi138.stdout:4/275: getdents d20 0 2024-02-07T12:25:30.587 INFO:tasks.workunit.client.1.smithi138.stdout:4/276: fdatasync f1c 0 2024-02-07T12:25:30.588 INFO:tasks.workunit.client.1.smithi138.stdout:6/343: dread dc/d31/d3f/f52 [0,4194304] 0 2024-02-07T12:25:30.589 INFO:tasks.workunit.client.1.smithi138.stdout:0/387: rmdir d4/d9/d37/d3d 39 2024-02-07T12:25:30.590 INFO:tasks.workunit.client.1.smithi138.stdout:3/451: write d5/d26/f60 [321742,41282] 0 2024-02-07T12:25:30.590 INFO:tasks.workunit.client.1.smithi138.stdout:3/452: chown d5/d27/d35/f50 1 1 2024-02-07T12:25:30.590 INFO:tasks.workunit.client.1.smithi138.stdout:3/453: fsync d5/d15/f41 0 2024-02-07T12:25:30.590 INFO:tasks.workunit.client.1.smithi138.stdout:8/486: dwrite d1/de/d11/d17/d2e/d3a/d50/f5c [0,4194304] 0 2024-02-07T12:25:30.590 INFO:tasks.workunit.client.1.smithi138.stdout:3/454: creat d5/d34/fa0 x:0 0 0 2024-02-07T12:25:30.591 INFO:tasks.workunit.client.1.smithi138.stdout:7/499: mknod d0/d6/d73/ca0 0 2024-02-07T12:25:30.591 INFO:tasks.workunit.client.1.smithi138.stdout:9/289: symlink d0/d34/l62 0 2024-02-07T12:25:30.591 INFO:tasks.workunit.client.1.smithi138.stdout:1/270: mkdir d5/d5b 0 2024-02-07T12:25:30.594 INFO:tasks.workunit.client.1.smithi138.stdout:2/436: link d3/dd/d14/d49/f98 d3/d4e/fa0 0 2024-02-07T12:25:30.594 INFO:tasks.workunit.client.1.smithi138.stdout:2/437: truncate d3/f12 1372070 0 2024-02-07T12:25:30.595 INFO:tasks.workunit.client.1.smithi138.stdout:5/336: unlink da/df/d27/f60 0 2024-02-07T12:25:30.597 INFO:tasks.workunit.client.1.smithi138.stdout:4/277: mkdir d20/d34/d59 0 2024-02-07T12:25:30.597 INFO:tasks.workunit.client.1.smithi138.stdout:4/278: write d20/f54 [323197,11913] 0 2024-02-07T12:25:30.598 INFO:tasks.workunit.client.1.smithi138.stdout:4/279: chown f15 5504209 1 2024-02-07T12:25:30.598 INFO:tasks.workunit.client.1.smithi138.stdout:9/290: dread d0/d6/d8/d1d/f61 [0,4194304] 0 2024-02-07T12:25:30.598 INFO:tasks.workunit.client.1.smithi138.stdout:9/291: readlink d0/d6/d8/d1d/l54 0 2024-02-07T12:25:30.598 INFO:tasks.workunit.client.1.smithi138.stdout:6/344: symlink dc/d13/d1e/d35/l6c 0 2024-02-07T12:25:30.601 INFO:tasks.workunit.client.1.smithi138.stdout:3/455: mkdir d5/d15/d32/da1 0 2024-02-07T12:25:30.603 INFO:tasks.workunit.client.1.smithi138.stdout:7/500: mknod d0/d8/d11/d5f/d86/ca1 0 2024-02-07T12:25:30.603 INFO:tasks.workunit.client.1.smithi138.stdout:0/388: write d4/f6 [1775909,76956] 0 2024-02-07T12:25:30.604 INFO:tasks.workunit.client.1.smithi138.stdout:1/271: write d5/d8/da/d15/f24 [8000460,38570] 0 2024-02-07T12:25:30.604 INFO:tasks.workunit.client.1.smithi138.stdout:1/272: chown d5/d8/da/d1f/f25 31 1 2024-02-07T12:25:30.605 INFO:tasks.workunit.client.1.smithi138.stdout:9/292: creat d0/d6/d8/d1d/dd/f63 x:0 0 0 2024-02-07T12:25:30.608 INFO:tasks.workunit.client.1.smithi138.stdout:6/345: mkdir dc/d13/d1e/d35/d6d 0 2024-02-07T12:25:30.610 INFO:tasks.workunit.client.1.smithi138.stdout:0/389: link d4/d9/d37/d3d/f78 d4/d9/de/f7d 0 2024-02-07T12:25:30.611 INFO:tasks.workunit.client.1.smithi138.stdout:7/501: fdatasync d0/d8/d15/f47 0 2024-02-07T12:25:30.611 INFO:tasks.workunit.client.1.smithi138.stdout:7/502: write d0/d8/d11/d1f/f77 [243612,120815] 0 2024-02-07T12:25:30.611 INFO:tasks.workunit.client.1.smithi138.stdout:7/503: write d0/d6/d3e/f3f [2009601,39601] 0 2024-02-07T12:25:30.611 INFO:tasks.workunit.client.1.smithi138.stdout:7/504: write d0/d8/d11/d1f/f77 [1063872,12684] 0 2024-02-07T12:25:30.612 INFO:tasks.workunit.client.1.smithi138.stdout:8/487: dwrite d1/f85 [0,4194304] 0 2024-02-07T12:25:30.612 INFO:tasks.workunit.client.1.smithi138.stdout:8/488: fdatasync d1/de/d11/f31 0 2024-02-07T12:25:30.612 INFO:tasks.workunit.client.1.smithi138.stdout:8/489: write d1/de/d11/f7b [333214,44618] 0 2024-02-07T12:25:30.613 INFO:tasks.workunit.client.1.smithi138.stdout:3/456: write f1 [1148823,27679] 0 2024-02-07T12:25:30.613 INFO:tasks.workunit.client.1.smithi138.stdout:8/490: write d1/de/d11/f31 [413297,116517] 0 2024-02-07T12:25:30.614 INFO:tasks.workunit.client.1.smithi138.stdout:1/273: write d5/f1e [2273626,9415] 0 2024-02-07T12:25:30.615 INFO:tasks.workunit.client.1.smithi138.stdout:6/346: dread dc/d13/f39 [0,4194304] 0 2024-02-07T12:25:30.616 INFO:tasks.workunit.client.1.smithi138.stdout:5/337: dwrite da/df/f5a [0,4194304] 0 2024-02-07T12:25:30.616 INFO:tasks.workunit.client.1.smithi138.stdout:5/338: write da/f29 [2675032,48374] 0 2024-02-07T12:25:30.619 INFO:tasks.workunit.client.1.smithi138.stdout:4/280: dwrite d20/f25 [0,4194304] 0 2024-02-07T12:25:30.620 INFO:tasks.workunit.client.1.smithi138.stdout:2/438: rmdir d3 39 2024-02-07T12:25:30.622 INFO:tasks.workunit.client.1.smithi138.stdout:9/293: mkdir d0/d6/d64 0 2024-02-07T12:25:30.624 INFO:tasks.workunit.client.1.smithi138.stdout:0/390: mknod d4/d9/d33/c7e 0 2024-02-07T12:25:30.625 INFO:tasks.workunit.client.1.smithi138.stdout:6/347: read dc/f1f [4184984,119500] 0 2024-02-07T12:25:30.625 INFO:tasks.workunit.client.1.smithi138.stdout:7/505: symlink d0/d6/d19/d4e/la2 0 2024-02-07T12:25:30.631 INFO:tasks.workunit.client.1.smithi138.stdout:3/457: rename d5/d15/d32/l44 to d5/d26/d5e/d86/la2 0 2024-02-07T12:25:30.631 INFO:tasks.workunit.client.1.smithi138.stdout:3/458: truncate d5/d26/d5e/f6e 2167 0 2024-02-07T12:25:30.631 INFO:tasks.workunit.client.1.smithi138.stdout:8/491: truncate d1/de/d11/d17/d2e/d49/f8 3637085 0 2024-02-07T12:25:30.635 INFO:tasks.workunit.client.1.smithi138.stdout:0/391: dread d4/d9/de/d1d/d21/f59 [0,4194304] 0 2024-02-07T12:25:30.635 INFO:tasks.workunit.client.1.smithi138.stdout:0/392: chown d4/d9/f12 49 1 2024-02-07T12:25:30.635 INFO:tasks.workunit.client.1.smithi138.stdout:5/339: mkdir da/df/d27/d2e/d4f/d2b/d35/d67 0 2024-02-07T12:25:30.635 INFO:tasks.workunit.client.1.smithi138.stdout:1/274: mkdir d5/d5c 0 2024-02-07T12:25:30.635 INFO:tasks.workunit.client.1.smithi138.stdout:6/348: rename dc/d31/f3e to dc/d13/d1e/d35/d6d/f6e 0 2024-02-07T12:25:30.636 INFO:tasks.workunit.client.1.smithi138.stdout:1/275: creat d5/d4b/f5d x:0 0 0 2024-02-07T12:25:30.637 INFO:tasks.workunit.client.1.smithi138.stdout:6/349: truncate dc/d13/f1a 1366639 0 2024-02-07T12:25:30.637 INFO:tasks.workunit.client.1.smithi138.stdout:6/350: readlink dc/d13/d1e/d24/l44 0 2024-02-07T12:25:30.637 INFO:tasks.workunit.client.1.smithi138.stdout:3/459: mknod d5/d26/d90/ca3 0 2024-02-07T12:25:30.639 INFO:tasks.workunit.client.1.smithi138.stdout:7/506: rename d0/d6/c59 to d0/d6/d19/d4e/ca3 0 2024-02-07T12:25:30.640 INFO:tasks.workunit.client.1.smithi138.stdout:5/340: dread da/df/d27/d2e/f2f [0,4194304] 0 2024-02-07T12:25:30.641 INFO:tasks.workunit.client.1.smithi138.stdout:1/276: unlink d5/d8/da/d15/l19 0 2024-02-07T12:25:30.642 INFO:tasks.workunit.client.1.smithi138.stdout:6/351: creat dc/d13/d1e/d4d/f6f x:0 0 0 2024-02-07T12:25:30.645 INFO:tasks.workunit.client.1.smithi138.stdout:7/507: rename d0/f7e to d0/d39/fa4 0 2024-02-07T12:25:30.646 INFO:tasks.workunit.client.1.smithi138.stdout:5/341: mknod da/df/d27/d2e/c68 0 2024-02-07T12:25:30.647 INFO:tasks.workunit.client.1.smithi138.stdout:6/352: mknod dc/d13/d1e/d24/c70 0 2024-02-07T12:25:30.647 INFO:tasks.workunit.client.1.smithi138.stdout:6/353: chown ca 7443 1 2024-02-07T12:25:30.647 INFO:tasks.workunit.client.1.smithi138.stdout:7/508: creat d0/d6/d76/fa5 x:0 0 0 2024-02-07T12:25:30.649 INFO:tasks.workunit.client.1.smithi138.stdout:0/393: dread d4/f5 [0,4194304] 0 2024-02-07T12:25:30.650 INFO:tasks.workunit.client.1.smithi138.stdout:5/342: rename da/df/d58 to da/d43/d4a/d69 0 2024-02-07T12:25:30.650 INFO:tasks.workunit.client.1.smithi138.stdout:5/343: readlink l7 0 2024-02-07T12:25:30.650 INFO:tasks.workunit.client.1.smithi138.stdout:7/509: mkdir d0/d8/d11/d26/d90/d98/da6 0 2024-02-07T12:25:30.651 INFO:tasks.workunit.client.1.smithi138.stdout:5/344: mknod da/df/d27/d2e/d4f/d2b/d35/d5d/c6a 0 2024-02-07T12:25:30.654 INFO:tasks.workunit.client.1.smithi138.stdout:5/345: creat da/df/f6b x:0 0 0 2024-02-07T12:25:30.654 INFO:tasks.workunit.client.1.smithi138.stdout:7/510: rmdir d0/d6/d3e 39 2024-02-07T12:25:30.655 INFO:tasks.workunit.client.1.smithi138.stdout:5/346: link da/d43/c4d da/d34/c6c 0 2024-02-07T12:25:30.656 INFO:tasks.workunit.client.1.smithi138.stdout:7/511: mknod d0/d8/d11/d5f/d86/ca7 0 2024-02-07T12:25:30.656 INFO:tasks.workunit.client.1.smithi138.stdout:7/512: write d0/d8/d11/d5f/d86/f9d [41394,126201] 0 2024-02-07T12:25:30.657 INFO:tasks.workunit.client.1.smithi138.stdout:5/347: truncate da/df/f20 1277520 0 2024-02-07T12:25:30.658 INFO:tasks.workunit.client.1.smithi138.stdout:7/513: dread d0/d8/d11/d5f/d86/f92 [0,4194304] 0 2024-02-07T12:25:30.660 INFO:tasks.workunit.client.1.smithi138.stdout:7/514: symlink d0/d8/d11/d5f/d86/la8 0 2024-02-07T12:25:30.660 INFO:tasks.workunit.client.1.smithi138.stdout:7/515: write d0/d8/d11/f79 [753107,121758] 0 2024-02-07T12:25:30.660 INFO:tasks.workunit.client.1.smithi138.stdout:5/348: dread da/df/d27/d2e/d4f/d2b/d35/d40/f45 [0,4194304] 0 2024-02-07T12:25:30.661 INFO:tasks.workunit.client.1.smithi138.stdout:7/516: getdents d0/d6/d73 0 2024-02-07T12:25:30.661 INFO:tasks.workunit.client.1.smithi138.stdout:7/517: creat d0/d6/d76/fa9 x:0 0 0 2024-02-07T12:25:30.661 INFO:tasks.workunit.client.1.smithi138.stdout:7/518: readlink d0/d8/l7b 0 2024-02-07T12:25:30.661 INFO:tasks.workunit.client.1.smithi138.stdout:7/519: write d0/d8/d11/d5f/d86/f92 [1080702,15508] 0 2024-02-07T12:25:30.661 INFO:tasks.workunit.client.1.smithi138.stdout:7/520: truncate d0/f8b 966014 0 2024-02-07T12:25:30.664 INFO:tasks.workunit.client.1.smithi138.stdout:0/394: write d4/d9/db/f5f [307135,30272] 0 2024-02-07T12:25:30.665 INFO:tasks.workunit.client.1.smithi138.stdout:0/395: read d4/d9/de/d1d/f42 [359482,95896] 0 2024-02-07T12:25:30.666 INFO:tasks.workunit.client.1.smithi138.stdout:4/281: dwrite d20/f33 [0,4194304] 0 2024-02-07T12:25:30.666 INFO:tasks.workunit.client.1.smithi138.stdout:4/282: chown d20/c52 1018108477 1 2024-02-07T12:25:30.667 INFO:tasks.workunit.client.1.smithi138.stdout:0/396: getdents d4/d69 0 2024-02-07T12:25:30.667 INFO:tasks.workunit.client.1.smithi138.stdout:0/397: chown d4/d9/d37/d3d/f68 5 1 2024-02-07T12:25:30.667 INFO:tasks.workunit.client.1.smithi138.stdout:0/398: chown d4/d9/db/d71/f7c 5087 1 2024-02-07T12:25:30.667 INFO:tasks.workunit.client.1.smithi138.stdout:0/399: write d4/d9/db/d39/f50 [1507447,122180] 0 2024-02-07T12:25:30.667 INFO:tasks.workunit.client.1.smithi138.stdout:0/400: write d4/d9/de/d1d/f42 [24630,72917] 0 2024-02-07T12:25:30.668 INFO:tasks.workunit.client.1.smithi138.stdout:2/439: dwrite f0 [0,4194304] 0 2024-02-07T12:25:30.668 INFO:tasks.workunit.client.1.smithi138.stdout:8/492: dwrite d1/d8e/f8f [0,4194304] 0 2024-02-07T12:25:30.668 INFO:tasks.workunit.client.1.smithi138.stdout:8/493: chown d1/de/d11/d17/d3e/d72 20 1 2024-02-07T12:25:30.669 INFO:tasks.workunit.client.1.smithi138.stdout:2/440: read d3/dd/d14/f2c [483051,329] 0 2024-02-07T12:25:30.669 INFO:tasks.workunit.client.1.smithi138.stdout:2/441: fsync d3/dd/f2e 0 2024-02-07T12:25:30.669 INFO:tasks.workunit.client.1.smithi138.stdout:2/442: readlink d3/dd/d14/d49/d29/d5b/l93 0 2024-02-07T12:25:30.671 INFO:tasks.workunit.client.1.smithi138.stdout:5/349: dread da/df/d27/f33 [0,4194304] 0 2024-02-07T12:25:30.671 INFO:tasks.workunit.client.1.smithi138.stdout:9/294: dwrite d0/f38 [0,4194304] 0 2024-02-07T12:25:30.672 INFO:tasks.workunit.client.1.smithi138.stdout:4/283: link d20/f3d d20/d4d/f5a 0 2024-02-07T12:25:30.673 INFO:tasks.workunit.client.1.smithi138.stdout:0/401: readlink d4/d52/d3f/l5a 0 2024-02-07T12:25:30.673 INFO:tasks.workunit.client.1.smithi138.stdout:0/402: write d4/d52/f44 [720170,105934] 0 2024-02-07T12:25:30.673 INFO:tasks.workunit.client.1.smithi138.stdout:0/403: getdents d4/d9/d75 0 2024-02-07T12:25:30.673 INFO:tasks.workunit.client.1.smithi138.stdout:0/404: write d4/d9/db/d39/f5c [305097,33306] 0 2024-02-07T12:25:30.676 INFO:tasks.workunit.client.1.smithi138.stdout:4/284: write d20/d34/d36/f3c [3472159,71038] 0 2024-02-07T12:25:30.680 INFO:tasks.workunit.client.1.smithi138.stdout:8/494: rename d1/de/d11/d17/d2e/d49/d4c/d57 to d1/d99 0 2024-02-07T12:25:30.703 INFO:tasks.workunit.client.1.smithi138.stdout:6/354: dwrite dc/fd [0,4194304] 0 2024-02-07T12:25:30.703 INFO:tasks.workunit.client.1.smithi138.stdout:6/355: fsync dc/d31/d38/f64 0 2024-02-07T12:25:30.704 INFO:tasks.workunit.client.1.smithi138.stdout:6/356: fdatasync dc/d13/d1e/d35/f46 0 2024-02-07T12:25:30.706 INFO:tasks.workunit.client.1.smithi138.stdout:9/295: creat d0/d6/d64/f65 x:0 0 0 2024-02-07T12:25:30.712 INFO:tasks.workunit.client.1.smithi138.stdout:4/285: link d20/f31 d20/d34/d36/d55/f5b 0 2024-02-07T12:25:30.713 INFO:tasks.workunit.client.1.smithi138.stdout:7/521: getdents d0/d6/d76 0 2024-02-07T12:25:30.713 INFO:tasks.workunit.client.1.smithi138.stdout:7/522: stat d0/d6/d3e/c58 0 2024-02-07T12:25:30.714 INFO:tasks.workunit.client.1.smithi138.stdout:8/495: getdents d1/d99 0 2024-02-07T12:25:30.716 INFO:tasks.workunit.client.1.smithi138.stdout:2/443: rename d3/dd/d19/d1f/d46/d71/c7a to d3/dd/d14/d82/ca1 0 2024-02-07T12:25:30.719 INFO:tasks.workunit.client.1.smithi138.stdout:7/523: link d0/d8/d15/c6e d0/d8/d15/caa 0 2024-02-07T12:25:30.721 INFO:tasks.workunit.client.1.smithi138.stdout:2/444: creat d3/dd/d19/d1f/fa2 x:0 0 0 2024-02-07T12:25:30.721 INFO:tasks.workunit.client.1.smithi138.stdout:2/445: fsync d3/dd/d14/d8f/f68 0 2024-02-07T12:25:30.728 INFO:tasks.workunit.client.1.smithi138.stdout:4/286: truncate d20/f33 3425358 0 2024-02-07T12:25:30.730 INFO:tasks.workunit.client.1.smithi138.stdout:8/496: dread d1/d8e/f8f [0,4194304] 0 2024-02-07T12:25:30.730 INFO:tasks.workunit.client.1.smithi138.stdout:8/497: fdatasync d1/de/f53 0 2024-02-07T12:25:30.732 INFO:tasks.workunit.client.1.smithi138.stdout:8/498: creat d1/de/d11/d17/d2e/d49/d4c/f9a x:0 0 0 2024-02-07T12:25:30.733 INFO:tasks.workunit.client.1.smithi138.stdout:8/499: rmdir d1/d8b 0 2024-02-07T12:25:30.734 INFO:tasks.workunit.client.1.smithi138.stdout:8/500: mknod d1/de/d11/d17/d3e/d72/c9b 0 2024-02-07T12:25:30.734 INFO:tasks.workunit.client.1.smithi138.stdout:8/501: truncate d1/de/d11/d17/d3e/d72/f88 126345 0 2024-02-07T12:25:30.734 INFO:tasks.workunit.client.1.smithi138.stdout:8/502: readlink d1/de/l1c 0 2024-02-07T12:25:30.735 INFO:tasks.workunit.client.1.smithi138.stdout:8/503: creat d1/de/d11/d17/d58/f9c x:0 0 0 2024-02-07T12:25:30.736 INFO:tasks.workunit.client.1.smithi138.stdout:8/504: link d1/f85 d1/de/d11/d17/d3e/d72/d95/f9d 0 2024-02-07T12:25:30.746 INFO:tasks.workunit.client.1.smithi138.stdout:4/287: dread d20/f25 [0,4194304] 0 2024-02-07T12:25:30.751 INFO:tasks.workunit.client.1.smithi138.stdout:5/350: dwrite da/df/f13 [0,4194304] 0 2024-02-07T12:25:30.751 INFO:tasks.workunit.client.1.smithi138.stdout:6/357: dwrite dc/d31/d54/f5c [0,4194304] 0 2024-02-07T12:25:30.751 INFO:tasks.workunit.client.1.smithi138.stdout:5/351: truncate da/df/d27/d2e/d4f/d2b/d35/f48 585310 0 2024-02-07T12:25:30.752 INFO:tasks.workunit.client.1.smithi138.stdout:4/288: read f13 [1279450,94237] 0 2024-02-07T12:25:30.752 INFO:tasks.workunit.client.1.smithi138.stdout:4/289: read f3 [2339193,40166] 0 2024-02-07T12:25:30.752 INFO:tasks.workunit.client.1.smithi138.stdout:4/290: write f8 [1785043,37165] 0 2024-02-07T12:25:30.756 INFO:tasks.workunit.client.1.smithi138.stdout:5/352: rmdir da/df/d27 39 2024-02-07T12:25:30.757 INFO:tasks.workunit.client.1.smithi138.stdout:5/353: chown da/df/d27/d2e/d4f/d2b/d35 922 1 2024-02-07T12:25:30.758 INFO:tasks.workunit.client.1.smithi138.stdout:5/354: stat da/df/f20 0 2024-02-07T12:25:30.758 INFO:tasks.workunit.client.1.smithi138.stdout:5/355: chown da/df/f4e 459390612 1 2024-02-07T12:25:30.758 INFO:tasks.workunit.client.1.smithi138.stdout:5/356: chown da/d43/d4a/c66 175034922 1 2024-02-07T12:25:30.759 INFO:tasks.workunit.client.1.smithi138.stdout:4/291: write f8 [367846,40810] 0 2024-02-07T12:25:30.762 INFO:tasks.workunit.client.1.smithi138.stdout:9/296: dwrite d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:30.762 INFO:tasks.workunit.client.1.smithi138.stdout:7/524: dwrite d0/d39/f9c [0,4194304] 0 2024-02-07T12:25:30.763 INFO:tasks.workunit.client.1.smithi138.stdout:8/505: dwrite d1/de/d11/d17/d3e/d72/d95/f9d [0,4194304] 0 2024-02-07T12:25:30.763 INFO:tasks.workunit.client.1.smithi138.stdout:2/446: dwrite d3/dd/d14/d49/d29/d5b/f8d [0,4194304] 0 2024-02-07T12:25:30.763 INFO:tasks.workunit.client.1.smithi138.stdout:2/447: truncate d3/dd/d14/d49/f98 385828 0 2024-02-07T12:25:30.764 INFO:tasks.workunit.client.1.smithi138.stdout:9/297: creat d0/d6/d8/f66 x:0 0 0 2024-02-07T12:25:30.764 INFO:tasks.workunit.client.1.smithi138.stdout:9/298: fsync d0/d6/d8/d1d/dd/d25/f5b 0 2024-02-07T12:25:30.769 INFO:tasks.workunit.client.1.smithi138.stdout:7/525: link d0/d8/d11/d26/f9a d0/d6/d19/d4e/fab 0 2024-02-07T12:25:30.782 INFO:tasks.workunit.client.1.smithi138.stdout:5/357: dwrite da/d22/f26 [0,4194304] 0 2024-02-07T12:25:30.784 INFO:tasks.workunit.client.1.smithi138.stdout:2/448: creat d3/dd/d14/d82/fa3 x:0 0 0 2024-02-07T12:25:30.786 INFO:tasks.workunit.client.1.smithi138.stdout:9/299: rename d0/d6/d64/f65 to d0/d6/d8/d1d/dd/d41/d5e/f67 0 2024-02-07T12:25:30.788 INFO:tasks.workunit.client.1.smithi138.stdout:7/526: unlink d0/d8/d11/f5a 0 2024-02-07T12:25:30.790 INFO:tasks.workunit.client.1.smithi138.stdout:4/292: dwrite d20/d34/d36/d55/f57 [0,4194304] 0 2024-02-07T12:25:30.791 INFO:tasks.workunit.client.1.smithi138.stdout:8/506: dwrite d1/f3f [0,4194304] 0 2024-02-07T12:25:30.791 INFO:tasks.workunit.client.1.smithi138.stdout:8/507: creat d1/f9e x:0 0 0 2024-02-07T12:25:30.791 INFO:tasks.workunit.client.1.smithi138.stdout:2/449: mknod d3/dd/d14/d8f/d73/d80/ca4 0 2024-02-07T12:25:30.791 INFO:tasks.workunit.client.1.smithi138.stdout:2/450: truncate d3/dd/d14/d49/d25/d3d/f55 512988 0 2024-02-07T12:25:30.793 INFO:tasks.workunit.client.1.smithi138.stdout:9/300: symlink d0/d34/d45/l68 0 2024-02-07T12:25:30.794 INFO:tasks.workunit.client.1.smithi138.stdout:7/527: mknod d0/cac 0 2024-02-07T12:25:30.800 INFO:tasks.workunit.client.1.smithi138.stdout:4/293: write fd [1605059,111915] 0 2024-02-07T12:25:30.803 INFO:tasks.workunit.client.1.smithi138.stdout:2/451: mkdir d3/dd/d14/d8f/da5 0 2024-02-07T12:25:30.803 INFO:tasks.workunit.client.1.smithi138.stdout:3/460: sync 2024-02-07T12:25:30.803 INFO:tasks.workunit.client.1.smithi138.stdout:3/461: stat d5/d15/f48 0 2024-02-07T12:25:30.803 INFO:tasks.workunit.client.1.smithi138.stdout:3/462: chown d5/d27/d35/l38 13282 1 2024-02-07T12:25:30.804 INFO:tasks.workunit.client.1.smithi138.stdout:7/528: write d0/d8/d11/d5f/f95 [3836552,107741] 0 2024-02-07T12:25:30.804 INFO:tasks.workunit.client.1.smithi138.stdout:7/529: write d0/d8/d11/d1f/f9b [619628,124586] 0 2024-02-07T12:25:30.806 INFO:tasks.workunit.client.1.smithi138.stdout:4/294: symlink d20/d4d/l5c 0 2024-02-07T12:25:30.810 INFO:tasks.workunit.client.1.smithi138.stdout:3/463: rename d5/d15/c76 to d5/d26/d28/ca4 0 2024-02-07T12:25:30.811 INFO:tasks.workunit.client.1.smithi138.stdout:7/530: read d0/d6/d76/d93/f57 [2265042,89474] 0 2024-02-07T12:25:30.811 INFO:tasks.workunit.client.1.smithi138.stdout:5/358: rename da/df to da/d6d 0 2024-02-07T12:25:30.812 INFO:tasks.workunit.client.1.smithi138.stdout:5/359: read da/f15 [1253956,97411] 0 2024-02-07T12:25:30.815 INFO:tasks.workunit.client.1.smithi138.stdout:9/301: dwrite d0/d6/d8/d1d/dd/d41/d5e/f67 [0,4194304] 0 2024-02-07T12:25:30.815 INFO:tasks.workunit.client.1.smithi138.stdout:5/360: symlink da/d43/l6e 0 2024-02-07T12:25:30.816 INFO:tasks.workunit.client.1.smithi138.stdout:3/464: symlink d5/d26/la5 0 2024-02-07T12:25:30.820 INFO:tasks.workunit.client.1.smithi138.stdout:4/295: dread d20/d47/f4b [0,4194304] 0 2024-02-07T12:25:30.822 INFO:tasks.workunit.client.1.smithi138.stdout:5/361: creat da/d43/d4a/d69/f6f x:0 0 0 2024-02-07T12:25:30.823 INFO:tasks.workunit.client.1.smithi138.stdout:4/296: dread f19 [0,4194304] 0 2024-02-07T12:25:30.823 INFO:tasks.workunit.client.1.smithi138.stdout:4/297: write d20/f31 [923944,31891] 0 2024-02-07T12:25:30.823 INFO:tasks.workunit.client.1.smithi138.stdout:3/465: fsync d5/d26/f2c 0 2024-02-07T12:25:30.823 INFO:tasks.workunit.client.1.smithi138.stdout:3/466: creat d5/d26/d4e/fa6 x:0 0 0 2024-02-07T12:25:30.823 INFO:tasks.workunit.client.1.smithi138.stdout:3/467: fsync d5/d15/f6d 0 2024-02-07T12:25:30.823 INFO:tasks.workunit.client.1.smithi138.stdout:3/468: getdents d5/d15/d96 0 2024-02-07T12:25:30.824 INFO:tasks.workunit.client.1.smithi138.stdout:3/469: write d5/d27/d35/f50 [477835,100458] 0 2024-02-07T12:25:30.826 INFO:tasks.workunit.client.1.smithi138.stdout:5/362: creat da/d6d/d27/d2e/d4f/d2b/d35/d5d/f70 x:0 0 0 2024-02-07T12:25:30.826 INFO:tasks.workunit.client.1.smithi138.stdout:8/508: dwrite d1/de/d11/d17/d2e/d49/d4c/f65 [0,4194304] 0 2024-02-07T12:25:30.826 INFO:tasks.workunit.client.1.smithi138.stdout:8/509: write d1/d8e/f91 [21027,13597] 0 2024-02-07T12:25:30.826 INFO:tasks.workunit.client.1.smithi138.stdout:2/452: dwrite d3/dd/d19/d1f/fa2 [0,4194304] 0 2024-02-07T12:25:30.828 INFO:tasks.workunit.client.1.smithi138.stdout:3/470: creat d5/d26/d90/fa7 x:0 0 0 2024-02-07T12:25:30.831 INFO:tasks.workunit.client.1.smithi138.stdout:2/453: symlink d3/dd/d14/d8f/d73/la6 0 2024-02-07T12:25:30.834 INFO:tasks.workunit.client.1.smithi138.stdout:7/531: dwrite d0/d8/d11/d26/f49 [0,4194304] 0 2024-02-07T12:25:30.834 INFO:tasks.workunit.client.1.smithi138.stdout:5/363: rename da/c16 to da/d6d/d27/d2e/c71 0 2024-02-07T12:25:30.834 INFO:tasks.workunit.client.1.smithi138.stdout:5/364: fsync da/f1d 0 2024-02-07T12:25:30.836 INFO:tasks.workunit.client.1.smithi138.stdout:4/298: read d20/f2e [2136104,6475] 0 2024-02-07T12:25:30.836 INFO:tasks.workunit.client.1.smithi138.stdout:2/454: mknod d3/dd/d14/d8f/ca7 0 2024-02-07T12:25:30.840 INFO:tasks.workunit.client.1.smithi138.stdout:7/532: rename d0/d8/d15/ff to d0/d6/d76/d93/fad 0 2024-02-07T12:25:30.840 INFO:tasks.workunit.client.1.smithi138.stdout:7/533: creat d0/d8/d11/d26/fae x:0 0 0 2024-02-07T12:25:30.841 INFO:tasks.workunit.client.1.smithi138.stdout:7/534: chown d0/d8/d11/d26/d90/f9e 23025876 1 2024-02-07T12:25:30.842 INFO:tasks.workunit.client.1.smithi138.stdout:5/365: unlink da/f1d 0 2024-02-07T12:25:30.842 INFO:tasks.workunit.client.1.smithi138.stdout:5/366: fdatasync da/f24 0 2024-02-07T12:25:30.842 INFO:tasks.workunit.client.1.smithi138.stdout:5/367: write da/d6d/d27/f28 [1196429,101283] 0 2024-02-07T12:25:30.842 INFO:tasks.workunit.client.1.smithi138.stdout:5/368: stat da/d6d/d27/d2e/d4f/d2b/d59 0 2024-02-07T12:25:30.844 INFO:tasks.workunit.client.1.smithi138.stdout:2/455: link d3/c9a d3/dd/d14/d8f/da5/ca8 0 2024-02-07T12:25:30.844 INFO:tasks.workunit.client.1.smithi138.stdout:2/456: chown d3/dd/d14/d49/d29/d5b 2023718 1 2024-02-07T12:25:30.845 INFO:tasks.workunit.client.1.smithi138.stdout:4/299: dread f14 [0,4194304] 0 2024-02-07T12:25:30.846 INFO:tasks.workunit.client.1.smithi138.stdout:3/471: dwrite d5/d26/d4e/f63 [0,4194304] 0 2024-02-07T12:25:30.848 INFO:tasks.workunit.client.1.smithi138.stdout:5/369: mknod da/d6d/d27/d2e/c72 0 2024-02-07T12:25:30.848 INFO:tasks.workunit.client.1.smithi138.stdout:5/370: write da/d6d/f4e [1818717,72622] 0 2024-02-07T12:25:30.848 INFO:tasks.workunit.client.1.smithi138.stdout:5/371: write f8 [1496046,47262] 0 2024-02-07T12:25:30.850 INFO:tasks.workunit.client.1.smithi138.stdout:2/457: mknod d3/d4e/ca9 0 2024-02-07T12:25:30.850 INFO:tasks.workunit.client.1.smithi138.stdout:7/535: write d0/d8/d11/d26/d90/f2c [3954064,107911] 0 2024-02-07T12:25:30.850 INFO:tasks.workunit.client.1.smithi138.stdout:7/536: chown d0/d8/d11/l1c 412336674 1 2024-02-07T12:25:30.852 INFO:tasks.workunit.client.1.smithi138.stdout:4/300: link d20/f2f d20/d53/f5d 0 2024-02-07T12:25:30.852 INFO:tasks.workunit.client.1.smithi138.stdout:4/301: write d20/f32 [690976,97873] 0 2024-02-07T12:25:30.852 INFO:tasks.workunit.client.1.smithi138.stdout:4/302: read - d20/d34/d36/f46 zero size 2024-02-07T12:25:30.859 INFO:tasks.workunit.client.1.smithi138.stdout:3/472: rmdir d5/d26/d5e/d86 39 2024-02-07T12:25:30.859 INFO:tasks.workunit.client.1.smithi138.stdout:3/473: fdatasync d5/d26/d28/f8b 0 2024-02-07T12:25:30.860 INFO:tasks.workunit.client.1.smithi138.stdout:5/372: dread da/fc [0,4194304] 0 2024-02-07T12:25:30.860 INFO:tasks.workunit.client.1.smithi138.stdout:5/373: write da/d50/f56 [503752,63467] 0 2024-02-07T12:25:30.860 INFO:tasks.workunit.client.1.smithi138.stdout:5/374: write da/d6d/d27/d2e/d4f/f30 [3589773,130045] 0 2024-02-07T12:25:30.862 INFO:tasks.workunit.client.1.smithi138.stdout:7/537: creat d0/d8/d11/d26/d90/faf x:0 0 0 2024-02-07T12:25:30.875 INFO:tasks.workunit.client.1.smithi138.stdout:7/538: write d0/d8/d11/d26/f33 [3463261,86902] 0 2024-02-07T12:25:30.875 INFO:tasks.workunit.client.1.smithi138.stdout:7/539: creat d0/d8/d11/d26/d90/d98/fb0 x:0 0 0 2024-02-07T12:25:30.875 INFO:tasks.workunit.client.1.smithi138.stdout:7/540: chown d0/c71 93522 1 2024-02-07T12:25:30.875 INFO:tasks.workunit.client.1.smithi138.stdout:7/541: chown d0/d8/d11/d26/f49 26238 1 2024-02-07T12:25:30.883 INFO:tasks.workunit.client.1.smithi138.stdout:3/474: dwrite d5/d34/d79/f89 [0,4194304] 0 2024-02-07T12:25:30.883 INFO:tasks.workunit.client.1.smithi138.stdout:2/458: dwrite d3/dd/d14/d8f/d73/d80/f85 [0,4194304] 0 2024-02-07T12:25:30.883 INFO:tasks.workunit.client.1.smithi138.stdout:3/475: write d5/fd [309849,4765] 0 2024-02-07T12:25:30.883 INFO:tasks.workunit.client.1.smithi138.stdout:4/303: dwrite d20/f40 [0,4194304] 0 2024-02-07T12:25:30.887 INFO:tasks.workunit.client.1.smithi138.stdout:2/459: unlink d3/dd/d14/d8f/d73/d80/ca4 0 2024-02-07T12:25:30.889 INFO:tasks.workunit.client.1.smithi138.stdout:3/476: symlink d5/d26/d90/la8 0 2024-02-07T12:25:30.889 INFO:tasks.workunit.client.1.smithi138.stdout:3/477: write d5/d27/d35/f66 [4682994,125654] 0 2024-02-07T12:25:30.889 INFO:tasks.workunit.client.1.smithi138.stdout:3/478: stat d5/d34/f8f 0 2024-02-07T12:25:30.894 INFO:tasks.workunit.client.1.smithi138.stdout:4/304: mknod d20/d34/c5e 0 2024-02-07T12:25:30.901 INFO:tasks.workunit.client.1.smithi138.stdout:4/305: truncate d20/f31 689233 0 2024-02-07T12:25:30.901 INFO:tasks.workunit.client.1.smithi138.stdout:4/306: getdents d20/d34/d59 0 2024-02-07T12:25:30.903 INFO:tasks.workunit.client.1.smithi138.stdout:4/307: rename f19 to d20/d34/d36/f5f 0 2024-02-07T12:25:30.906 INFO:tasks.workunit.client.1.smithi138.stdout:4/308: unlink d20/c27 0 2024-02-07T12:25:30.907 INFO:tasks.workunit.client.1.smithi138.stdout:1/277: sync 2024-02-07T12:25:30.914 INFO:tasks.workunit.client.1.smithi138.stdout:0/405: sync 2024-02-07T12:25:30.917 INFO:tasks.workunit.client.1.smithi138.stdout:2/460: dwrite d3/dd/d19/d1f/fa2 [0,4194304] 0 2024-02-07T12:25:30.918 INFO:tasks.workunit.client.1.smithi138.stdout:5/375: dwrite da/f29 [4194304,4194304] 0 2024-02-07T12:25:30.920 INFO:tasks.workunit.client.1.smithi138.stdout:2/461: creat d3/dd/d19/d1f/d46/d71/faa x:0 0 0 2024-02-07T12:25:30.920 INFO:tasks.workunit.client.1.smithi138.stdout:2/462: fdatasync d3/dd/d14/d49/d25/f6c 0 2024-02-07T12:25:30.920 INFO:tasks.workunit.client.1.smithi138.stdout:4/309: write d20/f21 [3230492,15103] 0 2024-02-07T12:25:30.922 INFO:tasks.workunit.client.1.smithi138.stdout:5/376: mkdir da/d6d/d27/d2e/d4f/d2b/d35/d5d/d73 0 2024-02-07T12:25:30.922 INFO:tasks.workunit.client.1.smithi138.stdout:4/310: rmdir d20/d34/d36 39 2024-02-07T12:25:30.922 INFO:tasks.workunit.client.1.smithi138.stdout:4/311: fsync f13 0 2024-02-07T12:25:30.922 INFO:tasks.workunit.client.1.smithi138.stdout:4/312: write d20/d34/d36/f44 [100586,14488] 0 2024-02-07T12:25:30.924 INFO:tasks.workunit.client.1.smithi138.stdout:3/479: dwrite d5/d27/f57 [0,4194304] 0 2024-02-07T12:25:30.924 INFO:tasks.workunit.client.1.smithi138.stdout:5/377: dread da/f1f [0,4194304] 0 2024-02-07T12:25:30.927 INFO:tasks.workunit.client.1.smithi138.stdout:1/278: dwrite d5/d8/da/d1f/f25 [0,4194304] 0 2024-02-07T12:25:30.931 INFO:tasks.workunit.client.1.smithi138.stdout:5/378: creat da/d43/d4a/f74 x:0 0 0 2024-02-07T12:25:30.935 INFO:tasks.workunit.client.1.smithi138.stdout:2/463: write d3/dd/d14/d49/d29/d5b/f8d [3557140,114918] 0 2024-02-07T12:25:30.937 INFO:tasks.workunit.client.1.smithi138.stdout:1/279: mkdir d5/d8/da/d1f/d5e 0 2024-02-07T12:25:30.937 INFO:tasks.workunit.client.1.smithi138.stdout:1/280: readlink d5/d8/da/d15/l37 0 2024-02-07T12:25:30.938 INFO:tasks.workunit.client.1.smithi138.stdout:2/464: creat d3/dd/d19/d1f/d37/fab x:0 0 0 2024-02-07T12:25:30.940 INFO:tasks.workunit.client.1.smithi138.stdout:2/465: rename d3/d4e/l8e to d3/dd/d14/d8f/da5/lac 0 2024-02-07T12:25:30.942 INFO:tasks.workunit.client.1.smithi138.stdout:3/480: dwrite d5/d27/f80 [0,4194304] 0 2024-02-07T12:25:30.942 INFO:tasks.workunit.client.1.smithi138.stdout:4/313: dwrite f1a [0,4194304] 0 2024-02-07T12:25:30.942 INFO:tasks.workunit.client.1.smithi138.stdout:2/466: fdatasync d3/dd/d14/f5a 0 2024-02-07T12:25:30.943 INFO:tasks.workunit.client.1.smithi138.stdout:0/406: dwrite d4/f6 [0,4194304] 0 2024-02-07T12:25:30.949 INFO:tasks.workunit.client.1.smithi138.stdout:3/481: symlink d5/d34/la9 0 2024-02-07T12:25:30.952 INFO:tasks.workunit.client.1.smithi138.stdout:1/281: dwrite d5/d8/da/d1f/d27/d3e/f57 [0,4194304] 0 2024-02-07T12:25:30.952 INFO:tasks.workunit.client.1.smithi138.stdout:1/282: read - d5/d8/f49 zero size 2024-02-07T12:25:30.953 INFO:tasks.workunit.client.1.smithi138.stdout:4/314: creat d20/d53/f60 x:0 0 0 2024-02-07T12:25:30.953 INFO:tasks.workunit.client.1.smithi138.stdout:2/467: dread d3/dd/d14/f5a [0,4194304] 0 2024-02-07T12:25:30.953 INFO:tasks.workunit.client.1.smithi138.stdout:2/468: chown d3/d4e/f88 114 1 2024-02-07T12:25:30.956 INFO:tasks.workunit.client.1.smithi138.stdout:0/407: write d4/f67 [177119,65395] 0 2024-02-07T12:25:30.958 INFO:tasks.workunit.client.1.smithi138.stdout:3/482: truncate d5/d26/d4e/f8c 1634122 0 2024-02-07T12:25:30.958 INFO:tasks.workunit.client.1.smithi138.stdout:3/483: fsync d5/d26/d28/f52 0 2024-02-07T12:25:30.962 INFO:tasks.workunit.client.1.smithi138.stdout:1/283: symlink d5/d8/da/d4a/l5f 0 2024-02-07T12:25:30.968 INFO:tasks.workunit.client.1.smithi138.stdout:4/315: unlink f15 0 2024-02-07T12:25:30.968 INFO:tasks.workunit.client.1.smithi138.stdout:4/316: truncate d20/f50 531139 0 2024-02-07T12:25:30.968 INFO:tasks.workunit.client.1.smithi138.stdout:4/317: fdatasync d20/d34/d36/f38 0 2024-02-07T12:25:30.968 INFO:tasks.workunit.client.1.smithi138.stdout:4/318: truncate d20/f3d 373325 0 2024-02-07T12:25:30.968 INFO:tasks.workunit.client.1.smithi138.stdout:2/469: truncate d3/dd/d19/d44/f69 3134589 0 2024-02-07T12:25:30.970 INFO:tasks.workunit.client.1.smithi138.stdout:0/408: dwrite d4/d9/de/d1d/f49 [0,4194304] 0 2024-02-07T12:25:30.972 INFO:tasks.workunit.client.1.smithi138.stdout:1/284: unlink d5/d8/da/d20/f30 0 2024-02-07T12:25:30.974 INFO:tasks.workunit.client.1.smithi138.stdout:4/319: truncate d20/d47/f4b 3207753 0 2024-02-07T12:25:30.974 INFO:tasks.workunit.client.1.smithi138.stdout:4/320: write d20/d34/f4a [5129534,83628] 0 2024-02-07T12:25:30.974 INFO:tasks.workunit.client.1.smithi138.stdout:2/470: stat d3/d4e/c77 0 2024-02-07T12:25:30.978 INFO:tasks.workunit.client.1.smithi138.stdout:4/321: dread fd [0,4194304] 0 2024-02-07T12:25:30.980 INFO:tasks.workunit.client.1.smithi138.stdout:3/484: getdents d5/d26/d4e 0 2024-02-07T12:25:30.981 INFO:tasks.workunit.client.0.smithi047.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-07T12:25:30.983 INFO:tasks.workunit.client.1.smithi138.stdout:0/409: write d4/f1f [511343,50148] 0 2024-02-07T12:25:30.988 INFO:tasks.workunit.client.1.smithi138.stdout:1/285: mkdir d5/d8/da/d1f/d60 0 2024-02-07T12:25:30.988 INFO:tasks.workunit.client.1.smithi138.stdout:1/286: creat d5/f61 x:0 0 0 2024-02-07T12:25:30.991 INFO:tasks.workunit.client.1.smithi138.stdout:2/471: dwrite d3/f12 [0,4194304] 0 2024-02-07T12:25:30.991 INFO:tasks.workunit.client.1.smithi138.stdout:2/472: stat d3/dd/d19/d1f/d37/f7c 0 2024-02-07T12:25:30.991 INFO:tasks.workunit.client.1.smithi138.stdout:2/473: read d3/dd/d14/d49/d29/f51 [245282,36616] 0 2024-02-07T12:25:30.991 INFO:tasks.workunit.client.1.smithi138.stdout:3/485: dread d5/d15/f6d [0,4194304] 0 2024-02-07T12:25:30.994 INFO:tasks.workunit.client.1.smithi138.stdout:0/410: mkdir d4/d9/d37/d6b/d7f 0 2024-02-07T12:25:30.998 INFO:tasks.workunit.client.1.smithi138.stdout:1/287: mkdir d5/d8/da/d1f/d5e/d62 0 2024-02-07T12:25:30.999 INFO:tasks.workunit.client.1.smithi138.stdout:2/474: symlink d3/dd/d14/d49/d25/lad 0 2024-02-07T12:25:31.001 INFO:tasks.workunit.client.1.smithi138.stdout:2/475: dread d3/dd/d19/d1f/d37/f7c [0,4194304] 0 2024-02-07T12:25:31.001 INFO:tasks.workunit.client.1.smithi138.stdout:2/476: fdatasync d3/dd/d19/d1f/fa2 0 2024-02-07T12:25:31.001 INFO:tasks.workunit.client.1.smithi138.stdout:2/477: fdatasync d3/dd/d14/d49/d29/d5b/f8d 0 2024-02-07T12:25:31.002 INFO:tasks.workunit.client.1.smithi138.stdout:3/486: unlink d5/d27/d35/l45 0 2024-02-07T12:25:31.004 INFO:tasks.workunit.client.1.smithi138.stdout:1/288: unlink d5/d8/da/d4a/l56 0 2024-02-07T12:25:31.004 INFO:tasks.workunit.client.1.smithi138.stdout:1/289: fsync d5/d8/da/d15/f2c 0 2024-02-07T12:25:31.014 INFO:tasks.workunit.client.1.smithi138.stdout:1/290: truncate d5/d8/fd 15586038 0 2024-02-07T12:25:31.015 INFO:tasks.workunit.client.1.smithi138.stdout:2/478: rename d3/dd/d14/f4d to d3/dd/fae 0 2024-02-07T12:25:31.018 INFO:tasks.workunit.client.1.smithi138.stdout:3/487: rmdir d5/d27 39 2024-02-07T12:25:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.018+0000 7f462bec7700 1 -- 172.21.15.47:0/2228803125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46240fd3f0 msgr2=0x7f46240fd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.018+0000 7f462bec7700 1 --2- 172.21.15.47:0/2228803125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46240fd3f0 0x7f46240fd800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4620004940 tx=0x7f4620009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.018+0000 7f462bec7700 1 -- 172.21.15.47:0/2228803125 shutdown_connections 2024-02-07T12:25:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.018+0000 7f462bec7700 1 --2- 172.21.15.47:0/2228803125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46240fc140 0x7f46240fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.018+0000 7f462bec7700 1 --2- 172.21.15.47:0/2228803125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46240fd3f0 0x7f46240fd800 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.018+0000 7f462bec7700 1 -- 172.21.15.47:0/2228803125 >> 172.21.15.47:0/2228803125 conn(0x7f46240f6ca0 msgr2=0x7f46240f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.019+0000 7f462bec7700 1 -- 172.21.15.47:0/2228803125 shutdown_connections 2024-02-07T12:25:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.019+0000 7f462bec7700 1 -- 172.21.15.47:0/2228803125 wait complete. 2024-02-07T12:25:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.020+0000 7f462bec7700 1 Processor -- start 2024-02-07T12:25:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.020+0000 7f462bec7700 1 -- start start 2024-02-07T12:25:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.020+0000 7f462bec7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46240fc140 0x7f462410fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.020+0000 7f462bec7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46240fd3f0 0x7f4624110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.021+0000 7f4629c63700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46240fc140 0x7f462410fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.021+0000 7f4629c63700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46240fc140 0x7f462410fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39964/0 (socket says 172.21.15.47:39964) 2024-02-07T12:25:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.021+0000 7f4629c63700 1 -- 172.21.15.47:0/2331490057 learned_addr learned my addr 172.21.15.47:0/2331490057 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:25:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.021+0000 7f462bec7700 1 -- 172.21.15.47:0/2331490057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4624110740 con 0x7f46240fc140 2024-02-07T12:25:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.021+0000 7f4629462700 1 --2- 172.21.15.47:0/2331490057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46240fd3f0 0x7f4624110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.021+0000 7f462bec7700 1 -- 172.21.15.47:0/2331490057 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4624110fe0 con 0x7f46240fd3f0 2024-02-07T12:25:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.022+0000 7f4629462700 1 -- 172.21.15.47:0/2331490057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46240fc140 msgr2=0x7f462410fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.022+0000 7f4629462700 1 --2- 172.21.15.47:0/2331490057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46240fc140 0x7f462410fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.022+0000 7f4629462700 1 -- 172.21.15.47:0/2331490057 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4620005040 con 0x7f46240fd3f0 2024-02-07T12:25:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.022+0000 7f4629462700 1 --2- 172.21.15.47:0/2331490057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46240fd3f0 0x7f4624110140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4614002820 tx=0x7f4614004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.023+0000 7f461a7fc700 1 -- 172.21.15.47:0/2331490057 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4614007cc0 con 0x7f46240fd3f0 2024-02-07T12:25:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.023+0000 7f461a7fc700 1 -- 172.21.15.47:0/2331490057 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f461400f040 con 0x7f46240fd3f0 2024-02-07T12:25:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.023+0000 7f461a7fc700 1 -- 172.21.15.47:0/2331490057 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4614013860 con 0x7f46240fd3f0 2024-02-07T12:25:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.023+0000 7f462bec7700 1 -- 172.21.15.47:0/2331490057 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46241112c0 con 0x7f46240fd3f0 2024-02-07T12:25:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.023+0000 7f462bec7700 1 -- 172.21.15.47:0/2331490057 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4624111740 con 0x7f46240fd3f0 2024-02-07T12:25:31.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.025+0000 7f461a7fc700 1 -- 172.21.15.47:0/2331490057 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 20) v1 ==== 88827+0+0 (secure 0 0 0) 0x7f4614009070 con 0x7f46240fd3f0 2024-02-07T12:25:31.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.025+0000 7f462bec7700 1 -- 172.21.15.47:0/2331490057 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462404bed0 con 0x7f46240fd3f0 2024-02-07T12:25:31.027 INFO:tasks.workunit.client.1.smithi138.stdout:3/488: symlink d5/d26/d28/laa 0 2024-02-07T12:25:31.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.025+0000 7f461a7fc700 1 --2- 172.21.15.47:0/2331490057 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f461006b0f0 0x7f461006d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:31.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.025+0000 7f461a7fc700 1 -- 172.21.15.47:0/2331490057 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f46140893d0 con 0x7f46240fd3f0 2024-02-07T12:25:31.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.025+0000 7f4629c63700 1 --2- 172.21.15.47:0/2331490057 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f461006b0f0 0x7f461006d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:31.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.026+0000 7f4629c63700 1 --2- 172.21.15.47:0/2331490057 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f461006b0f0 0x7f461006d5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4620004f90 tx=0x7f4620009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:31.029 INFO:tasks.workunit.client.1.smithi138.stdout:2/479: creat d3/dd/d14/d86/faf x:0 0 0 2024-02-07T12:25:31.030 INFO:tasks.workunit.client.1.smithi138.stdout:3/489: mkdir d5/d26/d9b/dab 0 2024-02-07T12:25:31.032 INFO:tasks.workunit.client.1.smithi138.stdout:1/291: rename d5/d8/da/d1f/d27/d3e to d5/d8/da/d1f/d5e/d63 0 2024-02-07T12:25:31.033 INFO:tasks.workunit.client.1.smithi138.stdout:2/480: dread f1 [0,4194304] 0 2024-02-07T12:25:31.035 INFO:tasks.workunit.client.1.smithi138.stdout:2/481: truncate d3/dd/d19/d44/f57 2612139 0 2024-02-07T12:25:31.035 INFO:tasks.workunit.client.1.smithi138.stdout:2/482: read - d3/dd/f9c zero size 2024-02-07T12:25:31.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.035+0000 7f461a7fc700 1 -- 172.21.15.47:0/2331490057 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4614059380 con 0x7f46240fd3f0 2024-02-07T12:25:31.039 INFO:tasks.workunit.client.1.smithi138.stdout:2/483: creat d3/dd/d14/fb0 x:0 0 0 2024-02-07T12:25:31.047 INFO:tasks.workunit.client.1.smithi138.stdout:1/292: dwrite d5/d8/da/d1f/f51 [0,4194304] 0 2024-02-07T12:25:31.047 INFO:tasks.workunit.client.1.smithi138.stdout:1/293: chown d5/d8/f49 262 1 2024-02-07T12:25:31.049 INFO:tasks.workunit.client.1.smithi138.stdout:3/490: dwrite d5/d27/d35/f53 [0,4194304] 0 2024-02-07T12:25:31.049 INFO:tasks.workunit.client.1.smithi138.stdout:1/294: creat d5/d8/da/d1f/d5e/d63/f64 x:0 0 0 2024-02-07T12:25:31.050 INFO:tasks.workunit.client.1.smithi138.stdout:1/295: write d5/d8/da/d15/f3d [700685,49400] 0 2024-02-07T12:25:31.051 INFO:tasks.workunit.client.1.smithi138.stdout:1/296: rmdir d5/d8/da/d15 39 2024-02-07T12:25:31.059 INFO:tasks.workunit.client.1.smithi138.stdout:1/297: write d5/d8/da/d1f/d5e/d63/f57 [2119582,46527] 0 2024-02-07T12:25:31.059 INFO:tasks.workunit.client.1.smithi138.stdout:3/491: write d5/d26/d4e/f58 [3395551,124822] 0 2024-02-07T12:25:31.060 INFO:tasks.workunit.client.1.smithi138.stdout:1/298: mkdir d5/d4b/d65 0 2024-02-07T12:25:31.061 INFO:tasks.workunit.client.1.smithi138.stdout:3/492: dread d5/d26/f60 [0,4194304] 0 2024-02-07T12:25:31.061 INFO:tasks.workunit.client.1.smithi138.stdout:3/493: dread - d5/d27/f7d zero size 2024-02-07T12:25:31.061 INFO:tasks.workunit.client.1.smithi138.stdout:3/494: readlink d5/d26/d4e/l9f 0 2024-02-07T12:25:31.061 INFO:tasks.workunit.client.1.smithi138.stdout:1/299: symlink d5/d8/da/d20/l66 0 2024-02-07T12:25:31.061 INFO:tasks.workunit.client.1.smithi138.stdout:1/300: fsync d5/d8/f5a 0 2024-02-07T12:25:31.062 INFO:tasks.workunit.client.1.smithi138.stdout:3/495: getdents d5/d15/d32 0 2024-02-07T12:25:31.064 INFO:tasks.workunit.client.1.smithi138.stdout:3/496: dread d5/d26/d28/f78 [0,4194304] 0 2024-02-07T12:25:31.064 INFO:tasks.workunit.client.1.smithi138.stdout:1/301: unlink d5/d8/f49 0 2024-02-07T12:25:31.065 INFO:tasks.workunit.client.1.smithi138.stdout:3/497: mkdir d5/d27/d35/dac 0 2024-02-07T12:25:31.065 INFO:tasks.workunit.client.1.smithi138.stdout:3/498: truncate d5/d15/f6d 5106873 0 2024-02-07T12:25:31.169 INFO:tasks.workunit.client.1.smithi138.stdout:6/358: sync 2024-02-07T12:25:31.169 INFO:tasks.workunit.client.1.smithi138.stdout:6/359: truncate dc/d13/f1d 4618892 0 2024-02-07T12:25:31.170 INFO:tasks.workunit.client.1.smithi138.stdout:6/360: mkdir dc/d31/d3f/d71 0 2024-02-07T12:25:31.170 INFO:tasks.workunit.client.1.smithi138.stdout:6/361: chown dc/d13/d1e/d4d/c65 559119 1 2024-02-07T12:25:31.170 INFO:tasks.workunit.client.1.smithi138.stdout:6/362: creat dc/d31/f72 x:0 0 0 2024-02-07T12:25:31.170 INFO:tasks.workunit.client.1.smithi138.stdout:6/363: chown l5 4 1 2024-02-07T12:25:31.170 INFO:tasks.workunit.client.1.smithi138.stdout:6/364: mkdir dc/d73 0 2024-02-07T12:25:31.177 INFO:tasks.workunit.client.1.smithi138.stdout:6/365: dread dc/d69/f5e [0,4194304] 0 2024-02-07T12:25:31.177 INFO:tasks.workunit.client.1.smithi138.stdout:6/366: read - dc/d13/d1e/d24/f3c zero size 2024-02-07T12:25:31.178 INFO:tasks.workunit.client.1.smithi138.stdout:6/367: mknod dc/d13/d1e/d24/c74 0 2024-02-07T12:25:31.178 INFO:tasks.workunit.client.1.smithi138.stdout:6/368: unlink c4 0 2024-02-07T12:25:31.179 INFO:tasks.workunit.client.1.smithi138.stdout:6/369: mknod dc/d13/d1e/d35/c75 0 2024-02-07T12:25:31.180 INFO:tasks.workunit.client.1.smithi138.stdout:6/370: getdents dc/d13/d1e/d35/d6d 0 2024-02-07T12:25:31.180 INFO:tasks.workunit.client.1.smithi138.stdout:6/371: truncate dc/d31/f47 4916120 0 2024-02-07T12:25:31.188 INFO:tasks.workunit.client.1.smithi138.stdout:6/372: write dc/d13/d1e/d24/f2c [1509535,91904] 0 2024-02-07T12:25:31.205 INFO:tasks.workunit.client.1.smithi138.stdout:6/373: dwrite dc/d31/d54/f61 [0,4194304] 0 2024-02-07T12:25:31.207 INFO:tasks.workunit.client.1.smithi138.stdout:6/374: mknod dc/d31/d54/c76 0 2024-02-07T12:25:31.207 INFO:tasks.workunit.client.1.smithi138.stdout:6/375: creat dc/f77 x:0 0 0 2024-02-07T12:25:31.211 INFO:tasks.workunit.client.1.smithi138.stdout:6/376: truncate dc/d13/d1e/f30 191109 0 2024-02-07T12:25:31.212 INFO:tasks.workunit.client.1.smithi138.stdout:6/377: symlink dc/l78 0 2024-02-07T12:25:31.230 INFO:tasks.workunit.client.1.smithi138.stdout:6/378: dwrite dc/d13/d1e/d24/f3c [0,4194304] 0 2024-02-07T12:25:31.232 INFO:tasks.workunit.client.1.smithi138.stdout:6/379: symlink dc/d31/d54/l79 0 2024-02-07T12:25:31.232 INFO:tasks.workunit.client.1.smithi138.stdout:6/380: truncate dc/d13/d1e/d35/f46 760700 0 2024-02-07T12:25:31.233 INFO:tasks.workunit.client.1.smithi138.stdout:6/381: fsync dc/d13/d1e/d4d/f6f 0 2024-02-07T12:25:31.238 INFO:tasks.workunit.client.1.smithi138.stdout:9/302: sync 2024-02-07T12:25:31.238 INFO:tasks.workunit.client.1.smithi138.stdout:8/510: sync 2024-02-07T12:25:31.238 INFO:tasks.workunit.client.1.smithi138.stdout:8/511: chown d1/de/d11/d17/d58 87799 1 2024-02-07T12:25:31.238 INFO:tasks.workunit.client.1.smithi138.stdout:9/303: dread - d0/d6/d8/d1d/f3d zero size 2024-02-07T12:25:31.238 INFO:tasks.workunit.client.1.smithi138.stdout:8/512: write d1/de/d11/d17/d3e/d72/f88 [842928,123425] 0 2024-02-07T12:25:31.238 INFO:tasks.workunit.client.1.smithi138.stdout:8/513: creat d1/de/d11/d17/d3e/d72/f9f x:0 0 0 2024-02-07T12:25:31.240 INFO:tasks.workunit.client.1.smithi138.stdout:8/514: creat d1/de/d11/d17/d2e/d3a/d50/fa0 x:0 0 0 2024-02-07T12:25:31.241 INFO:tasks.workunit.client.1.smithi138.stdout:8/515: creat d1/de/d11/d17/d2e/fa1 x:0 0 0 2024-02-07T12:25:31.241 INFO:tasks.workunit.client.1.smithi138.stdout:8/516: chown d1/de/d11/d17/d3e/l71 9971833 1 2024-02-07T12:25:31.242 INFO:tasks.workunit.client.1.smithi138.stdout:8/517: dread - d1/de/d11/d17/d3e/f5a zero size 2024-02-07T12:25:31.242 INFO:tasks.workunit.client.1.smithi138.stdout:8/518: read - d1/de/d11/d17/d58/f9c zero size 2024-02-07T12:25:31.242 INFO:tasks.workunit.client.1.smithi138.stdout:8/519: symlink d1/de/d11/d17/d2e/d3a/la2 0 2024-02-07T12:25:31.243 INFO:tasks.workunit.client.1.smithi138.stdout:8/520: symlink d1/de/d11/d96/la3 0 2024-02-07T12:25:31.254 INFO:tasks.workunit.client.1.smithi138.stdout:9/304: dwrite d0/d34/f51 [0,4194304] 0 2024-02-07T12:25:31.256 INFO:tasks.workunit.client.1.smithi138.stdout:9/305: dread d0/d6/f15 [0,4194304] 0 2024-02-07T12:25:31.256 INFO:tasks.workunit.client.1.smithi138.stdout:9/306: write d0/d6/d8/d1d/dd/d41/d5e/f67 [5208434,24098] 0 2024-02-07T12:25:31.257 INFO:tasks.workunit.client.1.smithi138.stdout:9/307: write d0/d6/d8/d1d/f3d [453402,45713] 0 2024-02-07T12:25:31.258 INFO:tasks.workunit.client.1.smithi138.stdout:9/308: truncate d0/d6/f15 87728 0 2024-02-07T12:25:31.258 INFO:tasks.workunit.client.1.smithi138.stdout:9/309: write d0/d6/d8/d1d/dd/d1f/f47 [1164946,107656] 0 2024-02-07T12:25:31.258 INFO:tasks.workunit.client.1.smithi138.stdout:9/310: chown d0/c56 2 1 2024-02-07T12:25:31.259 INFO:tasks.workunit.client.1.smithi138.stdout:9/311: creat d0/d34/d45/f69 x:0 0 0 2024-02-07T12:25:31.261 INFO:tasks.workunit.client.1.smithi138.stdout:8/521: dwrite d1/de/d11/d17/d2e/fa1 [0,4194304] 0 2024-02-07T12:25:31.268 INFO:tasks.workunit.client.1.smithi138.stdout:9/312: write d0/f38 [1522940,57474] 0 2024-02-07T12:25:31.276 INFO:tasks.workunit.client.1.smithi138.stdout:9/313: dread d0/d6/f27 [0,4194304] 0 2024-02-07T12:25:31.276 INFO:tasks.workunit.client.1.smithi138.stdout:9/314: chown d0/d6/d8/d1d/dd/c58 33780185 1 2024-02-07T12:25:31.277 INFO:tasks.workunit.client.1.smithi138.stdout:9/315: creat d0/d6/d8/d1d/dd/d1f/f6a x:0 0 0 2024-02-07T12:25:31.278 INFO:tasks.workunit.client.1.smithi138.stdout:9/316: chown d0/d6/d8/c29 201347655 1 2024-02-07T12:25:31.279 INFO:tasks.workunit.client.1.smithi138.stdout:8/522: dwrite d1/d8e/f91 [0,4194304] 0 2024-02-07T12:25:31.279 INFO:tasks.workunit.client.1.smithi138.stdout:8/523: dread - d1/de/d11/d17/d3e/f5a zero size 2024-02-07T12:25:31.279 INFO:tasks.workunit.client.1.smithi138.stdout:8/524: dread - d1/de/d11/f1a zero size 2024-02-07T12:25:31.298 INFO:tasks.workunit.client.1.smithi138.stdout:9/317: dwrite d0/d6/d8/f66 [0,4194304] 0 2024-02-07T12:25:31.299 INFO:tasks.workunit.client.1.smithi138.stdout:8/525: dwrite d1/de/d11/d17/d2e/d3a/d50/f5f [0,4194304] 0 2024-02-07T12:25:31.299 INFO:tasks.workunit.client.1.smithi138.stdout:8/526: truncate d1/de/d11/d17/d2e/d3a/f83 4428983 0 2024-02-07T12:25:31.309 INFO:tasks.workunit.client.1.smithi138.stdout:9/318: read d0/d6/d8/d1d/dd/d41/d5e/f67 [2082472,108555] 0 2024-02-07T12:25:31.311 INFO:tasks.workunit.client.1.smithi138.stdout:7/542: sync 2024-02-07T12:25:31.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.309+0000 7f462bec7700 1 -- 172.21.15.47:0/2331490057 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4624101640 con 0x7f461006b0f0 2024-02-07T12:25:31.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.311+0000 7f461a7fc700 1 -- 172.21.15.47:0/2331490057 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f4624101640 con 0x7f461006b0f0 2024-02-07T12:25:31.313 INFO:tasks.workunit.client.1.smithi138.stdout:7/543: mkdir d0/d8/d15/db1 0 2024-02-07T12:25:31.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.314+0000 7f462bec7700 1 -- 172.21.15.47:0/2331490057 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f461006b0f0 msgr2=0x7f461006d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:31.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.314+0000 7f462bec7700 1 --2- 172.21.15.47:0/2331490057 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f461006b0f0 0x7f461006d5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4620004f90 tx=0x7f4620009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:31.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.314+0000 7f462bec7700 1 -- 172.21.15.47:0/2331490057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46240fd3f0 msgr2=0x7f4624110140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:31.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.314+0000 7f462bec7700 1 --2- 172.21.15.47:0/2331490057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46240fd3f0 0x7f4624110140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4614002820 tx=0x7f4614004570 comp rx=0 tx=0).stop 2024-02-07T12:25:31.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.314+0000 7f462bec7700 1 -- 172.21.15.47:0/2331490057 shutdown_connections 2024-02-07T12:25:31.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.314+0000 7f462bec7700 1 --2- 172.21.15.47:0/2331490057 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f461006b0f0 0x7f461006d5a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:31.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.314+0000 7f462bec7700 1 --2- 172.21.15.47:0/2331490057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46240fc140 0x7f462410fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:31.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.314+0000 7f462bec7700 1 --2- 172.21.15.47:0/2331490057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46240fd3f0 0x7f4624110140 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:31.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.314+0000 7f462bec7700 1 -- 172.21.15.47:0/2331490057 >> 172.21.15.47:0/2331490057 conn(0x7f46240f6ca0 msgr2=0x7f46240f8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:31.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.315+0000 7f462bec7700 1 -- 172.21.15.47:0/2331490057 shutdown_connections 2024-02-07T12:25:31.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.315+0000 7f462bec7700 1 -- 172.21.15.47:0/2331490057 wait complete. 2024-02-07T12:25:31.325 INFO:tasks.workunit.client.1.smithi138.stdout:7/544: dread d0/d8/d15/f47 [0,4194304] 0 2024-02-07T12:25:31.327 INFO:tasks.workunit.client.1.smithi138.stdout:8/527: dwrite d1/de/d11/d17/d2e/d3a/d50/f5c [0,4194304] 0 2024-02-07T12:25:31.328 INFO:tasks.workunit.client.1.smithi138.stdout:8/528: truncate d1/de/d11/d17/d2e/d3a/f66 339357 0 2024-02-07T12:25:31.328 INFO:tasks.workunit.client.1.smithi138.stdout:8/529: creat d1/de/d11/d17/d2e/fa4 x:0 0 0 2024-02-07T12:25:31.328 INFO:tasks.workunit.client.1.smithi138.stdout:8/530: write d1/de/d11/d17/f25 [1957584,93248] 0 2024-02-07T12:25:31.328 INFO:tasks.workunit.client.1.smithi138.stdout:8/531: read - d1/de/d11/d17/d2e/d49/d4c/f9a zero size 2024-02-07T12:25:31.330 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:25:31.335 INFO:tasks.workunit.client.1.smithi138.stdout:9/319: dwrite d0/d6/d8/d1d/f1c [0,4194304] 0 2024-02-07T12:25:31.335 INFO:tasks.workunit.client.1.smithi138.stdout:9/320: write d0/d6/d8/d1d/dd/d41/f60 [476286,62814] 0 2024-02-07T12:25:31.347 INFO:tasks.workunit.client.1.smithi138.stdout:7/545: dwrite d0/d8/d11/d26/d90/faf [0,4194304] 0 2024-02-07T12:25:31.348 INFO:tasks.workunit.client.1.smithi138.stdout:8/532: dwrite d1/de/d11/d17/d2e/d3a/f98 [0,4194304] 0 2024-02-07T12:25:31.350 INFO:tasks.workunit.client.1.smithi138.stdout:7/546: symlink d0/d6/d19/lb2 0 2024-02-07T12:25:31.352 INFO:tasks.workunit.client.1.smithi138.stdout:9/321: dwrite d0/d6/d8/d1d/dd/d41/f5c [0,4194304] 0 2024-02-07T12:25:31.352 INFO:tasks.workunit.client.1.smithi138.stdout:9/322: stat d0/d6/d8/d1d/f61 0 2024-02-07T12:25:31.354 INFO:tasks.workunit.client.1.smithi138.stdout:9/323: fdatasync d0/d6/d8/d1d/dd/d41/d5e/f67 0 2024-02-07T12:25:31.354 INFO:tasks.workunit.client.1.smithi138.stdout:9/324: creat d0/d34/f6b x:0 0 0 2024-02-07T12:25:31.357 INFO:tasks.workunit.client.1.smithi138.stdout:8/533: getdents d1/de/d11/d96 0 2024-02-07T12:25:31.357 INFO:tasks.workunit.client.1.smithi138.stdout:9/325: dread d0/d6/d8/d1d/dd/f20 [0,4194304] 0 2024-02-07T12:25:31.357 INFO:tasks.workunit.client.1.smithi138.stdout:8/534: truncate d1/de/d11/d17/d3e/f84 1007889 0 2024-02-07T12:25:31.358 INFO:tasks.workunit.client.1.smithi138.stdout:7/547: mkdir d0/d8/db3 0 2024-02-07T12:25:31.361 INFO:tasks.workunit.client.1.smithi138.stdout:9/326: unlink d0/d6/d8/d1d/dd/c59 0 2024-02-07T12:25:31.363 INFO:tasks.workunit.client.1.smithi138.stdout:8/535: link d1/de/d11/d17/d2e/d49/f19 d1/d8e/fa5 0 2024-02-07T12:25:31.365 INFO:tasks.workunit.client.1.smithi138.stdout:7/548: creat d0/d6/d1d/fb4 x:0 0 0 2024-02-07T12:25:31.365 INFO:tasks.workunit.client.1.smithi138.stdout:7/549: chown d0/d8/d11/d26/d90/d98 17 1 2024-02-07T12:25:31.365 INFO:tasks.workunit.client.1.smithi138.stdout:7/550: read d0/d8/d11/d1f/f9b [410632,77026] 0 2024-02-07T12:25:31.367 INFO:tasks.workunit.client.1.smithi138.stdout:7/551: symlink d0/d8/d11/d26/lb5 0 2024-02-07T12:25:31.367 INFO:tasks.workunit.client.1.smithi138.stdout:7/552: chown d0/d6/d1d/d38/c64 23835 1 2024-02-07T12:25:31.372 INFO:tasks.workunit.client.1.smithi138.stdout:7/553: write d0/d6/fa [1603986,61486] 0 2024-02-07T12:25:31.374 INFO:tasks.workunit.client.1.smithi138.stdout:6/382: sync 2024-02-07T12:25:31.374 INFO:tasks.workunit.client.1.smithi138.stdout:5/379: sync 2024-02-07T12:25:31.374 INFO:tasks.workunit.client.1.smithi138.stdout:0/411: sync 2024-02-07T12:25:31.374 INFO:tasks.workunit.client.1.smithi138.stdout:2/484: sync 2024-02-07T12:25:31.374 INFO:tasks.workunit.client.1.smithi138.stdout:1/302: sync 2024-02-07T12:25:31.374 INFO:tasks.workunit.client.1.smithi138.stdout:4/322: sync 2024-02-07T12:25:31.374 INFO:tasks.workunit.client.1.smithi138.stdout:4/323: fdatasync f1a 0 2024-02-07T12:25:31.374 INFO:tasks.workunit.client.1.smithi138.stdout:6/383: creat dc/d31/f7a x:0 0 0 2024-02-07T12:25:31.374 INFO:tasks.workunit.client.1.smithi138.stdout:3/499: sync 2024-02-07T12:25:31.381 INFO:tasks.workunit.client.1.smithi138.stdout:0/412: link d4/d52/f38 d4/d9/db/d39/d4b/d6c/f80 0 2024-02-07T12:25:31.381 INFO:tasks.workunit.client.1.smithi138.stdout:0/413: fdatasync d4/d9/d37/d3d/f5b 0 2024-02-07T12:25:31.381 INFO:tasks.workunit.client.1.smithi138.stdout:0/414: fdatasync d4/d9/db/d39/f5c 0 2024-02-07T12:25:31.381 INFO:tasks.workunit.client.1.smithi138.stdout:0/415: write d4/d52/d3f/f63 [57313,29379] 0 2024-02-07T12:25:31.381 INFO:tasks.workunit.client.1.smithi138.stdout:0/416: dread - d4/d52/f34 zero size 2024-02-07T12:25:31.381 INFO:tasks.workunit.client.1.smithi138.stdout:5/380: link da/d6d/l54 da/d6d/d27/d2e/d4f/d2b/d59/d65/l75 0 2024-02-07T12:25:31.381 INFO:tasks.workunit.client.1.smithi138.stdout:5/381: chown da/d43/c61 41 1 2024-02-07T12:25:31.382 INFO:tasks.workunit.client.1.smithi138.stdout:7/554: write d0/d8/d11/f6d [1393093,70574] 0 2024-02-07T12:25:31.382 INFO:tasks.workunit.client.1.smithi138.stdout:7/555: write d0/d39/fa4 [1131573,94376] 0 2024-02-07T12:25:31.382 INFO:tasks.workunit.client.1.smithi138.stdout:1/303: read d5/d8/da/d15/f3d [362753,94009] 0 2024-02-07T12:25:31.382 INFO:tasks.workunit.client.1.smithi138.stdout:1/304: chown d5/d8/da/f11 0 1 2024-02-07T12:25:31.382 INFO:tasks.workunit.client.1.smithi138.stdout:4/324: rename d20/l23 to d20/d53/l61 0 2024-02-07T12:25:31.383 INFO:tasks.workunit.client.1.smithi138.stdout:6/384: getdents dc/d13/d1e 0 2024-02-07T12:25:31.384 INFO:tasks.workunit.client.1.smithi138.stdout:9/327: dwrite d0/d6/f3c [0,4194304] 0 2024-02-07T12:25:31.384 INFO:tasks.workunit.client.1.smithi138.stdout:9/328: fdatasync d0/d6/d8/d1d/dd/f31 0 2024-02-07T12:25:31.384 INFO:tasks.workunit.client.1.smithi138.stdout:9/329: creat d0/d34/d45/f6c x:0 0 0 2024-02-07T12:25:31.384 INFO:tasks.workunit.client.1.smithi138.stdout:8/536: dwrite d1/de/d11/d17/d2e/d49/d4c/f9a [0,4194304] 0 2024-02-07T12:25:31.385 INFO:tasks.workunit.client.1.smithi138.stdout:3/500: unlink d5/d26/d28/f2b 0 2024-02-07T12:25:31.386 INFO:tasks.workunit.client.1.smithi138.stdout:2/485: read f0 [3977258,33918] 0 2024-02-07T12:25:31.387 INFO:tasks.workunit.client.1.smithi138.stdout:5/382: symlink da/d43/d4a/d69/l76 0 2024-02-07T12:25:31.387 INFO:tasks.workunit.client.1.smithi138.stdout:5/383: getdents da/d6d/d27/d2e/d4f/d2b/d35/d67 0 2024-02-07T12:25:31.388 INFO:tasks.workunit.client.1.smithi138.stdout:7/556: creat d0/d8/d11/d26/d90/fb6 x:0 0 0 2024-02-07T12:25:31.388 INFO:tasks.workunit.client.1.smithi138.stdout:3/501: dread d5/d27/f40 [0,4194304] 0 2024-02-07T12:25:31.388 INFO:tasks.workunit.client.1.smithi138.stdout:3/502: fdatasync d5/d15/f85 0 2024-02-07T12:25:31.390 INFO:tasks.workunit.client.1.smithi138.stdout:1/305: truncate d5/d8/f14 5656827 0 2024-02-07T12:25:31.391 INFO:tasks.workunit.client.1.smithi138.stdout:0/417: rename d4/d52/l53 to d4/d9/d33/l81 0 2024-02-07T12:25:31.391 INFO:tasks.workunit.client.1.smithi138.stdout:0/418: stat d4/d52/f44 0 2024-02-07T12:25:31.391 INFO:tasks.workunit.client.1.smithi138.stdout:0/419: dread - d4/d52/f34 zero size 2024-02-07T12:25:31.394 INFO:tasks.workunit.client.1.smithi138.stdout:4/325: dread f1d [0,4194304] 0 2024-02-07T12:25:31.394 INFO:tasks.workunit.client.1.smithi138.stdout:4/326: chown d20/d34/d36 3467438 1 2024-02-07T12:25:31.395 INFO:tasks.workunit.client.1.smithi138.stdout:7/557: dread d0/f14 [0,4194304] 0 2024-02-07T12:25:31.395 INFO:tasks.workunit.client.1.smithi138.stdout:7/558: fdatasync d0/d8/d11/d63/f7a 0 2024-02-07T12:25:31.399 INFO:tasks.workunit.client.1.smithi138.stdout:2/486: creat d3/dd/d14/d49/d25/d3d/fb1 x:0 0 0 2024-02-07T12:25:31.399 INFO:tasks.workunit.client.1.smithi138.stdout:2/487: chown d3/dd/d14/d49/d29/d5b/c8a 5412 1 2024-02-07T12:25:31.400 INFO:tasks.workunit.client.1.smithi138.stdout:5/384: creat da/d6d/d27/d2e/f77 x:0 0 0 2024-02-07T12:25:31.404 INFO:tasks.workunit.client.1.smithi138.stdout:1/306: link d5/d8/da/d1f/c39 d5/d4b/c67 0 2024-02-07T12:25:31.408 INFO:tasks.workunit.client.1.smithi138.stdout:0/420: creat d4/d9/d37/d6b/d7f/f82 x:0 0 0 2024-02-07T12:25:31.409 INFO:tasks.workunit.client.1.smithi138.stdout:8/537: dwrite d1/de/d11/d17/d2e/d49/f3d [0,4194304] 0 2024-02-07T12:25:31.409 INFO:tasks.workunit.client.1.smithi138.stdout:8/538: read d1/de/d11/f1d [1535243,95814] 0 2024-02-07T12:25:31.410 INFO:tasks.workunit.client.1.smithi138.stdout:8/539: write d1/de/d11/d17/d58/f60 [867419,8323] 0 2024-02-07T12:25:31.410 INFO:tasks.workunit.client.1.smithi138.stdout:2/488: symlink d3/dd/d14/d49/d29/lb2 0 2024-02-07T12:25:31.412 INFO:tasks.workunit.client.1.smithi138.stdout:6/385: dwrite f8 [0,4194304] 0 2024-02-07T12:25:31.413 INFO:tasks.workunit.client.1.smithi138.stdout:1/307: mkdir d5/d8/da/d1f/d27/d68 0 2024-02-07T12:25:31.414 INFO:tasks.workunit.client.1.smithi138.stdout:3/503: dwrite d5/d27/f71 [4194304,4194304] 0 2024-02-07T12:25:31.415 INFO:tasks.workunit.client.1.smithi138.stdout:9/330: rename d0/d6/d8/d1d/dd/d41/f50 to d0/d6/d8/f6d 0 2024-02-07T12:25:31.416 INFO:tasks.workunit.client.1.smithi138.stdout:4/327: dwrite d20/f39 [0,4194304] 0 2024-02-07T12:25:31.418 INFO:tasks.workunit.client.1.smithi138.stdout:0/421: unlink d4/d52/d3f/f63 0 2024-02-07T12:25:31.419 INFO:tasks.workunit.client.0.smithi047.stderr:++ readlink -f fsstress 2024-02-07T12:25:31.420 INFO:tasks.workunit.client.1.smithi138.stdout:8/540: write d1/de/d11/d17/d2e/d49/d4c/f9a [741506,87874] 0 2024-02-07T12:25:31.420 INFO:tasks.workunit.client.0.smithi047.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-07T12:25:31.420 INFO:tasks.workunit.client.0.smithi047.stderr:+ popd 2024-02-07T12:25:31.420 INFO:tasks.workunit.client.0.smithi047.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-07T12:25:31.421 INFO:tasks.workunit.client.0.smithi047.stderr:+ popd 2024-02-07T12:25:31.421 INFO:tasks.workunit.client.0.smithi047.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-07T12:25:31.421 INFO:tasks.workunit.client.0.smithi047.stderr:++ mktemp -d -p . 2024-02-07T12:25:31.422 INFO:tasks.workunit.client.1.smithi138.stdout:2/489: mknod d3/dd/d14/d8f/cb3 0 2024-02-07T12:25:31.422 INFO:tasks.workunit.client.1.smithi138.stdout:2/490: chown d3/dd/d19/d1f/d37 410 1 2024-02-07T12:25:31.423 INFO:tasks.workunit.client.0.smithi047.stderr:+ T=./tmp.gyYfCMUOBs 2024-02-07T12:25:31.423 INFO:tasks.workunit.client.0.smithi047.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.gyYfCMUOBs -l 1 -n 1000 -p 10 -v 2024-02-07T12:25:31.424 INFO:tasks.workunit.client.1.smithi138.stdout:6/386: stat dc/d31/d54/l6a 0 2024-02-07T12:25:31.424 INFO:tasks.workunit.client.1.smithi138.stdout:6/387: truncate dc/d13/d1e/f30 359280 0 2024-02-07T12:25:31.425 INFO:tasks.workunit.client.1.smithi138.stdout:5/385: getdents da/d43/d4a/d69 0 2024-02-07T12:25:31.425 INFO:tasks.workunit.client.1.smithi138.stdout:5/386: write da/d22/f62 [228053,61788] 0 2024-02-07T12:25:31.425 INFO:tasks.workunit.client.0.smithi047.stdout:seed = 1707412620 2024-02-07T12:25:31.426 INFO:tasks.workunit.client.1.smithi138.stdout:9/331: write d0/d6/f1e [2189685,70807] 0 2024-02-07T12:25:31.426 INFO:tasks.workunit.client.1.smithi138.stdout:9/332: truncate d0/d6/d8/d1d/dd/f63 423609 0 2024-02-07T12:25:31.427 INFO:tasks.workunit.client.1.smithi138.stdout:1/308: symlink d5/d5c/l69 0 2024-02-07T12:25:31.427 INFO:tasks.workunit.client.1.smithi138.stdout:1/309: truncate d5/d8/da/fe 4896615 0 2024-02-07T12:25:31.427 INFO:tasks.workunit.client.1.smithi138.stdout:3/504: mkdir d5/d27/d35/dad 0 2024-02-07T12:25:31.428 INFO:tasks.workunit.client.0.smithi047.stdout:0/0: readlink - no filename 2024-02-07T12:25:31.428 INFO:tasks.workunit.client.0.smithi047.stdout:0/1: write - no filename 2024-02-07T12:25:31.429 INFO:tasks.workunit.client.0.smithi047.stdout:0/2: chown . 25 1 2024-02-07T12:25:31.430 INFO:tasks.workunit.client.0.smithi047.stdout:0/3: mknod c0 0 2024-02-07T12:25:31.430 INFO:tasks.workunit.client.0.smithi047.stdout:0/4: rmdir - no directory 2024-02-07T12:25:31.430 INFO:tasks.workunit.client.0.smithi047.stdout:0/5: write - no filename 2024-02-07T12:25:31.430 INFO:tasks.workunit.client.0.smithi047.stdout:0/6: read - no filename 2024-02-07T12:25:31.430 INFO:tasks.workunit.client.0.smithi047.stdout:0/7: dwrite - no filename 2024-02-07T12:25:31.430 INFO:tasks.workunit.client.1.smithi138.stdout:8/541: read d1/de/d11/d17/d2e/fa1 [292160,78920] 0 2024-02-07T12:25:31.430 INFO:tasks.workunit.client.1.smithi138.stdout:8/542: truncate d1/de/d11/d17/d2e/f52 1520236 0 2024-02-07T12:25:31.431 INFO:tasks.workunit.client.1.smithi138.stdout:8/543: fsync d1/de/d11/d17/d2e/d3a/d50/fa0 0 2024-02-07T12:25:31.431 INFO:tasks.workunit.client.1.smithi138.stdout:8/544: fdatasync d1/f3f 0 2024-02-07T12:25:31.431 INFO:tasks.workunit.client.1.smithi138.stdout:7/559: rename d0/d6/d19/lb2 to d0/d6/d76/d93/lb7 0 2024-02-07T12:25:31.438 INFO:tasks.workunit.client.1.smithi138.stdout:2/491: mknod d3/dd/d14/d82/cb4 0 2024-02-07T12:25:31.438 INFO:tasks.workunit.client.1.smithi138.stdout:4/328: creat d20/d4d/f62 x:0 0 0 2024-02-07T12:25:31.440 INFO:tasks.workunit.client.1.smithi138.stdout:6/388: mknod dc/d13/d1e/d35/d6d/c7b 0 2024-02-07T12:25:31.441 INFO:tasks.workunit.client.1.smithi138.stdout:6/389: read dc/d13/d1e/f2b [2732852,84549] 0 2024-02-07T12:25:31.444 INFO:tasks.workunit.client.1.smithi138.stdout:3/505: rmdir d5/d27/d35/dad 0 2024-02-07T12:25:31.446 INFO:tasks.workunit.client.1.smithi138.stdout:5/387: write da/d6d/f5a [3122599,62160] 0 2024-02-07T12:25:31.446 INFO:tasks.workunit.client.1.smithi138.stdout:5/388: fsync da/d6d/d27/d2e/d4f/d2b/d35/d5d/f70 0 2024-02-07T12:25:31.449 INFO:tasks.workunit.client.1.smithi138.stdout:0/422: getdents d4/d9/de/d1d 0 2024-02-07T12:25:31.450 INFO:tasks.workunit.client.1.smithi138.stdout:4/329: creat d20/d34/d36/f63 x:0 0 0 2024-02-07T12:25:31.451 INFO:tasks.workunit.client.1.smithi138.stdout:2/492: creat d3/dd/d19/d44/d7d/fb5 x:0 0 0 2024-02-07T12:25:31.453 INFO:tasks.workunit.client.1.smithi138.stdout:4/330: read d20/d34/d36/f43 [223043,126036] 0 2024-02-07T12:25:31.453 INFO:tasks.workunit.client.1.smithi138.stdout:6/390: mkdir dc/d13/d1e/d35/d7c 0 2024-02-07T12:25:31.456 INFO:tasks.workunit.client.1.smithi138.stdout:3/506: mkdir d5/d26/d5e/d86/dae 0 2024-02-07T12:25:31.456 INFO:tasks.workunit.client.0.smithi047.stdout:3/0: truncate - no filename 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:1/0: write - no filename 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:1/1: rename - no filename 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:1/2: read - no filename 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:1/3: write - no filename 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:1/4: rename - no filename 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:1/5: dread - no filename 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:1/6: unlink - no file 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:1/7: rename - no filename 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:4/0: rename - no filename 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:4/1: chown . 559366 1 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:4/2: dread - no filename 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:4/3: fsync - no filename 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:4/4: dread - no filename 2024-02-07T12:25:31.457 INFO:tasks.workunit.client.0.smithi047.stdout:2/0: fsync - no filename 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:2/1: fsync - no filename 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:2/2: chown . 64780 1 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:5/0: truncate - no filename 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:6/0: write - no filename 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:6/1: readlink - no filename 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:8/0: chown . 3 1 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:6/2: fdatasync - no filename 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:6/3: dread - no filename 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:8/1: write - no filename 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:7/0: dread - no filename 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:8/2: chown . 2 1 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:8/3: dread - no filename 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:8/4: chown . 2274 1 2024-02-07T12:25:31.458 INFO:tasks.workunit.client.0.smithi047.stdout:6/4: chown . 4 1 2024-02-07T12:25:31.459 INFO:tasks.workunit.client.0.smithi047.stdout:6/5: unlink - no file 2024-02-07T12:25:31.459 INFO:tasks.workunit.client.0.smithi047.stdout:8/5: getdents . 0 2024-02-07T12:25:31.459 INFO:tasks.workunit.client.0.smithi047.stdout:8/6: write - no filename 2024-02-07T12:25:31.459 INFO:tasks.workunit.client.0.smithi047.stdout:8/7: truncate - no filename 2024-02-07T12:25:31.459 INFO:tasks.workunit.client.0.smithi047.stdout:9/0: chown . 19152 1 2024-02-07T12:25:31.459 INFO:tasks.workunit.client.0.smithi047.stdout:9/1: chown . 1 1 2024-02-07T12:25:31.459 INFO:tasks.workunit.client.1.smithi138.stdout:2/493: dread f0 [0,4194304] 0 2024-02-07T12:25:31.460 INFO:tasks.workunit.client.1.smithi138.stdout:5/389: getdents da/d6d/d27/d2e/d4f/d2b/d35/d5d 0 2024-02-07T12:25:31.463 INFO:tasks.workunit.client.1.smithi138.stdout:0/423: unlink d4/d9/de/d1d/d21/f31 0 2024-02-07T12:25:31.466 INFO:tasks.workunit.client.1.smithi138.stdout:4/331: truncate f3 516531 0 2024-02-07T12:25:31.466 INFO:tasks.workunit.client.1.smithi138.stdout:8/545: dwrite d1/de/d11/d17/d2e/d49/f19 [0,4194304] 0 2024-02-07T12:25:31.467 INFO:tasks.workunit.client.1.smithi138.stdout:7/560: dwrite d0/d8/d11/d5f/d86/f9d [0,4194304] 0 2024-02-07T12:25:31.469 INFO:tasks.workunit.client.0.smithi047.stdout:1/8: creat f0 x:0 0 0 2024-02-07T12:25:31.469 INFO:tasks.workunit.client.0.smithi047.stdout:1/9: chown f0 706605 1 2024-02-07T12:25:31.469 INFO:tasks.workunit.client.0.smithi047.stdout:1/10: dread - f0 zero size 2024-02-07T12:25:31.469 INFO:tasks.workunit.client.0.smithi047.stdout:1/11: read - f0 zero size 2024-02-07T12:25:31.471 INFO:tasks.workunit.client.0.smithi047.stdout:3/1: symlink l0 0 2024-02-07T12:25:31.471 INFO:tasks.workunit.client.1.smithi138.stdout:2/494: dread d3/f12 [0,4194304] 0 2024-02-07T12:25:31.472 INFO:tasks.workunit.client.1.smithi138.stdout:3/507: symlink d5/d15/d96/laf 0 2024-02-07T12:25:31.472 INFO:tasks.workunit.client.0.smithi047.stdout:4/5: symlink l0 0 2024-02-07T12:25:31.472 INFO:tasks.workunit.client.1.smithi138.stdout:2/495: write d3/dd/d14/d49/d25/d3d/f52 [1306734,82099] 0 2024-02-07T12:25:31.473 INFO:tasks.workunit.client.1.smithi138.stdout:9/333: dwrite d0/f2c [0,4194304] 0 2024-02-07T12:25:31.473 INFO:tasks.workunit.client.1.smithi138.stdout:9/334: chown d0/d6/l44 24181 1 2024-02-07T12:25:31.473 INFO:tasks.workunit.client.0.smithi047.stdout:2/3: creat f0 x:0 0 0 2024-02-07T12:25:31.474 INFO:tasks.workunit.client.0.smithi047.stdout:5/1: mknod c0 0 2024-02-07T12:25:31.474 INFO:tasks.workunit.client.0.smithi047.stdout:5/2: fsync - no filename 2024-02-07T12:25:31.475 INFO:tasks.workunit.client.0.smithi047.stdout:7/1: mkdir d0 0 2024-02-07T12:25:31.475 INFO:tasks.workunit.client.0.smithi047.stdout:7/2: dwrite - no filename 2024-02-07T12:25:31.475 INFO:tasks.workunit.client.1.smithi138.stdout:0/424: symlink d4/d9/l83 0 2024-02-07T12:25:31.476 INFO:tasks.workunit.client.0.smithi047.stdout:6/6: symlink l0 0 2024-02-07T12:25:31.476 INFO:tasks.workunit.client.0.smithi047.stdout:6/7: fsync - no filename 2024-02-07T12:25:31.477 INFO:tasks.workunit.client.0.smithi047.stdout:8/8: mknod c0 0 2024-02-07T12:25:31.477 INFO:tasks.workunit.client.1.smithi138.stdout:8/546: mkdir d1/d99/da6 0 2024-02-07T12:25:31.477 INFO:tasks.workunit.client.0.smithi047.stdout:9/2: symlink l0 0 2024-02-07T12:25:31.478 INFO:tasks.workunit.client.1.smithi138.stdout:7/561: mknod d0/d8/d11/d1f/cb8 0 2024-02-07T12:25:31.479 INFO:tasks.workunit.client.1.smithi138.stdout:5/390: dwrite da/d6d/d27/d2e/d4f/d2b/f36 [0,4194304] 0 2024-02-07T12:25:31.479 INFO:tasks.workunit.client.1.smithi138.stdout:5/391: truncate da/d50/f56 692302 0 2024-02-07T12:25:31.479 INFO:tasks.workunit.client.1.smithi138.stdout:5/392: truncate da/d6d/f6b 431991 0 2024-02-07T12:25:31.479 INFO:tasks.workunit.client.1.smithi138.stdout:6/391: rmdir dc/d31/d54 39 2024-02-07T12:25:31.481 INFO:tasks.workunit.client.1.smithi138.stdout:4/332: dread f16 [0,4194304] 0 2024-02-07T12:25:31.481 INFO:tasks.workunit.client.1.smithi138.stdout:4/333: write d20/f26 [2134232,39945] 0 2024-02-07T12:25:31.482 INFO:tasks.workunit.client.1.smithi138.stdout:9/335: write d0/d6/d8/d1d/f1c [1061639,128691] 0 2024-02-07T12:25:31.482 INFO:tasks.workunit.client.1.smithi138.stdout:9/336: chown d0/d6/d8/d1d 5052 1 2024-02-07T12:25:31.485 INFO:tasks.workunit.client.0.smithi047.stdout:2/4: rename f0 to f1 0 2024-02-07T12:25:31.485 INFO:tasks.workunit.client.0.smithi047.stdout:2/5: creat f2 x:0 0 0 2024-02-07T12:25:31.485 INFO:tasks.workunit.client.1.smithi138.stdout:9/337: dread d0/d6/d8/d1d/dd/d41/d5e/f67 [0,4194304] 0 2024-02-07T12:25:31.486 INFO:tasks.workunit.client.0.smithi047.stdout:5/3: symlink l1 0 2024-02-07T12:25:31.487 INFO:tasks.workunit.client.1.smithi138.stdout:0/425: mknod d4/d9/db/d71/c84 0 2024-02-07T12:25:31.488 INFO:tasks.workunit.client.1.smithi138.stdout:7/562: rename d0/f8b to d0/d8/d11/d26/fb9 0 2024-02-07T12:25:31.492 INFO:tasks.workunit.client.0.smithi047.stdout:8/9: symlink l1 0 2024-02-07T12:25:31.492 INFO:tasks.workunit.client.0.smithi047.stdout:6/8: mknod c1 0 2024-02-07T12:25:31.492 INFO:tasks.workunit.client.0.smithi047.stdout:6/9: readlink l0 0 2024-02-07T12:25:31.492 INFO:tasks.workunit.client.0.smithi047.stdout:6/10: fdatasync - no filename 2024-02-07T12:25:31.492 INFO:tasks.workunit.client.0.smithi047.stdout:6/11: chown c1 0 1 2024-02-07T12:25:31.492 INFO:tasks.workunit.client.1.smithi138.stdout:3/508: dwrite d5/d34/d79/f7a [0,4194304] 0 2024-02-07T12:25:31.493 INFO:tasks.workunit.client.0.smithi047.stdout:2/6: mknod c3 0 2024-02-07T12:25:31.494 INFO:tasks.workunit.client.0.smithi047.stdout:5/4: rename c0 to c2 0 2024-02-07T12:25:31.496 INFO:tasks.workunit.client.0.smithi047.stdout:8/10: creat f2 x:0 0 0 2024-02-07T12:25:31.496 INFO:tasks.workunit.client.1.smithi138.stdout:5/393: mknod da/d6d/d27/d2e/d4f/d2b/d59/c78 0 2024-02-07T12:25:31.496 INFO:tasks.workunit.client.1.smithi138.stdout:5/394: creat da/d6d/d27/d2e/f79 x:0 0 0 2024-02-07T12:25:31.497 INFO:tasks.workunit.client.1.smithi138.stdout:6/392: creat dc/d13/d1e/d35/d6d/f7d x:0 0 0 2024-02-07T12:25:31.498 INFO:tasks.workunit.client.1.smithi138.stdout:9/338: dread d0/d34/d45/f43 [0,4194304] 0 2024-02-07T12:25:31.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.497+0000 7f592b7fe700 1 -- 172.21.15.47:0/1115788519 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f592000e070 con 0x7f592c06eeb0 2024-02-07T12:25:31.499 INFO:tasks.workunit.client.0.smithi047.stdout:6/12: creat f2 x:0 0 0 2024-02-07T12:25:31.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.497+0000 7f59331ab700 1 -- 172.21.15.47:0/1115788519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f592c06eeb0 msgr2=0x7f592c108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:31.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.497+0000 7f59331ab700 1 --2- 172.21.15.47:0/1115788519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f592c06eeb0 0x7f592c108fb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5920004940 tx=0x7f5920009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:31.500 INFO:tasks.workunit.client.0.smithi047.stdout:6/13: write f2 [535181,97727] 0 2024-02-07T12:25:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.497+0000 7f59331ab700 1 -- 172.21.15.47:0/1115788519 shutdown_connections 2024-02-07T12:25:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.497+0000 7f59331ab700 1 --2- 172.21.15.47:0/1115788519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f592c06eeb0 0x7f592c108fb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.497+0000 7f59331ab700 1 --2- 172.21.15.47:0/1115788519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f592c06e560 0x7f592c06e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.497+0000 7f59331ab700 1 -- 172.21.15.47:0/1115788519 >> 172.21.15.47:0/1115788519 conn(0x7f592c069e70 msgr2=0x7f592c06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.498+0000 7f59331ab700 1 -- 172.21.15.47:0/1115788519 shutdown_connections 2024-02-07T12:25:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.498+0000 7f59331ab700 1 -- 172.21.15.47:0/1115788519 wait complete. 2024-02-07T12:25:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.498+0000 7f59331ab700 1 Processor -- start 2024-02-07T12:25:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.499+0000 7f59331ab700 1 -- start start 2024-02-07T12:25:31.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.499+0000 7f59331ab700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f592c06e560 0x7f592c11c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:31.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.499+0000 7f59331ab700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f592c06eeb0 0x7f592c11cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:31.502 INFO:tasks.workunit.client.1.smithi138.stdout:3/509: truncate d5/d26/d28/f4d 1266441 0 2024-02-07T12:25:31.502 INFO:tasks.workunit.client.1.smithi138.stdout:3/510: chown d5/d27/d35/f50 12856800 1 2024-02-07T12:25:31.502 INFO:tasks.workunit.client.0.smithi047.stdout:2/7: link c3 c4 0 2024-02-07T12:25:31.503 INFO:tasks.workunit.client.0.smithi047.stdout:2/8: creat f5 x:0 0 0 2024-02-07T12:25:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.499+0000 7f59331ab700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c11d450 con 0x7f592c06e560 2024-02-07T12:25:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.499+0000 7f59331ab700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c11dc90 con 0x7f592c06eeb0 2024-02-07T12:25:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.499+0000 7f592bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f592c06eeb0 0x7f592c11cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.499+0000 7f592bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f592c06eeb0 0x7f592c11cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.47:40612/0 (socket says 172.21.15.47:40612) 2024-02-07T12:25:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.499+0000 7f592bfff700 1 -- 172.21.15.47:0/287114255 learned_addr learned my addr 172.21.15.47:0/287114255 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:25:31.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.500+0000 7f5930f47700 1 --2- 172.21.15.47:0/287114255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f592c06e560 0x7f592c11c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:31.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.500+0000 7f592bfff700 1 -- 172.21.15.47:0/287114255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f592c06e560 msgr2=0x7f592c11c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:31.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.500+0000 7f592bfff700 1 --2- 172.21.15.47:0/287114255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f592c06e560 0x7f592c11c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:31.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.500+0000 7f592bfff700 1 -- 172.21.15.47:0/287114255 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920005040 con 0x7f592c06eeb0 2024-02-07T12:25:31.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.500+0000 7f592bfff700 1 --2- 172.21.15.47:0/287114255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f592c06eeb0 0x7f592c11cdc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5920004890 tx=0x7f5920009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:31.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.500+0000 7f59297fa700 1 -- 172.21.15.47:0/287114255 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f592000e040 con 0x7f592c06eeb0 2024-02-07T12:25:31.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.501+0000 7f59297fa700 1 -- 172.21.15.47:0/287114255 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f592000bc50 con 0x7f592c06eeb0 2024-02-07T12:25:31.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.501+0000 7f59297fa700 1 -- 172.21.15.47:0/287114255 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f592001c3f0 con 0x7f592c06eeb0 2024-02-07T12:25:31.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.501+0000 7f59331ab700 1 -- 172.21.15.47:0/287114255 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c11df10 con 0x7f592c06eeb0 2024-02-07T12:25:31.504 INFO:tasks.workunit.client.0.smithi047.stdout:5/5: creat f3 x:0 0 0 2024-02-07T12:25:31.504 INFO:tasks.workunit.client.0.smithi047.stdout:5/6: dread - f3 zero size 2024-02-07T12:25:31.505 INFO:tasks.workunit.client.0.smithi047.stdout:5/7: truncate f3 609343 0 2024-02-07T12:25:31.505 INFO:tasks.workunit.client.0.smithi047.stdout:5/8: write f3 [634867,78089] 0 2024-02-07T12:25:31.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.501+0000 7f59331ab700 1 -- 172.21.15.47:0/287114255 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c11e450 con 0x7f592c06eeb0 2024-02-07T12:25:31.505 INFO:tasks.workunit.client.0.smithi047.stdout:8/11: mkdir d3 0 2024-02-07T12:25:31.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.502+0000 7f59331ab700 1 -- 172.21.15.47:0/287114255 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c116930 con 0x7f592c06eeb0 2024-02-07T12:25:31.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.503+0000 7f59297fa700 1 -- 172.21.15.47:0/287114255 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 20) v1 ==== 88827+0+0 (secure 0 0 0) 0x7f5920013420 con 0x7f592c06eeb0 2024-02-07T12:25:31.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.503+0000 7f59297fa700 1 --2- 172.21.15.47:0/287114255 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f591c06b1c0 0x7f591c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:31.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.503+0000 7f59297fa700 1 -- 172.21.15.47:0/287114255 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f592008ac10 con 0x7f592c06eeb0 2024-02-07T12:25:31.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.504+0000 7f5930f47700 1 --2- 172.21.15.47:0/287114255 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f591c06b1c0 0x7f591c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.504+0000 7f5930f47700 1 --2- 172.21.15.47:0/287114255 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f591c06b1c0 0x7f591c06d670 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f592c06e1d0 tx=0x7f59180090f0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:31.507 INFO:tasks.workunit.client.1.smithi138.stdout:5/395: link da/d6d/d27/d2e/d4f/d2b/f36 da/d43/d4a/d69/f7a 0 2024-02-07T12:25:31.507 INFO:tasks.workunit.client.1.smithi138.stdout:8/547: dwrite d1/de/d11/d17/f24 [0,4194304] 0 2024-02-07T12:25:31.507 INFO:tasks.workunit.client.0.smithi047.stdout:6/14: mkdir d3 0 2024-02-07T12:25:31.508 INFO:tasks.workunit.client.1.smithi138.stdout:6/393: rename dc/d31/f47 to dc/d13/d1e/d24/f7e 0 2024-02-07T12:25:31.509 INFO:tasks.workunit.client.1.smithi138.stdout:9/339: mknod d0/d6/d64/c6e 0 2024-02-07T12:25:31.509 INFO:tasks.workunit.client.1.smithi138.stdout:9/340: write d0/d34/d45/f69 [388000,23683] 0 2024-02-07T12:25:31.509 INFO:tasks.workunit.client.1.smithi138.stdout:9/341: creat d0/f6f x:0 0 0 2024-02-07T12:25:31.509 INFO:tasks.workunit.client.1.smithi138.stdout:9/342: dread - d0/f6f zero size 2024-02-07T12:25:31.509 INFO:tasks.workunit.client.1.smithi138.stdout:3/511: symlink d5/d26/d5e/d86/d9c/lb0 0 2024-02-07T12:25:31.510 INFO:tasks.workunit.client.0.smithi047.stdout:8/12: mkdir d3/d4 0 2024-02-07T12:25:31.510 INFO:tasks.workunit.client.1.smithi138.stdout:5/396: getdents da/d6d/d27/d2e/d4f/d2b 0 2024-02-07T12:25:31.511 INFO:tasks.workunit.client.1.smithi138.stdout:4/334: dwrite f13 [0,4194304] 0 2024-02-07T12:25:31.511 INFO:tasks.workunit.client.1.smithi138.stdout:7/563: dwrite d0/d8/d11/d26/d90/f9e [0,4194304] 0 2024-02-07T12:25:31.511 INFO:tasks.workunit.client.1.smithi138.stdout:7/564: stat d0/d8/d11/d1f/f56 0 2024-02-07T12:25:31.511 INFO:tasks.workunit.client.1.smithi138.stdout:4/335: creat d20/d53/f64 x:0 0 0 2024-02-07T12:25:31.511 INFO:tasks.workunit.client.0.smithi047.stdout:6/15: mkdir d3/d4 0 2024-02-07T12:25:31.513 INFO:tasks.workunit.client.0.smithi047.stdout:8/13: unlink f2 0 2024-02-07T12:25:31.515 INFO:tasks.workunit.client.0.smithi047.stdout:6/16: rmdir d3/d4 0 2024-02-07T12:25:31.515 INFO:tasks.workunit.client.0.smithi047.stdout:6/17: chown c1 52973530 1 2024-02-07T12:25:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.513+0000 7f59297fa700 1 -- 172.21.15.47:0/287114255 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f592005ab00 con 0x7f592c06eeb0 2024-02-07T12:25:31.518 INFO:tasks.workunit.client.0.smithi047.stdout:8/14: link l1 d3/d4/l5 0 2024-02-07T12:25:31.518 INFO:tasks.workunit.client.0.smithi047.stdout:8/15: dread - no filename 2024-02-07T12:25:31.518 INFO:tasks.workunit.client.0.smithi047.stdout:8/16: dread - no filename 2024-02-07T12:25:31.520 INFO:tasks.workunit.client.0.smithi047.stdout:6/18: mkdir d3/d5 0 2024-02-07T12:25:31.521 INFO:tasks.workunit.client.0.smithi047.stdout:6/19: write f2 [363014,65375] 0 2024-02-07T12:25:31.521 INFO:tasks.workunit.client.1.smithi138.stdout:7/565: creat d0/d8/db3/fba x:0 0 0 2024-02-07T12:25:31.525 INFO:tasks.workunit.client.1.smithi138.stdout:4/336: rename d20/f31 to d20/d34/d36/f65 0 2024-02-07T12:25:31.532 INFO:tasks.workunit.client.1.smithi138.stdout:7/566: rename d0/d6/f4d to d0/d6/d76/d93/fbb 0 2024-02-07T12:25:31.532 INFO:tasks.workunit.client.1.smithi138.stdout:4/337: mknod d20/d47/c66 0 2024-02-07T12:25:31.532 INFO:tasks.workunit.client.1.smithi138.stdout:4/338: write d20/d4d/f5a [671531,105301] 0 2024-02-07T12:25:31.534 INFO:tasks.workunit.client.1.smithi138.stdout:7/567: creat d0/d39/d8a/fbc x:0 0 0 2024-02-07T12:25:31.534 INFO:tasks.workunit.client.1.smithi138.stdout:7/568: read - d0/d6/d1d/d38/f8d zero size 2024-02-07T12:25:31.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:31 smithi138 ceph-mon[35528]: pgmap v257: 65 pgs: 65 active+clean; 748 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 70 MiB/s rd, 91 MiB/s wr, 794 op/s 2024-02-07T12:25:31.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:31 smithi138 ceph-mon[35528]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:31.537 INFO:tasks.workunit.client.1.smithi138.stdout:7/569: dread d0/d6/d76/d93/f57 [0,4194304] 0 2024-02-07T12:25:31.538 INFO:tasks.workunit.client.1.smithi138.stdout:4/339: dread d20/d34/d36/f43 [0,4194304] 0 2024-02-07T12:25:31.538 INFO:tasks.workunit.client.1.smithi138.stdout:7/570: symlink d0/d6/d84/lbd 0 2024-02-07T12:25:31.538 INFO:tasks.workunit.client.1.smithi138.stdout:7/571: chown d0/d8/d11/d5f/d86/la8 57 1 2024-02-07T12:25:31.538 INFO:tasks.workunit.client.1.smithi138.stdout:3/512: dwrite d5/d26/d4e/fa6 [0,4194304] 0 2024-02-07T12:25:31.539 INFO:tasks.workunit.client.1.smithi138.stdout:4/340: symlink d20/d47/l67 0 2024-02-07T12:25:31.540 INFO:tasks.workunit.client.1.smithi138.stdout:9/343: dwrite d0/d6/d8/d1d/dd/f63 [0,4194304] 0 2024-02-07T12:25:31.541 INFO:tasks.workunit.client.0.smithi047.stdout:6/20: fdatasync f2 0 2024-02-07T12:25:31.541 INFO:tasks.workunit.client.0.smithi047.stdout:6/21: write f2 [235444,91646] 0 2024-02-07T12:25:31.542 INFO:tasks.workunit.client.1.smithi138.stdout:5/397: dwrite da/d6d/f13 [0,4194304] 0 2024-02-07T12:25:31.542 INFO:tasks.workunit.client.1.smithi138.stdout:8/548: dwrite d1/de/d11/d17/d3e/f4e [0,4194304] 0 2024-02-07T12:25:31.542 INFO:tasks.workunit.client.1.smithi138.stdout:7/572: unlink d0/d6/d76/d93/f7f 0 2024-02-07T12:25:31.542 INFO:tasks.workunit.client.1.smithi138.stdout:7/573: dread - d0/d6/d1d/fb4 zero size 2024-02-07T12:25:31.548 INFO:tasks.workunit.client.1.smithi138.stdout:4/341: truncate d20/f33 2134672 0 2024-02-07T12:25:31.554 INFO:tasks.workunit.client.0.smithi047.stdout:6/22: dread f2 [0,4194304] 0 2024-02-07T12:25:31.560 INFO:tasks.workunit.client.1.smithi138.stdout:3/513: dwrite d5/d26/f2c [0,4194304] 0 2024-02-07T12:25:31.561 INFO:tasks.workunit.client.1.smithi138.stdout:8/549: link d1/de/d11/d17/d2e/f78 d1/de/d11/d17/d2e/d3a/d50/fa7 0 2024-02-07T12:25:31.563 INFO:tasks.workunit.client.1.smithi138.stdout:7/574: mknod d0/d39/cbe 0 2024-02-07T12:25:31.563 INFO:tasks.workunit.client.1.smithi138.stdout:7/575: creat d0/d8/db3/fbf x:0 0 0 2024-02-07T12:25:31.565 INFO:tasks.workunit.client.1.smithi138.stdout:5/398: dwrite da/f24 [0,4194304] 0 2024-02-07T12:25:31.566 INFO:tasks.workunit.client.1.smithi138.stdout:4/342: rename lf to d20/d53/l68 0 2024-02-07T12:25:31.568 INFO:tasks.workunit.client.0.smithi047.stdout:1/12: fsync f0 0 2024-02-07T12:25:31.568 INFO:tasks.workunit.client.0.smithi047.stdout:1/13: stat f0 0 2024-02-07T12:25:31.568 INFO:tasks.workunit.client.0.smithi047.stdout:1/14: stat f0 0 2024-02-07T12:25:31.568 INFO:tasks.workunit.client.0.smithi047.stdout:1/15: readlink - no filename 2024-02-07T12:25:31.569 INFO:tasks.workunit.client.1.smithi138.stdout:9/344: mknod d0/d6/d8/d1d/dd/d1f/c70 0 2024-02-07T12:25:31.569 INFO:tasks.workunit.client.1.smithi138.stdout:9/345: dread - d0/d6/d8/f6d zero size 2024-02-07T12:25:31.569 INFO:tasks.workunit.client.1.smithi138.stdout:9/346: chown d0/f38 1 1 2024-02-07T12:25:31.573 INFO:tasks.workunit.client.1.smithi138.stdout:3/514: creat d5/d26/d5e/d86/dae/fb1 x:0 0 0 2024-02-07T12:25:31.573 INFO:tasks.workunit.client.1.smithi138.stdout:3/515: write d5/d26/d5e/f8a [356931,102005] 0 2024-02-07T12:25:31.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:31 smithi047 ceph-mon[28972]: pgmap v257: 65 pgs: 65 active+clean; 748 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 70 MiB/s rd, 91 MiB/s wr, 794 op/s 2024-02-07T12:25:31.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:31 smithi047 ceph-mon[28972]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:31.577 INFO:tasks.workunit.client.0.smithi047.stdout:2/9: unlink f1 0 2024-02-07T12:25:31.577 INFO:tasks.workunit.client.0.smithi047.stdout:6/23: dwrite f2 [0,4194304] 0 2024-02-07T12:25:31.580 INFO:tasks.workunit.client.0.smithi047.stdout:6/24: creat d3/d5/f6 x:0 0 0 2024-02-07T12:25:31.585 INFO:tasks.workunit.client.1.smithi138.stdout:5/399: truncate da/f1f 474695 0 2024-02-07T12:25:31.585 INFO:tasks.workunit.client.1.smithi138.stdout:7/576: rename d0/d39/f46 to d0/d8/d15/fc0 0 2024-02-07T12:25:31.585 INFO:tasks.workunit.client.0.smithi047.stdout:5/9: rename c2 to c4 0 2024-02-07T12:25:31.585 INFO:tasks.workunit.client.0.smithi047.stdout:5/10: creat f5 x:0 0 0 2024-02-07T12:25:31.585 INFO:tasks.workunit.client.0.smithi047.stdout:5/11: chown l1 11 1 2024-02-07T12:25:31.589 INFO:tasks.workunit.client.0.smithi047.stdout:1/16: dwrite f0 [0,4194304] 0 2024-02-07T12:25:31.590 INFO:tasks.workunit.client.1.smithi138.stdout:9/347: dwrite d0/d34/d45/f6c [0,4194304] 0 2024-02-07T12:25:31.590 INFO:tasks.workunit.client.1.smithi138.stdout:9/348: chown d0/d6/d8/f52 4366 1 2024-02-07T12:25:31.592 INFO:tasks.workunit.client.0.smithi047.stdout:1/17: mkdir d1 0 2024-02-07T12:25:31.594 INFO:tasks.workunit.client.0.smithi047.stdout:8/17: getdents d3 0 2024-02-07T12:25:31.594 INFO:tasks.workunit.client.0.smithi047.stdout:8/18: dwrite - no filename 2024-02-07T12:25:31.595 INFO:tasks.workunit.client.0.smithi047.stdout:8/19: link d3/d4/l5 d3/l6 0 2024-02-07T12:25:31.596 INFO:tasks.workunit.client.1.smithi138.stdout:3/516: creat d5/d27/d35/dac/fb2 x:0 0 0 2024-02-07T12:25:31.598 INFO:tasks.workunit.client.0.smithi047.stdout:8/20: creat d3/d4/f7 x:0 0 0 2024-02-07T12:25:31.598 INFO:tasks.workunit.client.1.smithi138.stdout:8/550: getdents d1/de/d11/d17/d3e/d72 0 2024-02-07T12:25:31.599 INFO:tasks.workunit.client.1.smithi138.stdout:5/400: stat da/d6d/f17 0 2024-02-07T12:25:31.599 INFO:tasks.workunit.client.0.smithi047.stdout:5/12: dwrite f3 [0,4194304] 0 2024-02-07T12:25:31.604 INFO:tasks.workunit.client.1.smithi138.stdout:7/577: rename d0/d6/d1d/d38/c96 to d0/d8/d15/db1/cc1 0 2024-02-07T12:25:31.610 INFO:tasks.workunit.client.1.smithi138.stdout:4/343: getdents d20/d34/d36 0 2024-02-07T12:25:31.612 INFO:tasks.workunit.client.0.smithi047.stdout:1/18: dwrite f0 [0,4194304] 0 2024-02-07T12:25:31.617 INFO:tasks.workunit.client.1.smithi138.stdout:3/517: rmdir d5/d26/d9b 39 2024-02-07T12:25:31.618 INFO:tasks.workunit.client.1.smithi138.stdout:8/551: truncate d1/de/d11/d17/d2e/d49/f8 493586 0 2024-02-07T12:25:31.619 INFO:tasks.workunit.client.1.smithi138.stdout:5/401: creat da/d6d/d27/f7b x:0 0 0 2024-02-07T12:25:31.621 INFO:tasks.workunit.client.1.smithi138.stdout:5/402: write da/f1f [190059,81571] 0 2024-02-07T12:25:31.622 INFO:tasks.workunit.client.0.smithi047.stdout:8/21: dwrite d3/d4/f7 [0,4194304] 0 2024-02-07T12:25:31.622 INFO:tasks.workunit.client.0.smithi047.stdout:8/22: rename d3 to d3/d8 22 2024-02-07T12:25:31.623 INFO:tasks.workunit.client.0.smithi047.stdout:5/13: dwrite f5 [0,4194304] 0 2024-02-07T12:25:31.624 INFO:tasks.workunit.client.1.smithi138.stdout:4/344: mkdir d20/d47/d69 0 2024-02-07T12:25:31.624 INFO:tasks.workunit.client.1.smithi138.stdout:4/345: fdatasync d20/f40 0 2024-02-07T12:25:31.628 INFO:tasks.workunit.client.1.smithi138.stdout:3/518: symlink d5/d27/d35/lb3 0 2024-02-07T12:25:31.631 INFO:tasks.workunit.client.1.smithi138.stdout:5/403: creat da/d6d/f7c x:0 0 0 2024-02-07T12:25:31.631 INFO:tasks.workunit.client.1.smithi138.stdout:5/404: stat da/d43/d4a/f74 0 2024-02-07T12:25:31.631 INFO:tasks.workunit.client.1.smithi138.stdout:5/405: fsync da/d6d/d27/d2e/d4f/d2b/d35/d40/f45 0 2024-02-07T12:25:31.631 INFO:tasks.workunit.client.1.smithi138.stdout:7/578: dread d0/d8/d11/d63/f7a [0,4194304] 0 2024-02-07T12:25:31.631 INFO:tasks.workunit.client.1.smithi138.stdout:7/579: stat d0/d8/db3 0 2024-02-07T12:25:31.632 INFO:tasks.workunit.client.1.smithi138.stdout:4/346: truncate f3 339755 0 2024-02-07T12:25:31.633 INFO:tasks.workunit.client.1.smithi138.stdout:5/406: symlink da/d43/l7d 0 2024-02-07T12:25:31.635 INFO:tasks.workunit.client.1.smithi138.stdout:1/310: sync 2024-02-07T12:25:31.635 INFO:tasks.workunit.client.1.smithi138.stdout:1/311: chown d5/d8/da/d4a/l5f 1 1 2024-02-07T12:25:31.636 INFO:tasks.workunit.client.1.smithi138.stdout:4/347: dread fd [0,4194304] 0 2024-02-07T12:25:31.636 INFO:tasks.workunit.client.1.smithi138.stdout:7/580: mknod d0/d39/cc2 0 2024-02-07T12:25:31.637 INFO:tasks.workunit.client.1.smithi138.stdout:8/552: dwrite d1/de/d11/f30 [0,4194304] 0 2024-02-07T12:25:31.637 INFO:tasks.workunit.client.1.smithi138.stdout:8/553: stat d1/de/d11/d17/d3e 0 2024-02-07T12:25:31.637 INFO:tasks.workunit.client.1.smithi138.stdout:5/407: truncate da/f24 2360034 0 2024-02-07T12:25:31.639 INFO:tasks.workunit.client.1.smithi138.stdout:1/312: mknod d5/d8/da/d1f/d60/c6a 0 2024-02-07T12:25:31.641 INFO:tasks.workunit.client.1.smithi138.stdout:4/348: truncate d20/d4d/f5a 698343 0 2024-02-07T12:25:31.643 INFO:tasks.workunit.client.1.smithi138.stdout:5/408: mknod da/d6d/d27/d2e/d4f/d2b/d35/d5d/d73/c7e 0 2024-02-07T12:25:31.644 INFO:tasks.workunit.client.1.smithi138.stdout:4/349: truncate d20/f39 2318033 0 2024-02-07T12:25:31.649 INFO:tasks.workunit.client.1.smithi138.stdout:5/409: dread da/d6d/d27/f33 [0,4194304] 0 2024-02-07T12:25:31.649 INFO:tasks.workunit.client.1.smithi138.stdout:5/410: readlink da/d6d/d27/d2e/l3f 0 2024-02-07T12:25:31.652 INFO:tasks.workunit.client.1.smithi138.stdout:5/411: creat da/d6d/d27/d2e/d4f/d2b/d59/f7f x:0 0 0 2024-02-07T12:25:31.656 INFO:tasks.workunit.client.1.smithi138.stdout:5/412: creat da/d34/f80 x:0 0 0 2024-02-07T12:25:31.659 INFO:tasks.workunit.client.1.smithi138.stdout:7/581: dwrite d0/d8/d11/d5f/d86/f92 [0,4194304] 0 2024-02-07T12:25:31.663 INFO:tasks.workunit.client.1.smithi138.stdout:8/554: dwrite d1/de/d11/d17/d58/f97 [0,4194304] 0 2024-02-07T12:25:31.663 INFO:tasks.workunit.client.1.smithi138.stdout:8/555: chown d1/de/d11/d17/d2e/f79 121015711 1 2024-02-07T12:25:31.667 INFO:tasks.workunit.client.1.smithi138.stdout:8/556: mkdir d1/de/d11/d17/da8 0 2024-02-07T12:25:31.667 INFO:tasks.workunit.client.1.smithi138.stdout:8/557: fsync d1/de/d11/d17/d2e/d3a/d50/fa0 0 2024-02-07T12:25:31.671 INFO:tasks.workunit.client.1.smithi138.stdout:4/350: dwrite f1c [0,4194304] 0 2024-02-07T12:25:31.671 INFO:tasks.workunit.client.1.smithi138.stdout:4/351: chown d20/d4d/f62 57 1 2024-02-07T12:25:31.671 INFO:tasks.workunit.client.1.smithi138.stdout:4/352: creat d20/d53/f6a x:0 0 0 2024-02-07T12:25:31.672 INFO:tasks.workunit.client.1.smithi138.stdout:8/558: read d1/de/d11/f5b [1772324,101879] 0 2024-02-07T12:25:31.676 INFO:tasks.workunit.client.1.smithi138.stdout:8/559: unlink d1/de/d11/d17/c6e 0 2024-02-07T12:25:31.679 INFO:tasks.workunit.client.1.smithi138.stdout:8/560: link d1/de/d11/d17/d3e/l71 d1/de/d11/d17/d58/la9 0 2024-02-07T12:25:31.679 INFO:tasks.workunit.client.1.smithi138.stdout:8/561: creat d1/de/d11/d17/d58/faa x:0 0 0 2024-02-07T12:25:31.679 INFO:tasks.workunit.client.1.smithi138.stdout:8/562: read d1/de/d11/d17/d3e/d72/f88 [936451,120988] 0 2024-02-07T12:25:31.682 INFO:tasks.workunit.client.1.smithi138.stdout:1/313: dwrite d5/d8/f3b [0,4194304] 0 2024-02-07T12:25:31.682 INFO:tasks.workunit.client.1.smithi138.stdout:1/314: chown d5/d8/da/fe 60 1 2024-02-07T12:25:31.682 INFO:tasks.workunit.client.1.smithi138.stdout:8/563: getdents d1/de/d11/d17/d3e/d72/d95 0 2024-02-07T12:25:31.682 INFO:tasks.workunit.client.1.smithi138.stdout:8/564: readlink d1/de/d11/d17/d2e/d49/l6d 0 2024-02-07T12:25:31.684 INFO:tasks.workunit.client.1.smithi138.stdout:1/315: getdents d5/d8/da/d4a 0 2024-02-07T12:25:31.684 INFO:tasks.workunit.client.1.smithi138.stdout:1/316: dread - d5/d8/da/f47 zero size 2024-02-07T12:25:31.690 INFO:tasks.workunit.client.1.smithi138.stdout:8/565: dread d1/de/d11/d17/d3e/f4e [0,4194304] 0 2024-02-07T12:25:31.690 INFO:tasks.workunit.client.1.smithi138.stdout:5/413: dwrite da/d34/f80 [0,4194304] 0 2024-02-07T12:25:31.691 INFO:tasks.workunit.client.1.smithi138.stdout:8/566: mknod d1/de/d11/d17/d8a/cab 0 2024-02-07T12:25:31.692 INFO:tasks.workunit.client.1.smithi138.stdout:7/582: dwrite d0/d39/f9c [0,4194304] 0 2024-02-07T12:25:31.692 INFO:tasks.workunit.client.1.smithi138.stdout:4/353: dwrite d20/d34/d36/f44 [0,4194304] 0 2024-02-07T12:25:31.692 INFO:tasks.workunit.client.1.smithi138.stdout:4/354: write f3 [1328438,105036] 0 2024-02-07T12:25:31.695 INFO:tasks.workunit.client.1.smithi138.stdout:1/317: dread d5/d8/da/d15/f24 [0,4194304] 0 2024-02-07T12:25:31.695 INFO:tasks.workunit.client.1.smithi138.stdout:5/414: unlink da/d6d/d27/d2e/d4f/l55 0 2024-02-07T12:25:31.695 INFO:tasks.workunit.client.0.smithi047.stdout:1/19: creat d1/f2 x:0 0 0 2024-02-07T12:25:31.696 INFO:tasks.workunit.client.1.smithi138.stdout:8/567: stat d1/de/d11/d17/d2e/d49/d4c/l77 0 2024-02-07T12:25:31.699 INFO:tasks.workunit.client.0.smithi047.stdout:8/23: creat d3/f9 x:0 0 0 2024-02-07T12:25:31.700 INFO:tasks.workunit.client.0.smithi047.stdout:8/24: stat d3 0 2024-02-07T12:25:31.700 INFO:tasks.workunit.client.0.smithi047.stdout:8/25: creat d3/d4/fa x:0 0 0 2024-02-07T12:25:31.700 INFO:tasks.workunit.client.0.smithi047.stdout:8/26: chown d3/d4 976654535 1 2024-02-07T12:25:31.702 INFO:tasks.workunit.client.1.smithi138.stdout:7/583: read d0/d39/f9c [1681289,34493] 0 2024-02-07T12:25:31.703 INFO:tasks.workunit.client.1.smithi138.stdout:7/584: creat d0/d8/d11/d1f/fc3 x:0 0 0 2024-02-07T12:25:31.703 INFO:tasks.workunit.client.0.smithi047.stdout:8/27: mknod d3/d4/cb 0 2024-02-07T12:25:31.703 INFO:tasks.workunit.client.0.smithi047.stdout:8/28: creat d3/d4/fc x:0 0 0 2024-02-07T12:25:31.713 INFO:tasks.workunit.client.0.smithi047.stdout:8/29: read d3/d4/f7 [2975611,128540] 0 2024-02-07T12:25:31.714 INFO:tasks.workunit.client.0.smithi047.stdout:8/30: dread - d3/d4/fa zero size 2024-02-07T12:25:31.716 INFO:tasks.workunit.client.0.smithi047.stdout:8/31: getdents d3 0 2024-02-07T12:25:31.716 INFO:tasks.workunit.client.0.smithi047.stdout:8/32: dread - d3/d4/fc zero size 2024-02-07T12:25:31.716 INFO:tasks.workunit.client.0.smithi047.stdout:8/33: rename d3 to d3/d4/dd 22 2024-02-07T12:25:31.720 INFO:tasks.workunit.client.0.smithi047.stdout:1/20: dwrite d1/f2 [0,4194304] 0 2024-02-07T12:25:31.721 INFO:tasks.workunit.client.1.smithi138.stdout:8/568: dwrite d1/de/d11/d17/d2e/fa1 [4194304,4194304] 0 2024-02-07T12:25:31.721 INFO:tasks.workunit.client.1.smithi138.stdout:8/569: fsync d1/de/d11/f5b 0 2024-02-07T12:25:31.726 INFO:tasks.workunit.client.0.smithi047.stdout:1/21: rmdir d1 39 2024-02-07T12:25:31.726 INFO:tasks.workunit.client.0.smithi047.stdout:1/22: chown d1/f2 56 1 2024-02-07T12:25:31.726 INFO:tasks.workunit.client.0.smithi047.stdout:1/23: rmdir d1 39 2024-02-07T12:25:31.726 INFO:tasks.workunit.client.0.smithi047.stdout:1/24: readlink - no filename 2024-02-07T12:25:31.741 INFO:tasks.workunit.client.0.smithi047.stdout:1/25: read d1/f2 [3682481,88884] 0 2024-02-07T12:25:31.743 INFO:tasks.workunit.client.0.smithi047.stdout:8/34: dwrite d3/f9 [0,4194304] 0 2024-02-07T12:25:31.743 INFO:tasks.workunit.client.0.smithi047.stdout:8/35: write d3/d4/fc [58559,18886] 0 2024-02-07T12:25:31.743 INFO:tasks.workunit.client.1.smithi138.stdout:8/570: dwrite d1/de/d11/d17/d3e/d72/d95/f9d [0,4194304] 0 2024-02-07T12:25:31.760 INFO:tasks.workunit.client.0.smithi047.stdout:8/36: dwrite d3/d4/fc [0,4194304] 0 2024-02-07T12:25:31.761 INFO:tasks.workunit.client.0.smithi047.stdout:8/37: symlink d3/d4/le 0 2024-02-07T12:25:31.761 INFO:tasks.workunit.client.0.smithi047.stdout:8/38: write d3/d4/fa [669677,118780] 0 2024-02-07T12:25:31.762 INFO:tasks.workunit.client.0.smithi047.stdout:8/39: rename l1 to d3/d4/lf 0 2024-02-07T12:25:31.763 INFO:tasks.workunit.client.0.smithi047.stdout:8/40: rename c0 to d3/c10 0 2024-02-07T12:25:31.767 INFO:tasks.workunit.client.0.smithi047.stdout:8/41: rmdir d3/d4 39 2024-02-07T12:25:31.768 INFO:tasks.workunit.client.0.smithi047.stdout:8/42: creat d3/f11 x:0 0 0 2024-02-07T12:25:31.786 INFO:tasks.workunit.client.0.smithi047.stdout:8/43: dwrite d3/f11 [0,4194304] 0 2024-02-07T12:25:31.787 INFO:tasks.workunit.client.0.smithi047.stdout:8/44: creat d3/d4/f12 x:0 0 0 2024-02-07T12:25:31.791 INFO:tasks.workunit.client.0.smithi047.stdout:8/45: mknod d3/c13 0 2024-02-07T12:25:31.792 INFO:tasks.workunit.client.0.smithi047.stdout:8/46: getdents d3/d4 0 2024-02-07T12:25:31.800 INFO:tasks.workunit.client.0.smithi047.stdout:8/47: write d3/d4/fc [2835584,3624] 0 2024-02-07T12:25:31.801 INFO:tasks.workunit.client.0.smithi047.stdout:8/48: rename d3/f11 to d3/f14 0 2024-02-07T12:25:31.802 INFO:tasks.workunit.client.0.smithi047.stdout:8/49: readlink d3/d4/l5 0 2024-02-07T12:25:31.802 INFO:tasks.workunit.client.0.smithi047.stdout:8/50: write d3/d4/f12 [261131,92319] 0 2024-02-07T12:25:31.820 INFO:tasks.workunit.client.1.smithi138.stdout:4/355: creat d20/d34/d59/f6b x:0 0 0 2024-02-07T12:25:31.821 INFO:tasks.workunit.client.1.smithi138.stdout:1/318: mkdir d5/d4b/d6b 0 2024-02-07T12:25:31.822 INFO:tasks.workunit.client.1.smithi138.stdout:5/415: truncate da/f15 1436636 0 2024-02-07T12:25:31.825 INFO:tasks.workunit.client.0.smithi047.stdout:8/51: dwrite d3/d4/fa [0,4194304] 0 2024-02-07T12:25:31.826 INFO:tasks.workunit.client.0.smithi047.stdout:8/52: symlink d3/l15 0 2024-02-07T12:25:31.827 INFO:tasks.workunit.client.0.smithi047.stdout:8/53: stat d3/d4/lf 0 2024-02-07T12:25:31.831 INFO:tasks.workunit.client.1.smithi138.stdout:1/319: symlink d5/d4b/l6c 0 2024-02-07T12:25:31.833 INFO:tasks.workunit.client.1.smithi138.stdout:7/585: truncate d0/d8/d11/d26/d90/f2c 740862 0 2024-02-07T12:25:31.833 INFO:tasks.workunit.client.1.smithi138.stdout:8/571: unlink d1/de/d11/d17/d58/faa 0 2024-02-07T12:25:31.835 INFO:tasks.workunit.client.1.smithi138.stdout:4/356: rename d20/d53/f6a to d20/d34/d59/f6c 0 2024-02-07T12:25:31.835 INFO:tasks.workunit.client.1.smithi138.stdout:4/357: creat d20/d34/d36/d55/f6d x:0 0 0 2024-02-07T12:25:31.835 INFO:tasks.workunit.client.0.smithi047.stdout:8/54: dread d3/f9 [0,4194304] 0 2024-02-07T12:25:31.836 INFO:tasks.workunit.client.1.smithi138.stdout:8/572: dread d1/d99/f7d [0,4194304] 0 2024-02-07T12:25:31.838 INFO:tasks.workunit.client.1.smithi138.stdout:5/416: rename da/l42 to da/d6d/d27/d2e/d4f/d2b/d59/d65/l81 0 2024-02-07T12:25:31.841 INFO:tasks.workunit.client.1.smithi138.stdout:8/573: symlink d1/lac 0 2024-02-07T12:25:31.841 INFO:tasks.workunit.client.1.smithi138.stdout:8/574: stat d1/de/d11/c3b 0 2024-02-07T12:25:31.841 INFO:tasks.workunit.client.1.smithi138.stdout:4/358: dread d20/f3d [0,4194304] 0 2024-02-07T12:25:31.841 INFO:tasks.workunit.client.1.smithi138.stdout:4/359: write d20/d34/d36/f3c [5032548,96379] 0 2024-02-07T12:25:31.841 INFO:tasks.workunit.client.1.smithi138.stdout:4/360: fdatasync d20/d34/d36/f48 0 2024-02-07T12:25:31.844 INFO:tasks.workunit.client.0.smithi047.stdout:8/55: dread d3/d4/fc [0,4194304] 0 2024-02-07T12:25:31.846 INFO:tasks.workunit.client.1.smithi138.stdout:8/575: mknod d1/de/d11/d17/d58/cad 0 2024-02-07T12:25:31.863 INFO:tasks.workunit.client.1.smithi138.stdout:7/586: dwrite d0/d8/d11/f79 [0,4194304] 0 2024-02-07T12:25:31.867 INFO:tasks.workunit.client.1.smithi138.stdout:1/320: dwrite d5/d8/ff [0,4194304] 0 2024-02-07T12:25:31.868 INFO:tasks.workunit.client.1.smithi138.stdout:6/394: sync 2024-02-07T12:25:31.868 INFO:tasks.workunit.client.1.smithi138.stdout:0/426: sync 2024-02-07T12:25:31.868 INFO:tasks.workunit.client.1.smithi138.stdout:2/496: sync 2024-02-07T12:25:31.873 INFO:tasks.workunit.client.1.smithi138.stdout:5/417: mkdir da/d6d/d82 0 2024-02-07T12:25:31.873 INFO:tasks.workunit.client.1.smithi138.stdout:5/418: read - da/d6d/d27/f7b zero size 2024-02-07T12:25:31.873 INFO:tasks.workunit.client.1.smithi138.stdout:5/419: chown da/f15 2604 1 2024-02-07T12:25:31.877 INFO:tasks.workunit.client.1.smithi138.stdout:1/321: dread d5/d8/da/d1f/f46 [0,4194304] 0 2024-02-07T12:25:31.877 INFO:tasks.workunit.client.1.smithi138.stdout:1/322: write f3 [4333176,30245] 0 2024-02-07T12:25:31.877 INFO:tasks.workunit.client.1.smithi138.stdout:1/323: chown d5/d8/da/c40 80 1 2024-02-07T12:25:31.877 INFO:tasks.workunit.client.1.smithi138.stdout:1/324: write d5/f1a [3847612,25860] 0 2024-02-07T12:25:31.877 INFO:tasks.workunit.client.1.smithi138.stdout:1/325: write d5/d8/da/d1f/f25 [5167786,82795] 0 2024-02-07T12:25:31.879 INFO:tasks.workunit.client.1.smithi138.stdout:8/576: truncate d1/de/d11/d17/d58/f60 81598 0 2024-02-07T12:25:31.888 INFO:tasks.workunit.client.1.smithi138.stdout:0/427: dwrite d4/d9/de/f7d [0,4194304] 0 2024-02-07T12:25:31.888 INFO:tasks.workunit.client.1.smithi138.stdout:0/428: write d4/d52/f44 [1253213,62667] 0 2024-02-07T12:25:31.894 INFO:tasks.workunit.client.1.smithi138.stdout:2/497: dwrite d3/dd/d19/d1f/d46/d71/faa [0,4194304] 0 2024-02-07T12:25:31.909 INFO:tasks.workunit.client.1.smithi138.stdout:2/498: dwrite d3/dd/d14/d49/d25/d3d/f3e [0,4194304] 0 2024-02-07T12:25:31.909 INFO:tasks.workunit.client.1.smithi138.stdout:2/499: chown d3/dd/d14/d49/c65 132836 1 2024-02-07T12:25:31.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.920+0000 7f59331ab700 1 -- 172.21.15.47:0/287114255 --> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f592c11e730 con 0x7f591c06b1c0 2024-02-07T12:25:31.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.921+0000 7f59297fa700 1 -- 172.21.15.47:0/287114255 <== mgr.14208 v2:172.21.15.47:6800/3356603129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f592c11e730 con 0x7f591c06b1c0 2024-02-07T12:25:31.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.924+0000 7f59331ab700 1 -- 172.21.15.47:0/287114255 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f591c06b1c0 msgr2=0x7f591c06d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:31.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.924+0000 7f59331ab700 1 --2- 172.21.15.47:0/287114255 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f591c06b1c0 0x7f591c06d670 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f592c06e1d0 tx=0x7f59180090f0 comp rx=0 tx=0).stop 2024-02-07T12:25:31.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.924+0000 7f59331ab700 1 -- 172.21.15.47:0/287114255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f592c06eeb0 msgr2=0x7f592c11cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:31.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.924+0000 7f59331ab700 1 --2- 172.21.15.47:0/287114255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f592c06eeb0 0x7f592c11cdc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5920004890 tx=0x7f5920009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:31.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.925+0000 7f59331ab700 1 -- 172.21.15.47:0/287114255 shutdown_connections 2024-02-07T12:25:31.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.925+0000 7f59331ab700 1 --2- 172.21.15.47:0/287114255 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f591c06b1c0 0x7f591c06d670 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:31.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.925+0000 7f59331ab700 1 --2- 172.21.15.47:0/287114255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f592c06e560 0x7f592c11c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:31.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.925+0000 7f59331ab700 1 --2- 172.21.15.47:0/287114255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f592c06eeb0 0x7f592c11cdc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:31.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.925+0000 7f59331ab700 1 -- 172.21.15.47:0/287114255 >> 172.21.15.47:0/287114255 conn(0x7f592c069e70 msgr2=0x7f592c107830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:31.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.925+0000 7f59331ab700 1 -- 172.21.15.47:0/287114255 shutdown_connections 2024-02-07T12:25:31.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:31.925+0000 7f59331ab700 1 -- 172.21.15.47:0/287114255 wait complete. 2024-02-07T12:25:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.095+0000 7f07ff5ac700 1 -- 172.21.15.47:0/393779006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07f806eeb0 msgr2=0x7f07f810b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.095+0000 7f07ff5ac700 1 --2- 172.21.15.47:0/393779006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07f806eeb0 0x7f07f810b1c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f07e8004940 tx=0x7f07e8009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.095+0000 7f07ff5ac700 1 -- 172.21.15.47:0/393779006 shutdown_connections 2024-02-07T12:25:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.095+0000 7f07ff5ac700 1 --2- 172.21.15.47:0/393779006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07f806eeb0 0x7f07f810b1c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.095+0000 7f07ff5ac700 1 --2- 172.21.15.47:0/393779006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07f806e560 0x7f07f806e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.095+0000 7f07ff5ac700 1 -- 172.21.15.47:0/393779006 >> 172.21.15.47:0/393779006 conn(0x7f07f8069e70 msgr2=0x7f07f806c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.096+0000 7f07ff5ac700 1 -- 172.21.15.47:0/393779006 shutdown_connections 2024-02-07T12:25:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.096+0000 7f07ff5ac700 1 -- 172.21.15.47:0/393779006 wait complete. 2024-02-07T12:25:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.097+0000 7f07ff5ac700 1 Processor -- start 2024-02-07T12:25:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.097+0000 7f07ff5ac700 1 -- start start 2024-02-07T12:25:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.097+0000 7f07ff5ac700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07f806e560 0x7f07f81161a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:32.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.098+0000 7f07ff5ac700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07f806eeb0 0x7f07f81166e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:32.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.098+0000 7f07fd348700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07f806e560 0x7f07f81161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:32.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.098+0000 7f07fd348700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07f806e560 0x7f07f81161a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40006/0 (socket says 172.21.15.47:40006) 2024-02-07T12:25:32.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.098+0000 7f07fd348700 1 -- 172.21.15.47:0/362147325 learned_addr learned my addr 172.21.15.47:0/362147325 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:25:32.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.098+0000 7f07ff5ac700 1 -- 172.21.15.47:0/362147325 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8116ce0 con 0x7f07f806e560 2024-02-07T12:25:32.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.098+0000 7f07fcb47700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07f806eeb0 0x7f07f81166e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:32.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.098+0000 7f07ff5ac700 1 -- 172.21.15.47:0/362147325 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8117580 con 0x7f07f806eeb0 2024-02-07T12:25:32.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.099+0000 7f07fd348700 1 -- 172.21.15.47:0/362147325 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07f806eeb0 msgr2=0x7f07f81166e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:32.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.099+0000 7f07fd348700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07f806eeb0 0x7f07f81166e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:32.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.099+0000 7f07fd348700 1 -- 172.21.15.47:0/362147325 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8005040 con 0x7f07f806e560 2024-02-07T12:25:32.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.099+0000 7f07fd348700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07f806e560 0x7f07f81161a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f07f4002a80 tx=0x7f07f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:32.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.100+0000 7f07edffb700 1 -- 172.21.15.47:0/362147325 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07f4007cc0 con 0x7f07f806e560 2024-02-07T12:25:32.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.100+0000 7f07ff5ac700 1 -- 172.21.15.47:0/362147325 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f8117860 con 0x7f07f806e560 2024-02-07T12:25:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.100+0000 7f07edffb700 1 -- 172.21.15.47:0/362147325 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07f400f040 con 0x7f07f806e560 2024-02-07T12:25:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.101+0000 7f07edffb700 1 -- 172.21.15.47:0/362147325 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07f400d9d0 con 0x7f07f806e560 2024-02-07T12:25:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.101+0000 7f07ff5ac700 1 -- 172.21.15.47:0/362147325 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f8117da0 con 0x7f07f806e560 2024-02-07T12:25:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.102+0000 7f07ff5ac700 1 -- 172.21.15.47:0/362147325 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f8110290 con 0x7f07f806e560 2024-02-07T12:25:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.103+0000 7f07edffb700 1 -- 172.21.15.47:0/362147325 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) v1 ==== 88827+0+0 (secure 0 0 0) 0x7f07f400db30 con 0x7f07f806e560 2024-02-07T12:25:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.104+0000 7f07edffb700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f07e406b030 0x7f07e406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.104+0000 7f07fcb47700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f07e406b030 0x7f07e406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.104+0000 7f07edffb700 1 -- 172.21.15.47:0/362147325 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f07f4089d60 con 0x7f07f806e560 2024-02-07T12:25:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.104+0000 7f07fcb47700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f07e406b030 0x7f07e406d4e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f07e800b840 tx=0x7f07e8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:32.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.111+0000 7f07edffb700 1 -- 172.21.15.47:0/362147325 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f07f4059bd0 con 0x7f07f806e560 2024-02-07T12:25:32.250 INFO:tasks.workunit.client.1.smithi138.stdout:3/519: sync 2024-02-07T12:25:32.250 INFO:tasks.workunit.client.1.smithi138.stdout:9/349: sync 2024-02-07T12:25:32.250 INFO:tasks.workunit.client.1.smithi138.stdout:9/350: dread - d0/d6/d8/f6d zero size 2024-02-07T12:25:32.250 INFO:tasks.workunit.client.1.smithi138.stdout:9/351: stat d0/d6/d8/d1d/dd/d25/f2d 0 2024-02-07T12:25:32.250 INFO:tasks.workunit.client.1.smithi138.stdout:9/352: readlink d0/d6/d8/d1d/dd/l23 0 2024-02-07T12:25:32.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.268+0000 7f07edffb700 1 -- 172.21.15.47:0/362147325 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 21) v1 ==== 45455+0+0 (secure 0 0 0) 0x7f07f4056510 con 0x7f07f806e560 2024-02-07T12:25:32.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.268+0000 7f07edffb700 1 -- 172.21.15.47:0/362147325 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f07e406b030 msgr2=0x7f07e406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:32.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:32.268+0000 7f07edffb700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f07e406b030 0x7f07e406d4e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f07e800b840 tx=0x7f07e8009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:32.315 INFO:tasks.workunit.client.1.smithi138.stdout:6/395: symlink dc/d69/l7f 0 2024-02-07T12:25:32.316 INFO:tasks.workunit.client.1.smithi138.stdout:6/396: readlink dc/d13/d1e/d4d/l5a 0 2024-02-07T12:25:32.316 INFO:tasks.workunit.client.1.smithi138.stdout:4/361: getdents d20/d53 0 2024-02-07T12:25:32.318 INFO:tasks.workunit.client.1.smithi138.stdout:5/420: rmdir da/d6d/d82 0 2024-02-07T12:25:32.318 INFO:tasks.workunit.client.1.smithi138.stdout:5/421: dread - da/d6d/d27/d2e/f79 zero size 2024-02-07T12:25:32.324 INFO:tasks.workunit.client.1.smithi138.stdout:1/326: rename d5/d8/da/d1f/d3c/c48 to d5/d8/da/d1f/d5e/d63/c6d 0 2024-02-07T12:25:32.327 INFO:tasks.workunit.client.1.smithi138.stdout:8/577: mkdir d1/de/d11/dae 0 2024-02-07T12:25:32.327 INFO:tasks.workunit.client.1.smithi138.stdout:8/578: truncate d1/f9e 865988 0 2024-02-07T12:25:32.327 INFO:tasks.workunit.client.1.smithi138.stdout:8/579: stat d1/de/d11/d17/d2e/d3a/d50/f4b 0 2024-02-07T12:25:32.328 INFO:tasks.workunit.client.1.smithi138.stdout:8/580: creat d1/d8e/faf x:0 0 0 2024-02-07T12:25:32.342 INFO:tasks.workunit.client.1.smithi138.stdout:0/429: mkdir d4/d69/d85 0 2024-02-07T12:25:32.342 INFO:tasks.workunit.client.1.smithi138.stdout:0/430: creat d4/d9/de/d1d/d21/f86 x:0 0 0 2024-02-07T12:25:32.353 INFO:tasks.workunit.client.1.smithi138.stdout:3/520: link d5/l33 d5/d26/d9d/lb4 0 2024-02-07T12:25:32.357 INFO:tasks.workunit.client.1.smithi138.stdout:9/353: unlink d0/f4f 0 2024-02-07T12:25:32.360 INFO:tasks.workunit.client.1.smithi138.stdout:7/587: getdents d0/d8/d11/d1f 0 2024-02-07T12:25:32.363 INFO:tasks.workunit.client.1.smithi138.stdout:6/397: creat dc/d13/f80 x:0 0 0 2024-02-07T12:25:32.364 INFO:tasks.workunit.client.1.smithi138.stdout:6/398: dread dc/d13/d1e/d35/f46 [0,4194304] 0 2024-02-07T12:25:32.366 INFO:tasks.workunit.client.1.smithi138.stdout:9/354: read d0/d6/d8/f2a [3912920,82302] 0 2024-02-07T12:25:32.366 INFO:tasks.workunit.client.1.smithi138.stdout:9/355: write d0/f33 [750268,39259] 0 2024-02-07T12:25:32.367 INFO:tasks.workunit.client.1.smithi138.stdout:2/500: rename d3/dd/fae to d3/dd/d19/d44/d7d/d97/fb6 0 2024-02-07T12:25:32.369 INFO:tasks.workunit.client.1.smithi138.stdout:1/327: mkdir d5/d4b/d6b/d6e 0 2024-02-07T12:25:32.373 INFO:tasks.workunit.client.1.smithi138.stdout:8/581: truncate d1/de/d11/d17/d2e/d49/f39 2651385 0 2024-02-07T12:25:32.380 INFO:tasks.workunit.client.1.smithi138.stdout:3/521: truncate f1 3945163 0 2024-02-07T12:25:32.380 INFO:tasks.workunit.client.1.smithi138.stdout:3/522: write d5/d26/d5e/d86/dae/fb1 [17591,50431] 0 2024-02-07T12:25:32.385 INFO:tasks.workunit.client.1.smithi138.stdout:1/328: dwrite d5/f2a [0,4194304] 0 2024-02-07T12:25:32.387 INFO:tasks.workunit.client.1.smithi138.stdout:9/356: mknod d0/c71 0 2024-02-07T12:25:32.387 INFO:tasks.workunit.client.1.smithi138.stdout:9/357: chown d0/d6/f15 395 1 2024-02-07T12:25:32.390 INFO:tasks.workunit.client.1.smithi138.stdout:4/362: rename d20/d34/d36/f46 to d20/d47/d69/f6e 0 2024-02-07T12:25:32.390 INFO:tasks.workunit.client.1.smithi138.stdout:5/422: rename da/d6d/d27/d2e/d4f/d2b to da/d6d/d27/d2e/d4f/d2b/d59/d65/d83 22 2024-02-07T12:25:32.392 INFO:tasks.workunit.client.1.smithi138.stdout:2/501: symlink d3/dd/d19/d44/d7d/d97/lb7 0 2024-02-07T12:25:32.394 INFO:tasks.workunit.client.1.smithi138.stdout:0/431: truncate d4/d9/f22 3454479 0 2024-02-07T12:25:32.394 INFO:tasks.workunit.client.1.smithi138.stdout:0/432: write d4/d9/f3e [653774,62951] 0 2024-02-07T12:25:32.398 INFO:tasks.workunit.client.1.smithi138.stdout:8/582: write d1/de/d11/d17/d2e/fa1 [5898193,2729] 0 2024-02-07T12:25:32.399 INFO:tasks.workunit.client.1.smithi138.stdout:9/358: link d0/d6/d8/d1d/dd/d1f/l21 d0/d34/l72 0 2024-02-07T12:25:32.403 INFO:tasks.workunit.client.1.smithi138.stdout:7/588: rename d0/d8/d11/f6d to d0/d6/d84/fc4 0 2024-02-07T12:25:32.403 INFO:tasks.workunit.client.1.smithi138.stdout:7/589: chown d0/d8/d15/c32 355 1 2024-02-07T12:25:32.404 INFO:tasks.workunit.client.1.smithi138.stdout:5/423: truncate da/fc 2158163 0 2024-02-07T12:25:32.404 INFO:tasks.workunit.client.1.smithi138.stdout:5/424: creat da/d43/d4a/f84 x:0 0 0 2024-02-07T12:25:32.407 INFO:tasks.workunit.client.1.smithi138.stdout:2/502: symlink d3/dd/d19/d44/lb8 0 2024-02-07T12:25:32.411 INFO:tasks.workunit.client.1.smithi138.stdout:0/433: creat d4/d69/f87 x:0 0 0 2024-02-07T12:25:32.411 INFO:tasks.workunit.client.1.smithi138.stdout:8/583: link d1/de/d11/d17/d2e/d49/l94 d1/de/d11/d17/lb0 0 2024-02-07T12:25:32.414 INFO:tasks.workunit.client.1.smithi138.stdout:6/399: rename dc/d13/d1e/d35/l6c to dc/d13/d1e/d24/l81 0 2024-02-07T12:25:32.414 INFO:tasks.workunit.client.1.smithi138.stdout:6/400: write dc/d13/f14 [4233038,23608] 0 2024-02-07T12:25:32.415 INFO:tasks.workunit.client.1.smithi138.stdout:7/590: symlink d0/d6/d3e/lc5 0 2024-02-07T12:25:32.417 INFO:tasks.workunit.client.1.smithi138.stdout:8/584: creat d1/de/d11/d17/d3e/fb1 x:0 0 0 2024-02-07T12:25:32.420 INFO:tasks.workunit.client.1.smithi138.stdout:8/585: dread d1/de/d11/d17/f20 [0,4194304] 0 2024-02-07T12:25:32.421 INFO:tasks.workunit.client.1.smithi138.stdout:8/586: stat d1/de/d11/c82 0 2024-02-07T12:25:32.423 INFO:tasks.workunit.client.1.smithi138.stdout:3/523: rename d5/f56 to d5/d26/d9b/dab/fb5 0 2024-02-07T12:25:32.425 INFO:tasks.workunit.client.1.smithi138.stdout:5/425: dwrite da/f29 [8388608,4194304] 0 2024-02-07T12:25:32.427 INFO:tasks.workunit.client.1.smithi138.stdout:6/401: symlink dc/d31/d54/l82 0 2024-02-07T12:25:32.427 INFO:tasks.workunit.client.1.smithi138.stdout:7/591: dread d0/d8/d15/fc0 [0,4194304] 0 2024-02-07T12:25:32.430 INFO:tasks.workunit.client.1.smithi138.stdout:4/363: dwrite d20/d47/f4b [0,4194304] 0 2024-02-07T12:25:32.431 INFO:tasks.workunit.client.1.smithi138.stdout:9/359: rmdir d0/d6/d8 39 2024-02-07T12:25:32.432 INFO:tasks.workunit.client.1.smithi138.stdout:5/426: creat da/f85 x:0 0 0 2024-02-07T12:25:32.434 INFO:tasks.workunit.client.1.smithi138.stdout:7/592: symlink d0/d6/d3e/lc6 0 2024-02-07T12:25:32.437 INFO:tasks.workunit.client.1.smithi138.stdout:4/364: mknod d20/d34/c6f 0 2024-02-07T12:25:32.438 INFO:tasks.workunit.client.1.smithi138.stdout:3/524: getdents d5/d26/d5e 0 2024-02-07T12:25:32.440 INFO:tasks.workunit.client.1.smithi138.stdout:9/360: creat d0/d6/d8/f73 x:0 0 0 2024-02-07T12:25:32.442 INFO:tasks.workunit.client.1.smithi138.stdout:5/427: mknod da/d6d/d27/d2e/d4f/d2b/d35/d67/c86 0 2024-02-07T12:25:32.442 INFO:tasks.workunit.client.1.smithi138.stdout:5/428: write da/d6d/d27/f28 [4263456,3865] 0 2024-02-07T12:25:32.442 INFO:tasks.workunit.client.1.smithi138.stdout:5/429: fdatasync da/d34/f80 0 2024-02-07T12:25:32.442 INFO:tasks.workunit.client.1.smithi138.stdout:5/430: fdatasync da/d6d/d27/d2e/d4f/d2b/d35/d40/f5e 0 2024-02-07T12:25:32.443 INFO:tasks.workunit.client.1.smithi138.stdout:2/503: dwrite d3/dd/d19/d1f/d37/f3b [0,4194304] 0 2024-02-07T12:25:32.443 INFO:tasks.workunit.client.1.smithi138.stdout:2/504: chown d3/dd/d14/d82/fa3 1 1 2024-02-07T12:25:32.445 INFO:tasks.workunit.client.1.smithi138.stdout:7/593: rename d0/f6c to d0/d6/d73/fc7 0 2024-02-07T12:25:32.445 INFO:tasks.workunit.client.1.smithi138.stdout:7/594: write d0/d8/d11/d5f/f95 [1452135,42820] 0 2024-02-07T12:25:32.446 INFO:tasks.workunit.client.1.smithi138.stdout:4/365: symlink d20/l70 0 2024-02-07T12:25:32.446 INFO:tasks.workunit.client.1.smithi138.stdout:3/525: symlink d5/d15/d96/lb6 0 2024-02-07T12:25:32.447 INFO:tasks.workunit.client.1.smithi138.stdout:2/505: link d3/dd/d14/d49/d29/l32 d3/dd/d14/d49/lb9 0 2024-02-07T12:25:32.448 INFO:tasks.workunit.client.1.smithi138.stdout:2/506: chown d3/l6 401487895 1 2024-02-07T12:25:32.449 INFO:tasks.workunit.client.1.smithi138.stdout:0/434: dwrite d4/d9/de/d1d/f41 [0,4194304] 0 2024-02-07T12:25:32.449 INFO:tasks.workunit.client.1.smithi138.stdout:0/435: chown d4/d9/de/l1e 2576279 1 2024-02-07T12:25:32.450 INFO:tasks.workunit.client.1.smithi138.stdout:7/595: mkdir d0/d8/d11/d63/dc8 0 2024-02-07T12:25:32.453 INFO:tasks.workunit.client.1.smithi138.stdout:3/526: rmdir d5/d26/d9d 39 2024-02-07T12:25:32.454 INFO:tasks.workunit.client.1.smithi138.stdout:2/507: creat d3/dd/d14/d49/d29/d5b/fba x:0 0 0 2024-02-07T12:25:32.455 INFO:tasks.workunit.client.1.smithi138.stdout:8/587: dwrite d1/f26 [0,4194304] 0 2024-02-07T12:25:32.459 INFO:tasks.workunit.client.1.smithi138.stdout:0/436: creat d4/d9/de/d1d/d77/f88 x:0 0 0 2024-02-07T12:25:32.461 INFO:tasks.workunit.client.1.smithi138.stdout:3/527: mkdir d5/d26/d28/db7 0 2024-02-07T12:25:32.463 INFO:tasks.workunit.client.1.smithi138.stdout:8/588: rename d1/de/d11/f30 to d1/de/d11/d17/d8a/d8d/fb2 0 2024-02-07T12:25:32.465 INFO:tasks.workunit.client.1.smithi138.stdout:0/437: symlink d4/d69/d85/l89 0 2024-02-07T12:25:32.467 INFO:tasks.workunit.client.1.smithi138.stdout:4/366: dwrite f1c [0,4194304] 0 2024-02-07T12:25:32.467 INFO:tasks.workunit.client.1.smithi138.stdout:8/589: mkdir d1/db3 0 2024-02-07T12:25:32.468 INFO:tasks.workunit.client.1.smithi138.stdout:0/438: mkdir d4/d69/d85/d8a 0 2024-02-07T12:25:32.470 INFO:tasks.workunit.client.1.smithi138.stdout:5/431: dwrite da/d6d/f13 [4194304,4194304] 0 2024-02-07T12:25:32.472 INFO:tasks.workunit.client.1.smithi138.stdout:6/402: dread dc/d13/f1b [0,4194304] 0 2024-02-07T12:25:32.472 INFO:tasks.workunit.client.1.smithi138.stdout:6/403: truncate dc/d31/f37 134682 0 2024-02-07T12:25:32.472 INFO:tasks.workunit.client.1.smithi138.stdout:6/404: chown dc/d31/d38/f3b 874247579 1 2024-02-07T12:25:32.474 INFO:tasks.workunit.client.1.smithi138.stdout:4/367: mkdir d20/d53/d71 0 2024-02-07T12:25:32.474 INFO:tasks.workunit.client.1.smithi138.stdout:0/439: rename d4/d9/db/f5f to d4/d9/d37/d6b/f8b 0 2024-02-07T12:25:32.476 INFO:tasks.workunit.client.1.smithi138.stdout:5/432: creat da/d6d/d27/d2e/d4f/d2b/f87 x:0 0 0 2024-02-07T12:25:32.476 INFO:tasks.workunit.client.1.smithi138.stdout:7/596: dwrite d0/d8/d11/d26/f9a [0,4194304] 0 2024-02-07T12:25:32.478 INFO:tasks.workunit.client.1.smithi138.stdout:5/433: dread da/d6d/d27/d2e/f2f [0,4194304] 0 2024-02-07T12:25:32.478 INFO:tasks.workunit.client.1.smithi138.stdout:5/434: creat da/d6d/d27/d2e/f88 x:0 0 0 2024-02-07T12:25:32.478 INFO:tasks.workunit.client.1.smithi138.stdout:5/435: chown da/d6d/d27 7715161 1 2024-02-07T12:25:32.478 INFO:tasks.workunit.client.1.smithi138.stdout:5/436: chown da/d50 0 1 2024-02-07T12:25:32.479 INFO:tasks.workunit.client.1.smithi138.stdout:6/405: symlink dc/d31/l83 0 2024-02-07T12:25:32.480 INFO:tasks.workunit.client.1.smithi138.stdout:4/368: mkdir d20/d34/d59/d72 0 2024-02-07T12:25:32.483 INFO:tasks.workunit.client.1.smithi138.stdout:0/440: mkdir d4/d9/de/d1d/d8c 0 2024-02-07T12:25:32.485 INFO:tasks.workunit.client.1.smithi138.stdout:3/528: dwrite d5/d27/d35/f50 [0,4194304] 0 2024-02-07T12:25:32.485 INFO:tasks.workunit.client.1.smithi138.stdout:3/529: write d5/f94 [652026,67801] 0 2024-02-07T12:25:32.485 INFO:tasks.workunit.client.1.smithi138.stdout:3/530: write d5/d26/d4e/f8c [1374378,37565] 0 2024-02-07T12:25:32.487 INFO:tasks.workunit.client.1.smithi138.stdout:2/508: dread f0 [0,4194304] 0 2024-02-07T12:25:32.489 INFO:tasks.workunit.client.1.smithi138.stdout:3/531: write d5/d34/d79/f89 [1161313,126062] 0 2024-02-07T12:25:32.489 INFO:tasks.workunit.client.1.smithi138.stdout:3/532: dread - d5/d34/d79/f7b zero size 2024-02-07T12:25:32.489 INFO:tasks.workunit.client.1.smithi138.stdout:3/533: chown d5/d26/d9b 1298 1 2024-02-07T12:25:32.496 INFO:tasks.workunit.client.1.smithi138.stdout:5/437: rename da/l18 to da/d43/l89 0 2024-02-07T12:25:32.496 INFO:tasks.workunit.client.1.smithi138.stdout:4/369: mkdir d20/d34/d73 0 2024-02-07T12:25:32.496 INFO:tasks.workunit.client.1.smithi138.stdout:4/370: chown d20/d34/l3b 53147 1 2024-02-07T12:25:32.497 INFO:tasks.workunit.client.1.smithi138.stdout:5/438: read - da/d6d/f7c zero size 2024-02-07T12:25:32.497 INFO:tasks.workunit.client.1.smithi138.stdout:0/441: link d4/d9/db/f15 d4/d9/d37/f8d 0 2024-02-07T12:25:32.497 INFO:tasks.workunit.client.1.smithi138.stdout:0/442: creat d4/d9/f8e x:0 0 0 2024-02-07T12:25:32.500 INFO:tasks.workunit.client.1.smithi138.stdout:6/406: dwrite dc/d69/f5e [0,4194304] 0 2024-02-07T12:25:32.500 INFO:tasks.workunit.client.1.smithi138.stdout:3/534: dread d5/d27/f49 [0,4194304] 0 2024-02-07T12:25:32.500 INFO:tasks.workunit.client.1.smithi138.stdout:3/535: chown d5/d26/d90/ca3 0 1 2024-02-07T12:25:32.500 INFO:tasks.workunit.client.1.smithi138.stdout:3/536: write f1 [30154,108939] 0 2024-02-07T12:25:32.500 INFO:tasks.workunit.client.1.smithi138.stdout:9/361: dwrite d0/d6/d8/f52 [0,4194304] 0 2024-02-07T12:25:32.500 INFO:tasks.workunit.client.1.smithi138.stdout:9/362: write d0/d6/d8/f2a [1531750,75426] 0 2024-02-07T12:25:32.500 INFO:tasks.workunit.client.1.smithi138.stdout:2/509: link d3/dd/d19/l7 d3/dd/d14/d8f/d73/lbb 0 2024-02-07T12:25:32.502 INFO:tasks.workunit.client.1.smithi138.stdout:7/597: truncate d0/d8/d11/d26/d90/f36 720770 0 2024-02-07T12:25:32.503 INFO:tasks.workunit.client.1.smithi138.stdout:4/371: mkdir d20/d34/d36/d55/d74 0 2024-02-07T12:25:32.506 INFO:tasks.workunit.client.1.smithi138.stdout:5/439: creat da/d6d/d27/d2e/d4f/d2b/d59/d65/f8a x:0 0 0 2024-02-07T12:25:32.506 INFO:tasks.workunit.client.1.smithi138.stdout:5/440: write da/d6d/d27/d2e/d4f/d2b/f87 [760674,25395] 0 2024-02-07T12:25:32.506 INFO:tasks.workunit.client.1.smithi138.stdout:5/441: creat da/d6d/d27/d2e/d4f/d2b/d59/f8b x:0 0 0 2024-02-07T12:25:32.512 INFO:tasks.workunit.client.1.smithi138.stdout:6/407: creat dc/d13/d1e/f84 x:0 0 0 2024-02-07T12:25:32.512 INFO:tasks.workunit.client.1.smithi138.stdout:6/408: truncate dc/f4b 935491 0 2024-02-07T12:25:32.513 INFO:tasks.workunit.client.1.smithi138.stdout:6/409: chown dc/d73 327 1 2024-02-07T12:25:32.514 INFO:tasks.workunit.client.1.smithi138.stdout:3/537: creat d5/d15/d32/fb8 x:0 0 0 2024-02-07T12:25:32.517 INFO:tasks.workunit.client.1.smithi138.stdout:3/538: dread d5/d27/f29 [0,4194304] 0 2024-02-07T12:25:32.517 INFO:tasks.workunit.client.1.smithi138.stdout:0/443: dwrite d4/d9/f2f [4194304,4194304] 0 2024-02-07T12:25:32.517 INFO:tasks.workunit.client.1.smithi138.stdout:9/363: mkdir d0/d6/d8/d1d/dd/d41/d5e/d74 0 2024-02-07T12:25:32.518 INFO:tasks.workunit.client.1.smithi138.stdout:9/364: stat d0/d6/d8/d1d/f3d 0 2024-02-07T12:25:32.518 INFO:tasks.workunit.client.1.smithi138.stdout:9/365: chown d0/d6/f27 4050652 1 2024-02-07T12:25:32.518 INFO:tasks.workunit.client.1.smithi138.stdout:9/366: stat d0/f2c 0 2024-02-07T12:25:32.518 INFO:tasks.workunit.client.1.smithi138.stdout:2/510: truncate d3/dd/d19/d1f/f5d 128381 0 2024-02-07T12:25:32.519 INFO:tasks.workunit.client.1.smithi138.stdout:7/598: creat d0/d8/d15/db1/fc9 x:0 0 0 2024-02-07T12:25:32.520 INFO:tasks.workunit.client.1.smithi138.stdout:3/539: dread d5/d26/d28/f39 [0,4194304] 0 2024-02-07T12:25:32.520 INFO:tasks.workunit.client.1.smithi138.stdout:3/540: write d5/f94 [898965,76694] 0 2024-02-07T12:25:32.520 INFO:tasks.workunit.client.1.smithi138.stdout:4/372: mkdir d20/d53/d71/d75 0 2024-02-07T12:25:32.525 INFO:tasks.workunit.client.1.smithi138.stdout:6/410: mkdir dc/d13/d1e/d35/d85 0 2024-02-07T12:25:32.525 INFO:tasks.workunit.client.1.smithi138.stdout:6/411: write dc/d69/f67 [838900,129132] 0 2024-02-07T12:25:32.528 INFO:tasks.workunit.client.1.smithi138.stdout:0/444: mkdir d4/d9/db/d39/d4b/d6c/d8f 0 2024-02-07T12:25:32.529 INFO:tasks.workunit.client.1.smithi138.stdout:9/367: creat d0/d6/d8/d1d/dd/d41/d5e/f75 x:0 0 0 2024-02-07T12:25:32.530 INFO:tasks.workunit.client.1.smithi138.stdout:9/368: read d0/d34/d45/f69 [283840,83494] 0 2024-02-07T12:25:32.531 INFO:tasks.workunit.client.1.smithi138.stdout:2/511: mkdir d3/dd/d14/d8f/dbc 0 2024-02-07T12:25:32.533 INFO:tasks.workunit.client.1.smithi138.stdout:7/599: unlink d0/d6/d1d/fb4 0 2024-02-07T12:25:32.533 INFO:tasks.workunit.client.1.smithi138.stdout:7/600: creat d0/d8/d15/db1/fca x:0 0 0 2024-02-07T12:25:32.534 INFO:tasks.workunit.client.1.smithi138.stdout:4/373: mkdir d20/d47/d69/d76 0 2024-02-07T12:25:32.534 INFO:tasks.workunit.client.1.smithi138.stdout:3/541: dwrite d5/f3a [0,4194304] 0 2024-02-07T12:25:32.534 INFO:tasks.workunit.client.1.smithi138.stdout:3/542: write d5/d26/d28/f4d [162899,19999] 0 2024-02-07T12:25:32.534 INFO:tasks.workunit.client.1.smithi138.stdout:6/412: symlink dc/d13/d1e/d35/d7c/l86 0 2024-02-07T12:25:32.536 INFO:tasks.workunit.client.1.smithi138.stdout:0/445: link d4/d9/f40 d4/d52/f90 0 2024-02-07T12:25:32.536 INFO:tasks.workunit.client.1.smithi138.stdout:0/446: dread - d4/d69/f87 zero size 2024-02-07T12:25:32.541 INFO:tasks.workunit.client.1.smithi138.stdout:7/601: dread d0/f2 [0,4194304] 0 2024-02-07T12:25:32.541 INFO:tasks.workunit.client.1.smithi138.stdout:7/602: write d0/d8/d11/d26/d90/f2c [1338964,45823] 0 2024-02-07T12:25:32.544 INFO:tasks.workunit.client.1.smithi138.stdout:4/374: dread d20/f40 [0,4194304] 0 2024-02-07T12:25:32.545 INFO:tasks.workunit.client.1.smithi138.stdout:2/512: mkdir d3/dd/d14/d8f/dbc/dbd 0 2024-02-07T12:25:32.549 INFO:tasks.workunit.client.1.smithi138.stdout:2/513: dread d3/d4e/f88 [0,4194304] 0 2024-02-07T12:25:32.551 INFO:tasks.workunit.client.1.smithi138.stdout:6/413: rename dc/d31/d38/f63 to dc/d13/f87 0 2024-02-07T12:25:32.551 INFO:tasks.workunit.client.1.smithi138.stdout:6/414: fsync dc/fd 0 2024-02-07T12:25:32.552 INFO:tasks.workunit.client.1.smithi138.stdout:6/415: stat dc/d31/d38/c43 0 2024-02-07T12:25:32.553 INFO:tasks.workunit.client.1.smithi138.stdout:0/447: creat d4/d9/d37/d6b/f91 x:0 0 0 2024-02-07T12:25:32.556 INFO:tasks.workunit.client.1.smithi138.stdout:4/375: mkdir d20/d34/d59/d72/d77 0 2024-02-07T12:25:32.558 INFO:tasks.workunit.client.1.smithi138.stdout:2/514: link d3/dd/d14/f5a d3/dd/d19/d1f/d37/fbe 0 2024-02-07T12:25:32.558 INFO:tasks.workunit.client.1.smithi138.stdout:2/515: fdatasync d3/dd/d14/d49/d29/f51 0 2024-02-07T12:25:32.559 INFO:tasks.workunit.client.1.smithi138.stdout:7/603: rename d0/d6/d1d/d38/l78 to d0/d6/d76/lcb 0 2024-02-07T12:25:32.559 INFO:tasks.workunit.client.1.smithi138.stdout:7/604: fdatasync d0/d6/d19/f29 0 2024-02-07T12:25:32.560 INFO:tasks.workunit.client.1.smithi138.stdout:6/416: truncate dc/d13/d1e/d35/d6d/f6e 361425 0 2024-02-07T12:25:32.562 INFO:tasks.workunit.client.1.smithi138.stdout:7/605: link d0/d6/d1d/d38/f8d d0/d8/d11/d26/fcc 0 2024-02-07T12:25:32.564 INFO:tasks.workunit.client.1.smithi138.stdout:6/417: unlink dc/d13/d1e/d24/f7e 0 2024-02-07T12:25:32.565 INFO:tasks.workunit.client.1.smithi138.stdout:0/448: getdents d4/d9/d37/d6b/d7f 0 2024-02-07T12:25:32.565 INFO:tasks.workunit.client.1.smithi138.stdout:4/376: dread f1a [0,4194304] 0 2024-02-07T12:25:32.565 INFO:tasks.workunit.client.1.smithi138.stdout:0/449: truncate d4/d9/d37/d3d/f68 448331 0 2024-02-07T12:25:32.566 INFO:tasks.workunit.client.1.smithi138.stdout:6/418: mkdir dc/d13/d1e/d35/d85/d88 0 2024-02-07T12:25:32.567 INFO:tasks.workunit.client.1.smithi138.stdout:4/377: unlink l12 0 2024-02-07T12:25:32.568 INFO:tasks.workunit.client.1.smithi138.stdout:0/450: mknod d4/d69/d85/d8a/c92 0 2024-02-07T12:25:32.569 INFO:tasks.workunit.client.1.smithi138.stdout:7/606: getdents d0/d6/d76/d93 0 2024-02-07T12:25:32.569 INFO:tasks.workunit.client.1.smithi138.stdout:2/516: dread d3/dd/d19/d1f/fa2 [0,4194304] 0 2024-02-07T12:25:32.569 INFO:tasks.workunit.client.1.smithi138.stdout:0/451: dread d4/d9/d33/f4c [0,4194304] 0 2024-02-07T12:25:32.569 INFO:tasks.workunit.client.1.smithi138.stdout:0/452: readlink d4/d9/d33/l4f 0 2024-02-07T12:25:32.571 INFO:tasks.workunit.client.1.smithi138.stdout:6/419: creat dc/d13/d1e/d35/d85/f89 x:0 0 0 2024-02-07T12:25:32.571 INFO:tasks.workunit.client.1.smithi138.stdout:6/420: write dc/d13/d1e/f5f [164470,99664] 0 2024-02-07T12:25:32.571 INFO:tasks.workunit.client.1.smithi138.stdout:6/421: dread - dc/d13/d1e/d4d/f5d zero size 2024-02-07T12:25:32.571 INFO:tasks.workunit.client.1.smithi138.stdout:6/422: chown dc/d31/d3f/f41 31 1 2024-02-07T12:25:32.571 INFO:tasks.workunit.client.1.smithi138.stdout:6/423: stat dc/d13/d1e/d24/c70 0 2024-02-07T12:25:32.571 INFO:tasks.workunit.client.1.smithi138.stdout:6/424: write dc/d31/d38/f3a [2852394,52499] 0 2024-02-07T12:25:32.571 INFO:tasks.workunit.client.1.smithi138.stdout:6/425: chown dc/l78 1578098 1 2024-02-07T12:25:32.571 INFO:tasks.workunit.client.1.smithi138.stdout:4/378: symlink d20/d34/d36/l78 0 2024-02-07T12:25:32.571 INFO:tasks.workunit.client.1.smithi138.stdout:4/379: chown d20/d34 973204592 1 2024-02-07T12:25:32.572 INFO:tasks.workunit.client.1.smithi138.stdout:2/517: symlink d3/dd/d14/d8f/dbc/dbd/lbf 0 2024-02-07T12:25:32.575 INFO:tasks.workunit.client.1.smithi138.stdout:6/426: rmdir dc/d69 39 2024-02-07T12:25:32.575 INFO:tasks.workunit.client.1.smithi138.stdout:4/380: mknod d20/d53/d71/d75/c79 0 2024-02-07T12:25:32.575 INFO:tasks.workunit.client.1.smithi138.stdout:4/381: fdatasync d20/d47/d69/f6e 0 2024-02-07T12:25:32.576 INFO:tasks.workunit.client.1.smithi138.stdout:6/427: dread dc/f4b [0,4194304] 0 2024-02-07T12:25:32.576 INFO:tasks.workunit.client.1.smithi138.stdout:2/518: creat d3/dd/d19/d44/fc0 x:0 0 0 2024-02-07T12:25:32.576 INFO:tasks.workunit.client.1.smithi138.stdout:6/428: creat dc/d13/d1e/d35/d85/f8a x:0 0 0 2024-02-07T12:25:32.578 INFO:tasks.workunit.client.1.smithi138.stdout:4/382: rename d20/d34/d36/d55/f57 to d20/d47/d69/d76/f7a 0 2024-02-07T12:25:32.580 INFO:tasks.workunit.client.1.smithi138.stdout:2/519: truncate d3/dd/d19/d1f/fa2 1210937 0 2024-02-07T12:25:32.585 INFO:tasks.workunit.client.1.smithi138.stdout:2/520: link d3/dd/d14/d8f/da5/ca8 d3/dd/d14/d49/d25/cc1 0 2024-02-07T12:25:32.585 INFO:tasks.workunit.client.1.smithi138.stdout:2/521: stat d3/dd/d19/d1f/d46 0 2024-02-07T12:25:32.586 INFO:tasks.workunit.client.1.smithi138.stdout:2/522: mkdir d3/dd/d14/d49/dc2 0 2024-02-07T12:25:32.587 INFO:tasks.workunit.client.1.smithi138.stdout:4/383: dread d20/d34/f4a [0,4194304] 0 2024-02-07T12:25:32.588 INFO:tasks.workunit.client.1.smithi138.stdout:2/523: creat d3/dd/d14/d8f/dbc/fc3 x:0 0 0 2024-02-07T12:25:32.590 INFO:tasks.workunit.client.1.smithi138.stdout:4/384: creat d20/f7b x:0 0 0 2024-02-07T12:25:32.590 INFO:tasks.workunit.client.1.smithi138.stdout:4/385: dread d20/d34/f4c [0,4194304] 0 2024-02-07T12:25:32.591 INFO:tasks.workunit.client.1.smithi138.stdout:4/386: chown f1d 613093191 1 2024-02-07T12:25:32.591 INFO:tasks.workunit.client.1.smithi138.stdout:4/387: stat d20/d53/d71 0 2024-02-07T12:25:32.591 INFO:tasks.workunit.client.1.smithi138.stdout:2/524: truncate d3/dd/d14/d49/d25/d3d/f55 36155 0 2024-02-07T12:25:32.591 INFO:tasks.workunit.client.1.smithi138.stdout:2/525: chown d3/dd/d14/d49/d25/l92 120 1 2024-02-07T12:25:32.591 INFO:tasks.workunit.client.1.smithi138.stdout:4/388: write d20/d34/d36/d55/f5b [416404,102955] 0 2024-02-07T12:25:32.592 INFO:tasks.workunit.client.1.smithi138.stdout:0/453: dwrite d4/d52/f34 [0,4194304] 0 2024-02-07T12:25:32.592 INFO:tasks.workunit.client.1.smithi138.stdout:7/607: dwrite d0/d6/d76/d93/fad [0,4194304] 0 2024-02-07T12:25:32.593 INFO:tasks.workunit.client.1.smithi138.stdout:7/608: read d0/d8/d11/d63/f89 [162272,108056] 0 2024-02-07T12:25:32.593 INFO:tasks.workunit.client.1.smithi138.stdout:4/389: unlink c1e 0 2024-02-07T12:25:32.597 INFO:tasks.workunit.client.1.smithi138.stdout:7/609: mknod d0/d8/d11/d5f/ccd 0 2024-02-07T12:25:32.598 INFO:tasks.workunit.client.1.smithi138.stdout:4/390: unlink d20/d34/f4a 0 2024-02-07T12:25:32.599 INFO:tasks.workunit.client.1.smithi138.stdout:0/454: getdents d4/d52/d3f 0 2024-02-07T12:25:32.599 INFO:tasks.workunit.client.1.smithi138.stdout:0/455: readlink d4/d9/l55 0 2024-02-07T12:25:32.601 INFO:tasks.workunit.client.1.smithi138.stdout:7/610: mkdir d0/d8/d11/d63/dc8/dce 0 2024-02-07T12:25:32.601 INFO:tasks.workunit.client.1.smithi138.stdout:4/391: stat d20/l42 0 2024-02-07T12:25:32.602 INFO:tasks.workunit.client.1.smithi138.stdout:4/392: stat d20/f39 0 2024-02-07T12:25:32.603 INFO:tasks.workunit.client.1.smithi138.stdout:4/393: mkdir d20/d47/d69/d7c 0 2024-02-07T12:25:32.603 INFO:tasks.workunit.client.1.smithi138.stdout:4/394: write fb [3861050,51360] 0 2024-02-07T12:25:32.605 INFO:tasks.workunit.client.1.smithi138.stdout:4/395: unlink lc 0 2024-02-07T12:25:32.605 INFO:tasks.workunit.client.1.smithi138.stdout:4/396: stat d20/f2f 0 2024-02-07T12:25:32.607 INFO:tasks.workunit.client.1.smithi138.stdout:4/397: mkdir d20/d34/d59/d72/d77/d7d 0 2024-02-07T12:25:32.607 INFO:tasks.workunit.client.1.smithi138.stdout:4/398: write d20/f28 [20327,68971] 0 2024-02-07T12:25:32.607 INFO:tasks.workunit.client.1.smithi138.stdout:4/399: chown d20/l2a 6751144 1 2024-02-07T12:25:32.607 INFO:tasks.workunit.client.1.smithi138.stdout:4/400: mknod d20/d34/c7e 0 2024-02-07T12:25:32.611 INFO:tasks.workunit.client.1.smithi138.stdout:4/401: dread fd [0,4194304] 0 2024-02-07T12:25:32.612 INFO:tasks.workunit.client.1.smithi138.stdout:4/402: read d20/f32 [675476,82028] 0 2024-02-07T12:25:32.624 INFO:tasks.workunit.client.1.smithi138.stdout:4/403: dwrite d20/f50 [0,4194304] 0 2024-02-07T12:25:32.624 INFO:tasks.workunit.client.1.smithi138.stdout:4/404: creat d20/d34/d36/d55/f7f x:0 0 0 2024-02-07T12:25:32.628 INFO:tasks.workunit.client.1.smithi138.stdout:4/405: dread d20/f28 [0,4194304] 0 2024-02-07T12:25:32.629 INFO:tasks.workunit.client.1.smithi138.stdout:4/406: truncate f3 1157321 0 2024-02-07T12:25:32.629 INFO:tasks.workunit.client.1.smithi138.stdout:4/407: chown d20/d34 0 1 2024-02-07T12:25:32.631 INFO:tasks.workunit.client.1.smithi138.stdout:4/408: write d20/d34/d36/f65 [1496844,27529] 0 2024-02-07T12:25:32.631 INFO:tasks.workunit.client.1.smithi138.stdout:4/409: fdatasync f1d 0 2024-02-07T12:25:32.772 INFO:tasks.workunit.client.1.smithi138.stdout:8/590: sync 2024-02-07T12:25:32.773 INFO:tasks.workunit.client.1.smithi138.stdout:5/442: sync 2024-02-07T12:25:32.773 INFO:tasks.workunit.client.1.smithi138.stdout:1/329: sync 2024-02-07T12:25:32.773 INFO:tasks.workunit.client.1.smithi138.stdout:1/330: chown d5/d4b/c67 153679378 1 2024-02-07T12:25:32.773 INFO:tasks.workunit.client.1.smithi138.stdout:8/591: fdatasync d1/de/d11/d17/d3e/f84 0 2024-02-07T12:25:32.773 INFO:tasks.workunit.client.1.smithi138.stdout:8/592: mkdir d1/de/db4 0 2024-02-07T12:25:32.773 INFO:tasks.workunit.client.1.smithi138.stdout:8/593: chown d1/de/d11/d17/d3e/d89/c92 16123 1 2024-02-07T12:25:32.774 INFO:tasks.workunit.client.1.smithi138.stdout:8/594: stat d1/de/d11/d17/d2e/c6b 0 2024-02-07T12:25:32.774 INFO:tasks.workunit.client.1.smithi138.stdout:8/595: dread - d1/de/d11/f1a zero size 2024-02-07T12:25:32.775 INFO:tasks.workunit.client.1.smithi138.stdout:8/596: creat d1/de/d11/d17/d8a/fb5 x:0 0 0 2024-02-07T12:25:32.780 INFO:tasks.workunit.client.1.smithi138.stdout:1/331: dread d5/d8/f35 [0,4194304] 0 2024-02-07T12:25:32.782 INFO:tasks.workunit.client.1.smithi138.stdout:8/597: dread d1/de/d11/d17/d3e/f4e [0,4194304] 0 2024-02-07T12:25:32.782 INFO:tasks.workunit.client.1.smithi138.stdout:1/332: creat d5/d8/da/d1f/d3c/d59/f6f x:0 0 0 2024-02-07T12:25:32.783 INFO:tasks.workunit.client.1.smithi138.stdout:8/598: mkdir d1/de/d11/d17/d8a/db6 0 2024-02-07T12:25:32.784 INFO:tasks.workunit.client.1.smithi138.stdout:8/599: chown d1/de/d11/d17/d3e/fb1 19114005 1 2024-02-07T12:25:32.784 INFO:tasks.workunit.client.1.smithi138.stdout:8/600: chown d1/c2b 0 1 2024-02-07T12:25:32.786 INFO:tasks.workunit.client.1.smithi138.stdout:8/601: rename d1/de/d11/d17/d2e/d49/d4c/f51 to d1/de/d11/d17/d8a/db6/fb7 0 2024-02-07T12:25:32.786 INFO:tasks.workunit.client.1.smithi138.stdout:1/333: dread d5/d8/f35 [0,4194304] 0 2024-02-07T12:25:32.788 INFO:tasks.workunit.client.1.smithi138.stdout:1/334: mknod d5/d8/da/d15/c70 0 2024-02-07T12:25:32.788 INFO:tasks.workunit.client.1.smithi138.stdout:1/335: creat d5/d8/da/f71 x:0 0 0 2024-02-07T12:25:32.790 INFO:tasks.workunit.client.1.smithi138.stdout:5/443: dwrite da/d50/f56 [0,4194304] 0 2024-02-07T12:25:32.795 INFO:tasks.workunit.client.1.smithi138.stdout:1/336: truncate d5/f9 1691 0 2024-02-07T12:25:32.797 INFO:tasks.workunit.client.1.smithi138.stdout:5/444: creat da/d6d/d27/d2e/d4f/d2b/d35/d5d/f8c x:0 0 0 2024-02-07T12:25:32.798 INFO:tasks.workunit.client.1.smithi138.stdout:8/602: rename d1/de/d11 to d1/de/db4/db8 0 2024-02-07T12:25:32.799 INFO:tasks.workunit.client.1.smithi138.stdout:5/445: dread da/fc [0,4194304] 0 2024-02-07T12:25:32.799 INFO:tasks.workunit.client.1.smithi138.stdout:1/337: mkdir d5/d4b/d72 0 2024-02-07T12:25:32.801 INFO:tasks.workunit.client.1.smithi138.stdout:8/603: rename d1/f3f to d1/de/db4/db8/fb9 0 2024-02-07T12:25:32.804 INFO:tasks.workunit.client.1.smithi138.stdout:5/446: rename da/d6d/f17 to da/d22/f8d 0 2024-02-07T12:25:32.804 INFO:tasks.workunit.client.1.smithi138.stdout:5/447: chown da/d50 278 1 2024-02-07T12:25:32.805 INFO:tasks.workunit.client.1.smithi138.stdout:8/604: truncate d1/d8e/f8f 3773956 0 2024-02-07T12:25:32.813 INFO:tasks.workunit.client.1.smithi138.stdout:1/338: dwrite d5/f61 [0,4194304] 0 2024-02-07T12:25:32.817 INFO:tasks.workunit.client.1.smithi138.stdout:1/339: mkdir d5/d8/da/d1f/d27/d68/d73 0 2024-02-07T12:25:32.824 INFO:tasks.workunit.client.1.smithi138.stdout:8/605: dwrite d1/de/db4/db8/d17/f24 [0,4194304] 0 2024-02-07T12:25:32.824 INFO:tasks.workunit.client.1.smithi138.stdout:8/606: chown d1/de/db4/db8/d17/d2e/d49/c87 0 1 2024-02-07T12:25:32.825 INFO:tasks.workunit.client.1.smithi138.stdout:1/340: write d5/d8/fd [10990013,43399] 0 2024-02-07T12:25:32.827 INFO:tasks.workunit.client.1.smithi138.stdout:8/607: creat d1/de/db4/db8/d17/d2e/d3a/d50/fba x:0 0 0 2024-02-07T12:25:32.829 INFO:tasks.workunit.client.1.smithi138.stdout:1/341: rename d5/d8/da/d1f/f46 to d5/d8/da/d1f/d27/d58/f74 0 2024-02-07T12:25:32.829 INFO:tasks.workunit.client.1.smithi138.stdout:8/608: link d1/f26 d1/fbb 0 2024-02-07T12:25:32.831 INFO:tasks.workunit.client.1.smithi138.stdout:1/342: creat d5/d8/da/d15/f75 x:0 0 0 2024-02-07T12:25:32.831 INFO:tasks.workunit.client.1.smithi138.stdout:1/343: chown d5/d8/da/d15/l37 601 1 2024-02-07T12:25:32.831 INFO:tasks.workunit.client.1.smithi138.stdout:1/344: dread - d5/d8/da/d20/f21 zero size 2024-02-07T12:25:32.831 INFO:tasks.workunit.client.1.smithi138.stdout:1/345: chown d5/d8/da/d15/f4e 157 1 2024-02-07T12:25:32.831 INFO:tasks.workunit.client.1.smithi138.stdout:1/346: readlink d5/d8/da/d15/l31 0 2024-02-07T12:25:32.831 INFO:tasks.workunit.client.1.smithi138.stdout:1/347: mkdir d5/d8/da/d1f/d27/d58/d76 0 2024-02-07T12:25:32.832 INFO:tasks.workunit.client.1.smithi138.stdout:1/348: getdents d5/d4b/d6b 0 2024-02-07T12:25:32.832 INFO:tasks.workunit.client.1.smithi138.stdout:8/609: dread d1/de/db4/db8/d17/f25 [0,4194304] 0 2024-02-07T12:25:32.832 INFO:tasks.workunit.client.1.smithi138.stdout:1/349: creat d5/d8/da/d1f/d3c/d59/f77 x:0 0 0 2024-02-07T12:25:32.841 INFO:tasks.workunit.client.1.smithi138.stdout:8/610: dread d1/f85 [0,4194304] 0 2024-02-07T12:25:32.848 INFO:tasks.workunit.client.1.smithi138.stdout:1/350: dwrite d5/f2a [0,4194304] 0 2024-02-07T12:25:32.848 INFO:tasks.workunit.client.1.smithi138.stdout:1/351: readlink d5/d8/da/d20/l66 0 2024-02-07T12:25:32.848 INFO:tasks.workunit.client.1.smithi138.stdout:1/352: creat d5/d8/da/d1f/d3c/d59/f78 x:0 0 0 2024-02-07T12:25:32.850 INFO:tasks.workunit.client.1.smithi138.stdout:1/353: mkdir d5/d4b/d6b/d6e/d79 0 2024-02-07T12:25:32.851 INFO:tasks.workunit.client.1.smithi138.stdout:1/354: creat d5/d5c/f7a x:0 0 0 2024-02-07T12:25:32.857 INFO:tasks.workunit.client.1.smithi138.stdout:8/611: dwrite d1/de/db4/db8/d17/d2e/d49/f3d [0,4194304] 0 2024-02-07T12:25:32.866 INFO:tasks.workunit.client.1.smithi138.stdout:8/612: dread d1/de/db4/db8/f18 [0,4194304] 0 2024-02-07T12:25:32.866 INFO:tasks.workunit.client.1.smithi138.stdout:1/355: rename d5/d8/da/d15 to d5/d8/da/d1f/d27/d68/d73/d7b 0 2024-02-07T12:25:32.867 INFO:tasks.workunit.client.1.smithi138.stdout:8/613: write d1/de/db4/db8/d17/d8a/db6/fb7 [484906,117108] 0 2024-02-07T12:25:32.868 INFO:tasks.workunit.client.1.smithi138.stdout:1/356: mknod d5/d8/da/d1f/d60/c7c 0 2024-02-07T12:25:32.868 INFO:tasks.workunit.client.1.smithi138.stdout:1/357: chown d5/d8/da/d1f/d27/d68/d73/d7b/f24 637040 1 2024-02-07T12:25:32.868 INFO:tasks.workunit.client.1.smithi138.stdout:8/614: creat d1/de/db4/db8/fbc x:0 0 0 2024-02-07T12:25:32.868 INFO:tasks.workunit.client.1.smithi138.stdout:1/358: mknod d5/d8/da/d4a/c7d 0 2024-02-07T12:25:32.870 INFO:tasks.workunit.client.1.smithi138.stdout:8/615: dread d1/d99/f6a [0,4194304] 0 2024-02-07T12:25:32.870 INFO:tasks.workunit.client.1.smithi138.stdout:8/616: chown d1/de/db4/db8/d17/l4d 0 1 2024-02-07T12:25:32.871 INFO:tasks.workunit.client.1.smithi138.stdout:8/617: write d1/de/db4/db8/d17/d2e/d49/f56 [829302,47572] 0 2024-02-07T12:25:32.875 INFO:tasks.workunit.client.1.smithi138.stdout:8/618: rename d1/de/db4/db8/f36 to d1/de/db4/db8/d96/fbd 0 2024-02-07T12:25:32.885 INFO:tasks.workunit.client.1.smithi138.stdout:8/619: dread d1/de/db4/db8/d17/d2e/fa1 [4194304,4194304] 0 2024-02-07T12:25:32.885 INFO:tasks.workunit.client.1.smithi138.stdout:8/620: truncate d1/d99/f6a 919236 0 2024-02-07T12:25:32.885 INFO:tasks.workunit.client.1.smithi138.stdout:1/359: dwrite d5/f9 [0,4194304] 0 2024-02-07T12:25:32.897 INFO:tasks.workunit.client.1.smithi138.stdout:8/621: write d1/f26 [3942668,128970] 0 2024-02-07T12:25:32.940 INFO:tasks.workunit.client.1.smithi138.stdout:8/622: rename d1/d8e/faf to d1/de/db4/db8/d17/d2e/d49/fbe 0 2024-02-07T12:25:32.943 INFO:tasks.workunit.client.1.smithi138.stdout:8/623: rename d1/f26 to d1/de/db4/db8/d96/fbf 0 2024-02-07T12:25:32.945 INFO:tasks.workunit.client.1.smithi138.stdout:8/624: rename d1/de/db4/db8/d17/d2e/d49/f19 to d1/fc0 0 2024-02-07T12:25:32.946 INFO:tasks.workunit.client.1.smithi138.stdout:8/625: mknod d1/d99/cc1 0 2024-02-07T12:25:33.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.266+0000 7f07edffb700 1 -- 172.21.15.47:0/362147325 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mgrmap(e 22) v1 ==== 45582+0+0 (secure 0 0 0) 0x7f07f404efb0 con 0x7f07f806e560 2024-02-07T12:25:33.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.267+0000 7f07edffb700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f07e4005cc0 0x7f07e4034550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:33.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.267+0000 7f07edffb700 1 -- 172.21.15.47:0/362147325 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f07e4032440 con 0x7f07e4005cc0 2024-02-07T12:25:33.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.267+0000 7f07fcb47700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f07e4005cc0 0x7f07e4034550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:33.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr fail", "who": "smithi047.zhgnrm"}]: dispatch 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: osdmap e48: 6 total, 6 up, 6 in 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "mgr fail", "who": "smithi047.zhgnrm"}]': finished 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: mgrmap e21: smithi138.fiugmj(active, starting, since 0.00825062s) 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:25:33.271 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mgr metadata", "who": "smithi138.fiugmj", "id": "smithi138.fiugmj"}]: dispatch 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: Manager daemon smithi138.fiugmj is now available 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:33.272 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:25:33.273 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:25:33.273 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:25:33.273 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.fiugmj/mirror_snapshot_schedule"}]: dispatch 2024-02-07T12:25:33.273 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.fiugmj/mirror_snapshot_schedule"}]: dispatch 2024-02-07T12:25:33.273 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.fiugmj/trash_purge_schedule"}]: dispatch 2024-02-07T12:25:33.273 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.fiugmj/trash_purge_schedule"}]: dispatch 2024-02-07T12:25:33.273 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:33.273 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:33 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:33.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.275+0000 7f07fcb47700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f07e4005cc0 0x7f07e4034550 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f07e800b840 tx=0x7f07e8009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:33.293 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (6m) 2m ago 7m 26.9M - 0.25.0 c8568f914cd2 edd19ce884c8 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (8m) 2m ago 8m 6660k - 17.2.7-491-gf2462625 4ad3622d1b31 bca7317ed169 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (7m) 10s ago 7m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 110c84c6624b 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (6m) 2m ago 7m 82.8M - 9.4.7 954c08fa6188 5b93631efbfc 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (2m) 2m ago 2m 16.7M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (2m) 2m ago 2m 14.7M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (2m) 10s ago 2m 60.3M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (2m) 10s ago 2m 36.9M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:9283 running (9m) 2m ago 9m 481M - 17.2.7-491-gf2462625 4ad3622d1b31 f3b25479d84e 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283 running (28s) 10s ago 7m 49.1M - 19.0.0-1252-g44458cce 79957b372307 fd928ea0fb8a 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (9m) 2m ago 9m 42.4M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 105826d9ef9a 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (7m) 10s ago 7m 37.3M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 02dfa0b8d573 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (8m) 2m ago 8m 16.2M - 1.5.0 0da6a335fe13 ba35c488ed6d 2024-02-07T12:25:33.294 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (7m) 10s ago 7m 15.8M - 1.5.0 0da6a335fe13 8823dad6f717 2024-02-07T12:25:33.295 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (6m) 2m ago 6m 47.6M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 4f37918f583a 2024-02-07T12:25:33.295 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (5m) 2m ago 5m 46.3M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 1c6e3c603ed3 2024-02-07T12:25:33.295 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (5m) 2m ago 5m 44.7M 4289M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:25:33.295 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (4m) 10s ago 4m 93.2M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:25:33.295 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (4m) 10s ago 4m 80.7M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:25:33.295 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (4m) 10s ago 4m 83.7M 5312M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:25:33.295 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (6m) 2m ago 7m 55.1M - 2.43.0 a07b618ecd1d e41b94b0d167 2024-02-07T12:25:33.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.289+0000 7f07edffb700 1 -- 172.21.15.47:0/362147325 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f07e4032440 con 0x7f07e4005cc0 2024-02-07T12:25:33.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.293+0000 7f07ff5ac700 1 -- 172.21.15.47:0/362147325 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f07e4005cc0 msgr2=0x7f07e4034550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:33.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.293+0000 7f07ff5ac700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f07e4005cc0 0x7f07e4034550 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f07e800b840 tx=0x7f07e8009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:33.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.293+0000 7f07ff5ac700 1 -- 172.21.15.47:0/362147325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07f806e560 msgr2=0x7f07f81161a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:33.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.293+0000 7f07ff5ac700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07f806e560 0x7f07f81161a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f07f4002a80 tx=0x7f07f4004600 comp rx=0 tx=0).stop 2024-02-07T12:25:33.299 INFO:tasks.workunit.client.1.smithi138.stdout:9/369: sync 2024-02-07T12:25:33.299 INFO:tasks.workunit.client.1.smithi138.stdout:9/370: dread - d0/d6/d8/f6d zero size 2024-02-07T12:25:33.299 INFO:tasks.workunit.client.1.smithi138.stdout:9/371: dread - d0/d6/d8/d1d/dd/f31 zero size 2024-02-07T12:25:33.299 INFO:tasks.workunit.client.1.smithi138.stdout:1/360: rmdir d5/d8/da 39 2024-02-07T12:25:33.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.296+0000 7f07ff5ac700 1 -- 172.21.15.47:0/362147325 shutdown_connections 2024-02-07T12:25:33.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.296+0000 7f07ff5ac700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f07e4005cc0 0x7f07e4034550 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:33.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.296+0000 7f07ff5ac700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.47:6800/3356603129,v1:172.21.15.47:6801/3356603129] conn(0x7f07e406b030 0x7f07e406d4e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:33.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.296+0000 7f07ff5ac700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07f806e560 0x7f07f81161a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:33.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.296+0000 7f07ff5ac700 1 --2- 172.21.15.47:0/362147325 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07f806eeb0 0x7f07f81166e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:33.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.296+0000 7f07ff5ac700 1 -- 172.21.15.47:0/362147325 >> 172.21.15.47:0/362147325 conn(0x7f07f8069e70 msgr2=0x7f07f8109a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:33.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.298+0000 7f07ff5ac700 1 -- 172.21.15.47:0/362147325 shutdown_connections 2024-02-07T12:25:33.301 INFO:tasks.workunit.client.1.smithi138.stdout:1/361: symlink d5/d4b/d72/l7e 0 2024-02-07T12:25:33.301 INFO:tasks.workunit.client.1.smithi138.stdout:1/362: chown d5/d8/da/d20/l66 19 1 2024-02-07T12:25:33.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.298+0000 7f07ff5ac700 1 -- 172.21.15.47:0/362147325 wait complete. 2024-02-07T12:25:33.302 INFO:tasks.workunit.client.1.smithi138.stdout:1/363: link d5/d8/da/d1f/f51 d5/d8/da/d1f/d27/f7f 0 2024-02-07T12:25:33.304 INFO:tasks.workunit.client.1.smithi138.stdout:1/364: creat d5/d8/da/d20/f80 x:0 0 0 2024-02-07T12:25:33.314 INFO:tasks.workunit.client.1.smithi138.stdout:6/429: sync 2024-02-07T12:25:33.314 INFO:tasks.workunit.client.1.smithi138.stdout:3/543: sync 2024-02-07T12:25:33.314 INFO:tasks.workunit.client.1.smithi138.stdout:7/611: sync 2024-02-07T12:25:33.314 INFO:tasks.workunit.client.1.smithi138.stdout:6/430: chown dc/d13/d1e/d24/f3c 387194 1 2024-02-07T12:25:33.314 INFO:tasks.workunit.client.1.smithi138.stdout:3/544: truncate d5/d26/d28/f4d 1535761 0 2024-02-07T12:25:33.315 INFO:tasks.workunit.client.1.smithi138.stdout:3/545: fdatasync d5/d26/d28/f83 0 2024-02-07T12:25:33.315 INFO:tasks.workunit.client.1.smithi138.stdout:8/626: rmdir d1/d8e 39 2024-02-07T12:25:33.316 INFO:tasks.workunit.client.1.smithi138.stdout:2/526: sync 2024-02-07T12:25:33.316 INFO:tasks.workunit.client.1.smithi138.stdout:2/527: write d3/dd/d14/d49/d29/d5b/fba [294358,26250] 0 2024-02-07T12:25:33.316 INFO:tasks.workunit.client.1.smithi138.stdout:0/456: sync 2024-02-07T12:25:33.316 INFO:tasks.workunit.client.1.smithi138.stdout:0/457: fdatasync d4/d9/de/d1d/d21/f86 0 2024-02-07T12:25:33.316 INFO:tasks.workunit.client.1.smithi138.stdout:0/458: dread - d4/d9/f8e zero size 2024-02-07T12:25:33.316 INFO:tasks.workunit.client.1.smithi138.stdout:5/448: sync 2024-02-07T12:25:33.316 INFO:tasks.workunit.client.1.smithi138.stdout:4/410: sync 2024-02-07T12:25:33.316 INFO:tasks.workunit.client.1.smithi138.stdout:4/411: creat d20/d34/d36/d55/f80 x:0 0 0 2024-02-07T12:25:33.316 INFO:tasks.workunit.client.1.smithi138.stdout:4/412: fsync d20/d53/f60 0 2024-02-07T12:25:33.316 INFO:tasks.workunit.client.1.smithi138.stdout:4/413: chown d20/d34/d36/f43 25064143 1 2024-02-07T12:25:33.316 INFO:tasks.workunit.client.1.smithi138.stdout:4/414: chown d20/d34/d36/l49 76734 1 2024-02-07T12:25:33.316 INFO:tasks.workunit.client.1.smithi138.stdout:4/415: fdatasync d20/d34/d36/f63 0 2024-02-07T12:25:33.318 INFO:tasks.workunit.client.1.smithi138.stdout:1/365: dread f3 [0,4194304] 0 2024-02-07T12:25:33.322 INFO:tasks.workunit.client.1.smithi138.stdout:2/528: creat d3/dd/d19/fc4 x:0 0 0 2024-02-07T12:25:33.322 INFO:tasks.workunit.client.1.smithi138.stdout:2/529: write d3/d4e/f50 [5084698,129299] 0 2024-02-07T12:25:33.322 INFO:tasks.workunit.client.1.smithi138.stdout:9/372: dwrite d0/d6/d8/f52 [0,4194304] 0 2024-02-07T12:25:33.323 INFO:tasks.workunit.client.1.smithi138.stdout:0/459: creat d4/d9/de/d1d/d8c/f93 x:0 0 0 2024-02-07T12:25:33.324 INFO:tasks.workunit.client.1.smithi138.stdout:5/449: symlink da/d50/l8e 0 2024-02-07T12:25:33.324 INFO:tasks.workunit.client.1.smithi138.stdout:5/450: dread - da/d6d/d27/d2e/f77 zero size 2024-02-07T12:25:33.327 INFO:tasks.workunit.client.1.smithi138.stdout:5/451: mknod da/d6d/d27/d2e/d4f/d2b/d35/d5d/c8f 0 2024-02-07T12:25:33.331 INFO:tasks.workunit.client.1.smithi138.stdout:5/452: rmdir da/d34 39 2024-02-07T12:25:33.331 INFO:tasks.workunit.client.1.smithi138.stdout:5/453: dread - da/d6d/d27/d2e/f79 zero size 2024-02-07T12:25:33.331 INFO:tasks.workunit.client.1.smithi138.stdout:5/454: chown da/d6d/f13 14960278 1 2024-02-07T12:25:33.331 INFO:tasks.workunit.client.1.smithi138.stdout:5/455: creat da/d22/f90 x:0 0 0 2024-02-07T12:25:33.331 INFO:tasks.workunit.client.1.smithi138.stdout:5/456: chown da/d6d/d27/d2e/d4f/d2b/d59/f8b 1 1 2024-02-07T12:25:33.331 INFO:tasks.workunit.client.1.smithi138.stdout:5/457: readlink da/d6d/l54 0 2024-02-07T12:25:33.331 INFO:tasks.workunit.client.1.smithi138.stdout:5/458: write da/d6d/d27/d2e/f88 [249031,97218] 0 2024-02-07T12:25:33.333 INFO:tasks.workunit.client.1.smithi138.stdout:3/546: dread d5/d26/d4e/f8c [0,4194304] 0 2024-02-07T12:25:33.336 INFO:tasks.workunit.client.1.smithi138.stdout:5/459: mkdir da/d6d/d27/d2e/d4f/d2b/d59/d91 0 2024-02-07T12:25:33.341 INFO:tasks.workunit.client.1.smithi138.stdout:3/547: link d5/d26/f60 d5/d26/d9b/fb9 0 2024-02-07T12:25:33.342 INFO:tasks.workunit.client.1.smithi138.stdout:3/548: getdents d5/d26/d4e 0 2024-02-07T12:25:33.342 INFO:tasks.workunit.client.1.smithi138.stdout:5/460: chown da/c3c 70787070 1 2024-02-07T12:25:33.343 INFO:tasks.workunit.client.1.smithi138.stdout:9/373: dread d0/d6/d8/f66 [0,4194304] 0 2024-02-07T12:25:33.343 INFO:tasks.workunit.client.1.smithi138.stdout:5/461: mknod da/d50/c92 0 2024-02-07T12:25:33.343 INFO:tasks.workunit.client.1.smithi138.stdout:5/462: creat da/d6d/d27/d2e/d4f/d2b/d59/d65/f93 x:0 0 0 2024-02-07T12:25:33.346 INFO:tasks.workunit.client.1.smithi138.stdout:9/374: unlink d0/d6/d8/c49 0 2024-02-07T12:25:33.346 INFO:tasks.workunit.client.1.smithi138.stdout:9/375: write d0/d6/d8/d1d/f1c [2576204,60798] 0 2024-02-07T12:25:33.348 INFO:tasks.workunit.client.1.smithi138.stdout:9/376: creat d0/d6/d8/d1d/dd/d41/f76 x:0 0 0 2024-02-07T12:25:33.349 INFO:tasks.workunit.client.1.smithi138.stdout:9/377: stat d0/d6/d8/c11 0 2024-02-07T12:25:33.349 INFO:tasks.workunit.client.1.smithi138.stdout:9/378: write d0/f38 [3520603,95105] 0 2024-02-07T12:25:33.352 INFO:tasks.workunit.client.1.smithi138.stdout:5/463: dread f8 [4194304,4194304] 0 2024-02-07T12:25:33.353 INFO:tasks.workunit.client.1.smithi138.stdout:5/464: symlink da/d6d/d27/d2e/d4f/d2b/d59/d91/l94 0 2024-02-07T12:25:33.355 INFO:tasks.workunit.client.1.smithi138.stdout:3/549: read d5/d27/d35/f50 [2111941,63778] 0 2024-02-07T12:25:33.355 INFO:tasks.workunit.client.1.smithi138.stdout:3/550: dread - d5/d15/f41 zero size 2024-02-07T12:25:33.356 INFO:tasks.workunit.client.1.smithi138.stdout:3/551: creat d5/d26/d90/fba x:0 0 0 2024-02-07T12:25:33.356 INFO:tasks.workunit.client.1.smithi138.stdout:3/552: creat d5/d26/d28/fbb x:0 0 0 2024-02-07T12:25:33.356 INFO:tasks.workunit.client.1.smithi138.stdout:3/553: write d5/d34/d79/f7b [37364,87954] 0 2024-02-07T12:25:33.357 INFO:tasks.workunit.client.1.smithi138.stdout:5/465: read da/f19 [4640735,67608] 0 2024-02-07T12:25:33.357 INFO:tasks.workunit.client.1.smithi138.stdout:3/554: symlink d5/d15/d32/lbc 0 2024-02-07T12:25:33.360 INFO:tasks.workunit.client.1.smithi138.stdout:4/416: dwrite d20/f7b [0,4194304] 0 2024-02-07T12:25:33.360 INFO:tasks.workunit.client.1.smithi138.stdout:4/417: chown d20/d4d/f62 1636460118 1 2024-02-07T12:25:33.361 INFO:tasks.workunit.client.1.smithi138.stdout:9/379: write d0/d34/d45/f6c [772594,8442] 0 2024-02-07T12:25:33.362 INFO:tasks.workunit.client.1.smithi138.stdout:5/466: read da/d6d/f4e [19406,126462] 0 2024-02-07T12:25:33.362 INFO:tasks.workunit.client.1.smithi138.stdout:5/467: fsync da/f1f 0 2024-02-07T12:25:33.362 INFO:tasks.workunit.client.1.smithi138.stdout:1/366: dwrite d5/d8/da/d1f/d27/d68/d73/d7b/f3d [0,4194304] 0 2024-02-07T12:25:33.362 INFO:tasks.workunit.client.1.smithi138.stdout:8/627: dwrite d1/de/db4/db8/d17/d2e/fa4 [0,4194304] 0 2024-02-07T12:25:33.362 INFO:tasks.workunit.client.1.smithi138.stdout:7/612: dwrite d0/d8/d11/d26/f49 [0,4194304] 0 2024-02-07T12:25:33.362 INFO:tasks.workunit.client.1.smithi138.stdout:3/555: dread d5/d26/d28/f4b [0,4194304] 0 2024-02-07T12:25:33.362 INFO:tasks.workunit.client.1.smithi138.stdout:2/530: dwrite d3/dd/d19/d1f/d37/f3b [4194304,4194304] 0 2024-02-07T12:25:33.362 INFO:tasks.workunit.client.1.smithi138.stdout:7/613: write d0/f74 [237883,3443] 0 2024-02-07T12:25:33.362 INFO:tasks.workunit.client.1.smithi138.stdout:7/614: chown d0/d6/d76/d93/f57 1609413 1 2024-02-07T12:25:33.363 INFO:tasks.workunit.client.1.smithi138.stdout:4/418: mknod d20/d34/d59/d72/d77/c81 0 2024-02-07T12:25:33.366 INFO:tasks.workunit.client.1.smithi138.stdout:5/468: mkdir da/d43/d4a/d95 0 2024-02-07T12:25:33.368 INFO:tasks.workunit.client.1.smithi138.stdout:1/367: creat d5/d8/da/d1f/d5e/d63/f81 x:0 0 0 2024-02-07T12:25:33.368 INFO:tasks.workunit.client.1.smithi138.stdout:1/368: stat d5/d8/da/d1f/d27/d68/d73 0 2024-02-07T12:25:33.368 INFO:tasks.workunit.client.1.smithi138.stdout:1/369: chown d5/f9 97332539 1 2024-02-07T12:25:33.368 INFO:tasks.workunit.client.1.smithi138.stdout:1/370: chown d5/d8/f14 5 1 2024-02-07T12:25:33.377 INFO:tasks.workunit.client.1.smithi138.stdout:3/556: creat d5/d26/d28/db7/fbd x:0 0 0 2024-02-07T12:25:33.377 INFO:tasks.workunit.client.1.smithi138.stdout:2/531: rename d3/dd/d14/d8f/cb3 to d3/cc5 0 2024-02-07T12:25:33.379 INFO:tasks.workunit.client.1.smithi138.stdout:7/615: stat d0/d8/d11/d26/d90/f72 0 2024-02-07T12:25:33.380 INFO:tasks.workunit.client.1.smithi138.stdout:4/419: getdents d20/d47 0 2024-02-07T12:25:33.382 INFO:tasks.workunit.client.1.smithi138.stdout:1/371: unlink d5/d8/fd 0 2024-02-07T12:25:33.383 INFO:tasks.workunit.client.1.smithi138.stdout:3/557: stat d5/d26/d28/c54 0 2024-02-07T12:25:33.384 INFO:tasks.workunit.client.1.smithi138.stdout:9/380: dwrite d0/d6/d8/d1d/dd/d41/f60 [0,4194304] 0 2024-02-07T12:25:33.384 INFO:tasks.workunit.client.1.smithi138.stdout:9/381: creat d0/f77 x:0 0 0 2024-02-07T12:25:33.386 INFO:tasks.workunit.client.1.smithi138.stdout:4/420: rename d20/f50 to d20/d34/d59/d72/d77/f82 0 2024-02-07T12:25:33.386 INFO:tasks.workunit.client.1.smithi138.stdout:4/421: stat d20/f26 0 2024-02-07T12:25:33.386 INFO:tasks.workunit.client.1.smithi138.stdout:4/422: chown d20/d34/d36 1969 1 2024-02-07T12:25:33.387 INFO:tasks.workunit.client.1.smithi138.stdout:2/532: dread d3/dd/d19/f35 [0,4194304] 0 2024-02-07T12:25:33.389 INFO:tasks.workunit.client.1.smithi138.stdout:1/372: symlink d5/d4b/d65/l82 0 2024-02-07T12:25:33.390 INFO:tasks.workunit.client.1.smithi138.stdout:7/616: dread d0/d8/d11/d5f/d86/f9d [0,4194304] 0 2024-02-07T12:25:33.390 INFO:tasks.workunit.client.1.smithi138.stdout:7/617: dread - d0/d6/d1d/d38/f8d zero size 2024-02-07T12:25:33.390 INFO:tasks.workunit.client.1.smithi138.stdout:7/618: write d0/d8/d11/d5f/f95 [4842556,59949] 0 2024-02-07T12:25:33.390 INFO:tasks.workunit.client.1.smithi138.stdout:9/382: dread d0/d6/d8/d1d/dd/d1f/f1b [0,4194304] 0 2024-02-07T12:25:33.390 INFO:tasks.workunit.client.1.smithi138.stdout:9/383: fsync d0/d6/f1e 0 2024-02-07T12:25:33.390 INFO:tasks.workunit.client.1.smithi138.stdout:9/384: fdatasync d0/d6/d8/d1d/dd/d41/d5e/f67 0 2024-02-07T12:25:33.392 INFO:tasks.workunit.client.1.smithi138.stdout:7/619: dread d0/d8/d11/d26/d90/f2c [0,4194304] 0 2024-02-07T12:25:33.392 INFO:tasks.workunit.client.1.smithi138.stdout:7/620: truncate d0/d8/d11/d26/f33 4308394 0 2024-02-07T12:25:33.396 INFO:tasks.workunit.client.1.smithi138.stdout:5/469: dwrite da/d6d/f13 [0,4194304] 0 2024-02-07T12:25:33.396 INFO:tasks.workunit.client.1.smithi138.stdout:5/470: dread - da/d43/d4a/f84 zero size 2024-02-07T12:25:33.396 INFO:tasks.workunit.client.1.smithi138.stdout:5/471: write da/d43/d4a/f84 [343942,102218] 0 2024-02-07T12:25:33.396 INFO:tasks.workunit.client.1.smithi138.stdout:8/628: dwrite d1/de/db4/db8/d17/d2e/d3a/f66 [0,4194304] 0 2024-02-07T12:25:33.397 INFO:tasks.workunit.client.1.smithi138.stdout:3/558: rename d5/d26/d28/f4d to d5/d26/d5e/d86/dae/fbe 0 2024-02-07T12:25:33.397 INFO:tasks.workunit.client.1.smithi138.stdout:3/559: dread - d5/d26/d28/db7/fbd zero size 2024-02-07T12:25:33.397 INFO:tasks.workunit.client.1.smithi138.stdout:3/560: chown d5/d26/f2c 183447 1 2024-02-07T12:25:33.397 INFO:tasks.workunit.client.1.smithi138.stdout:4/423: mknod d20/d34/d73/c83 0 2024-02-07T12:25:33.397 INFO:tasks.workunit.client.1.smithi138.stdout:4/424: read - d20/d34/d59/f6c zero size 2024-02-07T12:25:33.398 INFO:tasks.workunit.client.1.smithi138.stdout:1/373: symlink d5/d5b/l83 0 2024-02-07T12:25:33.398 INFO:tasks.workunit.client.1.smithi138.stdout:1/374: readlink d5/d8/da/d1f/d27/d68/d73/d7b/l1b 0 2024-02-07T12:25:33.400 INFO:tasks.workunit.client.1.smithi138.stdout:2/533: dread d3/dd/d19/d44/f69 [0,4194304] 0 2024-02-07T12:25:33.405 INFO:tasks.workunit.client.1.smithi138.stdout:8/629: dread d1/de/db4/db8/d17/d2e/d3a/f83 [0,4194304] 0 2024-02-07T12:25:33.406 INFO:tasks.workunit.client.1.smithi138.stdout:8/630: dread d1/de/db4/db8/d17/d2e/d49/d4c/d62/f68 [0,4194304] 0 2024-02-07T12:25:33.408 INFO:tasks.workunit.client.1.smithi138.stdout:3/561: rename d5/d26/d4e/c98 to d5/d26/d5e/d77/cbf 0 2024-02-07T12:25:33.413 INFO:tasks.workunit.client.1.smithi138.stdout:4/425: rmdir d20/d47/d69/d76 39 2024-02-07T12:25:33.413 INFO:tasks.workunit.client.1.smithi138.stdout:7/621: dwrite d0/d8/d15/db1/fc9 [0,4194304] 0 2024-02-07T12:25:33.414 INFO:tasks.workunit.client.1.smithi138.stdout:2/534: write d3/d4e/f50 [1492088,7324] 0 2024-02-07T12:25:33.414 INFO:tasks.workunit.client.1.smithi138.stdout:2/535: stat d3/dd/d19/d44/d7d/l90 0 2024-02-07T12:25:33.414 INFO:tasks.workunit.client.1.smithi138.stdout:2/536: write d3/dd/d14/d49/d25/d3d/f52 [1968645,53595] 0 2024-02-07T12:25:33.414 INFO:tasks.workunit.client.1.smithi138.stdout:1/375: mknod d5/d8/da/d1f/d27/c84 0 2024-02-07T12:25:33.415 INFO:tasks.workunit.client.1.smithi138.stdout:9/385: rmdir d0/d6/d8/d1d/dd/d41/d5e 39 2024-02-07T12:25:33.416 INFO:tasks.workunit.client.1.smithi138.stdout:8/631: write d1/d8e/fa5 [4075209,84626] 0 2024-02-07T12:25:33.416 INFO:tasks.workunit.client.1.smithi138.stdout:8/632: stat f0 0 2024-02-07T12:25:33.418 INFO:tasks.workunit.client.1.smithi138.stdout:3/562: mkdir d5/d26/d5e/d86/dc0 0 2024-02-07T12:25:33.418 INFO:tasks.workunit.client.1.smithi138.stdout:3/563: write d5/d34/f8f [828141,117801] 0 2024-02-07T12:25:33.419 INFO:tasks.workunit.client.1.smithi138.stdout:4/426: mkdir d20/d34/d36/d55/d74/d84 0 2024-02-07T12:25:33.419 INFO:tasks.workunit.client.1.smithi138.stdout:4/427: dread - d20/d47/d69/f6e zero size 2024-02-07T12:25:33.419 INFO:tasks.workunit.client.1.smithi138.stdout:4/428: fdatasync d20/d53/f64 0 2024-02-07T12:25:33.422 INFO:tasks.workunit.client.1.smithi138.stdout:7/622: write d0/d8/d11/d26/d90/f4f [924209,80125] 0 2024-02-07T12:25:33.422 INFO:tasks.workunit.client.1.smithi138.stdout:7/623: creat d0/d8/d11/fcf x:0 0 0 2024-02-07T12:25:33.424 INFO:tasks.workunit.client.1.smithi138.stdout:2/537: symlink d3/dd/d19/d44/d7d/lc6 0 2024-02-07T12:25:33.427 INFO:tasks.workunit.client.1.smithi138.stdout:1/376: symlink d5/d8/da/d1f/d27/d68/l85 0 2024-02-07T12:25:33.428 INFO:tasks.workunit.client.1.smithi138.stdout:1/377: creat d5/f86 x:0 0 0 2024-02-07T12:25:33.429 INFO:tasks.workunit.client.1.smithi138.stdout:8/633: creat d1/d99/da6/fc2 x:0 0 0 2024-02-07T12:25:33.429 INFO:tasks.workunit.client.1.smithi138.stdout:8/634: readlink d1/de/db4/db8/d96/la3 0 2024-02-07T12:25:33.430 INFO:tasks.workunit.client.1.smithi138.stdout:5/472: rename da/d6d/d27/d2e/d4f/d2b/d59/d65 to da/d6d/d27/d2e/d4f/d2b/d59/d96 0 2024-02-07T12:25:33.431 INFO:tasks.workunit.client.1.smithi138.stdout:5/473: dread da/d6d/f6b [0,4194304] 0 2024-02-07T12:25:33.433 INFO:tasks.workunit.client.1.smithi138.stdout:9/386: dwrite d0/d6/d8/d1d/dd/f31 [0,4194304] 0 2024-02-07T12:25:33.443 INFO:tasks.workunit.client.1.smithi138.stdout:5/474: dwrite da/d6d/d27/f33 [4194304,4194304] 0 2024-02-07T12:25:33.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.456+0000 7f8ae630f700 1 -- 172.21.15.47:0/236968094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0066c70 msgr2=0x7f8ae0101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:33.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.456+0000 7f8ae630f700 1 --2- 172.21.15.47:0/236968094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0066c70 0x7f8ae0101ef0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0004940 tx=0x7f8ad0009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:33.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.456+0000 7f8ae630f700 1 -- 172.21.15.47:0/236968094 shutdown_connections 2024-02-07T12:25:33.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.456+0000 7f8ae630f700 1 --2- 172.21.15.47:0/236968094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ae0102430 0x7f8ae0104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:33.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.456+0000 7f8ae630f700 1 --2- 172.21.15.47:0/236968094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0066c70 0x7f8ae0101ef0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:33.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.456+0000 7f8ae630f700 1 -- 172.21.15.47:0/236968094 >> 172.21.15.47:0/236968094 conn(0x7f8ae00f7500 msgr2=0x7f8ae00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:33.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.456+0000 7f8ae630f700 1 -- 172.21.15.47:0/236968094 shutdown_connections 2024-02-07T12:25:33.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.456+0000 7f8ae630f700 1 -- 172.21.15.47:0/236968094 wait complete. 2024-02-07T12:25:33.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.457+0000 7f8ae630f700 1 Processor -- start 2024-02-07T12:25:33.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.457+0000 7f8ae630f700 1 -- start start 2024-02-07T12:25:33.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.457+0000 7f8ae630f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0066c70 0x7f8ae010fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:33.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8ae630f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ae0102430 0x7f8ae0110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:33.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8ae630f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0110610 con 0x7f8ae0066c70 2024-02-07T12:25:33.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8ae630f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0110eb0 con 0x7f8ae0102430 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8adffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0066c70 0x7f8ae010fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8adffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0066c70 0x7f8ae010fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40048/0 (socket says 172.21.15.47:40048) 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8adffff700 1 -- 172.21.15.47:0/3233256280 learned_addr learned my addr 172.21.15.47:0/3233256280 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8adf7fe700 1 --2- 172.21.15.47:0/3233256280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ae0102430 0x7f8ae0110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8adffff700 1 -- 172.21.15.47:0/3233256280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ae0102430 msgr2=0x7f8ae0110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8adffff700 1 --2- 172.21.15.47:0/3233256280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ae0102430 0x7f8ae0110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8adffff700 1 -- 172.21.15.47:0/3233256280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0005040 con 0x7f8ae0066c70 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8adf7fe700 1 --2- 172.21.15.47:0/3233256280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ae0102430 0x7f8ae0110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8adffff700 1 --2- 172.21.15.47:0/3233256280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0066c70 0x7f8ae010fad0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0000c00 tx=0x7f8ad0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8adcff9700 1 -- 172.21.15.47:0/3233256280 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad0021070 con 0x7f8ae0066c70 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8adcff9700 1 -- 172.21.15.47:0/3233256280 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ad001c400 con 0x7f8ae0066c70 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8ae630f700 1 -- 172.21.15.47:0/3233256280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae0111130 con 0x7f8ae0066c70 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8adcff9700 1 -- 172.21.15.47:0/3233256280 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad000e070 con 0x7f8ae0066c70 2024-02-07T12:25:33.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.458+0000 7f8ae630f700 1 -- 172.21.15.47:0/3233256280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae0111610 con 0x7f8ae0066c70 2024-02-07T12:25:33.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.459+0000 7f8adcff9700 1 -- 172.21.15.47:0/3233256280 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) v1 ==== 45582+0+0 (secure 0 0 0) 0x7f8ad000b7d0 con 0x7f8ae0066c70 2024-02-07T12:25:33.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.459+0000 7f8adcff9700 1 --2- 172.21.15.47:0/3233256280 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f8ac8038650 0x7f8ac803ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:33.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.459+0000 7f8adcff9700 1 -- 172.21.15.47:0/3233256280 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8ad004d120 con 0x7f8ae0066c70 2024-02-07T12:25:33.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.460+0000 7f8adf7fe700 1 --2- 172.21.15.47:0/3233256280 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f8ac8038650 0x7f8ac803ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:33.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.460+0000 7f8ae630f700 1 -- 172.21.15.47:0/3233256280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae0109c70 con 0x7f8ae0066c70 2024-02-07T12:25:33.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.460+0000 7f8adf7fe700 1 --2- 172.21.15.47:0/3233256280 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f8ac8038650 0x7f8ac803ab00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4004600 tx=0x7f8ad400b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:33.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.465+0000 7f8adcff9700 1 -- 172.21.15.47:0/3233256280 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8ad000bb70 con 0x7f8ae0066c70 2024-02-07T12:25:33.524 INFO:tasks.workunit.client.1.smithi138.stdout:3/564: mkdir d5/d26/d5e/d86/dae/dc1 0 2024-02-07T12:25:33.526 INFO:tasks.workunit.client.1.smithi138.stdout:4/429: link d20/f54 d20/d47/d69/d7c/f85 0 2024-02-07T12:25:33.527 INFO:tasks.workunit.client.1.smithi138.stdout:4/430: stat d20/d34/d36/d55/f80 0 2024-02-07T12:25:33.530 INFO:tasks.workunit.client.1.smithi138.stdout:7/624: creat d0/d6/d84/fd0 x:0 0 0 2024-02-07T12:25:33.532 INFO:tasks.workunit.client.1.smithi138.stdout:2/538: unlink d3/dd/d19/d1f/c40 0 2024-02-07T12:25:33.532 INFO:tasks.workunit.client.1.smithi138.stdout:2/539: readlink d3/dd/d14/d49/d29/lb2 0 2024-02-07T12:25:33.532 INFO:tasks.workunit.client.1.smithi138.stdout:2/540: read - d3/dd/d19/d1f/d37/f75 zero size 2024-02-07T12:25:33.532 INFO:tasks.workunit.client.1.smithi138.stdout:5/475: dwrite da/d6d/d27/f28 [0,4194304] 0 2024-02-07T12:25:33.532 INFO:tasks.workunit.client.1.smithi138.stdout:5/476: read da/d6d/f4e [1167759,5208] 0 2024-02-07T12:25:33.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:33.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:33.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:25:33.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:25:33.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:25:33.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:25:33.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr fail", "who": "smithi047.zhgnrm"}]: dispatch 2024-02-07T12:25:33.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: osdmap e48: 6 total, 6 up, 6 in 2024-02-07T12:25:33.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:25:33.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:25:33.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.14208 172.21.15.47:0/3375135891' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "mgr fail", "who": "smithi047.zhgnrm"}]': finished 2024-02-07T12:25:33.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: mgrmap e21: smithi138.fiugmj(active, starting, since 0.00825062s) 2024-02-07T12:25:33.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:25:33.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:25:33.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:25:33.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:25:33.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mgr metadata", "who": "smithi138.fiugmj", "id": "smithi138.fiugmj"}]: dispatch 2024-02-07T12:25:33.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:25:33.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:25:33.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:25:33.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:25:33.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:25:33.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:25:33.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-07T12:25:33.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-07T12:25:33.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-07T12:25:33.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: Manager daemon smithi138.fiugmj is now available 2024-02-07T12:25:33.537 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:33.537 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:25:33.537 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:25:33.537 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:25:33.537 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.fiugmj/mirror_snapshot_schedule"}]: dispatch 2024-02-07T12:25:33.537 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.fiugmj/mirror_snapshot_schedule"}]: dispatch 2024-02-07T12:25:33.537 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.fiugmj/trash_purge_schedule"}]: dispatch 2024-02-07T12:25:33.537 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.fiugmj/trash_purge_schedule"}]: dispatch 2024-02-07T12:25:33.537 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:33.537 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:33 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:33.549 INFO:tasks.workunit.client.1.smithi138.stdout:7/625: dwrite d0/d8/d11/d5f/f95 [0,4194304] 0 2024-02-07T12:25:33.549 INFO:tasks.workunit.client.1.smithi138.stdout:7/626: readlink d0/d8/l43 0 2024-02-07T12:25:33.552 INFO:tasks.workunit.client.1.smithi138.stdout:1/378: creat d5/d8/da/d1f/d27/d58/f87 x:0 0 0 2024-02-07T12:25:33.553 INFO:tasks.workunit.client.1.smithi138.stdout:8/635: mknod d1/de/db4/db8/d17/d3e/cc3 0 2024-02-07T12:25:33.558 INFO:tasks.workunit.client.1.smithi138.stdout:9/387: unlink d0/d34/d45/f6c 0 2024-02-07T12:25:33.561 INFO:tasks.workunit.client.1.smithi138.stdout:4/431: rmdir d20/d47/d69/d76 39 2024-02-07T12:25:33.562 INFO:tasks.workunit.client.1.smithi138.stdout:1/379: dread d5/d8/da/d1f/d27/d68/d73/d7b/f3d [0,4194304] 0 2024-02-07T12:25:33.562 INFO:tasks.workunit.client.1.smithi138.stdout:1/380: write d5/d8/da/f71 [149644,88409] 0 2024-02-07T12:25:33.563 INFO:tasks.workunit.client.1.smithi138.stdout:5/477: mknod da/d6d/d27/d2e/d4f/d2b/d59/d91/c97 0 2024-02-07T12:25:33.571 INFO:tasks.workunit.client.1.smithi138.stdout:8/636: dwrite d1/fbb [0,4194304] 0 2024-02-07T12:25:33.571 INFO:tasks.workunit.client.1.smithi138.stdout:8/637: truncate d1/de/db4/db8/d17/d3e/fb1 80062 0 2024-02-07T12:25:33.572 INFO:tasks.workunit.client.1.smithi138.stdout:8/638: getdents d1/db3 0 2024-02-07T12:25:33.575 INFO:tasks.workunit.client.1.smithi138.stdout:5/478: dread da/f29 [8388608,4194304] 0 2024-02-07T12:25:33.583 INFO:tasks.workunit.client.1.smithi138.stdout:9/388: dwrite d0/f38 [0,4194304] 0 2024-02-07T12:25:33.583 INFO:tasks.workunit.client.1.smithi138.stdout:9/389: chown d0/d6/d8/d1d/c46 847047 1 2024-02-07T12:25:33.636 INFO:tasks.workunit.client.1.smithi138.stdout:7/627: creat d0/d6/d3e/fd1 x:0 0 0 2024-02-07T12:25:33.637 INFO:tasks.workunit.client.1.smithi138.stdout:4/432: mkdir d20/d34/d59/d72/d86 0 2024-02-07T12:25:33.637 INFO:tasks.workunit.client.1.smithi138.stdout:1/381: creat d5/d8/da/d20/f88 x:0 0 0 2024-02-07T12:25:33.637 INFO:tasks.workunit.client.1.smithi138.stdout:1/382: chown d5/d8/da/d1f/d27/d68 97765 1 2024-02-07T12:25:33.637 INFO:tasks.workunit.client.1.smithi138.stdout:1/383: getdents d5/d4b/d6b 0 2024-02-07T12:25:33.639 INFO:tasks.workunit.client.1.smithi138.stdout:3/565: rename d5/d15/l1f to d5/d27/d35/d7c/lc2 0 2024-02-07T12:25:33.639 INFO:tasks.workunit.client.1.smithi138.stdout:5/479: mkdir da/d43/d4a/d98 0 2024-02-07T12:25:33.646 INFO:tasks.workunit.client.1.smithi138.stdout:7/628: dread d0/d6/d3e/f3f [0,4194304] 0 2024-02-07T12:25:33.647 INFO:tasks.workunit.client.1.smithi138.stdout:2/541: link d3/dd/d14/d8f/l74 d3/dd/d19/d1f/lc7 0 2024-02-07T12:25:33.651 INFO:tasks.workunit.client.1.smithi138.stdout:1/384: dwrite d5/f1e [0,4194304] 0 2024-02-07T12:25:33.652 INFO:tasks.workunit.client.1.smithi138.stdout:1/385: write d5/d8/da/d1f/d3c/d59/f77 [291264,49965] 0 2024-02-07T12:25:33.653 INFO:tasks.workunit.client.1.smithi138.stdout:2/542: dread d3/dd/d19/d1f/f5c [0,4194304] 0 2024-02-07T12:25:33.654 INFO:tasks.workunit.client.1.smithi138.stdout:9/390: mkdir d0/d34/d45/d78 0 2024-02-07T12:25:33.655 INFO:tasks.workunit.client.1.smithi138.stdout:9/391: write d0/d6/d8/d1d/dd/d41/d5e/f75 [871199,18365] 0 2024-02-07T12:25:33.655 INFO:tasks.workunit.client.1.smithi138.stdout:4/433: getdents d20/d53/d71 0 2024-02-07T12:25:33.656 INFO:tasks.workunit.client.1.smithi138.stdout:9/392: fdatasync d0/d6/d8/d1d/dd/d41/d5e/f75 0 2024-02-07T12:25:33.658 INFO:tasks.workunit.client.1.smithi138.stdout:5/480: getdents da/d6d/d27/d2e/d4f/d2b/d35/d40 0 2024-02-07T12:25:33.659 INFO:tasks.workunit.client.1.smithi138.stdout:7/629: getdents d0/d8/d11/d63/dc8 0 2024-02-07T12:25:33.661 INFO:tasks.workunit.client.1.smithi138.stdout:1/386: link d5/d8/l4c d5/d4b/d72/l89 0 2024-02-07T12:25:33.663 INFO:tasks.workunit.client.1.smithi138.stdout:2/543: link d3/dd/d19/d1f/d37/l79 d3/dd/d14/d8f/da5/lc8 0 2024-02-07T12:25:33.663 INFO:tasks.workunit.client.1.smithi138.stdout:2/544: readlink d3/dd/d19/d44/l63 0 2024-02-07T12:25:33.667 INFO:tasks.workunit.client.1.smithi138.stdout:5/481: dread da/d6d/d27/f28 [0,4194304] 0 2024-02-07T12:25:33.667 INFO:tasks.workunit.client.1.smithi138.stdout:5/482: fdatasync da/d22/f8d 0 2024-02-07T12:25:33.667 INFO:tasks.workunit.client.1.smithi138.stdout:5/483: dread - da/d6d/d27/f7b zero size 2024-02-07T12:25:33.669 INFO:tasks.workunit.client.1.smithi138.stdout:9/393: truncate d0/d6/d8/d1d/dd/f20 770314 0 2024-02-07T12:25:33.670 INFO:tasks.workunit.client.1.smithi138.stdout:7/630: mknod d0/d6/d76/cd2 0 2024-02-07T12:25:33.672 INFO:tasks.workunit.client.1.smithi138.stdout:1/387: stat d5/d8/da/f11 0 2024-02-07T12:25:33.672 INFO:tasks.workunit.client.1.smithi138.stdout:2/545: dread d3/dd/d14/d49/d25/d3d/f3e [0,4194304] 0 2024-02-07T12:25:33.678 INFO:tasks.workunit.client.1.smithi138.stdout:8/639: rename d1/de/l1c to d1/de/db4/db8/d17/d2e/d49/d4c/lc4 0 2024-02-07T12:25:33.679 INFO:tasks.workunit.client.1.smithi138.stdout:4/434: rmdir d20/d34/d36/d55 39 2024-02-07T12:25:33.679 INFO:tasks.workunit.client.1.smithi138.stdout:4/435: readlink d20/d34/d36/l49 0 2024-02-07T12:25:33.679 INFO:tasks.workunit.client.1.smithi138.stdout:4/436: write d20/f32 [5900404,42202] 0 2024-02-07T12:25:33.683 INFO:tasks.workunit.client.1.smithi138.stdout:5/484: unlink da/d22/f62 0 2024-02-07T12:25:33.686 INFO:tasks.workunit.client.1.smithi138.stdout:9/394: rmdir d0/d6/d8/d1d/dd/d1f 39 2024-02-07T12:25:33.687 INFO:tasks.workunit.client.1.smithi138.stdout:2/546: mkdir d3/dd/d19/d1f/dc9 0 2024-02-07T12:25:33.687 INFO:tasks.workunit.client.1.smithi138.stdout:2/547: fdatasync d3/f53 0 2024-02-07T12:25:33.690 INFO:tasks.workunit.client.1.smithi138.stdout:3/566: rename d5/d26/d28/f59 to d5/d26/d5e/d86/dc0/fc3 0 2024-02-07T12:25:33.692 INFO:tasks.workunit.client.1.smithi138.stdout:4/437: dread f13 [0,4194304] 0 2024-02-07T12:25:33.692 INFO:tasks.workunit.client.1.smithi138.stdout:4/438: dread - d20/d4d/f62 zero size 2024-02-07T12:25:33.693 INFO:tasks.workunit.client.1.smithi138.stdout:4/439: fdatasync d20/d34/f4c 0 2024-02-07T12:25:33.693 INFO:tasks.workunit.client.1.smithi138.stdout:4/440: truncate d20/f3d 1484211 0 2024-02-07T12:25:33.695 INFO:tasks.workunit.client.1.smithi138.stdout:5/485: mkdir da/d22/d99 0 2024-02-07T12:25:33.695 INFO:tasks.workunit.client.1.smithi138.stdout:5/486: creat da/d43/d4a/f9a x:0 0 0 2024-02-07T12:25:33.698 INFO:tasks.workunit.client.1.smithi138.stdout:2/548: rename d3/dd/d19/l7 to d3/dd/d14/d8f/dbc/lca 0 2024-02-07T12:25:33.700 INFO:tasks.workunit.client.1.smithi138.stdout:7/631: dwrite d0/d6/d76/d93/fbb [0,4194304] 0 2024-02-07T12:25:33.700 INFO:tasks.workunit.client.1.smithi138.stdout:1/388: dwrite d5/d8/da/d20/f88 [0,4194304] 0 2024-02-07T12:25:33.700 INFO:tasks.workunit.client.1.smithi138.stdout:3/567: mkdir d5/d26/d9b/dab/dc4 0 2024-02-07T12:25:33.705 INFO:tasks.workunit.client.1.smithi138.stdout:4/441: rmdir d20/d34/d36/d55/d74/d84 0 2024-02-07T12:25:33.707 INFO:tasks.workunit.client.1.smithi138.stdout:8/640: dwrite d1/de/db4/db8/f43 [0,4194304] 0 2024-02-07T12:25:33.707 INFO:tasks.workunit.client.1.smithi138.stdout:8/641: write d1/de/db4/db8/f1a [686454,66298] 0 2024-02-07T12:25:33.708 INFO:tasks.workunit.client.1.smithi138.stdout:5/487: creat da/d22/d99/f9b x:0 0 0 2024-02-07T12:25:33.709 INFO:tasks.workunit.client.1.smithi138.stdout:9/395: dwrite d0/d6/d8/d1d/dd/d41/f5c [0,4194304] 0 2024-02-07T12:25:33.709 INFO:tasks.workunit.client.1.smithi138.stdout:2/549: mknod d3/dd/d19/d44/d7d/d97/ccb 0 2024-02-07T12:25:33.709 INFO:tasks.workunit.client.1.smithi138.stdout:9/396: creat d0/d6/d8/d1d/dd/d41/f79 x:0 0 0 2024-02-07T12:25:33.710 INFO:tasks.workunit.client.1.smithi138.stdout:3/568: write d5/f9 [2705423,66569] 0 2024-02-07T12:25:33.710 INFO:tasks.workunit.client.1.smithi138.stdout:3/569: chown d5/d34/d79/l93 3555764 1 2024-02-07T12:25:33.713 INFO:tasks.workunit.client.1.smithi138.stdout:8/642: write d1/de/db4/db8/d17/d2e/d3a/f83 [2371038,53092] 0 2024-02-07T12:25:33.714 INFO:tasks.workunit.client.1.smithi138.stdout:1/389: mknod d5/d8/da/d1f/d27/d68/c8a 0 2024-02-07T12:25:33.715 INFO:tasks.workunit.client.1.smithi138.stdout:4/442: mkdir d20/d4d/d87 0 2024-02-07T12:25:33.716 INFO:tasks.workunit.client.1.smithi138.stdout:9/397: write d0/d6/d8/d1d/dd/f31 [1529144,90799] 0 2024-02-07T12:25:33.718 INFO:tasks.workunit.client.1.smithi138.stdout:5/488: creat da/d6d/d27/d2e/d4f/f9c x:0 0 0 2024-02-07T12:25:33.720 INFO:tasks.workunit.client.1.smithi138.stdout:2/550: mkdir d3/dd/d14/d82/dcc 0 2024-02-07T12:25:33.721 INFO:tasks.workunit.client.1.smithi138.stdout:3/570: mkdir d5/d34/dc5 0 2024-02-07T12:25:33.721 INFO:tasks.workunit.client.1.smithi138.stdout:3/571: chown d5/d15/l1e 15890 1 2024-02-07T12:25:33.723 INFO:tasks.workunit.client.1.smithi138.stdout:7/632: mknod d0/d8/d11/d26/d90/d98/da6/cd3 0 2024-02-07T12:25:33.723 INFO:tasks.workunit.client.1.smithi138.stdout:7/633: stat d0/d6/d84/fd0 0 2024-02-07T12:25:33.723 INFO:tasks.workunit.client.1.smithi138.stdout:8/643: rmdir d1/de/db4/db8/d17/d58 39 2024-02-07T12:25:33.725 INFO:tasks.workunit.client.1.smithi138.stdout:1/390: unlink d5/f32 0 2024-02-07T12:25:33.726 INFO:tasks.workunit.client.1.smithi138.stdout:1/391: write d5/d8/da/d1f/d27/d58/f87 [1003371,109107] 0 2024-02-07T12:25:33.728 INFO:tasks.workunit.client.1.smithi138.stdout:5/489: rename da/d22/f90 to da/d43/d4a/f9d 0 2024-02-07T12:25:33.729 INFO:tasks.workunit.client.1.smithi138.stdout:2/551: rmdir d3/dd/d19/d1f 39 2024-02-07T12:25:33.730 INFO:tasks.workunit.client.1.smithi138.stdout:2/552: dread d3/dd/d14/d49/f98 [0,4194304] 0 2024-02-07T12:25:33.732 INFO:tasks.workunit.client.1.smithi138.stdout:7/634: dread d0/d6/d3e/f3f [0,4194304] 0 2024-02-07T12:25:33.732 INFO:tasks.workunit.client.1.smithi138.stdout:7/635: creat d0/d8/d11/d26/d90/d98/fd4 x:0 0 0 2024-02-07T12:25:33.732 INFO:tasks.workunit.client.1.smithi138.stdout:6/431: sync 2024-02-07T12:25:33.732 INFO:tasks.workunit.client.1.smithi138.stdout:0/460: sync 2024-02-07T12:25:33.732 INFO:tasks.workunit.client.1.smithi138.stdout:3/572: getdents d5/d26/d5e/d86 0 2024-02-07T12:25:33.733 INFO:tasks.workunit.client.1.smithi138.stdout:8/644: dread d1/de/db4/db8/f43 [0,4194304] 0 2024-02-07T12:25:33.733 INFO:tasks.workunit.client.1.smithi138.stdout:8/645: dread - d1/de/db4/db8/d17/d3e/d72/f9f zero size 2024-02-07T12:25:33.733 INFO:tasks.workunit.client.1.smithi138.stdout:5/490: rename da/fc to da/d43/d4a/f9e 0 2024-02-07T12:25:33.733 INFO:tasks.workunit.client.1.smithi138.stdout:8/646: dread - d1/de/db4/db8/d17/d3e/f5a zero size 2024-02-07T12:25:33.734 INFO:tasks.workunit.client.1.smithi138.stdout:2/553: creat d3/dd/d14/d49/d25/fcd x:0 0 0 2024-02-07T12:25:33.738 INFO:tasks.workunit.client.1.smithi138.stdout:1/392: dread d5/f1e [0,4194304] 0 2024-02-07T12:25:33.738 INFO:tasks.workunit.client.1.smithi138.stdout:1/393: fsync d5/d5c/f7a 0 2024-02-07T12:25:33.738 INFO:tasks.workunit.client.1.smithi138.stdout:1/394: creat d5/d8/da/d1f/d27/d58/f8b x:0 0 0 2024-02-07T12:25:33.738 INFO:tasks.workunit.client.1.smithi138.stdout:1/395: creat d5/d8/da/d1f/d27/d58/f8c x:0 0 0 2024-02-07T12:25:33.739 INFO:tasks.workunit.client.1.smithi138.stdout:0/461: write d4/fd [532042,94061] 0 2024-02-07T12:25:33.741 INFO:tasks.workunit.client.1.smithi138.stdout:3/573: rename d5/d15/f16 to d5/d15/fc6 0 2024-02-07T12:25:33.743 INFO:tasks.workunit.client.1.smithi138.stdout:8/647: unlink d1/de/db4/db8/fb9 0 2024-02-07T12:25:33.744 INFO:tasks.workunit.client.1.smithi138.stdout:8/648: readlink d1/de/db4/db8/d96/la3 0 2024-02-07T12:25:33.744 INFO:tasks.workunit.client.1.smithi138.stdout:9/398: dwrite d0/d6/d8/f2a [4194304,4194304] 0 2024-02-07T12:25:33.748 INFO:tasks.workunit.client.1.smithi138.stdout:4/443: dwrite f1d [0,4194304] 0 2024-02-07T12:25:33.748 INFO:tasks.workunit.client.1.smithi138.stdout:6/432: dread dc/d13/f34 [0,4194304] 0 2024-02-07T12:25:33.748 INFO:tasks.workunit.client.1.smithi138.stdout:4/444: write d20/d53/f60 [915357,98937] 0 2024-02-07T12:25:33.748 INFO:tasks.workunit.client.1.smithi138.stdout:4/445: fsync d20/d34/d36/f5f 0 2024-02-07T12:25:33.748 INFO:tasks.workunit.client.1.smithi138.stdout:4/446: write d20/f3d [2175010,67545] 0 2024-02-07T12:25:33.756 INFO:tasks.workunit.client.1.smithi138.stdout:7/636: write d0/d8/d11/d26/d90/faf [4121160,84874] 0 2024-02-07T12:25:33.759 INFO:tasks.workunit.client.1.smithi138.stdout:0/462: rename d4/d9/de/d1d/d21/f62 to d4/d9/db/d39/f94 0 2024-02-07T12:25:33.759 INFO:tasks.workunit.client.1.smithi138.stdout:0/463: write d4/d52/f38 [2556168,12943] 0 2024-02-07T12:25:33.759 INFO:tasks.workunit.client.1.smithi138.stdout:3/574: mkdir d5/d26/d9b/dab/dc4/dc7 0 2024-02-07T12:25:33.759 INFO:tasks.workunit.client.1.smithi138.stdout:3/575: chown d5/d34/f8f 30 1 2024-02-07T12:25:33.761 INFO:tasks.workunit.client.1.smithi138.stdout:7/637: dread d0/d8/d11/d26/d90/f2c [0,4194304] 0 2024-02-07T12:25:33.761 INFO:tasks.workunit.client.1.smithi138.stdout:8/649: write d1/de/db4/db8/d96/fbd [2535067,113305] 0 2024-02-07T12:25:33.761 INFO:tasks.workunit.client.1.smithi138.stdout:8/650: fsync d1/de/db4/db8/fbc 0 2024-02-07T12:25:33.761 INFO:tasks.workunit.client.1.smithi138.stdout:8/651: write d1/de/db4/db8/d17/d8a/d8d/fb2 [5087763,105756] 0 2024-02-07T12:25:33.763 INFO:tasks.workunit.client.1.smithi138.stdout:3/576: dread d5/d26/f60 [0,4194304] 0 2024-02-07T12:25:33.766 INFO:tasks.workunit.client.1.smithi138.stdout:4/447: mkdir d20/d34/d59/d88 0 2024-02-07T12:25:33.769 INFO:tasks.workunit.client.1.smithi138.stdout:2/554: dwrite d3/dd/d19/d1f/d46/d71/faa [0,4194304] 0 2024-02-07T12:25:33.769 INFO:tasks.workunit.client.1.smithi138.stdout:0/464: link d4/d9/f11 d4/d9/de/f95 0 2024-02-07T12:25:33.771 INFO:tasks.workunit.client.1.smithi138.stdout:8/652: creat d1/de/db4/db8/d17/d3e/d89/fc5 x:0 0 0 2024-02-07T12:25:33.773 INFO:tasks.workunit.client.1.smithi138.stdout:3/577: symlink d5/d27/lc8 0 2024-02-07T12:25:33.773 INFO:tasks.workunit.client.1.smithi138.stdout:3/578: read - d5/d15/d32/f68 zero size 2024-02-07T12:25:33.775 INFO:tasks.workunit.client.1.smithi138.stdout:5/491: dwrite da/d50/f56 [0,4194304] 0 2024-02-07T12:25:33.775 INFO:tasks.workunit.client.1.smithi138.stdout:5/492: fdatasync da/d6d/d27/d2e/d4f/d2b/f36 0 2024-02-07T12:25:33.775 INFO:tasks.workunit.client.1.smithi138.stdout:4/448: mknod d20/d34/d36/d55/d74/c89 0 2024-02-07T12:25:33.776 INFO:tasks.workunit.client.1.smithi138.stdout:9/399: dwrite d0/d6/d8/d1d/dd/d41/f60 [0,4194304] 0 2024-02-07T12:25:33.776 INFO:tasks.workunit.client.1.smithi138.stdout:9/400: write d0/d6/f12 [4343718,71217] 0 2024-02-07T12:25:33.777 INFO:tasks.workunit.client.1.smithi138.stdout:9/401: chown d0/d6/d8/d1d/dd/l23 45048 1 2024-02-07T12:25:33.777 INFO:tasks.workunit.client.1.smithi138.stdout:9/402: dread - d0/d6/d8/f6d zero size 2024-02-07T12:25:33.777 INFO:tasks.workunit.client.1.smithi138.stdout:1/396: dwrite d5/d8/da/f1d [0,4194304] 0 2024-02-07T12:25:33.777 INFO:tasks.workunit.client.1.smithi138.stdout:1/397: write d5/d8/f14 [380007,75804] 0 2024-02-07T12:25:33.779 INFO:tasks.workunit.client.1.smithi138.stdout:0/465: mknod d4/d9/db/d39/d4b/c96 0 2024-02-07T12:25:33.782 INFO:tasks.workunit.client.1.smithi138.stdout:7/638: dread d0/d8/d11/d26/d90/faf [0,4194304] 0 2024-02-07T12:25:33.782 INFO:tasks.workunit.client.1.smithi138.stdout:7/639: chown d0/d6/d19/d4e/la2 5 1 2024-02-07T12:25:33.784 INFO:tasks.workunit.client.1.smithi138.stdout:3/579: rename d5/d26/f3c to d5/d26/d9d/fc9 0 2024-02-07T12:25:33.785 INFO:tasks.workunit.client.1.smithi138.stdout:3/580: chown d5/d15/c1d 4067 1 2024-02-07T12:25:33.785 INFO:tasks.workunit.client.1.smithi138.stdout:3/581: write d5/d27/d35/f50 [3247319,89346] 0 2024-02-07T12:25:33.785 INFO:tasks.workunit.client.1.smithi138.stdout:3/582: write d5/d26/d90/fa7 [143085,72933] 0 2024-02-07T12:25:33.790 INFO:tasks.workunit.client.1.smithi138.stdout:2/555: dwrite d3/dd/d19/f35 [0,4194304] 0 2024-02-07T12:25:33.790 INFO:tasks.workunit.client.1.smithi138.stdout:2/556: chown d3/dd/d14/d49/d29/d5b/f8d 0 1 2024-02-07T12:25:33.793 INFO:tasks.workunit.client.1.smithi138.stdout:4/449: unlink f13 0 2024-02-07T12:25:33.797 INFO:tasks.workunit.client.1.smithi138.stdout:1/398: creat d5/d8/da/d1f/d3c/d59/f8d x:0 0 0 2024-02-07T12:25:33.801 INFO:tasks.workunit.client.1.smithi138.stdout:0/466: dwrite d4/d9/db/d39/d4b/d6c/f80 [0,4194304] 0 2024-02-07T12:25:33.801 INFO:tasks.workunit.client.1.smithi138.stdout:8/653: dwrite d1/de/db4/db8/d17/f20 [0,4194304] 0 2024-02-07T12:25:33.806 INFO:tasks.workunit.client.1.smithi138.stdout:5/493: rename da/d6d/d27/d2e/d4f/d2b/d35/f48 to da/d6d/d27/d2e/d4f/d2b/d35/d40/f9f 0 2024-02-07T12:25:33.809 INFO:tasks.workunit.client.1.smithi138.stdout:3/583: symlink d5/d26/d9a/lca 0 2024-02-07T12:25:33.811 INFO:tasks.workunit.client.1.smithi138.stdout:2/557: creat d3/dd/d14/d8f/da5/fce x:0 0 0 2024-02-07T12:25:33.811 INFO:tasks.workunit.client.1.smithi138.stdout:2/558: chown d3/dd/d19/d1f/d37/fab 27257 1 2024-02-07T12:25:33.813 INFO:tasks.workunit.client.1.smithi138.stdout:4/450: mknod d20/d4d/d87/c8a 0 2024-02-07T12:25:33.813 INFO:tasks.workunit.client.1.smithi138.stdout:4/451: chown d20/d34/d36/d55/f7f 0 1 2024-02-07T12:25:33.821 INFO:tasks.workunit.client.1.smithi138.stdout:8/654: rmdir d1/de/db4/db8/d17/d58 39 2024-02-07T12:25:33.822 INFO:tasks.workunit.client.1.smithi138.stdout:8/655: write d1/de/db4/db8/d17/d2e/d49/f56 [1845791,76302] 0 2024-02-07T12:25:33.823 INFO:tasks.workunit.client.1.smithi138.stdout:7/640: mknod d0/d8/d11/d26/d90/cd5 0 2024-02-07T12:25:33.827 INFO:tasks.workunit.client.1.smithi138.stdout:5/494: mknod da/d6d/d27/d2e/d4f/d2b/d59/d96/ca0 0 2024-02-07T12:25:33.828 INFO:tasks.workunit.client.1.smithi138.stdout:5/495: write da/d43/d4a/f9d [624352,15683] 0 2024-02-07T12:25:33.829 INFO:tasks.workunit.client.1.smithi138.stdout:5/496: dread da/d6d/d27/d2e/f2f [0,4194304] 0 2024-02-07T12:25:33.831 INFO:tasks.workunit.client.1.smithi138.stdout:2/559: link d3/dd/d14/d49/c65 d3/dd/d14/d82/ccf 0 2024-02-07T12:25:33.833 INFO:tasks.workunit.client.1.smithi138.stdout:1/399: rmdir d5/d8/da/d1f/d27/d58 39 2024-02-07T12:25:33.834 INFO:tasks.workunit.client.1.smithi138.stdout:4/452: dwrite d20/d47/d69/d76/f7a [0,4194304] 0 2024-02-07T12:25:33.836 INFO:tasks.workunit.client.1.smithi138.stdout:9/403: rename d0/d6/d8/c16 to d0/d6/c7a 0 2024-02-07T12:25:33.836 INFO:tasks.workunit.client.1.smithi138.stdout:9/404: stat d0/d34 0 2024-02-07T12:25:33.836 INFO:tasks.workunit.client.1.smithi138.stdout:9/405: chown d0/d6/d8/d1d/dd/d1f/l21 22907 1 2024-02-07T12:25:33.836 INFO:tasks.workunit.client.1.smithi138.stdout:9/406: write d0/d6/f3c [4903220,35967] 0 2024-02-07T12:25:33.840 INFO:tasks.workunit.client.1.smithi138.stdout:3/584: getdents d5/d26/d28 0 2024-02-07T12:25:33.848 INFO:tasks.workunit.client.1.smithi138.stdout:0/467: rename d4/d9/db/d39/f57 to d4/d9/db/d39/d4b/d6c/d8f/f97 0 2024-02-07T12:25:33.848 INFO:tasks.workunit.client.1.smithi138.stdout:0/468: readlink d4/d52/l1a 0 2024-02-07T12:25:33.850 INFO:tasks.workunit.client.1.smithi138.stdout:3/585: symlink d5/d26/d9b/dab/dc4/dc7/lcb 0 2024-02-07T12:25:33.853 INFO:tasks.workunit.client.1.smithi138.stdout:9/407: rename d0/f2c to d0/d6/d8/d1d/dd/d41/d5e/d74/f7b 0 2024-02-07T12:25:33.855 INFO:tasks.workunit.client.1.smithi138.stdout:3/586: mknod d5/d15/ccc 0 2024-02-07T12:25:33.855 INFO:tasks.workunit.client.1.smithi138.stdout:3/587: creat d5/d27/d35/dac/fcd x:0 0 0 2024-02-07T12:25:33.855 INFO:tasks.workunit.client.1.smithi138.stdout:3/588: fdatasync d5/d15/f6d 0 2024-02-07T12:25:33.856 INFO:tasks.workunit.client.1.smithi138.stdout:5/497: dwrite da/d6d/d27/d2e/d4f/d2b/d35/d40/f45 [0,4194304] 0 2024-02-07T12:25:33.858 INFO:tasks.workunit.client.1.smithi138.stdout:9/408: rename d0/d6/d8/d1d/dd/c3b to d0/d6/c7c 0 2024-02-07T12:25:33.860 INFO:tasks.workunit.client.1.smithi138.stdout:3/589: mknod d5/d26/d5e/d77/cce 0 2024-02-07T12:25:33.866 INFO:tasks.workunit.client.1.smithi138.stdout:4/453: dwrite d20/d34/d36/f44 [0,4194304] 0 2024-02-07T12:25:33.867 INFO:tasks.workunit.client.1.smithi138.stdout:2/560: dwrite d3/dd/d14/d49/d25/fcd [0,4194304] 0 2024-02-07T12:25:33.867 INFO:tasks.workunit.client.1.smithi138.stdout:3/590: rename d5/d26/d5e/d77/cbf to d5/d26/d5e/d86/ccf 0 2024-02-07T12:25:33.870 INFO:tasks.workunit.client.1.smithi138.stdout:4/454: mkdir d20/d34/d59/d72/d8b 0 2024-02-07T12:25:33.871 INFO:tasks.workunit.client.1.smithi138.stdout:1/400: dwrite d5/d4b/f5d [0,4194304] 0 2024-02-07T12:25:33.873 INFO:tasks.workunit.client.1.smithi138.stdout:2/561: creat d3/dd/fd0 x:0 0 0 2024-02-07T12:25:33.876 INFO:tasks.workunit.client.1.smithi138.stdout:0/469: dwrite d4/d9/db/d39/d4b/d6c/f80 [0,4194304] 0 2024-02-07T12:25:33.876 INFO:tasks.workunit.client.1.smithi138.stdout:0/470: write d4/d9/f4a [4285293,12593] 0 2024-02-07T12:25:33.876 INFO:tasks.workunit.client.1.smithi138.stdout:0/471: chown d4/d9/d37/d3d/f78 4 1 2024-02-07T12:25:33.876 INFO:tasks.workunit.client.1.smithi138.stdout:0/472: write d4/d9/db/d39/d4b/d6c/f80 [5861198,6480] 0 2024-02-07T12:25:33.877 INFO:tasks.workunit.client.1.smithi138.stdout:4/455: rename d20/d34/d36/f44 to d20/d34/d59/d72/d8b/f8c 0 2024-02-07T12:25:33.878 INFO:tasks.workunit.client.1.smithi138.stdout:3/591: write d5/d26/f2c [1321942,27148] 0 2024-02-07T12:25:33.881 INFO:tasks.workunit.client.1.smithi138.stdout:1/401: unlink d5/d8/da/c40 0 2024-02-07T12:25:33.881 INFO:tasks.workunit.client.1.smithi138.stdout:1/402: getdents d5/d43 0 2024-02-07T12:25:33.882 INFO:tasks.workunit.client.1.smithi138.stdout:5/498: dwrite da/f29 [4194304,4194304] 0 2024-02-07T12:25:33.882 INFO:tasks.workunit.client.1.smithi138.stdout:5/499: fsync da/d43/d4a/f84 0 2024-02-07T12:25:33.883 INFO:tasks.workunit.client.1.smithi138.stdout:0/473: getdents d4/d9/d33 0 2024-02-07T12:25:33.885 INFO:tasks.workunit.client.1.smithi138.stdout:4/456: mkdir d20/d34/d59/d88/d8d 0 2024-02-07T12:25:33.885 INFO:tasks.workunit.client.1.smithi138.stdout:4/457: readlink d20/l2b 0 2024-02-07T12:25:33.887 INFO:tasks.workunit.client.1.smithi138.stdout:3/592: mkdir d5/d26/d9b/dab/dc4/dd0 0 2024-02-07T12:25:33.889 INFO:tasks.workunit.client.1.smithi138.stdout:1/403: creat d5/d4b/d6b/f8e x:0 0 0 2024-02-07T12:25:33.894 INFO:tasks.workunit.client.1.smithi138.stdout:0/474: symlink d4/d9/l98 0 2024-02-07T12:25:33.896 INFO:tasks.workunit.client.1.smithi138.stdout:4/458: mkdir d20/d34/d59/d88/d8e 0 2024-02-07T12:25:33.900 INFO:tasks.workunit.client.1.smithi138.stdout:1/404: write d5/d8/da/d20/f88 [1080508,40441] 0 2024-02-07T12:25:33.900 INFO:tasks.workunit.client.1.smithi138.stdout:9/409: dwrite d0/d6/d8/d1d/f1c [0,4194304] 0 2024-02-07T12:25:33.902 INFO:tasks.workunit.client.1.smithi138.stdout:3/593: write d5/d15/f48 [3180280,98543] 0 2024-02-07T12:25:33.906 INFO:tasks.workunit.client.1.smithi138.stdout:5/500: rmdir da/d22 39 2024-02-07T12:25:33.909 INFO:tasks.workunit.client.1.smithi138.stdout:4/459: creat d20/d34/d36/f8f x:0 0 0 2024-02-07T12:25:33.909 INFO:tasks.workunit.client.1.smithi138.stdout:4/460: chown d20/d4d/d87 517829 1 2024-02-07T12:25:33.909 INFO:tasks.workunit.client.1.smithi138.stdout:9/410: write d0/d6/f3c [3375039,66725] 0 2024-02-07T12:25:33.911 INFO:tasks.workunit.client.1.smithi138.stdout:0/475: dwrite d4/d9/de/d1d/d77/f88 [0,4194304] 0 2024-02-07T12:25:33.912 INFO:tasks.workunit.client.1.smithi138.stdout:2/562: dwrite d3/dd/d19/f72 [0,4194304] 0 2024-02-07T12:25:33.913 INFO:tasks.workunit.client.1.smithi138.stdout:1/405: creat d5/d8/da/d1f/d27/f8f x:0 0 0 2024-02-07T12:25:33.915 INFO:tasks.workunit.client.1.smithi138.stdout:3/594: truncate d5/d26/d9d/fc9 49829 0 2024-02-07T12:25:33.917 INFO:tasks.workunit.client.1.smithi138.stdout:5/501: symlink da/d43/la1 0 2024-02-07T12:25:33.921 INFO:tasks.workunit.client.1.smithi138.stdout:4/461: unlink f16 0 2024-02-07T12:25:33.922 INFO:tasks.workunit.client.1.smithi138.stdout:1/406: dread d5/f9 [0,4194304] 0 2024-02-07T12:25:33.922 INFO:tasks.workunit.client.1.smithi138.stdout:1/407: dread - d5/f86 zero size 2024-02-07T12:25:33.927 INFO:tasks.workunit.client.1.smithi138.stdout:0/476: creat d4/d52/d74/f99 x:0 0 0 2024-02-07T12:25:33.931 INFO:tasks.workunit.client.1.smithi138.stdout:2/563: mknod d3/dd/d19/d1f/d46/d71/d7e/cd1 0 2024-02-07T12:25:33.933 INFO:tasks.workunit.client.1.smithi138.stdout:3/595: getdents d5/d15 0 2024-02-07T12:25:33.934 INFO:tasks.workunit.client.1.smithi138.stdout:5/502: unlink da/d43/d4a/d69/l76 0 2024-02-07T12:25:33.936 INFO:tasks.workunit.client.1.smithi138.stdout:4/462: rename d20/d34/d36/f3a to d20/d4d/f90 0 2024-02-07T12:25:33.936 INFO:tasks.workunit.client.1.smithi138.stdout:4/463: fsync d20/d34/d36/f5f 0 2024-02-07T12:25:33.937 INFO:tasks.workunit.client.1.smithi138.stdout:4/464: chown d20/f2f 3188797 1 2024-02-07T12:25:33.937 INFO:tasks.workunit.client.1.smithi138.stdout:1/408: creat d5/d8/da/d20/f90 x:0 0 0 2024-02-07T12:25:33.941 INFO:tasks.workunit.client.1.smithi138.stdout:0/477: mkdir d4/d9/d37/d64/d9a 0 2024-02-07T12:25:33.941 INFO:tasks.workunit.client.1.smithi138.stdout:0/478: write d4/d9/d37/d6b/d7f/f82 [162085,56795] 0 2024-02-07T12:25:33.942 INFO:tasks.workunit.client.1.smithi138.stdout:2/564: mkdir d3/dd/dd2 0 2024-02-07T12:25:33.949 INFO:tasks.workunit.client.1.smithi138.stdout:4/465: rename d20/f40 to d20/d34/d59/d88/f91 0 2024-02-07T12:25:33.951 INFO:tasks.workunit.client.1.smithi138.stdout:1/409: mkdir d5/d4b/d91 0 2024-02-07T12:25:33.954 INFO:tasks.workunit.client.1.smithi138.stdout:0/479: link d4/d9/f3e d4/d9/d37/d64/f9b 0 2024-02-07T12:25:33.955 INFO:tasks.workunit.client.1.smithi138.stdout:5/503: dwrite da/d6d/d27/f7b [0,4194304] 0 2024-02-07T12:25:33.955 INFO:tasks.workunit.client.1.smithi138.stdout:5/504: dread - da/d6d/f7c zero size 2024-02-07T12:25:33.956 INFO:tasks.workunit.client.1.smithi138.stdout:2/565: creat d3/dd/d14/d49/d25/d3d/fd3 x:0 0 0 2024-02-07T12:25:33.956 INFO:tasks.workunit.client.1.smithi138.stdout:2/566: chown d3/dd/d19/fc4 5832871 1 2024-02-07T12:25:33.961 INFO:tasks.workunit.client.1.smithi138.stdout:3/596: dwrite d5/d26/f5f [0,4194304] 0 2024-02-07T12:25:33.961 INFO:tasks.workunit.client.1.smithi138.stdout:3/597: fdatasync d5/d34/f8f 0 2024-02-07T12:25:33.961 INFO:tasks.workunit.client.1.smithi138.stdout:4/466: unlink d20/d34/d36/f65 0 2024-02-07T12:25:33.961 INFO:tasks.workunit.client.1.smithi138.stdout:4/467: truncate d20/d34/f4c 248045 0 2024-02-07T12:25:33.963 INFO:tasks.workunit.client.1.smithi138.stdout:0/480: mkdir d4/d9/d37/d3d/d9c 0 2024-02-07T12:25:33.963 INFO:tasks.workunit.client.1.smithi138.stdout:0/481: write d4/d9/d37/d64/f9b [1496968,54395] 0 2024-02-07T12:25:33.966 INFO:tasks.workunit.client.1.smithi138.stdout:5/505: truncate da/d43/d4a/d69/f7a 3003514 0 2024-02-07T12:25:33.967 INFO:tasks.workunit.client.1.smithi138.stdout:2/567: mknod d3/dd/cd4 0 2024-02-07T12:25:33.969 INFO:tasks.workunit.client.1.smithi138.stdout:3/598: mkdir d5/d26/d9b/dab/dc4/dd0/dd1 0 2024-02-07T12:25:33.969 INFO:tasks.workunit.client.1.smithi138.stdout:3/599: write d5/d26/f2c [110665,77086] 0 2024-02-07T12:25:33.969 INFO:tasks.workunit.client.1.smithi138.stdout:3/600: creat d5/d34/fd2 x:0 0 0 2024-02-07T12:25:33.969 INFO:tasks.workunit.client.1.smithi138.stdout:3/601: dread - d5/d26/d90/fba zero size 2024-02-07T12:25:33.969 INFO:tasks.workunit.client.1.smithi138.stdout:3/602: write d5/d26/d5e/d86/dc0/fc3 [791101,63900] 0 2024-02-07T12:25:33.969 INFO:tasks.workunit.client.1.smithi138.stdout:2/568: dread d3/d4e/f88 [0,4194304] 0 2024-02-07T12:25:33.969 INFO:tasks.workunit.client.1.smithi138.stdout:2/569: read - d3/dd/d19/d44/d7d/fb5 zero size 2024-02-07T12:25:33.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.967+0000 7f8ae630f700 1 -- 172.21.15.47:0/3233256280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8ae0109690 con 0x7f8ae0066c70 2024-02-07T12:25:33.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.968+0000 7f8adcff9700 1 -- 172.21.15.47:0/3233256280 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f8ad004a300 con 0x7f8ae0066c70 2024-02-07T12:25:33.970 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 1 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 6 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 12, 2024-02-07T12:25:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 1 2024-02-07T12:25:33.972 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:25:33.972 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:25:33.972 INFO:tasks.workunit.client.1.smithi138.stdout:4/468: rename d20/f30 to d20/d34/d59/d72/d86/f92 0 2024-02-07T12:25:33.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.971+0000 7f8ae630f700 1 -- 172.21.15.47:0/3233256280 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f8ac8038650 msgr2=0x7f8ac803ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:33.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.971+0000 7f8ae630f700 1 --2- 172.21.15.47:0/3233256280 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f8ac8038650 0x7f8ac803ab00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4004600 tx=0x7f8ad400b040 comp rx=0 tx=0).stop 2024-02-07T12:25:33.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.971+0000 7f8ae630f700 1 -- 172.21.15.47:0/3233256280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0066c70 msgr2=0x7f8ae010fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:33.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.971+0000 7f8ae630f700 1 --2- 172.21.15.47:0/3233256280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0066c70 0x7f8ae010fad0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0000c00 tx=0x7f8ad0009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:33.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.971+0000 7f8ae630f700 1 -- 172.21.15.47:0/3233256280 shutdown_connections 2024-02-07T12:25:33.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.971+0000 7f8ae630f700 1 --2- 172.21.15.47:0/3233256280 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f8ac8038650 0x7f8ac803ab00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:33.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.971+0000 7f8ae630f700 1 --2- 172.21.15.47:0/3233256280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0066c70 0x7f8ae010fad0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:33.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.971+0000 7f8ae630f700 1 --2- 172.21.15.47:0/3233256280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ae0102430 0x7f8ae0110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:33.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.971+0000 7f8ae630f700 1 -- 172.21.15.47:0/3233256280 >> 172.21.15.47:0/3233256280 conn(0x7f8ae00f7500 msgr2=0x7f8ae00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:33.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.971+0000 7f8ae630f700 1 -- 172.21.15.47:0/3233256280 shutdown_connections 2024-02-07T12:25:33.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:33.971+0000 7f8ae630f700 1 -- 172.21.15.47:0/3233256280 wait complete. 2024-02-07T12:25:33.976 INFO:tasks.workunit.client.1.smithi138.stdout:0/482: mkdir d4/d9/d37/d64/d9d 0 2024-02-07T12:25:33.980 INFO:tasks.workunit.client.1.smithi138.stdout:5/506: mkdir da/d43/d4a/da2 0 2024-02-07T12:25:33.980 INFO:tasks.workunit.client.1.smithi138.stdout:5/507: chown da/d6d/d27/d2e/d4f/c3a 995907 1 2024-02-07T12:25:33.984 INFO:tasks.workunit.client.1.smithi138.stdout:3/603: mknod d5/d26/d9d/cd3 0 2024-02-07T12:25:33.985 INFO:tasks.workunit.client.1.smithi138.stdout:2/570: rmdir d3/dd/d19/d1f 39 2024-02-07T12:25:33.988 INFO:tasks.workunit.client.1.smithi138.stdout:4/469: truncate d20/f32 3219751 0 2024-02-07T12:25:33.988 INFO:tasks.workunit.client.1.smithi138.stdout:1/410: rmdir d5/d8/da/d1f/d5e/d63 39 2024-02-07T12:25:33.990 INFO:tasks.workunit.client.1.smithi138.stdout:0/483: symlink d4/d69/l9e 0 2024-02-07T12:25:33.997 INFO:tasks.workunit.client.1.smithi138.stdout:3/604: unlink d5/d15/l31 0 2024-02-07T12:25:33.997 INFO:tasks.workunit.client.1.smithi138.stdout:3/605: truncate d5/d26/d28/f83 458251 0 2024-02-07T12:25:33.997 INFO:tasks.workunit.client.1.smithi138.stdout:3/606: creat d5/d26/d5e/d86/dae/fd4 x:0 0 0 2024-02-07T12:25:33.997 INFO:tasks.workunit.client.1.smithi138.stdout:3/607: chown d5/d15/l30 918 1 2024-02-07T12:25:33.997 INFO:tasks.workunit.client.1.smithi138.stdout:3/608: creat d5/d27/d35/dac/fd5 x:0 0 0 2024-02-07T12:25:33.997 INFO:tasks.workunit.client.1.smithi138.stdout:3/609: creat d5/d26/d5e/d77/fd6 x:0 0 0 2024-02-07T12:25:33.997 INFO:tasks.workunit.client.1.smithi138.stdout:2/571: mknod d3/dd/d14/d8f/d73/cd5 0 2024-02-07T12:25:33.999 INFO:tasks.workunit.client.1.smithi138.stdout:4/470: rename d20/d34/d36/f48 to d20/d47/f93 0 2024-02-07T12:25:34.000 INFO:tasks.workunit.client.1.smithi138.stdout:6/433: sync 2024-02-07T12:25:34.000 INFO:tasks.workunit.client.1.smithi138.stdout:1/411: creat d5/d8/da/d1f/d5e/d63/f92 x:0 0 0 2024-02-07T12:25:34.002 INFO:tasks.workunit.client.1.smithi138.stdout:0/484: creat d4/d69/d85/d8a/f9f x:0 0 0 2024-02-07T12:25:34.008 INFO:tasks.workunit.client.1.smithi138.stdout:3/610: symlink d5/d26/d5e/d86/d9c/ld7 0 2024-02-07T12:25:34.010 INFO:tasks.workunit.client.1.smithi138.stdout:2/572: symlink d3/dd/d19/d44/d7d/ld6 0 2024-02-07T12:25:34.010 INFO:tasks.workunit.client.1.smithi138.stdout:2/573: chown d3/dd/d19/d44/f69 18404 1 2024-02-07T12:25:34.011 INFO:tasks.workunit.client.1.smithi138.stdout:2/574: write d3/dd/d19/f42 [984350,85992] 0 2024-02-07T12:25:34.011 INFO:tasks.workunit.client.1.smithi138.stdout:2/575: stat d3/dd/d14/d82/dcc 0 2024-02-07T12:25:34.011 INFO:tasks.workunit.client.1.smithi138.stdout:2/576: stat d3/dd/d19/d44/d7d/d97/ccb 0 2024-02-07T12:25:34.011 INFO:tasks.workunit.client.1.smithi138.stdout:2/577: chown d3 1048 1 2024-02-07T12:25:34.011 INFO:tasks.workunit.client.1.smithi138.stdout:2/578: chown d3/dd/d14/d86/faf 4595480 1 2024-02-07T12:25:34.014 INFO:tasks.workunit.client.1.smithi138.stdout:4/471: rename d20/d34/d59/d72/d8b to d20/d53/d71/d75/d94 0 2024-02-07T12:25:34.017 INFO:tasks.workunit.client.1.smithi138.stdout:6/434: mknod dc/d31/c8b 0 2024-02-07T12:25:34.018 INFO:tasks.workunit.client.1.smithi138.stdout:6/435: chown dc/d13/d1e/d4d 273 1 2024-02-07T12:25:34.018 INFO:tasks.workunit.client.1.smithi138.stdout:6/436: truncate dc/d13/d1e/d35/d85/f89 843780 0 2024-02-07T12:25:34.019 INFO:tasks.workunit.client.1.smithi138.stdout:1/412: mknod d5/d8/da/d1f/c93 0 2024-02-07T12:25:34.021 INFO:tasks.workunit.client.1.smithi138.stdout:0/485: creat d4/d52/fa0 x:0 0 0 2024-02-07T12:25:34.023 INFO:tasks.workunit.client.1.smithi138.stdout:1/413: write f3 [2681772,18071] 0 2024-02-07T12:25:34.023 INFO:tasks.workunit.client.1.smithi138.stdout:5/508: unlink da/d6d/d27/d2e/d4f/d2b/f36 0 2024-02-07T12:25:34.023 INFO:tasks.workunit.client.1.smithi138.stdout:5/509: write da/d43/d4a/d69/f6f [477615,12105] 0 2024-02-07T12:25:34.025 INFO:tasks.workunit.client.1.smithi138.stdout:2/579: creat d3/dd/d14/d8f/dbc/dbd/fd7 x:0 0 0 2024-02-07T12:25:34.025 INFO:tasks.workunit.client.1.smithi138.stdout:2/580: chown d3/cc5 2327676 1 2024-02-07T12:25:34.025 INFO:tasks.workunit.client.1.smithi138.stdout:2/581: fsync d3/dd/d19/fc4 0 2024-02-07T12:25:34.025 INFO:tasks.workunit.client.1.smithi138.stdout:3/611: dwrite d5/f75 [0,4194304] 0 2024-02-07T12:25:34.027 INFO:tasks.workunit.client.1.smithi138.stdout:6/437: unlink dc/d13/d1e/d4d/c65 0 2024-02-07T12:25:34.027 INFO:tasks.workunit.client.1.smithi138.stdout:6/438: write dc/f77 [908075,57997] 0 2024-02-07T12:25:34.027 INFO:tasks.workunit.client.1.smithi138.stdout:6/439: write dc/f1f [1812078,62863] 0 2024-02-07T12:25:34.031 INFO:tasks.workunit.client.1.smithi138.stdout:1/414: symlink d5/d43/l94 0 2024-02-07T12:25:34.034 INFO:tasks.workunit.client.1.smithi138.stdout:8/656: sync 2024-02-07T12:25:34.036 INFO:tasks.workunit.client.1.smithi138.stdout:5/510: mkdir da/d6d/d27/d2e/d4f/da3 0 2024-02-07T12:25:34.038 INFO:tasks.workunit.client.1.smithi138.stdout:3/612: dread d5/d27/f3d [0,4194304] 0 2024-02-07T12:25:34.038 INFO:tasks.workunit.client.1.smithi138.stdout:3/613: readlink d5/d26/d5e/d86/d9c/lb0 0 2024-02-07T12:25:34.039 INFO:tasks.workunit.client.1.smithi138.stdout:3/614: fsync d5/d27/f88 0 2024-02-07T12:25:34.039 INFO:tasks.workunit.client.1.smithi138.stdout:2/582: rename d3/dd/d14/d49/d29/c9d to d3/dd/d14/d8f/dbc/cd8 0 2024-02-07T12:25:34.039 INFO:tasks.workunit.client.1.smithi138.stdout:2/583: write d3/dd/d19/d1f/d37/f75 [756586,24392] 0 2024-02-07T12:25:34.047 INFO:tasks.workunit.client.1.smithi138.stdout:4/472: dwrite f3 [0,4194304] 0 2024-02-07T12:25:34.047 INFO:tasks.workunit.client.1.smithi138.stdout:4/473: creat d20/d34/d59/f95 x:0 0 0 2024-02-07T12:25:34.047 INFO:tasks.workunit.client.1.smithi138.stdout:8/657: symlink d1/d99/lc6 0 2024-02-07T12:25:34.048 INFO:tasks.workunit.client.1.smithi138.stdout:5/511: symlink da/d43/d4a/da2/la4 0 2024-02-07T12:25:34.048 INFO:tasks.workunit.client.1.smithi138.stdout:3/615: mknod d5/d26/d5e/d86/dae/cd8 0 2024-02-07T12:25:34.050 INFO:tasks.workunit.client.1.smithi138.stdout:6/440: rename dc/d13/f34 to dc/d13/d1e/f8c 0 2024-02-07T12:25:34.050 INFO:tasks.workunit.client.1.smithi138.stdout:2/584: write d3/dd/d19/d1f/d46/d71/faa [2920839,6531] 0 2024-02-07T12:25:34.050 INFO:tasks.workunit.client.1.smithi138.stdout:6/441: write dc/d31/d38/f53 [530774,128637] 0 2024-02-07T12:25:34.053 INFO:tasks.workunit.client.1.smithi138.stdout:4/474: creat d20/d34/d36/d55/f96 x:0 0 0 2024-02-07T12:25:34.053 INFO:tasks.workunit.client.1.smithi138.stdout:4/475: write d20/f3f [1875247,129967] 0 2024-02-07T12:25:34.053 INFO:tasks.workunit.client.1.smithi138.stdout:4/476: readlink d20/d34/l3b 0 2024-02-07T12:25:34.053 INFO:tasks.workunit.client.1.smithi138.stdout:8/658: symlink d1/de/db4/db8/d17/d8a/lc7 0 2024-02-07T12:25:34.057 INFO:tasks.workunit.client.1.smithi138.stdout:5/512: rename da/d6d/d27/f28 to da/d6d/d27/d2e/d4f/d2b/d35/d5d/fa5 0 2024-02-07T12:25:34.058 INFO:tasks.workunit.client.1.smithi138.stdout:3/616: read d5/d26/d4e/f84 [1467645,83530] 0 2024-02-07T12:25:34.058 INFO:tasks.workunit.client.1.smithi138.stdout:1/415: dwrite d5/d8/da/d1f/d27/d58/f8b [0,4194304] 0 2024-02-07T12:25:34.060 INFO:tasks.workunit.client.1.smithi138.stdout:6/442: symlink dc/d31/l8d 0 2024-02-07T12:25:34.062 INFO:tasks.workunit.client.1.smithi138.stdout:0/486: getdents d4/d52 0 2024-02-07T12:25:34.062 INFO:tasks.workunit.client.1.smithi138.stdout:0/487: dread - d4/d69/f87 zero size 2024-02-07T12:25:34.062 INFO:tasks.workunit.client.1.smithi138.stdout:8/659: dread d1/de/db4/db8/d17/f24 [0,4194304] 0 2024-02-07T12:25:34.063 INFO:tasks.workunit.client.1.smithi138.stdout:9/411: sync 2024-02-07T12:25:34.063 INFO:tasks.workunit.client.1.smithi138.stdout:7/641: sync 2024-02-07T12:25:34.063 INFO:tasks.workunit.client.1.smithi138.stdout:7/642: creat d0/fd6 x:0 0 0 2024-02-07T12:25:34.063 INFO:tasks.workunit.client.1.smithi138.stdout:7/643: read d0/d8/d11/d26/d90/f2c [764389,130052] 0 2024-02-07T12:25:34.063 INFO:tasks.workunit.client.1.smithi138.stdout:7/644: write d0/d39/fa4 [1403964,81815] 0 2024-02-07T12:25:34.064 INFO:tasks.workunit.client.1.smithi138.stdout:4/477: creat d20/d34/d59/d72/d77/f97 x:0 0 0 2024-02-07T12:25:34.064 INFO:tasks.workunit.client.1.smithi138.stdout:4/478: write d20/d34/d36/f41 [637515,100850] 0 2024-02-07T12:25:34.065 INFO:tasks.workunit.client.1.smithi138.stdout:1/416: dread d5/d8/da/d1f/d3c/d59/f55 [0,4194304] 0 2024-02-07T12:25:34.066 INFO:tasks.workunit.client.1.smithi138.stdout:5/513: link da/f29 da/d43/d4a/d69/fa6 0 2024-02-07T12:25:34.070 INFO:tasks.workunit.client.1.smithi138.stdout:7/645: dread d0/d39/fa4 [0,4194304] 0 2024-02-07T12:25:34.070 INFO:tasks.workunit.client.1.smithi138.stdout:3/617: creat d5/d15/d32/da1/fd9 x:0 0 0 2024-02-07T12:25:34.070 INFO:tasks.workunit.client.1.smithi138.stdout:3/618: getdents d5/d26/d5e/d86/dae/dc1 0 2024-02-07T12:25:34.074 INFO:tasks.workunit.client.1.smithi138.stdout:2/585: rmdir d3/dd/d19/d44 39 2024-02-07T12:25:34.074 INFO:tasks.workunit.client.1.smithi138.stdout:2/586: chown d3/dd/d14/d49/d25/l1e 28 1 2024-02-07T12:25:34.074 INFO:tasks.workunit.client.1.smithi138.stdout:2/587: write d3/dd/d14/d49/d25/d3d/f55 [205523,110096] 0 2024-02-07T12:25:34.075 INFO:tasks.workunit.client.1.smithi138.stdout:6/443: mkdir dc/d13/d8e 0 2024-02-07T12:25:34.077 INFO:tasks.workunit.client.1.smithi138.stdout:0/488: rename d4/d9/l27 to d4/d9/de/d1d/d77/la1 0 2024-02-07T12:25:34.078 INFO:tasks.workunit.client.1.smithi138.stdout:8/660: truncate d1/de/db4/db8/d17/d2e/d3a/f83 2404355 0 2024-02-07T12:25:34.079 INFO:tasks.workunit.client.1.smithi138.stdout:9/412: truncate d0/d34/d45/f43 2237558 0 2024-02-07T12:25:34.082 INFO:tasks.workunit.client.1.smithi138.stdout:4/479: mkdir d20/d53/d71/d98 0 2024-02-07T12:25:34.082 INFO:tasks.workunit.client.1.smithi138.stdout:4/480: stat d20/d47/c66 0 2024-02-07T12:25:34.082 INFO:tasks.workunit.client.1.smithi138.stdout:4/481: fsync d20/f2e 0 2024-02-07T12:25:34.083 INFO:tasks.workunit.client.1.smithi138.stdout:5/514: chown da/d22/d99 7 1 2024-02-07T12:25:34.083 INFO:tasks.workunit.client.1.smithi138.stdout:5/515: fsync da/d6d/d27/d2e/d4f/f30 0 2024-02-07T12:25:34.083 INFO:tasks.workunit.client.1.smithi138.stdout:1/417: dwrite d5/d8/da/d1f/f25 [0,4194304] 0 2024-02-07T12:25:34.085 INFO:tasks.workunit.client.1.smithi138.stdout:7/646: mkdir d0/d8/d11/d63/dc8/dce/dd7 0 2024-02-07T12:25:34.086 INFO:tasks.workunit.client.1.smithi138.stdout:3/619: truncate d5/d26/d28/f52 2179452 0 2024-02-07T12:25:34.087 INFO:tasks.workunit.client.1.smithi138.stdout:2/588: link d3/dd/d19/d1f/d46/d71/l9f d3/dd/d14/d49/d29/ld9 0 2024-02-07T12:25:34.089 INFO:tasks.workunit.client.1.smithi138.stdout:6/444: creat dc/d31/d54/f8f x:0 0 0 2024-02-07T12:25:34.089 INFO:tasks.workunit.client.1.smithi138.stdout:6/445: chown dc/d13/d1e/d4d/f5d 46153 1 2024-02-07T12:25:34.090 INFO:tasks.workunit.client.1.smithi138.stdout:6/446: dread dc/d13/d1e/d35/d85/f89 [0,4194304] 0 2024-02-07T12:25:34.091 INFO:tasks.workunit.client.1.smithi138.stdout:0/489: rename d4/d9/d37/d3d/f78 to d4/d9/db/d39/fa2 0 2024-02-07T12:25:34.094 INFO:tasks.workunit.client.1.smithi138.stdout:2/589: dread f0 [0,4194304] 0 2024-02-07T12:25:34.095 INFO:tasks.workunit.client.1.smithi138.stdout:9/413: rmdir d0/d6/d8/d1d/dd/d41/d5e/d74 39 2024-02-07T12:25:34.097 INFO:tasks.workunit.client.1.smithi138.stdout:4/482: getdents d20/d4d/d87 0 2024-02-07T12:25:34.097 INFO:tasks.workunit.client.1.smithi138.stdout:4/483: creat d20/d4d/f99 x:0 0 0 2024-02-07T12:25:34.097 INFO:tasks.workunit.client.1.smithi138.stdout:5/516: mknod da/d6d/d27/d2e/d4f/d2b/d59/d91/ca7 0 2024-02-07T12:25:34.099 INFO:tasks.workunit.client.1.smithi138.stdout:1/418: mknod d5/d5c/c95 0 2024-02-07T12:25:34.102 INFO:tasks.workunit.client.1.smithi138.stdout:7/647: truncate d0/d6/d76/d93/f57 140572 0 2024-02-07T12:25:34.104 INFO:tasks.workunit.client.1.smithi138.stdout:6/447: mknod dc/d13/d1e/d35/d6d/c90 0 2024-02-07T12:25:34.106 INFO:tasks.workunit.client.1.smithi138.stdout:3/620: dwrite d5/d26/d5e/d77/fd6 [0,4194304] 0 2024-02-07T12:25:34.106 INFO:tasks.workunit.client.1.smithi138.stdout:0/490: write d4/d9/de/d1d/f49 [951120,21689] 0 2024-02-07T12:25:34.106 INFO:tasks.workunit.client.1.smithi138.stdout:3/621: readlink d5/d26/d9b/dab/dc4/dc7/lcb 0 2024-02-07T12:25:34.108 INFO:tasks.workunit.client.1.smithi138.stdout:2/590: symlink d3/dd/d14/d49/d25/lda 0 2024-02-07T12:25:34.111 INFO:tasks.workunit.client.1.smithi138.stdout:9/414: rename d0/d6/l5a to d0/d6/l7d 0 2024-02-07T12:25:34.115 INFO:tasks.workunit.client.1.smithi138.stdout:4/484: getdents d20/d34/d59/d72 0 2024-02-07T12:25:34.115 INFO:tasks.workunit.client.1.smithi138.stdout:4/485: fdatasync d20/f24 0 2024-02-07T12:25:34.115 INFO:tasks.workunit.client.1.smithi138.stdout:4/486: truncate d20/d34/d36/d55/f6d 760834 0 2024-02-07T12:25:34.117 INFO:tasks.workunit.client.1.smithi138.stdout:5/517: mknod da/d22/ca8 0 2024-02-07T12:25:34.117 INFO:tasks.workunit.client.1.smithi138.stdout:5/518: creat da/d6d/d27/d2e/d4f/fa9 x:0 0 0 2024-02-07T12:25:34.119 INFO:tasks.workunit.client.1.smithi138.stdout:6/448: creat dc/d13/d1e/f91 x:0 0 0 2024-02-07T12:25:34.120 INFO:tasks.workunit.client.1.smithi138.stdout:6/449: dread dc/d13/d1e/f5f [0,4194304] 0 2024-02-07T12:25:34.122 INFO:tasks.workunit.client.1.smithi138.stdout:6/450: dread dc/d13/d1e/f30 [0,4194304] 0 2024-02-07T12:25:34.122 INFO:tasks.workunit.client.1.smithi138.stdout:6/451: chown dc/d31/d3f 98538535 1 2024-02-07T12:25:34.126 INFO:tasks.workunit.client.1.smithi138.stdout:3/622: mknod d5/d26/d9b/dab/dc4/dc7/cda 0 2024-02-07T12:25:34.126 INFO:tasks.workunit.client.1.smithi138.stdout:3/623: chown d5/d26/d28/f9e 6 1 2024-02-07T12:25:34.126 INFO:tasks.workunit.client.1.smithi138.stdout:3/624: fdatasync d5/d26/d9d/fc9 0 2024-02-07T12:25:34.129 INFO:tasks.workunit.client.1.smithi138.stdout:8/661: rename d1/de/db4/db8/d17/f2d to d1/de/db4/db8/d17/d2e/d3a/d50/fc8 0 2024-02-07T12:25:34.129 INFO:tasks.workunit.client.1.smithi138.stdout:8/662: chown d1/de/db4/db8/d17/d2e/d3a/la2 10297694 1 2024-02-07T12:25:34.129 INFO:tasks.workunit.client.1.smithi138.stdout:2/591: creat d3/d4e/fdb x:0 0 0 2024-02-07T12:25:34.129 INFO:tasks.workunit.client.1.smithi138.stdout:2/592: write d3/dd/d14/d8f/f68 [10171975,101370] 0 2024-02-07T12:25:34.129 INFO:tasks.workunit.client.1.smithi138.stdout:2/593: write d3/dd/d19/f15 [8836506,79428] 0 2024-02-07T12:25:34.129 INFO:tasks.workunit.client.1.smithi138.stdout:2/594: fdatasync d3/dd/f2e 0 2024-02-07T12:25:34.129 INFO:tasks.workunit.client.1.smithi138.stdout:0/491: dwrite d4/d9/de/d1d/f42 [0,4194304] 0 2024-02-07T12:25:34.130 INFO:tasks.workunit.client.1.smithi138.stdout:0/492: creat d4/d9/de/d1d/d8c/fa3 x:0 0 0 2024-02-07T12:25:34.131 INFO:tasks.workunit.client.1.smithi138.stdout:9/415: link d0/d6/f1e d0/f7e 0 2024-02-07T12:25:34.132 INFO:tasks.workunit.client.1.smithi138.stdout:4/487: mkdir d20/d34/d36/d55/d74/d9a 0 2024-02-07T12:25:34.133 INFO:tasks.workunit.client.1.smithi138.stdout:7/648: dwrite d0/d39/fa4 [0,4194304] 0 2024-02-07T12:25:34.133 INFO:tasks.workunit.client.1.smithi138.stdout:7/649: read d0/d39/f9c [1298490,78964] 0 2024-02-07T12:25:34.133 INFO:tasks.workunit.client.1.smithi138.stdout:1/419: dwrite d5/d8/da/d1f/d5e/d63/f92 [0,4194304] 0 2024-02-07T12:25:34.135 INFO:tasks.workunit.client.1.smithi138.stdout:3/625: symlink d5/d26/d28/db7/ldb 0 2024-02-07T12:25:34.135 INFO:tasks.workunit.client.1.smithi138.stdout:3/626: creat d5/d15/d32/da1/fdc x:0 0 0 2024-02-07T12:25:34.140 INFO:tasks.workunit.client.1.smithi138.stdout:8/663: dread d1/de/db4/db8/d17/d2e/d3a/d50/f5c [0,4194304] 0 2024-02-07T12:25:34.142 INFO:tasks.workunit.client.1.smithi138.stdout:5/519: rename da/d6d/d27/d2e/f2f to da/d6d/d27/d2e/d4f/d2b/d59/d91/faa 0 2024-02-07T12:25:34.142 INFO:tasks.workunit.client.1.smithi138.stdout:1/420: dread d5/d8/da/f11 [12582912,4194304] 0 2024-02-07T12:25:34.142 INFO:tasks.workunit.client.1.smithi138.stdout:1/421: chown d5/d8/da/d1f/c34 126 1 2024-02-07T12:25:34.144 INFO:tasks.workunit.client.1.smithi138.stdout:2/595: mkdir d3/dd/d14/d49/ddc 0 2024-02-07T12:25:34.146 INFO:tasks.workunit.client.1.smithi138.stdout:0/493: mknod d4/d9/d37/d6b/d7f/ca4 0 2024-02-07T12:25:34.148 INFO:tasks.workunit.client.1.smithi138.stdout:4/488: truncate d20/f2e 367849 0 2024-02-07T12:25:34.149 INFO:tasks.workunit.client.1.smithi138.stdout:7/650: link d0/d6/d19/d4e/f91 d0/d8/d11/d26/d90/d98/da6/fd8 0 2024-02-07T12:25:34.149 INFO:tasks.workunit.client.1.smithi138.stdout:7/651: fdatasync d0/d8/db3/fbf 0 2024-02-07T12:25:34.154 INFO:tasks.workunit.client.1.smithi138.stdout:8/664: symlink d1/de/db4/db8/d17/d3e/d72/lc9 0 2024-02-07T12:25:34.155 INFO:tasks.workunit.client.1.smithi138.stdout:4/489: mknod d20/d34/d59/d88/d8e/c9b 0 2024-02-07T12:25:34.155 INFO:tasks.workunit.client.1.smithi138.stdout:4/490: chown d20/d53/l56 80611 1 2024-02-07T12:25:34.155 INFO:tasks.workunit.client.1.smithi138.stdout:4/491: chown d20/d4d/l5c 398 1 2024-02-07T12:25:34.157 INFO:tasks.workunit.client.1.smithi138.stdout:6/452: dwrite dc/f1f [4194304,4194304] 0 2024-02-07T12:25:34.157 INFO:tasks.workunit.client.1.smithi138.stdout:6/453: stat dc/d13/f80 0 2024-02-07T12:25:34.158 INFO:tasks.workunit.client.1.smithi138.stdout:3/627: mkdir d5/d26/ddd 0 2024-02-07T12:25:34.158 INFO:tasks.workunit.client.1.smithi138.stdout:3/628: chown d5/d26/d9b/fb9 66838 1 2024-02-07T12:25:34.158 INFO:tasks.workunit.client.1.smithi138.stdout:9/416: dwrite d0/d6/d8/d1d/dd/f20 [0,4194304] 0 2024-02-07T12:25:34.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.157+0000 7f75f5b89700 1 -- 172.21.15.47:0/3608216773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75f00fe1d0 msgr2=0x7f75f0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:34.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.157+0000 7f75f5b89700 1 --2- 172.21.15.47:0/3608216773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75f00fe1d0 0x7f75f0100650 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f75e0004880 tx=0x7f75e0009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:34.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.157+0000 7f75f5b89700 1 -- 172.21.15.47:0/3608216773 shutdown_connections 2024-02-07T12:25:34.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.157+0000 7f75f5b89700 1 --2- 172.21.15.47:0/3608216773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75f00fe1d0 0x7f75f0100650 secure :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f75e0004880 tx=0x7f75e0009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:34.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.157+0000 7f75f5b89700 1 --2- 172.21.15.47:0/3608216773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75f00fb870 0x7f75f00fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:34.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.157+0000 7f75f5b89700 1 -- 172.21.15.47:0/3608216773 >> 172.21.15.47:0/3608216773 conn(0x7f75f00f74e0 msgr2=0x7f75f00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:34.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.158+0000 7f75f5b89700 1 -- 172.21.15.47:0/3608216773 shutdown_connections 2024-02-07T12:25:34.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.158+0000 7f75f5b89700 1 -- 172.21.15.47:0/3608216773 wait complete. 2024-02-07T12:25:34.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.159+0000 7f75f5b89700 1 Processor -- start 2024-02-07T12:25:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.159+0000 7f75f5b89700 1 -- start start 2024-02-07T12:25:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.159+0000 7f75f5b89700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75f00fb870 0x7f75f006f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.159+0000 7f75f5b89700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75f006f840 0x7f75f011ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.159+0000 7f75f5b89700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f006fd50 con 0x7f75f006f840 2024-02-07T12:25:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.159+0000 7f75f5b89700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f006fec0 con 0x7f75f00fb870 2024-02-07T12:25:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.160+0000 7f75eeffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75f006f840 0x7f75f011ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.160+0000 7f75eeffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75f006f840 0x7f75f011ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40054/0 (socket says 172.21.15.47:40054) 2024-02-07T12:25:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.160+0000 7f75eeffd700 1 -- 172.21.15.47:0/2148620792 learned_addr learned my addr 172.21.15.47:0/2148620792 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:25:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.160+0000 7f75ef7fe700 1 --2- 172.21.15.47:0/2148620792 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75f00fb870 0x7f75f006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.160+0000 7f75eeffd700 1 -- 172.21.15.47:0/2148620792 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75f00fb870 msgr2=0x7f75f006f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.160+0000 7f75eeffd700 1 --2- 172.21.15.47:0/2148620792 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75f00fb870 0x7f75f006f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.160+0000 7f75eeffd700 1 -- 172.21.15.47:0/2148620792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e0005040 con 0x7f75f006f840 2024-02-07T12:25:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.160+0000 7f75eeffd700 1 --2- 172.21.15.47:0/2148620792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75f006f840 0x7f75f011ddf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f75e0000c00 tx=0x7f75e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:34.165 INFO:tasks.workunit.client.1.smithi138.stdout:8/665: rmdir d1/de/db4/db8/d17/d2e 39 2024-02-07T12:25:34.165 INFO:tasks.workunit.client.1.smithi138.stdout:8/666: readlink d1/de/db4/db8/d17/d2e/l32 0 2024-02-07T12:25:34.165 INFO:tasks.workunit.client.1.smithi138.stdout:8/667: readlink d1/l4f 0 2024-02-07T12:25:34.165 INFO:tasks.workunit.client.1.smithi138.stdout:8/668: write d1/f6f [56659,77143] 0 2024-02-07T12:25:34.165 INFO:tasks.workunit.client.1.smithi138.stdout:8/669: readlink d1/de/db4/db8/d17/l4d 0 2024-02-07T12:25:34.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.161+0000 7f75d7fff700 1 -- 172.21.15.47:0/2148620792 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e000e040 con 0x7f75f006f840 2024-02-07T12:25:34.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.161+0000 7f75f5b89700 1 -- 172.21.15.47:0/2148620792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f011e3f0 con 0x7f75f006f840 2024-02-07T12:25:34.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.161+0000 7f75f5b89700 1 -- 172.21.15.47:0/2148620792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f011e8d0 con 0x7f75f006f840 2024-02-07T12:25:34.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.161+0000 7f75d7fff700 1 -- 172.21.15.47:0/2148620792 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75e0014d50 con 0x7f75f006f840 2024-02-07T12:25:34.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.161+0000 7f75d7fff700 1 -- 172.21.15.47:0/2148620792 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e001c630 con 0x7f75f006f840 2024-02-07T12:25:34.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.162+0000 7f75d7fff700 1 -- 172.21.15.47:0/2148620792 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) v1 ==== 45582+0+0 (secure 0 0 0) 0x7f75e001c790 con 0x7f75f006f840 2024-02-07T12:25:34.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.162+0000 7f75d7fff700 1 --2- 172.21.15.47:0/2148620792 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f75d80386a0 0x7f75d803ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:34.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.162+0000 7f75d7fff700 1 -- 172.21.15.47:0/2148620792 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f75e004d420 con 0x7f75f006f840 2024-02-07T12:25:34.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.163+0000 7f75f5b89700 1 -- 172.21.15.47:0/2148620792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f0069110 con 0x7f75f006f840 2024-02-07T12:25:34.167 INFO:tasks.workunit.client.1.smithi138.stdout:4/492: rmdir d20/d34/d59/d88 39 2024-02-07T12:25:34.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.163+0000 7f75ef7fe700 1 --2- 172.21.15.47:0/2148620792 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f75d80386a0 0x7f75d803ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:34.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.165+0000 7f75ef7fe700 1 --2- 172.21.15.47:0/2148620792 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f75d80386a0 0x7f75d803ab50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f75e4004990 tx=0x7f75e4009e20 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:34.170 INFO:tasks.workunit.client.1.smithi138.stdout:3/629: mkdir d5/d27/dde 0 2024-02-07T12:25:34.170 INFO:tasks.workunit.client.1.smithi138.stdout:3/630: dread - d5/d27/f7d zero size 2024-02-07T12:25:34.170 INFO:tasks.workunit.client.1.smithi138.stdout:3/631: write d5/d26/d28/f83 [667551,9470] 0 2024-02-07T12:25:34.171 INFO:tasks.workunit.client.1.smithi138.stdout:6/454: dread dc/d13/f1a [0,4194304] 0 2024-02-07T12:25:34.172 INFO:tasks.workunit.client.1.smithi138.stdout:4/493: mknod d20/d47/d69/c9c 0 2024-02-07T12:25:34.173 INFO:tasks.workunit.client.1.smithi138.stdout:9/417: dread d0/d6/f27 [0,4194304] 0 2024-02-07T12:25:34.174 INFO:tasks.workunit.client.1.smithi138.stdout:3/632: symlink d5/d26/d9d/ldf 0 2024-02-07T12:25:34.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.171+0000 7f75d7fff700 1 -- 172.21.15.47:0/2148620792 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f75e00123c0 con 0x7f75f006f840 2024-02-07T12:25:34.175 INFO:tasks.workunit.client.1.smithi138.stdout:6/455: stat c3 0 2024-02-07T12:25:34.175 INFO:tasks.workunit.client.1.smithi138.stdout:6/456: dread - dc/d31/d38/f64 zero size 2024-02-07T12:25:34.175 INFO:tasks.workunit.client.1.smithi138.stdout:7/652: dread d0/d8/d11/d1f/f42 [0,4194304] 0 2024-02-07T12:25:34.175 INFO:tasks.workunit.client.1.smithi138.stdout:8/670: write d1/de/db4/db8/f43 [3516904,61147] 0 2024-02-07T12:25:34.176 INFO:tasks.workunit.client.1.smithi138.stdout:4/494: truncate d20/f7b 2985053 0 2024-02-07T12:25:34.179 INFO:tasks.workunit.client.1.smithi138.stdout:9/418: rename d0/d6/f1e to d0/d6/d8/d1d/dd/d25/f7f 0 2024-02-07T12:25:34.180 INFO:tasks.workunit.client.1.smithi138.stdout:7/653: creat d0/d6/d73/fd9 x:0 0 0 2024-02-07T12:25:34.180 INFO:tasks.workunit.client.1.smithi138.stdout:7/654: getdents d0/d6/d76/d93 0 2024-02-07T12:25:34.182 INFO:tasks.workunit.client.1.smithi138.stdout:4/495: unlink d20/d34/d59/f95 0 2024-02-07T12:25:34.182 INFO:tasks.workunit.client.1.smithi138.stdout:0/494: dwrite d4/d9/f12 [0,4194304] 0 2024-02-07T12:25:34.182 INFO:tasks.workunit.client.1.smithi138.stdout:0/495: stat d4/d9/de/l1e 0 2024-02-07T12:25:34.182 INFO:tasks.workunit.client.1.smithi138.stdout:5/520: dwrite da/f85 [0,4194304] 0 2024-02-07T12:25:34.183 INFO:tasks.workunit.client.1.smithi138.stdout:7/655: dread d0/d8/d11/d1f/f77 [0,4194304] 0 2024-02-07T12:25:34.184 INFO:tasks.workunit.client.1.smithi138.stdout:6/457: rename dc/d13/d1e/d4d/l51 to dc/d69/l92 0 2024-02-07T12:25:34.184 INFO:tasks.workunit.client.1.smithi138.stdout:1/422: dwrite d5/d8/da/d1f/d3c/d59/f78 [0,4194304] 0 2024-02-07T12:25:34.185 INFO:tasks.workunit.client.1.smithi138.stdout:2/596: dwrite d3/d4e/f6e [0,4194304] 0 2024-02-07T12:25:34.185 INFO:tasks.workunit.client.1.smithi138.stdout:2/597: dread - d3/dd/d14/d8f/dbc/dbd/fd7 zero size 2024-02-07T12:25:34.190 INFO:tasks.workunit.client.1.smithi138.stdout:0/496: symlink d4/d9/db/d39/d4b/d6c/d8f/la5 0 2024-02-07T12:25:34.190 INFO:tasks.workunit.client.1.smithi138.stdout:0/497: chown d4/d9/de/d1d/d21/f43 3061 1 2024-02-07T12:25:34.193 INFO:tasks.workunit.client.1.smithi138.stdout:5/521: rename da/d43/d4a/f84 to da/d6d/d27/d2e/d4f/d2b/fab 0 2024-02-07T12:25:34.201 INFO:tasks.workunit.client.1.smithi138.stdout:2/598: mknod d3/dd/d19/d1f/d46/cdd 0 2024-02-07T12:25:34.205 INFO:tasks.workunit.client.1.smithi138.stdout:0/498: rename d4/d9/d33/l81 to d4/d9/db/d39/d4b/la6 0 2024-02-07T12:25:34.205 INFO:tasks.workunit.client.1.smithi138.stdout:0/499: readlink d4/d9/d37/l79 0 2024-02-07T12:25:34.205 INFO:tasks.workunit.client.1.smithi138.stdout:0/500: truncate d4/d69/f87 610688 0 2024-02-07T12:25:34.208 INFO:tasks.workunit.client.1.smithi138.stdout:5/522: creat da/d6d/fac x:0 0 0 2024-02-07T12:25:34.208 INFO:tasks.workunit.client.1.smithi138.stdout:5/523: readlink da/d43/l7d 0 2024-02-07T12:25:34.208 INFO:tasks.workunit.client.1.smithi138.stdout:6/458: dread dc/d13/f87 [0,4194304] 0 2024-02-07T12:25:34.208 INFO:tasks.workunit.client.1.smithi138.stdout:6/459: chown dc/d69/f67 211240 1 2024-02-07T12:25:34.208 INFO:tasks.workunit.client.1.smithi138.stdout:6/460: chown dc/d31/d3f/f52 801070 1 2024-02-07T12:25:34.208 INFO:tasks.workunit.client.1.smithi138.stdout:5/524: write da/d6d/f6b [692579,120980] 0 2024-02-07T12:25:34.208 INFO:tasks.workunit.client.1.smithi138.stdout:6/461: write dc/d31/d38/f64 [892444,95728] 0 2024-02-07T12:25:34.208 INFO:tasks.workunit.client.1.smithi138.stdout:3/633: dwrite d5/d15/d32/fb8 [0,4194304] 0 2024-02-07T12:25:34.210 INFO:tasks.workunit.client.1.smithi138.stdout:0/501: rmdir d4/d52/d74 39 2024-02-07T12:25:34.211 INFO:tasks.workunit.client.1.smithi138.stdout:4/496: dread d20/f3d [0,4194304] 0 2024-02-07T12:25:34.211 INFO:tasks.workunit.client.1.smithi138.stdout:8/671: dwrite d1/de/db4/db8/d17/d2e/d3a/f61 [0,4194304] 0 2024-02-07T12:25:34.212 INFO:tasks.workunit.client.1.smithi138.stdout:6/462: creat dc/d13/d1e/d35/f93 x:0 0 0 2024-02-07T12:25:34.215 INFO:tasks.workunit.client.1.smithi138.stdout:5/525: write da/d6d/f20 [402063,105923] 0 2024-02-07T12:25:34.215 INFO:tasks.workunit.client.1.smithi138.stdout:5/526: stat da/d50/l8e 0 2024-02-07T12:25:34.215 INFO:tasks.workunit.client.1.smithi138.stdout:3/634: rename d5/d26/d5e/d86/dc0/fc3 to d5/d26/d5e/fe0 0 2024-02-07T12:25:34.217 INFO:tasks.workunit.client.1.smithi138.stdout:4/497: creat d20/d47/d69/d76/f9d x:0 0 0 2024-02-07T12:25:34.218 INFO:tasks.workunit.client.1.smithi138.stdout:8/672: creat d1/de/db4/db8/d17/d2e/fca x:0 0 0 2024-02-07T12:25:34.220 INFO:tasks.workunit.client.1.smithi138.stdout:6/463: mknod dc/d31/d38/c94 0 2024-02-07T12:25:34.221 INFO:tasks.workunit.client.1.smithi138.stdout:6/464: dread dc/d13/f39 [0,4194304] 0 2024-02-07T12:25:34.223 INFO:tasks.workunit.client.1.smithi138.stdout:3/635: creat d5/d26/d9b/dab/dc4/dc7/fe1 x:0 0 0 2024-02-07T12:25:34.226 INFO:tasks.workunit.client.1.smithi138.stdout:4/498: mknod d20/d53/d71/d75/d94/c9e 0 2024-02-07T12:25:34.226 INFO:tasks.workunit.client.1.smithi138.stdout:2/599: dwrite d3/dd/d14/d8f/da5/fce [0,4194304] 0 2024-02-07T12:25:34.230 INFO:tasks.workunit.client.1.smithi138.stdout:6/465: rename dc/d13/d1e/d4d/f6f to dc/d13/d1e/d35/d85/f95 0 2024-02-07T12:25:34.230 INFO:tasks.workunit.client.1.smithi138.stdout:6/466: chown dc/d13/d1e/d35/d85/f95 2032690 1 2024-02-07T12:25:34.231 INFO:tasks.workunit.client.1.smithi138.stdout:6/467: dread dc/d13/d1e/f30 [0,4194304] 0 2024-02-07T12:25:34.232 INFO:tasks.workunit.client.1.smithi138.stdout:4/499: mknod d20/c9f 0 2024-02-07T12:25:34.232 INFO:tasks.workunit.client.1.smithi138.stdout:4/500: truncate d20/d34/d36/d55/f96 199025 0 2024-02-07T12:25:34.235 INFO:tasks.workunit.client.1.smithi138.stdout:8/673: rmdir d1/de/db4/db8/d17/d2e/d3a/d50 39 2024-02-07T12:25:34.237 INFO:tasks.workunit.client.1.smithi138.stdout:3/636: rename d5/d26/d4e/f58 to d5/d27/d35/dac/fe2 0 2024-02-07T12:25:34.238 INFO:tasks.workunit.client.1.smithi138.stdout:3/637: write d5/d26/d5e/f8a [83533,21164] 0 2024-02-07T12:25:34.238 INFO:tasks.workunit.client.1.smithi138.stdout:3/638: truncate d5/f8d 253291 0 2024-02-07T12:25:34.239 INFO:tasks.workunit.client.1.smithi138.stdout:6/468: creat dc/d31/f96 x:0 0 0 2024-02-07T12:25:34.239 INFO:tasks.workunit.client.1.smithi138.stdout:6/469: rename dc to dc/d31/d97 22 2024-02-07T12:25:34.241 INFO:tasks.workunit.client.1.smithi138.stdout:4/501: symlink d20/d53/d71/d98/la0 0 2024-02-07T12:25:34.242 INFO:tasks.workunit.client.1.smithi138.stdout:8/674: creat d1/de/db4/db8/d17/fcb x:0 0 0 2024-02-07T12:25:34.244 INFO:tasks.workunit.client.1.smithi138.stdout:9/419: dwrite d0/d6/d8/d1d/f61 [0,4194304] 0 2024-02-07T12:25:34.244 INFO:tasks.workunit.client.1.smithi138.stdout:9/420: dread - d0/d6/d8/d1d/dd/d25/f5b zero size 2024-02-07T12:25:34.244 INFO:tasks.workunit.client.1.smithi138.stdout:9/421: truncate d0/d6/d8/d1d/f53 963769 0 2024-02-07T12:25:34.245 INFO:tasks.workunit.client.1.smithi138.stdout:4/502: rename d20/d34/c6f to d20/d53/d71/d98/ca1 0 2024-02-07T12:25:34.247 INFO:tasks.workunit.client.1.smithi138.stdout:2/600: fsync d3/dd/d19/f42 0 2024-02-07T12:25:34.252 INFO:tasks.workunit.client.1.smithi138.stdout:3/639: dread d5/d15/d32/fb8 [0,4194304] 0 2024-02-07T12:25:34.252 INFO:tasks.workunit.client.1.smithi138.stdout:7/656: dwrite d0/d8/d11/f79 [0,4194304] 0 2024-02-07T12:25:34.252 INFO:tasks.workunit.client.1.smithi138.stdout:3/640: dread - d5/d26/d5e/d86/dae/fd4 zero size 2024-02-07T12:25:34.252 INFO:tasks.workunit.client.1.smithi138.stdout:2/601: getdents d3/dd/d19 0 2024-02-07T12:25:34.253 INFO:tasks.workunit.client.1.smithi138.stdout:1/423: dwrite d5/d8/da/d1f/d27/f8f [0,4194304] 0 2024-02-07T12:25:34.253 INFO:tasks.workunit.client.1.smithi138.stdout:1/424: write d5/d8/da/d1f/d27/d68/d73/d7b/f2c [397964,11955] 0 2024-02-07T12:25:34.253 INFO:tasks.workunit.client.1.smithi138.stdout:2/602: symlink d3/dd/d19/d1f/d46/d71/lde 0 2024-02-07T12:25:34.258 INFO:tasks.workunit.client.1.smithi138.stdout:0/502: dwrite d4/d9/de/d1d/d8c/f93 [0,4194304] 0 2024-02-07T12:25:34.258 INFO:tasks.workunit.client.1.smithi138.stdout:0/503: readlink d4/d9/de/d1d/l7a 0 2024-02-07T12:25:34.258 INFO:tasks.workunit.client.1.smithi138.stdout:5/527: dwrite da/d43/d4a/d69/f7a [0,4194304] 0 2024-02-07T12:25:34.262 INFO:tasks.workunit.client.1.smithi138.stdout:1/425: creat d5/d8/da/d1f/f96 x:0 0 0 2024-02-07T12:25:34.262 INFO:tasks.workunit.client.1.smithi138.stdout:1/426: chown d5/d4b/d72/l89 190241504 1 2024-02-07T12:25:34.263 INFO:tasks.workunit.client.1.smithi138.stdout:9/422: dread d0/f38 [0,4194304] 0 2024-02-07T12:25:34.264 INFO:tasks.workunit.client.1.smithi138.stdout:6/470: dwrite dc/d13/d1e/f84 [0,4194304] 0 2024-02-07T12:25:34.264 INFO:tasks.workunit.client.1.smithi138.stdout:6/471: stat dc/d31/d38/c43 0 2024-02-07T12:25:34.264 INFO:tasks.workunit.client.1.smithi138.stdout:9/423: write d0/d6/d8/d1d/dd/d1f/f47 [141162,112125] 0 2024-02-07T12:25:34.265 INFO:tasks.workunit.client.1.smithi138.stdout:0/504: rename d4/d9/db/l10 to d4/d9/d37/la7 0 2024-02-07T12:25:34.269 INFO:tasks.workunit.client.1.smithi138.stdout:7/657: dread d0/d6/d76/d93/fbb [0,4194304] 0 2024-02-07T12:25:34.269 INFO:tasks.workunit.client.1.smithi138.stdout:7/658: chown d0/d8/d11/d63/dc8/dce/dd7 1381163 1 2024-02-07T12:25:34.269 INFO:tasks.workunit.client.1.smithi138.stdout:7/659: chown d0/d8/d11/d26/d90/d98/da6/cd3 11793502 1 2024-02-07T12:25:34.269 INFO:tasks.workunit.client.1.smithi138.stdout:7/660: read d0/d8/d11/d26/d90/d98/da6/fd8 [340985,80629] 0 2024-02-07T12:25:34.270 INFO:tasks.workunit.client.1.smithi138.stdout:6/472: symlink dc/l98 0 2024-02-07T12:25:34.270 INFO:tasks.workunit.client.1.smithi138.stdout:6/473: dread - dc/d13/d1e/d4d/f5d zero size 2024-02-07T12:25:34.270 INFO:tasks.workunit.client.1.smithi138.stdout:6/474: creat dc/d13/d1e/f99 x:0 0 0 2024-02-07T12:25:34.273 INFO:tasks.workunit.client.1.smithi138.stdout:9/424: mknod d0/d6/d8/d1d/dd/c80 0 2024-02-07T12:25:34.274 INFO:tasks.workunit.client.1.smithi138.stdout:2/603: truncate d3/dd/d14/d8f/da5/fce 3090702 0 2024-02-07T12:25:34.274 INFO:tasks.workunit.client.1.smithi138.stdout:2/604: write f0 [85464,64001] 0 2024-02-07T12:25:34.274 INFO:tasks.workunit.client.1.smithi138.stdout:2/605: dread - d3/dd/d14/d82/fa3 zero size 2024-02-07T12:25:34.275 INFO:tasks.workunit.client.1.smithi138.stdout:1/427: rename d5/d8/da/d1f/d27/d68/c8a to d5/d8/da/d1f/d27/d68/d73/d7b/c97 0 2024-02-07T12:25:34.275 INFO:tasks.workunit.client.1.smithi138.stdout:1/428: readlink d5/d5c/l69 0 2024-02-07T12:25:34.276 INFO:tasks.workunit.client.1.smithi138.stdout:0/505: write d4/d9/f18 [1558689,4333] 0 2024-02-07T12:25:34.276 INFO:tasks.workunit.client.1.smithi138.stdout:0/506: write d4/d9/f8e [709571,9249] 0 2024-02-07T12:25:34.276 INFO:tasks.workunit.client.1.smithi138.stdout:0/507: write d4/d9/de/d1d/d8c/fa3 [610332,57601] 0 2024-02-07T12:25:34.277 INFO:tasks.workunit.client.1.smithi138.stdout:7/661: symlink d0/d8/d11/d5f/lda 0 2024-02-07T12:25:34.277 INFO:tasks.workunit.client.1.smithi138.stdout:7/662: chown d0/d39/c50 64933897 1 2024-02-07T12:25:34.277 INFO:tasks.workunit.client.1.smithi138.stdout:7/663: creat d0/d8/d11/d26/fdb x:0 0 0 2024-02-07T12:25:34.279 INFO:tasks.workunit.client.1.smithi138.stdout:8/675: dwrite d1/de/db4/db8/d17/d2e/d49/f56 [0,4194304] 0 2024-02-07T12:25:34.279 INFO:tasks.workunit.client.1.smithi138.stdout:5/528: dwrite da/d43/d4a/f9d [0,4194304] 0 2024-02-07T12:25:34.280 INFO:tasks.workunit.client.1.smithi138.stdout:4/503: dwrite d20/d34/d36/d55/f7f [0,4194304] 0 2024-02-07T12:25:34.280 INFO:tasks.workunit.client.1.smithi138.stdout:4/504: read fb [2863984,110446] 0 2024-02-07T12:25:34.281 INFO:tasks.workunit.client.1.smithi138.stdout:6/475: mkdir dc/d31/d38/d9a 0 2024-02-07T12:25:34.281 INFO:tasks.workunit.client.1.smithi138.stdout:6/476: truncate dc/d13/f87 1520495 0 2024-02-07T12:25:34.281 INFO:tasks.workunit.client.1.smithi138.stdout:8/676: dread d1/de/db4/db8/f31 [0,4194304] 0 2024-02-07T12:25:34.285 INFO:tasks.workunit.client.1.smithi138.stdout:2/606: link d3/dd/d14/f2c d3/dd/fdf 0 2024-02-07T12:25:34.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.284+0000 7f75d7fff700 1 -- 172.21.15.47:0/2148620792 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 23) v1 ==== 45878+0+0 (secure 0 0 0) 0x7f75e00259d0 con 0x7f75f006f840 2024-02-07T12:25:34.290 INFO:tasks.workunit.client.1.smithi138.stdout:0/508: creat d4/d9/db/fa8 x:0 0 0 2024-02-07T12:25:34.290 INFO:tasks.workunit.client.1.smithi138.stdout:0/509: read d4/d52/f90 [2386564,130547] 0 2024-02-07T12:25:34.293 INFO:tasks.workunit.client.1.smithi138.stdout:7/664: unlink d0/d6/d76/d93/f57 0 2024-02-07T12:25:34.293 INFO:tasks.workunit.client.1.smithi138.stdout:7/665: stat d0/d8/d11/d63/dc8/dce 0 2024-02-07T12:25:34.303 INFO:tasks.workunit.client.1.smithi138.stdout:5/529: creat da/d6d/d27/d2e/d4f/d2b/d35/d5d/d73/fad x:0 0 0 2024-02-07T12:25:34.312 INFO:tasks.workunit.client.1.smithi138.stdout:4/505: rename d20/d53/d71/d75/d94/f8c to d20/d34/d59/d88/d8d/fa2 0 2024-02-07T12:25:34.326 INFO:tasks.workunit.client.1.smithi138.stdout:6/477: mkdir dc/d73/d9b 0 2024-02-07T12:25:34.327 INFO:tasks.workunit.client.1.smithi138.stdout:9/425: mknod d0/d6/d8/d1d/dd/d1f/c81 0 2024-02-07T12:25:34.329 INFO:tasks.workunit.client.1.smithi138.stdout:2/607: truncate d3/d4e/f50 2282402 0 2024-02-07T12:25:34.330 INFO:tasks.workunit.client.1.smithi138.stdout:2/608: chown d3/dd/d14/d49/d25 268371372 1 2024-02-07T12:25:34.330 INFO:tasks.workunit.client.1.smithi138.stdout:1/429: getdents d5/d8/da/d20 0 2024-02-07T12:25:34.333 INFO:tasks.workunit.client.1.smithi138.stdout:8/677: rename d1/de/db4/db8/d17/da8 to d1/de/db4/db8/d17/d2e/dcc 0 2024-02-07T12:25:34.334 INFO:tasks.workunit.client.1.smithi138.stdout:4/506: symlink d20/d34/d36/d55/d74/la3 0 2024-02-07T12:25:34.335 INFO:tasks.workunit.client.1.smithi138.stdout:6/478: getdents dc/d69 0 2024-02-07T12:25:34.337 INFO:tasks.workunit.client.1.smithi138.stdout:9/426: symlink d0/d6/d8/d1d/dd/d41/d5e/d74/l82 0 2024-02-07T12:25:34.337 INFO:tasks.workunit.client.1.smithi138.stdout:9/427: fsync d0/d6/f3c 0 2024-02-07T12:25:34.337 INFO:tasks.workunit.client.1.smithi138.stdout:9/428: write d0/d6/d8/d1d/dd/d25/f7f [4720985,94086] 0 2024-02-07T12:25:34.338 INFO:tasks.workunit.client.1.smithi138.stdout:2/609: symlink d3/dd/d19/d1f/le0 0 2024-02-07T12:25:34.342 INFO:tasks.workunit.client.1.smithi138.stdout:0/510: rename d4/d9/d37/d3d/l46 to d4/d9/db/d71/la9 0 2024-02-07T12:25:34.344 INFO:tasks.workunit.client.1.smithi138.stdout:6/479: unlink dc/d13/d1e/d35/l4a 0 2024-02-07T12:25:34.348 INFO:tasks.workunit.client.1.smithi138.stdout:9/429: link d0/d6/d8/d1d/dd/l23 d0/l83 0 2024-02-07T12:25:34.350 INFO:tasks.workunit.client.1.smithi138.stdout:1/430: mknod d5/d8/c98 0 2024-02-07T12:25:34.350 INFO:tasks.workunit.client.1.smithi138.stdout:1/431: fsync d5/f86 0 2024-02-07T12:25:34.351 INFO:tasks.workunit.client.1.smithi138.stdout:1/432: write d5/f1a [6644200,63386] 0 2024-02-07T12:25:34.351 INFO:tasks.workunit.client.1.smithi138.stdout:8/678: dwrite d1/de/db4/db8/d17/d3e/d89/fc5 [0,4194304] 0 2024-02-07T12:25:34.353 INFO:tasks.workunit.client.1.smithi138.stdout:7/666: rename d0/d8/d11/fcf to d0/d6/d76/d93/fdc 0 2024-02-07T12:25:34.356 INFO:tasks.workunit.client.1.smithi138.stdout:1/433: mkdir d5/d8/da/d1f/d5e/d63/d99 0 2024-02-07T12:25:34.363 INFO:tasks.workunit.client.1.smithi138.stdout:7/667: dread d0/d6/d3e/f68 [0,4194304] 0 2024-02-07T12:25:34.363 INFO:tasks.workunit.client.1.smithi138.stdout:7/668: read d0/d8/d11/d1f/f42 [598939,101281] 0 2024-02-07T12:25:34.364 INFO:tasks.workunit.client.1.smithi138.stdout:2/610: rename d3/dd/d14/d49/d29/d5b/f7f to d3/dd/d19/d44/d7d/fe1 0 2024-02-07T12:25:34.364 INFO:tasks.workunit.client.1.smithi138.stdout:2/611: fdatasync d3/dd/d19/d44/f69 0 2024-02-07T12:25:34.369 INFO:tasks.workunit.client.1.smithi138.stdout:7/669: link d0/d6/d1d/d38/f8d d0/fdd 0 2024-02-07T12:25:34.371 INFO:tasks.workunit.client.1.smithi138.stdout:0/511: rename d4/d9/de/d1d/d21/f3b to d4/d9/db/d39/faa 0 2024-02-07T12:25:34.372 INFO:tasks.workunit.client.1.smithi138.stdout:7/670: symlink d0/d6/d1d/lde 0 2024-02-07T12:25:34.372 INFO:tasks.workunit.client.1.smithi138.stdout:7/671: stat d0/d6/d3e/f51 0 2024-02-07T12:25:34.374 INFO:tasks.workunit.client.1.smithi138.stdout:6/480: rename dc/d31/d54/f61 to dc/d13/d1e/d4d/f9c 0 2024-02-07T12:25:34.375 INFO:tasks.workunit.client.1.smithi138.stdout:2/612: dread d3/dd/d19/f15 [0,4194304] 0 2024-02-07T12:25:34.377 INFO:tasks.workunit.client.1.smithi138.stdout:7/672: symlink d0/d8/d11/d63/dc8/dce/ldf 0 2024-02-07T12:25:34.377 INFO:tasks.workunit.client.1.smithi138.stdout:7/673: read - d0/d8/d11/d26/d90/f72 zero size 2024-02-07T12:25:34.379 INFO:tasks.workunit.client.1.smithi138.stdout:6/481: mknod dc/d31/d38/c9d 0 2024-02-07T12:25:34.379 INFO:tasks.workunit.client.1.smithi138.stdout:6/482: truncate dc/d13/d1e/f5f 1242461 0 2024-02-07T12:25:34.380 INFO:tasks.workunit.client.1.smithi138.stdout:2/613: link d3/dd/d14/d49/c65 d3/dd/d14/d49/ce2 0 2024-02-07T12:25:34.381 INFO:tasks.workunit.client.1.smithi138.stdout:9/430: dwrite d0/d6/d8/d1d/f3d [0,4194304] 0 2024-02-07T12:25:34.381 INFO:tasks.workunit.client.1.smithi138.stdout:9/431: write d0/d34/f6b [178985,29442] 0 2024-02-07T12:25:34.381 INFO:tasks.workunit.client.1.smithi138.stdout:8/679: dwrite d1/de/db4/db8/d17/d2e/d3a/f61 [0,4194304] 0 2024-02-07T12:25:34.381 INFO:tasks.workunit.client.1.smithi138.stdout:6/483: creat dc/d73/f9e x:0 0 0 2024-02-07T12:25:34.382 INFO:tasks.workunit.client.1.smithi138.stdout:2/614: symlink d3/dd/d19/d44/le3 0 2024-02-07T12:25:34.382 INFO:tasks.workunit.client.1.smithi138.stdout:2/615: creat d3/dd/d19/d1f/d46/d71/fe4 x:0 0 0 2024-02-07T12:25:34.383 INFO:tasks.workunit.client.1.smithi138.stdout:2/616: creat d3/dd/fe5 x:0 0 0 2024-02-07T12:25:34.383 INFO:tasks.workunit.client.1.smithi138.stdout:2/617: read d3/d4e/f50 [607691,88704] 0 2024-02-07T12:25:34.390 INFO:tasks.workunit.client.1.smithi138.stdout:8/680: link d1/de/db4/db8/d17/d3e/f5a d1/d99/fcd 0 2024-02-07T12:25:34.392 INFO:tasks.workunit.client.1.smithi138.stdout:1/434: dwrite d5/f86 [0,4194304] 0 2024-02-07T12:25:34.392 INFO:tasks.workunit.client.1.smithi138.stdout:2/618: symlink d3/dd/d19/d1f/d46/d71/le6 0 2024-02-07T12:25:34.394 INFO:tasks.workunit.client.1.smithi138.stdout:9/432: rename d0/d6/d8/d1d/l13 to d0/d6/d8/d1d/dd/d1f/l84 0 2024-02-07T12:25:34.394 INFO:tasks.workunit.client.1.smithi138.stdout:9/433: chown d0/d6/d8/d1d/dd/c80 624 1 2024-02-07T12:25:34.396 INFO:tasks.workunit.client.1.smithi138.stdout:1/435: creat d5/d4b/d91/f9a x:0 0 0 2024-02-07T12:25:34.397 INFO:tasks.workunit.client.1.smithi138.stdout:2/619: mkdir d3/dd/d14/d8f/de7 0 2024-02-07T12:25:34.397 INFO:tasks.workunit.client.1.smithi138.stdout:2/620: chown d3/dd/d14/d8f/dbc/dbd/fd7 12632381 1 2024-02-07T12:25:34.398 INFO:tasks.workunit.client.1.smithi138.stdout:2/621: write d3/dd/d14/d49/d25/d3d/fb1 [683181,85496] 0 2024-02-07T12:25:34.399 INFO:tasks.workunit.client.1.smithi138.stdout:8/681: rename d1/de/db4/db8/d17/d2e/d3a/d50 to d1/de/db4/db8/d17/d3e/dce 0 2024-02-07T12:25:34.401 INFO:tasks.workunit.client.1.smithi138.stdout:9/434: creat d0/d6/d8/d1d/dd/d25/f85 x:0 0 0 2024-02-07T12:25:34.401 INFO:tasks.workunit.client.1.smithi138.stdout:9/435: fdatasync d0/d6/d8/d1d/dd/f63 0 2024-02-07T12:25:34.401 INFO:tasks.workunit.client.1.smithi138.stdout:9/436: write d0/d6/d8/f2a [8584468,42113] 0 2024-02-07T12:25:34.401 INFO:tasks.workunit.client.1.smithi138.stdout:1/436: mknod d5/c9b 0 2024-02-07T12:25:34.402 INFO:tasks.workunit.client.1.smithi138.stdout:8/682: mkdir d1/de/db4/db8/d17/d2e/d49/dcf 0 2024-02-07T12:25:34.403 INFO:tasks.workunit.client.1.smithi138.stdout:0/512: dwrite d4/d9/f22 [0,4194304] 0 2024-02-07T12:25:34.404 INFO:tasks.workunit.client.1.smithi138.stdout:9/437: truncate d0/d6/d8/d1d/dd/d41/d5e/d74/f7b 659906 0 2024-02-07T12:25:34.405 INFO:tasks.workunit.client.1.smithi138.stdout:6/484: dwrite dc/d31/f37 [0,4194304] 0 2024-02-07T12:25:34.405 INFO:tasks.workunit.client.1.smithi138.stdout:6/485: truncate dc/d13/d1e/f5f 2216291 0 2024-02-07T12:25:34.405 INFO:tasks.workunit.client.1.smithi138.stdout:6/486: truncate dc/d13/f87 1937355 0 2024-02-07T12:25:34.405 INFO:tasks.workunit.client.1.smithi138.stdout:6/487: dread - dc/d13/f80 zero size 2024-02-07T12:25:34.406 INFO:tasks.workunit.client.1.smithi138.stdout:7/674: dwrite d0/d6/d19/d4e/fab [0,4194304] 0 2024-02-07T12:25:34.410 INFO:tasks.workunit.client.1.smithi138.stdout:1/437: creat d5/d8/da/d1f/d5e/d62/f9c x:0 0 0 2024-02-07T12:25:34.410 INFO:tasks.workunit.client.1.smithi138.stdout:1/438: write d5/d8/da/d20/f21 [122235,110061] 0 2024-02-07T12:25:34.414 INFO:tasks.workunit.client.1.smithi138.stdout:0/513: rename d4/d9/de/f95 to d4/d69/d85/d8a/fab 0 2024-02-07T12:25:34.415 INFO:tasks.workunit.client.1.smithi138.stdout:9/438: write d0/d6/d8/d1d/dd/d41/d5e/f67 [4536086,77237] 0 2024-02-07T12:25:34.415 INFO:tasks.workunit.client.1.smithi138.stdout:9/439: write d0/d6/d8/d1d/dd/d25/f85 [73299,89255] 0 2024-02-07T12:25:34.415 INFO:tasks.workunit.client.1.smithi138.stdout:6/488: read dc/d13/d1e/d35/f4c [1210357,96991] 0 2024-02-07T12:25:34.417 INFO:tasks.workunit.client.1.smithi138.stdout:0/514: read d4/d9/de/d1d/f36 [674611,75819] 0 2024-02-07T12:25:34.425 INFO:tasks.workunit.client.1.smithi138.stdout:1/439: creat d5/d8/da/d1f/d27/d68/f9d x:0 0 0 2024-02-07T12:25:34.425 INFO:tasks.workunit.client.1.smithi138.stdout:1/440: readlink d5/d8/da/d1f/d27/d68/d73/d7b/l2b 0 2024-02-07T12:25:34.425 INFO:tasks.workunit.client.1.smithi138.stdout:6/489: dread dc/d31/d54/f5c [0,4194304] 0 2024-02-07T12:25:34.426 INFO:tasks.workunit.client.1.smithi138.stdout:9/440: mkdir d0/d34/d86 0 2024-02-07T12:25:34.426 INFO:tasks.workunit.client.1.smithi138.stdout:9/441: getdents d0/d34/d45/d78 0 2024-02-07T12:25:34.426 INFO:tasks.workunit.client.1.smithi138.stdout:0/515: truncate d4/fd 513336 0 2024-02-07T12:25:34.429 INFO:tasks.workunit.client.1.smithi138.stdout:6/490: mkdir dc/d31/d9f 0 2024-02-07T12:25:34.430 INFO:tasks.workunit.client.1.smithi138.stdout:0/516: creat d4/d9/d37/d64/fac x:0 0 0 2024-02-07T12:25:34.431 INFO:tasks.workunit.client.1.smithi138.stdout:6/491: creat dc/d73/d9b/fa0 x:0 0 0 2024-02-07T12:25:34.431 INFO:tasks.workunit.client.1.smithi138.stdout:6/492: stat dc/d13/d1e/d24/f2c 0 2024-02-07T12:25:34.432 INFO:tasks.workunit.client.1.smithi138.stdout:8/683: dwrite d1/f6f [0,4194304] 0 2024-02-07T12:25:34.433 INFO:tasks.workunit.client.1.smithi138.stdout:8/684: chown d1/de/db4/db8/d17/d2e/d3a/f83 897917 1 2024-02-07T12:25:34.433 INFO:tasks.workunit.client.1.smithi138.stdout:8/685: write d1/de/db4/db8/d96/fbf [4590028,61274] 0 2024-02-07T12:25:34.433 INFO:tasks.workunit.client.1.smithi138.stdout:7/675: dwrite d0/d8/d11/d1f/f77 [0,4194304] 0 2024-02-07T12:25:34.433 INFO:tasks.workunit.client.1.smithi138.stdout:6/493: unlink dc/d13/d1e/d35/c45 0 2024-02-07T12:25:34.436 INFO:tasks.workunit.client.1.smithi138.stdout:8/686: creat d1/de/db4/db8/d17/d3e/d89/fd0 x:0 0 0 2024-02-07T12:25:34.438 INFO:tasks.workunit.client.1.smithi138.stdout:9/442: dread d0/d6/d8/d1d/dd/d41/d5e/f67 [0,4194304] 0 2024-02-07T12:25:34.438 INFO:tasks.workunit.client.1.smithi138.stdout:9/443: write d0/d6/d8/d1d/dd/d41/d5e/f75 [1144429,98474] 0 2024-02-07T12:25:34.440 INFO:tasks.workunit.client.1.smithi138.stdout:7/676: link d0/d8/d15/f6b d0/d8/fe0 0 2024-02-07T12:25:34.443 INFO:tasks.workunit.client.1.smithi138.stdout:6/494: rmdir dc/d31/d3f/d71 0 2024-02-07T12:25:34.447 INFO:tasks.workunit.client.1.smithi138.stdout:1/441: dwrite d5/d8/da/d1f/f51 [0,4194304] 0 2024-02-07T12:25:34.449 INFO:tasks.workunit.client.1.smithi138.stdout:7/677: creat d0/d8/d11/d63/dc8/dce/dd7/fe1 x:0 0 0 2024-02-07T12:25:34.449 INFO:tasks.workunit.client.1.smithi138.stdout:6/495: creat dc/d13/d1e/d35/d85/d88/fa1 x:0 0 0 2024-02-07T12:25:34.452 INFO:tasks.workunit.client.1.smithi138.stdout:1/442: creat d5/d5b/f9e x:0 0 0 2024-02-07T12:25:34.457 INFO:tasks.workunit.client.1.smithi138.stdout:7/678: symlink d0/d39/le2 0 2024-02-07T12:25:34.457 INFO:tasks.workunit.client.1.smithi138.stdout:7/679: write d0/d6/d3e/fd1 [419584,90589] 0 2024-02-07T12:25:34.457 INFO:tasks.workunit.client.1.smithi138.stdout:7/680: creat d0/d39/d8a/fe3 x:0 0 0 2024-02-07T12:25:34.458 INFO:tasks.workunit.client.1.smithi138.stdout:6/496: link dc/d31/d38/c4e dc/d31/d3f/ca2 0 2024-02-07T12:25:34.458 INFO:tasks.workunit.client.1.smithi138.stdout:1/443: truncate d5/d8/da/f29 4332461 0 2024-02-07T12:25:34.458 INFO:tasks.workunit.client.1.smithi138.stdout:9/444: dwrite d0/d34/d45/f69 [0,4194304] 0 2024-02-07T12:25:34.461 INFO:tasks.workunit.client.1.smithi138.stdout:8/687: dwrite d1/de/db4/db8/d17/d3e/d72/f9f [0,4194304] 0 2024-02-07T12:25:34.462 INFO:tasks.workunit.client.1.smithi138.stdout:0/517: dwrite d4/d9/de/d1d/d21/f4e [0,4194304] 0 2024-02-07T12:25:34.468 INFO:tasks.workunit.client.1.smithi138.stdout:8/688: dread d1/de/db4/db8/f1d [0,4194304] 0 2024-02-07T12:25:34.468 INFO:tasks.workunit.client.1.smithi138.stdout:8/689: chown d1/de/db4/db8/d17/d58 135858 1 2024-02-07T12:25:34.468 INFO:tasks.workunit.client.1.smithi138.stdout:1/444: write d5/d8/da/d1f/d27/f8f [882411,58172] 0 2024-02-07T12:25:34.469 INFO:tasks.workunit.client.1.smithi138.stdout:1/445: creat d5/d4b/d91/f9f x:0 0 0 2024-02-07T12:25:34.470 INFO:tasks.workunit.client.1.smithi138.stdout:9/445: link d0/d6/d8/d1d/dd/l2e d0/d34/d45/d78/l87 0 2024-02-07T12:25:34.472 INFO:tasks.workunit.client.1.smithi138.stdout:6/497: dwrite dc/d31/d3f/f41 [0,4194304] 0 2024-02-07T12:25:34.473 INFO:tasks.workunit.client.1.smithi138.stdout:9/446: dread d0/d6/d8/d1d/f61 [0,4194304] 0 2024-02-07T12:25:34.474 INFO:tasks.workunit.client.1.smithi138.stdout:3/641: sync 2024-02-07T12:25:34.477 INFO:tasks.workunit.client.1.smithi138.stdout:0/518: dread d4/d9/de/d1d/d77/f88 [0,4194304] 0 2024-02-07T12:25:34.478 INFO:tasks.workunit.client.1.smithi138.stdout:7/681: dwrite d0/d6/d1d/d38/f8d [0,4194304] 0 2024-02-07T12:25:34.478 INFO:tasks.workunit.client.1.smithi138.stdout:7/682: truncate d0/d8/d15/f18 3045513 0 2024-02-07T12:25:34.481 INFO:tasks.workunit.client.1.smithi138.stdout:1/446: stat d5/d4b/d72/l89 0 2024-02-07T12:25:34.485 INFO:tasks.workunit.client.1.smithi138.stdout:6/498: link dc/d13/d1e/c21 dc/d13/d8e/ca3 0 2024-02-07T12:25:34.486 INFO:tasks.workunit.client.1.smithi138.stdout:3/642: mkdir d5/d26/d5e/d77/de3 0 2024-02-07T12:25:34.486 INFO:tasks.workunit.client.1.smithi138.stdout:3/643: stat d5/d26/d90/la8 0 2024-02-07T12:25:34.486 INFO:tasks.workunit.client.1.smithi138.stdout:3/644: chown d5/d27/d35/lb3 4170198 1 2024-02-07T12:25:34.486 INFO:tasks.workunit.client.1.smithi138.stdout:3/645: dread - d5/d15/f85 zero size 2024-02-07T12:25:34.486 INFO:tasks.workunit.client.1.smithi138.stdout:3/646: chown d5/d34/f8f 57 1 2024-02-07T12:25:34.488 INFO:tasks.workunit.client.1.smithi138.stdout:0/519: dread d4/d9/db/d39/f50 [0,4194304] 0 2024-02-07T12:25:34.497 INFO:tasks.workunit.client.1.smithi138.stdout:8/690: dwrite d1/de/db4/db8/d17/d2e/d3a/f98 [4194304,4194304] 0 2024-02-07T12:25:34.497 INFO:tasks.workunit.client.1.smithi138.stdout:9/447: dwrite d0/d34/d45/f69 [0,4194304] 0 2024-02-07T12:25:34.497 INFO:tasks.workunit.client.1.smithi138.stdout:8/691: chown d1/de/db4/db8/d17/d3e/f5a 397403538 1 2024-02-07T12:25:34.505 INFO:tasks.workunit.client.1.smithi138.stdout:1/447: fdatasync d5/d8/f14 0 2024-02-07T12:25:34.505 INFO:tasks.workunit.client.1.smithi138.stdout:1/448: dread - d5/d4b/d91/f9f zero size 2024-02-07T12:25:34.508 INFO:tasks.workunit.client.1.smithi138.stdout:9/448: dread d0/d6/d8/d1d/dd/f20 [0,4194304] 0 2024-02-07T12:25:34.513 INFO:tasks.workunit.client.1.smithi138.stdout:1/449: getdents d5/d8/da/d1f/d27/d68/d73 0 2024-02-07T12:25:34.515 INFO:tasks.workunit.client.1.smithi138.stdout:9/449: stat d0/d34/d45/d78/l87 0 2024-02-07T12:25:34.515 INFO:tasks.workunit.client.1.smithi138.stdout:9/450: creat d0/d34/d45/f88 x:0 0 0 2024-02-07T12:25:34.517 INFO:tasks.workunit.client.1.smithi138.stdout:1/450: truncate d5/d8/da/f1d 4122638 0 2024-02-07T12:25:34.520 INFO:tasks.workunit.client.1.smithi138.stdout:9/451: getdents d0/d6/d8 0 2024-02-07T12:25:34.521 INFO:tasks.workunit.client.1.smithi138.stdout:1/451: truncate d5/d8/da/d1f/d27/d68/d73/d7b/f4e 2859208 0 2024-02-07T12:25:34.522 INFO:tasks.workunit.client.1.smithi138.stdout:1/452: chown d5/d8/da/c50 335 1 2024-02-07T12:25:34.522 INFO:tasks.workunit.client.1.smithi138.stdout:6/499: dwrite dc/d13/d1e/f8c [0,4194304] 0 2024-02-07T12:25:34.523 INFO:tasks.workunit.client.1.smithi138.stdout:3/647: dwrite d5/d27/d35/f91 [0,4194304] 0 2024-02-07T12:25:34.524 INFO:tasks.workunit.client.1.smithi138.stdout:1/453: symlink d5/d4b/la0 0 2024-02-07T12:25:34.524 INFO:tasks.workunit.client.1.smithi138.stdout:1/454: chown d5/d8/da/d1f/d3c/d59/f78 6848803 1 2024-02-07T12:25:34.525 INFO:tasks.workunit.client.1.smithi138.stdout:1/455: read d5/d8/da/d1f/d27/f7f [4279992,103130] 0 2024-02-07T12:25:34.526 INFO:tasks.workunit.client.1.smithi138.stdout:7/683: dwrite d0/d8/d11/d26/d90/f9e [0,4194304] 0 2024-02-07T12:25:34.527 INFO:tasks.workunit.client.1.smithi138.stdout:1/456: creat d5/d8/da/d1f/d3c/fa1 x:0 0 0 2024-02-07T12:25:34.527 INFO:tasks.workunit.client.1.smithi138.stdout:1/457: chown d5/d8/da/f11 32 1 2024-02-07T12:25:34.527 INFO:tasks.workunit.client.1.smithi138.stdout:1/458: readlink d5/d5b/l83 0 2024-02-07T12:25:34.529 INFO:tasks.workunit.client.1.smithi138.stdout:7/684: truncate d0/d8/d15/fc0 1463949 0 2024-02-07T12:25:34.530 INFO:tasks.workunit.client.1.smithi138.stdout:1/459: mknod d5/d8/da/d1f/d5e/ca2 0 2024-02-07T12:25:34.532 INFO:tasks.workunit.client.1.smithi138.stdout:7/685: chown d0/d8/d11/d26/d90/l83 0 1 2024-02-07T12:25:34.532 INFO:tasks.workunit.client.1.smithi138.stdout:7/686: stat d0/d8/d11/d5f/d86/f9d 0 2024-02-07T12:25:34.532 INFO:tasks.workunit.client.1.smithi138.stdout:7/687: dread - d0/d6/d76/fa5 zero size 2024-02-07T12:25:34.533 INFO:tasks.workunit.client.1.smithi138.stdout:1/460: chown d5/d8/f35 96 1 2024-02-07T12:25:34.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:34 smithi138 ceph-mon[35528]: Deploying cephadm binary to smithi138 2024-02-07T12:25:34.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:34 smithi138 ceph-mon[35528]: Deploying cephadm binary to smithi047 2024-02-07T12:25:34.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:34 smithi138 ceph-mon[35528]: mgrmap e22: smithi138.fiugmj(active, since 1.00795s) 2024-02-07T12:25:34.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:34 smithi138 ceph-mon[35528]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:34.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:34 smithi138 ceph-mon[35528]: pgmap v3: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail 2024-02-07T12:25:34.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:34 smithi138 ceph-mon[35528]: [07/Feb/2024:12:25:33] ENGINE Bus STARTING 2024-02-07T12:25:34.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:34 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3233256280' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:25:34.536 INFO:tasks.workunit.client.1.smithi138.stdout:7/688: rename d0/d8/d11/d1f/fc3 to d0/d6/fe4 0 2024-02-07T12:25:34.536 INFO:tasks.workunit.client.1.smithi138.stdout:3/648: write d5/d15/fc6 [4002731,4028] 0 2024-02-07T12:25:34.537 INFO:tasks.workunit.client.1.smithi138.stdout:7/689: symlink d0/d6/le5 0 2024-02-07T12:25:34.539 INFO:tasks.workunit.client.1.smithi138.stdout:0/520: dwrite d4/d9/f11 [4194304,4194304] 0 2024-02-07T12:25:34.541 INFO:tasks.workunit.client.1.smithi138.stdout:3/649: creat d5/d26/d28/fe4 x:0 0 0 2024-02-07T12:25:34.542 INFO:tasks.workunit.client.1.smithi138.stdout:0/521: mkdir d4/d9/d37/d3d/d9c/dad 0 2024-02-07T12:25:34.542 INFO:tasks.workunit.client.1.smithi138.stdout:0/522: getdents d4/d52 0 2024-02-07T12:25:34.544 INFO:tasks.workunit.client.1.smithi138.stdout:3/650: creat d5/d27/d35/d7c/fe5 x:0 0 0 2024-02-07T12:25:34.544 INFO:tasks.workunit.client.1.smithi138.stdout:0/523: dread d4/f4d [0,4194304] 0 2024-02-07T12:25:34.544 INFO:tasks.workunit.client.1.smithi138.stdout:0/524: write d4/d9/de/f72 [354334,107291] 0 2024-02-07T12:25:34.544 INFO:tasks.workunit.client.1.smithi138.stdout:0/525: dread - d4/d9/d37/d6b/f91 zero size 2024-02-07T12:25:34.546 INFO:tasks.workunit.client.1.smithi138.stdout:3/651: symlink d5/d26/d5e/d86/dae/dc1/le6 0 2024-02-07T12:25:34.546 INFO:tasks.workunit.client.1.smithi138.stdout:3/652: write d5/fd [973796,7238] 0 2024-02-07T12:25:34.546 INFO:tasks.workunit.client.1.smithi138.stdout:3/653: fdatasync d5/d15/d32/da1/fdc 0 2024-02-07T12:25:34.546 INFO:tasks.workunit.client.1.smithi138.stdout:3/654: readlink d5/d26/d90/la8 0 2024-02-07T12:25:34.547 INFO:tasks.workunit.client.1.smithi138.stdout:8/692: dwrite d1/de/db4/db8/f1e [0,4194304] 0 2024-02-07T12:25:34.549 INFO:tasks.workunit.client.1.smithi138.stdout:9/452: dwrite d0/f6f [0,4194304] 0 2024-02-07T12:25:34.549 INFO:tasks.workunit.client.1.smithi138.stdout:6/500: dwrite dc/d31/d54/f5c [0,4194304] 0 2024-02-07T12:25:34.549 INFO:tasks.workunit.client.1.smithi138.stdout:6/501: read dc/d13/d1e/f2b [1960493,56428] 0 2024-02-07T12:25:34.549 INFO:tasks.workunit.client.1.smithi138.stdout:8/693: truncate d1/de/db4/db8/d17/d2e/f52 1235354 0 2024-02-07T12:25:34.552 INFO:tasks.workunit.client.1.smithi138.stdout:9/453: dread d0/f7e [4194304,4194304] 0 2024-02-07T12:25:34.552 INFO:tasks.workunit.client.1.smithi138.stdout:9/454: getdents d0/d6/d8 0 2024-02-07T12:25:34.562 INFO:tasks.workunit.client.1.smithi138.stdout:6/502: symlink dc/d31/d38/d9a/la4 0 2024-02-07T12:25:34.562 INFO:tasks.workunit.client.1.smithi138.stdout:6/503: readlink dc/d31/d54/l6a 0 2024-02-07T12:25:34.562 INFO:tasks.workunit.client.1.smithi138.stdout:6/504: readlink dc/d13/l68 0 2024-02-07T12:25:34.563 INFO:tasks.workunit.client.1.smithi138.stdout:8/694: creat d1/de/db4/db8/d17/d3e/d72/fd1 x:0 0 0 2024-02-07T12:25:34.564 INFO:tasks.workunit.client.1.smithi138.stdout:9/455: creat d0/d34/d86/f89 x:0 0 0 2024-02-07T12:25:34.566 INFO:tasks.workunit.client.1.smithi138.stdout:6/505: rename dc/d13/d1e/d35/f93 to dc/d73/d9b/fa5 0 2024-02-07T12:25:34.568 INFO:tasks.workunit.client.1.smithi138.stdout:8/695: mkdir d1/de/db4/db8/dd2 0 2024-02-07T12:25:34.568 INFO:tasks.workunit.client.1.smithi138.stdout:7/690: dwrite d0/d8/d11/d63/f89 [0,4194304] 0 2024-02-07T12:25:34.568 INFO:tasks.workunit.client.1.smithi138.stdout:1/461: dwrite d5/d8/da/d1f/f96 [0,4194304] 0 2024-02-07T12:25:34.568 INFO:tasks.workunit.client.1.smithi138.stdout:0/526: dwrite d4/d52/fa0 [0,4194304] 0 2024-02-07T12:25:34.568 INFO:tasks.workunit.client.1.smithi138.stdout:0/527: fsync d4/d9/d37/f60 0 2024-02-07T12:25:34.569 INFO:tasks.workunit.client.1.smithi138.stdout:9/456: symlink d0/d6/d8/l8a 0 2024-02-07T12:25:34.571 INFO:tasks.workunit.client.1.smithi138.stdout:0/528: dread d4/d9/d37/d6b/d7f/f82 [0,4194304] 0 2024-02-07T12:25:34.571 INFO:tasks.workunit.client.1.smithi138.stdout:6/506: mkdir dc/d13/d1e/d35/d6d/da6 0 2024-02-07T12:25:34.571 INFO:tasks.workunit.client.1.smithi138.stdout:6/507: write dc/d73/d9b/fa5 [270832,53373] 0 2024-02-07T12:25:34.571 INFO:tasks.workunit.client.1.smithi138.stdout:6/508: chown dc/d31/d3f 494036850 1 2024-02-07T12:25:34.573 INFO:tasks.workunit.client.1.smithi138.stdout:8/696: mkdir d1/de/db4/db8/dd3 0 2024-02-07T12:25:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:34 smithi047 ceph-mon[28972]: Deploying cephadm binary to smithi138 2024-02-07T12:25:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:34 smithi047 ceph-mon[28972]: Deploying cephadm binary to smithi047 2024-02-07T12:25:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:34 smithi047 ceph-mon[28972]: mgrmap e22: smithi138.fiugmj(active, since 1.00795s) 2024-02-07T12:25:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:34 smithi047 ceph-mon[28972]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:34 smithi047 ceph-mon[28972]: pgmap v3: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail 2024-02-07T12:25:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:34 smithi047 ceph-mon[28972]: [07/Feb/2024:12:25:33] ENGINE Bus STARTING 2024-02-07T12:25:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:34 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3233256280' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:25:34.578 INFO:tasks.workunit.client.1.smithi138.stdout:7/691: unlink d0/d39/fa4 0 2024-02-07T12:25:34.580 INFO:tasks.workunit.client.1.smithi138.stdout:6/509: dread dc/d31/d3f/f41 [0,4194304] 0 2024-02-07T12:25:34.580 INFO:tasks.workunit.client.1.smithi138.stdout:6/510: stat dc/d13/d1e/d35/d85/d88/fa1 0 2024-02-07T12:25:34.582 INFO:tasks.workunit.client.1.smithi138.stdout:1/462: symlink d5/d4b/d6b/d6e/la3 0 2024-02-07T12:25:34.585 INFO:tasks.workunit.client.1.smithi138.stdout:3/655: truncate d5/d27/f29 42499 0 2024-02-07T12:25:34.585 INFO:tasks.workunit.client.1.smithi138.stdout:3/656: dread - d5/d15/d32/da1/fd9 zero size 2024-02-07T12:25:34.588 INFO:tasks.workunit.client.1.smithi138.stdout:0/529: link d4/d9/db/d39/f50 d4/d9/d37/fae 0 2024-02-07T12:25:34.591 INFO:tasks.workunit.client.1.smithi138.stdout:8/697: rename d1/de/db4/db8/d17/d58/cad to d1/de/db4/cd4 0 2024-02-07T12:25:34.592 INFO:tasks.workunit.client.1.smithi138.stdout:7/692: getdents d0/d8 0 2024-02-07T12:25:34.593 INFO:tasks.workunit.client.1.smithi138.stdout:1/463: symlink d5/la4 0 2024-02-07T12:25:34.597 INFO:tasks.workunit.client.1.smithi138.stdout:6/511: dwrite dc/d13/d1e/d24/f3c [4194304,4194304] 0 2024-02-07T12:25:34.597 INFO:tasks.workunit.client.1.smithi138.stdout:7/693: dread d0/f2 [0,4194304] 0 2024-02-07T12:25:34.597 INFO:tasks.workunit.client.1.smithi138.stdout:7/694: write d0/fd6 [313791,80517] 0 2024-02-07T12:25:34.598 INFO:tasks.workunit.client.1.smithi138.stdout:1/464: mkdir d5/d5c/da5 0 2024-02-07T12:25:34.599 INFO:tasks.workunit.client.1.smithi138.stdout:0/530: rmdir d4/d69/d85/d8a 39 2024-02-07T12:25:34.601 INFO:tasks.workunit.client.1.smithi138.stdout:0/531: read d4/d9/de/d1d/d21/f59 [200286,5386] 0 2024-02-07T12:25:34.602 INFO:tasks.workunit.client.1.smithi138.stdout:6/512: getdents dc/d31/d3f 0 2024-02-07T12:25:34.602 INFO:tasks.workunit.client.1.smithi138.stdout:6/513: readlink dc/l66 0 2024-02-07T12:25:34.603 INFO:tasks.workunit.client.1.smithi138.stdout:8/698: rmdir d1/de/db4/db8/d17/d3e/d89 39 2024-02-07T12:25:34.605 INFO:tasks.workunit.client.1.smithi138.stdout:1/465: creat d5/d4b/d65/fa6 x:0 0 0 2024-02-07T12:25:34.605 INFO:tasks.workunit.client.1.smithi138.stdout:1/466: fsync d5/f1a 0 2024-02-07T12:25:34.605 INFO:tasks.workunit.client.1.smithi138.stdout:7/695: write d0/d6/f12 [1407899,111858] 0 2024-02-07T12:25:34.606 INFO:tasks.workunit.client.1.smithi138.stdout:6/514: symlink dc/d13/d1e/d35/d6d/la7 0 2024-02-07T12:25:34.608 INFO:tasks.workunit.client.1.smithi138.stdout:8/699: rename d1/de/db4/db8/d17/d2e/d49/d4c/f9a to d1/de/db4/db8/d17/d8a/db6/fd5 0 2024-02-07T12:25:34.609 INFO:tasks.workunit.client.1.smithi138.stdout:1/467: mkdir d5/d8/da/d1f/d27/d68/da7 0 2024-02-07T12:25:34.609 INFO:tasks.workunit.client.1.smithi138.stdout:0/532: dread d4/d9/de/d1d/f41 [0,4194304] 0 2024-02-07T12:25:34.611 INFO:tasks.workunit.client.1.smithi138.stdout:7/696: creat d0/d8/d11/d26/d90/d98/da6/fe6 x:0 0 0 2024-02-07T12:25:34.613 INFO:tasks.workunit.client.1.smithi138.stdout:6/515: unlink dc/d13/d1e/d24/c74 0 2024-02-07T12:25:34.613 INFO:tasks.workunit.client.1.smithi138.stdout:6/516: creat dc/d13/d1e/d35/d6d/fa8 x:0 0 0 2024-02-07T12:25:34.613 INFO:tasks.workunit.client.1.smithi138.stdout:6/517: dread - dc/d31/f7a zero size 2024-02-07T12:25:34.613 INFO:tasks.workunit.client.1.smithi138.stdout:6/518: fsync dc/d13/f80 0 2024-02-07T12:25:34.613 INFO:tasks.workunit.client.1.smithi138.stdout:6/519: dread - dc/d31/f48 zero size 2024-02-07T12:25:34.614 INFO:tasks.workunit.client.1.smithi138.stdout:8/700: truncate d1/de/db4/db8/d17/d2e/d3a/f98 1093487 0 2024-02-07T12:25:34.614 INFO:tasks.workunit.client.1.smithi138.stdout:8/701: chown d1/de/db4/db8/d17/d2e/d49/c87 1 1 2024-02-07T12:25:34.614 INFO:tasks.workunit.client.1.smithi138.stdout:8/702: readlink d1/de/db4/db8/l14 0 2024-02-07T12:25:34.614 INFO:tasks.workunit.client.1.smithi138.stdout:8/703: write d1/de/db4/db8/d17/d58/f97 [5105860,129033] 0 2024-02-07T12:25:34.614 INFO:tasks.workunit.client.1.smithi138.stdout:8/704: dread - d1/de/db4/db8/d17/d2e/d49/fbe zero size 2024-02-07T12:25:34.615 INFO:tasks.workunit.client.1.smithi138.stdout:1/468: creat d5/d8/da/d1f/d60/fa8 x:0 0 0 2024-02-07T12:25:34.616 INFO:tasks.workunit.client.1.smithi138.stdout:0/533: dread d4/d9/de/f1c [0,4194304] 0 2024-02-07T12:25:34.620 INFO:tasks.workunit.client.1.smithi138.stdout:6/520: creat dc/d31/d38/d9a/fa9 x:0 0 0 2024-02-07T12:25:34.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.618+0000 7f75f5b89700 1 -- 172.21.15.47:0/2148620792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f75f010c010 con 0x7f75f006f840 2024-02-07T12:25:34.621 INFO:tasks.workunit.client.1.smithi138.stdout:6/521: read dc/d13/d1e/d35/d6d/f6e [316796,71253] 0 2024-02-07T12:25:34.622 INFO:tasks.workunit.client.1.smithi138.stdout:6/522: truncate dc/d13/d1e/d35/d6d/f7d 581369 0 2024-02-07T12:25:34.622 INFO:tasks.workunit.client.1.smithi138.stdout:6/523: stat fb 0 2024-02-07T12:25:34.622 INFO:tasks.workunit.client.1.smithi138.stdout:6/524: write dc/d13/d1e/d35/f46 [2739731,14047] 0 2024-02-07T12:25:34.622 INFO:tasks.workunit.client.1.smithi138.stdout:8/705: creat d1/de/db4/db8/d17/d8a/d8d/fd6 x:0 0 0 2024-02-07T12:25:34.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.619+0000 7f75d7fff700 1 -- 172.21.15.47:0/2148620792 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f75e001be60 con 0x7f75f006f840 2024-02-07T12:25:34.623 INFO:teuthology.orchestra.run.smithi047.stdout:e19 2024-02-07T12:25:34.623 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:25:34.623 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:25:34.623 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:25:34.623 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:25:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:25:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:25:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 19 2024-02-07T12:25:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:25:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:25:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:24:57.983373+0000 2024-02-07T12:25:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:25:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:25:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:25:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:25:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:25:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:25:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 export targets 1 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:25:34.625 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:25:34.626 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:25:34.626 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:25:34.626 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:25:34.626 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:25:34.627 INFO:tasks.workunit.client.1.smithi138.stdout:0/534: rename d4/d9/de/d1d/d8c/fa3 to d4/d9/db/d39/d4b/d6c/faf 0 2024-02-07T12:25:34.627 INFO:tasks.workunit.client.1.smithi138.stdout:0/535: truncate d4/d69/d85/d8a/f9f 173250 0 2024-02-07T12:25:34.627 INFO:tasks.workunit.client.1.smithi138.stdout:8/706: read d1/de/db4/db8/d17/d3e/d72/d95/f9d [3425386,63798] 0 2024-02-07T12:25:34.627 INFO:tasks.workunit.client.1.smithi138.stdout:7/697: rmdir d0/d8/db3 39 2024-02-07T12:25:34.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.622+0000 7f75f5b89700 1 -- 172.21.15.47:0/2148620792 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f75d80386a0 msgr2=0x7f75d803ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.622+0000 7f75f5b89700 1 --2- 172.21.15.47:0/2148620792 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f75d80386a0 0x7f75d803ab50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f75e4004990 tx=0x7f75e4009e20 comp rx=0 tx=0).stop 2024-02-07T12:25:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.622+0000 7f75f5b89700 1 -- 172.21.15.47:0/2148620792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75f006f840 msgr2=0x7f75f011ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.622+0000 7f75f5b89700 1 --2- 172.21.15.47:0/2148620792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75f006f840 0x7f75f011ddf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f75e0000c00 tx=0x7f75e0009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.622+0000 7f75f5b89700 1 -- 172.21.15.47:0/2148620792 shutdown_connections 2024-02-07T12:25:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.622+0000 7f75f5b89700 1 --2- 172.21.15.47:0/2148620792 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f75d80386a0 0x7f75d803ab50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.622+0000 7f75f5b89700 1 --2- 172.21.15.47:0/2148620792 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75f00fb870 0x7f75f006f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.622+0000 7f75f5b89700 1 --2- 172.21.15.47:0/2148620792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75f006f840 0x7f75f011ddf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.622+0000 7f75f5b89700 1 -- 172.21.15.47:0/2148620792 >> 172.21.15.47:0/2148620792 conn(0x7f75f00f74e0 msgr2=0x7f75f00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.622+0000 7f75f5b89700 1 -- 172.21.15.47:0/2148620792 shutdown_connections 2024-02-07T12:25:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.622+0000 7f75f5b89700 1 -- 172.21.15.47:0/2148620792 wait complete. 2024-02-07T12:25:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-02-07T12:25:34.629 INFO:tasks.workunit.client.1.smithi138.stdout:5/530: sync 2024-02-07T12:25:34.629 INFO:tasks.workunit.client.1.smithi138.stdout:2/622: sync 2024-02-07T12:25:34.629 INFO:tasks.workunit.client.1.smithi138.stdout:4/507: sync 2024-02-07T12:25:34.629 INFO:tasks.workunit.client.1.smithi138.stdout:3/657: write d5/d27/f29 [468851,43591] 0 2024-02-07T12:25:34.629 INFO:tasks.workunit.client.1.smithi138.stdout:5/531: dread - da/d6d/d27/d2e/d4f/d2b/d59/d96/f8a zero size 2024-02-07T12:25:34.629 INFO:tasks.workunit.client.1.smithi138.stdout:4/508: chown d20/d34/d59/d88/f91 1441 1 2024-02-07T12:25:34.630 INFO:tasks.workunit.client.1.smithi138.stdout:3/658: truncate d5/d26/d9b/dab/dc4/dc7/fe1 794047 0 2024-02-07T12:25:34.630 INFO:tasks.workunit.client.1.smithi138.stdout:3/659: write d5/d26/d5e/f8a [101993,21592] 0 2024-02-07T12:25:34.630 INFO:tasks.workunit.client.1.smithi138.stdout:6/525: dread dc/d13/d1e/d4d/f9c [0,4194304] 0 2024-02-07T12:25:34.630 INFO:tasks.workunit.client.1.smithi138.stdout:6/526: write dc/d31/d54/f8f [930486,126865] 0 2024-02-07T12:25:34.631 INFO:tasks.workunit.client.1.smithi138.stdout:0/536: mkdir d4/d9/d37/d64/d9a/db0 0 2024-02-07T12:25:34.631 INFO:tasks.workunit.client.1.smithi138.stdout:0/537: fdatasync d4/d9/de/f45 0 2024-02-07T12:25:34.632 INFO:tasks.workunit.client.1.smithi138.stdout:8/707: mkdir d1/de/db4/db8/d17/d8a/dd7 0 2024-02-07T12:25:34.635 INFO:tasks.workunit.client.1.smithi138.stdout:7/698: rename d0/d6/d3e/f48 to d0/d6/d1d/fe7 0 2024-02-07T12:25:34.635 INFO:tasks.workunit.client.1.smithi138.stdout:7/699: stat d0/d8/d11/d5f/l9f 0 2024-02-07T12:25:34.637 INFO:tasks.workunit.client.1.smithi138.stdout:5/532: mkdir da/d6d/d27/d2e/d4f/d2b/d35/dae 0 2024-02-07T12:25:34.638 INFO:tasks.workunit.client.1.smithi138.stdout:8/708: dread d1/de/db4/db8/d17/f25 [0,4194304] 0 2024-02-07T12:25:34.638 INFO:tasks.workunit.client.1.smithi138.stdout:2/623: dread d3/dd/d14/d49/d25/fcd [0,4194304] 0 2024-02-07T12:25:34.638 INFO:tasks.workunit.client.1.smithi138.stdout:2/624: truncate d3/dd/d19/f15 8917670 0 2024-02-07T12:25:34.639 INFO:tasks.workunit.client.1.smithi138.stdout:4/509: unlink d20/d47/c66 0 2024-02-07T12:25:34.639 INFO:tasks.workunit.client.1.smithi138.stdout:4/510: chown f1c 636213 1 2024-02-07T12:25:34.639 INFO:tasks.workunit.client.1.smithi138.stdout:4/511: chown d20/d4d/f99 166723573 1 2024-02-07T12:25:34.640 INFO:tasks.workunit.client.1.smithi138.stdout:6/527: mkdir dc/d31/d38/d9a/daa 0 2024-02-07T12:25:34.640 INFO:tasks.workunit.client.1.smithi138.stdout:6/528: creat dc/d73/d9b/fab x:0 0 0 2024-02-07T12:25:34.641 INFO:tasks.workunit.client.1.smithi138.stdout:0/538: getdents d4/d69/d85 0 2024-02-07T12:25:34.644 INFO:tasks.workunit.client.1.smithi138.stdout:0/539: write d4/d9/db/d39/d4b/d6c/f80 [733791,45025] 0 2024-02-07T12:25:34.645 INFO:tasks.workunit.client.1.smithi138.stdout:7/700: unlink d0/d8/f87 0 2024-02-07T12:25:34.648 INFO:tasks.workunit.client.1.smithi138.stdout:3/660: dwrite d5/d26/d9b/fb9 [0,4194304] 0 2024-02-07T12:25:34.649 INFO:tasks.workunit.client.1.smithi138.stdout:8/709: creat d1/de/db4/db8/d17/d3e/dce/fd8 x:0 0 0 2024-02-07T12:25:34.651 INFO:tasks.workunit.client.1.smithi138.stdout:5/533: dread da/d50/f56 [0,4194304] 0 2024-02-07T12:25:34.651 INFO:tasks.workunit.client.1.smithi138.stdout:2/625: unlink d3/dd/d19/d44/d7d/d97/lb7 0 2024-02-07T12:25:34.654 INFO:tasks.workunit.client.1.smithi138.stdout:6/529: mknod dc/d73/cac 0 2024-02-07T12:25:34.657 INFO:tasks.workunit.client.1.smithi138.stdout:0/540: rename d4/d9/f3e to d4/d52/d74/fb1 0 2024-02-07T12:25:34.657 INFO:tasks.workunit.client.1.smithi138.stdout:0/541: write d4/d9/de/d1d/f49 [5129761,20709] 0 2024-02-07T12:25:34.657 INFO:tasks.workunit.client.1.smithi138.stdout:0/542: write d4/d9/db/fa8 [278395,80800] 0 2024-02-07T12:25:34.659 INFO:tasks.workunit.client.1.smithi138.stdout:7/701: mkdir d0/d6/d19/de8 0 2024-02-07T12:25:34.659 INFO:tasks.workunit.client.1.smithi138.stdout:7/702: chown d0/d8/d11/d26/lb5 2 1 2024-02-07T12:25:34.664 INFO:tasks.workunit.client.1.smithi138.stdout:5/534: dread da/d6d/d27/d2e/d4f/d2b/d35/d5d/fa5 [0,4194304] 0 2024-02-07T12:25:34.665 INFO:tasks.workunit.client.1.smithi138.stdout:3/661: creat d5/d15/fe7 x:0 0 0 2024-02-07T12:25:34.665 INFO:tasks.workunit.client.1.smithi138.stdout:3/662: chown d5/d26 5694892 1 2024-02-07T12:25:34.665 INFO:tasks.workunit.client.1.smithi138.stdout:8/710: symlink d1/de/db4/db8/d17/d2e/d49/dcf/ld9 0 2024-02-07T12:25:34.665 INFO:tasks.workunit.client.1.smithi138.stdout:8/711: chown d1/de/db4/db8/d96/la3 9 1 2024-02-07T12:25:34.665 INFO:tasks.workunit.client.1.smithi138.stdout:2/626: mkdir d3/dd/d19/d44/de8 0 2024-02-07T12:25:34.665 INFO:tasks.workunit.client.1.smithi138.stdout:6/530: dread f6 [0,4194304] 0 2024-02-07T12:25:34.665 INFO:tasks.workunit.client.1.smithi138.stdout:6/531: dread - dc/d31/f72 zero size 2024-02-07T12:25:34.666 INFO:tasks.workunit.client.1.smithi138.stdout:6/532: fdatasync dc/d13/d1e/d35/f4c 0 2024-02-07T12:25:34.666 INFO:tasks.workunit.client.1.smithi138.stdout:4/512: dwrite d20/d34/d36/f5f [0,4194304] 0 2024-02-07T12:25:34.667 INFO:tasks.workunit.client.1.smithi138.stdout:4/513: write d20/d34/d59/d72/d77/f97 [669699,51675] 0 2024-02-07T12:25:34.668 INFO:tasks.workunit.client.1.smithi138.stdout:3/663: creat d5/fe8 x:0 0 0 2024-02-07T12:25:34.671 INFO:tasks.workunit.client.1.smithi138.stdout:5/535: write f8 [9722257,31447] 0 2024-02-07T12:25:34.671 INFO:tasks.workunit.client.1.smithi138.stdout:2/627: unlink d3/f12 0 2024-02-07T12:25:34.678 INFO:tasks.workunit.client.1.smithi138.stdout:4/514: mknod d20/d34/d36/d55/ca4 0 2024-02-07T12:25:34.679 INFO:tasks.workunit.client.1.smithi138.stdout:0/543: dwrite d4/d52/d74/f99 [0,4194304] 0 2024-02-07T12:25:34.679 INFO:tasks.workunit.client.1.smithi138.stdout:3/664: mknod d5/d15/d32/ce9 0 2024-02-07T12:25:34.680 INFO:tasks.workunit.client.1.smithi138.stdout:7/703: rmdir d0/d6/d3e 39 2024-02-07T12:25:34.683 INFO:tasks.workunit.client.1.smithi138.stdout:5/536: symlink da/d6d/d27/d2e/d4f/d2b/d35/laf 0 2024-02-07T12:25:34.683 INFO:tasks.workunit.client.1.smithi138.stdout:5/537: truncate da/f24 2410697 0 2024-02-07T12:25:34.685 INFO:tasks.workunit.client.1.smithi138.stdout:2/628: creat d3/dd/d19/d44/d7d/d97/fe9 x:0 0 0 2024-02-07T12:25:34.685 INFO:tasks.workunit.client.1.smithi138.stdout:2/629: readlink d3/dd/d19/d44/d7d/ld6 0 2024-02-07T12:25:34.685 INFO:tasks.workunit.client.1.smithi138.stdout:2/630: write d3/dd/d19/d1f/d37/f3b [8583768,104754] 0 2024-02-07T12:25:34.685 INFO:tasks.workunit.client.1.smithi138.stdout:2/631: dread - d3/dd/d14/d49/d29/d5b/f9e zero size 2024-02-07T12:25:34.685 INFO:tasks.workunit.client.1.smithi138.stdout:2/632: chown d3/dd/d14/d8f/dbc/cd8 166 1 2024-02-07T12:25:34.686 INFO:tasks.workunit.client.1.smithi138.stdout:6/533: rmdir dc/d13/d1e/d24 39 2024-02-07T12:25:34.688 INFO:tasks.workunit.client.1.smithi138.stdout:3/665: dread d5/d26/f60 [0,4194304] 0 2024-02-07T12:25:34.688 INFO:tasks.workunit.client.1.smithi138.stdout:3/666: truncate d5/d15/f85 1045359 0 2024-02-07T12:25:34.688 INFO:tasks.workunit.client.1.smithi138.stdout:3/667: truncate d5/f20 5024573 0 2024-02-07T12:25:34.688 INFO:tasks.workunit.client.1.smithi138.stdout:4/515: symlink d20/d34/d59/d72/la5 0 2024-02-07T12:25:34.690 INFO:tasks.workunit.client.1.smithi138.stdout:3/668: read d5/d26/d28/f78 [432909,128636] 0 2024-02-07T12:25:34.690 INFO:tasks.workunit.client.1.smithi138.stdout:3/669: write d5/d15/f6d [8728115,51649] 0 2024-02-07T12:25:34.692 INFO:tasks.workunit.client.1.smithi138.stdout:0/544: getdents d4/d9/d37 0 2024-02-07T12:25:34.693 INFO:tasks.workunit.client.1.smithi138.stdout:7/704: mknod d0/d8/d11/d63/dc8/dce/ce9 0 2024-02-07T12:25:34.694 INFO:tasks.workunit.client.1.smithi138.stdout:3/670: read d5/d26/d9b/fb9 [3695700,16228] 0 2024-02-07T12:25:34.695 INFO:tasks.workunit.client.1.smithi138.stdout:7/705: dread d0/d8/d11/d26/d90/f36 [0,4194304] 0 2024-02-07T12:25:34.695 INFO:tasks.workunit.client.1.smithi138.stdout:7/706: fsync d0/d39/f52 0 2024-02-07T12:25:34.697 INFO:tasks.workunit.client.1.smithi138.stdout:6/534: unlink dc/d13/d1e/d4d/f5d 0 2024-02-07T12:25:34.699 INFO:tasks.workunit.client.1.smithi138.stdout:4/516: mknod d20/d34/d59/ca6 0 2024-02-07T12:25:34.699 INFO:tasks.workunit.client.1.smithi138.stdout:2/633: dwrite d3/dd/d19/d44/d7d/fe1 [0,4194304] 0 2024-02-07T12:25:34.699 INFO:tasks.workunit.client.1.smithi138.stdout:4/517: write d20/d53/f64 [253697,85983] 0 2024-02-07T12:25:34.699 INFO:tasks.workunit.client.1.smithi138.stdout:4/518: truncate d20/d34/d59/d72/d86/f92 573822 0 2024-02-07T12:25:34.700 INFO:tasks.workunit.client.1.smithi138.stdout:0/545: symlink d4/d52/lb2 0 2024-02-07T12:25:34.701 INFO:tasks.workunit.client.1.smithi138.stdout:3/671: truncate d5/d26/f2c 1250893 0 2024-02-07T12:25:34.701 INFO:tasks.workunit.client.1.smithi138.stdout:3/672: write d5/d26/d90/fa7 [882462,48583] 0 2024-02-07T12:25:34.702 INFO:tasks.workunit.client.1.smithi138.stdout:7/707: mkdir d0/d39/dea 0 2024-02-07T12:25:34.705 INFO:tasks.workunit.client.1.smithi138.stdout:8/712: rename d1/de/db4/db8/d17/d2e/d49 to d1/de/db4/db8/d17/d3e/d72/dda 0 2024-02-07T12:25:34.705 INFO:tasks.workunit.client.1.smithi138.stdout:8/713: readlink d1/de/db4/db8/d96/la3 0 2024-02-07T12:25:34.711 INFO:tasks.workunit.client.1.smithi138.stdout:2/634: symlink d3/dd/d19/lea 0 2024-02-07T12:25:34.712 INFO:tasks.workunit.client.1.smithi138.stdout:4/519: truncate d20/d47/d69/d76/f7a 2902633 0 2024-02-07T12:25:34.712 INFO:tasks.workunit.client.1.smithi138.stdout:4/520: write d20/f54 [849395,129806] 0 2024-02-07T12:25:34.712 INFO:tasks.workunit.client.1.smithi138.stdout:4/521: chown d20/d4d/d87/c8a 249597 1 2024-02-07T12:25:34.712 INFO:tasks.workunit.client.1.smithi138.stdout:0/546: read d4/d9/f22 [884736,28029] 0 2024-02-07T12:25:34.712 INFO:tasks.workunit.client.1.smithi138.stdout:3/673: truncate d5/d27/f3d 2280829 0 2024-02-07T12:25:34.715 INFO:tasks.workunit.client.1.smithi138.stdout:7/708: mkdir d0/d6/deb 0 2024-02-07T12:25:34.715 INFO:tasks.workunit.client.1.smithi138.stdout:6/535: dwrite f6 [0,4194304] 0 2024-02-07T12:25:34.716 INFO:tasks.workunit.client.1.smithi138.stdout:6/536: truncate dc/d31/d3f/f52 1111185 0 2024-02-07T12:25:34.716 INFO:tasks.workunit.client.1.smithi138.stdout:6/537: creat dc/d13/d1e/d35/d85/fad x:0 0 0 2024-02-07T12:25:34.720 INFO:tasks.workunit.client.1.smithi138.stdout:4/522: unlink f8 0 2024-02-07T12:25:34.720 INFO:tasks.workunit.client.1.smithi138.stdout:4/523: dread - d20/d34/d59/f6b zero size 2024-02-07T12:25:34.720 INFO:tasks.workunit.client.1.smithi138.stdout:3/674: creat d5/d26/d5e/d86/d9c/fea x:0 0 0 2024-02-07T12:25:34.721 INFO:tasks.workunit.client.1.smithi138.stdout:0/547: write d4/d9/db/d39/fa2 [3124796,17161] 0 2024-02-07T12:25:34.732 INFO:tasks.workunit.client.1.smithi138.stdout:6/538: dwrite dc/f4b [0,4194304] 0 2024-02-07T12:25:34.733 INFO:tasks.workunit.client.1.smithi138.stdout:7/709: symlink d0/d6/deb/lec 0 2024-02-07T12:25:34.737 INFO:tasks.workunit.client.1.smithi138.stdout:4/524: dwrite d20/f3d [0,4194304] 0 2024-02-07T12:25:34.739 INFO:tasks.workunit.client.1.smithi138.stdout:0/548: mknod d4/d69/cb3 0 2024-02-07T12:25:34.743 INFO:tasks.workunit.client.1.smithi138.stdout:6/539: mkdir dc/d13/d1e/dae 0 2024-02-07T12:25:34.745 INFO:tasks.workunit.client.1.smithi138.stdout:7/710: fsync d0/d8/d11/d26/d90/f37 0 2024-02-07T12:25:34.748 INFO:tasks.workunit.client.1.smithi138.stdout:5/538: rename da/d6d/d27/d2e/d4f/d2b/d59 to da/d6d/d27/d2e/d4f/d2b/d35/dae/db0 0 2024-02-07T12:25:34.749 INFO:tasks.workunit.client.1.smithi138.stdout:4/525: dwrite d20/d4d/f99 [0,4194304] 0 2024-02-07T12:25:34.750 INFO:tasks.workunit.client.1.smithi138.stdout:0/549: creat d4/d9/de/d1d/d21/fb4 x:0 0 0 2024-02-07T12:25:34.750 INFO:tasks.workunit.client.1.smithi138.stdout:0/550: fdatasync d4/d52/f2d 0 2024-02-07T12:25:34.751 INFO:tasks.workunit.client.1.smithi138.stdout:6/540: creat dc/d13/d8e/faf x:0 0 0 2024-02-07T12:25:34.753 INFO:tasks.workunit.client.1.smithi138.stdout:7/711: write d0/d8/d11/d26/d90/f85 [99674,10308] 0 2024-02-07T12:25:34.755 INFO:tasks.workunit.client.1.smithi138.stdout:5/539: link da/l52 da/d34/lb1 0 2024-02-07T12:25:34.755 INFO:tasks.workunit.client.1.smithi138.stdout:5/540: fsync da/d34/f80 0 2024-02-07T12:25:34.755 INFO:tasks.workunit.client.1.smithi138.stdout:5/541: chown da/d34/lb1 156452483 1 2024-02-07T12:25:34.755 INFO:tasks.workunit.client.1.smithi138.stdout:5/542: fdatasync da/d6d/d27/d2e/f79 0 2024-02-07T12:25:34.756 INFO:tasks.workunit.client.1.smithi138.stdout:2/635: rename d3/dd/d19/d1f/f47 to d3/dd/d14/d49/d29/feb 0 2024-02-07T12:25:34.756 INFO:tasks.workunit.client.1.smithi138.stdout:2/636: truncate d3/dd/d14/d49/d29/d5b/fba 1153633 0 2024-02-07T12:25:34.759 INFO:tasks.workunit.client.1.smithi138.stdout:4/526: symlink d20/d47/la7 0 2024-02-07T12:25:34.762 INFO:tasks.workunit.client.1.smithi138.stdout:4/527: write d20/f25 [215931,129129] 0 2024-02-07T12:25:34.776 INFO:tasks.workunit.client.1.smithi138.stdout:0/551: mkdir d4/d9/d37/d64/d9a/db0/db5 0 2024-02-07T12:25:34.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.777+0000 7fc5f2941700 1 -- 172.21.15.47:0/2730661994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5ec0fcef0 msgr2=0x7fc5ec0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:34.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.777+0000 7fc5f2941700 1 --2- 172.21.15.47:0/2730661994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5ec0fcef0 0x7fc5ec0fd320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc004940 tx=0x7fc5dc009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:34.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.777+0000 7fc5f2941700 1 -- 172.21.15.47:0/2730661994 shutdown_connections 2024-02-07T12:25:34.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.777+0000 7fc5f2941700 1 --2- 172.21.15.47:0/2730661994 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0fe0e0 0x7fc5ec0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:34.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.777+0000 7fc5f2941700 1 --2- 172.21.15.47:0/2730661994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5ec0fcef0 0x7fc5ec0fd320 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:34.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.777+0000 7fc5f2941700 1 -- 172.21.15.47:0/2730661994 >> 172.21.15.47:0/2730661994 conn(0x7fc5ec0f8620 msgr2=0x7fc5ec0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:34.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.777+0000 7fc5f2941700 1 -- 172.21.15.47:0/2730661994 shutdown_connections 2024-02-07T12:25:34.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.777+0000 7fc5f2941700 1 -- 172.21.15.47:0/2730661994 wait complete. 2024-02-07T12:25:34.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.778+0000 7fc5f2941700 1 Processor -- start 2024-02-07T12:25:34.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.778+0000 7fc5f2941700 1 -- start start 2024-02-07T12:25:34.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.778+0000 7fc5f2941700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5ec0fcef0 0x7fc5ec10d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:34.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.778+0000 7fc5f2941700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0fe0e0 0x7fc5ec10de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:34.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.778+0000 7fc5f2941700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec10e430 con 0x7fc5ec0fcef0 2024-02-07T12:25:34.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.778+0000 7fc5f2941700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec10ecd0 con 0x7fc5ec0fe0e0 2024-02-07T12:25:34.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.779+0000 7fc5ebfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5ec0fcef0 0x7fc5ec10d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:34.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.779+0000 7fc5ebfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5ec0fcef0 0x7fc5ec10d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40072/0 (socket says 172.21.15.47:40072) 2024-02-07T12:25:34.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.779+0000 7fc5ebfff700 1 -- 172.21.15.47:0/2681068826 learned_addr learned my addr 172.21.15.47:0/2681068826 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:25:34.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.779+0000 7fc5eb7fe700 1 --2- 172.21.15.47:0/2681068826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0fe0e0 0x7fc5ec10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:34.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.779+0000 7fc5ebfff700 1 -- 172.21.15.47:0/2681068826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0fe0e0 msgr2=0x7fc5ec10de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:34.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.779+0000 7fc5ebfff700 1 --2- 172.21.15.47:0/2681068826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0fe0e0 0x7fc5ec10de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:34.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.779+0000 7fc5ebfff700 1 -- 172.21.15.47:0/2681068826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc005040 con 0x7fc5ec0fcef0 2024-02-07T12:25:34.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.779+0000 7fc5ebfff700 1 --2- 172.21.15.47:0/2681068826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5ec0fcef0 0x7fc5ec10d8f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc007d40 tx=0x7fc5dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:34.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.779+0000 7fc5e8ff9700 1 -- 172.21.15.47:0/2681068826 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5dc021070 con 0x7fc5ec0fcef0 2024-02-07T12:25:34.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.780+0000 7fc5e8ff9700 1 -- 172.21.15.47:0/2681068826 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5dc01c400 con 0x7fc5ec0fcef0 2024-02-07T12:25:34.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.780+0000 7fc5f2941700 1 -- 172.21.15.47:0/2681068826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ec10ef50 con 0x7fc5ec0fcef0 2024-02-07T12:25:34.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.780+0000 7fc5e8ff9700 1 -- 172.21.15.47:0/2681068826 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5dc00e070 con 0x7fc5ec0fcef0 2024-02-07T12:25:34.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.780+0000 7fc5f2941700 1 -- 172.21.15.47:0/2681068826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ec10f430 con 0x7fc5ec0fcef0 2024-02-07T12:25:34.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.781+0000 7fc5e8ff9700 1 -- 172.21.15.47:0/2681068826 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) v1 ==== 45878+0+0 (secure 0 0 0) 0x7fc5dc00b650 con 0x7fc5ec0fcef0 2024-02-07T12:25:34.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.781+0000 7fc5e8ff9700 1 --2- 172.21.15.47:0/2681068826 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fc5d40389e0 0x7fc5d403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:34.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.781+0000 7fc5e8ff9700 1 -- 172.21.15.47:0/2681068826 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc5dc04d9a0 con 0x7fc5ec0fcef0 2024-02-07T12:25:34.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.781+0000 7fc5f2941700 1 -- 172.21.15.47:0/2681068826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ec04bed0 con 0x7fc5ec0fcef0 2024-02-07T12:25:34.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.782+0000 7fc5eb7fe700 1 --2- 172.21.15.47:0/2681068826 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fc5d40389e0 0x7fc5d403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:34.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.783+0000 7fc5eb7fe700 1 --2- 172.21.15.47:0/2681068826 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fc5d40389e0 0x7fc5d403ae90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0004600 tx=0x7fc5e000b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:34.787 INFO:tasks.workunit.client.1.smithi138.stdout:7/712: mkdir d0/d6/deb/ded 0 2024-02-07T12:25:34.787 INFO:tasks.workunit.client.1.smithi138.stdout:5/543: readlink da/l1e 0 2024-02-07T12:25:34.788 INFO:tasks.workunit.client.1.smithi138.stdout:5/544: write da/d6d/d27/d2e/d4f/f9c [388273,129880] 0 2024-02-07T12:25:34.788 INFO:tasks.workunit.client.1.smithi138.stdout:5/545: stat da/d6d/d27/d2e/d4f/d2b/d35/d5d/f70 0 2024-02-07T12:25:34.788 INFO:tasks.workunit.client.1.smithi138.stdout:3/675: rename d5/d26/d4e/f5a to d5/d27/dde/feb 0 2024-02-07T12:25:34.788 INFO:tasks.workunit.client.1.smithi138.stdout:3/676: truncate d5/d27/d35/f66 5304632 0 2024-02-07T12:25:34.788 INFO:tasks.workunit.client.1.smithi138.stdout:3/677: chown d5/d26/d9b/dab/dc4/dc7 64388059 1 2024-02-07T12:25:34.788 INFO:tasks.workunit.client.1.smithi138.stdout:2/637: fsync d3/dd/d14/d49/d29/feb 0 2024-02-07T12:25:34.788 INFO:tasks.workunit.client.1.smithi138.stdout:2/638: creat d3/d4e/fec x:0 0 0 2024-02-07T12:25:34.788 INFO:tasks.workunit.client.1.smithi138.stdout:2/639: dread d3/dd/d19/d1f/d37/f7c [0,4194304] 0 2024-02-07T12:25:34.788 INFO:tasks.workunit.client.1.smithi138.stdout:4/528: unlink d20/l2c 0 2024-02-07T12:25:34.789 INFO:tasks.workunit.client.1.smithi138.stdout:6/541: rmdir dc/d13/d1e/d35/d85 39 2024-02-07T12:25:34.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:34.789+0000 7fc5e8ff9700 1 -- 172.21.15.47:0/2681068826 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc5dc00ba40 con 0x7fc5ec0fcef0 2024-02-07T12:25:34.791 INFO:tasks.workunit.client.1.smithi138.stdout:7/713: truncate d0/d6/d3e/f3f 809716 0 2024-02-07T12:25:34.793 INFO:tasks.workunit.client.1.smithi138.stdout:5/546: unlink l6 0 2024-02-07T12:25:34.794 INFO:tasks.workunit.client.1.smithi138.stdout:5/547: truncate da/d6d/d27/d2e/f79 543471 0 2024-02-07T12:25:34.795 INFO:tasks.workunit.client.1.smithi138.stdout:4/529: dread d20/d4d/f99 [0,4194304] 0 2024-02-07T12:25:34.795 INFO:tasks.workunit.client.1.smithi138.stdout:4/530: chown d20/d34/d59/f6c 0 1 2024-02-07T12:25:34.795 INFO:tasks.workunit.client.1.smithi138.stdout:4/531: creat d20/d34/d59/fa8 x:0 0 0 2024-02-07T12:25:34.796 INFO:tasks.workunit.client.1.smithi138.stdout:4/532: write d20/d34/d36/d55/f7f [4654950,89187] 0 2024-02-07T12:25:34.796 INFO:tasks.workunit.client.1.smithi138.stdout:0/552: dwrite d4/d9/d37/d6b/d7f/f82 [0,4194304] 0 2024-02-07T12:25:34.796 INFO:tasks.workunit.client.1.smithi138.stdout:0/553: chown d4/d9/db/d39/d4b/d6c/d8f 190 1 2024-02-07T12:25:34.797 INFO:tasks.workunit.client.1.smithi138.stdout:7/714: write d0/d6/d76/d93/fbb [1796634,99883] 0 2024-02-07T12:25:34.797 INFO:tasks.workunit.client.1.smithi138.stdout:7/715: dread - d0/d6/d73/fd9 zero size 2024-02-07T12:25:34.800 INFO:tasks.workunit.client.1.smithi138.stdout:2/640: getdents d3/dd/d19/d1f/d46 0 2024-02-07T12:25:34.801 INFO:tasks.workunit.client.1.smithi138.stdout:6/542: rename dc/d31/d38/f3a to dc/d13/d1e/d35/fb0 0 2024-02-07T12:25:34.806 INFO:tasks.workunit.client.1.smithi138.stdout:5/548: link da/d22/d99/f9b da/d43/d4a/d95/fb2 0 2024-02-07T12:25:34.806 INFO:tasks.workunit.client.1.smithi138.stdout:5/549: creat da/d6d/d27/d2e/d4f/d2b/fb3 x:0 0 0 2024-02-07T12:25:34.806 INFO:tasks.workunit.client.1.smithi138.stdout:4/533: dread d20/d34/d36/f43 [0,4194304] 0 2024-02-07T12:25:34.807 INFO:tasks.workunit.client.1.smithi138.stdout:4/534: chown d20/d34/d59/d72/d77/f97 7838 1 2024-02-07T12:25:34.815 INFO:tasks.workunit.client.1.smithi138.stdout:0/554: dwrite d4/d9/db/f20 [0,4194304] 0 2024-02-07T12:25:34.818 INFO:tasks.workunit.client.1.smithi138.stdout:7/716: dwrite d0/d8/d11/d5f/f95 [0,4194304] 0 2024-02-07T12:25:34.819 INFO:tasks.workunit.client.1.smithi138.stdout:5/550: dread da/d43/d4a/d69/f7a [0,4194304] 0 2024-02-07T12:25:34.819 INFO:tasks.workunit.client.1.smithi138.stdout:5/551: chown da/d6d/f6b 4 1 2024-02-07T12:25:34.821 INFO:tasks.workunit.client.1.smithi138.stdout:3/678: mknod d5/cec 0 2024-02-07T12:25:34.823 INFO:tasks.workunit.client.1.smithi138.stdout:2/641: truncate d3/dd/d19/f42 565173 0 2024-02-07T12:25:34.823 INFO:tasks.workunit.client.1.smithi138.stdout:2/642: chown d3/dd/d14/d82/fa3 154990 1 2024-02-07T12:25:34.824 INFO:tasks.workunit.client.1.smithi138.stdout:6/543: symlink dc/d69/lb1 0 2024-02-07T12:25:34.824 INFO:tasks.workunit.client.1.smithi138.stdout:6/544: truncate dc/f77 1258187 0 2024-02-07T12:25:34.830 INFO:tasks.workunit.client.1.smithi138.stdout:4/535: rmdir d20/d34/d59/d72/d77/d7d 0 2024-02-07T12:25:34.834 INFO:tasks.workunit.client.1.smithi138.stdout:0/555: unlink d4/d9/db/d39/f94 0 2024-02-07T12:25:34.837 INFO:tasks.workunit.client.1.smithi138.stdout:7/717: symlink d0/d6/d1d/d38/lee 0 2024-02-07T12:25:34.838 INFO:tasks.workunit.client.1.smithi138.stdout:5/552: symlink da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d96/lb4 0 2024-02-07T12:25:34.839 INFO:tasks.workunit.client.1.smithi138.stdout:2/643: mknod d3/dd/d19/d1f/d37/ced 0 2024-02-07T12:25:34.839 INFO:tasks.workunit.client.1.smithi138.stdout:9/457: sync 2024-02-07T12:25:34.839 INFO:tasks.workunit.client.1.smithi138.stdout:9/458: chown d0/d6/d8 1 1 2024-02-07T12:25:34.841 INFO:tasks.workunit.client.1.smithi138.stdout:6/545: mkdir dc/d13/d1e/dae/db2 0 2024-02-07T12:25:34.841 INFO:tasks.workunit.client.1.smithi138.stdout:6/546: getdents dc/d31/d3f 0 2024-02-07T12:25:34.842 INFO:tasks.workunit.client.1.smithi138.stdout:6/547: dread dc/d13/d1e/f30 [0,4194304] 0 2024-02-07T12:25:34.843 INFO:tasks.workunit.client.1.smithi138.stdout:6/548: write dc/f77 [968159,64456] 0 2024-02-07T12:25:34.843 INFO:tasks.workunit.client.1.smithi138.stdout:6/549: creat dc/d31/d38/d9a/fb3 x:0 0 0 2024-02-07T12:25:34.843 INFO:tasks.workunit.client.1.smithi138.stdout:6/550: truncate dc/d73/d9b/fab 803134 0 2024-02-07T12:25:34.845 INFO:tasks.workunit.client.1.smithi138.stdout:0/556: mkdir d4/d9/d37/db6 0 2024-02-07T12:25:34.847 INFO:tasks.workunit.client.1.smithi138.stdout:7/718: mknod d0/d8/d15/cef 0 2024-02-07T12:25:34.847 INFO:tasks.workunit.client.1.smithi138.stdout:7/719: truncate d0/d8/d15/db1/fca 492870 0 2024-02-07T12:25:34.848 INFO:tasks.workunit.client.1.smithi138.stdout:4/536: dwrite d20/d34/d59/fa8 [0,4194304] 0 2024-02-07T12:25:34.851 INFO:tasks.workunit.client.1.smithi138.stdout:2/644: link f1 d3/dd/d19/d44/de8/fee 0 2024-02-07T12:25:34.851 INFO:tasks.workunit.client.1.smithi138.stdout:2/645: truncate d3/dd/d19/d44/fc0 632053 0 2024-02-07T12:25:34.852 INFO:tasks.workunit.client.1.smithi138.stdout:9/459: symlink d0/d6/d8/d1d/dd/d41/d5e/d74/l8b 0 2024-02-07T12:25:34.852 INFO:tasks.workunit.client.1.smithi138.stdout:9/460: chown d0/d6/d8/d1d/dd/d25/f85 10 1 2024-02-07T12:25:34.853 INFO:tasks.workunit.client.1.smithi138.stdout:2/646: read d3/dd/d19/f42 [551983,16340] 0 2024-02-07T12:25:34.854 INFO:tasks.workunit.client.1.smithi138.stdout:2/647: dread - d3/dd/d19/fc4 zero size 2024-02-07T12:25:34.856 INFO:tasks.workunit.client.1.smithi138.stdout:7/720: mknod d0/cf0 0 2024-02-07T12:25:34.856 INFO:tasks.workunit.client.1.smithi138.stdout:7/721: chown d0/f2 72572403 1 2024-02-07T12:25:34.857 INFO:tasks.workunit.client.1.smithi138.stdout:7/722: write d0/d8/d11/d26/fae [528519,47944] 0 2024-02-07T12:25:34.860 INFO:tasks.workunit.client.1.smithi138.stdout:5/553: link da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d96/l81 da/d6d/d27/d2e/d4f/d2b/lb5 0 2024-02-07T12:25:34.860 INFO:tasks.workunit.client.1.smithi138.stdout:6/551: dwrite dc/d13/d1e/d35/d6d/f6e [0,4194304] 0 2024-02-07T12:25:34.864 INFO:tasks.workunit.client.1.smithi138.stdout:0/557: dwrite d4/d9/de/d1d/d21/f86 [0,4194304] 0 2024-02-07T12:25:34.864 INFO:tasks.workunit.client.1.smithi138.stdout:0/558: write d4/d9/f18 [4709820,47726] 0 2024-02-07T12:25:34.864 INFO:tasks.workunit.client.1.smithi138.stdout:4/537: mknod d20/d34/d36/d55/ca9 0 2024-02-07T12:25:34.866 INFO:tasks.workunit.client.1.smithi138.stdout:6/552: write fb [1769976,112914] 0 2024-02-07T12:25:34.867 INFO:tasks.workunit.client.1.smithi138.stdout:6/553: readlink dc/d31/l8d 0 2024-02-07T12:25:34.873 INFO:tasks.workunit.client.1.smithi138.stdout:2/648: symlink d3/lef 0 2024-02-07T12:25:34.874 INFO:tasks.workunit.client.1.smithi138.stdout:2/649: write d3/d4e/fa0 [1412503,20738] 0 2024-02-07T12:25:34.874 INFO:tasks.workunit.client.1.smithi138.stdout:2/650: chown d3/dd/f9c 54800 1 2024-02-07T12:25:34.874 INFO:tasks.workunit.client.1.smithi138.stdout:2/651: write d3/dd/d14/d49/d25/d3d/f52 [935558,104607] 0 2024-02-07T12:25:34.874 INFO:tasks.workunit.client.1.smithi138.stdout:2/652: stat d3/dd/d14/d49/d25/l58 0 2024-02-07T12:25:34.874 INFO:tasks.workunit.client.1.smithi138.stdout:5/554: chown da/d43/c61 0 1 2024-02-07T12:25:34.885 INFO:tasks.workunit.client.1.smithi138.stdout:0/559: mkdir d4/d9/d37/d64/db7 0 2024-02-07T12:25:34.886 INFO:tasks.workunit.client.1.smithi138.stdout:0/560: fdatasync d4/d9/db/fa8 0 2024-02-07T12:25:34.886 INFO:tasks.workunit.client.1.smithi138.stdout:0/561: stat d4/d9/de/f2a 0 2024-02-07T12:25:34.886 INFO:tasks.workunit.client.1.smithi138.stdout:0/562: chown d4/d9/de/d1d/l5d 728500350 1 2024-02-07T12:25:34.886 INFO:tasks.workunit.client.1.smithi138.stdout:0/563: readlink d4/d52/l1a 0 2024-02-07T12:25:34.887 INFO:tasks.workunit.client.1.smithi138.stdout:4/538: creat d20/d4d/d87/faa x:0 0 0 2024-02-07T12:25:34.887 INFO:tasks.workunit.client.1.smithi138.stdout:4/539: dread - d20/d34/d36/d55/f58 zero size 2024-02-07T12:25:34.888 INFO:tasks.workunit.client.1.smithi138.stdout:6/554: mknod dc/d13/d1e/d24/cb4 0 2024-02-07T12:25:34.888 INFO:tasks.workunit.client.1.smithi138.stdout:6/555: chown dc/d13/d1e/d24/cb4 36 1 2024-02-07T12:25:34.888 INFO:tasks.workunit.client.1.smithi138.stdout:6/556: chown dc/d13/d1e/d35/d85/f95 413 1 2024-02-07T12:25:34.888 INFO:tasks.workunit.client.1.smithi138.stdout:6/557: readlink dc/d69/l7f 0 2024-02-07T12:25:34.890 INFO:tasks.workunit.client.1.smithi138.stdout:9/461: link d0/d34/d45/l68 d0/d6/d8/d1d/dd/d1f/l8c 0 2024-02-07T12:25:34.891 INFO:tasks.workunit.client.1.smithi138.stdout:2/653: getdents d3/dd/d19/d1f/d46/d71/d7e 0 2024-02-07T12:25:34.894 INFO:tasks.workunit.client.1.smithi138.stdout:4/540: mkdir d20/d34/d73/dab 0 2024-02-07T12:25:34.895 INFO:tasks.workunit.client.1.smithi138.stdout:6/558: symlink dc/d13/d1e/dae/lb5 0 2024-02-07T12:25:34.897 INFO:tasks.workunit.client.1.smithi138.stdout:9/462: truncate d0/d6/d8/f2a 5430383 0 2024-02-07T12:25:34.897 INFO:tasks.workunit.client.1.smithi138.stdout:9/463: dread - d0/d6/d8/d1d/dd/d41/f79 zero size 2024-02-07T12:25:34.900 INFO:tasks.workunit.client.1.smithi138.stdout:5/555: link da/l52 da/d6d/d27/d2e/d4f/d2b/d35/d40/lb6 0 2024-02-07T12:25:34.902 INFO:tasks.workunit.client.1.smithi138.stdout:0/564: getdents d4/d9/db/d71 0 2024-02-07T12:25:34.905 INFO:tasks.workunit.client.1.smithi138.stdout:9/464: write d0/d6/d8/d1d/f3d [698720,71065] 0 2024-02-07T12:25:34.905 INFO:tasks.workunit.client.1.smithi138.stdout:9/465: fdatasync d0/d6/d8/d1d/f61 0 2024-02-07T12:25:34.907 INFO:tasks.workunit.client.1.smithi138.stdout:2/654: getdents d3/dd/d14/d86 0 2024-02-07T12:25:34.909 INFO:tasks.workunit.client.1.smithi138.stdout:6/559: dwrite dc/d13/f39 [0,4194304] 0 2024-02-07T12:25:34.909 INFO:tasks.workunit.client.1.smithi138.stdout:6/560: creat dc/d31/d54/fb6 x:0 0 0 2024-02-07T12:25:34.909 INFO:tasks.workunit.client.1.smithi138.stdout:6/561: fdatasync dc/d13/d1e/d35/d85/fad 0 2024-02-07T12:25:34.910 INFO:tasks.workunit.client.1.smithi138.stdout:6/562: creat dc/d31/d38/d9a/fb7 x:0 0 0 2024-02-07T12:25:34.912 INFO:tasks.workunit.client.1.smithi138.stdout:0/565: rename d4/d9/de/d1d/f49 to d4/d9/d37/d64/d9a/db0/db5/fb8 0 2024-02-07T12:25:34.914 INFO:tasks.workunit.client.1.smithi138.stdout:9/466: truncate d0/f38 924918 0 2024-02-07T12:25:34.915 INFO:tasks.workunit.client.1.smithi138.stdout:6/563: dread dc/d31/d3f/f41 [0,4194304] 0 2024-02-07T12:25:34.915 INFO:tasks.workunit.client.1.smithi138.stdout:6/564: fdatasync f6 0 2024-02-07T12:25:34.920 INFO:tasks.workunit.client.1.smithi138.stdout:2/655: dread f1 [0,4194304] 0 2024-02-07T12:25:34.920 INFO:tasks.workunit.client.1.smithi138.stdout:2/656: truncate d3/dd/d19/d1f/f5c 1820663 0 2024-02-07T12:25:34.923 INFO:tasks.workunit.client.1.smithi138.stdout:0/566: mkdir d4/d9/d33/db9 0 2024-02-07T12:25:34.923 INFO:tasks.workunit.client.1.smithi138.stdout:0/567: creat d4/d9/db/fba x:0 0 0 2024-02-07T12:25:34.924 INFO:tasks.workunit.client.1.smithi138.stdout:2/657: chown d3/dd/d14/f26 73140 1 2024-02-07T12:25:34.927 INFO:tasks.workunit.client.1.smithi138.stdout:0/568: creat d4/d9/d75/fbb x:0 0 0 2024-02-07T12:25:34.929 INFO:tasks.workunit.client.1.smithi138.stdout:2/658: mkdir d3/dd/d14/d8f/d73/d80/df0 0 2024-02-07T12:25:34.931 INFO:tasks.workunit.client.1.smithi138.stdout:2/659: symlink d3/dd/d19/d44/d7d/lf1 0 2024-02-07T12:25:34.933 INFO:tasks.workunit.client.1.smithi138.stdout:1/469: sync 2024-02-07T12:25:34.936 INFO:tasks.workunit.client.1.smithi138.stdout:0/569: write d4/d9/db/f20 [524889,26067] 0 2024-02-07T12:25:34.936 INFO:tasks.workunit.client.1.smithi138.stdout:9/467: dwrite d0/d6/d8/d1d/f53 [0,4194304] 0 2024-02-07T12:25:34.938 INFO:tasks.workunit.client.1.smithi138.stdout:2/660: dread d3/dd/d19/d1f/d46/d71/faa [0,4194304] 0 2024-02-07T12:25:34.938 INFO:tasks.workunit.client.1.smithi138.stdout:0/570: symlink d4/d52/d3f/lbc 0 2024-02-07T12:25:34.938 INFO:tasks.workunit.client.1.smithi138.stdout:0/571: chown d4/d9/db/f20 523879 1 2024-02-07T12:25:34.938 INFO:tasks.workunit.client.1.smithi138.stdout:0/572: creat d4/d69/fbd x:0 0 0 2024-02-07T12:25:34.938 INFO:tasks.workunit.client.1.smithi138.stdout:0/573: readlink d4/d9/l55 0 2024-02-07T12:25:34.938 INFO:tasks.workunit.client.1.smithi138.stdout:0/574: write d4/f5 [1867663,15637] 0 2024-02-07T12:25:34.940 INFO:tasks.workunit.client.1.smithi138.stdout:9/468: creat d0/d6/d8/d1d/dd/d41/d5e/f8d x:0 0 0 2024-02-07T12:25:34.940 INFO:tasks.workunit.client.1.smithi138.stdout:9/469: write d0/d6/d8/d1d/f3d [5021409,41491] 0 2024-02-07T12:25:34.940 INFO:tasks.workunit.client.1.smithi138.stdout:9/470: chown d0/d34/d45/l68 295 1 2024-02-07T12:25:34.941 INFO:tasks.workunit.client.1.smithi138.stdout:0/575: unlink d4/d9/db/d39/f5c 0 2024-02-07T12:25:34.943 INFO:tasks.workunit.client.1.smithi138.stdout:9/471: link d0/d6/d8/d1d/dd/d41/d5e/f67 d0/d6/d8/f8e 0 2024-02-07T12:25:34.945 INFO:tasks.workunit.client.1.smithi138.stdout:0/576: mkdir d4/d9/d37/dbe 0 2024-02-07T12:25:34.947 INFO:tasks.workunit.client.1.smithi138.stdout:2/661: dread d3/dd/d19/f35 [0,4194304] 0 2024-02-07T12:25:34.947 INFO:tasks.workunit.client.1.smithi138.stdout:2/662: fdatasync d3/dd/d19/f72 0 2024-02-07T12:25:34.949 INFO:tasks.workunit.client.1.smithi138.stdout:0/577: dread d4/d9/de/d1d/f36 [0,4194304] 0 2024-02-07T12:25:34.949 INFO:tasks.workunit.client.1.smithi138.stdout:0/578: stat d4/d9/f8e 0 2024-02-07T12:25:34.949 INFO:tasks.workunit.client.1.smithi138.stdout:2/663: symlink d3/dd/d14/d8f/d73/d80/df0/lf2 0 2024-02-07T12:25:34.949 INFO:tasks.workunit.client.1.smithi138.stdout:2/664: chown d3/dd/d14/d82/dcc 125558408 1 2024-02-07T12:25:34.949 INFO:tasks.workunit.client.1.smithi138.stdout:5/556: dwrite da/f85 [0,4194304] 0 2024-02-07T12:25:34.950 INFO:tasks.workunit.client.1.smithi138.stdout:0/579: mknod d4/d9/d37/db6/cbf 0 2024-02-07T12:25:34.952 INFO:tasks.workunit.client.1.smithi138.stdout:2/665: unlink d3/dd/d14/d8f/d73/lbb 0 2024-02-07T12:25:34.952 INFO:tasks.workunit.client.1.smithi138.stdout:2/666: dread - d3/dd/f9c zero size 2024-02-07T12:25:34.954 INFO:tasks.workunit.client.1.smithi138.stdout:1/470: dread d5/d8/da/d1f/d5e/d63/f57 [0,4194304] 0 2024-02-07T12:25:34.954 INFO:tasks.workunit.client.1.smithi138.stdout:1/471: stat d5/d4b/d65 0 2024-02-07T12:25:34.955 INFO:tasks.workunit.client.1.smithi138.stdout:1/472: readlink d5/d4b/d6b/d6e/la3 0 2024-02-07T12:25:34.955 INFO:tasks.workunit.client.1.smithi138.stdout:1/473: chown d5/d8/da/d20/f90 95859 1 2024-02-07T12:25:34.955 INFO:tasks.workunit.client.1.smithi138.stdout:1/474: getdents d5/d8/da/d1f/d27/d68/d73 0 2024-02-07T12:25:34.955 INFO:tasks.workunit.client.1.smithi138.stdout:0/580: dread d4/f67 [0,4194304] 0 2024-02-07T12:25:34.955 INFO:tasks.workunit.client.1.smithi138.stdout:1/475: creat d5/d8/da/d1f/d3c/d59/fa9 x:0 0 0 2024-02-07T12:25:34.955 INFO:tasks.workunit.client.1.smithi138.stdout:1/476: chown d5/d4b/d6b/d6e 1 1 2024-02-07T12:25:34.955 INFO:tasks.workunit.client.1.smithi138.stdout:1/477: chown d5/d8/da/d1f/d5e/d62/f9c 2137691866 1 2024-02-07T12:25:34.955 INFO:tasks.workunit.client.1.smithi138.stdout:1/478: chown d5/d4b/d65/l82 152139577 1 2024-02-07T12:25:34.955 INFO:tasks.workunit.client.1.smithi138.stdout:5/557: link da/d6d/d27/d2e/d4f/d2b/d35/d40/f5e da/d43/d4a/da2/fb7 0 2024-02-07T12:25:34.956 INFO:tasks.workunit.client.1.smithi138.stdout:6/565: dwrite dc/d13/f1a [0,4194304] 0 2024-02-07T12:25:34.956 INFO:tasks.workunit.client.1.smithi138.stdout:6/566: creat dc/d31/d38/d9a/fb8 x:0 0 0 2024-02-07T12:25:34.956 INFO:tasks.workunit.client.1.smithi138.stdout:6/567: truncate dc/d31/d38/f53 871330 0 2024-02-07T12:25:34.956 INFO:tasks.workunit.client.1.smithi138.stdout:2/667: symlink d3/dd/d14/d8f/da5/lf3 0 2024-02-07T12:25:34.957 INFO:tasks.workunit.client.1.smithi138.stdout:2/668: chown d3/dd/d14/d49/d25/d3d/fb1 3439 1 2024-02-07T12:25:34.957 INFO:tasks.workunit.client.1.smithi138.stdout:2/669: write d3/dd/d14/d49/d25/d3d/f52 [82119,73844] 0 2024-02-07T12:25:34.959 INFO:tasks.workunit.client.1.smithi138.stdout:0/581: unlink d4/f5 0 2024-02-07T12:25:34.959 INFO:tasks.workunit.client.1.smithi138.stdout:0/582: chown d4/d9/db/d71/la9 10925 1 2024-02-07T12:25:34.961 INFO:tasks.workunit.client.1.smithi138.stdout:1/479: rename d5/d8/da/d1f/d27/d58/f87 to d5/d8/da/d1f/d27/d68/faa 0 2024-02-07T12:25:34.962 INFO:tasks.workunit.client.1.smithi138.stdout:1/480: creat d5/d4b/fab x:0 0 0 2024-02-07T12:25:34.967 INFO:tasks.workunit.client.1.smithi138.stdout:9/472: dwrite d0/d6/d8/d1d/dd/d1f/f6a [0,4194304] 0 2024-02-07T12:25:34.967 INFO:tasks.workunit.client.1.smithi138.stdout:9/473: chown d0/d6/d8/d1d/dd/d25/f85 200 1 2024-02-07T12:25:34.969 INFO:tasks.workunit.client.1.smithi138.stdout:2/670: mkdir d3/dd/d14/d49/d25/df4 0 2024-02-07T12:25:34.971 INFO:tasks.workunit.client.1.smithi138.stdout:6/568: rename dc/d13/d1e/d35/f46 to dc/d13/d8e/fb9 0 2024-02-07T12:25:34.972 INFO:tasks.workunit.client.1.smithi138.stdout:6/569: write dc/d13/d1e/d35/f4c [1070672,82047] 0 2024-02-07T12:25:34.973 INFO:tasks.workunit.client.1.smithi138.stdout:5/558: write da/d34/f80 [2792134,73767] 0 2024-02-07T12:25:34.973 INFO:tasks.workunit.client.1.smithi138.stdout:9/474: write d0/d6/f27 [4085231,24754] 0 2024-02-07T12:25:34.975 INFO:tasks.workunit.client.1.smithi138.stdout:1/481: unlink d5/d8/da/d20/f88 0 2024-02-07T12:25:34.980 INFO:tasks.workunit.client.1.smithi138.stdout:2/671: symlink d3/dd/d19/lf5 0 2024-02-07T12:25:34.980 INFO:tasks.workunit.client.1.smithi138.stdout:2/672: write d3/dd/d19/d1f/f5c [1022495,127411] 0 2024-02-07T12:25:34.983 INFO:tasks.workunit.client.1.smithi138.stdout:6/570: mkdir dc/d13/d1e/d35/d85/dba 0 2024-02-07T12:25:34.983 INFO:tasks.workunit.client.1.smithi138.stdout:6/571: creat dc/d31/fbb x:0 0 0 2024-02-07T12:25:34.983 INFO:tasks.workunit.client.1.smithi138.stdout:6/572: truncate dc/d73/d9b/fa5 1048884 0 2024-02-07T12:25:34.983 INFO:tasks.workunit.client.1.smithi138.stdout:5/559: creat da/d6d/d27/fb8 x:0 0 0 2024-02-07T12:25:34.983 INFO:tasks.workunit.client.1.smithi138.stdout:1/482: read d5/d8/da/d1f/d3c/d59/f78 [2458923,39068] 0 2024-02-07T12:25:34.984 INFO:tasks.workunit.client.1.smithi138.stdout:9/475: symlink d0/l8f 0 2024-02-07T12:25:34.984 INFO:tasks.workunit.client.1.smithi138.stdout:9/476: write d0/d6/d8/d1d/f61 [1699966,115178] 0 2024-02-07T12:25:34.987 INFO:tasks.workunit.client.1.smithi138.stdout:6/573: rename dc/d13/d1e/d35/d85/f8a to dc/d13/d8e/fbc 0 2024-02-07T12:25:34.989 INFO:tasks.workunit.client.1.smithi138.stdout:1/483: mknod d5/d8/da/d1f/d5e/d63/d99/cac 0 2024-02-07T12:25:34.991 INFO:tasks.workunit.client.1.smithi138.stdout:5/560: symlink da/d6d/d27/d2e/d4f/d2b/d35/d40/lb9 0 2024-02-07T12:25:34.995 INFO:tasks.workunit.client.1.smithi138.stdout:6/574: symlink dc/d69/lbd 0 2024-02-07T12:25:34.997 INFO:tasks.workunit.client.1.smithi138.stdout:5/561: mknod da/d43/d4a/cba 0 2024-02-07T12:25:34.997 INFO:tasks.workunit.client.1.smithi138.stdout:5/562: stat da/d6d/d27/d2e/d4f/d2b/d35/d40/lb9 0 2024-02-07T12:25:34.997 INFO:tasks.workunit.client.1.smithi138.stdout:1/484: dread d5/d8/da/d1f/f51 [0,4194304] 0 2024-02-07T12:25:34.999 INFO:tasks.workunit.client.1.smithi138.stdout:6/575: mkdir dc/d13/d1e/d35/d7c/dbe 0 2024-02-07T12:25:34.999 INFO:tasks.workunit.client.1.smithi138.stdout:6/576: chown dc/d13/d1e/d35/d85/dba 20658 1 2024-02-07T12:25:35.000 INFO:tasks.workunit.client.1.smithi138.stdout:6/577: chown dc/d13/d1e/d24/l33 9482702 1 2024-02-07T12:25:35.001 INFO:tasks.workunit.client.1.smithi138.stdout:1/485: creat d5/d4b/d6b/d6e/fad x:0 0 0 2024-02-07T12:25:35.002 INFO:tasks.workunit.client.1.smithi138.stdout:1/486: truncate d5/d8/da/d1f/f51 5005970 0 2024-02-07T12:25:35.004 INFO:tasks.workunit.client.1.smithi138.stdout:1/487: creat d5/d8/da/d20/fae x:0 0 0 2024-02-07T12:25:35.009 INFO:tasks.workunit.client.1.smithi138.stdout:1/488: symlink d5/d8/da/d1f/d27/d68/d73/laf 0 2024-02-07T12:25:35.010 INFO:tasks.workunit.client.1.smithi138.stdout:9/477: dwrite d0/d6/d8/d1d/dd/d1f/f6a [0,4194304] 0 2024-02-07T12:25:35.010 INFO:tasks.workunit.client.1.smithi138.stdout:9/478: fdatasync d0/f6f 0 2024-02-07T12:25:35.011 INFO:tasks.workunit.client.1.smithi138.stdout:1/489: creat d5/d8/da/d4a/fb0 x:0 0 0 2024-02-07T12:25:35.021 INFO:tasks.workunit.client.1.smithi138.stdout:8/714: sync 2024-02-07T12:25:35.021 INFO:tasks.workunit.client.1.smithi138.stdout:8/715: truncate d1/de/db4/db8/d17/d2e/f74 1327724 0 2024-02-07T12:25:35.024 INFO:tasks.workunit.client.1.smithi138.stdout:8/716: creat d1/de/db4/db8/d17/d3e/d72/dda/d4c/d62/fdb x:0 0 0 2024-02-07T12:25:35.025 INFO:tasks.workunit.client.1.smithi138.stdout:1/490: dread d5/d8/ff [0,4194304] 0 2024-02-07T12:25:35.030 INFO:tasks.workunit.client.1.smithi138.stdout:8/717: mkdir d1/ddc 0 2024-02-07T12:25:35.031 INFO:tasks.workunit.client.1.smithi138.stdout:6/578: dwrite dc/d73/d9b/fa5 [0,4194304] 0 2024-02-07T12:25:35.032 INFO:tasks.workunit.client.1.smithi138.stdout:1/491: rename d5/d8/da/d1f/d27/d68/d73/d7b/f24 to d5/d4b/d6b/d6e/d79/fb1 0 2024-02-07T12:25:35.033 INFO:tasks.workunit.client.1.smithi138.stdout:8/718: mkdir d1/de/db4/db8/d17/d3e/d72/dda/dcf/ddd 0 2024-02-07T12:25:35.035 INFO:tasks.workunit.client.1.smithi138.stdout:6/579: mknod dc/d13/d1e/dae/cbf 0 2024-02-07T12:25:35.037 INFO:tasks.workunit.client.1.smithi138.stdout:5/563: dwrite da/d6d/d27/d2e/d4f/d2b/d35/d5d/f70 [0,4194304] 0 2024-02-07T12:25:35.037 INFO:tasks.workunit.client.1.smithi138.stdout:1/492: read d5/f9 [3053341,12123] 0 2024-02-07T12:25:35.037 INFO:tasks.workunit.client.1.smithi138.stdout:9/479: dwrite d0/d6/f3c [0,4194304] 0 2024-02-07T12:25:35.038 INFO:tasks.workunit.client.1.smithi138.stdout:9/480: chown d0/d6/d8/d1d/dd/d1f/f6a 257527246 1 2024-02-07T12:25:35.038 INFO:tasks.workunit.client.1.smithi138.stdout:8/719: rename d1/de/db4/db8/d96/fbf to d1/de/db4/fde 0 2024-02-07T12:25:35.038 INFO:tasks.workunit.client.1.smithi138.stdout:6/580: truncate dc/d13/d1e/d35/fb0 1735574 0 2024-02-07T12:25:35.038 INFO:tasks.workunit.client.1.smithi138.stdout:6/581: chown dc/l98 202829 1 2024-02-07T12:25:35.043 INFO:tasks.workunit.client.1.smithi138.stdout:5/564: link da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d96/l81 da/d6d/d27/d2e/d4f/d2b/d35/d67/lbb 0 2024-02-07T12:25:35.043 INFO:tasks.workunit.client.1.smithi138.stdout:5/565: fsync da/d6d/fac 0 2024-02-07T12:25:35.043 INFO:tasks.workunit.client.1.smithi138.stdout:5/566: readlink da/d43/l7d 0 2024-02-07T12:25:35.047 INFO:tasks.workunit.client.1.smithi138.stdout:6/582: dread dc/d73/d9b/fa5 [0,4194304] 0 2024-02-07T12:25:35.048 INFO:tasks.workunit.client.1.smithi138.stdout:1/493: symlink d5/d4b/d91/lb2 0 2024-02-07T12:25:35.048 INFO:tasks.workunit.client.1.smithi138.stdout:1/494: truncate d5/d4b/f5d 4469113 0 2024-02-07T12:25:35.049 INFO:tasks.workunit.client.1.smithi138.stdout:9/481: getdents d0/d6/d8/d1d 0 2024-02-07T12:25:35.049 INFO:tasks.workunit.client.1.smithi138.stdout:9/482: fsync d0/d6/d8/f8e 0 2024-02-07T12:25:35.051 INFO:tasks.workunit.client.1.smithi138.stdout:8/720: unlink d1/d99/cc1 0 2024-02-07T12:25:35.055 INFO:tasks.workunit.client.1.smithi138.stdout:1/495: mknod d5/d4b/cb3 0 2024-02-07T12:25:35.055 INFO:tasks.workunit.client.1.smithi138.stdout:1/496: truncate d5/d4b/d91/f9f 931889 0 2024-02-07T12:25:35.056 INFO:tasks.workunit.client.1.smithi138.stdout:6/583: dread dc/d13/f1d [0,4194304] 0 2024-02-07T12:25:35.057 INFO:tasks.workunit.client.1.smithi138.stdout:6/584: fsync dc/d13/d1e/d35/d6d/f7d 0 2024-02-07T12:25:35.059 INFO:tasks.workunit.client.1.smithi138.stdout:9/483: link d0/d6/d8/d1d/dd/d1f/f47 d0/d6/d64/f90 0 2024-02-07T12:25:35.062 INFO:tasks.workunit.client.1.smithi138.stdout:5/567: dwrite da/d6d/d27/d2e/d4f/d2b/d35/d5d/d73/fad [0,4194304] 0 2024-02-07T12:25:35.071 INFO:tasks.workunit.client.1.smithi138.stdout:9/484: dread d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:35.071 INFO:tasks.workunit.client.1.smithi138.stdout:9/485: fsync d0/d6/d8/f73 0 2024-02-07T12:25:35.076 INFO:tasks.workunit.client.1.smithi138.stdout:9/486: mknod d0/d34/d45/c91 0 2024-02-07T12:25:35.076 INFO:tasks.workunit.client.1.smithi138.stdout:9/487: symlink d0/d34/d45/l92 0 2024-02-07T12:25:35.076 INFO:tasks.workunit.client.1.smithi138.stdout:5/568: dread da/d50/f56 [0,4194304] 0 2024-02-07T12:25:35.077 INFO:tasks.workunit.client.1.smithi138.stdout:9/488: link d0/d34/d45/d78/l87 d0/d34/d45/l93 0 2024-02-07T12:25:35.078 INFO:tasks.workunit.client.1.smithi138.stdout:9/489: truncate d0/d34/f51 1400597 0 2024-02-07T12:25:35.080 INFO:tasks.workunit.client.1.smithi138.stdout:9/490: symlink d0/d34/d45/l94 0 2024-02-07T12:25:35.081 INFO:tasks.workunit.client.1.smithi138.stdout:9/491: mkdir d0/d6/d8/d95 0 2024-02-07T12:25:35.081 INFO:tasks.workunit.client.1.smithi138.stdout:9/492: write d0/d6/d8/d1d/dd/d41/d5e/f8d [890685,81677] 0 2024-02-07T12:25:35.081 INFO:tasks.workunit.client.1.smithi138.stdout:9/493: stat d0/d6/d64 0 2024-02-07T12:25:35.083 INFO:tasks.workunit.client.1.smithi138.stdout:1/497: dwrite d5/d8/da/d1f/d3c/d59/f55 [0,4194304] 0 2024-02-07T12:25:35.085 INFO:tasks.workunit.client.1.smithi138.stdout:8/721: dwrite d1/de/db4/db8/d17/d8a/db6/fd5 [0,4194304] 0 2024-02-07T12:25:35.085 INFO:tasks.workunit.client.1.smithi138.stdout:6/585: dwrite dc/d31/fbb [0,4194304] 0 2024-02-07T12:25:35.085 INFO:tasks.workunit.client.1.smithi138.stdout:9/494: dread d0/f33 [0,4194304] 0 2024-02-07T12:25:35.085 INFO:tasks.workunit.client.1.smithi138.stdout:1/498: unlink d5/d8/da/d1f/d27/d68/d73/d7b/l31 0 2024-02-07T12:25:35.085 INFO:tasks.workunit.client.1.smithi138.stdout:1/499: stat d5/d8/da/d1f/d27/d68/d73/d7b/f75 0 2024-02-07T12:25:35.085 INFO:tasks.workunit.client.1.smithi138.stdout:1/500: fsync d5/d4b/fab 0 2024-02-07T12:25:35.086 INFO:tasks.workunit.client.1.smithi138.stdout:1/501: chown d5/d8/da/f1d 2573 1 2024-02-07T12:25:35.086 INFO:tasks.workunit.client.1.smithi138.stdout:8/722: dread d1/de/db4/db8/f1d [0,4194304] 0 2024-02-07T12:25:35.095 INFO:tasks.workunit.client.1.smithi138.stdout:6/586: mkdir dc/d13/d1e/d35/dc0 0 2024-02-07T12:25:35.097 INFO:tasks.workunit.client.1.smithi138.stdout:9/495: creat d0/d6/d8/d95/f96 x:0 0 0 2024-02-07T12:25:35.097 INFO:tasks.workunit.client.1.smithi138.stdout:9/496: write d0/d6/d8/d95/f96 [101874,94236] 0 2024-02-07T12:25:35.100 INFO:tasks.workunit.client.1.smithi138.stdout:8/723: symlink d1/de/db4/db8/d17/d3e/d72/dda/d4c/d62/ldf 0 2024-02-07T12:25:35.100 INFO:tasks.workunit.client.1.smithi138.stdout:5/569: dwrite da/d43/d4a/d69/f6f [0,4194304] 0 2024-02-07T12:25:35.103 INFO:tasks.workunit.client.1.smithi138.stdout:1/502: dwrite d5/d4b/fab [0,4194304] 0 2024-02-07T12:25:35.112 INFO:tasks.workunit.client.1.smithi138.stdout:8/724: dread d1/f15 [0,4194304] 0 2024-02-07T12:25:35.112 INFO:tasks.workunit.client.1.smithi138.stdout:5/570: write da/d22/f8d [299,101014] 0 2024-02-07T12:25:35.112 INFO:tasks.workunit.client.1.smithi138.stdout:5/571: fdatasync da/d50/f56 0 2024-02-07T12:25:35.114 INFO:tasks.workunit.client.1.smithi138.stdout:3/679: sync 2024-02-07T12:25:35.115 INFO:tasks.workunit.client.1.smithi138.stdout:3/680: write d5/d15/f48 [1599589,60729] 0 2024-02-07T12:25:35.118 INFO:tasks.workunit.client.1.smithi138.stdout:5/572: mknod da/d43/d4a/d95/cbc 0 2024-02-07T12:25:35.119 INFO:tasks.workunit.client.1.smithi138.stdout:5/573: mkdir da/d34/dbd 0 2024-02-07T12:25:35.119 INFO:tasks.workunit.client.1.smithi138.stdout:5/574: creat da/d43/d4a/fbe x:0 0 0 2024-02-07T12:25:35.121 INFO:tasks.workunit.client.1.smithi138.stdout:5/575: truncate da/d6d/d27/d2e/d4f/d2b/d35/d5d/fa5 366817 0 2024-02-07T12:25:35.122 INFO:tasks.workunit.client.1.smithi138.stdout:5/576: read - da/d6d/d27/d2e/f77 zero size 2024-02-07T12:25:35.122 INFO:tasks.workunit.client.1.smithi138.stdout:5/577: chown da/d6d/d27/d2e/d4f/d2b/lb5 0 1 2024-02-07T12:25:35.123 INFO:tasks.workunit.client.1.smithi138.stdout:8/725: read d1/fbb [3621975,61464] 0 2024-02-07T12:25:35.124 INFO:tasks.workunit.client.1.smithi138.stdout:6/587: dwrite dc/d13/d1e/d24/f3c [4194304,4194304] 0 2024-02-07T12:25:35.125 INFO:tasks.workunit.client.1.smithi138.stdout:8/726: unlink d1/de/db4/db8/d17/d3e/d72/dda/f39 0 2024-02-07T12:25:35.126 INFO:tasks.workunit.client.1.smithi138.stdout:6/588: unlink dc/d31/f96 0 2024-02-07T12:25:35.126 INFO:tasks.workunit.client.1.smithi138.stdout:9/497: dwrite d0/d6/d8/d1d/dd/f31 [0,4194304] 0 2024-02-07T12:25:35.126 INFO:tasks.workunit.client.1.smithi138.stdout:9/498: chown d0/d6/d8/d1d 1983042 1 2024-02-07T12:25:35.127 INFO:tasks.workunit.client.1.smithi138.stdout:9/499: write d0/d34/d86/f89 [4682,112245] 0 2024-02-07T12:25:35.129 INFO:tasks.workunit.client.1.smithi138.stdout:1/503: dwrite d5/d4b/d65/fa6 [0,4194304] 0 2024-02-07T12:25:35.132 INFO:tasks.workunit.client.1.smithi138.stdout:5/578: write da/d6d/d27/d2e/d4f/d2b/d35/d5d/f70 [3376792,117691] 0 2024-02-07T12:25:35.137 INFO:tasks.workunit.client.1.smithi138.stdout:5/579: creat da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/fbf x:0 0 0 2024-02-07T12:25:35.137 INFO:tasks.workunit.client.1.smithi138.stdout:5/580: fdatasync da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d91/faa 0 2024-02-07T12:25:35.138 INFO:tasks.workunit.client.1.smithi138.stdout:2/673: sync 2024-02-07T12:25:35.138 INFO:tasks.workunit.client.1.smithi138.stdout:4/541: sync 2024-02-07T12:25:35.138 INFO:tasks.workunit.client.1.smithi138.stdout:9/500: dread d0/d34/d45/f69 [0,4194304] 0 2024-02-07T12:25:35.138 INFO:tasks.workunit.client.1.smithi138.stdout:7/723: sync 2024-02-07T12:25:35.138 INFO:tasks.workunit.client.1.smithi138.stdout:2/674: read - d3/dd/d14/d8f/dbc/dbd/fd7 zero size 2024-02-07T12:25:35.139 INFO:tasks.workunit.client.1.smithi138.stdout:0/583: sync 2024-02-07T12:25:35.139 INFO:tasks.workunit.client.1.smithi138.stdout:1/504: getdents d5/d8/da/d1f/d27/d68 0 2024-02-07T12:25:35.143 INFO:tasks.workunit.client.1.smithi138.stdout:4/542: mkdir d20/d47/d69/d7c/dac 0 2024-02-07T12:25:35.143 INFO:tasks.workunit.client.1.smithi138.stdout:4/543: read - d20/d4d/d87/faa zero size 2024-02-07T12:25:35.146 INFO:tasks.workunit.client.1.smithi138.stdout:0/584: mkdir d4/d9/d37/d64/d9a/dc0 0 2024-02-07T12:25:35.149 INFO:tasks.workunit.client.1.smithi138.stdout:0/585: symlink d4/d9/d37/d64/d9a/db0/lc1 0 2024-02-07T12:25:35.150 INFO:tasks.workunit.client.1.smithi138.stdout:0/586: readlink d4/d9/d37/la7 0 2024-02-07T12:25:35.152 INFO:tasks.workunit.client.1.smithi138.stdout:2/675: rename d3/dd/d14/d8f/da5 to d3/dd/d14/d8f/dbc/df6 0 2024-02-07T12:25:35.152 INFO:tasks.workunit.client.1.smithi138.stdout:2/676: truncate d3/dd/d19/d1f/d37/fab 562105 0 2024-02-07T12:25:35.156 INFO:tasks.workunit.client.1.smithi138.stdout:7/724: read d0/d8/d11/d5f/d86/f92 [2504485,69708] 0 2024-02-07T12:25:35.156 INFO:tasks.workunit.client.1.smithi138.stdout:7/725: creat d0/d6/d1d/d38/ff1 x:0 0 0 2024-02-07T12:25:35.157 INFO:tasks.workunit.client.1.smithi138.stdout:1/505: rename d5/d8/f3b to d5/d8/da/d1f/d27/d58/fb4 0 2024-02-07T12:25:35.158 INFO:tasks.workunit.client.1.smithi138.stdout:2/677: rmdir d3/dd/d14/d8f/dbc/dbd 39 2024-02-07T12:25:35.162 INFO:tasks.workunit.client.1.smithi138.stdout:2/678: symlink d3/dd/d19/d44/de8/lf7 0 2024-02-07T12:25:35.162 INFO:tasks.workunit.client.1.smithi138.stdout:2/679: fdatasync d3/dd/d14/d49/d29/feb 0 2024-02-07T12:25:35.168 INFO:tasks.workunit.client.1.smithi138.stdout:7/726: dread d0/d6/d19/f29 [0,4194304] 0 2024-02-07T12:25:35.168 INFO:tasks.workunit.client.1.smithi138.stdout:7/727: stat d0/d8/d11/d5f/d86/ca1 0 2024-02-07T12:25:35.169 INFO:tasks.workunit.client.1.smithi138.stdout:6/589: dwrite dc/d31/d38/d9a/fa9 [0,4194304] 0 2024-02-07T12:25:35.169 INFO:tasks.workunit.client.1.smithi138.stdout:6/590: write dc/d13/d1e/d35/d85/fad [1043855,35071] 0 2024-02-07T12:25:35.169 INFO:tasks.workunit.client.1.smithi138.stdout:6/591: chown dc/d13/d1e/d35/d6d/f6e 51 1 2024-02-07T12:25:35.169 INFO:tasks.workunit.client.1.smithi138.stdout:6/592: dread - dc/d13/f42 zero size 2024-02-07T12:25:35.173 INFO:tasks.workunit.client.1.smithi138.stdout:6/593: creat dc/fc1 x:0 0 0 2024-02-07T12:25:35.173 INFO:tasks.workunit.client.1.smithi138.stdout:2/680: write d3/dd/d19/f15 [1294142,32957] 0 2024-02-07T12:25:35.173 INFO:tasks.workunit.client.1.smithi138.stdout:5/581: dwrite da/d6d/d27/d2e/d4f/d2b/d35/d40/f9f [0,4194304] 0 2024-02-07T12:25:35.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.171+0000 7fc5f2941700 1 -- 172.21.15.47:0/2681068826 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5ec10f880 con 0x7fc5d40389e0 2024-02-07T12:25:35.174 INFO:tasks.workunit.client.1.smithi138.stdout:9/501: dwrite d0/d6/f27 [0,4194304] 0 2024-02-07T12:25:35.176 INFO:tasks.workunit.client.1.smithi138.stdout:5/582: link l7 da/d6d/d27/d2e/d4f/d2b/d35/d5d/lc0 0 2024-02-07T12:25:35.176 INFO:tasks.workunit.client.1.smithi138.stdout:5/583: write da/d43/d4a/d95/fb2 [402870,76963] 0 2024-02-07T12:25:35.176 INFO:tasks.workunit.client.1.smithi138.stdout:5/584: fdatasync da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/f7f 0 2024-02-07T12:25:35.177 INFO:tasks.workunit.client.1.smithi138.stdout:7/728: write d0/d8/d11/d5f/d86/f9d [1005583,15521] 0 2024-02-07T12:25:35.177 INFO:tasks.workunit.client.1.smithi138.stdout:7/729: fdatasync d0/d6/d1d/d38/f8d 0 2024-02-07T12:25:35.178 INFO:tasks.workunit.client.1.smithi138.stdout:7/730: creat d0/d6/d1d/ff2 x:0 0 0 2024-02-07T12:25:35.180 INFO:tasks.workunit.client.1.smithi138.stdout:7/731: dread d0/d8/d11/d26/fae [0,4194304] 0 2024-02-07T12:25:35.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.179+0000 7fc5e8ff9700 1 -- 172.21.15.47:0/2681068826 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc5ec10f880 con 0x7fc5d40389e0 2024-02-07T12:25:35.181 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:25:35.181 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:25:35.181 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:25:35.181 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:25:35.181 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [], 2024-02-07T12:25:35.182 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "1/21 daemons upgraded", 2024-02-07T12:25:35.182 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "", 2024-02-07T12:25:35.182 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:25:35.182 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:25:35.182 INFO:tasks.workunit.client.1.smithi138.stdout:2/681: dread d3/dd/d19/d1f/fa2 [0,4194304] 0 2024-02-07T12:25:35.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.181+0000 7fc5f2941700 1 -- 172.21.15.47:0/2681068826 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fc5d40389e0 msgr2=0x7fc5d403ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:35.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.181+0000 7fc5f2941700 1 --2- 172.21.15.47:0/2681068826 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fc5d40389e0 0x7fc5d403ae90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0004600 tx=0x7fc5e000b040 comp rx=0 tx=0).stop 2024-02-07T12:25:35.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.181+0000 7fc5f2941700 1 -- 172.21.15.47:0/2681068826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5ec0fcef0 msgr2=0x7fc5ec10d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:35.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.181+0000 7fc5f2941700 1 --2- 172.21.15.47:0/2681068826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5ec0fcef0 0x7fc5ec10d8f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc007d40 tx=0x7fc5dc009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:35.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.181+0000 7fc5f2941700 1 -- 172.21.15.47:0/2681068826 shutdown_connections 2024-02-07T12:25:35.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.181+0000 7fc5f2941700 1 --2- 172.21.15.47:0/2681068826 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fc5d40389e0 0x7fc5d403ae90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:35.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.181+0000 7fc5f2941700 1 --2- 172.21.15.47:0/2681068826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5ec0fcef0 0x7fc5ec10d8f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:35.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.181+0000 7fc5f2941700 1 --2- 172.21.15.47:0/2681068826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0fe0e0 0x7fc5ec10de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:35.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.181+0000 7fc5f2941700 1 -- 172.21.15.47:0/2681068826 >> 172.21.15.47:0/2681068826 conn(0x7fc5ec0f8620 msgr2=0x7fc5ec1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:35.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.182+0000 7fc5f2941700 1 -- 172.21.15.47:0/2681068826 shutdown_connections 2024-02-07T12:25:35.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.182+0000 7fc5f2941700 1 -- 172.21.15.47:0/2681068826 wait complete. 2024-02-07T12:25:35.186 INFO:tasks.workunit.client.1.smithi138.stdout:2/682: mkdir d3/dd/d14/d49/df8 0 2024-02-07T12:25:35.187 INFO:tasks.workunit.client.1.smithi138.stdout:2/683: dread d3/dd/d19/f42 [0,4194304] 0 2024-02-07T12:25:35.187 INFO:tasks.workunit.client.1.smithi138.stdout:2/684: chown d3/dd/d19/f72 68933341 1 2024-02-07T12:25:35.187 INFO:tasks.workunit.client.1.smithi138.stdout:6/594: dread dc/d13/d1e/f84 [0,4194304] 0 2024-02-07T12:25:35.187 INFO:tasks.workunit.client.1.smithi138.stdout:0/587: dwrite d4/d9/d37/fae [0,4194304] 0 2024-02-07T12:25:35.188 INFO:tasks.workunit.client.1.smithi138.stdout:1/506: rename d5/d8/da/d1f/d27 to d5/d8/da/d1f/d5e/db5 0 2024-02-07T12:25:35.189 INFO:tasks.workunit.client.1.smithi138.stdout:1/507: readlink d5/d4b/d72/l89 0 2024-02-07T12:25:35.189 INFO:tasks.workunit.client.1.smithi138.stdout:2/685: read d3/dd/d19/d1f/fa2 [852477,106364] 0 2024-02-07T12:25:35.191 INFO:tasks.workunit.client.1.smithi138.stdout:0/588: rmdir d4/d9/d33/db9 0 2024-02-07T12:25:35.191 INFO:tasks.workunit.client.1.smithi138.stdout:0/589: truncate d4/d9/db/d71/f7c 1013591 0 2024-02-07T12:25:35.191 INFO:tasks.workunit.client.1.smithi138.stdout:0/590: chown d4/d9/d37/f8d 417366 1 2024-02-07T12:25:35.191 INFO:tasks.workunit.client.1.smithi138.stdout:0/591: stat d4/d9/de/l1e 0 2024-02-07T12:25:35.192 INFO:tasks.workunit.client.1.smithi138.stdout:0/592: truncate d4/d52/f44 1856362 0 2024-02-07T12:25:35.192 INFO:tasks.workunit.client.1.smithi138.stdout:0/593: write d4/d9/db/f20 [1243977,92018] 0 2024-02-07T12:25:35.192 INFO:tasks.workunit.client.1.smithi138.stdout:0/594: dread - d4/d69/fbd zero size 2024-02-07T12:25:35.193 INFO:tasks.workunit.client.1.smithi138.stdout:5/585: rename da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d91/l94 to da/d43/d4a/d98/lc1 0 2024-02-07T12:25:35.193 INFO:tasks.workunit.client.1.smithi138.stdout:6/595: dread dc/d13/d1e/d4d/f9c [0,4194304] 0 2024-02-07T12:25:35.194 INFO:tasks.workunit.client.1.smithi138.stdout:1/508: link d5/d8/da/d1f/c93 d5/d8/da/d1f/d5e/d63/d99/cb6 0 2024-02-07T12:25:35.195 INFO:tasks.workunit.client.1.smithi138.stdout:1/509: write d5/d8/da/d1f/d5e/db5/d58/f8c [494208,38607] 0 2024-02-07T12:25:35.196 INFO:tasks.workunit.client.1.smithi138.stdout:2/686: symlink d3/dd/d19/d1f/lf9 0 2024-02-07T12:25:35.198 INFO:tasks.workunit.client.1.smithi138.stdout:5/586: rename da/d6d/f5a to da/d43/d4a/fc2 0 2024-02-07T12:25:35.199 INFO:tasks.workunit.client.1.smithi138.stdout:6/596: mknod dc/d13/d1e/d35/dc0/cc2 0 2024-02-07T12:25:35.199 INFO:tasks.workunit.client.1.smithi138.stdout:6/597: fsync dc/d13/d1e/f99 0 2024-02-07T12:25:35.200 INFO:tasks.workunit.client.1.smithi138.stdout:7/732: dwrite d0/d6/d1d/ff2 [0,4194304] 0 2024-02-07T12:25:35.200 INFO:tasks.workunit.client.1.smithi138.stdout:7/733: readlink d0/d8/d11/d26/d90/l83 0 2024-02-07T12:25:35.200 INFO:tasks.workunit.client.1.smithi138.stdout:0/595: dread d4/d9/de/d1d/d21/f86 [0,4194304] 0 2024-02-07T12:25:35.200 INFO:tasks.workunit.client.1.smithi138.stdout:2/687: unlink d3/dd/d19/d1f/d46/cdd 0 2024-02-07T12:25:35.200 INFO:tasks.workunit.client.1.smithi138.stdout:0/596: chown d4/d9/d37/d3d/d9c/dad 693617021 1 2024-02-07T12:25:35.204 INFO:tasks.workunit.client.1.smithi138.stdout:6/598: unlink dc/d31/d54/c76 0 2024-02-07T12:25:35.205 INFO:tasks.workunit.client.1.smithi138.stdout:6/599: chown dc/d13/d1e/d35/dc0/cc2 20910764 1 2024-02-07T12:25:35.206 INFO:tasks.workunit.client.1.smithi138.stdout:2/688: creat d3/dd/d14/d8f/d73/d80/ffa x:0 0 0 2024-02-07T12:25:35.206 INFO:tasks.workunit.client.1.smithi138.stdout:2/689: chown d3/dd/d19/d44/le3 102528154 1 2024-02-07T12:25:35.206 INFO:tasks.workunit.client.1.smithi138.stdout:2/690: write d3/dd/d19/d44/f69 [3262326,79518] 0 2024-02-07T12:25:35.206 INFO:tasks.workunit.client.1.smithi138.stdout:7/734: dread d0/d39/f9c [0,4194304] 0 2024-02-07T12:25:35.208 INFO:tasks.workunit.client.1.smithi138.stdout:5/587: unlink da/l4c 0 2024-02-07T12:25:35.208 INFO:tasks.workunit.client.1.smithi138.stdout:0/597: dread d4/d9/de/d1d/f54 [0,4194304] 0 2024-02-07T12:25:35.209 INFO:tasks.workunit.client.1.smithi138.stdout:6/600: rmdir dc/d69 39 2024-02-07T12:25:35.210 INFO:tasks.workunit.client.1.smithi138.stdout:6/601: dread - dc/d31/f72 zero size 2024-02-07T12:25:35.210 INFO:tasks.workunit.client.1.smithi138.stdout:6/602: write dc/d31/d3f/f52 [1917003,101861] 0 2024-02-07T12:25:35.210 INFO:tasks.workunit.client.1.smithi138.stdout:6/603: readlink dc/l98 0 2024-02-07T12:25:35.210 INFO:tasks.workunit.client.1.smithi138.stdout:2/691: symlink d3/dd/d14/d49/lfb 0 2024-02-07T12:25:35.213 INFO:tasks.workunit.client.1.smithi138.stdout:1/510: dwrite d5/d8/da/d1f/d3c/d59/f77 [0,4194304] 0 2024-02-07T12:25:35.214 INFO:tasks.workunit.client.1.smithi138.stdout:1/511: chown d5/d8/da/d1f/d5e/db5/d58/f8b 40 1 2024-02-07T12:25:35.214 INFO:tasks.workunit.client.1.smithi138.stdout:7/735: mkdir d0/d6/d19/de8/df3 0 2024-02-07T12:25:35.216 INFO:tasks.workunit.client.1.smithi138.stdout:5/588: link da/d43/d4a/d69/f6f da/d34/dbd/fc3 0 2024-02-07T12:25:35.218 INFO:tasks.workunit.client.1.smithi138.stdout:0/598: mknod d4/d9/d37/d64/d9d/cc2 0 2024-02-07T12:25:35.218 INFO:tasks.workunit.client.1.smithi138.stdout:0/599: write d4/d9/d37/f3a [4101731,45578] 0 2024-02-07T12:25:35.219 INFO:tasks.workunit.client.1.smithi138.stdout:6/604: link dc/d13/d1e/f2f dc/d31/d38/fc3 0 2024-02-07T12:25:35.223 INFO:tasks.workunit.client.1.smithi138.stdout:1/512: mkdir d5/d8/da/d1f/d3c/db7 0 2024-02-07T12:25:35.223 INFO:tasks.workunit.client.1.smithi138.stdout:1/513: chown d5/d8/da/d1f/d5e/db5/d68/l85 8 1 2024-02-07T12:25:35.226 INFO:tasks.workunit.client.1.smithi138.stdout:7/736: creat d0/d8/d11/d26/d90/ff4 x:0 0 0 2024-02-07T12:25:35.226 INFO:tasks.workunit.client.1.smithi138.stdout:7/737: fsync d0/d8/d15/db1/fc9 0 2024-02-07T12:25:35.233 INFO:tasks.workunit.client.1.smithi138.stdout:5/589: unlink da/d6d/d27/d2e/d4f/d2b/d35/d5d/fa5 0 2024-02-07T12:25:35.236 INFO:tasks.workunit.client.1.smithi138.stdout:0/600: link d4/d9/de/d1d/f36 d4/d9/de/fc3 0 2024-02-07T12:25:35.240 INFO:tasks.workunit.client.1.smithi138.stdout:7/738: dwrite d0/d6/d84/fd0 [0,4194304] 0 2024-02-07T12:25:35.240 INFO:tasks.workunit.client.1.smithi138.stdout:7/739: read - d0/d6/d76/fa5 zero size 2024-02-07T12:25:35.241 INFO:tasks.workunit.client.1.smithi138.stdout:6/605: mkdir dc/d73/dc4 0 2024-02-07T12:25:35.241 INFO:tasks.workunit.client.1.smithi138.stdout:6/606: fsync dc/d13/f19 0 2024-02-07T12:25:35.243 INFO:tasks.workunit.client.1.smithi138.stdout:5/590: write da/d34/dbd/fc3 [1305772,69099] 0 2024-02-07T12:25:35.243 INFO:tasks.workunit.client.1.smithi138.stdout:5/591: chown da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d96/l81 79299373 1 2024-02-07T12:25:35.244 INFO:tasks.workunit.client.1.smithi138.stdout:1/514: rmdir d5/d8/da/d1f/d5e/d63/d99 39 2024-02-07T12:25:35.247 INFO:tasks.workunit.client.1.smithi138.stdout:6/607: dread dc/d13/f87 [0,4194304] 0 2024-02-07T12:25:35.253 INFO:tasks.workunit.client.1.smithi138.stdout:0/601: link d4/d9/db/d39/faa d4/d9/db/d39/d4b/d6c/d8f/fc4 0 2024-02-07T12:25:35.254 INFO:tasks.workunit.client.1.smithi138.stdout:0/602: write d4/f6 [997943,84256] 0 2024-02-07T12:25:35.254 INFO:tasks.workunit.client.1.smithi138.stdout:0/603: readlink d4/d9/db/d39/d4b/d6c/l6d 0 2024-02-07T12:25:35.262 INFO:tasks.workunit.client.1.smithi138.stdout:7/740: dwrite d0/d8/d11/d1f/f77 [4194304,4194304] 0 2024-02-07T12:25:35.263 INFO:tasks.workunit.client.1.smithi138.stdout:1/515: dwrite d5/f2a [0,4194304] 0 2024-02-07T12:25:35.263 INFO:tasks.workunit.client.1.smithi138.stdout:1/516: getdents d5/d8/da/d1f/d3c/db7 0 2024-02-07T12:25:35.263 INFO:tasks.workunit.client.1.smithi138.stdout:5/592: symlink da/d6d/d27/d2e/d4f/d2b/d35/lc4 0 2024-02-07T12:25:35.264 INFO:tasks.workunit.client.1.smithi138.stdout:6/608: rmdir dc/d13/d1e/d35/dc0 39 2024-02-07T12:25:35.268 INFO:tasks.workunit.client.1.smithi138.stdout:0/604: unlink d4/d9/db/d39/faa 0 2024-02-07T12:25:35.268 INFO:tasks.workunit.client.1.smithi138.stdout:0/605: chown d4/d9/d37/d3d 0 1 2024-02-07T12:25:35.270 INFO:tasks.workunit.client.1.smithi138.stdout:7/741: mknod d0/d8/d11/d5f/d86/cf5 0 2024-02-07T12:25:35.272 INFO:tasks.workunit.client.1.smithi138.stdout:3/681: sync 2024-02-07T12:25:35.272 INFO:tasks.workunit.client.1.smithi138.stdout:8/727: sync 2024-02-07T12:25:35.272 INFO:tasks.workunit.client.1.smithi138.stdout:8/728: dread - d1/de/db4/db8/d17/f8c zero size 2024-02-07T12:25:35.273 INFO:tasks.workunit.client.1.smithi138.stdout:6/609: dread dc/d31/d38/d9a/fa9 [0,4194304] 0 2024-02-07T12:25:35.274 INFO:tasks.workunit.client.1.smithi138.stdout:1/517: rename d5/d8/da/d1f/d3c/db7 to d5/d8/da/d1f/d5e/db8 0 2024-02-07T12:25:35.280 INFO:tasks.workunit.client.1.smithi138.stdout:5/593: symlink da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d96/lc5 0 2024-02-07T12:25:35.282 INFO:tasks.workunit.client.1.smithi138.stdout:1/518: dread d5/d8/da/d1f/f25 [0,4194304] 0 2024-02-07T12:25:35.282 INFO:tasks.workunit.client.1.smithi138.stdout:1/519: chown d5/d8/da/d1f/d5e 40730 1 2024-02-07T12:25:35.290 INFO:tasks.workunit.client.1.smithi138.stdout:7/742: mkdir d0/d39/dea/df6 0 2024-02-07T12:25:35.291 INFO:tasks.workunit.client.1.smithi138.stdout:4/544: sync 2024-02-07T12:25:35.291 INFO:tasks.workunit.client.1.smithi138.stdout:9/502: sync 2024-02-07T12:25:35.291 INFO:tasks.workunit.client.1.smithi138.stdout:2/692: sync 2024-02-07T12:25:35.291 INFO:tasks.workunit.client.1.smithi138.stdout:4/545: write d20/f24 [382968,14501] 0 2024-02-07T12:25:35.291 INFO:tasks.workunit.client.1.smithi138.stdout:4/546: chown d20/d34/d59/d88/d8d 7826 1 2024-02-07T12:25:35.291 INFO:tasks.workunit.client.1.smithi138.stdout:4/547: stat d20/d47/d69/c9c 0 2024-02-07T12:25:35.292 INFO:tasks.workunit.client.1.smithi138.stdout:2/693: creat d3/dd/d14/d82/ffc x:0 0 0 2024-02-07T12:25:35.292 INFO:tasks.workunit.client.1.smithi138.stdout:4/548: creat d20/d4d/fad x:0 0 0 2024-02-07T12:25:35.292 INFO:tasks.workunit.client.1.smithi138.stdout:1/520: dread d5/d8/da/d1f/d3c/d59/f55 [0,4194304] 0 2024-02-07T12:25:35.292 INFO:tasks.workunit.client.1.smithi138.stdout:1/521: dread - d5/d8/da/f47 zero size 2024-02-07T12:25:35.292 INFO:tasks.workunit.client.1.smithi138.stdout:3/682: dwrite d5/d27/d35/f50 [0,4194304] 0 2024-02-07T12:25:35.292 INFO:tasks.workunit.client.1.smithi138.stdout:3/683: fdatasync d5/d27/d35/f6f 0 2024-02-07T12:25:35.293 INFO:tasks.workunit.client.1.smithi138.stdout:8/729: creat d1/de/db4/db8/dae/fe0 x:0 0 0 2024-02-07T12:25:35.293 INFO:tasks.workunit.client.1.smithi138.stdout:8/730: stat d1/f6f 0 2024-02-07T12:25:35.293 INFO:tasks.workunit.client.1.smithi138.stdout:8/731: creat d1/de/db4/db8/d17/d3e/d72/dda/d4c/d62/fe1 x:0 0 0 2024-02-07T12:25:35.293 INFO:tasks.workunit.client.1.smithi138.stdout:8/732: stat d1/de/db4 0 2024-02-07T12:25:35.295 INFO:tasks.workunit.client.1.smithi138.stdout:0/606: rename d4/d9/d37/d64/db7 to d4/d9/db/d39/d4b/d6c/dc5 0 2024-02-07T12:25:35.296 INFO:tasks.workunit.client.1.smithi138.stdout:1/522: write d5/d8/da/d1f/f51 [2909036,75356] 0 2024-02-07T12:25:35.298 INFO:tasks.workunit.client.1.smithi138.stdout:5/594: mknod da/d6d/d27/d2e/d4f/d2b/d35/d40/cc6 0 2024-02-07T12:25:35.300 INFO:tasks.workunit.client.1.smithi138.stdout:4/549: write d20/d4d/f5a [3752456,50472] 0 2024-02-07T12:25:35.302 INFO:tasks.workunit.client.1.smithi138.stdout:8/733: dread d1/f85 [0,4194304] 0 2024-02-07T12:25:35.302 INFO:tasks.workunit.client.1.smithi138.stdout:8/734: stat d1/de/db4/db8/d17/d58 0 2024-02-07T12:25:35.302 INFO:tasks.workunit.client.1.smithi138.stdout:8/735: chown d1/f6f 5182 1 2024-02-07T12:25:35.303 INFO:tasks.workunit.client.1.smithi138.stdout:7/743: mkdir d0/d6/df7 0 2024-02-07T12:25:35.303 INFO:tasks.workunit.client.1.smithi138.stdout:7/744: write d0/d8/d15/db1/fca [892811,65396] 0 2024-02-07T12:25:35.303 INFO:tasks.workunit.client.1.smithi138.stdout:7/745: chown d0/d6/d84/fd0 90760 1 2024-02-07T12:25:35.303 INFO:tasks.workunit.client.1.smithi138.stdout:7/746: write d0/d39/f9c [3012034,5017] 0 2024-02-07T12:25:35.303 INFO:tasks.workunit.client.1.smithi138.stdout:7/747: stat d0/d6/d1d/ff2 0 2024-02-07T12:25:35.305 INFO:tasks.workunit.client.1.smithi138.stdout:9/503: unlink d0/d6/d8/d1d/f53 0 2024-02-07T12:25:35.306 INFO:tasks.workunit.client.1.smithi138.stdout:7/748: dread d0/d8/d11/d1f/f42 [0,4194304] 0 2024-02-07T12:25:35.306 INFO:tasks.workunit.client.1.smithi138.stdout:7/749: fdatasync d0/d8/d15/f18 0 2024-02-07T12:25:35.307 INFO:tasks.workunit.client.1.smithi138.stdout:7/750: truncate d0/d8/d11/d1f/f56 1399906 0 2024-02-07T12:25:35.307 INFO:tasks.workunit.client.1.smithi138.stdout:2/694: dwrite d3/d4e/f50 [0,4194304] 0 2024-02-07T12:25:35.307 INFO:tasks.workunit.client.1.smithi138.stdout:2/695: creat d3/dd/d19/d44/d7d/d97/ffd x:0 0 0 2024-02-07T12:25:35.312 INFO:tasks.workunit.client.1.smithi138.stdout:6/610: rename dc/d31/d38/d9a/la4 to dc/d13/d1e/d35/d85/dba/lc5 0 2024-02-07T12:25:35.313 INFO:tasks.workunit.client.1.smithi138.stdout:1/523: rmdir d5/d8/da/d1f/d5e 39 2024-02-07T12:25:35.313 INFO:tasks.workunit.client.1.smithi138.stdout:5/595: stat da/f29 0 2024-02-07T12:25:35.314 INFO:tasks.workunit.client.1.smithi138.stdout:4/550: rmdir d20/d47/d69/d7c/dac 0 2024-02-07T12:25:35.315 INFO:tasks.workunit.client.1.smithi138.stdout:9/504: symlink d0/d6/d8/d95/l97 0 2024-02-07T12:25:35.317 INFO:tasks.workunit.client.1.smithi138.stdout:7/751: read - d0/d8/d11/d26/d90/f7d zero size 2024-02-07T12:25:35.318 INFO:tasks.workunit.client.1.smithi138.stdout:7/752: dread - d0/d8/d11/d26/d90/f72 zero size 2024-02-07T12:25:35.319 INFO:tasks.workunit.client.1.smithi138.stdout:2/696: mkdir d3/dd/d14/d8f/dbc/dfe 0 2024-02-07T12:25:35.320 INFO:tasks.workunit.client.1.smithi138.stdout:2/697: chown d3/dd/d14/d82/ca1 81 1 2024-02-07T12:25:35.320 INFO:tasks.workunit.client.1.smithi138.stdout:2/698: creat d3/dd/d14/d82/fff x:0 0 0 2024-02-07T12:25:35.325 INFO:tasks.workunit.client.1.smithi138.stdout:4/551: dread d20/f21 [0,4194304] 0 2024-02-07T12:25:35.328 INFO:tasks.workunit.client.1.smithi138.stdout:6/611: unlink dc/d13/d1e/d35/d6d/c90 0 2024-02-07T12:25:35.328 INFO:tasks.workunit.client.1.smithi138.stdout:6/612: creat dc/fc6 x:0 0 0 2024-02-07T12:25:35.329 INFO:tasks.workunit.client.1.smithi138.stdout:0/607: mknod d4/d9/cc6 0 2024-02-07T12:25:35.331 INFO:tasks.workunit.client.1.smithi138.stdout:1/524: mknod d5/d8/da/cb9 0 2024-02-07T12:25:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.329+0000 7f7a7855a700 1 -- 172.21.15.47:0/1625401814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a701003a0 msgr2=0x7f7a70102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.329+0000 7f7a7855a700 1 --2- 172.21.15.47:0/1625401814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a701003a0 0x7f7a70102780 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7a60004940 tx=0x7f7a60009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.329+0000 7f7a7855a700 1 -- 172.21.15.47:0/1625401814 shutdown_connections 2024-02-07T12:25:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.329+0000 7f7a7855a700 1 --2- 172.21.15.47:0/1625401814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a701003a0 0x7f7a70102780 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.329+0000 7f7a7855a700 1 --2- 172.21.15.47:0/1625401814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a700fda80 0x7f7a700ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.329+0000 7f7a7855a700 1 -- 172.21.15.47:0/1625401814 >> 172.21.15.47:0/1625401814 conn(0x7f7a700f7500 msgr2=0x7f7a700f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.329+0000 7f7a7855a700 1 -- 172.21.15.47:0/1625401814 shutdown_connections 2024-02-07T12:25:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.329+0000 7f7a7855a700 1 -- 172.21.15.47:0/1625401814 wait complete. 2024-02-07T12:25:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.330+0000 7f7a7855a700 1 Processor -- start 2024-02-07T12:25:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.330+0000 7f7a7855a700 1 -- start start 2024-02-07T12:25:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.330+0000 7f7a7855a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a700fda80 0x7f7a7010d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.330+0000 7f7a7855a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a701003a0 0x7f7a7010de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.330+0000 7f7a7855a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7010e400 con 0x7f7a701003a0 2024-02-07T12:25:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.330+0000 7f7a7855a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7010eca0 con 0x7f7a700fda80 2024-02-07T12:25:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.330+0000 7f7a75af5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a701003a0 0x7f7a7010de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.330+0000 7f7a75af5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a701003a0 0x7f7a7010de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40084/0 (socket says 172.21.15.47:40084) 2024-02-07T12:25:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.330+0000 7f7a762f6700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a700fda80 0x7f7a7010d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.330+0000 7f7a75af5700 1 -- 172.21.15.47:0/3978537353 learned_addr learned my addr 172.21.15.47:0/3978537353 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:25:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.330+0000 7f7a762f6700 1 -- 172.21.15.47:0/3978537353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a701003a0 msgr2=0x7f7a7010de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:35.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.330+0000 7f7a762f6700 1 --2- 172.21.15.47:0/3978537353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a701003a0 0x7f7a7010de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:35.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.330+0000 7f7a762f6700 1 -- 172.21.15.47:0/3978537353 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a60005040 con 0x7f7a700fda80 2024-02-07T12:25:35.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.331+0000 7f7a762f6700 1 --2- 172.21.15.47:0/3978537353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a700fda80 0x7f7a7010d8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009fd0 tx=0x7f7a6c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:35.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.331+0000 7f7a66ffd700 1 -- 172.21.15.47:0/3978537353 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a6c004e90 con 0x7f7a700fda80 2024-02-07T12:25:35.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.331+0000 7f7a7855a700 1 -- 172.21.15.47:0/3978537353 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7010ef20 con 0x7f7a700fda80 2024-02-07T12:25:35.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.331+0000 7f7a66ffd700 1 -- 172.21.15.47:0/3978537353 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a6c00f040 con 0x7f7a700fda80 2024-02-07T12:25:35.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.331+0000 7f7a66ffd700 1 -- 172.21.15.47:0/3978537353 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a6c00ca50 con 0x7f7a700fda80 2024-02-07T12:25:35.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.331+0000 7f7a7855a700 1 -- 172.21.15.47:0/3978537353 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7010f460 con 0x7f7a700fda80 2024-02-07T12:25:35.337 INFO:tasks.workunit.client.1.smithi138.stdout:5/596: rmdir da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d96 39 2024-02-07T12:25:35.338 INFO:tasks.workunit.client.1.smithi138.stdout:8/736: mkdir d1/de/db4/db8/d17/d3e/d89/de2 0 2024-02-07T12:25:35.338 INFO:tasks.workunit.client.1.smithi138.stdout:8/737: write d1/de/db4/db8/d17/d8a/fb5 [628155,98736] 0 2024-02-07T12:25:35.338 INFO:tasks.workunit.client.1.smithi138.stdout:7/753: mkdir d0/d8/d11/d5f/df8 0 2024-02-07T12:25:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.332+0000 7f7a66ffd700 1 -- 172.21.15.47:0/3978537353 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 23) v1 ==== 45878+0+0 (secure 0 0 0) 0x7f7a6c00cc00 con 0x7f7a700fda80 2024-02-07T12:25:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.332+0000 7f7a7855a700 1 -- 172.21.15.47:0/3978537353 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a70107a50 con 0x7f7a700fda80 2024-02-07T12:25:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.332+0000 7f7a66ffd700 1 --2- 172.21.15.47:0/3978537353 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f7a5c0389e0 0x7f7a5c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:25:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.332+0000 7f7a66ffd700 1 -- 172.21.15.47:0/3978537353 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7a6c04bfb0 con 0x7f7a700fda80 2024-02-07T12:25:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.333+0000 7f7a75af5700 1 --2- 172.21.15.47:0/3978537353 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f7a5c0389e0 0x7f7a5c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:25:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.333+0000 7f7a75af5700 1 --2- 172.21.15.47:0/3978537353 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f7a5c0389e0 0x7f7a5c03ae90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000b0d0 tx=0x7f7a60009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:25:35.339 INFO:tasks.workunit.client.1.smithi138.stdout:2/699: symlink d3/dd/d14/d8f/d73/l100 0 2024-02-07T12:25:35.339 INFO:tasks.workunit.client.1.smithi138.stdout:2/700: stat d3/dd/d19/l2f 0 2024-02-07T12:25:35.339 INFO:tasks.workunit.client.1.smithi138.stdout:2/701: getdents d3/dd/d14/d8f/dbc/dfe 0 2024-02-07T12:25:35.339 INFO:tasks.workunit.client.1.smithi138.stdout:2/702: write d3/dd/fe5 [855259,32062] 0 2024-02-07T12:25:35.340 INFO:tasks.workunit.client.1.smithi138.stdout:4/552: mknod d20/d53/cae 0 2024-02-07T12:25:35.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.342+0000 7f7a66ffd700 1 -- 172.21.15.47:0/3978537353 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f7a6c01b2c0 con 0x7f7a700fda80 2024-02-07T12:25:35.344 INFO:tasks.workunit.client.1.smithi138.stdout:4/553: dread d20/f39 [0,4194304] 0 2024-02-07T12:25:35.345 INFO:tasks.workunit.client.1.smithi138.stdout:6/613: mkdir dc/d13/d1e/dc7 0 2024-02-07T12:25:35.347 INFO:tasks.workunit.client.1.smithi138.stdout:0/608: creat d4/d9/de/fc7 x:0 0 0 2024-02-07T12:25:35.348 INFO:tasks.workunit.client.1.smithi138.stdout:1/525: creat d5/d8/da/d1f/d5e/d63/d99/fba x:0 0 0 2024-02-07T12:25:35.350 INFO:tasks.workunit.client.1.smithi138.stdout:5/597: mknod da/d6d/d27/d2e/d4f/cc7 0 2024-02-07T12:25:35.350 INFO:tasks.workunit.client.1.smithi138.stdout:5/598: getdents da/d6d/d27/d2e/d4f/da3 0 2024-02-07T12:25:35.351 INFO:tasks.workunit.client.1.smithi138.stdout:8/738: getdents d1/de/db4/db8/d17/d3e/d72/dda/d4c 0 2024-02-07T12:25:35.352 INFO:tasks.workunit.client.1.smithi138.stdout:7/754: creat d0/d6/ff9 x:0 0 0 2024-02-07T12:25:35.353 INFO:tasks.workunit.client.1.smithi138.stdout:2/703: mkdir d3/dd/d14/d8f/dbc/dbd/d101 0 2024-02-07T12:25:35.356 INFO:tasks.workunit.client.1.smithi138.stdout:3/684: rename d5/d15 to d5/d26/d5e/d86/ded 0 2024-02-07T12:25:35.357 INFO:tasks.workunit.client.1.smithi138.stdout:3/685: creat d5/d26/d28/fee x:0 0 0 2024-02-07T12:25:35.357 INFO:tasks.workunit.client.1.smithi138.stdout:4/554: getdents d20/d34/d59/d88/d8d 0 2024-02-07T12:25:35.359 INFO:tasks.workunit.client.1.smithi138.stdout:6/614: rename dc/d31/f7a to dc/d31/fc8 0 2024-02-07T12:25:35.360 INFO:tasks.workunit.client.1.smithi138.stdout:6/615: creat dc/d31/fc9 x:0 0 0 2024-02-07T12:25:35.360 INFO:tasks.workunit.client.1.smithi138.stdout:6/616: truncate dc/d13/d1e/d35/d85/fad 1170856 0 2024-02-07T12:25:35.361 INFO:tasks.workunit.client.1.smithi138.stdout:0/609: symlink d4/d9/d37/d64/d9a/db0/lc8 0 2024-02-07T12:25:35.361 INFO:tasks.workunit.client.1.smithi138.stdout:0/610: readlink d4/d9/de/d1d/l5d 0 2024-02-07T12:25:35.362 INFO:tasks.workunit.client.1.smithi138.stdout:8/739: unlink d1/de/db4/db8/d17/d8a/d8d/fb2 0 2024-02-07T12:25:35.363 INFO:tasks.workunit.client.1.smithi138.stdout:7/755: mkdir d0/d8/d11/d63/dc8/dce/dd7/dfa 0 2024-02-07T12:25:35.365 INFO:tasks.workunit.client.1.smithi138.stdout:2/704: rename d3/dd/d19/d1f/lf9 to d3/dd/d14/d8f/d73/l102 0 2024-02-07T12:25:35.365 INFO:tasks.workunit.client.1.smithi138.stdout:2/705: stat d3/dd/d19/d44/d7d/l90 0 2024-02-07T12:25:35.365 INFO:tasks.workunit.client.1.smithi138.stdout:2/706: creat d3/dd/d14/d49/d25/d3d/f103 x:0 0 0 2024-02-07T12:25:35.365 INFO:tasks.workunit.client.1.smithi138.stdout:2/707: chown d3/dd/d19/d1f/d37/fbe 2370 1 2024-02-07T12:25:35.366 INFO:tasks.workunit.client.1.smithi138.stdout:3/686: link d5/d26/d90/fa7 d5/d27/d35/d7c/fef 0 2024-02-07T12:25:35.366 INFO:tasks.workunit.client.1.smithi138.stdout:3/687: chown d5/d26/d5e/d77/cce 150545 1 2024-02-07T12:25:35.366 INFO:tasks.workunit.client.1.smithi138.stdout:6/617: dread dc/d13/d1e/d35/f4c [0,4194304] 0 2024-02-07T12:25:35.366 INFO:tasks.workunit.client.1.smithi138.stdout:6/618: chown dc/d31/d38/c4e 6598471 1 2024-02-07T12:25:35.366 INFO:tasks.workunit.client.1.smithi138.stdout:1/526: dwrite d5/d4b/d6b/d6e/fad [0,4194304] 0 2024-02-07T12:25:35.367 INFO:tasks.workunit.client.1.smithi138.stdout:1/527: fsync d5/d8/da/d4a/fb0 0 2024-02-07T12:25:35.367 INFO:tasks.workunit.client.1.smithi138.stdout:4/555: getdents d20/d34/d73 0 2024-02-07T12:25:35.367 INFO:tasks.workunit.client.1.smithi138.stdout:4/556: write d20/f2f [139012,42121] 0 2024-02-07T12:25:35.367 INFO:tasks.workunit.client.1.smithi138.stdout:4/557: write d20/f2e [1235208,4997] 0 2024-02-07T12:25:35.368 INFO:tasks.workunit.client.1.smithi138.stdout:4/558: dread - d20/d47/f93 zero size 2024-02-07T12:25:35.368 INFO:tasks.workunit.client.1.smithi138.stdout:5/599: creat da/d43/d4a/d98/fc8 x:0 0 0 2024-02-07T12:25:35.368 INFO:tasks.workunit.client.1.smithi138.stdout:5/600: creat da/d6d/d27/d2e/d4f/fc9 x:0 0 0 2024-02-07T12:25:35.369 INFO:tasks.workunit.client.1.smithi138.stdout:8/740: mkdir d1/de/de3 0 2024-02-07T12:25:35.369 INFO:tasks.workunit.client.1.smithi138.stdout:7/756: symlink d0/d8/d11/d63/dc8/dce/dd7/dfa/lfb 0 2024-02-07T12:25:35.369 INFO:tasks.workunit.client.1.smithi138.stdout:7/757: fsync d0/d6/d76/d93/fdc 0 2024-02-07T12:25:35.371 INFO:tasks.workunit.client.1.smithi138.stdout:2/708: truncate d3/dd/d19/d1f/d46/d71/faa 844107 0 2024-02-07T12:25:35.372 INFO:tasks.workunit.client.1.smithi138.stdout:3/688: creat d5/d26/d9b/ff0 x:0 0 0 2024-02-07T12:25:35.372 INFO:tasks.workunit.client.1.smithi138.stdout:3/689: fsync d5/d26/d28/f5d 0 2024-02-07T12:25:35.372 INFO:tasks.workunit.client.1.smithi138.stdout:3/690: write d5/d27/d35/d7c/fef [975516,124992] 0 2024-02-07T12:25:35.372 INFO:tasks.workunit.client.1.smithi138.stdout:3/691: write d5/d26/d4e/f8c [2362441,49029] 0 2024-02-07T12:25:35.378 INFO:tasks.workunit.client.1.smithi138.stdout:6/619: write dc/d31/d54/f5c [614741,42571] 0 2024-02-07T12:25:35.378 INFO:tasks.workunit.client.1.smithi138.stdout:4/559: symlink d20/d34/d73/laf 0 2024-02-07T12:25:35.378 INFO:tasks.workunit.client.1.smithi138.stdout:1/528: link d5/d4b/d6b/d6e/fad d5/d8/fbb 0 2024-02-07T12:25:35.378 INFO:tasks.workunit.client.1.smithi138.stdout:1/529: stat d5/d4b/f5d 0 2024-02-07T12:25:35.378 INFO:tasks.workunit.client.1.smithi138.stdout:3/692: mkdir d5/d26/d28/df1 0 2024-02-07T12:25:35.378 INFO:tasks.workunit.client.1.smithi138.stdout:3/693: fsync d5/f9 0 2024-02-07T12:25:35.387 INFO:tasks.workunit.client.1.smithi138.stdout:6/620: creat dc/d31/d3f/fca x:0 0 0 2024-02-07T12:25:35.387 INFO:tasks.workunit.client.1.smithi138.stdout:2/709: dread d3/dd/d14/d8f/d73/d80/f85 [0,4194304] 0 2024-02-07T12:25:35.388 INFO:tasks.workunit.client.1.smithi138.stdout:1/530: write d5/f86 [2782422,79044] 0 2024-02-07T12:25:35.388 INFO:tasks.workunit.client.1.smithi138.stdout:1/531: chown d5/d8/fbb 1853323942 1 2024-02-07T12:25:35.388 INFO:tasks.workunit.client.1.smithi138.stdout:1/532: chown d5/d4b 49 1 2024-02-07T12:25:35.390 INFO:tasks.workunit.client.1.smithi138.stdout:4/560: rename d20/d53/f5d to d20/d34/d36/d55/d74/fb0 0 2024-02-07T12:25:35.390 INFO:tasks.workunit.client.1.smithi138.stdout:4/561: fdatasync d20/d4d/f62 0 2024-02-07T12:25:35.390 INFO:tasks.workunit.client.1.smithi138.stdout:4/562: dread - d20/d4d/d87/faa zero size 2024-02-07T12:25:35.390 INFO:tasks.workunit.client.1.smithi138.stdout:4/563: chown d20/f21 56789999 1 2024-02-07T12:25:35.392 INFO:tasks.workunit.client.1.smithi138.stdout:3/694: creat d5/d26/d9b/dab/dc4/dd0/ff2 x:0 0 0 2024-02-07T12:25:35.392 INFO:tasks.workunit.client.1.smithi138.stdout:3/695: write d5/d26/d5e/d86/ded/fc6 [3345358,121824] 0 2024-02-07T12:25:35.392 INFO:tasks.workunit.client.1.smithi138.stdout:3/696: chown d5/c8 4477143 1 2024-02-07T12:25:35.392 INFO:tasks.workunit.client.1.smithi138.stdout:3/697: read d5/d27/f88 [482958,23120] 0 2024-02-07T12:25:35.394 INFO:tasks.workunit.client.1.smithi138.stdout:5/601: mkdir da/d22/d99/dca 0 2024-02-07T12:25:35.394 INFO:tasks.workunit.client.1.smithi138.stdout:5/602: fsync da/d43/d4a/f9d 0 2024-02-07T12:25:35.394 INFO:tasks.workunit.client.1.smithi138.stdout:7/758: dwrite d0/d8/d15/f47 [0,4194304] 0 2024-02-07T12:25:35.395 INFO:tasks.workunit.client.1.smithi138.stdout:7/759: chown d0/d6/d19/f29 1124785 1 2024-02-07T12:25:35.395 INFO:tasks.workunit.client.1.smithi138.stdout:7/760: chown d0/d8/d11/d1f/l81 393833279 1 2024-02-07T12:25:35.396 INFO:tasks.workunit.client.1.smithi138.stdout:6/621: creat dc/d13/d1e/dae/fcb x:0 0 0 2024-02-07T12:25:35.397 INFO:tasks.workunit.client.1.smithi138.stdout:0/611: dwrite d4/d52/f44 [0,4194304] 0 2024-02-07T12:25:35.397 INFO:tasks.workunit.client.1.smithi138.stdout:2/710: stat d3/dd/d14/d8f/dbc/df6/lc8 0 2024-02-07T12:25:35.401 INFO:tasks.workunit.client.1.smithi138.stdout:3/698: dread d5/f2f [0,4194304] 0 2024-02-07T12:25:35.401 INFO:tasks.workunit.client.1.smithi138.stdout:3/699: fsync d5/d26/d28/db7/fbd 0 2024-02-07T12:25:35.401 INFO:tasks.workunit.client.1.smithi138.stdout:3/700: dread - d5/d26/d5e/d86/ded/f41 zero size 2024-02-07T12:25:35.401 INFO:tasks.workunit.client.1.smithi138.stdout:3/701: read - d5/d34/fd2 zero size 2024-02-07T12:25:35.401 INFO:tasks.workunit.client.1.smithi138.stdout:3/702: chown d5/f24 0 1 2024-02-07T12:25:35.402 INFO:tasks.workunit.client.1.smithi138.stdout:8/741: dwrite d1/d8e/fa5 [4194304,4194304] 0 2024-02-07T12:25:35.402 INFO:tasks.workunit.client.1.smithi138.stdout:8/742: write d1/de/db4/db8/d17/d3e/fb1 [402955,6720] 0 2024-02-07T12:25:35.402 INFO:tasks.workunit.client.1.smithi138.stdout:8/743: readlink d1/de/db4/db8/d17/l34 0 2024-02-07T12:25:35.409 INFO:tasks.workunit.client.1.smithi138.stdout:4/564: creat d20/d47/d69/d7c/fb1 x:0 0 0 2024-02-07T12:25:35.415 INFO:tasks.workunit.client.1.smithi138.stdout:6/622: creat dc/d13/fcc x:0 0 0 2024-02-07T12:25:35.420 INFO:tasks.workunit.client.1.smithi138.stdout:0/612: mknod d4/d9/db/d71/cc9 0 2024-02-07T12:25:35.420 INFO:tasks.workunit.client.1.smithi138.stdout:5/603: dwrite f8 [4194304,4194304] 0 2024-02-07T12:25:35.420 INFO:tasks.workunit.client.1.smithi138.stdout:0/613: write d4/d9/db/f20 [4390843,75337] 0 2024-02-07T12:25:35.420 INFO:tasks.workunit.client.1.smithi138.stdout:0/614: chown d4/d9/f8e 1211900417 1 2024-02-07T12:25:35.421 INFO:tasks.workunit.client.1.smithi138.stdout:2/711: mknod d3/dd/d14/d8f/dbc/dbd/c104 0 2024-02-07T12:25:35.421 INFO:tasks.workunit.client.1.smithi138.stdout:2/712: creat d3/dd/d14/d8f/dbc/f105 x:0 0 0 2024-02-07T12:25:35.421 INFO:tasks.workunit.client.1.smithi138.stdout:2/713: fdatasync d3/dd/d14/d49/f98 0 2024-02-07T12:25:35.421 INFO:tasks.workunit.client.1.smithi138.stdout:7/761: dwrite d0/d8/d15/f6b [0,4194304] 0 2024-02-07T12:25:35.422 INFO:tasks.workunit.client.1.smithi138.stdout:1/533: mkdir d5/d8/dbc 0 2024-02-07T12:25:35.422 INFO:tasks.workunit.client.1.smithi138.stdout:1/534: fdatasync d5/d8/da/d1f/d3c/fa1 0 2024-02-07T12:25:35.423 INFO:tasks.workunit.client.1.smithi138.stdout:3/703: dwrite d5/d27/d35/dac/fb2 [0,4194304] 0 2024-02-07T12:25:35.426 INFO:tasks.workunit.client.1.smithi138.stdout:8/744: rename d1/de/db4/db8/dd3 to d1/de/db4/db8/d17/d8a/db6/de4 0 2024-02-07T12:25:35.430 INFO:tasks.workunit.client.1.smithi138.stdout:4/565: link d20/l4f d20/d34/lb2 0 2024-02-07T12:25:35.432 INFO:tasks.workunit.client.1.smithi138.stdout:6/623: mknod dc/d13/d1e/d35/d85/dba/ccd 0 2024-02-07T12:25:35.436 INFO:tasks.workunit.client.1.smithi138.stdout:0/615: mknod d4/d9/d37/d6b/cca 0 2024-02-07T12:25:35.439 INFO:tasks.workunit.client.1.smithi138.stdout:2/714: creat d3/dd/d14/d8f/d73/d80/df0/f106 x:0 0 0 2024-02-07T12:25:35.439 INFO:tasks.workunit.client.1.smithi138.stdout:2/715: write d3/dd/d19/d1f/f5d [190,106418] 0 2024-02-07T12:25:35.440 INFO:tasks.workunit.client.1.smithi138.stdout:6/624: dread dc/d69/f5e [0,4194304] 0 2024-02-07T12:25:35.441 INFO:tasks.workunit.client.1.smithi138.stdout:6/625: chown dc/d13/d1e/d35/d6d/da6 103949 1 2024-02-07T12:25:35.441 INFO:tasks.workunit.client.1.smithi138.stdout:6/626: read dc/d13/d1e/d35/fb0 [1390309,37946] 0 2024-02-07T12:25:35.450 INFO:tasks.workunit.client.1.smithi138.stdout:5/604: dwrite da/d6d/d27/d2e/d4f/d2b/d35/d5d/d73/fad [0,4194304] 0 2024-02-07T12:25:35.454 INFO:tasks.workunit.client.1.smithi138.stdout:7/762: truncate d0/d6/d3e/f68 3796099 0 2024-02-07T12:25:35.456 INFO:tasks.workunit.client.1.smithi138.stdout:1/535: mknod d5/d4b/d72/cbd 0 2024-02-07T12:25:35.456 INFO:tasks.workunit.client.1.smithi138.stdout:1/536: fdatasync d5/d8/da/d1f/d5e/db5/d58/f8c 0 2024-02-07T12:25:35.460 INFO:tasks.workunit.client.1.smithi138.stdout:3/704: link d5/d27/d35/l3f d5/d26/d9b/dab/dc4/lf3 0 2024-02-07T12:25:35.460 INFO:tasks.workunit.client.1.smithi138.stdout:3/705: stat d5/d26/d5e/d77/cce 0 2024-02-07T12:25:35.462 INFO:tasks.workunit.client.1.smithi138.stdout:4/566: link d20/d34/d59/d72/d77/c81 d20/d34/d59/d88/cb3 0 2024-02-07T12:25:35.465 INFO:tasks.workunit.client.1.smithi138.stdout:0/616: readlink d4/l35 0 2024-02-07T12:25:35.467 INFO:tasks.workunit.client.1.smithi138.stdout:2/716: symlink d3/d4e/l107 0 2024-02-07T12:25:35.468 INFO:tasks.workunit.client.1.smithi138.stdout:6/627: symlink dc/d31/d38/d9a/lce 0 2024-02-07T12:25:35.472 INFO:tasks.workunit.client.1.smithi138.stdout:7/763: truncate d0/d8/d11/f79 4148840 0 2024-02-07T12:25:35.474 INFO:tasks.workunit.client.1.smithi138.stdout:1/537: creat d5/d8/da/d1f/d5e/db5/d58/d76/fbe x:0 0 0 2024-02-07T12:25:35.476 INFO:tasks.workunit.client.1.smithi138.stdout:4/567: unlink d20/d4d/l5c 0 2024-02-07T12:25:35.478 INFO:tasks.workunit.client.1.smithi138.stdout:0/617: link d4/d9/d37/f8d d4/d9/db/fcb 0 2024-02-07T12:25:35.480 INFO:tasks.workunit.client.1.smithi138.stdout:2/717: symlink d3/dd/d19/l108 0 2024-02-07T12:25:35.484 INFO:tasks.workunit.client.1.smithi138.stdout:6/628: rmdir dc/d13/d1e/d35/d85/d88 39 2024-02-07T12:25:35.485 INFO:tasks.workunit.client.1.smithi138.stdout:6/629: creat dc/d31/d38/d9a/fcf x:0 0 0 2024-02-07T12:25:35.485 INFO:tasks.workunit.client.1.smithi138.stdout:6/630: fsync dc/d13/d8e/fb9 0 2024-02-07T12:25:35.485 INFO:tasks.workunit.client.1.smithi138.stdout:3/706: dwrite d5/d26/f60 [0,4194304] 0 2024-02-07T12:25:35.485 INFO:tasks.workunit.client.1.smithi138.stdout:1/538: rename d5/d8/da/d1f/d60/c7c to d5/d8/da/d1f/d5e/d62/cbf 0 2024-02-07T12:25:35.485 INFO:tasks.workunit.client.1.smithi138.stdout:1/539: truncate d5/d8/da/d1f/d5e/db5/d68/d73/d7b/f4e 2977254 0 2024-02-07T12:25:35.485 INFO:tasks.workunit.client.1.smithi138.stdout:1/540: readlink d5/d43/l94 0 2024-02-07T12:25:35.485 INFO:tasks.workunit.client.1.smithi138.stdout:1/541: chown d5/d8/c98 20671229 1 2024-02-07T12:25:35.485 INFO:tasks.workunit.client.1.smithi138.stdout:4/568: unlink d20/c2d 0 2024-02-07T12:25:35.485 INFO:tasks.workunit.client.1.smithi138.stdout:4/569: chown d20/d34/d36/d55/f58 11 1 2024-02-07T12:25:35.486 INFO:tasks.workunit.client.1.smithi138.stdout:2/718: creat d3/dd/d19/d1f/dc9/f109 x:0 0 0 2024-02-07T12:25:35.486 INFO:tasks.workunit.client.1.smithi138.stdout:9/505: sync 2024-02-07T12:25:35.486 INFO:tasks.workunit.client.1.smithi138.stdout:9/506: write d0/d6/d8/d1d/dd/d41/f79 [294783,51044] 0 2024-02-07T12:25:35.487 INFO:tasks.workunit.client.1.smithi138.stdout:9/507: truncate d0/d6/d8/d95/f96 627823 0 2024-02-07T12:25:35.490 INFO:tasks.workunit.client.1.smithi138.stdout:1/542: symlink d5/d8/da/d1f/d5e/lc0 0 2024-02-07T12:25:35.490 INFO:tasks.workunit.client.1.smithi138.stdout:1/543: fsync d5/d4b/fab 0 2024-02-07T12:25:35.493 INFO:tasks.workunit.client.1.smithi138.stdout:0/618: dwrite d4/d9/d37/f60 [0,4194304] 0 2024-02-07T12:25:35.493 INFO:tasks.workunit.client.1.smithi138.stdout:0/619: chown d4/d9/l83 8 1 2024-02-07T12:25:35.493 INFO:tasks.workunit.client.1.smithi138.stdout:0/620: chown d4/d52/d74/fb1 0 1 2024-02-07T12:25:35.494 INFO:tasks.workunit.client.1.smithi138.stdout:0/621: chown d4/d9/de/f45 0 1 2024-02-07T12:25:35.494 INFO:tasks.workunit.client.1.smithi138.stdout:0/622: truncate d4/d9/de/f72 1404489 0 2024-02-07T12:25:35.494 INFO:tasks.workunit.client.1.smithi138.stdout:3/707: rename d5/d26/d28/db7/ldb to d5/d27/d35/lf4 0 2024-02-07T12:25:35.494 INFO:tasks.workunit.client.1.smithi138.stdout:3/708: write d5/d26/d5e/f6e [476902,106890] 0 2024-02-07T12:25:35.496 INFO:tasks.workunit.client.1.smithi138.stdout:4/570: getdents d20/d53 0 2024-02-07T12:25:35.502 INFO:tasks.workunit.client.1.smithi138.stdout:1/544: read d5/d4b/f5d [2626938,48092] 0 2024-02-07T12:25:35.505 INFO:tasks.workunit.client.1.smithi138.stdout:3/709: rename d5/d27/d35/dac/fcd to d5/d26/d9b/dab/dc4/ff5 0 2024-02-07T12:25:35.506 INFO:tasks.workunit.client.1.smithi138.stdout:0/623: write d4/d52/d74/f99 [2534018,121731] 0 2024-02-07T12:25:35.508 INFO:tasks.workunit.client.1.smithi138.stdout:9/508: getdents d0/d6/d8/d1d/dd/d41/d5e 0 2024-02-07T12:25:35.509 INFO:tasks.workunit.client.1.smithi138.stdout:3/710: link d5/d26/d9a/lca d5/d34/d79/lf6 0 2024-02-07T12:25:35.509 INFO:tasks.workunit.client.1.smithi138.stdout:3/711: fsync d5/d26/d9d/fc9 0 2024-02-07T12:25:35.510 INFO:tasks.workunit.client.1.smithi138.stdout:3/712: fsync d5/d26/f2c 0 2024-02-07T12:25:35.513 INFO:tasks.workunit.client.1.smithi138.stdout:9/509: symlink d0/d6/d8/d1d/dd/d41/l98 0 2024-02-07T12:25:35.513 INFO:tasks.workunit.client.1.smithi138.stdout:9/510: write d0/d6/d8/d1d/f61 [2661154,90348] 0 2024-02-07T12:25:35.515 INFO:tasks.workunit.client.1.smithi138.stdout:3/713: getdents d5/d26/d5e/d86/ded 0 2024-02-07T12:25:35.516 INFO:tasks.workunit.client.1.smithi138.stdout:6/631: dwrite dc/d13/d8e/fbc [0,4194304] 0 2024-02-07T12:25:35.519 INFO:tasks.workunit.client.1.smithi138.stdout:4/571: dwrite d20/d47/d69/f6e [0,4194304] 0 2024-02-07T12:25:35.519 INFO:tasks.workunit.client.1.smithi138.stdout:4/572: write d20/d34/d36/d55/f80 [420948,100238] 0 2024-02-07T12:25:35.519 INFO:tasks.workunit.client.1.smithi138.stdout:4/573: fdatasync f1c 0 2024-02-07T12:25:35.519 INFO:tasks.workunit.client.1.smithi138.stdout:9/511: dread d0/d6/d8/d95/f96 [0,4194304] 0 2024-02-07T12:25:35.519 INFO:tasks.workunit.client.1.smithi138.stdout:9/512: write d0/d6/d8/d1d/dd/d41/f76 [621429,79001] 0 2024-02-07T12:25:35.519 INFO:tasks.workunit.client.1.smithi138.stdout:9/513: write d0/d6/d8/d1d/dd/d41/d5e/d74/f7b [3145625,54438] 0 2024-02-07T12:25:35.520 INFO:tasks.workunit.client.1.smithi138.stdout:9/514: fdatasync d0/d6/d8/f52 0 2024-02-07T12:25:35.523 INFO:tasks.workunit.client.1.smithi138.stdout:3/714: getdents d5/d26/d9b/dab/dc4/dc7 0 2024-02-07T12:25:35.524 INFO:tasks.workunit.client.1.smithi138.stdout:3/715: read f1 [1234114,101795] 0 2024-02-07T12:25:35.525 INFO:tasks.workunit.client.1.smithi138.stdout:2/719: dwrite d3/dd/d19/d44/d7d/f91 [0,4194304] 0 2024-02-07T12:25:35.527 INFO:tasks.workunit.client.1.smithi138.stdout:2/720: write d3/dd/d14/d49/d25/d3d/fb1 [153814,49608] 0 2024-02-07T12:25:35.529 INFO:tasks.workunit.client.1.smithi138.stdout:4/574: rename d20/d34/d59/d72/la5 to d20/d53/d71/d75/d94/lb4 0 2024-02-07T12:25:35.529 INFO:tasks.workunit.client.1.smithi138.stdout:4/575: creat d20/d34/d59/d72/d77/fb5 x:0 0 0 2024-02-07T12:25:35.530 INFO:tasks.workunit.client.1.smithi138.stdout:4/576: write d20/d47/f93 [133813,72511] 0 2024-02-07T12:25:35.532 INFO:tasks.workunit.client.1.smithi138.stdout:9/515: symlink d0/l99 0 2024-02-07T12:25:35.533 INFO:tasks.workunit.client.1.smithi138.stdout:2/721: dread f0 [0,4194304] 0 2024-02-07T12:25:35.533 INFO:tasks.workunit.client.1.smithi138.stdout:6/632: rmdir dc/d73 39 2024-02-07T12:25:35.537 INFO:tasks.workunit.client.1.smithi138.stdout:4/577: mknod d20/d47/d69/d7c/cb6 0 2024-02-07T12:25:35.537 INFO:tasks.workunit.client.1.smithi138.stdout:4/578: read d20/d53/f64 [268977,15783] 0 2024-02-07T12:25:35.537 INFO:tasks.workunit.client.1.smithi138.stdout:1/545: dwrite d5/d4b/d65/fa6 [0,4194304] 0 2024-02-07T12:25:35.537 INFO:tasks.workunit.client.1.smithi138.stdout:0/624: dwrite d4/d9/db/d39/f50 [0,4194304] 0 2024-02-07T12:25:35.548 INFO:tasks.workunit.client.1.smithi138.stdout:0/625: creat d4/d9/d37/d3d/d9c/fcc x:0 0 0 2024-02-07T12:25:35.548 INFO:tasks.workunit.client.1.smithi138.stdout:0/626: fdatasync d4/d9/d37/d3d/f68 0 2024-02-07T12:25:35.548 INFO:tasks.workunit.client.1.smithi138.stdout:1/546: write d5/d8/fbb [3724385,91767] 0 2024-02-07T12:25:35.549 INFO:tasks.workunit.client.1.smithi138.stdout:1/547: getdents d5/d5c/da5 0 2024-02-07T12:25:35.549 INFO:tasks.workunit.client.1.smithi138.stdout:2/722: rmdir d3/dd/d19/d1f/dc9 39 2024-02-07T12:25:35.550 INFO:tasks.workunit.client.1.smithi138.stdout:4/579: getdents d20/d4d 0 2024-02-07T12:25:35.550 INFO:tasks.workunit.client.1.smithi138.stdout:4/580: readlink d20/d53/l61 0 2024-02-07T12:25:35.551 INFO:tasks.workunit.client.1.smithi138.stdout:3/716: dwrite d5/d27/d35/f66 [4194304,4194304] 0 2024-02-07T12:25:35.551 INFO:tasks.workunit.client.1.smithi138.stdout:3/717: fsync d5/d26/d5e/d86/ded/fe7 0 2024-02-07T12:25:35.551 INFO:tasks.workunit.client.1.smithi138.stdout:3/718: fdatasync d5/d26/d5e/d86/ded/fe7 0 2024-02-07T12:25:35.552 INFO:tasks.workunit.client.1.smithi138.stdout:9/516: dwrite d0/d6/d8/f73 [0,4194304] 0 2024-02-07T12:25:35.552 INFO:tasks.workunit.client.1.smithi138.stdout:6/633: dwrite dc/d13/d1e/d35/d6d/f7d [0,4194304] 0 2024-02-07T12:25:35.555 INFO:tasks.workunit.client.1.smithi138.stdout:1/548: dread d5/f9 [0,4194304] 0 2024-02-07T12:25:35.559 INFO:tasks.workunit.client.1.smithi138.stdout:0/627: truncate d4/d9/d37/d64/f9b 297669 0 2024-02-07T12:25:35.562 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:35 smithi047 ceph-mon[28972]: [07/Feb/2024:12:25:33] ENGINE Serving on https://172.21.15.138:7150 2024-02-07T12:25:35.562 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:35 smithi047 ceph-mon[28972]: [07/Feb/2024:12:25:33] ENGINE Serving on http://172.21.15.138:8765 2024-02-07T12:25:35.562 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:35 smithi047 ceph-mon[28972]: [07/Feb/2024:12:25:33] ENGINE Bus STARTED 2024-02-07T12:25:35.562 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:35 smithi047 ceph-mon[28972]: pgmap v4: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail 2024-02-07T12:25:35.562 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:35 smithi047 ceph-mon[28972]: mgrmap e23: smithi138.fiugmj(active, since 2s) 2024-02-07T12:25:35.562 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:35 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2148620792' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:25:35.563 INFO:tasks.workunit.client.1.smithi138.stdout:2/723: creat d3/dd/d14/d49/d25/d3d/d5f/f10a x:0 0 0 2024-02-07T12:25:35.565 INFO:tasks.workunit.client.1.smithi138.stdout:3/719: unlink d5/d27/d35/dac/fd5 0 2024-02-07T12:25:35.565 INFO:tasks.workunit.client.1.smithi138.stdout:3/720: write d5/d26/d4e/f8c [3230812,17355] 0 2024-02-07T12:25:35.567 INFO:tasks.workunit.client.1.smithi138.stdout:4/581: dwrite d20/d4d/f99 [4194304,4194304] 0 2024-02-07T12:25:35.567 INFO:tasks.workunit.client.1.smithi138.stdout:4/582: stat d20/d4d/d87/c8a 0 2024-02-07T12:25:35.567 INFO:tasks.workunit.client.1.smithi138.stdout:4/583: creat d20/d34/d59/fb7 x:0 0 0 2024-02-07T12:25:35.567 INFO:tasks.workunit.client.1.smithi138.stdout:4/584: fsync d20/d34/d36/d55/d74/fb0 0 2024-02-07T12:25:35.567 INFO:tasks.workunit.client.1.smithi138.stdout:4/585: chown d20/d53/d71 78808 1 2024-02-07T12:25:35.568 INFO:tasks.workunit.client.1.smithi138.stdout:9/517: mknod d0/d6/d64/c9a 0 2024-02-07T12:25:35.571 INFO:tasks.workunit.client.1.smithi138.stdout:6/634: rename dc/d13/d1e/f91 to dc/d31/d38/fd0 0 2024-02-07T12:25:35.571 INFO:tasks.workunit.client.1.smithi138.stdout:6/635: write dc/d13/d1e/f99 [819550,110548] 0 2024-02-07T12:25:35.571 INFO:tasks.workunit.client.1.smithi138.stdout:1/549: symlink d5/d8/da/d1f/d5e/db5/d68/d73/lc1 0 2024-02-07T12:25:35.571 INFO:tasks.workunit.client.1.smithi138.stdout:1/550: truncate d5/d8/da/d1f/d5e/d63/d99/fba 823835 0 2024-02-07T12:25:35.573 INFO:tasks.workunit.client.1.smithi138.stdout:0/628: link d4/d9/f18 d4/d9/db/d39/d4b/d6c/fcd 0 2024-02-07T12:25:35.575 INFO:tasks.workunit.client.1.smithi138.stdout:2/724: mknod d3/dd/d14/d49/dc2/c10b 0 2024-02-07T12:25:35.575 INFO:tasks.workunit.client.1.smithi138.stdout:2/725: truncate d3/dd/d14/d49/f98 2394263 0 2024-02-07T12:25:35.582 INFO:tasks.workunit.client.1.smithi138.stdout:4/586: rmdir d20/d34/d73/dab 0 2024-02-07T12:25:35.583 INFO:tasks.workunit.client.1.smithi138.stdout:9/518: mkdir d0/d6/d8/d1d/dd/d25/d9b 0 2024-02-07T12:25:35.585 INFO:tasks.workunit.client.1.smithi138.stdout:4/587: dread d20/d34/d36/d55/f80 [0,4194304] 0 2024-02-07T12:25:35.585 INFO:tasks.workunit.client.1.smithi138.stdout:4/588: truncate d20/d34/d36/d55/f96 997289 0 2024-02-07T12:25:35.588 INFO:tasks.workunit.client.1.smithi138.stdout:3/721: rename d5/d26/d28/fbb to d5/d26/d5e/d86/ded/ff7 0 2024-02-07T12:25:35.590 INFO:tasks.workunit.client.1.smithi138.stdout:6/636: link dc/fc6 dc/d13/d1e/d35/dc0/fd1 0 2024-02-07T12:25:35.592 INFO:tasks.workunit.client.1.smithi138.stdout:3/722: dread d5/d27/d35/d7c/fef [0,4194304] 0 2024-02-07T12:25:35.592 INFO:tasks.workunit.client.1.smithi138.stdout:3/723: creat d5/d26/d28/ff8 x:0 0 0 2024-02-07T12:25:35.594 INFO:tasks.workunit.client.1.smithi138.stdout:0/629: dwrite d4/d52/f34 [0,4194304] 0 2024-02-07T12:25:35.594 INFO:tasks.workunit.client.1.smithi138.stdout:0/630: chown d4/d9/d37/d3d/d9c/fcc 3 1 2024-02-07T12:25:35.594 INFO:tasks.workunit.client.1.smithi138.stdout:0/631: write d4/d9/db/d39/d4b/d6c/fcd [4803290,54570] 0 2024-02-07T12:25:35.594 INFO:tasks.workunit.client.1.smithi138.stdout:2/726: dwrite d3/dd/d14/fb0 [0,4194304] 0 2024-02-07T12:25:35.596 INFO:tasks.workunit.client.1.smithi138.stdout:4/589: truncate fb 3527898 0 2024-02-07T12:25:35.596 INFO:tasks.workunit.client.1.smithi138.stdout:4/590: chown d20/d34/d36/f63 1 1 2024-02-07T12:25:35.598 INFO:tasks.workunit.client.1.smithi138.stdout:6/637: creat dc/d73/dc4/fd2 x:0 0 0 2024-02-07T12:25:35.599 INFO:tasks.workunit.client.1.smithi138.stdout:6/638: creat dc/d13/d1e/d35/d6d/fd3 x:0 0 0 2024-02-07T12:25:35.603 INFO:tasks.workunit.client.1.smithi138.stdout:0/632: readlink d4/d69/d85/l89 0 2024-02-07T12:25:35.606 INFO:tasks.workunit.client.1.smithi138.stdout:4/591: write d20/d34/d36/d55/f7f [3479678,74992] 0 2024-02-07T12:25:35.606 INFO:tasks.workunit.client.1.smithi138.stdout:2/727: getdents d3/dd/d19/d44 0 2024-02-07T12:25:35.609 INFO:tasks.workunit.client.1.smithi138.stdout:0/633: mknod d4/d9/db/d39/d4b/cce 0 2024-02-07T12:25:35.611 INFO:tasks.workunit.client.1.smithi138.stdout:6/639: dwrite dc/d31/d54/f8f [0,4194304] 0 2024-02-07T12:25:35.612 INFO:tasks.workunit.client.1.smithi138.stdout:4/592: symlink d20/d34/d36/d55/d74/d9a/lb8 0 2024-02-07T12:25:35.614 INFO:tasks.workunit.client.1.smithi138.stdout:2/728: creat d3/dd/d19/d44/d7d/f10c x:0 0 0 2024-02-07T12:25:35.615 INFO:tasks.workunit.client.1.smithi138.stdout:0/634: mkdir d4/d9/d37/d6b/d7f/dcf 0 2024-02-07T12:25:35.615 INFO:tasks.workunit.client.1.smithi138.stdout:0/635: readlink d4/d9/l7b 0 2024-02-07T12:25:35.619 INFO:tasks.workunit.client.1.smithi138.stdout:4/593: mkdir d20/d47/d69/d7c/db9 0 2024-02-07T12:25:35.619 INFO:tasks.workunit.client.1.smithi138.stdout:4/594: fsync d20/d34/d36/d55/d74/fb0 0 2024-02-07T12:25:35.620 INFO:tasks.workunit.client.1.smithi138.stdout:2/729: read d3/dd/d19/d44/f57 [481897,110618] 0 2024-02-07T12:25:35.621 INFO:tasks.workunit.client.1.smithi138.stdout:0/636: rename d4/d9/d37/d64/d9d/cc2 to d4/d9/db/d71/cd0 0 2024-02-07T12:25:35.621 INFO:tasks.workunit.client.1.smithi138.stdout:0/637: chown d4/d52/d74/f99 229276296 1 2024-02-07T12:25:35.621 INFO:tasks.workunit.client.1.smithi138.stdout:0/638: dread - d4/d9/de/d1d/d21/fb4 zero size 2024-02-07T12:25:35.621 INFO:tasks.workunit.client.1.smithi138.stdout:0/639: readlink d4/d9/de/d1d/d77/la1 0 2024-02-07T12:25:35.622 INFO:tasks.workunit.client.1.smithi138.stdout:4/595: rmdir d20/d4d 39 2024-02-07T12:25:35.622 INFO:tasks.workunit.client.1.smithi138.stdout:4/596: write d20/d4d/fad [435330,54519] 0 2024-02-07T12:25:35.624 INFO:tasks.workunit.client.1.smithi138.stdout:4/597: mkdir d20/d47/d69/d7c/db9/dba 0 2024-02-07T12:25:35.628 INFO:tasks.workunit.client.1.smithi138.stdout:6/640: dwrite dc/d13/d1e/d35/d6d/f6e [0,4194304] 0 2024-02-07T12:25:35.628 INFO:tasks.workunit.client.1.smithi138.stdout:6/641: creat dc/d13/d1e/fd4 x:0 0 0 2024-02-07T12:25:35.628 INFO:tasks.workunit.client.1.smithi138.stdout:6/642: write dc/fc1 [619919,104210] 0 2024-02-07T12:25:35.629 INFO:tasks.workunit.client.1.smithi138.stdout:6/643: stat dc/d13/d1e/l56 0 2024-02-07T12:25:35.631 INFO:tasks.workunit.client.1.smithi138.stdout:6/644: mknod dc/d31/cd5 0 2024-02-07T12:25:35.631 INFO:tasks.workunit.client.1.smithi138.stdout:6/645: fdatasync dc/d31/d3f/f52 0 2024-02-07T12:25:35.632 INFO:tasks.workunit.client.1.smithi138.stdout:6/646: truncate dc/d13/d8e/fbc 854816 0 2024-02-07T12:25:35.635 INFO:tasks.workunit.client.1.smithi138.stdout:6/647: rename dc/d13/d1e/f84 to dc/d13/d1e/d35/d7c/dbe/fd6 0 2024-02-07T12:25:35.635 INFO:tasks.workunit.client.1.smithi138.stdout:6/648: fsync dc/d13/d1e/f2b 0 2024-02-07T12:25:35.636 INFO:tasks.workunit.client.1.smithi138.stdout:0/640: dwrite d4/d9/de/d1d/f41 [4194304,4194304] 0 2024-02-07T12:25:35.640 INFO:tasks.workunit.client.1.smithi138.stdout:0/641: mknod d4/d9/d75/cd1 0 2024-02-07T12:25:35.643 INFO:tasks.workunit.client.1.smithi138.stdout:0/642: unlink d4/d9/d37/d3d/f5b 0 2024-02-07T12:25:35.644 INFO:tasks.workunit.client.1.smithi138.stdout:0/643: creat d4/d9/d37/d64/fd2 x:0 0 0 2024-02-07T12:25:35.648 INFO:tasks.workunit.client.1.smithi138.stdout:0/644: dread d4/f1f [0,4194304] 0 2024-02-07T12:25:35.648 INFO:tasks.workunit.client.1.smithi138.stdout:0/645: creat d4/d9/db/fd3 x:0 0 0 2024-02-07T12:25:35.658 INFO:tasks.workunit.client.1.smithi138.stdout:4/598: dwrite d20/d34/d59/fa8 [0,4194304] 0 2024-02-07T12:25:35.660 INFO:tasks.workunit.client.1.smithi138.stdout:4/599: symlink d20/d4d/d87/lbb 0 2024-02-07T12:25:35.663 INFO:tasks.workunit.client.1.smithi138.stdout:6/649: dwrite dc/d13/d1e/d35/f4c [0,4194304] 0 2024-02-07T12:25:35.663 INFO:tasks.workunit.client.1.smithi138.stdout:6/650: chown dc/d13/f19 72 1 2024-02-07T12:25:35.664 INFO:tasks.workunit.client.1.smithi138.stdout:0/646: dwrite d4/d52/f44 [0,4194304] 0 2024-02-07T12:25:35.674 INFO:tasks.workunit.client.1.smithi138.stdout:6/651: dread dc/d13/d1e/d35/f4c [0,4194304] 0 2024-02-07T12:25:35.676 INFO:tasks.workunit.client.1.smithi138.stdout:0/647: dread d4/d52/f34 [0,4194304] 0 2024-02-07T12:25:35.677 INFO:tasks.workunit.client.1.smithi138.stdout:0/648: creat d4/d9/de/d1d/d21/fd4 x:0 0 0 2024-02-07T12:25:35.679 INFO:tasks.workunit.client.1.smithi138.stdout:0/649: mkdir d4/d9/db/d39/d4b/d6c/dc5/dd5 0 2024-02-07T12:25:35.680 INFO:tasks.workunit.client.1.smithi138.stdout:0/650: unlink d4/d9/de/d1d/d8c/f93 0 2024-02-07T12:25:35.682 INFO:tasks.workunit.client.1.smithi138.stdout:0/651: link d4/d9/de/d1d/f36 d4/d9/db/d39/d4b/fd6 0 2024-02-07T12:25:35.682 INFO:tasks.workunit.client.1.smithi138.stdout:6/652: dread dc/d13/f1a [0,4194304] 0 2024-02-07T12:25:35.682 INFO:tasks.workunit.client.1.smithi138.stdout:6/653: dread - dc/d13/d1e/d35/d85/f95 zero size 2024-02-07T12:25:35.682 INFO:tasks.workunit.client.1.smithi138.stdout:6/654: write dc/d31/f72 [69581,49379] 0 2024-02-07T12:25:35.687 INFO:tasks.workunit.client.1.smithi138.stdout:6/655: dread dc/d13/f1a [0,4194304] 0 2024-02-07T12:25:35.687 INFO:tasks.workunit.client.1.smithi138.stdout:6/656: creat dc/d31/d38/fd7 x:0 0 0 2024-02-07T12:25:35.700 INFO:tasks.workunit.client.1.smithi138.stdout:0/652: dwrite d4/d69/f87 [0,4194304] 0 2024-02-07T12:25:35.701 INFO:tasks.workunit.client.1.smithi138.stdout:6/657: dwrite dc/d31/f37 [0,4194304] 0 2024-02-07T12:25:35.701 INFO:tasks.workunit.client.1.smithi138.stdout:6/658: fdatasync dc/d73/dc4/fd2 0 2024-02-07T12:25:35.708 INFO:tasks.workunit.client.1.smithi138.stdout:0/653: dread d4/d9/db/d39/fa2 [0,4194304] 0 2024-02-07T12:25:35.708 INFO:tasks.workunit.client.1.smithi138.stdout:0/654: creat d4/d52/fd7 x:0 0 0 2024-02-07T12:25:35.709 INFO:tasks.workunit.client.1.smithi138.stdout:0/655: write d4/f4d [1188530,109762] 0 2024-02-07T12:25:35.710 INFO:tasks.workunit.client.1.smithi138.stdout:0/656: truncate d4/d9/f11 6597302 0 2024-02-07T12:25:35.710 INFO:tasks.workunit.client.1.smithi138.stdout:0/657: write d4/d9/db/d39/d4b/d6c/faf [778296,47761] 0 2024-02-07T12:25:35.712 INFO:tasks.workunit.client.1.smithi138.stdout:0/658: unlink d4/d9/de/f24 0 2024-02-07T12:25:35.712 INFO:tasks.workunit.client.1.smithi138.stdout:0/659: fsync d4/d69/f87 0 2024-02-07T12:25:35.712 INFO:tasks.workunit.client.1.smithi138.stdout:0/660: getdents d4/d9/d37/db6 0 2024-02-07T12:25:35.714 INFO:tasks.workunit.client.1.smithi138.stdout:0/661: symlink d4/d9/d37/d64/ld8 0 2024-02-07T12:25:35.715 INFO:tasks.workunit.client.1.smithi138.stdout:0/662: getdents d4/d52/d74 0 2024-02-07T12:25:35.715 INFO:tasks.workunit.client.1.smithi138.stdout:0/663: fsync d4/d9/de/d1d/f42 0 2024-02-07T12:25:35.719 INFO:tasks.workunit.client.1.smithi138.stdout:0/664: dread d4/d9/db/f20 [0,4194304] 0 2024-02-07T12:25:35.719 INFO:tasks.workunit.client.1.smithi138.stdout:0/665: getdents d4/d9/d37/d3d/d9c/dad 0 2024-02-07T12:25:35.725 INFO:tasks.workunit.client.1.smithi138.stdout:5/605: sync 2024-02-07T12:25:35.725 INFO:tasks.workunit.client.1.smithi138.stdout:8/745: sync 2024-02-07T12:25:35.727 INFO:tasks.workunit.client.1.smithi138.stdout:8/746: creat d1/ddc/fe5 x:0 0 0 2024-02-07T12:25:35.727 INFO:tasks.workunit.client.1.smithi138.stdout:8/747: write d1/de/db4/db8/d17/d8a/d8d/fd6 [630778,28372] 0 2024-02-07T12:25:35.727 INFO:tasks.workunit.client.1.smithi138.stdout:8/748: chown d1/db3 49442337 1 2024-02-07T12:25:35.727 INFO:tasks.workunit.client.1.smithi138.stdout:8/749: creat d1/ddc/fe6 x:0 0 0 2024-02-07T12:25:35.727 INFO:tasks.workunit.client.1.smithi138.stdout:8/750: fdatasync d1/de/db4/db8/d17/d3e/d72/dda/f76 0 2024-02-07T12:25:35.727 INFO:tasks.workunit.client.1.smithi138.stdout:5/606: mknod da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d96/ccb 0 2024-02-07T12:25:35.727 INFO:tasks.workunit.client.1.smithi138.stdout:5/607: chown da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d96/l75 210927766 1 2024-02-07T12:25:35.729 INFO:tasks.workunit.client.1.smithi138.stdout:8/751: mkdir d1/d99/da6/de7 0 2024-02-07T12:25:35.737 INFO:tasks.workunit.client.1.smithi138.stdout:5/608: read da/d50/f56 [849713,61918] 0 2024-02-07T12:25:35.738 INFO:tasks.workunit.client.1.smithi138.stdout:8/752: rmdir d1/de/db4/db8/d17 39 2024-02-07T12:25:35.740 INFO:tasks.workunit.client.1.smithi138.stdout:8/753: mkdir d1/de/db4/db8/d17/d2e/d3a/de8 0 2024-02-07T12:25:35.742 INFO:tasks.workunit.client.1.smithi138.stdout:8/754: rename d1/de/db4/db8/d17/d2e/f52 to d1/de/db4/db8/d17/d8a/d8d/fe9 0 2024-02-07T12:25:35.743 INFO:tasks.workunit.client.1.smithi138.stdout:8/755: chown d1/de/db4/db8/d17/d3e 678 1 2024-02-07T12:25:35.743 INFO:tasks.workunit.client.1.smithi138.stdout:8/756: chown d1/d99/da6/de7 22086 1 2024-02-07T12:25:35.750 INFO:tasks.workunit.client.1.smithi138.stdout:5/609: dwrite da/d22/f8d [0,4194304] 0 2024-02-07T12:25:35.751 INFO:tasks.workunit.client.1.smithi138.stdout:8/757: dread d1/de/db4/db8/d96/fbd [0,4194304] 0 2024-02-07T12:25:35.753 INFO:tasks.workunit.client.1.smithi138.stdout:5/610: dread da/d43/d4a/d95/fb2 [0,4194304] 0 2024-02-07T12:25:35.753 INFO:tasks.workunit.client.1.smithi138.stdout:5/611: dread - da/d6d/f7c zero size 2024-02-07T12:25:35.753 INFO:tasks.workunit.client.1.smithi138.stdout:5/612: dread - da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/fbf zero size 2024-02-07T12:25:35.753 INFO:tasks.workunit.client.1.smithi138.stdout:8/758: mknod d1/de/db4/db8/d17/d3e/d89/de2/cea 0 2024-02-07T12:25:35.754 INFO:tasks.workunit.client.1.smithi138.stdout:5/613: symlink da/d6d/d27/d2e/d4f/d2b/d35/d5d/d73/lcc 0 2024-02-07T12:25:35.754 INFO:tasks.workunit.client.1.smithi138.stdout:5/614: stat da/d6d/d27/d2e/c68 0 2024-02-07T12:25:35.755 INFO:tasks.workunit.client.1.smithi138.stdout:8/759: mkdir d1/de/db4/db8/d17/d3e/d72/dda/dcf/ddd/deb 0 2024-02-07T12:25:35.756 INFO:tasks.workunit.client.1.smithi138.stdout:8/760: creat d1/d99/da6/de7/fec x:0 0 0 2024-02-07T12:25:35.758 INFO:tasks.workunit.client.1.smithi138.stdout:8/761: mknod d1/de/db4/db8/d17/d3e/d72/dda/d4c/ced 0 2024-02-07T12:25:35.759 INFO:tasks.workunit.client.1.smithi138.stdout:8/762: creat d1/de/db4/db8/d17/d3e/fee x:0 0 0 2024-02-07T12:25:35.762 INFO:tasks.workunit.client.1.smithi138.stdout:5/615: write da/d43/d4a/f9d [2973829,63279] 0 2024-02-07T12:25:35.772 INFO:tasks.workunit.client.1.smithi138.stdout:5/616: rmdir da/d6d/d27 39 2024-02-07T12:25:35.772 INFO:tasks.workunit.client.1.smithi138.stdout:5/617: read da/d43/d4a/fc2 [770591,99842] 0 2024-02-07T12:25:35.774 INFO:tasks.workunit.client.1.smithi138.stdout:5/618: dread da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d91/faa [0,4194304] 0 2024-02-07T12:25:35.780 INFO:tasks.workunit.client.1.smithi138.stdout:5/619: read da/d6d/d27/d2e/d4f/f30 [1341180,98743] 0 2024-02-07T12:25:35.781 INFO:tasks.workunit.client.1.smithi138.stdout:5/620: link da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/c78 da/d22/ccd 0 2024-02-07T12:25:35.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:35 smithi138 ceph-mon[35528]: [07/Feb/2024:12:25:33] ENGINE Serving on https://172.21.15.138:7150 2024-02-07T12:25:35.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:35 smithi138 ceph-mon[35528]: [07/Feb/2024:12:25:33] ENGINE Serving on http://172.21.15.138:8765 2024-02-07T12:25:35.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:35 smithi138 ceph-mon[35528]: [07/Feb/2024:12:25:33] ENGINE Bus STARTED 2024-02-07T12:25:35.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:35 smithi138 ceph-mon[35528]: pgmap v4: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail 2024-02-07T12:25:35.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:35 smithi138 ceph-mon[35528]: mgrmap e23: smithi138.fiugmj(active, since 2s) 2024-02-07T12:25:35.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:35 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2148620792' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:25:35.789 INFO:tasks.workunit.client.1.smithi138.stdout:7/764: sync 2024-02-07T12:25:35.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.790+0000 7f7a7855a700 1 -- 172.21.15.47:0/3978537353 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7a7004bed0 con 0x7f7a700fda80 2024-02-07T12:25:35.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.791+0000 7f7a66ffd700 1 -- 172.21.15.47:0/3978537353 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7a6c012b90 con 0x7f7a700fda80 2024-02-07T12:25:35.793 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:25:35.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.793+0000 7f7a7855a700 1 -- 172.21.15.47:0/3978537353 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f7a5c0389e0 msgr2=0x7f7a5c03ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:35.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.793+0000 7f7a7855a700 1 --2- 172.21.15.47:0/3978537353 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f7a5c0389e0 0x7f7a5c03ae90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000b0d0 tx=0x7f7a60009e30 comp rx=0 tx=0).stop 2024-02-07T12:25:35.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.793+0000 7f7a7855a700 1 -- 172.21.15.47:0/3978537353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a700fda80 msgr2=0x7f7a7010d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:25:35.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.793+0000 7f7a7855a700 1 --2- 172.21.15.47:0/3978537353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a700fda80 0x7f7a7010d8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009fd0 tx=0x7f7a6c00b040 comp rx=0 tx=0).stop 2024-02-07T12:25:35.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.793+0000 7f7a7855a700 1 -- 172.21.15.47:0/3978537353 shutdown_connections 2024-02-07T12:25:35.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.793+0000 7f7a7855a700 1 --2- 172.21.15.47:0/3978537353 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f7a5c0389e0 0x7f7a5c03ae90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:35.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.793+0000 7f7a7855a700 1 --2- 172.21.15.47:0/3978537353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a700fda80 0x7f7a7010d8c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:35.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.793+0000 7f7a7855a700 1 --2- 172.21.15.47:0/3978537353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a701003a0 0x7f7a7010de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:25:35.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.793+0000 7f7a7855a700 1 -- 172.21.15.47:0/3978537353 >> 172.21.15.47:0/3978537353 conn(0x7f7a700f7500 msgr2=0x7f7a700f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:25:35.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.793+0000 7f7a7855a700 1 -- 172.21.15.47:0/3978537353 shutdown_connections 2024-02-07T12:25:35.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:25:35.793+0000 7f7a7855a700 1 -- 172.21.15.47:0/3978537353 wait complete. 2024-02-07T12:25:35.801 INFO:tasks.workunit.client.1.smithi138.stdout:7/765: dwrite d0/d6/d73/f75 [0,4194304] 0 2024-02-07T12:25:35.804 INFO:tasks.workunit.client.1.smithi138.stdout:7/766: mknod d0/d6/cfc 0 2024-02-07T12:25:35.807 INFO:tasks.workunit.client.1.smithi138.stdout:7/767: rename d0/d6/d76 to d0/d39/dfd 0 2024-02-07T12:25:35.814 INFO:tasks.workunit.client.1.smithi138.stdout:7/768: dread d0/d8/d11/d26/d90/f9e [0,4194304] 0 2024-02-07T12:25:35.815 INFO:tasks.workunit.client.1.smithi138.stdout:7/769: chown d0/d39/dfd/d93 15526 1 2024-02-07T12:25:35.815 INFO:tasks.workunit.client.1.smithi138.stdout:7/770: fsync d0/d6/d1d/d38/ff1 0 2024-02-07T12:25:35.815 INFO:tasks.workunit.client.1.smithi138.stdout:7/771: dread - d0/d6/fe4 zero size 2024-02-07T12:25:35.816 INFO:tasks.workunit.client.1.smithi138.stdout:7/772: rename d0/d39/dea to d0/d39/dfd/d93/dfe 0 2024-02-07T12:25:35.817 INFO:tasks.workunit.client.1.smithi138.stdout:7/773: rename d0/d8/d11/d5f/f95 to d0/d6/d84/fff 0 2024-02-07T12:25:35.818 INFO:tasks.workunit.client.1.smithi138.stdout:7/774: link d0/d6/d3e/c58 d0/d6/d19/de8/df3/c100 0 2024-02-07T12:25:35.818 INFO:tasks.workunit.client.1.smithi138.stdout:7/775: fdatasync d0/d8/d11/d1f/f77 0 2024-02-07T12:25:35.818 INFO:tasks.workunit.client.1.smithi138.stdout:7/776: creat d0/d6/d73/f101 x:0 0 0 2024-02-07T12:25:35.819 INFO:tasks.workunit.client.1.smithi138.stdout:7/777: mknod d0/d6/c102 0 2024-02-07T12:25:35.822 INFO:tasks.workunit.client.1.smithi138.stdout:7/778: dread d0/d8/d11/d26/d90/f2c [0,4194304] 0 2024-02-07T12:25:35.825 INFO:tasks.workunit.client.1.smithi138.stdout:7/779: dread d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:35.826 INFO:tasks.workunit.client.1.smithi138.stdout:7/780: creat d0/d8/d11/d63/dc8/dce/f103 x:0 0 0 2024-02-07T12:25:35.833 INFO:tasks.workunit.client.1.smithi138.stdout:7/781: dread d0/d39/dfd/d93/fbb [0,4194304] 0 2024-02-07T12:25:35.839 INFO:tasks.workunit.client.1.smithi138.stdout:1/551: sync 2024-02-07T12:25:35.839 INFO:tasks.workunit.client.1.smithi138.stdout:9/519: sync 2024-02-07T12:25:35.839 INFO:tasks.workunit.client.1.smithi138.stdout:1/552: write d5/d8/da/d1f/d5e/db5/d58/fb4 [5177907,116088] 0 2024-02-07T12:25:35.839 INFO:tasks.workunit.client.1.smithi138.stdout:1/553: truncate d5/d8/da/d1f/d3c/fa1 497896 0 2024-02-07T12:25:35.840 INFO:tasks.workunit.client.1.smithi138.stdout:9/520: creat d0/d6/d8/d1d/dd/f9c x:0 0 0 2024-02-07T12:25:35.840 INFO:tasks.workunit.client.1.smithi138.stdout:9/521: chown d0/d6/d8/f52 405764906 1 2024-02-07T12:25:35.841 INFO:tasks.workunit.client.1.smithi138.stdout:9/522: symlink d0/d6/d8/d1d/dd/d25/l9d 0 2024-02-07T12:25:35.841 INFO:tasks.workunit.client.1.smithi138.stdout:9/523: stat d0/d6/d64/c9a 0 2024-02-07T12:25:35.842 INFO:tasks.workunit.client.1.smithi138.stdout:1/554: rmdir d5/d8/da/d20 39 2024-02-07T12:25:35.842 INFO:tasks.workunit.client.1.smithi138.stdout:1/555: write d5/d4b/d91/f9a [272671,42446] 0 2024-02-07T12:25:35.843 INFO:tasks.workunit.client.1.smithi138.stdout:9/524: mknod d0/d6/d64/c9e 0 2024-02-07T12:25:35.843 INFO:tasks.workunit.client.1.smithi138.stdout:1/556: mkdir d5/d8/da/d20/dc2 0 2024-02-07T12:25:35.844 INFO:tasks.workunit.client.1.smithi138.stdout:9/525: truncate d0/d34/d45/f43 689992 0 2024-02-07T12:25:35.844 INFO:tasks.workunit.client.1.smithi138.stdout:9/526: write d0/d34/f51 [2084188,116345] 0 2024-02-07T12:25:35.845 INFO:tasks.workunit.client.1.smithi138.stdout:9/527: truncate d0/d6/d8/f2a 3600768 0 2024-02-07T12:25:35.848 INFO:tasks.workunit.client.1.smithi138.stdout:9/528: rename d0/d6/d8/d1d/dd/l2e to d0/d6/d8/d1d/dd/d1f/l9f 0 2024-02-07T12:25:35.849 INFO:tasks.workunit.client.1.smithi138.stdout:9/529: getdents d0/d6 0 2024-02-07T12:25:35.849 INFO:tasks.workunit.client.1.smithi138.stdout:9/530: chown d0/d6/d8/d1d/dd/l30 22 1 2024-02-07T12:25:35.850 INFO:tasks.workunit.client.1.smithi138.stdout:9/531: mkdir d0/d6/d8/d1d/da0 0 2024-02-07T12:25:35.850 INFO:tasks.workunit.client.1.smithi138.stdout:9/532: fsync d0/f77 0 2024-02-07T12:25:35.852 INFO:tasks.workunit.client.1.smithi138.stdout:9/533: creat d0/d6/d8/fa1 x:0 0 0 2024-02-07T12:25:35.861 INFO:tasks.workunit.client.1.smithi138.stdout:1/557: dwrite d5/d4b/d91/f9f [0,4194304] 0 2024-02-07T12:25:35.865 INFO:tasks.workunit.client.1.smithi138.stdout:1/558: mkdir d5/d5c/da5/dc3 0 2024-02-07T12:25:35.866 INFO:tasks.workunit.client.1.smithi138.stdout:9/534: dwrite d0/d6/d8/f2a [4194304,4194304] 0 2024-02-07T12:25:35.866 INFO:tasks.workunit.client.1.smithi138.stdout:1/559: dread d5/d8/da/d1f/d5e/d63/d99/fba [0,4194304] 0 2024-02-07T12:25:35.866 INFO:tasks.workunit.client.1.smithi138.stdout:1/560: rename d5 to d5/dc4 22 2024-02-07T12:25:35.866 INFO:tasks.workunit.client.1.smithi138.stdout:1/561: creat d5/d8/da/d1f/d5e/d63/fc5 x:0 0 0 2024-02-07T12:25:35.867 INFO:tasks.workunit.client.1.smithi138.stdout:9/535: truncate d0/d6/d8/d1d/f3d 3641487 0 2024-02-07T12:25:35.868 INFO:tasks.workunit.client.1.smithi138.stdout:1/562: symlink d5/d4b/d6b/d6e/lc6 0 2024-02-07T12:25:35.869 INFO:tasks.workunit.client.1.smithi138.stdout:1/563: dread d5/d8/da/fe [4194304,4194304] 0 2024-02-07T12:25:35.869 INFO:tasks.workunit.client.1.smithi138.stdout:9/536: unlink d0/d6/d64/c9e 0 2024-02-07T12:25:35.869 INFO:tasks.workunit.client.1.smithi138.stdout:9/537: chown d0/d6/d8/d1d/dd/d1f/c70 35535267 1 2024-02-07T12:25:35.870 INFO:tasks.workunit.client.1.smithi138.stdout:1/564: mknod d5/d8/da/d1f/d5e/db5/d68/d73/d7b/cc7 0 2024-02-07T12:25:35.872 INFO:tasks.workunit.client.1.smithi138.stdout:9/538: mknod d0/d6/d64/ca2 0 2024-02-07T12:25:35.872 INFO:tasks.workunit.client.1.smithi138.stdout:9/539: write d0/d6/d8/d1d/dd/d1f/f1b [720668,86306] 0 2024-02-07T12:25:35.872 INFO:tasks.workunit.client.1.smithi138.stdout:9/540: truncate d0/d34/d86/f89 630517 0 2024-02-07T12:25:35.875 INFO:tasks.workunit.client.1.smithi138.stdout:1/565: rename d5/d8/da/d1f/d5e/db5/f7f to d5/d8/dbc/fc8 0 2024-02-07T12:25:35.875 INFO:tasks.workunit.client.1.smithi138.stdout:1/566: write d5/f9 [565829,8380] 0 2024-02-07T12:25:35.875 INFO:tasks.workunit.client.1.smithi138.stdout:1/567: creat d5/d4b/fc9 x:0 0 0 2024-02-07T12:25:35.875 INFO:tasks.workunit.client.1.smithi138.stdout:1/568: write d5/d8/da/d1f/d5e/db5/d68/d73/d7b/f4e [1604469,77880] 0 2024-02-07T12:25:35.875 INFO:tasks.workunit.client.1.smithi138.stdout:1/569: creat d5/d8/da/d1f/d5e/d62/fca x:0 0 0 2024-02-07T12:25:35.875 INFO:tasks.workunit.client.1.smithi138.stdout:1/570: write d5/d5c/f7a [900937,87949] 0 2024-02-07T12:25:35.891 INFO:tasks.workunit.client.1.smithi138.stdout:9/541: dwrite d0/f77 [0,4194304] 0 2024-02-07T12:25:35.892 INFO:tasks.workunit.client.1.smithi138.stdout:1/571: dwrite d5/d8/da/d1f/d5e/d62/fca [0,4194304] 0 2024-02-07T12:25:35.897 INFO:tasks.workunit.client.1.smithi138.stdout:9/542: getdents d0 0 2024-02-07T12:25:35.904 INFO:tasks.workunit.client.1.smithi138.stdout:9/543: write d0/d6/f12 [3089333,31424] 0 2024-02-07T12:25:35.904 INFO:tasks.workunit.client.1.smithi138.stdout:9/544: fsync d0/d6/d8/d1d/dd/d41/d5e/f75 0 2024-02-07T12:25:35.905 INFO:tasks.workunit.client.1.smithi138.stdout:9/545: unlink d0/d6/c10 0 2024-02-07T12:25:35.907 INFO:tasks.workunit.client.1.smithi138.stdout:1/572: dwrite d5/d8/da/d1f/d5e/d63/d99/fba [0,4194304] 0 2024-02-07T12:25:35.916 INFO:tasks.workunit.client.1.smithi138.stdout:3/724: sync 2024-02-07T12:25:35.931 INFO:tasks.workunit.client.1.smithi138.stdout:9/546: dwrite d0/d6/d8/d1d/dd/d1f/f47 [0,4194304] 0 2024-02-07T12:25:35.933 INFO:tasks.workunit.client.1.smithi138.stdout:9/547: truncate d0/d6/d8/d1d/dd/d41/d5e/f67 3635824 0 2024-02-07T12:25:35.933 INFO:tasks.workunit.client.1.smithi138.stdout:1/573: dwrite d5/d4b/d91/f9f [0,4194304] 0 2024-02-07T12:25:35.933 INFO:tasks.workunit.client.1.smithi138.stdout:1/574: chown d5/d8/da/d1f/d5e/db5/c33 3715 1 2024-02-07T12:25:35.933 INFO:tasks.workunit.client.1.smithi138.stdout:3/725: dwrite d5/f3a [0,4194304] 0 2024-02-07T12:25:35.934 INFO:tasks.workunit.client.1.smithi138.stdout:9/548: mkdir d0/d6/da3 0 2024-02-07T12:25:35.936 INFO:tasks.workunit.client.1.smithi138.stdout:1/575: rmdir d5/d5c/da5/dc3 0 2024-02-07T12:25:35.937 INFO:tasks.workunit.client.1.smithi138.stdout:1/576: stat d5/d8/da/d1f/d5e/db5/d68/d73/d7b 0 2024-02-07T12:25:35.938 INFO:tasks.workunit.client.1.smithi138.stdout:3/726: creat d5/d26/d5e/d86/dc0/ff9 x:0 0 0 2024-02-07T12:25:35.939 INFO:tasks.workunit.client.1.smithi138.stdout:3/727: chown d5/d26/d5e/d86/ded/d32/da1/fd9 2740 1 2024-02-07T12:25:35.939 INFO:tasks.workunit.client.1.smithi138.stdout:3/728: write d5/d27/d35/f53 [4840739,82026] 0 2024-02-07T12:25:35.939 INFO:tasks.workunit.client.1.smithi138.stdout:3/729: write d5/f23 [187704,38119] 0 2024-02-07T12:25:35.939 INFO:tasks.workunit.client.1.smithi138.stdout:9/549: creat d0/d6/d8/d1d/dd/d41/d5e/d74/fa4 x:0 0 0 2024-02-07T12:25:35.941 INFO:tasks.workunit.client.1.smithi138.stdout:1/577: symlink d5/d4b/d91/lcb 0 2024-02-07T12:25:35.942 INFO:tasks.workunit.client.1.smithi138.stdout:8/763: sync 2024-02-07T12:25:35.942 INFO:tasks.workunit.client.1.smithi138.stdout:4/600: sync 2024-02-07T12:25:35.942 INFO:tasks.workunit.client.1.smithi138.stdout:5/621: sync 2024-02-07T12:25:35.942 INFO:tasks.workunit.client.1.smithi138.stdout:8/764: fdatasync d1/de/db4/db8/d17/d3e/d72/dda/f56 0 2024-02-07T12:25:35.942 INFO:tasks.workunit.client.1.smithi138.stdout:4/601: fdatasync d20/d4d/f99 0 2024-02-07T12:25:35.942 INFO:tasks.workunit.client.1.smithi138.stdout:8/765: write d1/de/db4/db8/d17/d58/f60 [205115,98640] 0 2024-02-07T12:25:35.944 INFO:tasks.workunit.client.1.smithi138.stdout:3/730: rename d5/d26/d28/ff8 to d5/d26/d5e/d77/ffa 0 2024-02-07T12:25:35.944 INFO:tasks.workunit.client.1.smithi138.stdout:4/602: dread d20/d4d/f90 [0,4194304] 0 2024-02-07T12:25:35.944 INFO:tasks.workunit.client.1.smithi138.stdout:7/782: sync 2024-02-07T12:25:35.944 INFO:tasks.workunit.client.1.smithi138.stdout:6/659: sync 2024-02-07T12:25:35.944 INFO:tasks.workunit.client.1.smithi138.stdout:0/666: sync 2024-02-07T12:25:35.944 INFO:tasks.workunit.client.1.smithi138.stdout:2/730: sync 2024-02-07T12:25:35.944 INFO:tasks.workunit.client.1.smithi138.stdout:0/667: write d4/d52/fd7 [711755,60618] 0 2024-02-07T12:25:35.944 INFO:tasks.workunit.client.1.smithi138.stdout:6/660: write dc/fc1 [1289635,129062] 0 2024-02-07T12:25:35.944 INFO:tasks.workunit.client.1.smithi138.stdout:0/668: write d4/d9/de/f72 [2348131,127166] 0 2024-02-07T12:25:35.945 INFO:tasks.workunit.client.1.smithi138.stdout:1/578: symlink d5/d4b/d6b/d6e/lcc 0 2024-02-07T12:25:35.949 INFO:tasks.workunit.client.1.smithi138.stdout:9/550: write d0/d6/d8/d1d/dd/d1f/f6a [2956905,95632] 0 2024-02-07T12:25:35.949 INFO:tasks.workunit.client.1.smithi138.stdout:9/551: fdatasync d0/f77 0 2024-02-07T12:25:35.949 INFO:tasks.workunit.client.1.smithi138.stdout:5/622: symlink da/d22/d99/dca/lce 0 2024-02-07T12:25:35.949 INFO:tasks.workunit.client.1.smithi138.stdout:8/766: symlink d1/lef 0 2024-02-07T12:25:35.950 INFO:tasks.workunit.client.1.smithi138.stdout:4/603: symlink d20/d34/d36/d55/d74/d9a/lbc 0 2024-02-07T12:25:35.951 INFO:tasks.workunit.client.1.smithi138.stdout:7/783: truncate d0/d8/d11/d1f/f77 6417094 0 2024-02-07T12:25:35.953 INFO:tasks.workunit.client.1.smithi138.stdout:6/661: unlink dc/d31/d38/d9a/fb8 0 2024-02-07T12:25:35.953 INFO:tasks.workunit.client.1.smithi138.stdout:6/662: stat dc/d13/d1e/d35/d7c 0 2024-02-07T12:25:35.954 INFO:tasks.workunit.client.1.smithi138.stdout:2/731: dread d3/dd/d19/d44/d7d/f91 [0,4194304] 0 2024-02-07T12:25:35.955 INFO:tasks.workunit.client.1.smithi138.stdout:9/552: getdents d0/d6/d8/d1d/dd/d1f 0 2024-02-07T12:25:35.957 INFO:tasks.workunit.client.1.smithi138.stdout:8/767: mkdir d1/db3/df0 0 2024-02-07T12:25:35.958 INFO:tasks.workunit.client.1.smithi138.stdout:1/579: dread d5/d8/da/d1f/d5e/db5/d58/f8b [0,4194304] 0 2024-02-07T12:25:35.958 INFO:tasks.workunit.client.1.smithi138.stdout:1/580: chown d5/f1a 1020970 1 2024-02-07T12:25:35.958 INFO:tasks.workunit.client.1.smithi138.stdout:4/604: unlink d20/d4d/d87/faa 0 2024-02-07T12:25:35.960 INFO:tasks.workunit.client.1.smithi138.stdout:6/663: truncate dc/d13/d1e/f8c 370282 0 2024-02-07T12:25:35.960 INFO:tasks.workunit.client.1.smithi138.stdout:0/669: mknod d4/d9/db/d39/d4b/d6c/d8f/cd9 0 2024-02-07T12:25:35.962 INFO:tasks.workunit.client.1.smithi138.stdout:2/732: creat d3/dd/d14/d8f/d73/f10d x:0 0 0 2024-02-07T12:25:35.964 INFO:tasks.workunit.client.1.smithi138.stdout:5/623: mknod da/d6d/d27/d2e/d4f/d2b/d35/d5d/ccf 0 2024-02-07T12:25:35.965 INFO:tasks.workunit.client.1.smithi138.stdout:3/731: dwrite d5/d26/d28/f52 [0,4194304] 0 2024-02-07T12:25:35.965 INFO:tasks.workunit.client.1.smithi138.stdout:9/553: write d0/f77 [406481,88465] 0 2024-02-07T12:25:35.965 INFO:tasks.workunit.client.1.smithi138.stdout:9/554: write d0/d34/d45/f88 [529082,62197] 0 2024-02-07T12:25:35.965 INFO:tasks.workunit.client.1.smithi138.stdout:9/555: fsync d0/d6/d8/f52 0 2024-02-07T12:25:35.966 INFO:tasks.workunit.client.1.smithi138.stdout:8/768: symlink d1/de/db4/db8/d17/d3e/d72/dda/dcf/lf1 0 2024-02-07T12:25:35.967 INFO:tasks.workunit.client.1.smithi138.stdout:4/605: rename d20/f3d to d20/d47/d69/d7c/db9/fbd 0 2024-02-07T12:25:35.967 INFO:tasks.workunit.client.1.smithi138.stdout:9/556: rename d0/d6/d8/d1d to d0/d6/d8/d1d/dd/d41/da5 22 2024-02-07T12:25:35.967 INFO:tasks.workunit.client.1.smithi138.stdout:4/606: write d20/f54 [1744682,74595] 0 2024-02-07T12:25:35.968 INFO:tasks.workunit.client.1.smithi138.stdout:6/664: symlink dc/d31/d38/d9a/daa/ld8 0 2024-02-07T12:25:35.968 INFO:tasks.workunit.client.1.smithi138.stdout:1/581: write d5/d4b/d65/fa6 [26197,37934] 0 2024-02-07T12:25:35.968 INFO:tasks.workunit.client.1.smithi138.stdout:5/624: dread da/d6d/d27/d2e/f88 [0,4194304] 0 2024-02-07T12:25:35.968 INFO:tasks.workunit.client.1.smithi138.stdout:1/582: write d5/f1a [3961983,100260] 0 2024-02-07T12:25:35.969 INFO:tasks.workunit.client.1.smithi138.stdout:0/670: mkdir d4/d9/d37/d64/dda 0 2024-02-07T12:25:35.969 INFO:tasks.workunit.client.1.smithi138.stdout:0/671: dread - d4/d69/f73 zero size 2024-02-07T12:25:35.969 INFO:tasks.workunit.client.1.smithi138.stdout:7/784: dwrite d0/d8/d11/d26/d90/f72 [0,4194304] 0 2024-02-07T12:25:35.970 INFO:tasks.workunit.client.1.smithi138.stdout:2/733: unlink d3/dd/d19/d1f/d46/d71/lde 0 2024-02-07T12:25:35.970 INFO:tasks.workunit.client.1.smithi138.stdout:2/734: chown d3/dd/d19/d44/d7d/d97/fe9 20841 1 2024-02-07T12:25:35.970 INFO:tasks.workunit.client.1.smithi138.stdout:2/735: chown d3/dd/d19/d44/d7d/lf1 213 1 2024-02-07T12:25:35.971 INFO:tasks.workunit.client.1.smithi138.stdout:2/736: stat d3/dd/d19 0 2024-02-07T12:25:35.972 INFO:tasks.workunit.client.1.smithi138.stdout:7/785: write d0/d8/d11/d26/fb9 [627901,38255] 0 2024-02-07T12:25:35.972 INFO:tasks.workunit.client.1.smithi138.stdout:3/732: mkdir d5/d26/d9b/dab/dc4/dfb 0 2024-02-07T12:25:35.972 INFO:tasks.workunit.client.1.smithi138.stdout:3/733: fdatasync d5/f24 0 2024-02-07T12:25:35.974 INFO:tasks.workunit.client.1.smithi138.stdout:9/557: unlink d0/d6/d8/d1d/dd/d41/d5e/f67 0 2024-02-07T12:25:35.974 INFO:tasks.workunit.client.1.smithi138.stdout:4/607: rmdir d20/d34/d59/d88 39 2024-02-07T12:25:35.974 INFO:tasks.workunit.client.1.smithi138.stdout:4/608: truncate d20/f28 735569 0 2024-02-07T12:25:35.974 INFO:tasks.workunit.client.1.smithi138.stdout:4/609: stat d20/d34/d59/d72/d77/f97 0 2024-02-07T12:25:35.975 INFO:tasks.workunit.client.1.smithi138.stdout:6/665: creat dc/d73/d9b/fd9 x:0 0 0 2024-02-07T12:25:35.976 INFO:tasks.workunit.client.1.smithi138.stdout:0/672: dread f1 [0,4194304] 0 2024-02-07T12:25:35.976 INFO:tasks.workunit.client.1.smithi138.stdout:2/737: mknod d3/dd/d14/d8f/dbc/df6/c10e 0 2024-02-07T12:25:35.978 INFO:tasks.workunit.client.1.smithi138.stdout:8/769: dread d1/de/db4/db8/d17/d3e/d72/d95/f9d [0,4194304] 0 2024-02-07T12:25:35.979 INFO:tasks.workunit.client.1.smithi138.stdout:3/734: link d5/d26/f60 d5/d27/d35/ffc 0 2024-02-07T12:25:35.979 INFO:tasks.workunit.client.1.smithi138.stdout:0/673: dread d4/d9/db/fcb [0,4194304] 0 2024-02-07T12:25:35.982 INFO:tasks.workunit.client.1.smithi138.stdout:9/558: mkdir d0/d6/d8/d1d/dd/d41/d5e/da6 0 2024-02-07T12:25:35.984 INFO:tasks.workunit.client.1.smithi138.stdout:6/666: symlink dc/d13/d1e/d35/d6d/da6/lda 0 2024-02-07T12:25:35.986 INFO:tasks.workunit.client.1.smithi138.stdout:1/583: dread d5/d8/f14 [0,4194304] 0 2024-02-07T12:25:35.986 INFO:tasks.workunit.client.1.smithi138.stdout:2/738: mknod d3/dd/d14/d8f/dbc/c10f 0 2024-02-07T12:25:35.986 INFO:tasks.workunit.client.1.smithi138.stdout:2/739: chown d3/d4e/ca9 60689 1 2024-02-07T12:25:35.986 INFO:tasks.workunit.client.1.smithi138.stdout:2/740: write d3/dd/d14/d49/d29/feb [397388,42140] 0 2024-02-07T12:25:35.986 INFO:tasks.workunit.client.1.smithi138.stdout:7/786: read d0/d6/d84/fd0 [1622978,34769] 0 2024-02-07T12:25:35.987 INFO:tasks.workunit.client.1.smithi138.stdout:0/674: mkdir d4/d9/db/d39/ddb 0 2024-02-07T12:25:35.989 INFO:tasks.workunit.client.1.smithi138.stdout:8/770: write d1/f15 [716467,82824] 0 2024-02-07T12:25:35.989 INFO:tasks.workunit.client.1.smithi138.stdout:9/559: rename d0/d6/f15 to d0/d6/d8/d95/fa7 0 2024-02-07T12:25:35.989 INFO:tasks.workunit.client.1.smithi138.stdout:9/560: fdatasync d0/d6/d8/d1d/dd/d25/f85 0 2024-02-07T12:25:35.991 INFO:tasks.workunit.client.1.smithi138.stdout:4/610: rmdir d20/d47/d69/d76 39 2024-02-07T12:25:35.991 INFO:tasks.workunit.client.1.smithi138.stdout:1/584: dread d5/d5c/f7a [0,4194304] 0 2024-02-07T12:25:35.991 INFO:tasks.workunit.client.1.smithi138.stdout:0/675: dread d4/d9/db/f20 [0,4194304] 0 2024-02-07T12:25:35.993 INFO:tasks.workunit.client.1.smithi138.stdout:6/667: symlink dc/d13/d1e/d35/d7c/ldb 0 2024-02-07T12:25:35.993 INFO:tasks.workunit.client.1.smithi138.stdout:6/668: chown dc/d13/d1e/d35/d6d/f6e 104297 1 2024-02-07T12:25:35.995 INFO:tasks.workunit.client.1.smithi138.stdout:2/741: mknod d3/dd/d19/d1f/d46/c110 0 2024-02-07T12:25:35.995 INFO:tasks.workunit.client.1.smithi138.stdout:2/742: write d3/dd/fdf [1559731,28558] 0 2024-02-07T12:25:35.997 INFO:tasks.workunit.client.1.smithi138.stdout:9/561: dread d0/d6/d8/d1d/dd/d41/d5e/f75 [0,4194304] 0 2024-02-07T12:25:35.997 INFO:tasks.workunit.client.1.smithi138.stdout:1/585: symlink d5/d8/da/d1f/d5e/db5/d68/da7/lcd 0 2024-02-07T12:25:36.001 INFO:tasks.workunit.client.1.smithi138.stdout:8/771: dread d1/de/db4/db8/f1a [0,4194304] 0 2024-02-07T12:25:36.001 INFO:tasks.workunit.client.1.smithi138.stdout:8/772: readlink d1/de/db4/db8/d17/d3e/d72/dda/d4c/d62/ldf 0 2024-02-07T12:25:36.001 INFO:tasks.workunit.client.1.smithi138.stdout:2/743: mkdir d3/dd/d19/d1f/d46/d71/d111 0 2024-02-07T12:25:36.001 INFO:tasks.workunit.client.1.smithi138.stdout:5/625: dwrite da/d6d/d27/d2e/d4f/f9c [0,4194304] 0 2024-02-07T12:25:36.001 INFO:tasks.workunit.client.1.smithi138.stdout:2/744: truncate d3/f53 1258493 0 2024-02-07T12:25:36.001 INFO:tasks.workunit.client.1.smithi138.stdout:5/626: write da/d6d/f4e [2097327,55514] 0 2024-02-07T12:25:36.004 INFO:tasks.workunit.client.1.smithi138.stdout:9/562: unlink d0/d6/d8/d1d/c3f 0 2024-02-07T12:25:36.005 INFO:tasks.workunit.client.1.smithi138.stdout:3/735: dwrite d5/d26/d5e/d77/fd6 [4194304,4194304] 0 2024-02-07T12:25:36.005 INFO:tasks.workunit.client.1.smithi138.stdout:3/736: stat d5/d26/d28/f4b 0 2024-02-07T12:25:36.010 INFO:tasks.workunit.client.1.smithi138.stdout:8/773: symlink d1/de/db4/db8/d17/d2e/d3a/de8/lf2 0 2024-02-07T12:25:36.016 INFO:tasks.workunit.client.1.smithi138.stdout:9/563: dread d0/d6/d8/d1d/dd/d25/f2d [0,4194304] 0 2024-02-07T12:25:36.017 INFO:tasks.workunit.client.1.smithi138.stdout:5/627: chown da/d34/dbd/fc3 7316425 1 2024-02-07T12:25:36.020 INFO:tasks.workunit.client.1.smithi138.stdout:8/774: dread d1/de/db4/db8/f1e [0,4194304] 0 2024-02-07T12:25:36.020 INFO:tasks.workunit.client.1.smithi138.stdout:8/775: write d1/de/db4/db8/d17/f8c [283235,36896] 0 2024-02-07T12:25:36.020 INFO:tasks.workunit.client.1.smithi138.stdout:1/586: getdents d5/d4b 0 2024-02-07T12:25:36.025 INFO:tasks.workunit.client.1.smithi138.stdout:8/776: dread d1/de/db4/db8/f1d [0,4194304] 0 2024-02-07T12:25:36.026 INFO:tasks.workunit.client.1.smithi138.stdout:3/737: mkdir d5/dfd 0 2024-02-07T12:25:36.027 INFO:tasks.workunit.client.1.smithi138.stdout:1/587: creat d5/d8/da/d20/dc2/fce x:0 0 0 2024-02-07T12:25:36.028 INFO:tasks.workunit.client.1.smithi138.stdout:8/777: symlink d1/de/db4/db8/d17/d2e/lf3 0 2024-02-07T12:25:36.028 INFO:tasks.workunit.client.1.smithi138.stdout:9/564: stat d0/d6/d8/d1d/dd/d1f/l9f 0 2024-02-07T12:25:36.029 INFO:tasks.workunit.client.1.smithi138.stdout:3/738: symlink d5/d27/d35/dac/lfe 0 2024-02-07T12:25:36.030 INFO:tasks.workunit.client.1.smithi138.stdout:8/778: getdents d1/de/db4 0 2024-02-07T12:25:36.031 INFO:tasks.workunit.client.1.smithi138.stdout:3/739: creat d5/d34/dc5/fff x:0 0 0 2024-02-07T12:25:36.033 INFO:tasks.workunit.client.1.smithi138.stdout:8/779: rename d1/de/db4/db8/d17/d8a/d8d/fe9 to d1/d99/ff4 0 2024-02-07T12:25:36.034 INFO:tasks.workunit.client.1.smithi138.stdout:3/740: symlink d5/d26/d5e/d77/l100 0 2024-02-07T12:25:36.034 INFO:tasks.workunit.client.1.smithi138.stdout:3/741: dread - d5/d26/d28/f9e zero size 2024-02-07T12:25:36.036 INFO:tasks.workunit.client.1.smithi138.stdout:6/669: dwrite dc/d31/d38/f3d [0,4194304] 0 2024-02-07T12:25:36.037 INFO:tasks.workunit.client.1.smithi138.stdout:6/670: stat dc/d13/f42 0 2024-02-07T12:25:36.037 INFO:tasks.workunit.client.1.smithi138.stdout:6/671: chown dc/d31/d38/f3b 13255856 1 2024-02-07T12:25:36.037 INFO:tasks.workunit.client.1.smithi138.stdout:8/780: link d1/de/db4/db8/d17/d3e/d72/dda/d4c/d62/ldf d1/de/db4/db8/d17/lf5 0 2024-02-07T12:25:36.040 INFO:tasks.workunit.client.1.smithi138.stdout:2/745: dwrite f1 [4194304,4194304] 0 2024-02-07T12:25:36.040 INFO:tasks.workunit.client.1.smithi138.stdout:7/787: dwrite d0/d8/d11/d26/d90/f7d [0,4194304] 0 2024-02-07T12:25:36.040 INFO:tasks.workunit.client.1.smithi138.stdout:7/788: truncate d0/d6/d3e/f3f 837180 0 2024-02-07T12:25:36.041 INFO:tasks.workunit.client.1.smithi138.stdout:4/611: dwrite d20/f2f [0,4194304] 0 2024-02-07T12:25:36.041 INFO:tasks.workunit.client.1.smithi138.stdout:6/672: rename dc/d31/d54/f8f to dc/d31/d38/d9a/fdc 0 2024-02-07T12:25:36.042 INFO:tasks.workunit.client.1.smithi138.stdout:3/742: symlink d5/l101 0 2024-02-07T12:25:36.053 INFO:tasks.workunit.client.1.smithi138.stdout:2/746: write d3/dd/d14/d49/d25/d3d/f45 [1755607,110081] 0 2024-02-07T12:25:36.058 INFO:tasks.workunit.client.1.smithi138.stdout:1/588: dwrite d5/d4b/d91/f9f [4194304,4194304] 0 2024-02-07T12:25:36.058 INFO:tasks.workunit.client.1.smithi138.stdout:9/565: dwrite d0/d6/d8/d1d/dd/d25/f2d [0,4194304] 0 2024-02-07T12:25:36.060 INFO:tasks.workunit.client.1.smithi138.stdout:7/789: dwrite d0/d8/db3/fba [0,4194304] 0 2024-02-07T12:25:36.060 INFO:tasks.workunit.client.1.smithi138.stdout:7/790: creat d0/d8/d11/d63/f104 x:0 0 0 2024-02-07T12:25:36.061 INFO:tasks.workunit.client.1.smithi138.stdout:4/612: creat d20/d53/d71/d75/fbe x:0 0 0 2024-02-07T12:25:36.062 INFO:tasks.workunit.client.1.smithi138.stdout:6/673: mkdir dc/d31/d54/ddd 0 2024-02-07T12:25:36.063 INFO:tasks.workunit.client.1.smithi138.stdout:2/747: creat d3/dd/d14/d8f/de7/f112 x:0 0 0 2024-02-07T12:25:36.063 INFO:tasks.workunit.client.1.smithi138.stdout:2/748: readlink d3/dd/d14/d8f/d73/d80/l8c 0 2024-02-07T12:25:36.064 INFO:tasks.workunit.client.1.smithi138.stdout:3/743: dwrite d5/f75 [0,4194304] 0 2024-02-07T12:25:36.064 INFO:tasks.workunit.client.1.smithi138.stdout:3/744: chown d5/c2d 2433176 1 2024-02-07T12:25:36.066 INFO:tasks.workunit.client.1.smithi138.stdout:3/745: dread d5/d26/d5e/fe0 [0,4194304] 0 2024-02-07T12:25:36.066 INFO:tasks.workunit.client.1.smithi138.stdout:3/746: chown d5/d27/d35/d7c/lc2 47 1 2024-02-07T12:25:36.066 INFO:tasks.workunit.client.1.smithi138.stdout:3/747: truncate d5/d26/d90/fba 581386 0 2024-02-07T12:25:36.066 INFO:tasks.workunit.client.1.smithi138.stdout:3/748: dread - d5/d26/d5e/d86/ded/f41 zero size 2024-02-07T12:25:36.068 INFO:tasks.workunit.client.1.smithi138.stdout:1/589: creat d5/d8/fcf x:0 0 0 2024-02-07T12:25:36.070 INFO:tasks.workunit.client.1.smithi138.stdout:9/566: mknod d0/d6/d8/d1d/dd/d1f/ca8 0 2024-02-07T12:25:36.080 INFO:tasks.workunit.client.1.smithi138.stdout:7/791: symlink d0/d8/d15/l105 0 2024-02-07T12:25:36.081 INFO:tasks.workunit.client.1.smithi138.stdout:3/749: dwrite d5/f24 [0,4194304] 0 2024-02-07T12:25:36.083 INFO:tasks.workunit.client.1.smithi138.stdout:6/674: mknod dc/d13/d1e/d35/d7c/cde 0 2024-02-07T12:25:36.083 INFO:tasks.workunit.client.1.smithi138.stdout:6/675: fsync dc/d31/f72 0 2024-02-07T12:25:36.083 INFO:tasks.workunit.client.1.smithi138.stdout:6/676: readlink dc/d31/d38/d9a/lce 0 2024-02-07T12:25:36.083 INFO:tasks.workunit.client.1.smithi138.stdout:6/677: chown dc/d69/l92 602033 1 2024-02-07T12:25:36.083 INFO:tasks.workunit.client.1.smithi138.stdout:6/678: fdatasync dc/d69/f5e 0 2024-02-07T12:25:36.084 INFO:tasks.workunit.client.1.smithi138.stdout:2/749: creat d3/dd/d14/d86/f113 x:0 0 0 2024-02-07T12:25:36.085 INFO:tasks.workunit.client.1.smithi138.stdout:1/590: readlink d5/d8/l54 0 2024-02-07T12:25:36.087 INFO:tasks.workunit.client.1.smithi138.stdout:9/567: rename d0/d34/d45/l93 to d0/d34/d45/d78/la9 0 2024-02-07T12:25:36.089 INFO:tasks.workunit.client.1.smithi138.stdout:7/792: symlink d0/d8/db3/l106 0 2024-02-07T12:25:36.092 INFO:tasks.workunit.client.1.smithi138.stdout:4/613: rmdir d20/d34/d59 39 2024-02-07T12:25:36.097 INFO:tasks.workunit.client.1.smithi138.stdout:3/750: rename d5/d26/d28/f52 to d5/d26/d9a/f102 0 2024-02-07T12:25:36.097 INFO:tasks.workunit.client.1.smithi138.stdout:7/793: read d0/d8/db3/fba [1570751,105031] 0 2024-02-07T12:25:36.099 INFO:tasks.workunit.client.1.smithi138.stdout:9/568: creat d0/d6/d8/d1d/dd/d1f/faa x:0 0 0 2024-02-07T12:25:36.102 INFO:tasks.workunit.client.1.smithi138.stdout:2/750: rename d3/dd/d14/d8f/dbc/df6/c10e to d3/dd/d14/d49/d29/c114 0 2024-02-07T12:25:36.102 INFO:tasks.workunit.client.1.smithi138.stdout:2/751: stat d3/d4e/fdb 0 2024-02-07T12:25:36.102 INFO:tasks.workunit.client.1.smithi138.stdout:2/752: dread - d3/dd/d14/d8f/d73/d80/ffa zero size 2024-02-07T12:25:36.104 INFO:tasks.workunit.client.1.smithi138.stdout:1/591: dwrite d5/d4b/d6b/d6e/d79/fb1 [0,4194304] 0 2024-02-07T12:25:36.104 INFO:tasks.workunit.client.1.smithi138.stdout:3/751: link d5/d26/d5e/d86/ded/fe7 d5/d26/d5e/d86/ded/d32/da1/f103 0 2024-02-07T12:25:36.104 INFO:tasks.workunit.client.1.smithi138.stdout:3/752: fsync d5/d26/d28/f4b 0 2024-02-07T12:25:36.105 INFO:tasks.workunit.client.1.smithi138.stdout:6/679: dwrite dc/d13/d1e/f30 [0,4194304] 0 2024-02-07T12:25:36.105 INFO:tasks.workunit.client.1.smithi138.stdout:9/569: truncate d0/d6/d8/d95/f96 1382947 0 2024-02-07T12:25:36.105 INFO:tasks.workunit.client.1.smithi138.stdout:9/570: write d0/d6/d8/d1d/dd/f9c [102200,47988] 0 2024-02-07T12:25:36.106 INFO:tasks.workunit.client.1.smithi138.stdout:2/753: getdents d3/dd/d14 0 2024-02-07T12:25:36.107 INFO:tasks.workunit.client.1.smithi138.stdout:2/754: write d3/dd/d14/d49/d29/feb [2996306,92559] 0 2024-02-07T12:25:36.111 INFO:tasks.workunit.client.1.smithi138.stdout:6/680: symlink dc/d31/d54/ldf 0 2024-02-07T12:25:36.113 INFO:tasks.workunit.client.1.smithi138.stdout:7/794: dwrite d0/d39/d8a/fbc [0,4194304] 0 2024-02-07T12:25:36.113 INFO:tasks.workunit.client.1.smithi138.stdout:2/755: symlink d3/dd/d19/d1f/dc9/l115 0 2024-02-07T12:25:36.113 INFO:tasks.workunit.client.1.smithi138.stdout:2/756: creat d3/dd/d14/d49/d25/d3d/d5f/f116 x:0 0 0 2024-02-07T12:25:36.114 INFO:tasks.workunit.client.1.smithi138.stdout:6/681: dread dc/d31/d38/f53 [0,4194304] 0 2024-02-07T12:25:36.114 INFO:tasks.workunit.client.1.smithi138.stdout:6/682: read - dc/fc6 zero size 2024-02-07T12:25:36.114 INFO:tasks.workunit.client.1.smithi138.stdout:6/683: write dc/d31/f48 [872526,118760] 0 2024-02-07T12:25:36.114 INFO:tasks.workunit.client.1.smithi138.stdout:1/592: mkdir d5/d8/dd0 0 2024-02-07T12:25:36.118 INFO:tasks.workunit.client.1.smithi138.stdout:9/571: read d0/d6/d8/d1d/dd/d41/f60 [2684517,110637] 0 2024-02-07T12:25:36.118 INFO:tasks.workunit.client.1.smithi138.stdout:9/572: fsync d0/d6/d8/d1d/dd/d1f/f1b 0 2024-02-07T12:25:36.118 INFO:tasks.workunit.client.1.smithi138.stdout:9/573: write d0/d6/d8/d1d/dd/d41/f76 [951337,112248] 0 2024-02-07T12:25:36.122 INFO:tasks.workunit.client.1.smithi138.stdout:2/757: read d3/dd/d14/d49/d25/d3d/f3e [623266,26170] 0 2024-02-07T12:25:36.122 INFO:tasks.workunit.client.1.smithi138.stdout:6/684: mkdir dc/d13/d1e/d4d/de0 0 2024-02-07T12:25:36.123 INFO:tasks.workunit.client.1.smithi138.stdout:1/593: read d5/d4b/d6b/d6e/d79/fb1 [250891,115229] 0 2024-02-07T12:25:36.123 INFO:tasks.workunit.client.1.smithi138.stdout:1/594: getdents d5/d8/da/d1f/d5e/db8 0 2024-02-07T12:25:36.124 INFO:tasks.workunit.client.1.smithi138.stdout:9/574: creat d0/fab x:0 0 0 2024-02-07T12:25:36.126 INFO:tasks.workunit.client.1.smithi138.stdout:2/758: symlink d3/dd/d14/d49/d29/d5b/l117 0 2024-02-07T12:25:36.128 INFO:tasks.workunit.client.1.smithi138.stdout:6/685: truncate dc/d31/d38/f3b 764690 0 2024-02-07T12:25:36.128 INFO:tasks.workunit.client.1.smithi138.stdout:6/686: truncate dc/d31/d38/d9a/fb7 23885 0 2024-02-07T12:25:36.130 INFO:tasks.workunit.client.1.smithi138.stdout:1/595: getdents d5/d8/da/d1f/d5e/db5/d68/d73/d7b 0 2024-02-07T12:25:36.130 INFO:tasks.workunit.client.1.smithi138.stdout:1/596: fdatasync d5/d8/da/d1f/f96 0 2024-02-07T12:25:36.130 INFO:tasks.workunit.client.1.smithi138.stdout:1/597: chown d5/d8/da/d1f/d5e/db5/d68/faa 53902469 1 2024-02-07T12:25:36.130 INFO:tasks.workunit.client.1.smithi138.stdout:0/676: sync 2024-02-07T12:25:36.130 INFO:tasks.workunit.client.1.smithi138.stdout:0/677: dread d4/d52/f2e [4194304,4194304] 0 2024-02-07T12:25:36.134 INFO:tasks.workunit.client.1.smithi138.stdout:2/759: creat d3/dd/d19/d44/de8/f118 x:0 0 0 2024-02-07T12:25:36.136 INFO:tasks.workunit.client.1.smithi138.stdout:2/760: dread d3/dd/fdf [0,4194304] 0 2024-02-07T12:25:36.136 INFO:tasks.workunit.client.1.smithi138.stdout:2/761: write d3/dd/fdf [1616301,7173] 0 2024-02-07T12:25:36.137 INFO:tasks.workunit.client.1.smithi138.stdout:2/762: dread d3/dd/d14/d49/d29/d5b/fba [0,4194304] 0 2024-02-07T12:25:36.137 INFO:tasks.workunit.client.1.smithi138.stdout:2/763: read - d3/dd/d19/d44/d7d/fb5 zero size 2024-02-07T12:25:36.137 INFO:tasks.workunit.client.1.smithi138.stdout:2/764: write d3/dd/d19/fc4 [177735,109443] 0 2024-02-07T12:25:36.138 INFO:tasks.workunit.client.1.smithi138.stdout:6/687: creat dc/d13/d1e/d35/dc0/fe1 x:0 0 0 2024-02-07T12:25:36.138 INFO:tasks.workunit.client.1.smithi138.stdout:5/628: sync 2024-02-07T12:25:36.138 INFO:tasks.workunit.client.1.smithi138.stdout:8/781: sync 2024-02-07T12:25:36.138 INFO:tasks.workunit.client.1.smithi138.stdout:8/782: read d1/de/db4/db8/f7b [332686,35791] 0 2024-02-07T12:25:36.140 INFO:tasks.workunit.client.1.smithi138.stdout:0/678: creat d4/d52/d74/fdc x:0 0 0 2024-02-07T12:25:36.145 INFO:tasks.workunit.client.1.smithi138.stdout:5/629: creat da/d6d/d27/d2e/d4f/d2b/d35/fd0 x:0 0 0 2024-02-07T12:25:36.146 INFO:tasks.workunit.client.1.smithi138.stdout:1/598: symlink d5/d8/ld1 0 2024-02-07T12:25:36.146 INFO:tasks.workunit.client.1.smithi138.stdout:1/599: stat d5/d8/da/d1f/d5e/db5/d68/d73/d7b/c18 0 2024-02-07T12:25:36.149 INFO:tasks.workunit.client.1.smithi138.stdout:0/679: truncate d4/d9/db/d71/f7c 731209 0 2024-02-07T12:25:36.151 INFO:tasks.workunit.client.1.smithi138.stdout:5/630: readlink da/d6d/d27/d2e/d4f/d2b/d35/d5d/lc0 0 2024-02-07T12:25:36.152 INFO:tasks.workunit.client.1.smithi138.stdout:1/600: mknod d5/d8/da/d1f/d5e/db5/d68/da7/cd2 0 2024-02-07T12:25:36.154 INFO:tasks.workunit.client.1.smithi138.stdout:8/783: dwrite d1/de/db4/db8/d17/d3e/d89/fd0 [0,4194304] 0 2024-02-07T12:25:36.155 INFO:tasks.workunit.client.1.smithi138.stdout:5/631: mkdir da/d6d/d27/d2e/d4f/d2b/d35/d67/dd1 0 2024-02-07T12:25:36.159 INFO:tasks.workunit.client.1.smithi138.stdout:2/765: rename d3/dd/d19/d44 to d3/d4e/d119 0 2024-02-07T12:25:36.162 INFO:tasks.workunit.client.1.smithi138.stdout:8/784: getdents d1/de/db4/db8/d17/d3e/d72 0 2024-02-07T12:25:36.162 INFO:tasks.workunit.client.1.smithi138.stdout:8/785: write d1/de/db4/db8/d17/d3e/fb1 [1252221,85954] 0 2024-02-07T12:25:36.166 INFO:tasks.workunit.client.1.smithi138.stdout:0/680: rename d4/d9/c30 to d4/d69/d85/d8a/cdd 0 2024-02-07T12:25:36.168 INFO:tasks.workunit.client.1.smithi138.stdout:2/766: link d3/d4e/l107 d3/dd/d19/d1f/d46/d71/d7e/l11a 0 2024-02-07T12:25:36.168 INFO:tasks.workunit.client.1.smithi138.stdout:2/767: readlink d3/d4e/d119/d7d/l90 0 2024-02-07T12:25:36.171 INFO:tasks.workunit.client.1.smithi138.stdout:8/786: creat d1/de/db4/db8/d17/ff6 x:0 0 0 2024-02-07T12:25:36.172 INFO:tasks.workunit.client.1.smithi138.stdout:1/601: dwrite d5/d4b/d65/fa6 [0,4194304] 0 2024-02-07T12:25:36.172 INFO:tasks.workunit.client.1.smithi138.stdout:1/602: read d5/d8/da/d20/f21 [160286,110588] 0 2024-02-07T12:25:36.172 INFO:tasks.workunit.client.1.smithi138.stdout:1/603: dread - d5/d8/da/d1f/d3c/d59/f8d zero size 2024-02-07T12:25:36.173 INFO:tasks.workunit.client.1.smithi138.stdout:0/681: creat d4/d9/d37/d3d/fde x:0 0 0 2024-02-07T12:25:36.175 INFO:tasks.workunit.client.1.smithi138.stdout:2/768: symlink d3/dd/d14/d82/dcc/l11b 0 2024-02-07T12:25:36.175 INFO:tasks.workunit.client.1.smithi138.stdout:2/769: chown d3/dd/d14/d49/d25/l58 131406 1 2024-02-07T12:25:36.175 INFO:tasks.workunit.client.1.smithi138.stdout:0/682: write d4/d9/de/f72 [340448,106241] 0 2024-02-07T12:25:36.175 INFO:tasks.workunit.client.1.smithi138.stdout:8/787: getdents d1/de/db4/db8/d17/d58 0 2024-02-07T12:25:36.176 INFO:tasks.workunit.client.1.smithi138.stdout:1/604: dread d5/d4b/d6b/d6e/d79/fb1 [0,4194304] 0 2024-02-07T12:25:36.177 INFO:tasks.workunit.client.1.smithi138.stdout:2/770: creat d3/dd/dd2/f11c x:0 0 0 2024-02-07T12:25:36.177 INFO:tasks.workunit.client.1.smithi138.stdout:2/771: chown d3/dd/d19/d1f/d37/fbe 72 1 2024-02-07T12:25:36.177 INFO:tasks.workunit.client.1.smithi138.stdout:2/772: readlink d3/dd/d19/d1f/dc9/l115 0 2024-02-07T12:25:36.178 INFO:tasks.workunit.client.1.smithi138.stdout:0/683: rmdir d4/d9/d37/d6b/d7f 39 2024-02-07T12:25:36.178 INFO:tasks.workunit.client.1.smithi138.stdout:0/684: stat d4/d9/d37/d64/f9b 0 2024-02-07T12:25:36.179 INFO:tasks.workunit.client.1.smithi138.stdout:1/605: creat d5/d8/da/d1f/d5e/fd3 x:0 0 0 2024-02-07T12:25:36.190 INFO:tasks.workunit.client.1.smithi138.stdout:8/788: dread d1/f22 [0,4194304] 0 2024-02-07T12:25:36.191 INFO:tasks.workunit.client.1.smithi138.stdout:2/773: write d3/d4e/d119/d7d/fe1 [3029675,127274] 0 2024-02-07T12:25:36.191 INFO:tasks.workunit.client.1.smithi138.stdout:2/774: dread - d3/d4e/d119/de8/f118 zero size 2024-02-07T12:25:36.192 INFO:tasks.workunit.client.1.smithi138.stdout:8/789: rmdir d1/de/de3 0 2024-02-07T12:25:36.192 INFO:tasks.workunit.client.1.smithi138.stdout:8/790: readlink d1/de/db4/db8/d17/d2e/l69 0 2024-02-07T12:25:36.192 INFO:tasks.workunit.client.1.smithi138.stdout:8/791: write d1/de/db4/db8/d17/d3e/d72/dda/d4c/d62/fe1 [756551,130279] 0 2024-02-07T12:25:36.192 INFO:tasks.workunit.client.1.smithi138.stdout:1/606: write d5/d4b/d91/f9f [7943699,1834] 0 2024-02-07T12:25:36.194 INFO:tasks.workunit.client.1.smithi138.stdout:2/775: symlink d3/dd/d19/d1f/dc9/l11d 0 2024-02-07T12:25:36.194 INFO:tasks.workunit.client.1.smithi138.stdout:2/776: read d3/dd/d19/d1f/f5c [1548724,95518] 0 2024-02-07T12:25:36.196 INFO:tasks.workunit.client.1.smithi138.stdout:8/792: getdents d1/d99 0 2024-02-07T12:25:36.197 INFO:tasks.workunit.client.1.smithi138.stdout:5/632: dwrite da/d34/dbd/fc3 [0,4194304] 0 2024-02-07T12:25:36.198 INFO:tasks.workunit.client.1.smithi138.stdout:8/793: unlink d1/de/db4/db8/d17/d3e/d89/fd0 0 2024-02-07T12:25:36.198 INFO:tasks.workunit.client.1.smithi138.stdout:8/794: creat d1/d99/da6/de7/ff7 x:0 0 0 2024-02-07T12:25:36.207 INFO:tasks.workunit.client.1.smithi138.stdout:1/607: dread d5/f2a [0,4194304] 0 2024-02-07T12:25:36.208 INFO:tasks.workunit.client.1.smithi138.stdout:1/608: link d5/d8/da/d1f/d5e/d63/d99/fba d5/d8/dd0/fd4 0 2024-02-07T12:25:36.209 INFO:tasks.workunit.client.1.smithi138.stdout:1/609: getdents d5/d8/da/d1f/d60 0 2024-02-07T12:25:36.210 INFO:tasks.workunit.client.1.smithi138.stdout:1/610: symlink d5/d8/da/d1f/d5e/ld5 0 2024-02-07T12:25:36.211 INFO:tasks.workunit.client.1.smithi138.stdout:1/611: truncate d5/d8/da/f29 4831491 0 2024-02-07T12:25:36.212 INFO:tasks.workunit.client.1.smithi138.stdout:1/612: creat d5/d8/da/d1f/d5e/db5/d68/da7/fd6 x:0 0 0 2024-02-07T12:25:36.298 INFO:tasks.workunit.client.1.smithi138.stdout:5/633: dwrite da/d6d/d27/d2e/d4f/d2b/fb3 [0,4194304] 0 2024-02-07T12:25:36.299 INFO:tasks.workunit.client.1.smithi138.stdout:5/634: dread da/d43/d4a/d95/fb2 [0,4194304] 0 2024-02-07T12:25:36.301 INFO:tasks.workunit.client.1.smithi138.stdout:5/635: creat da/d6d/d27/d2e/fd2 x:0 0 0 2024-02-07T12:25:36.341 INFO:tasks.workunit.client.1.smithi138.stdout:0/685: dwrite d4/d9/db/fba [0,4194304] 0 2024-02-07T12:25:36.359 INFO:tasks.workunit.client.1.smithi138.stdout:8/795: dwrite d1/d99/da6/de7/fec [0,4194304] 0 2024-02-07T12:25:36.360 INFO:tasks.workunit.client.1.smithi138.stdout:8/796: write d1/de/db4/db8/d17/d2e/f78 [418523,123468] 0 2024-02-07T12:25:36.363 INFO:tasks.workunit.client.1.smithi138.stdout:8/797: mknod d1/db3/cf8 0 2024-02-07T12:25:36.363 INFO:tasks.workunit.client.1.smithi138.stdout:8/798: getdents d1/de/db4/db8/d17/d2e/dcc 0 2024-02-07T12:25:36.363 INFO:tasks.workunit.client.1.smithi138.stdout:1/613: dwrite d5/d8/da/d20/f80 [0,4194304] 0 2024-02-07T12:25:36.364 INFO:tasks.workunit.client.1.smithi138.stdout:8/799: getdents d1/de/db4/db8/d17/d3e/d72/dda/d4c 0 2024-02-07T12:25:36.365 INFO:tasks.workunit.client.1.smithi138.stdout:8/800: dread - d1/de/db4/db8/d17/ff6 zero size 2024-02-07T12:25:36.365 INFO:tasks.workunit.client.1.smithi138.stdout:0/686: dwrite d4/d9/de/d1d/d21/f4e [0,4194304] 0 2024-02-07T12:25:36.365 INFO:tasks.workunit.client.1.smithi138.stdout:0/687: write d4/d9/db/f15 [3447460,105804] 0 2024-02-07T12:25:36.365 INFO:tasks.workunit.client.1.smithi138.stdout:4/614: sync 2024-02-07T12:25:36.365 INFO:tasks.workunit.client.1.smithi138.stdout:4/615: getdents d20/d53 0 2024-02-07T12:25:36.367 INFO:tasks.workunit.client.1.smithi138.stdout:1/614: truncate d5/d8/da/f11 14710665 0 2024-02-07T12:25:36.368 INFO:tasks.workunit.client.1.smithi138.stdout:1/615: chown d5/d8/da/d1f/d5e/db5/c33 1019 1 2024-02-07T12:25:36.368 INFO:tasks.workunit.client.1.smithi138.stdout:1/616: stat d5/d43/l94 0 2024-02-07T12:25:36.368 INFO:tasks.workunit.client.1.smithi138.stdout:5/636: dwrite da/d6d/f4e [0,4194304] 0 2024-02-07T12:25:36.369 INFO:tasks.workunit.client.1.smithi138.stdout:0/688: creat d4/d9/db/d71/fdf x:0 0 0 2024-02-07T12:25:36.372 INFO:tasks.workunit.client.1.smithi138.stdout:1/617: unlink d5/d4b/fc9 0 2024-02-07T12:25:36.374 INFO:tasks.workunit.client.1.smithi138.stdout:3/753: sync 2024-02-07T12:25:36.375 INFO:tasks.workunit.client.1.smithi138.stdout:7/795: sync 2024-02-07T12:25:36.375 INFO:tasks.workunit.client.1.smithi138.stdout:3/754: write d5/f23 [433800,60402] 0 2024-02-07T12:25:36.375 INFO:tasks.workunit.client.1.smithi138.stdout:9/575: sync 2024-02-07T12:25:36.377 INFO:tasks.workunit.client.1.smithi138.stdout:5/637: symlink da/d22/d99/ld3 0 2024-02-07T12:25:36.377 INFO:tasks.workunit.client.1.smithi138.stdout:5/638: readlink da/d50/l8e 0 2024-02-07T12:25:36.378 INFO:tasks.workunit.client.1.smithi138.stdout:1/618: symlink d5/d8/dbc/ld7 0 2024-02-07T12:25:36.381 INFO:tasks.workunit.client.1.smithi138.stdout:7/796: truncate d0/d8/d11/d1f/f56 2419003 0 2024-02-07T12:25:36.383 INFO:tasks.workunit.client.1.smithi138.stdout:3/755: creat d5/f104 x:0 0 0 2024-02-07T12:25:36.383 INFO:tasks.workunit.client.1.smithi138.stdout:3/756: creat d5/d34/dc5/f105 x:0 0 0 2024-02-07T12:25:36.383 INFO:tasks.workunit.client.1.smithi138.stdout:3/757: readlink d5/d26/d9d/ldf 0 2024-02-07T12:25:36.383 INFO:tasks.workunit.client.1.smithi138.stdout:3/758: write d5/d26/d28/f78 [517686,52202] 0 2024-02-07T12:25:36.383 INFO:tasks.workunit.client.1.smithi138.stdout:3/759: fdatasync d5/d27/dde/feb 0 2024-02-07T12:25:36.383 INFO:tasks.workunit.client.1.smithi138.stdout:5/639: rmdir da/d6d/d27/d2e/d4f 39 2024-02-07T12:25:36.386 INFO:tasks.workunit.client.1.smithi138.stdout:7/797: rename d0/d39/dfd/cd2 to d0/d8/d11/d1f/c107 0 2024-02-07T12:25:36.388 INFO:tasks.workunit.client.1.smithi138.stdout:8/801: dwrite d1/f13 [0,4194304] 0 2024-02-07T12:25:36.389 INFO:tasks.workunit.client.1.smithi138.stdout:4/616: dwrite d20/d34/d36/f3c [0,4194304] 0 2024-02-07T12:25:36.390 INFO:tasks.workunit.client.1.smithi138.stdout:3/760: mknod d5/d26/d5e/d86/d9c/c106 0 2024-02-07T12:25:36.390 INFO:tasks.workunit.client.1.smithi138.stdout:1/619: write d5/d8/da/d1f/d3c/d59/f77 [2435255,31720] 0 2024-02-07T12:25:36.390 INFO:tasks.workunit.client.1.smithi138.stdout:5/640: chown da/d43/d4a/d69/l5f 1 1 2024-02-07T12:25:36.390 INFO:tasks.workunit.client.1.smithi138.stdout:9/576: write d0/d6/f27 [314655,40222] 0 2024-02-07T12:25:36.391 INFO:tasks.workunit.client.1.smithi138.stdout:2/777: sync 2024-02-07T12:25:36.391 INFO:tasks.workunit.client.1.smithi138.stdout:2/778: dread - d3/dd/d14/d8f/d73/d80/df0/f106 zero size 2024-02-07T12:25:36.392 INFO:tasks.workunit.client.1.smithi138.stdout:6/688: sync 2024-02-07T12:25:36.392 INFO:tasks.workunit.client.1.smithi138.stdout:2/779: write d3/d4e/f88 [977495,123757] 0 2024-02-07T12:25:36.394 INFO:tasks.workunit.client.1.smithi138.stdout:8/802: unlink d1/d99/da6/de7/fec 0 2024-02-07T12:25:36.395 INFO:tasks.workunit.client.1.smithi138.stdout:0/689: dwrite d4/d9/d33/f4c [0,4194304] 0 2024-02-07T12:25:36.396 INFO:tasks.workunit.client.1.smithi138.stdout:4/617: creat d20/d4d/fbf x:0 0 0 2024-02-07T12:25:36.400 INFO:tasks.workunit.client.1.smithi138.stdout:1/620: mkdir d5/d8/da/d1f/d3c/d59/dd8 0 2024-02-07T12:25:36.400 INFO:tasks.workunit.client.1.smithi138.stdout:1/621: chown d5/d8/da/d1f/d5e/db5/d68/d73/d7b 25497788 1 2024-02-07T12:25:36.400 INFO:tasks.workunit.client.1.smithi138.stdout:5/641: creat da/d43/d4a/d95/fd4 x:0 0 0 2024-02-07T12:25:36.401 INFO:tasks.workunit.client.1.smithi138.stdout:5/642: chown da/d6d/d27/d2e/d4f/fc9 2843 1 2024-02-07T12:25:36.401 INFO:tasks.workunit.client.1.smithi138.stdout:5/643: fdatasync da/d6d/d27/d2e/d4f/fa9 0 2024-02-07T12:25:36.402 INFO:tasks.workunit.client.1.smithi138.stdout:9/577: symlink d0/d34/d45/d78/lac 0 2024-02-07T12:25:36.403 INFO:tasks.workunit.client.1.smithi138.stdout:9/578: stat d0/d6/d8/d1d/dd/d25/d9b 0 2024-02-07T12:25:36.403 INFO:tasks.workunit.client.1.smithi138.stdout:6/689: mknod dc/ce2 0 2024-02-07T12:25:36.403 INFO:tasks.workunit.client.1.smithi138.stdout:4/618: dread d20/d4d/f5a [0,4194304] 0 2024-02-07T12:25:36.404 INFO:tasks.workunit.client.1.smithi138.stdout:4/619: fsync d20/f28 0 2024-02-07T12:25:36.404 INFO:tasks.workunit.client.1.smithi138.stdout:4/620: dread - d20/d34/d36/f63 zero size 2024-02-07T12:25:36.404 INFO:tasks.workunit.client.1.smithi138.stdout:6/690: dread dc/d13/f1d [0,4194304] 0 2024-02-07T12:25:36.405 INFO:tasks.workunit.client.1.smithi138.stdout:0/690: mkdir d4/d9/db/d39/d4b/d6c/dc5/de0 0 2024-02-07T12:25:36.412 INFO:tasks.workunit.client.1.smithi138.stdout:5/644: mkdir da/d22/d99/dca/dd5 0 2024-02-07T12:25:36.412 INFO:tasks.workunit.client.1.smithi138.stdout:0/691: dread d4/d9/db/f15 [0,4194304] 0 2024-02-07T12:25:36.412 INFO:tasks.workunit.client.1.smithi138.stdout:6/691: mknod dc/d31/d3f/ce3 0 2024-02-07T12:25:36.412 INFO:tasks.workunit.client.1.smithi138.stdout:5/645: chown da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d96/ca0 210949 1 2024-02-07T12:25:36.412 INFO:tasks.workunit.client.1.smithi138.stdout:6/692: dread - dc/d13/f80 zero size 2024-02-07T12:25:36.412 INFO:tasks.workunit.client.1.smithi138.stdout:6/693: dread - dc/d31/d38/fd0 zero size 2024-02-07T12:25:36.412 INFO:tasks.workunit.client.1.smithi138.stdout:4/621: mkdir d20/d34/d36/d55/d74/d9a/dc0 0 2024-02-07T12:25:36.414 INFO:tasks.workunit.client.1.smithi138.stdout:5/646: creat da/d6d/fd6 x:0 0 0 2024-02-07T12:25:36.417 INFO:tasks.workunit.client.1.smithi138.stdout:4/622: rename d20/d34/d36/f38 to d20/d47/d69/d7c/db9/dba/fc1 0 2024-02-07T12:25:36.418 INFO:tasks.workunit.client.1.smithi138.stdout:9/579: link d0/d6/d8/d1d/f61 d0/d6/d8/fad 0 2024-02-07T12:25:36.419 INFO:tasks.workunit.client.1.smithi138.stdout:9/580: truncate d0/d6/d8/d1d/dd/d25/f5b 306751 0 2024-02-07T12:25:36.419 INFO:tasks.workunit.client.1.smithi138.stdout:9/581: read - d0/fab zero size 2024-02-07T12:25:36.423 INFO:tasks.workunit.client.1.smithi138.stdout:4/623: dread d20/f3f [0,4194304] 0 2024-02-07T12:25:36.426 INFO:tasks.workunit.client.1.smithi138.stdout:4/624: rename d20/d34/d59/f6c to d20/d53/d71/d98/fc2 0 2024-02-07T12:25:36.427 INFO:tasks.workunit.client.1.smithi138.stdout:4/625: creat d20/d47/d69/fc3 x:0 0 0 2024-02-07T12:25:36.428 INFO:tasks.workunit.client.1.smithi138.stdout:4/626: getdents d20/d34 0 2024-02-07T12:25:36.428 INFO:tasks.workunit.client.1.smithi138.stdout:4/627: truncate f11 1101062 0 2024-02-07T12:25:36.428 INFO:tasks.workunit.client.1.smithi138.stdout:9/582: dread d0/d34/f51 [0,4194304] 0 2024-02-07T12:25:36.448 INFO:tasks.workunit.client.1.smithi138.stdout:4/628: dread f14 [0,4194304] 0 2024-02-07T12:25:36.450 INFO:tasks.workunit.client.1.smithi138.stdout:9/583: dread d0/d6/d64/f90 [0,4194304] 0 2024-02-07T12:25:36.451 INFO:tasks.workunit.client.1.smithi138.stdout:9/584: symlink d0/d6/d8/d1d/dd/d41/d5e/da6/lae 0 2024-02-07T12:25:36.451 INFO:tasks.workunit.client.1.smithi138.stdout:9/585: write d0/f77 [2414609,107473] 0 2024-02-07T12:25:36.452 INFO:tasks.workunit.client.1.smithi138.stdout:9/586: link d0/d6/d8/d1d/dd/d1f/f1b d0/faf 0 2024-02-07T12:25:36.453 INFO:tasks.workunit.client.1.smithi138.stdout:8/803: dwrite d1/d99/da6/de7/ff7 [0,4194304] 0 2024-02-07T12:25:36.453 INFO:tasks.workunit.client.1.smithi138.stdout:8/804: chown d1/de/db4/db8/d17/d2e 1 1 2024-02-07T12:25:36.454 INFO:tasks.workunit.client.1.smithi138.stdout:7/798: dwrite d0/d8/d11/d5f/d86/f9d [0,4194304] 0 2024-02-07T12:25:36.455 INFO:tasks.workunit.client.1.smithi138.stdout:0/692: dwrite d4/d9/de/d1d/d77/f88 [0,4194304] 0 2024-02-07T12:25:36.455 INFO:tasks.workunit.client.1.smithi138.stdout:1/622: dwrite d5/d4b/d65/fa6 [0,4194304] 0 2024-02-07T12:25:36.455 INFO:tasks.workunit.client.1.smithi138.stdout:6/694: dwrite dc/d13/f42 [0,4194304] 0 2024-02-07T12:25:36.457 INFO:tasks.workunit.client.1.smithi138.stdout:7/799: rename d0/d8/d11/d26/d90/ff4 to d0/d39/d8a/f108 0 2024-02-07T12:25:36.458 INFO:tasks.workunit.client.1.smithi138.stdout:4/629: read d20/f33 [2021518,110822] 0 2024-02-07T12:25:36.458 INFO:tasks.workunit.client.1.smithi138.stdout:2/780: dwrite d3/dd/d19/d1f/fa2 [0,4194304] 0 2024-02-07T12:25:36.459 INFO:tasks.workunit.client.1.smithi138.stdout:0/693: rmdir d4/d52/d3f 39 2024-02-07T12:25:36.464 INFO:tasks.workunit.client.1.smithi138.stdout:6/695: truncate dc/d31/d38/f3d 3203592 0 2024-02-07T12:25:36.464 INFO:tasks.workunit.client.1.smithi138.stdout:6/696: dread - dc/d31/d38/d9a/fcf zero size 2024-02-07T12:25:36.467 INFO:tasks.workunit.client.1.smithi138.stdout:7/800: rename d0/d8/d11/d63/dc8/dce/f103 to d0/d6/deb/f109 0 2024-02-07T12:25:36.470 INFO:tasks.workunit.client.1.smithi138.stdout:2/781: creat d3/dd/d14/d8f/dbc/dbd/d101/f11e x:0 0 0 2024-02-07T12:25:36.471 INFO:tasks.workunit.client.1.smithi138.stdout:0/694: creat d4/d9/d37/d6b/d7f/dcf/fe1 x:0 0 0 2024-02-07T12:25:36.471 INFO:tasks.workunit.client.1.smithi138.stdout:0/695: creat d4/d52/fe2 x:0 0 0 2024-02-07T12:25:36.472 INFO:tasks.workunit.client.1.smithi138.stdout:6/697: link dc/d73/cac dc/d13/d1e/d35/d6d/da6/ce4 0 2024-02-07T12:25:36.474 INFO:tasks.workunit.client.1.smithi138.stdout:4/630: rename d20/d34/d36/d55/f80 to d20/d47/d69/fc4 0 2024-02-07T12:25:36.474 INFO:tasks.workunit.client.1.smithi138.stdout:2/782: rmdir d3/d4e/d119/d7d/d97 39 2024-02-07T12:25:36.478 INFO:tasks.workunit.client.1.smithi138.stdout:4/631: rename d20/f28 to d20/d34/d36/d55/d74/d9a/fc5 0 2024-02-07T12:25:36.481 INFO:tasks.workunit.client.1.smithi138.stdout:4/632: link d20/f33 d20/d34/d36/d55/d74/fc6 0 2024-02-07T12:25:36.482 INFO:tasks.workunit.client.1.smithi138.stdout:9/587: dwrite d0/d6/d8/d1d/dd/d1f/f1b [0,4194304] 0 2024-02-07T12:25:36.482 INFO:tasks.workunit.client.1.smithi138.stdout:4/633: rmdir d20/d34/d59/d88 39 2024-02-07T12:25:36.485 INFO:tasks.workunit.client.1.smithi138.stdout:9/588: getdents d0/d6/d8/d1d 0 2024-02-07T12:25:36.487 INFO:tasks.workunit.client.1.smithi138.stdout:9/589: rename d0/d6/d8/d95/l97 to d0/d6/d8/d1d/dd/d1f/lb0 0 2024-02-07T12:25:36.487 INFO:tasks.workunit.client.1.smithi138.stdout:9/590: readlink d0/d34/d45/l92 0 2024-02-07T12:25:36.489 INFO:tasks.workunit.client.1.smithi138.stdout:9/591: unlink d0/d6/d8/d1d/dd/d25/f85 0 2024-02-07T12:25:36.489 INFO:tasks.workunit.client.1.smithi138.stdout:9/592: chown d0/f6f 3 1 2024-02-07T12:25:36.489 INFO:tasks.workunit.client.1.smithi138.stdout:1/623: dwrite d5/f2a [0,4194304] 0 2024-02-07T12:25:36.490 INFO:tasks.workunit.client.1.smithi138.stdout:7/801: dwrite d0/d8/d11/d26/d90/f36 [0,4194304] 0 2024-02-07T12:25:36.490 INFO:tasks.workunit.client.1.smithi138.stdout:6/698: dwrite dc/d13/d1e/d35/d7c/dbe/fd6 [0,4194304] 0 2024-02-07T12:25:36.490 INFO:tasks.workunit.client.1.smithi138.stdout:1/624: symlink d5/d4b/d91/ld9 0 2024-02-07T12:25:36.496 INFO:tasks.workunit.client.1.smithi138.stdout:6/699: rename dc/d13/d1e/c60 to dc/d13/d1e/d24/ce5 0 2024-02-07T12:25:36.497 INFO:tasks.workunit.client.1.smithi138.stdout:1/625: mkdir d5/d8/da/d1f/d5e/db5/d68/d73/d7b/dda 0 2024-02-07T12:25:36.500 INFO:tasks.workunit.client.1.smithi138.stdout:9/593: dread d0/faf [0,4194304] 0 2024-02-07T12:25:36.502 INFO:tasks.workunit.client.1.smithi138.stdout:7/802: dread d0/d8/d11/d63/f7a [0,4194304] 0 2024-02-07T12:25:36.502 INFO:tasks.workunit.client.1.smithi138.stdout:7/803: stat d0/d8/l7b 0 2024-02-07T12:25:36.502 INFO:tasks.workunit.client.1.smithi138.stdout:9/594: getdents d0/d6/d8/d1d/dd 0 2024-02-07T12:25:36.503 INFO:tasks.workunit.client.1.smithi138.stdout:1/626: dread d5/f1a [0,4194304] 0 2024-02-07T12:25:36.504 INFO:tasks.workunit.client.1.smithi138.stdout:7/804: rename d0/d39/cbe to d0/d6/d19/c10a 0 2024-02-07T12:25:36.508 INFO:tasks.workunit.client.1.smithi138.stdout:9/595: symlink d0/d6/d8/d1d/da0/lb1 0 2024-02-07T12:25:36.508 INFO:tasks.workunit.client.1.smithi138.stdout:7/805: mknod d0/d8/d11/d5f/c10b 0 2024-02-07T12:25:36.508 INFO:tasks.workunit.client.1.smithi138.stdout:9/596: dread d0/d34/d86/f89 [0,4194304] 0 2024-02-07T12:25:36.508 INFO:tasks.workunit.client.1.smithi138.stdout:9/597: stat d0/d6/d8/fad 0 2024-02-07T12:25:36.508 INFO:tasks.workunit.client.1.smithi138.stdout:9/598: write d0/d6/d8/d1d/dd/d1f/f6a [4019865,86506] 0 2024-02-07T12:25:36.510 INFO:tasks.workunit.client.1.smithi138.stdout:9/599: rename d0/d34/d45/f43 to d0/d6/d8/d1d/dd/d41/fb2 0 2024-02-07T12:25:36.511 INFO:tasks.workunit.client.1.smithi138.stdout:7/806: dread d0/d6/fa [0,4194304] 0 2024-02-07T12:25:36.511 INFO:tasks.workunit.client.1.smithi138.stdout:7/807: chown d0/d6/d73 5 1 2024-02-07T12:25:36.511 INFO:tasks.workunit.client.1.smithi138.stdout:9/600: mknod d0/d6/cb3 0 2024-02-07T12:25:36.514 INFO:tasks.workunit.client.1.smithi138.stdout:3/761: sync 2024-02-07T12:25:36.514 INFO:tasks.workunit.client.1.smithi138.stdout:5/647: sync 2024-02-07T12:25:36.514 INFO:tasks.workunit.client.1.smithi138.stdout:5/648: write da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/f7f [778969,56883] 0 2024-02-07T12:25:36.516 INFO:tasks.workunit.client.1.smithi138.stdout:9/601: getdents d0/d34 0 2024-02-07T12:25:36.516 INFO:tasks.workunit.client.1.smithi138.stdout:9/602: readlink d0/d6/d8/d1d/dd/d1f/l8c 0 2024-02-07T12:25:36.516 INFO:tasks.workunit.client.1.smithi138.stdout:9/603: truncate d0/d6/d8/fad 4218018 0 2024-02-07T12:25:36.519 INFO:tasks.workunit.client.1.smithi138.stdout:3/762: creat d5/d27/f107 x:0 0 0 2024-02-07T12:25:36.519 INFO:tasks.workunit.client.1.smithi138.stdout:3/763: fdatasync d5/d26/d28/f5d 0 2024-02-07T12:25:36.519 INFO:tasks.workunit.client.1.smithi138.stdout:5/649: symlink da/d50/ld7 0 2024-02-07T12:25:36.521 INFO:tasks.workunit.client.1.smithi138.stdout:3/764: chown d5/d26/c46 3 1 2024-02-07T12:25:36.521 INFO:tasks.workunit.client.1.smithi138.stdout:1/627: dwrite d5/d8/dbc/fc8 [4194304,4194304] 0 2024-02-07T12:25:36.521 INFO:tasks.workunit.client.1.smithi138.stdout:1/628: fdatasync d5/d8/f14 0 2024-02-07T12:25:36.521 INFO:tasks.workunit.client.1.smithi138.stdout:1/629: readlink d5/d5b/l83 0 2024-02-07T12:25:36.521 INFO:tasks.workunit.client.1.smithi138.stdout:1/630: fsync d5/d8/da/f47 0 2024-02-07T12:25:36.521 INFO:tasks.workunit.client.1.smithi138.stdout:1/631: creat d5/d8/da/d1f/d3c/fdb x:0 0 0 2024-02-07T12:25:36.528 INFO:tasks.workunit.client.1.smithi138.stdout:3/765: rename d5/d26/l81 to d5/d26/d28/l108 0 2024-02-07T12:25:36.528 INFO:tasks.workunit.client.1.smithi138.stdout:3/766: chown d5/f8d 33187181 1 2024-02-07T12:25:36.528 INFO:tasks.workunit.client.1.smithi138.stdout:3/767: chown d5/d26/d28/l4f 6335 1 2024-02-07T12:25:36.531 INFO:tasks.workunit.client.1.smithi138.stdout:1/632: rename d5/d8/da/cb9 to d5/d8/da/d1f/d5e/db5/cdc 0 2024-02-07T12:25:36.531 INFO:tasks.workunit.client.1.smithi138.stdout:1/633: chown d5/d8/da/d1f/d5e/db5/d68/da7/lcd 706 1 2024-02-07T12:25:36.531 INFO:tasks.workunit.client.1.smithi138.stdout:1/634: truncate d5/d8/da/d1f/f25 6050392 0 2024-02-07T12:25:36.532 INFO:tasks.workunit.client.1.smithi138.stdout:3/768: mkdir d5/d27/dde/d109 0 2024-02-07T12:25:36.534 INFO:tasks.workunit.client.1.smithi138.stdout:1/635: creat d5/d5c/da5/fdd x:0 0 0 2024-02-07T12:25:36.534 INFO:tasks.workunit.client.1.smithi138.stdout:3/769: dread d5/d27/f6b [0,4194304] 0 2024-02-07T12:25:36.534 INFO:tasks.workunit.client.1.smithi138.stdout:3/770: write d5/d26/d9d/fc9 [936297,95646] 0 2024-02-07T12:25:36.537 INFO:tasks.workunit.client.1.smithi138.stdout:3/771: getdents d5/d27/d35/dac 0 2024-02-07T12:25:36.539 INFO:tasks.workunit.client.1.smithi138.stdout:3/772: link d5/d26/d5e/d86/ded/d32/l67 d5/d34/d79/l10a 0 2024-02-07T12:25:36.540 INFO:tasks.workunit.client.1.smithi138.stdout:9/604: dwrite d0/d6/d8/d1d/dd/d41/f76 [0,4194304] 0 2024-02-07T12:25:36.540 INFO:tasks.workunit.client.1.smithi138.stdout:7/808: dwrite d0/d8/d11/d26/d90/f2c [0,4194304] 0 2024-02-07T12:25:36.545 INFO:tasks.workunit.client.1.smithi138.stdout:7/809: creat d0/d39/dfd/f10c x:0 0 0 2024-02-07T12:25:36.545 INFO:tasks.workunit.client.1.smithi138.stdout:7/810: fdatasync d0/d39/dfd/d93/fdc 0 2024-02-07T12:25:36.546 INFO:tasks.workunit.client.1.smithi138.stdout:7/811: unlink d0/d6/d3e/f44 0 2024-02-07T12:25:36.546 INFO:tasks.workunit.client.1.smithi138.stdout:7/812: write d0/d8/d11/d26/d90/d98/fb0 [883258,964] 0 2024-02-07T12:25:36.553 INFO:tasks.workunit.client.1.smithi138.stdout:3/773: dread d5/d26/d5e/d86/ded/f6d [4194304,4194304] 0 2024-02-07T12:25:36.553 INFO:tasks.workunit.client.1.smithi138.stdout:5/650: dwrite da/f51 [0,4194304] 0 2024-02-07T12:25:36.556 INFO:tasks.workunit.client.1.smithi138.stdout:9/605: dread d0/d6/d8/d1d/dd/d41/f76 [0,4194304] 0 2024-02-07T12:25:36.556 INFO:tasks.workunit.client.1.smithi138.stdout:9/606: chown d0/f7e 22602 1 2024-02-07T12:25:36.557 INFO:tasks.workunit.client.1.smithi138.stdout:5/651: creat da/d50/fd8 x:0 0 0 2024-02-07T12:25:36.558 INFO:tasks.workunit.client.1.smithi138.stdout:9/607: symlink d0/d6/d8/d1d/dd/lb4 0 2024-02-07T12:25:36.559 INFO:tasks.workunit.client.1.smithi138.stdout:1/636: dwrite f3 [4194304,4194304] 0 2024-02-07T12:25:36.559 INFO:tasks.workunit.client.1.smithi138.stdout:1/637: fdatasync d5/d8/da/d20/f80 0 2024-02-07T12:25:36.559 INFO:tasks.workunit.client.1.smithi138.stdout:1/638: write d5/d8/da/d1f/d5e/db5/d68/d73/d7b/f4e [1363700,97126] 0 2024-02-07T12:25:36.559 INFO:tasks.workunit.client.1.smithi138.stdout:9/608: fdatasync d0/d6/d8/f52 0 2024-02-07T12:25:36.561 INFO:tasks.workunit.client.1.smithi138.stdout:1/639: write d5/d5c/f7a [106174,46134] 0 2024-02-07T12:25:36.562 INFO:tasks.workunit.client.1.smithi138.stdout:1/640: creat d5/d8/da/d1f/d5e/d63/fde x:0 0 0 2024-02-07T12:25:36.562 INFO:tasks.workunit.client.1.smithi138.stdout:1/641: truncate d5/d8/da/d1f/d5e/d63/f64 165113 0 2024-02-07T12:25:36.562 INFO:tasks.workunit.client.1.smithi138.stdout:1/642: chown d5/d4b/fab 917180182 1 2024-02-07T12:25:36.562 INFO:tasks.workunit.client.1.smithi138.stdout:1/643: creat d5/d8/da/d1f/d5e/fdf x:0 0 0 2024-02-07T12:25:36.563 INFO:tasks.workunit.client.1.smithi138.stdout:3/774: dread d5/d26/f60 [0,4194304] 0 2024-02-07T12:25:36.564 INFO:tasks.workunit.client.1.smithi138.stdout:7/813: dwrite d0/d6/d1d/fe7 [0,4194304] 0 2024-02-07T12:25:36.564 INFO:tasks.workunit.client.1.smithi138.stdout:7/814: chown d0/d8/d11/d26/d90 306764846 1 2024-02-07T12:25:36.564 INFO:tasks.workunit.client.1.smithi138.stdout:1/644: unlink d5/f61 0 2024-02-07T12:25:36.565 INFO:tasks.workunit.client.1.smithi138.stdout:7/815: dread d0/d8/d11/d26/d90/d98/da6/fd8 [0,4194304] 0 2024-02-07T12:25:36.565 INFO:tasks.workunit.client.1.smithi138.stdout:3/775: unlink d5/d26/d28/c73 0 2024-02-07T12:25:36.565 INFO:tasks.workunit.client.1.smithi138.stdout:3/776: fsync d5/d26/d28/f83 0 2024-02-07T12:25:36.569 INFO:tasks.workunit.client.1.smithi138.stdout:1/645: mknod d5/d8/da/d1f/d5e/db5/d58/ce0 0 2024-02-07T12:25:36.569 INFO:tasks.workunit.client.1.smithi138.stdout:1/646: readlink d5/d8/da/d20/l66 0 2024-02-07T12:25:36.569 INFO:tasks.workunit.client.1.smithi138.stdout:1/647: fdatasync d5/d8/da/d1f/d5e/fdf 0 2024-02-07T12:25:36.569 INFO:tasks.workunit.client.1.smithi138.stdout:1/648: creat d5/d8/da/d1f/d3c/fe1 x:0 0 0 2024-02-07T12:25:36.570 INFO:tasks.workunit.client.1.smithi138.stdout:1/649: mkdir d5/d4b/d65/de2 0 2024-02-07T12:25:36.570 INFO:tasks.workunit.client.1.smithi138.stdout:1/650: fdatasync d5/d4b/d6b/d6e/d79/fb1 0 2024-02-07T12:25:36.571 INFO:tasks.workunit.client.1.smithi138.stdout:1/651: creat d5/d8/dbc/fe3 x:0 0 0 2024-02-07T12:25:36.572 INFO:tasks.workunit.client.1.smithi138.stdout:1/652: unlink d5/d5b/f9e 0 2024-02-07T12:25:36.574 INFO:tasks.workunit.client.1.smithi138.stdout:1/653: truncate d5/d8/da/d1f/d5e/db5/d58/f74 3633557 0 2024-02-07T12:25:36.574 INFO:tasks.workunit.client.1.smithi138.stdout:8/805: sync 2024-02-07T12:25:36.575 INFO:tasks.workunit.client.1.smithi138.stdout:7/816: dread d0/d8/d15/db1/fc9 [0,4194304] 0 2024-02-07T12:25:36.576 INFO:tasks.workunit.client.1.smithi138.stdout:1/654: mknod d5/d8/da/d1f/d5e/db5/d68/da7/ce4 0 2024-02-07T12:25:36.576 INFO:tasks.workunit.client.1.smithi138.stdout:1/655: fsync d5/d8/da/d1f/d5e/d63/fde 0 2024-02-07T12:25:36.576 INFO:tasks.workunit.client.1.smithi138.stdout:7/817: write d0/d6/d3e/f51 [842198,105652] 0 2024-02-07T12:25:36.577 INFO:tasks.workunit.client.1.smithi138.stdout:8/806: mknod d1/de/db4/db8/d17/d3e/d72/dda/cf9 0 2024-02-07T12:25:36.577 INFO:tasks.workunit.client.1.smithi138.stdout:3/777: read d5/f3a [1059027,54920] 0 2024-02-07T12:25:36.578 INFO:tasks.workunit.client.1.smithi138.stdout:3/778: creat d5/d27/f10b x:0 0 0 2024-02-07T12:25:36.580 INFO:tasks.workunit.client.1.smithi138.stdout:1/656: link d5/d8/da/d1f/d5e/db5/d68/d73/laf d5/d8/da/d1f/d5e/d63/d99/le5 0 2024-02-07T12:25:36.581 INFO:tasks.workunit.client.1.smithi138.stdout:7/818: mknod d0/d6/d1d/d38/c10d 0 2024-02-07T12:25:36.583 INFO:tasks.workunit.client.1.smithi138.stdout:3/779: symlink d5/d26/d9b/dab/l10c 0 2024-02-07T12:25:36.586 INFO:tasks.workunit.client.1.smithi138.stdout:7/819: truncate d0/d8/d11/d26/d90/f72 253137 0 2024-02-07T12:25:36.591 INFO:tasks.workunit.client.1.smithi138.stdout:3/780: write d5/d27/f49 [1223831,27484] 0 2024-02-07T12:25:36.593 INFO:tasks.workunit.client.1.smithi138.stdout:3/781: mkdir d5/d26/d5e/d86/d9c/d10d 0 2024-02-07T12:25:36.598 INFO:tasks.workunit.client.1.smithi138.stdout:7/820: dread d0/d6/d3e/f68 [0,4194304] 0 2024-02-07T12:25:36.598 INFO:tasks.workunit.client.1.smithi138.stdout:7/821: fdatasync d0/d6/deb/f109 0 2024-02-07T12:25:36.598 INFO:tasks.workunit.client.1.smithi138.stdout:7/822: fdatasync d0/d8/d11/d5f/d86/f9d 0 2024-02-07T12:25:36.598 INFO:tasks.workunit.client.1.smithi138.stdout:7/823: fdatasync d0/d39/d8a/fbc 0 2024-02-07T12:25:36.598 INFO:tasks.workunit.client.1.smithi138.stdout:7/824: dread - d0/d39/dfd/d93/fdc zero size 2024-02-07T12:25:36.599 INFO:tasks.workunit.client.1.smithi138.stdout:7/825: unlink d0/d8/d15/c32 0 2024-02-07T12:25:36.600 INFO:tasks.workunit.client.1.smithi138.stdout:7/826: mkdir d0/d6/d84/d10e 0 2024-02-07T12:25:36.606 INFO:tasks.workunit.client.1.smithi138.stdout:8/807: dwrite d1/f6f [4194304,4194304] 0 2024-02-07T12:25:36.608 INFO:tasks.workunit.client.1.smithi138.stdout:1/657: dwrite d5/d8/da/d1f/d60/fa8 [0,4194304] 0 2024-02-07T12:25:36.608 INFO:tasks.workunit.client.1.smithi138.stdout:3/782: dwrite d5/d26/d5e/d86/ded/d32/da1/f103 [0,4194304] 0 2024-02-07T12:25:36.609 INFO:tasks.workunit.client.1.smithi138.stdout:3/783: write d5/d26/d9b/dab/dc4/dc7/fe1 [577654,128083] 0 2024-02-07T12:25:36.609 INFO:tasks.workunit.client.1.smithi138.stdout:8/808: creat d1/de/ffa x:0 0 0 2024-02-07T12:25:36.614 INFO:tasks.workunit.client.1.smithi138.stdout:3/784: creat d5/d26/d28/df1/f10e x:0 0 0 2024-02-07T12:25:36.615 INFO:tasks.workunit.client.1.smithi138.stdout:3/785: read d5/d26/d5e/d86/dae/fb1 [11395,125130] 0 2024-02-07T12:25:36.616 INFO:tasks.workunit.client.1.smithi138.stdout:3/786: mkdir d5/d26/d9b/dab/dc4/dd0/dd1/d10f 0 2024-02-07T12:25:36.617 INFO:tasks.workunit.client.1.smithi138.stdout:3/787: symlink d5/d34/d79/l110 0 2024-02-07T12:25:36.617 INFO:tasks.workunit.client.1.smithi138.stdout:3/788: chown d5/d26/d28/c65 72 1 2024-02-07T12:25:36.618 INFO:tasks.workunit.client.1.smithi138.stdout:3/789: write d5/d27/f10b [783937,68498] 0 2024-02-07T12:25:36.618 INFO:tasks.workunit.client.1.smithi138.stdout:3/790: truncate d5/d26/d5e/d86/ded/f85 910565 0 2024-02-07T12:25:36.619 INFO:tasks.workunit.client.1.smithi138.stdout:1/658: write d5/d8/da/d1f/d5e/d63/d99/fba [1606054,19463] 0 2024-02-07T12:25:36.619 INFO:tasks.workunit.client.1.smithi138.stdout:7/827: dwrite d0/d6/d73/f97 [0,4194304] 0 2024-02-07T12:25:36.619 INFO:tasks.workunit.client.1.smithi138.stdout:7/828: truncate d0/d39/dfd/fa9 599568 0 2024-02-07T12:25:36.620 INFO:tasks.workunit.client.1.smithi138.stdout:8/809: write d1/de/db4/db8/d17/d3e/d72/dda/f56 [139891,56596] 0 2024-02-07T12:25:36.620 INFO:tasks.workunit.client.1.smithi138.stdout:1/659: symlink d5/d8/dbc/le6 0 2024-02-07T12:25:36.621 INFO:tasks.workunit.client.1.smithi138.stdout:7/829: link d0/d8/d11/d63/dc8/dce/ce9 d0/d6/d3e/c10f 0 2024-02-07T12:25:36.623 INFO:tasks.workunit.client.1.smithi138.stdout:8/810: creat d1/de/db4/db8/d17/d2e/d3a/ffb x:0 0 0 2024-02-07T12:25:36.623 INFO:tasks.workunit.client.1.smithi138.stdout:8/811: dread - d1/de/db4/db8/d17/d3e/dce/f4b zero size 2024-02-07T12:25:36.624 INFO:tasks.workunit.client.1.smithi138.stdout:7/830: symlink d0/d39/dfd/d93/l110 0 2024-02-07T12:25:36.624 INFO:tasks.workunit.client.1.smithi138.stdout:7/831: readlink d0/d8/db3/l106 0 2024-02-07T12:25:36.626 INFO:tasks.workunit.client.1.smithi138.stdout:7/832: truncate d0/d8/d11/d26/f49 163180 0 2024-02-07T12:25:36.626 INFO:tasks.workunit.client.1.smithi138.stdout:3/791: write d5/d26/d5e/d86/ded/f85 [907568,112688] 0 2024-02-07T12:25:36.626 INFO:tasks.workunit.client.1.smithi138.stdout:3/792: write d5/d26/d9b/dab/fb5 [949625,55234] 0 2024-02-07T12:25:36.627 INFO:tasks.workunit.client.1.smithi138.stdout:1/660: write d5/d8/da/d1f/d5e/d62/fca [623723,51836] 0 2024-02-07T12:25:36.628 INFO:tasks.workunit.client.1.smithi138.stdout:7/833: dread d0/d6/d73/fc7 [0,4194304] 0 2024-02-07T12:25:36.629 INFO:tasks.workunit.client.1.smithi138.stdout:3/793: rename d5/d34/d79/l10a to d5/d26/d5e/d86/l111 0 2024-02-07T12:25:36.629 INFO:tasks.workunit.client.1.smithi138.stdout:3/794: dread - d5/d34/fd2 zero size 2024-02-07T12:25:36.629 INFO:tasks.workunit.client.1.smithi138.stdout:3/795: read - d5/d26/d28/f8b zero size 2024-02-07T12:25:36.631 INFO:tasks.workunit.client.1.smithi138.stdout:3/796: link d5/c13 d5/d26/d9b/dab/dc4/dc7/c112 0 2024-02-07T12:25:36.632 INFO:tasks.workunit.client.1.smithi138.stdout:3/797: creat d5/d27/d35/d7c/f113 x:0 0 0 2024-02-07T12:25:36.636 INFO:tasks.workunit.client.1.smithi138.stdout:3/798: link d5/d26/la5 d5/d26/d5e/d86/ded/d32/da1/l114 0 2024-02-07T12:25:36.638 INFO:tasks.workunit.client.1.smithi138.stdout:8/812: write d1/d99/ff4 [1903954,43366] 0 2024-02-07T12:25:36.638 INFO:tasks.workunit.client.1.smithi138.stdout:8/813: creat d1/de/ffc x:0 0 0 2024-02-07T12:25:36.650 INFO:tasks.workunit.client.1.smithi138.stdout:3/799: truncate d5/d27/f40 1107743 0 2024-02-07T12:25:36.651 INFO:tasks.workunit.client.1.smithi138.stdout:3/800: chown d5/d27/d35/lf4 1746 1 2024-02-07T12:25:36.651 INFO:tasks.workunit.client.1.smithi138.stdout:3/801: dread - d5/d26/d9b/dab/dc4/ff5 zero size 2024-02-07T12:25:36.651 INFO:tasks.workunit.client.1.smithi138.stdout:3/802: fdatasync d5/d34/fa0 0 2024-02-07T12:25:36.651 INFO:tasks.workunit.client.1.smithi138.stdout:3/803: write d5/d26/d5e/d86/ded/f85 [369765,23625] 0 2024-02-07T12:25:36.652 INFO:tasks.workunit.client.1.smithi138.stdout:1/661: dwrite d5/d8/dd0/fd4 [0,4194304] 0 2024-02-07T12:25:36.652 INFO:tasks.workunit.client.1.smithi138.stdout:8/814: rmdir d1/de/db4/db8/d17/d3e/d72/d95 39 2024-02-07T12:25:36.652 INFO:tasks.workunit.client.1.smithi138.stdout:8/815: chown d1/de/db4/db8/d17/d2e/d3a/f66 7277497 1 2024-02-07T12:25:36.654 INFO:tasks.workunit.client.1.smithi138.stdout:1/662: link d5/d8/da/d1f/d5e/d63/d99/cb6 d5/d5c/da5/ce7 0 2024-02-07T12:25:36.655 INFO:tasks.workunit.client.1.smithi138.stdout:8/816: unlink d1/ddc/fe5 0 2024-02-07T12:25:36.657 INFO:tasks.workunit.client.1.smithi138.stdout:8/817: rename d1/l81 to d1/ddc/lfd 0 2024-02-07T12:25:36.657 INFO:tasks.workunit.client.1.smithi138.stdout:8/818: write d1/de/db4/db8/d17/d3e/d72/d95/f9d [2707449,23965] 0 2024-02-07T12:25:36.659 INFO:tasks.workunit.client.1.smithi138.stdout:8/819: rename d1/de/db4/db8/fbc to d1/de/db4/db8/d17/d2e/d3a/ffe 0 2024-02-07T12:25:36.659 INFO:tasks.workunit.client.1.smithi138.stdout:8/820: fdatasync d1/de/db4/db8/d17/d3e/d72/f9f 0 2024-02-07T12:25:36.662 INFO:tasks.workunit.client.1.smithi138.stdout:3/804: write d5/d26/d5e/f69 [1053273,96648] 0 2024-02-07T12:25:36.662 INFO:tasks.workunit.client.1.smithi138.stdout:3/805: write d5/f3a [2372491,6276] 0 2024-02-07T12:25:36.662 INFO:tasks.workunit.client.1.smithi138.stdout:3/806: truncate d5/d26/d5e/d86/ded/d32/f68 463218 0 2024-02-07T12:25:36.663 INFO:tasks.workunit.client.1.smithi138.stdout:1/663: read d5/d8/da/f1d [2107222,106277] 0 2024-02-07T12:25:36.663 INFO:tasks.workunit.client.1.smithi138.stdout:3/807: symlink d5/l115 0 2024-02-07T12:25:36.665 INFO:tasks.workunit.client.1.smithi138.stdout:1/664: truncate d5/d8/fbb 1468248 0 2024-02-07T12:25:36.668 INFO:tasks.workunit.client.1.smithi138.stdout:3/808: rename d5/d26/d5e/d86/dae/dc1 to d5/d26/d9b/dab/d116 0 2024-02-07T12:25:36.669 INFO:tasks.workunit.client.1.smithi138.stdout:1/665: creat d5/d8/da/fe8 x:0 0 0 2024-02-07T12:25:36.670 INFO:tasks.workunit.client.1.smithi138.stdout:3/809: symlink d5/d26/d5e/d77/l117 0 2024-02-07T12:25:36.673 INFO:tasks.workunit.client.1.smithi138.stdout:3/810: creat d5/d26/d9b/dab/dc4/dc7/f118 x:0 0 0 2024-02-07T12:25:36.673 INFO:tasks.workunit.client.1.smithi138.stdout:3/811: readlink d5/d26/d5e/d86/d9c/ld7 0 2024-02-07T12:25:36.673 INFO:tasks.workunit.client.1.smithi138.stdout:1/666: dread d5/d8/da/d1f/d5e/d63/f57 [0,4194304] 0 2024-02-07T12:25:36.675 INFO:tasks.workunit.client.1.smithi138.stdout:1/667: mknod d5/d8/da/d1f/d3c/d59/dd8/ce9 0 2024-02-07T12:25:36.675 INFO:tasks.workunit.client.1.smithi138.stdout:1/668: creat d5/d8/dbc/fea x:0 0 0 2024-02-07T12:25:36.676 INFO:tasks.workunit.client.1.smithi138.stdout:8/821: dwrite d1/de/db4/db8/d17/d3e/d72/fd1 [0,4194304] 0 2024-02-07T12:25:36.680 INFO:tasks.workunit.client.1.smithi138.stdout:8/822: mknod d1/de/db4/db8/d17/d8a/dd7/cff 0 2024-02-07T12:25:36.680 INFO:tasks.workunit.client.1.smithi138.stdout:8/823: creat d1/d99/da6/f100 x:0 0 0 2024-02-07T12:25:36.683 INFO:tasks.workunit.client.1.smithi138.stdout:8/824: link d1/de/db4/db8/dae/fe0 d1/de/db4/db8/d17/d8a/d8d/f101 0 2024-02-07T12:25:36.683 INFO:tasks.workunit.client.1.smithi138.stdout:1/669: write d5/d4b/d91/f9f [703330,30688] 0 2024-02-07T12:25:36.683 INFO:tasks.workunit.client.1.smithi138.stdout:1/670: truncate d5/d8/fbb 2199256 0 2024-02-07T12:25:36.684 INFO:tasks.workunit.client.1.smithi138.stdout:3/812: rmdir d5/d26/d5e/d77 39 2024-02-07T12:25:36.684 INFO:tasks.workunit.client.1.smithi138.stdout:3/813: write d5/d26/d5e/d86/ded/d32/f68 [269575,116697] 0 2024-02-07T12:25:36.684 INFO:tasks.workunit.client.1.smithi138.stdout:3/814: creat d5/d34/f119 x:0 0 0 2024-02-07T12:25:36.686 INFO:tasks.workunit.client.1.smithi138.stdout:3/815: mknod d5/d26/d9a/c11a 0 2024-02-07T12:25:36.695 INFO:tasks.workunit.client.1.smithi138.stdout:1/671: dread d5/d8/da/d1f/d5e/d63/d99/fba [0,4194304] 0 2024-02-07T12:25:36.698 INFO:tasks.workunit.client.1.smithi138.stdout:1/672: unlink d5/d4b/d65/fa6 0 2024-02-07T12:25:36.698 INFO:tasks.workunit.client.1.smithi138.stdout:1/673: chown d5/d8/da/d1f/d5e/d62/cbf 936051 1 2024-02-07T12:25:36.698 INFO:tasks.workunit.client.1.smithi138.stdout:1/674: dread - d5/d8/da/f47 zero size 2024-02-07T12:25:36.698 INFO:tasks.workunit.client.1.smithi138.stdout:1/675: read - d5/d8/da/d1f/d5e/d63/fc5 zero size 2024-02-07T12:25:36.700 INFO:tasks.workunit.client.1.smithi138.stdout:0/696: sync 2024-02-07T12:25:36.700 INFO:tasks.workunit.client.1.smithi138.stdout:0/697: stat d4/d9/d37/d64/d9a 0 2024-02-07T12:25:36.700 INFO:tasks.workunit.client.1.smithi138.stdout:0/698: write d4/d9/db/d39/fa2 [4503758,55149] 0 2024-02-07T12:25:36.700 INFO:tasks.workunit.client.1.smithi138.stdout:8/825: dread d1/de/f53 [0,4194304] 0 2024-02-07T12:25:36.701 INFO:tasks.workunit.client.1.smithi138.stdout:0/699: getdents d4/d9/d37/dbe 0 2024-02-07T12:25:36.701 INFO:tasks.workunit.client.1.smithi138.stdout:0/700: dread - d4/d9/db/d71/fdf zero size 2024-02-07T12:25:36.703 INFO:tasks.workunit.client.1.smithi138.stdout:8/826: read d1/de/db4/db8/d17/d3e/fb1 [1205436,27867] 0 2024-02-07T12:25:36.704 INFO:tasks.workunit.client.1.smithi138.stdout:8/827: truncate d1/de/db4/db8/d17/d3e/d72/dda/f29 3876206 0 2024-02-07T12:25:36.713 INFO:tasks.workunit.client.1.smithi138.stdout:0/701: write d4/d52/fa0 [4016774,93576] 0 2024-02-07T12:25:36.713 INFO:tasks.workunit.client.1.smithi138.stdout:0/702: write d4/d9/db/d39/d4b/d6c/faf [1067374,58036] 0 2024-02-07T12:25:36.725 INFO:tasks.workunit.client.1.smithi138.stdout:1/676: dwrite d5/f1a [0,4194304] 0 2024-02-07T12:25:36.726 INFO:tasks.workunit.client.1.smithi138.stdout:3/816: dwrite d5/d34/d79/f7b [0,4194304] 0 2024-02-07T12:25:36.726 INFO:tasks.workunit.client.1.smithi138.stdout:8/828: dwrite d1/f85 [0,4194304] 0 2024-02-07T12:25:36.728 INFO:tasks.workunit.client.1.smithi138.stdout:3/817: creat d5/d26/ddd/f11b x:0 0 0 2024-02-07T12:25:36.736 INFO:tasks.workunit.client.1.smithi138.stdout:8/829: mknod d1/de/db4/db8/d17/d2e/d3a/c102 0 2024-02-07T12:25:36.736 INFO:tasks.workunit.client.1.smithi138.stdout:8/830: write d1/de/db4/db8/d17/d2e/d3a/f83 [410793,14774] 0 2024-02-07T12:25:36.737 INFO:tasks.workunit.client.1.smithi138.stdout:3/818: mkdir d5/d26/d28/db7/d11c 0 2024-02-07T12:25:36.740 INFO:tasks.workunit.client.1.smithi138.stdout:8/831: rename d1/de/db4/db8/d17/d8a/d8d/f101 to d1/de/db4/db8/d17/d58/f103 0 2024-02-07T12:25:36.740 INFO:tasks.workunit.client.1.smithi138.stdout:1/677: dwrite d5/d8/da/f11 [8388608,4194304] 0 2024-02-07T12:25:36.740 INFO:tasks.workunit.client.1.smithi138.stdout:1/678: chown d5/d8/da/d1f/d3c 11143445 1 2024-02-07T12:25:36.743 INFO:tasks.workunit.client.1.smithi138.stdout:8/832: dread d1/de/db4/db8/d17/d3e/dce/fa7 [0,4194304] 0 2024-02-07T12:25:36.743 INFO:tasks.workunit.client.1.smithi138.stdout:8/833: fsync d1/de/db4/db8/d17/d3e/fb1 0 2024-02-07T12:25:36.743 INFO:tasks.workunit.client.1.smithi138.stdout:8/834: truncate d1/de/ff 4821805 0 2024-02-07T12:25:36.745 INFO:tasks.workunit.client.1.smithi138.stdout:8/835: symlink d1/de/db4/db8/dae/l104 0 2024-02-07T12:25:36.745 INFO:tasks.workunit.client.1.smithi138.stdout:8/836: creat d1/de/f105 x:0 0 0 2024-02-07T12:25:36.747 INFO:tasks.workunit.client.1.smithi138.stdout:1/679: dread d5/f86 [0,4194304] 0 2024-02-07T12:25:36.752 INFO:tasks.workunit.client.1.smithi138.stdout:3/819: dwrite d5/d26/d9b/fb9 [4194304,4194304] 0 2024-02-07T12:25:36.753 INFO:tasks.workunit.client.1.smithi138.stdout:3/820: write d5/d26/d5e/f6e [400605,97315] 0 2024-02-07T12:25:36.754 INFO:tasks.workunit.client.1.smithi138.stdout:3/821: dread d5/d27/f29 [0,4194304] 0 2024-02-07T12:25:36.758 INFO:tasks.workunit.client.1.smithi138.stdout:3/822: rename d5/d26/d28/f78 to d5/d27/dde/f11d 0 2024-02-07T12:25:36.760 INFO:tasks.workunit.client.1.smithi138.stdout:3/823: link d5/d27/f88 d5/d27/dde/f11e 0 2024-02-07T12:25:36.761 INFO:tasks.workunit.client.1.smithi138.stdout:3/824: dread - d5/d26/d5e/d86/ded/f41 zero size 2024-02-07T12:25:36.761 INFO:tasks.workunit.client.1.smithi138.stdout:3/825: read d5/d26/d5e/d86/dae/fb1 [3679,41047] 0 2024-02-07T12:25:36.762 INFO:tasks.workunit.client.1.smithi138.stdout:8/837: dread d1/de/db4/db8/d17/f20 [0,4194304] 0 2024-02-07T12:25:36.763 INFO:tasks.workunit.client.1.smithi138.stdout:3/826: dread d5/d27/f6b [0,4194304] 0 2024-02-07T12:25:36.763 INFO:tasks.workunit.client.1.smithi138.stdout:3/827: creat d5/d26/d5e/d86/d9c/f11f x:0 0 0 2024-02-07T12:25:36.763 INFO:tasks.workunit.client.1.smithi138.stdout:3/828: dread - d5/d26/d5e/d86/d9c/fea zero size 2024-02-07T12:25:36.767 INFO:tasks.workunit.client.1.smithi138.stdout:8/838: dread d1/de/db4/db8/d17/f20 [0,4194304] 0 2024-02-07T12:25:36.769 INFO:tasks.workunit.client.1.smithi138.stdout:8/839: rename d1/de/db4/db8/d17/d2e to d1/db3/df0/d106 0 2024-02-07T12:25:36.772 INFO:tasks.workunit.client.1.smithi138.stdout:3/829: dread d5/d26/d5e/d86/ded/fc6 [0,4194304] 0 2024-02-07T12:25:36.772 INFO:tasks.workunit.client.1.smithi138.stdout:3/830: chown d5/d26/d5e/d86/la2 23965 1 2024-02-07T12:25:36.772 INFO:tasks.workunit.client.1.smithi138.stdout:3/831: chown d5/d26/d5e/d86/ded/d32/da1/fdc 193 1 2024-02-07T12:25:36.772 INFO:tasks.workunit.client.1.smithi138.stdout:3/832: write d5/d26/d5e/d86/ded/fc6 [1349878,60395] 0 2024-02-07T12:25:36.774 INFO:tasks.workunit.client.1.smithi138.stdout:1/680: dwrite d5/d8/da/d1f/d5e/d62/f9c [0,4194304] 0 2024-02-07T12:25:36.774 INFO:tasks.workunit.client.1.smithi138.stdout:1/681: read d5/d5c/f7a [987608,111804] 0 2024-02-07T12:25:36.776 INFO:tasks.workunit.client.1.smithi138.stdout:3/833: getdents d5/d27 0 2024-02-07T12:25:36.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:36 smithi138 ceph-mon[35528]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:36.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:36 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3978537353' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:25:36.784 INFO:tasks.workunit.client.1.smithi138.stdout:3/834: write d5/d26/d5e/d86/ded/d32/da1/f103 [1645565,127371] 0 2024-02-07T12:25:36.786 INFO:tasks.workunit.client.1.smithi138.stdout:3/835: mkdir d5/d26/d5e/d86/ded/d96/d120 0 2024-02-07T12:25:36.786 INFO:tasks.workunit.client.1.smithi138.stdout:3/836: fdatasync d5/d27/f80 0 2024-02-07T12:25:36.786 INFO:tasks.workunit.client.1.smithi138.stdout:3/837: write d5/d34/fd2 [596,79155] 0 2024-02-07T12:25:36.786 INFO:tasks.workunit.client.1.smithi138.stdout:3/838: chown d5/d26/d9b/fb9 619688 1 2024-02-07T12:25:36.787 INFO:tasks.workunit.client.1.smithi138.stdout:8/840: dwrite d1/de/db4/db8/d17/d3e/d72/dda/f76 [4194304,4194304] 0 2024-02-07T12:25:36.789 INFO:tasks.workunit.client.1.smithi138.stdout:1/682: dwrite d5/d4b/d6b/d6e/d79/fb1 [0,4194304] 0 2024-02-07T12:25:36.793 INFO:tasks.workunit.client.1.smithi138.stdout:1/683: rename d5/d8/da/d1f/d5e/d63/d99 to d5/d8/dbc/deb 0 2024-02-07T12:25:36.796 INFO:tasks.workunit.client.1.smithi138.stdout:1/684: unlink d5/d8/da/d1f/f25 0 2024-02-07T12:25:36.796 INFO:tasks.workunit.client.1.smithi138.stdout:8/841: write d1/de/db4/db8/d17/d3e/dce/f5c [2120687,29199] 0 2024-02-07T12:25:36.797 INFO:tasks.workunit.client.1.smithi138.stdout:8/842: truncate d1/db3/df0/d106/d3a/ffb 524938 0 2024-02-07T12:25:36.797 INFO:tasks.workunit.client.1.smithi138.stdout:8/843: chown d1/de/db4/db8/d17/d3e/fee 545 1 2024-02-07T12:25:36.797 INFO:tasks.workunit.client.1.smithi138.stdout:8/844: chown d1/de/db4/db8/d17/d58/la9 3191 1 2024-02-07T12:25:36.797 INFO:tasks.workunit.client.1.smithi138.stdout:1/685: symlink d5/d8/da/d1f/d5e/db5/d68/d73/d7b/lec 0 2024-02-07T12:25:36.798 INFO:tasks.workunit.client.1.smithi138.stdout:8/845: truncate d1/de/db4/db8/d17/d3e/dce/fc8 1784762 0 2024-02-07T12:25:36.798 INFO:tasks.workunit.client.1.smithi138.stdout:8/846: chown d1/de/db4/db8/d17/d3e/dce/f5f 10622495 1 2024-02-07T12:25:36.799 INFO:tasks.workunit.client.1.smithi138.stdout:3/839: dwrite d5/d27/d35/f6f [0,4194304] 0 2024-02-07T12:25:36.799 INFO:tasks.workunit.client.1.smithi138.stdout:1/686: symlink d5/d8/da/d1f/d5e/db5/d68/led 0 2024-02-07T12:25:36.799 INFO:tasks.workunit.client.1.smithi138.stdout:8/847: dread d1/db3/df0/d106/d3a/ffb [0,4194304] 0 2024-02-07T12:25:36.802 INFO:tasks.workunit.client.1.smithi138.stdout:3/840: rename d5/d27/d35/dac/fe2 to d5/d26/d5e/d86/d9c/d10d/f121 0 2024-02-07T12:25:36.803 INFO:tasks.workunit.client.1.smithi138.stdout:8/848: mkdir d1/de/db4/db8/d17/d3e/d72/dda/d4c/d107 0 2024-02-07T12:25:36.807 INFO:tasks.workunit.client.1.smithi138.stdout:4/634: sync 2024-02-07T12:25:36.808 INFO:tasks.workunit.client.1.smithi138.stdout:2/783: sync 2024-02-07T12:25:36.808 INFO:tasks.workunit.client.1.smithi138.stdout:6/700: sync 2024-02-07T12:25:36.808 INFO:tasks.workunit.client.1.smithi138.stdout:6/701: write dc/d31/f72 [782152,72433] 0 2024-02-07T12:25:36.808 INFO:tasks.workunit.client.1.smithi138.stdout:1/687: write d5/d4b/d6b/d6e/d79/fb1 [1860371,103101] 0 2024-02-07T12:25:36.808 INFO:tasks.workunit.client.1.smithi138.stdout:1/688: dread - d5/d8/dbc/fe3 zero size 2024-02-07T12:25:36.811 INFO:tasks.workunit.client.1.smithi138.stdout:6/702: rename dc/d31/d38/f3d to dc/d31/d38/d9a/daa/fe6 0 2024-02-07T12:25:36.811 INFO:tasks.workunit.client.1.smithi138.stdout:6/703: chown dc/d31/d38/d9a 14484396 1 2024-02-07T12:25:36.811 INFO:tasks.workunit.client.1.smithi138.stdout:6/704: write dc/d13/d1e/d35/dc0/fe1 [527231,85313] 0 2024-02-07T12:25:36.813 INFO:tasks.workunit.client.1.smithi138.stdout:1/689: read d5/d8/da/d1f/d5e/d63/f64 [117018,116554] 0 2024-02-07T12:25:36.813 INFO:tasks.workunit.client.1.smithi138.stdout:1/690: chown d5/d8/da/d1f/d5e/db5/d68/d73/d7b/l37 7173 1 2024-02-07T12:25:36.814 INFO:tasks.workunit.client.1.smithi138.stdout:6/705: mknod dc/d31/d38/d9a/ce7 0 2024-02-07T12:25:36.817 INFO:tasks.workunit.client.1.smithi138.stdout:6/706: mknod dc/d13/d1e/d35/d85/ce8 0 2024-02-07T12:25:36.817 INFO:tasks.workunit.client.1.smithi138.stdout:8/849: dread d1/de/db4/db8/d17/d3e/dce/fc8 [0,4194304] 0 2024-02-07T12:25:36.819 INFO:tasks.workunit.client.1.smithi138.stdout:2/784: read d3/dd/d14/d8f/f68 [5330189,23309] 0 2024-02-07T12:25:36.820 INFO:tasks.workunit.client.1.smithi138.stdout:2/785: creat d3/dd/d19/f11f x:0 0 0 2024-02-07T12:25:36.821 INFO:tasks.workunit.client.1.smithi138.stdout:2/786: fsync d3/dd/d14/d49/d25/d3d/fd3 0 2024-02-07T12:25:36.821 INFO:tasks.workunit.client.1.smithi138.stdout:2/787: dread - d3/dd/d14/d8f/d73/d80/df0/f106 zero size 2024-02-07T12:25:36.823 INFO:tasks.workunit.client.1.smithi138.stdout:4/635: dwrite f1c [0,4194304] 0 2024-02-07T12:25:36.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:36 smithi047 ceph-mon[28972]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:25:36.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:36 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3978537353' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:25:36.825 INFO:tasks.workunit.client.1.smithi138.stdout:4/636: creat d20/fc7 x:0 0 0 2024-02-07T12:25:36.826 INFO:tasks.workunit.client.1.smithi138.stdout:6/707: dread dc/d31/d3f/f41 [0,4194304] 0 2024-02-07T12:25:36.826 INFO:tasks.workunit.client.1.smithi138.stdout:4/637: symlink d20/d34/d36/d55/d74/d9a/dc0/lc8 0 2024-02-07T12:25:36.827 INFO:tasks.workunit.client.1.smithi138.stdout:8/850: write d1/f22 [2830348,99118] 0 2024-02-07T12:25:36.827 INFO:tasks.workunit.client.1.smithi138.stdout:4/638: unlink d20/d34/d73/c83 0 2024-02-07T12:25:36.828 INFO:tasks.workunit.client.1.smithi138.stdout:8/851: symlink d1/de/db4/db8/d17/d3e/d72/dda/d4c/l108 0 2024-02-07T12:25:36.828 INFO:tasks.workunit.client.1.smithi138.stdout:8/852: creat d1/de/f109 x:0 0 0 2024-02-07T12:25:36.829 INFO:tasks.workunit.client.1.smithi138.stdout:4/639: rename d20/d34/d59/fa8 to d20/d47/d69/d7c/db9/fc9 0 2024-02-07T12:25:36.830 INFO:tasks.workunit.client.1.smithi138.stdout:8/853: rename d1/db3/df0/d106/d3a/f98 to d1/de/f10a 0 2024-02-07T12:25:36.831 INFO:tasks.workunit.client.1.smithi138.stdout:4/640: symlink d20/d34/d59/d88/d8d/lca 0 2024-02-07T12:25:36.831 INFO:tasks.workunit.client.1.smithi138.stdout:4/641: fsync d20/f26 0 2024-02-07T12:25:36.832 INFO:tasks.workunit.client.1.smithi138.stdout:4/642: stat l0 0 2024-02-07T12:25:36.832 INFO:tasks.workunit.client.1.smithi138.stdout:4/643: creat d20/fcb x:0 0 0 2024-02-07T12:25:36.832 INFO:tasks.workunit.client.1.smithi138.stdout:4/644: chown d20/d34/d36/f5f 479487900 1 2024-02-07T12:25:36.836 INFO:tasks.workunit.client.1.smithi138.stdout:6/708: read f8 [3929188,111272] 0 2024-02-07T12:25:36.836 INFO:tasks.workunit.client.1.smithi138.stdout:1/691: dwrite d5/d5c/da5/fdd [0,4194304] 0 2024-02-07T12:25:36.838 INFO:tasks.workunit.client.1.smithi138.stdout:6/709: mknod dc/d73/dc4/ce9 0 2024-02-07T12:25:36.838 INFO:tasks.workunit.client.1.smithi138.stdout:4/645: dread d20/f25 [0,4194304] 0 2024-02-07T12:25:36.842 INFO:tasks.workunit.client.1.smithi138.stdout:1/692: symlink d5/d4b/d6b/d6e/lee 0 2024-02-07T12:25:36.842 INFO:tasks.workunit.client.1.smithi138.stdout:1/693: creat d5/d8/da/d1f/d3c/fef x:0 0 0 2024-02-07T12:25:36.844 INFO:tasks.workunit.client.1.smithi138.stdout:6/710: rename dc/d31/cd5 to dc/d13/d8e/cea 0 2024-02-07T12:25:36.847 INFO:tasks.workunit.client.1.smithi138.stdout:4/646: write f1d [3050942,10416] 0 2024-02-07T12:25:36.848 INFO:tasks.workunit.client.1.smithi138.stdout:8/854: dwrite d1/db3/df0/d106/fa1 [4194304,4194304] 0 2024-02-07T12:25:36.850 INFO:tasks.workunit.client.1.smithi138.stdout:8/855: creat d1/db3/f10b x:0 0 0 2024-02-07T12:25:36.851 INFO:tasks.workunit.client.1.smithi138.stdout:8/856: link d1/db3/df0/d106/d3a/la2 d1/de/db4/db8/d17/d3e/d72/dda/l10c 0 2024-02-07T12:25:36.853 INFO:tasks.workunit.client.1.smithi138.stdout:8/857: rmdir d1/de/db4 39 2024-02-07T12:25:36.853 INFO:tasks.workunit.client.1.smithi138.stdout:8/858: getdents d1/de/db4/db8/dd2 0 2024-02-07T12:25:36.853 INFO:tasks.workunit.client.1.smithi138.stdout:8/859: chown d1/de/db4/db8/d17 64550203 1 2024-02-07T12:25:36.853 INFO:tasks.workunit.client.1.smithi138.stdout:8/860: fdatasync d1/f9e 0 2024-02-07T12:25:36.853 INFO:tasks.workunit.client.1.smithi138.stdout:8/861: creat d1/de/db4/db8/d17/d3e/f10d x:0 0 0 2024-02-07T12:25:36.853 INFO:tasks.workunit.client.1.smithi138.stdout:8/862: dread - d1/d99/fcd zero size 2024-02-07T12:25:36.854 INFO:tasks.workunit.client.1.smithi138.stdout:8/863: truncate d1/d8e/f8f 1135172 0 2024-02-07T12:25:36.856 INFO:tasks.workunit.client.1.smithi138.stdout:8/864: mkdir d1/de/db4/db8/d17/d3e/d10e 0 2024-02-07T12:25:36.856 INFO:tasks.workunit.client.1.smithi138.stdout:8/865: creat d1/db3/f10f x:0 0 0 2024-02-07T12:25:36.857 INFO:tasks.workunit.client.1.smithi138.stdout:4/647: dread f1c [0,4194304] 0 2024-02-07T12:25:36.857 INFO:tasks.workunit.client.1.smithi138.stdout:4/648: readlink d20/d34/l3b 0 2024-02-07T12:25:36.859 INFO:tasks.workunit.client.1.smithi138.stdout:8/866: mkdir d1/db3/df0/d106/d3a/d110 0 2024-02-07T12:25:36.859 INFO:tasks.workunit.client.1.smithi138.stdout:8/867: write d1/de/db4/db8/f5b [4791706,60350] 0 2024-02-07T12:25:36.865 INFO:tasks.workunit.client.1.smithi138.stdout:6/711: dwrite dc/f77 [0,4194304] 0 2024-02-07T12:25:36.885 INFO:tasks.workunit.client.1.smithi138.stdout:4/649: dwrite d20/f54 [0,4194304] 0 2024-02-07T12:25:36.885 INFO:tasks.workunit.client.1.smithi138.stdout:4/650: stat d20/d34/d36/d55/f7f 0 2024-02-07T12:25:36.885 INFO:tasks.workunit.client.1.smithi138.stdout:4/651: chown d20/d47/d69/d7c/f85 0 1 2024-02-07T12:25:36.885 INFO:tasks.workunit.client.1.smithi138.stdout:8/868: dwrite d1/d99/da6/de7/ff7 [4194304,4194304] 0 2024-02-07T12:25:36.885 INFO:tasks.workunit.client.1.smithi138.stdout:8/869: chown d1/de/db4/db8/d17/d3e/d72/dda/c12 711700 1 2024-02-07T12:25:36.885 INFO:tasks.workunit.client.1.smithi138.stdout:8/870: write d1/de/db4/db8/d17/d3e/d72/dda/fbe [8311,113177] 0 2024-02-07T12:25:36.885 INFO:tasks.workunit.client.1.smithi138.stdout:8/871: getdents d1/de/db4/db8/dd2 0 2024-02-07T12:25:36.887 INFO:tasks.workunit.client.1.smithi138.stdout:4/652: mknod d20/d34/d59/d72/ccc 0 2024-02-07T12:25:36.888 INFO:tasks.workunit.client.1.smithi138.stdout:4/653: link d20/d53/l56 d20/d53/d71/d98/lcd 0 2024-02-07T12:25:36.888 INFO:tasks.workunit.client.1.smithi138.stdout:4/654: stat d20/d34/d59/d88/d8d/lca 0 2024-02-07T12:25:36.890 INFO:tasks.workunit.client.1.smithi138.stdout:4/655: creat d20/d34/d36/d55/d74/d9a/dc0/fce x:0 0 0 2024-02-07T12:25:36.890 INFO:tasks.workunit.client.1.smithi138.stdout:1/694: dwrite d5/d8/da/f29 [0,4194304] 0 2024-02-07T12:25:36.892 INFO:tasks.workunit.client.1.smithi138.stdout:1/695: mknod d5/d8/da/d1f/d5e/db5/d68/d73/cf0 0 2024-02-07T12:25:36.892 INFO:tasks.workunit.client.1.smithi138.stdout:1/696: chown d5/d8/da/d1f/d5e/d62 60011198 1 2024-02-07T12:25:36.892 INFO:tasks.workunit.client.1.smithi138.stdout:9/609: sync 2024-02-07T12:25:36.892 INFO:tasks.workunit.client.1.smithi138.stdout:7/834: sync 2024-02-07T12:25:36.893 INFO:tasks.workunit.client.1.smithi138.stdout:5/652: sync 2024-02-07T12:25:36.893 INFO:tasks.workunit.client.1.smithi138.stdout:5/653: read - da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/f8b zero size 2024-02-07T12:25:36.893 INFO:tasks.workunit.client.1.smithi138.stdout:1/697: mknod d5/d8/da/d1f/d5e/db5/cf1 0 2024-02-07T12:25:36.893 INFO:tasks.workunit.client.1.smithi138.stdout:1/698: truncate d5/d8/fcf 915659 0 2024-02-07T12:25:36.894 INFO:tasks.workunit.client.1.smithi138.stdout:6/712: dwrite dc/d69/f5e [4194304,4194304] 0 2024-02-07T12:25:36.894 INFO:tasks.workunit.client.1.smithi138.stdout:8/872: dread d1/de/db4/db8/d17/d8a/db6/fd5 [0,4194304] 0 2024-02-07T12:25:36.894 INFO:tasks.workunit.client.1.smithi138.stdout:6/713: stat dc/d13/d1e/d35/d6d/f6e 0 2024-02-07T12:25:36.894 INFO:tasks.workunit.client.1.smithi138.stdout:6/714: dread - dc/d31/fc8 zero size 2024-02-07T12:25:36.894 INFO:tasks.workunit.client.1.smithi138.stdout:4/656: dread d20/d53/f60 [0,4194304] 0 2024-02-07T12:25:36.896 INFO:tasks.workunit.client.1.smithi138.stdout:5/654: mkdir da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/dd9 0 2024-02-07T12:25:36.906 INFO:tasks.workunit.client.1.smithi138.stdout:6/715: rename dc/d73/dc4/fd2 to dc/d13/d1e/dae/feb 0 2024-02-07T12:25:36.909 INFO:tasks.workunit.client.1.smithi138.stdout:7/835: rmdir d0 39 2024-02-07T12:25:36.909 INFO:tasks.workunit.client.1.smithi138.stdout:4/657: getdents d20/d47/d69/d76 0 2024-02-07T12:25:36.909 INFO:tasks.workunit.client.1.smithi138.stdout:4/658: fdatasync d20/f21 0 2024-02-07T12:25:36.909 INFO:tasks.workunit.client.1.smithi138.stdout:4/659: creat d20/d4d/d87/fcf x:0 0 0 2024-02-07T12:25:36.910 INFO:tasks.workunit.client.1.smithi138.stdout:5/655: mknod da/d6d/d27/d2e/d4f/cda 0 2024-02-07T12:25:36.911 INFO:tasks.workunit.client.1.smithi138.stdout:6/716: creat dc/d13/d1e/d35/d7c/fec x:0 0 0 2024-02-07T12:25:36.911 INFO:tasks.workunit.client.1.smithi138.stdout:6/717: getdents dc/d13/d1e/dc7 0 2024-02-07T12:25:36.911 INFO:tasks.workunit.client.1.smithi138.stdout:6/718: creat dc/d31/d3f/fed x:0 0 0 2024-02-07T12:25:36.912 INFO:tasks.workunit.client.1.smithi138.stdout:4/660: mkdir d20/d34/d73/dd0 0 2024-02-07T12:25:36.913 INFO:tasks.workunit.client.1.smithi138.stdout:6/719: mkdir dc/d31/d54/dee 0 2024-02-07T12:25:36.913 INFO:tasks.workunit.client.1.smithi138.stdout:6/720: fdatasync dc/d31/d38/d9a/daa/fe6 0 2024-02-07T12:25:36.914 INFO:tasks.workunit.client.1.smithi138.stdout:4/661: mkdir d20/d53/dd1 0 2024-02-07T12:25:36.916 INFO:tasks.workunit.client.1.smithi138.stdout:5/656: rename da/d22/f8d to da/d6d/d27/d2e/d4f/d2b/d35/d5d/fdb 0 2024-02-07T12:25:36.919 INFO:tasks.workunit.client.1.smithi138.stdout:4/662: link d20/d34/d36/d55/d74/fc6 d20/d4d/fd2 0 2024-02-07T12:25:36.919 INFO:tasks.workunit.client.1.smithi138.stdout:5/657: getdents da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d96 0 2024-02-07T12:25:36.921 INFO:tasks.workunit.client.1.smithi138.stdout:6/721: getdents dc/d13 0 2024-02-07T12:25:36.921 INFO:tasks.workunit.client.1.smithi138.stdout:6/722: write dc/d31/d3f/fed [343167,58416] 0 2024-02-07T12:25:36.921 INFO:tasks.workunit.client.1.smithi138.stdout:6/723: chown dc/d31/f72 54829692 1 2024-02-07T12:25:36.922 INFO:tasks.workunit.client.1.smithi138.stdout:4/663: dread f1c [0,4194304] 0 2024-02-07T12:25:36.922 INFO:tasks.workunit.client.1.smithi138.stdout:5/658: symlink da/d6d/d27/d2e/d4f/d2b/d35/d67/dd1/ldc 0 2024-02-07T12:25:36.922 INFO:tasks.workunit.client.1.smithi138.stdout:4/664: chown d20/d47/d69/fc4 396 1 2024-02-07T12:25:36.923 INFO:tasks.workunit.client.1.smithi138.stdout:6/724: creat dc/d31/d38/d9a/daa/fef x:0 0 0 2024-02-07T12:25:36.923 INFO:tasks.workunit.client.1.smithi138.stdout:6/725: truncate dc/d13/d1e/f30 4431236 0 2024-02-07T12:25:36.923 INFO:tasks.workunit.client.1.smithi138.stdout:6/726: read - dc/d31/fc9 zero size 2024-02-07T12:25:36.925 INFO:tasks.workunit.client.1.smithi138.stdout:5/659: rmdir da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/dd9 0 2024-02-07T12:25:36.926 INFO:tasks.workunit.client.1.smithi138.stdout:6/727: getdents dc/d13/d1e/d24 0 2024-02-07T12:25:36.926 INFO:tasks.workunit.client.1.smithi138.stdout:4/665: dread d20/d34/d36/f43 [0,4194304] 0 2024-02-07T12:25:36.926 INFO:tasks.workunit.client.1.smithi138.stdout:4/666: write d20/f32 [5059111,106923] 0 2024-02-07T12:25:36.927 INFO:tasks.workunit.client.1.smithi138.stdout:4/667: read d20/d34/f4c [150208,72474] 0 2024-02-07T12:25:36.927 INFO:tasks.workunit.client.1.smithi138.stdout:4/668: creat d20/d34/d36/d55/fd3 x:0 0 0 2024-02-07T12:25:36.927 INFO:tasks.workunit.client.1.smithi138.stdout:4/669: write d20/d4d/fd2 [2545975,40113] 0 2024-02-07T12:25:36.927 INFO:tasks.workunit.client.1.smithi138.stdout:4/670: chown d20/d47/d69/d7c/fb1 80 1 2024-02-07T12:25:36.927 INFO:tasks.workunit.client.1.smithi138.stdout:4/671: write d20/d4d/f90 [1839965,35391] 0 2024-02-07T12:25:36.927 INFO:tasks.workunit.client.1.smithi138.stdout:5/660: rmdir da/d6d/d27/d2e/d4f/d2b/d35/d5d/d73 39 2024-02-07T12:25:36.928 INFO:tasks.workunit.client.1.smithi138.stdout:6/728: getdents dc/d13/d1e/d35/d85 0 2024-02-07T12:25:36.932 INFO:tasks.workunit.client.1.smithi138.stdout:4/672: rename d20/d47/d69/fc3 to d20/d34/d59/d88/fd4 0 2024-02-07T12:25:36.932 INFO:tasks.workunit.client.1.smithi138.stdout:4/673: chown d20/d34/d36/f5f 338 1 2024-02-07T12:25:36.932 INFO:tasks.workunit.client.1.smithi138.stdout:4/674: readlink d20/d53/d71/d75/d94/lb4 0 2024-02-07T12:25:36.932 INFO:tasks.workunit.client.1.smithi138.stdout:7/836: dwrite d0/d6/ff9 [0,4194304] 0 2024-02-07T12:25:36.933 INFO:tasks.workunit.client.1.smithi138.stdout:7/837: readlink d0/d8/d11/l1c 0 2024-02-07T12:25:36.935 INFO:tasks.workunit.client.1.smithi138.stdout:4/675: rename d20/d34/d36/f3c to d20/d34/d59/d72/d77/fd5 0 2024-02-07T12:25:36.935 INFO:tasks.workunit.client.1.smithi138.stdout:4/676: write d20/d4d/fbf [1031039,64327] 0 2024-02-07T12:25:36.938 INFO:tasks.workunit.client.1.smithi138.stdout:5/661: getdents da/d50 0 2024-02-07T12:25:36.938 INFO:tasks.workunit.client.1.smithi138.stdout:5/662: write da/d6d/d27/d2e/f79 [1437538,87814] 0 2024-02-07T12:25:36.940 INFO:tasks.workunit.client.1.smithi138.stdout:6/729: getdents dc/d13/d1e/d35 0 2024-02-07T12:25:36.942 INFO:tasks.workunit.client.1.smithi138.stdout:4/677: truncate d20/f24 799193 0 2024-02-07T12:25:36.942 INFO:tasks.workunit.client.1.smithi138.stdout:4/678: write d20/d53/f64 [508149,77286] 0 2024-02-07T12:25:36.942 INFO:tasks.workunit.client.1.smithi138.stdout:4/679: write d20/d4d/f62 [202063,120295] 0 2024-02-07T12:25:36.944 INFO:tasks.workunit.client.1.smithi138.stdout:5/663: link da/d43/d4a/f9e da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d91/fdd 0 2024-02-07T12:25:36.946 INFO:tasks.workunit.client.1.smithi138.stdout:4/680: symlink d20/d34/ld6 0 2024-02-07T12:25:36.946 INFO:tasks.workunit.client.1.smithi138.stdout:6/730: write dc/d31/d3f/f41 [2427218,10767] 0 2024-02-07T12:25:36.946 INFO:tasks.workunit.client.1.smithi138.stdout:6/731: dread - dc/d31/d38/d9a/fb3 zero size 2024-02-07T12:25:36.946 INFO:tasks.workunit.client.1.smithi138.stdout:5/664: creat da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d91/fde x:0 0 0 2024-02-07T12:25:36.946 INFO:tasks.workunit.client.1.smithi138.stdout:5/665: write da/d6d/d27/d2e/f77 [23403,119982] 0 2024-02-07T12:25:36.947 INFO:tasks.workunit.client.1.smithi138.stdout:5/666: creat da/d6d/d27/d2e/d4f/d2b/d35/fdf x:0 0 0 2024-02-07T12:25:36.947 INFO:tasks.workunit.client.1.smithi138.stdout:5/667: fsync da/d43/d4a/d69/f7a 0 2024-02-07T12:25:36.948 INFO:tasks.workunit.client.1.smithi138.stdout:4/681: link d20/d34/d36/f41 d20/d53/fd7 0 2024-02-07T12:25:36.948 INFO:tasks.workunit.client.1.smithi138.stdout:6/732: symlink dc/d13/d1e/d35/dc0/lf0 0 2024-02-07T12:25:36.950 INFO:tasks.workunit.client.1.smithi138.stdout:4/682: getdents d20/d34/d36/d55/d74 0 2024-02-07T12:25:36.952 INFO:tasks.workunit.client.1.smithi138.stdout:7/838: dwrite d0/d6/d1d/ff2 [4194304,4194304] 0 2024-02-07T12:25:36.961 INFO:tasks.workunit.client.1.smithi138.stdout:4/683: read d20/d34/d59/d88/d8d/fa2 [1997148,130414] 0 2024-02-07T12:25:36.964 INFO:tasks.workunit.client.1.smithi138.stdout:7/839: mknod d0/d8/d11/d26/c111 0 2024-02-07T12:25:36.965 INFO:tasks.workunit.client.1.smithi138.stdout:7/840: write d0/d8/d11/d26/fae [177100,120150] 0 2024-02-07T12:25:36.965 INFO:tasks.workunit.client.1.smithi138.stdout:7/841: fdatasync d0/d8/d11/d26/d90/f4f 0 2024-02-07T12:25:36.965 INFO:tasks.workunit.client.1.smithi138.stdout:4/684: creat d20/d53/d71/d75/d94/fd8 x:0 0 0 2024-02-07T12:25:36.965 INFO:tasks.workunit.client.1.smithi138.stdout:5/668: dwrite da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d91/fdd [0,4194304] 0 2024-02-07T12:25:36.966 INFO:tasks.workunit.client.1.smithi138.stdout:7/842: mknod d0/d8/d11/d26/d90/d98/da6/c112 0 2024-02-07T12:25:36.968 INFO:tasks.workunit.client.1.smithi138.stdout:5/669: creat da/d50/fe0 x:0 0 0 2024-02-07T12:25:36.970 INFO:tasks.workunit.client.1.smithi138.stdout:4/685: mknod d20/d34/d36/d55/d74/cd9 0 2024-02-07T12:25:36.970 INFO:tasks.workunit.client.1.smithi138.stdout:4/686: fdatasync d20/d34/d36/f5f 0 2024-02-07T12:25:36.971 INFO:tasks.workunit.client.1.smithi138.stdout:7/843: creat d0/d6/deb/ded/f113 x:0 0 0 2024-02-07T12:25:36.972 INFO:tasks.workunit.client.1.smithi138.stdout:4/687: mknod d20/d34/d59/d88/d8e/cda 0 2024-02-07T12:25:36.974 INFO:tasks.workunit.client.1.smithi138.stdout:7/844: creat d0/d39/dfd/d93/dfe/df6/f114 x:0 0 0 2024-02-07T12:25:36.977 INFO:tasks.workunit.client.1.smithi138.stdout:5/670: dread f8 [8388608,4194304] 0 2024-02-07T12:25:36.977 INFO:tasks.workunit.client.1.smithi138.stdout:5/671: dread - da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/fbf zero size 2024-02-07T12:25:36.978 INFO:tasks.workunit.client.1.smithi138.stdout:4/688: dread d20/d34/d36/f43 [0,4194304] 0 2024-02-07T12:25:36.978 INFO:tasks.workunit.client.1.smithi138.stdout:4/689: chown d20/d47/d69/d7c/db9/fbd 313436 1 2024-02-07T12:25:36.978 INFO:tasks.workunit.client.1.smithi138.stdout:4/690: truncate fd 4477448 0 2024-02-07T12:25:36.980 INFO:tasks.workunit.client.1.smithi138.stdout:0/703: sync 2024-02-07T12:25:36.980 INFO:tasks.workunit.client.1.smithi138.stdout:3/841: sync 2024-02-07T12:25:36.980 INFO:tasks.workunit.client.1.smithi138.stdout:3/842: write d5/d34/f119 [78196,26297] 0 2024-02-07T12:25:36.981 INFO:tasks.workunit.client.1.smithi138.stdout:3/843: rmdir d5/d27 39 2024-02-07T12:25:36.989 INFO:tasks.workunit.client.1.smithi138.stdout:0/704: dread d4/d52/f34 [0,4194304] 0 2024-02-07T12:25:36.992 INFO:tasks.workunit.client.1.smithi138.stdout:0/705: getdents d4/d9/d37/d6b 0 2024-02-07T12:25:36.992 INFO:tasks.workunit.client.1.smithi138.stdout:0/706: readlink d4/d9/d37/d64/l6e 0 2024-02-07T12:25:36.993 INFO:tasks.workunit.client.1.smithi138.stdout:0/707: chown d4/d9/f2f 22001822 1 2024-02-07T12:25:36.993 INFO:tasks.workunit.client.1.smithi138.stdout:0/708: getdents d4/d9/d37/d3d/d9c/dad 0 2024-02-07T12:25:36.995 INFO:tasks.workunit.client.1.smithi138.stdout:0/709: creat d4/d9/d37/d64/d9a/db0/fe3 x:0 0 0 2024-02-07T12:25:36.996 INFO:tasks.workunit.client.1.smithi138.stdout:0/710: mkdir d4/d52/de4 0 2024-02-07T12:25:36.996 INFO:tasks.workunit.client.1.smithi138.stdout:3/844: read d5/d26/d4e/fa6 [2604469,74474] 0 2024-02-07T12:25:36.997 INFO:tasks.workunit.client.1.smithi138.stdout:0/711: mknod d4/d52/de4/ce5 0 2024-02-07T12:25:37.007 INFO:tasks.workunit.client.1.smithi138.stdout:5/672: dwrite da/d22/d99/f9b [0,4194304] 0 2024-02-07T12:25:37.009 INFO:tasks.workunit.client.1.smithi138.stdout:4/691: dwrite d20/f26 [0,4194304] 0 2024-02-07T12:25:37.009 INFO:tasks.workunit.client.1.smithi138.stdout:7/845: dwrite d0/d8/d11/d26/fcc [0,4194304] 0 2024-02-07T12:25:37.009 INFO:tasks.workunit.client.1.smithi138.stdout:7/846: chown d0/d6/d84/l94 29723 1 2024-02-07T12:25:37.010 INFO:tasks.workunit.client.1.smithi138.stdout:7/847: chown d0/d6/d3e 79091332 1 2024-02-07T12:25:37.021 INFO:tasks.workunit.client.1.smithi138.stdout:7/848: dread d0/d6/ff9 [0,4194304] 0 2024-02-07T12:25:37.023 INFO:tasks.workunit.client.1.smithi138.stdout:7/849: creat d0/d8/d11/d26/d90/f115 x:0 0 0 2024-02-07T12:25:37.024 INFO:tasks.workunit.client.1.smithi138.stdout:0/712: dwrite d4/d9/d37/d64/fac [0,4194304] 0 2024-02-07T12:25:37.024 INFO:tasks.workunit.client.1.smithi138.stdout:0/713: stat d4/d9/d37/d3d/d9c/dad 0 2024-02-07T12:25:37.025 INFO:tasks.workunit.client.1.smithi138.stdout:7/850: mkdir d0/d6/d19/d116 0 2024-02-07T12:25:37.029 INFO:tasks.workunit.client.1.smithi138.stdout:7/851: symlink d0/d39/d8a/l117 0 2024-02-07T12:25:37.029 INFO:tasks.workunit.client.1.smithi138.stdout:7/852: chown d0/d6/d19/d4e/f91 514 1 2024-02-07T12:25:37.029 INFO:tasks.workunit.client.1.smithi138.stdout:7/853: chown d0/d8/d11/d26/d90/d98 546290 1 2024-02-07T12:25:37.029 INFO:tasks.workunit.client.1.smithi138.stdout:7/854: dread - d0/d39/d8a/fe3 zero size 2024-02-07T12:25:37.030 INFO:tasks.workunit.client.1.smithi138.stdout:7/855: truncate d0/d8/d11/d26/fae 547084 0 2024-02-07T12:25:37.030 INFO:tasks.workunit.client.1.smithi138.stdout:7/856: dread - d0/d6/d73/fd9 zero size 2024-02-07T12:25:37.033 INFO:tasks.workunit.client.1.smithi138.stdout:7/857: rename d0/cf0 to d0/d6/d19/de8/df3/c118 0 2024-02-07T12:25:37.034 INFO:tasks.workunit.client.1.smithi138.stdout:7/858: readlink d0/d8/d11/d63/dc8/dce/dd7/dfa/lfb 0 2024-02-07T12:25:37.034 INFO:tasks.workunit.client.1.smithi138.stdout:4/692: dwrite d20/d47/f4b [0,4194304] 0 2024-02-07T12:25:37.035 INFO:tasks.workunit.client.1.smithi138.stdout:7/859: creat d0/d6/d1d/f119 x:0 0 0 2024-02-07T12:25:37.038 INFO:tasks.workunit.client.1.smithi138.stdout:4/693: rename d20/d53/l68 to d20/d4d/ldb 0 2024-02-07T12:25:37.040 INFO:tasks.workunit.client.1.smithi138.stdout:7/860: creat d0/d6/d84/f11a x:0 0 0 2024-02-07T12:25:37.040 INFO:tasks.workunit.client.1.smithi138.stdout:7/861: dread d0/d8/d11/d26/d90/d98/da6/fd8 [0,4194304] 0 2024-02-07T12:25:37.041 INFO:tasks.workunit.client.1.smithi138.stdout:7/862: chown d0/d8/d11/d63/f7a 371043 1 2024-02-07T12:25:37.041 INFO:tasks.workunit.client.1.smithi138.stdout:0/714: dwrite d4/d9/f2f [0,4194304] 0 2024-02-07T12:25:37.042 INFO:tasks.workunit.client.1.smithi138.stdout:5/673: dwrite da/d6d/d27/d2e/d4f/d2b/d35/d5d/f70 [0,4194304] 0 2024-02-07T12:25:37.042 INFO:tasks.workunit.client.1.smithi138.stdout:4/694: link d20/d34/d36/f43 d20/d34/d59/d72/fdc 0 2024-02-07T12:25:37.043 INFO:tasks.workunit.client.1.smithi138.stdout:4/695: chown d20/d47/la7 354 1 2024-02-07T12:25:37.043 INFO:tasks.workunit.client.1.smithi138.stdout:4/696: write d20/d4d/f62 [1222389,100676] 0 2024-02-07T12:25:37.044 INFO:tasks.workunit.client.1.smithi138.stdout:4/697: dread d20/d34/d36/d55/f96 [0,4194304] 0 2024-02-07T12:25:37.044 INFO:tasks.workunit.client.1.smithi138.stdout:4/698: chown f3 6841 1 2024-02-07T12:25:37.047 INFO:tasks.workunit.client.1.smithi138.stdout:0/715: rename d4/f4d to d4/d69/d85/fe6 0 2024-02-07T12:25:37.050 INFO:tasks.workunit.client.1.smithi138.stdout:7/863: dread d0/d8/d15/db1/fc9 [0,4194304] 0 2024-02-07T12:25:37.051 INFO:tasks.workunit.client.1.smithi138.stdout:4/699: creat d20/d53/d71/d98/fdd x:0 0 0 2024-02-07T12:25:37.051 INFO:tasks.workunit.client.1.smithi138.stdout:4/700: chown d20/d34/l35 1612 1 2024-02-07T12:25:37.051 INFO:tasks.workunit.client.1.smithi138.stdout:4/701: write d20/d53/d71/d98/fc2 [41950,114030] 0 2024-02-07T12:25:37.052 INFO:tasks.workunit.client.1.smithi138.stdout:0/716: creat d4/d9/db/d39/ddb/fe7 x:0 0 0 2024-02-07T12:25:37.054 INFO:tasks.workunit.client.1.smithi138.stdout:4/702: symlink d20/d47/d69/lde 0 2024-02-07T12:25:37.056 INFO:tasks.workunit.client.1.smithi138.stdout:5/674: dwrite da/d6d/d27/d2e/d4f/fc9 [0,4194304] 0 2024-02-07T12:25:37.056 INFO:tasks.workunit.client.1.smithi138.stdout:5/675: write da/d6d/d27/d2e/d4f/d2b/d35/d40/f5e [4679035,23850] 0 2024-02-07T12:25:37.057 INFO:tasks.workunit.client.1.smithi138.stdout:5/676: creat da/d6d/d27/d2e/fe1 x:0 0 0 2024-02-07T12:25:37.057 INFO:tasks.workunit.client.1.smithi138.stdout:5/677: write da/d6d/d27/d2e/d4f/d2b/d35/d40/f45 [4993743,67037] 0 2024-02-07T12:25:37.066 INFO:tasks.workunit.client.1.smithi138.stdout:5/678: unlink da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d91/faa 0 2024-02-07T12:25:37.070 INFO:tasks.workunit.client.1.smithi138.stdout:7/864: dwrite d0/d6/d1d/fe7 [4194304,4194304] 0 2024-02-07T12:25:37.072 INFO:tasks.workunit.client.1.smithi138.stdout:7/865: mknod d0/d6/d19/d4e/c11b 0 2024-02-07T12:25:37.072 INFO:tasks.workunit.client.1.smithi138.stdout:0/717: dwrite d4/d9/f4a [0,4194304] 0 2024-02-07T12:25:37.072 INFO:tasks.workunit.client.1.smithi138.stdout:7/866: fsync d0/d6/f12 0 2024-02-07T12:25:37.073 INFO:tasks.workunit.client.1.smithi138.stdout:4/703: rmdir d20/d53/d71/d98 39 2024-02-07T12:25:37.073 INFO:tasks.workunit.client.1.smithi138.stdout:5/679: dread da/d6d/d27/d2e/d4f/d2b/d35/d40/f5e [4194304,4194304] 0 2024-02-07T12:25:37.074 INFO:tasks.workunit.client.1.smithi138.stdout:4/704: write d20/d53/fd7 [66882,73242] 0 2024-02-07T12:25:37.075 INFO:tasks.workunit.client.1.smithi138.stdout:2/788: sync 2024-02-07T12:25:37.075 INFO:tasks.workunit.client.1.smithi138.stdout:2/789: creat d3/dd/dd2/f120 x:0 0 0 2024-02-07T12:25:37.075 INFO:tasks.workunit.client.1.smithi138.stdout:5/680: dread da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/f7f [0,4194304] 0 2024-02-07T12:25:37.078 INFO:tasks.workunit.client.1.smithi138.stdout:7/867: rmdir d0/d8/d11/d5f 39 2024-02-07T12:25:37.081 INFO:tasks.workunit.client.1.smithi138.stdout:4/705: mknod d20/cdf 0 2024-02-07T12:25:37.083 INFO:tasks.workunit.client.1.smithi138.stdout:2/790: mknod d3/dd/d14/d49/ddc/c121 0 2024-02-07T12:25:37.084 INFO:tasks.workunit.client.1.smithi138.stdout:2/791: write d3/dd/d14/d49/d29/d5b/fba [29739,119427] 0 2024-02-07T12:25:37.085 INFO:tasks.workunit.client.1.smithi138.stdout:5/681: rmdir da/d34 39 2024-02-07T12:25:37.085 INFO:tasks.workunit.client.1.smithi138.stdout:5/682: fsync da/d6d/d27/d2e/d4f/d2b/f87 0 2024-02-07T12:25:37.086 INFO:tasks.workunit.client.1.smithi138.stdout:7/868: mknod d0/d6/deb/ded/c11c 0 2024-02-07T12:25:37.087 INFO:tasks.workunit.client.1.smithi138.stdout:0/718: dwrite d4/d52/f38 [0,4194304] 0 2024-02-07T12:25:37.087 INFO:tasks.workunit.client.1.smithi138.stdout:0/719: stat d4/d9/d37/d64/d9a/dc0 0 2024-02-07T12:25:37.087 INFO:tasks.workunit.client.1.smithi138.stdout:0/720: creat d4/d9/d37/d64/d9a/db0/fe8 x:0 0 0 2024-02-07T12:25:37.088 INFO:tasks.workunit.client.1.smithi138.stdout:4/706: rename d20/d34/d59/d72/d86/f92 to d20/d34/d59/fe0 0 2024-02-07T12:25:37.090 INFO:tasks.workunit.client.1.smithi138.stdout:9/610: sync 2024-02-07T12:25:37.090 INFO:tasks.workunit.client.1.smithi138.stdout:8/873: sync 2024-02-07T12:25:37.090 INFO:tasks.workunit.client.1.smithi138.stdout:5/683: getdents da/d6d/d27/d2e/d4f/d2b/d35/d5d/d73 0 2024-02-07T12:25:37.090 INFO:tasks.workunit.client.1.smithi138.stdout:9/611: dread - d0/fab zero size 2024-02-07T12:25:37.090 INFO:tasks.workunit.client.1.smithi138.stdout:9/612: chown d0/d6/d8/d1d/dd/d41/d5e/f75 31959442 1 2024-02-07T12:25:37.091 INFO:tasks.workunit.client.1.smithi138.stdout:1/699: sync 2024-02-07T12:25:37.091 INFO:tasks.workunit.client.1.smithi138.stdout:1/700: read - d5/d8/da/d1f/d3c/fdb zero size 2024-02-07T12:25:37.091 INFO:tasks.workunit.client.1.smithi138.stdout:1/701: creat d5/d8/dbc/ff2 x:0 0 0 2024-02-07T12:25:37.091 INFO:tasks.workunit.client.1.smithi138.stdout:1/702: chown d5/d8/da/d1f/d5e/d63/fc5 7 1 2024-02-07T12:25:37.092 INFO:tasks.workunit.client.1.smithi138.stdout:7/869: getdents d0/d6/d19 0 2024-02-07T12:25:37.092 INFO:tasks.workunit.client.1.smithi138.stdout:7/870: write d0/d6/d3e/fd1 [1084003,17319] 0 2024-02-07T12:25:37.094 INFO:tasks.workunit.client.1.smithi138.stdout:0/721: rmdir d4/d9/db/d39/d4b/d6c/dc5 39 2024-02-07T12:25:37.095 INFO:tasks.workunit.client.1.smithi138.stdout:4/707: mknod d20/ce1 0 2024-02-07T12:25:37.096 INFO:tasks.workunit.client.1.smithi138.stdout:5/684: mkdir da/d22/d99/dca/dd5/de2 0 2024-02-07T12:25:37.096 INFO:tasks.workunit.client.1.smithi138.stdout:5/685: fsync da/d6d/d27/d2e/d4f/d2b/fab 0 2024-02-07T12:25:37.096 INFO:tasks.workunit.client.1.smithi138.stdout:9/613: symlink d0/lb5 0 2024-02-07T12:25:37.098 INFO:tasks.workunit.client.1.smithi138.stdout:1/703: mknod d5/d4b/d6b/d6e/d79/cf3 0 2024-02-07T12:25:37.099 INFO:tasks.workunit.client.1.smithi138.stdout:7/871: creat d0/d8/d15/f11d x:0 0 0 2024-02-07T12:25:37.102 INFO:tasks.workunit.client.1.smithi138.stdout:5/686: mkdir da/d6d/d27/d2e/d4f/d2b/d35/d67/de3 0 2024-02-07T12:25:37.102 INFO:tasks.workunit.client.1.smithi138.stdout:9/614: truncate d0/d6/d8/d1d/f61 3439738 0 2024-02-07T12:25:37.102 INFO:tasks.workunit.client.1.smithi138.stdout:5/687: fdatasync da/d6d/d27/d2e/d4f/d2b/d35/d40/f5e 0 2024-02-07T12:25:37.102 INFO:tasks.workunit.client.1.smithi138.stdout:4/708: getdents d20/d47 0 2024-02-07T12:25:37.102 INFO:tasks.workunit.client.1.smithi138.stdout:5/688: truncate da/d6d/d27/d2e/d4f/d2b/d35/fd0 983571 0 2024-02-07T12:25:37.105 INFO:tasks.workunit.client.1.smithi138.stdout:9/615: rename d0/d34/d45/d78/l87 to d0/lb6 0 2024-02-07T12:25:37.106 INFO:tasks.workunit.client.1.smithi138.stdout:4/709: mknod d20/d34/d36/d55/d74/ce2 0 2024-02-07T12:25:37.107 INFO:tasks.workunit.client.1.smithi138.stdout:9/616: truncate d0/f33 401978 0 2024-02-07T12:25:37.108 INFO:tasks.workunit.client.1.smithi138.stdout:1/704: write d5/d8/dbc/fc8 [7515562,95216] 0 2024-02-07T12:25:37.108 INFO:tasks.workunit.client.1.smithi138.stdout:1/705: chown d5/d8/da/d1f/d5e/db5/d58/f8c 42020 1 2024-02-07T12:25:37.108 INFO:tasks.workunit.client.1.smithi138.stdout:1/706: truncate d5/d8/da/d1f/d3c/fef 141118 0 2024-02-07T12:25:37.109 INFO:tasks.workunit.client.1.smithi138.stdout:5/689: mkdir da/d6d/d27/d2e/d4f/d2b/d35/d5d/de4 0 2024-02-07T12:25:37.109 INFO:tasks.workunit.client.1.smithi138.stdout:5/690: write da/d6d/d27/d2e/d4f/f9c [4235733,121400] 0 2024-02-07T12:25:37.109 INFO:tasks.workunit.client.1.smithi138.stdout:4/710: write d20/d4d/f90 [1649146,57865] 0 2024-02-07T12:25:37.112 INFO:tasks.workunit.client.1.smithi138.stdout:4/711: symlink d20/d34/d59/le3 0 2024-02-07T12:25:37.114 INFO:tasks.workunit.client.1.smithi138.stdout:1/707: getdents d5/d5b 0 2024-02-07T12:25:37.116 INFO:tasks.workunit.client.1.smithi138.stdout:4/712: mkdir d20/d47/d69/de4 0 2024-02-07T12:25:37.116 INFO:tasks.workunit.client.1.smithi138.stdout:5/691: dread da/d6d/d27/d2e/d4f/f30 [0,4194304] 0 2024-02-07T12:25:37.116 INFO:tasks.workunit.client.1.smithi138.stdout:5/692: dread - da/d6d/d27/d2e/fd2 zero size 2024-02-07T12:25:37.120 INFO:tasks.workunit.client.1.smithi138.stdout:9/617: rename d0/d6/d64 to d0/d6/d8/d1d/dd/d1f/db7 0 2024-02-07T12:25:37.120 INFO:tasks.workunit.client.1.smithi138.stdout:2/792: dwrite d3/dd/d14/d49/d25/fcd [4194304,4194304] 0 2024-02-07T12:25:37.120 INFO:tasks.workunit.client.1.smithi138.stdout:4/713: symlink d20/d34/le5 0 2024-02-07T12:25:37.120 INFO:tasks.workunit.client.1.smithi138.stdout:4/714: creat d20/d4d/fe6 x:0 0 0 2024-02-07T12:25:37.120 INFO:tasks.workunit.client.1.smithi138.stdout:5/693: chown da/c3c 1667 1 2024-02-07T12:25:37.121 INFO:tasks.workunit.client.1.smithi138.stdout:0/722: dwrite d4/d52/f34 [0,4194304] 0 2024-02-07T12:25:37.121 INFO:tasks.workunit.client.1.smithi138.stdout:7/872: dwrite d0/d6/d84/fd0 [0,4194304] 0 2024-02-07T12:25:37.121 INFO:tasks.workunit.client.1.smithi138.stdout:7/873: chown d0/d8/d11/c54 9492 1 2024-02-07T12:25:37.121 INFO:tasks.workunit.client.1.smithi138.stdout:7/874: read - d0/f8c zero size 2024-02-07T12:25:37.122 INFO:tasks.workunit.client.1.smithi138.stdout:9/618: mknod d0/d6/d8/d1d/dd/d1f/db7/cb8 0 2024-02-07T12:25:37.128 INFO:tasks.workunit.client.1.smithi138.stdout:2/793: read d3/d4e/f6e [2865066,42508] 0 2024-02-07T12:25:37.128 INFO:tasks.workunit.client.1.smithi138.stdout:2/794: readlink d3/l36 0 2024-02-07T12:25:37.128 INFO:tasks.workunit.client.1.smithi138.stdout:3/845: sync 2024-02-07T12:25:37.128 INFO:tasks.workunit.client.1.smithi138.stdout:6/733: sync 2024-02-07T12:25:37.133 INFO:tasks.workunit.client.1.smithi138.stdout:0/723: dread d4/d9/d37/d6b/d7f/f82 [0,4194304] 0 2024-02-07T12:25:37.133 INFO:tasks.workunit.client.1.smithi138.stdout:0/724: readlink d4/d9/db/d39/d4b/d6c/l6d 0 2024-02-07T12:25:37.133 INFO:tasks.workunit.client.1.smithi138.stdout:5/694: unlink da/d6d/d27/d2e/d4f/d2b/d35/lc4 0 2024-02-07T12:25:37.134 INFO:tasks.workunit.client.1.smithi138.stdout:7/875: dread d0/d6/d73/f75 [0,4194304] 0 2024-02-07T12:25:37.139 INFO:tasks.workunit.client.1.smithi138.stdout:2/795: truncate d3/dd/d19/d1f/d37/f3b 6061439 0 2024-02-07T12:25:37.141 INFO:tasks.workunit.client.1.smithi138.stdout:3/846: symlink d5/d26/d28/db7/d11c/l122 0 2024-02-07T12:25:37.143 INFO:tasks.workunit.client.1.smithi138.stdout:0/725: mkdir d4/d52/de9 0 2024-02-07T12:25:37.144 INFO:tasks.workunit.client.1.smithi138.stdout:7/876: rmdir d0/d8 39 2024-02-07T12:25:37.145 INFO:tasks.workunit.client.1.smithi138.stdout:6/734: write dc/d31/d38/d9a/fdc [937942,76659] 0 2024-02-07T12:25:37.145 INFO:tasks.workunit.client.1.smithi138.stdout:6/735: write dc/d31/d38/d9a/daa/fef [673579,100987] 0 2024-02-07T12:25:37.145 INFO:tasks.workunit.client.1.smithi138.stdout:9/619: dwrite d0/d6/d8/d1d/dd/d41/f60 [0,4194304] 0 2024-02-07T12:25:37.147 INFO:tasks.workunit.client.1.smithi138.stdout:1/708: rename d5/d8/da/d1f/d3c to d5/d8/da/d1f/d60/df4 0 2024-02-07T12:25:37.147 INFO:tasks.workunit.client.1.smithi138.stdout:1/709: fsync d5/d8/da/d1f/d60/df4/fe1 0 2024-02-07T12:25:37.148 INFO:tasks.workunit.client.1.smithi138.stdout:3/847: symlink d5/d26/d4e/l123 0 2024-02-07T12:25:37.148 INFO:tasks.workunit.client.1.smithi138.stdout:5/695: dread da/f51 [0,4194304] 0 2024-02-07T12:25:37.149 INFO:tasks.workunit.client.1.smithi138.stdout:0/726: symlink d4/d69/lea 0 2024-02-07T12:25:37.149 INFO:tasks.workunit.client.1.smithi138.stdout:0/727: chown d4/d9/l55 82167612 1 2024-02-07T12:25:37.149 INFO:tasks.workunit.client.1.smithi138.stdout:0/728: chown d4/d9/de/l1e 211 1 2024-02-07T12:25:37.153 INFO:tasks.workunit.client.1.smithi138.stdout:6/736: unlink dc/d31/d38/d9a/daa/ld8 0 2024-02-07T12:25:37.155 INFO:tasks.workunit.client.1.smithi138.stdout:9/620: mkdir d0/d6/d8/d1d/dd/d1f/db7/db9 0 2024-02-07T12:25:37.156 INFO:tasks.workunit.client.1.smithi138.stdout:1/710: dread d5/d8/da/d1f/d5e/d63/f92 [0,4194304] 0 2024-02-07T12:25:37.157 INFO:tasks.workunit.client.1.smithi138.stdout:4/715: rename d20/d47/d69/d76/f9d to d20/d34/d59/d72/fe7 0 2024-02-07T12:25:37.158 INFO:tasks.workunit.client.1.smithi138.stdout:0/729: dread d4/d9/f22 [0,4194304] 0 2024-02-07T12:25:37.158 INFO:tasks.workunit.client.1.smithi138.stdout:0/730: write d4/d69/fbd [361783,60348] 0 2024-02-07T12:25:37.158 INFO:tasks.workunit.client.1.smithi138.stdout:0/731: chown d4/d52/f44 42726539 1 2024-02-07T12:25:37.159 INFO:tasks.workunit.client.1.smithi138.stdout:3/848: unlink d5/d27/f40 0 2024-02-07T12:25:37.159 INFO:tasks.workunit.client.1.smithi138.stdout:1/711: fdatasync d5/d8/da/d1f/f51 0 2024-02-07T12:25:37.159 INFO:tasks.workunit.client.1.smithi138.stdout:1/712: readlink d5/d8/da/d1f/d5e/db5/d68/d73/d7b/l37 0 2024-02-07T12:25:37.160 INFO:tasks.workunit.client.1.smithi138.stdout:2/796: dwrite d3/d4e/d119/f57 [0,4194304] 0 2024-02-07T12:25:37.160 INFO:tasks.workunit.client.1.smithi138.stdout:2/797: dread - d3/dd/d14/d49/d25/d3d/d5f/f10a zero size 2024-02-07T12:25:37.160 INFO:tasks.workunit.client.1.smithi138.stdout:1/713: dread d5/d8/fcf [0,4194304] 0 2024-02-07T12:25:37.160 INFO:tasks.workunit.client.1.smithi138.stdout:5/696: symlink da/d50/le5 0 2024-02-07T12:25:37.162 INFO:tasks.workunit.client.1.smithi138.stdout:6/737: creat dc/d13/d1e/d35/d7c/dbe/ff1 x:0 0 0 2024-02-07T12:25:37.162 INFO:tasks.workunit.client.1.smithi138.stdout:6/738: creat dc/ff2 x:0 0 0 2024-02-07T12:25:37.163 INFO:tasks.workunit.client.1.smithi138.stdout:2/798: dread d3/dd/fdf [0,4194304] 0 2024-02-07T12:25:37.165 INFO:tasks.workunit.client.1.smithi138.stdout:7/877: rename d0/fd6 to d0/d8/d11/d1f/f11e 0 2024-02-07T12:25:37.165 INFO:tasks.workunit.client.1.smithi138.stdout:7/878: dread - d0/d8/d15/f11d zero size 2024-02-07T12:25:37.165 INFO:tasks.workunit.client.1.smithi138.stdout:7/879: stat d0/d8/d11/d5f/d86 0 2024-02-07T12:25:37.166 INFO:tasks.workunit.client.1.smithi138.stdout:7/880: read - d0/d8/d11/d26/fdb zero size 2024-02-07T12:25:37.168 INFO:tasks.workunit.client.1.smithi138.stdout:4/716: mkdir d20/d53/d71/d75/de8 0 2024-02-07T12:25:37.170 INFO:tasks.workunit.client.1.smithi138.stdout:4/717: read d20/d34/d59/d72/d77/f97 [31760,116708] 0 2024-02-07T12:25:37.172 INFO:tasks.workunit.client.1.smithi138.stdout:5/697: dread da/d6d/d27/f33 [0,4194304] 0 2024-02-07T12:25:37.172 INFO:tasks.workunit.client.1.smithi138.stdout:5/698: getdents da/d6d/d27/d2e/d4f/d2b/d35/d67/de3 0 2024-02-07T12:25:37.174 INFO:tasks.workunit.client.1.smithi138.stdout:1/714: truncate d5/d8/da/d1f/d5e/db5/d68/d73/d7b/f3d 3710831 0 2024-02-07T12:25:37.174 INFO:tasks.workunit.client.1.smithi138.stdout:2/799: write d3/dd/d14/f5a [1810191,11669] 0 2024-02-07T12:25:37.176 INFO:tasks.workunit.client.1.smithi138.stdout:3/849: dwrite d5/d26/d5e/fe0 [0,4194304] 0 2024-02-07T12:25:37.176 INFO:tasks.workunit.client.1.smithi138.stdout:3/850: chown d5/d34/d79/f7b 211395530 1 2024-02-07T12:25:37.176 INFO:tasks.workunit.client.1.smithi138.stdout:6/739: symlink dc/d31/d54/lf3 0 2024-02-07T12:25:37.178 INFO:tasks.workunit.client.1.smithi138.stdout:9/621: symlink d0/d6/d8/lba 0 2024-02-07T12:25:37.180 INFO:tasks.workunit.client.1.smithi138.stdout:4/718: unlink d20/d53/d71/d98/fc2 0 2024-02-07T12:25:37.180 INFO:tasks.workunit.client.1.smithi138.stdout:4/719: fdatasync d20/d34/d36/d55/f6d 0 2024-02-07T12:25:37.181 INFO:tasks.workunit.client.1.smithi138.stdout:5/699: creat da/d6d/d27/d2e/d4f/d2b/d35/d5d/de4/fe6 x:0 0 0 2024-02-07T12:25:37.182 INFO:tasks.workunit.client.1.smithi138.stdout:1/715: getdents d5/d8/da/d1f/d5e/db5/d68 0 2024-02-07T12:25:37.185 INFO:tasks.workunit.client.1.smithi138.stdout:2/800: creat d3/dd/d19/d1f/d46/d71/d111/f122 x:0 0 0 2024-02-07T12:25:37.185 INFO:tasks.workunit.client.1.smithi138.stdout:2/801: fsync d3/dd/d14/d86/f113 0 2024-02-07T12:25:37.187 INFO:tasks.workunit.client.1.smithi138.stdout:3/851: rename d5/d26/d5e/d86/dae/fd4 to d5/d27/d35/f124 0 2024-02-07T12:25:37.187 INFO:tasks.workunit.client.1.smithi138.stdout:3/852: readlink d5/d26/d4e/l92 0 2024-02-07T12:25:37.187 INFO:tasks.workunit.client.1.smithi138.stdout:7/881: dwrite d0/d6/d1d/fe7 [0,4194304] 0 2024-02-07T12:25:37.187 INFO:tasks.workunit.client.1.smithi138.stdout:4/720: read d20/d47/d69/d76/f7a [1389871,52827] 0 2024-02-07T12:25:37.187 INFO:tasks.workunit.client.1.smithi138.stdout:9/622: mkdir d0/d6/d8/d1d/dd/d1f/dbb 0 2024-02-07T12:25:37.187 INFO:tasks.workunit.client.1.smithi138.stdout:0/732: dwrite d4/d9/d37/d6b/f91 [0,4194304] 0 2024-02-07T12:25:37.188 INFO:tasks.workunit.client.1.smithi138.stdout:5/700: symlink da/d6d/d27/d2e/d4f/d2b/d35/d67/de3/le7 0 2024-02-07T12:25:37.188 INFO:tasks.workunit.client.1.smithi138.stdout:5/701: write da/d6d/d27/fb8 [929492,6929] 0 2024-02-07T12:25:37.188 INFO:tasks.workunit.client.1.smithi138.stdout:5/702: write da/d6d/d27/d2e/f77 [845597,78851] 0 2024-02-07T12:25:37.189 INFO:tasks.workunit.client.1.smithi138.stdout:1/716: symlink d5/d8/da/d1f/d5e/db5/d68/da7/lf5 0 2024-02-07T12:25:37.190 INFO:tasks.workunit.client.1.smithi138.stdout:2/802: mkdir d3/dd/d14/d8f/dbc/dbd/d101/d123 0 2024-02-07T12:25:37.192 INFO:tasks.workunit.client.1.smithi138.stdout:6/740: rename dc/d13/d1e/d24 to dc/d31/d54/ddd/df4 0 2024-02-07T12:25:37.193 INFO:tasks.workunit.client.1.smithi138.stdout:9/623: write d0/f38 [158881,123423] 0 2024-02-07T12:25:37.193 INFO:tasks.workunit.client.1.smithi138.stdout:4/721: creat d20/d34/d73/dd0/fe9 x:0 0 0 2024-02-07T12:25:37.194 INFO:tasks.workunit.client.1.smithi138.stdout:4/722: write d20/d53/f60 [596534,2337] 0 2024-02-07T12:25:37.196 INFO:tasks.workunit.client.1.smithi138.stdout:1/717: dread d5/d8/da/d1f/d5e/db5/d68/d73/d7b/f4e [0,4194304] 0 2024-02-07T12:25:37.197 INFO:tasks.workunit.client.1.smithi138.stdout:0/733: symlink d4/d9/db/leb 0 2024-02-07T12:25:37.198 INFO:tasks.workunit.client.1.smithi138.stdout:2/803: write d3/dd/d14/d8f/dbc/df6/fce [2169290,21584] 0 2024-02-07T12:25:37.199 INFO:tasks.workunit.client.1.smithi138.stdout:8/874: sync 2024-02-07T12:25:37.200 INFO:tasks.workunit.client.1.smithi138.stdout:3/853: rename d5/d26/d28/df1/f10e to d5/d26/d5e/d86/d9c/d10d/f125 0 2024-02-07T12:25:37.201 INFO:tasks.workunit.client.1.smithi138.stdout:6/741: mknod dc/d13/d8e/cf5 0 2024-02-07T12:25:37.202 INFO:tasks.workunit.client.1.smithi138.stdout:0/734: truncate d4/d9/f4a 687192 0 2024-02-07T12:25:37.203 INFO:tasks.workunit.client.1.smithi138.stdout:4/723: dread d20/f7b [0,4194304] 0 2024-02-07T12:25:37.206 INFO:tasks.workunit.client.1.smithi138.stdout:8/875: truncate d1/de/db4/db8/f1a 334701 0 2024-02-07T12:25:37.206 INFO:tasks.workunit.client.1.smithi138.stdout:8/876: fsync d1/de/db4/db8/d17/d3e/dce/fa7 0 2024-02-07T12:25:37.206 INFO:tasks.workunit.client.1.smithi138.stdout:8/877: dread - d1/db3/f10b zero size 2024-02-07T12:25:37.208 INFO:tasks.workunit.client.1.smithi138.stdout:7/882: rename d0/d8/l43 to d0/d8/d11/d5f/df8/l11f 0 2024-02-07T12:25:37.208 INFO:tasks.workunit.client.1.smithi138.stdout:7/883: creat d0/d8/d15/f120 x:0 0 0 2024-02-07T12:25:37.208 INFO:tasks.workunit.client.1.smithi138.stdout:7/884: creat d0/d8/d15/f121 x:0 0 0 2024-02-07T12:25:37.210 INFO:tasks.workunit.client.1.smithi138.stdout:3/854: mknod d5/d26/d9b/c126 0 2024-02-07T12:25:37.213 INFO:tasks.workunit.client.1.smithi138.stdout:9/624: dread d0/d6/f27 [0,4194304] 0 2024-02-07T12:25:37.213 INFO:tasks.workunit.client.1.smithi138.stdout:9/625: truncate d0/d6/d8/d1d/dd/d1f/faa 813931 0 2024-02-07T12:25:37.213 INFO:tasks.workunit.client.1.smithi138.stdout:9/626: getdents d0/d6/d8/d1d/dd/d25/d9b 0 2024-02-07T12:25:37.215 INFO:tasks.workunit.client.1.smithi138.stdout:4/724: link d20/d53/l61 d20/d34/d73/lea 0 2024-02-07T12:25:37.215 INFO:tasks.workunit.client.1.smithi138.stdout:4/725: write d20/d34/d36/d55/fd3 [443273,82190] 0 2024-02-07T12:25:37.215 INFO:tasks.workunit.client.1.smithi138.stdout:8/878: rmdir d1/de/db4/db8/d17/d3e/d72/dda/dcf/ddd/deb 0 2024-02-07T12:25:37.215 INFO:tasks.workunit.client.1.smithi138.stdout:8/879: dread - d1/de/f105 zero size 2024-02-07T12:25:37.216 INFO:tasks.workunit.client.1.smithi138.stdout:6/742: write dc/f1f [7061145,32257] 0 2024-02-07T12:25:37.216 INFO:tasks.workunit.client.1.smithi138.stdout:6/743: dread - dc/d13/d1e/d35/d7c/dbe/ff1 zero size 2024-02-07T12:25:37.221 INFO:tasks.workunit.client.1.smithi138.stdout:7/885: symlink d0/d6/d19/de8/l122 0 2024-02-07T12:25:37.221 INFO:tasks.workunit.client.1.smithi138.stdout:7/886: stat d0/d8/d11/d5f/l9f 0 2024-02-07T12:25:37.221 INFO:tasks.workunit.client.1.smithi138.stdout:8/880: write d1/de/f53 [2638266,18692] 0 2024-02-07T12:25:37.224 INFO:tasks.workunit.client.1.smithi138.stdout:4/726: link f3 d20/d34/d36/d55/feb 0 2024-02-07T12:25:37.226 INFO:tasks.workunit.client.1.smithi138.stdout:6/744: symlink dc/d13/d1e/d35/d7c/dbe/lf6 0 2024-02-07T12:25:37.226 INFO:tasks.workunit.client.1.smithi138.stdout:6/745: chown dc/d31/f37 28406588 1 2024-02-07T12:25:37.229 INFO:tasks.workunit.client.1.smithi138.stdout:8/881: rename d1/de/f109 to d1/de/db4/db8/d96/f111 0 2024-02-07T12:25:37.229 INFO:tasks.workunit.client.1.smithi138.stdout:5/703: dwrite da/d43/d4a/d69/fa6 [8388608,4194304] 0 2024-02-07T12:25:37.233 INFO:tasks.workunit.client.1.smithi138.stdout:4/727: link f14 d20/d47/d69/d7c/db9/dba/fec 0 2024-02-07T12:25:37.233 INFO:tasks.workunit.client.1.smithi138.stdout:4/728: chown f1c 622680 1 2024-02-07T12:25:37.233 INFO:tasks.workunit.client.1.smithi138.stdout:4/729: dread - d20/fcb zero size 2024-02-07T12:25:37.237 INFO:tasks.workunit.client.1.smithi138.stdout:2/804: dwrite d3/dd/d19/d1f/dc9/f109 [0,4194304] 0 2024-02-07T12:25:37.238 INFO:tasks.workunit.client.1.smithi138.stdout:5/704: write da/d6d/d27/d2e/d4f/d2b/d35/d5d/f70 [1415227,89395] 0 2024-02-07T12:25:37.238 INFO:tasks.workunit.client.1.smithi138.stdout:1/718: dwrite d5/d4b/f5d [0,4194304] 0 2024-02-07T12:25:37.239 INFO:tasks.workunit.client.1.smithi138.stdout:9/627: dwrite d0/d6/d8/d1d/dd/d25/f5b [0,4194304] 0 2024-02-07T12:25:37.239 INFO:tasks.workunit.client.1.smithi138.stdout:9/628: write d0/d6/d8/d1d/dd/d41/fb2 [1256091,106866] 0 2024-02-07T12:25:37.239 INFO:tasks.workunit.client.1.smithi138.stdout:4/730: mkdir d20/d47/d69/de4/ded 0 2024-02-07T12:25:37.241 INFO:tasks.workunit.client.1.smithi138.stdout:6/746: getdents dc/d31/d3f 0 2024-02-07T12:25:37.247 INFO:tasks.workunit.client.1.smithi138.stdout:2/805: write d3/dd/d19/d1f/d37/f3b [3631591,104121] 0 2024-02-07T12:25:37.251 INFO:tasks.workunit.client.1.smithi138.stdout:1/719: mknod d5/d8/da/d1f/d60/df4/d59/cf6 0 2024-02-07T12:25:37.253 INFO:tasks.workunit.client.1.smithi138.stdout:9/629: dwrite d0/d6/d8/d1d/dd/d41/d5e/f8d [0,4194304] 0 2024-02-07T12:25:37.254 INFO:tasks.workunit.client.1.smithi138.stdout:5/705: rename da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/c78 to da/d43/d4a/d95/ce8 0 2024-02-07T12:25:37.254 INFO:tasks.workunit.client.1.smithi138.stdout:5/706: dread - da/d6d/fac zero size 2024-02-07T12:25:37.258 INFO:tasks.workunit.client.1.smithi138.stdout:4/731: getdents d20/d34/d36/d55/d74/d9a 0 2024-02-07T12:25:37.261 INFO:tasks.workunit.client.1.smithi138.stdout:6/747: unlink dc/d13/d1e/d4d/f9c 0 2024-02-07T12:25:37.265 INFO:tasks.workunit.client.1.smithi138.stdout:5/707: fdatasync da/f15 0 2024-02-07T12:25:37.269 INFO:tasks.workunit.client.1.smithi138.stdout:4/732: rename d20/d34/d36/f8f to d20/d34/d36/d55/d74/d9a/fee 0 2024-02-07T12:25:37.269 INFO:tasks.workunit.client.1.smithi138.stdout:4/733: fdatasync d20/d34/d73/dd0/fe9 0 2024-02-07T12:25:37.281 INFO:tasks.workunit.client.1.smithi138.stdout:5/708: dread da/d22/d99/f9b [0,4194304] 0 2024-02-07T12:25:37.283 INFO:tasks.workunit.client.1.smithi138.stdout:5/709: link da/d43/d4a/fbe da/d34/fe9 0 2024-02-07T12:25:37.285 INFO:tasks.workunit.client.1.smithi138.stdout:5/710: rename da/d6d/d27/d2e/d4f/cc7 to da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/cea 0 2024-02-07T12:25:37.286 INFO:tasks.workunit.client.1.smithi138.stdout:5/711: creat da/d6d/d27/feb x:0 0 0 2024-02-07T12:25:37.296 INFO:tasks.workunit.client.1.smithi138.stdout:9/630: dwrite d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:37.296 INFO:tasks.workunit.client.1.smithi138.stdout:9/631: chown d0/d6/l44 6109 1 2024-02-07T12:25:37.299 INFO:tasks.workunit.client.1.smithi138.stdout:2/806: dwrite d3/d4e/f6e [0,4194304] 0 2024-02-07T12:25:37.299 INFO:tasks.workunit.client.1.smithi138.stdout:2/807: readlink d3/dd/d14/d49/d25/lda 0 2024-02-07T12:25:37.299 INFO:tasks.workunit.client.1.smithi138.stdout:2/808: dread - d3/dd/d14/d82/fff zero size 2024-02-07T12:25:37.299 INFO:tasks.workunit.client.1.smithi138.stdout:2/809: readlink d3/l6 0 2024-02-07T12:25:37.299 INFO:tasks.workunit.client.1.smithi138.stdout:6/748: dwrite dc/fc1 [0,4194304] 0 2024-02-07T12:25:37.300 INFO:tasks.workunit.client.1.smithi138.stdout:1/720: dwrite d5/d8/da/d1f/f51 [4194304,4194304] 0 2024-02-07T12:25:37.300 INFO:tasks.workunit.client.1.smithi138.stdout:4/734: dwrite d20/d47/d69/d76/f7a [0,4194304] 0 2024-02-07T12:25:37.301 INFO:tasks.workunit.client.1.smithi138.stdout:9/632: write d0/d6/d8/d1d/dd/d41/d5e/d74/f7b [1665556,26412] 0 2024-02-07T12:25:37.301 INFO:tasks.workunit.client.1.smithi138.stdout:9/633: chown d0/d6/d8/d1d/dd/d1f/f1b 39 1 2024-02-07T12:25:37.302 INFO:tasks.workunit.client.1.smithi138.stdout:6/749: creat dc/d13/d1e/d35/ff7 x:0 0 0 2024-02-07T12:25:37.303 INFO:tasks.workunit.client.1.smithi138.stdout:6/750: stat dc/d13/d1e/d35/f4c 0 2024-02-07T12:25:37.308 INFO:tasks.workunit.client.1.smithi138.stdout:5/712: dwrite da/d43/d4a/da2/fb7 [0,4194304] 0 2024-02-07T12:25:37.308 INFO:tasks.workunit.client.1.smithi138.stdout:2/810: write d3/d4e/d119/de8/fee [6955722,870] 0 2024-02-07T12:25:37.308 INFO:tasks.workunit.client.1.smithi138.stdout:2/811: chown d3/dd/d19/d1f/d46/l67 218711313 1 2024-02-07T12:25:37.312 INFO:tasks.workunit.client.1.smithi138.stdout:6/751: dread dc/d13/d1e/f30 [0,4194304] 0 2024-02-07T12:25:37.312 INFO:tasks.workunit.client.1.smithi138.stdout:6/752: creat dc/d13/d1e/d35/d7c/dbe/ff8 x:0 0 0 2024-02-07T12:25:37.313 INFO:tasks.workunit.client.1.smithi138.stdout:6/753: dread dc/d13/d1e/f8c [0,4194304] 0 2024-02-07T12:25:37.314 INFO:tasks.workunit.client.1.smithi138.stdout:5/713: chown da/l52 7 1 2024-02-07T12:25:37.314 INFO:tasks.workunit.client.1.smithi138.stdout:5/714: dread - da/d34/fe9 zero size 2024-02-07T12:25:37.316 INFO:tasks.workunit.client.1.smithi138.stdout:5/715: symlink da/d43/d4a/da2/lec 0 2024-02-07T12:25:37.316 INFO:tasks.workunit.client.1.smithi138.stdout:5/716: write da/d6d/f7c [31150,100166] 0 2024-02-07T12:25:37.318 INFO:tasks.workunit.client.1.smithi138.stdout:5/717: rename da/d43/d4a/da2/la4 to da/d34/dbd/led 0 2024-02-07T12:25:37.320 INFO:tasks.workunit.client.1.smithi138.stdout:5/718: link da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/cea da/d43/d4a/d98/cee 0 2024-02-07T12:25:37.321 INFO:tasks.workunit.client.1.smithi138.stdout:5/719: truncate da/d6d/d27/d2e/d4f/d2b/d35/d5d/f8c 1025328 0 2024-02-07T12:25:37.321 INFO:tasks.workunit.client.1.smithi138.stdout:6/754: write dc/d31/d38/d9a/fa9 [2106142,27282] 0 2024-02-07T12:25:37.322 INFO:tasks.workunit.client.1.smithi138.stdout:2/812: dread d3/dd/d14/d49/d29/d5b/f8d [0,4194304] 0 2024-02-07T12:25:37.322 INFO:tasks.workunit.client.1.smithi138.stdout:5/720: rmdir da/d22/d99 39 2024-02-07T12:25:37.322 INFO:tasks.workunit.client.1.smithi138.stdout:2/813: stat d3 0 2024-02-07T12:25:37.325 INFO:tasks.workunit.client.1.smithi138.stdout:6/755: rename dc/d31/fc8 to dc/d13/d1e/d35/d85/dba/ff9 0 2024-02-07T12:25:37.327 INFO:tasks.workunit.client.1.smithi138.stdout:2/814: unlink d3/dd/d14/d82/fa3 0 2024-02-07T12:25:37.329 INFO:tasks.workunit.client.1.smithi138.stdout:6/756: mknod dc/d13/d1e/d4d/cfa 0 2024-02-07T12:25:37.331 INFO:tasks.workunit.client.1.smithi138.stdout:5/721: rename da/d43/d4a/d69/c5c to da/d6d/d27/cef 0 2024-02-07T12:25:37.333 INFO:tasks.workunit.client.1.smithi138.stdout:6/757: mknod dc/d13/d1e/d35/d85/cfb 0 2024-02-07T12:25:37.333 INFO:tasks.workunit.client.1.smithi138.stdout:6/758: truncate dc/d13/d1e/f2f 4623980 0 2024-02-07T12:25:37.333 INFO:tasks.workunit.client.1.smithi138.stdout:6/759: chown dc/d13/d1e/d35/d6d/da6/lda 0 1 2024-02-07T12:25:37.333 INFO:tasks.workunit.client.1.smithi138.stdout:6/760: stat dc/d31/d38/f53 0 2024-02-07T12:25:37.333 INFO:tasks.workunit.client.1.smithi138.stdout:2/815: getdents d3/dd/dd2 0 2024-02-07T12:25:37.333 INFO:tasks.workunit.client.1.smithi138.stdout:2/816: dread - d3/dd/d14/d49/d25/d3d/d5f/f116 zero size 2024-02-07T12:25:37.334 INFO:tasks.workunit.client.1.smithi138.stdout:5/722: rmdir da/d6d/d27/d2e/d4f/d2b/d35/d5d 39 2024-02-07T12:25:37.336 INFO:tasks.workunit.client.1.smithi138.stdout:6/761: symlink dc/d31/d3f/lfc 0 2024-02-07T12:25:37.339 INFO:tasks.workunit.client.1.smithi138.stdout:6/762: rmdir dc/d31/d38/d9a/daa 39 2024-02-07T12:25:37.341 INFO:tasks.workunit.client.1.smithi138.stdout:6/763: mknod dc/d13/d1e/d35/d7c/cfd 0 2024-02-07T12:25:37.341 INFO:tasks.workunit.client.1.smithi138.stdout:6/764: getdents dc/d13/d1e/dc7 0 2024-02-07T12:25:37.342 INFO:tasks.workunit.client.1.smithi138.stdout:6/765: mkdir dc/d13/d1e/d35/d6d/dfe 0 2024-02-07T12:25:37.350 INFO:tasks.workunit.client.1.smithi138.stdout:1/721: dwrite d5/d8/da/d1f/d60/df4/fe1 [0,4194304] 0 2024-02-07T12:25:37.355 INFO:tasks.workunit.client.1.smithi138.stdout:0/735: sync 2024-02-07T12:25:37.355 INFO:tasks.workunit.client.1.smithi138.stdout:0/736: read f1 [517920,75930] 0 2024-02-07T12:25:37.358 INFO:tasks.workunit.client.1.smithi138.stdout:0/737: rename d4/d9/d75/fbb to d4/d9/d37/d6b/d7f/dcf/fec 0 2024-02-07T12:25:37.360 INFO:tasks.workunit.client.1.smithi138.stdout:0/738: read d4/d9/d37/f8d [3383222,130541] 0 2024-02-07T12:25:37.365 INFO:tasks.workunit.client.1.smithi138.stdout:0/739: getdents d4/d9/db/d71 0 2024-02-07T12:25:37.375 INFO:tasks.workunit.client.1.smithi138.stdout:5/723: dwrite da/d43/d4a/f9d [0,4194304] 0 2024-02-07T12:25:37.376 INFO:tasks.workunit.client.1.smithi138.stdout:5/724: mkdir da/d6d/d27/d2e/d4f/d2b/d35/d67/df0 0 2024-02-07T12:25:37.377 INFO:tasks.workunit.client.1.smithi138.stdout:5/725: rmdir da/d6d/d27/d2e/d4f/d2b/d35/dae/db0 39 2024-02-07T12:25:37.377 INFO:tasks.workunit.client.1.smithi138.stdout:5/726: truncate da/d6d/fd6 850800 0 2024-02-07T12:25:37.379 INFO:tasks.workunit.client.1.smithi138.stdout:5/727: mkdir da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d91/df1 0 2024-02-07T12:25:37.379 INFO:tasks.workunit.client.1.smithi138.stdout:6/766: dwrite dc/d13/d1e/d35/dc0/fd1 [0,4194304] 0 2024-02-07T12:25:37.379 INFO:tasks.workunit.client.1.smithi138.stdout:6/767: dread - dc/d13/d1e/d35/d7c/fec zero size 2024-02-07T12:25:37.380 INFO:tasks.workunit.client.1.smithi138.stdout:2/817: dwrite d3/dd/d14/d49/d25/d3d/f55 [0,4194304] 0 2024-02-07T12:25:37.380 INFO:tasks.workunit.client.1.smithi138.stdout:2/818: stat d3/dd/d19/f35 0 2024-02-07T12:25:37.380 INFO:tasks.workunit.client.1.smithi138.stdout:2/819: write d3/d4e/d119/f69 [4174415,52745] 0 2024-02-07T12:25:37.380 INFO:tasks.workunit.client.1.smithi138.stdout:1/722: dwrite d5/d8/f14 [4194304,4194304] 0 2024-02-07T12:25:37.380 INFO:tasks.workunit.client.1.smithi138.stdout:2/820: write d3/d4e/d119/d7d/fb5 [58240,41858] 0 2024-02-07T12:25:37.382 INFO:tasks.workunit.client.1.smithi138.stdout:0/740: dwrite d4/d9/de/fc7 [0,4194304] 0 2024-02-07T12:25:37.382 INFO:tasks.workunit.client.1.smithi138.stdout:0/741: chown d4/d9/db/d39/d4b/d6c 14861 1 2024-02-07T12:25:37.382 INFO:tasks.workunit.client.1.smithi138.stdout:0/742: creat d4/d9/de/fed x:0 0 0 2024-02-07T12:25:37.382 INFO:tasks.workunit.client.1.smithi138.stdout:0/743: truncate d4/d9/d37/d64/d9a/db0/fe8 828407 0 2024-02-07T12:25:37.383 INFO:tasks.workunit.client.1.smithi138.stdout:5/728: rename da/d6d/d27/d2e/d4f/d2b/fb3 to da/d6d/d27/d2e/d4f/d2b/d35/d67/df0/ff2 0 2024-02-07T12:25:37.384 INFO:tasks.workunit.client.1.smithi138.stdout:6/768: creat dc/d31/d54/ddd/df4/fff x:0 0 0 2024-02-07T12:25:37.397 INFO:tasks.workunit.client.1.smithi138.stdout:5/729: mknod da/d6d/d27/d2e/d4f/d2b/cf3 0 2024-02-07T12:25:37.397 INFO:tasks.workunit.client.1.smithi138.stdout:1/723: dwrite d5/d4b/d6b/d6e/fad [0,4194304] 0 2024-02-07T12:25:37.398 INFO:tasks.workunit.client.1.smithi138.stdout:0/744: dread d4/f6 [0,4194304] 0 2024-02-07T12:25:37.398 INFO:tasks.workunit.client.1.smithi138.stdout:0/745: write d4/d9/db/d39/d4b/d6c/f80 [6313469,53749] 0 2024-02-07T12:25:37.398 INFO:tasks.workunit.client.1.smithi138.stdout:0/746: chown d4/d9/d37/d6b/d7f/dcf 1171451 1 2024-02-07T12:25:37.398 INFO:tasks.workunit.client.1.smithi138.stdout:6/769: unlink dc/f77 0 2024-02-07T12:25:37.400 INFO:tasks.workunit.client.1.smithi138.stdout:1/724: mknod d5/d8/da/d1f/d5e/db5/d68/d73/cf7 0 2024-02-07T12:25:37.400 INFO:tasks.workunit.client.1.smithi138.stdout:1/725: read - d5/d8/da/d1f/d5e/fdf zero size 2024-02-07T12:25:37.400 INFO:tasks.workunit.client.1.smithi138.stdout:1/726: write d5/d8/da/d1f/d5e/fdf [918083,40171] 0 2024-02-07T12:25:37.400 INFO:tasks.workunit.client.1.smithi138.stdout:8/882: sync 2024-02-07T12:25:37.400 INFO:tasks.workunit.client.1.smithi138.stdout:3/855: sync 2024-02-07T12:25:37.400 INFO:tasks.workunit.client.1.smithi138.stdout:7/887: sync 2024-02-07T12:25:37.401 INFO:tasks.workunit.client.1.smithi138.stdout:0/747: truncate d4/d52/f2e 3071375 0 2024-02-07T12:25:37.401 INFO:tasks.workunit.client.1.smithi138.stdout:1/727: mkdir d5/d8/da/df8 0 2024-02-07T12:25:37.403 INFO:tasks.workunit.client.1.smithi138.stdout:8/883: mkdir d1/de/db4/db8/d17/d3e/d72/dda/dcf/ddd/d112 0 2024-02-07T12:25:37.403 INFO:tasks.workunit.client.1.smithi138.stdout:3/856: getdents d5/d26/d9b/dab/dc4 0 2024-02-07T12:25:37.405 INFO:tasks.workunit.client.1.smithi138.stdout:7/888: creat d0/d6/d19/d116/f123 x:0 0 0 2024-02-07T12:25:37.406 INFO:tasks.workunit.client.1.smithi138.stdout:0/748: rmdir d4/d9/de/d1d 39 2024-02-07T12:25:37.406 INFO:tasks.workunit.client.1.smithi138.stdout:0/749: read - d4/d52/f2d zero size 2024-02-07T12:25:37.407 INFO:tasks.workunit.client.1.smithi138.stdout:2/821: dwrite d3/d4e/d119/d7d/fb5 [0,4194304] 0 2024-02-07T12:25:37.409 INFO:tasks.workunit.client.1.smithi138.stdout:1/728: getdents d5/d8/da/d1f/d5e/db5/d58 0 2024-02-07T12:25:37.413 INFO:tasks.workunit.client.1.smithi138.stdout:3/857: mkdir d5/d26/d5e/d86/ded/d96/d120/d127 0 2024-02-07T12:25:37.413 INFO:tasks.workunit.client.1.smithi138.stdout:8/884: write d1/de/db4/db8/d17/d3e/d89/fc5 [3315087,86800] 0 2024-02-07T12:25:37.416 INFO:tasks.workunit.client.1.smithi138.stdout:3/858: symlink d5/d26/ddd/l128 0 2024-02-07T12:25:37.417 INFO:tasks.workunit.client.1.smithi138.stdout:3/859: creat d5/d27/d35/dac/f129 x:0 0 0 2024-02-07T12:25:37.418 INFO:tasks.workunit.client.1.smithi138.stdout:3/860: creat d5/d27/f12a x:0 0 0 2024-02-07T12:25:37.419 INFO:tasks.workunit.client.1.smithi138.stdout:7/889: dread d0/d6/d73/f75 [0,4194304] 0 2024-02-07T12:25:37.419 INFO:tasks.workunit.client.1.smithi138.stdout:7/890: creat d0/d6/d1d/f124 x:0 0 0 2024-02-07T12:25:37.420 INFO:tasks.workunit.client.1.smithi138.stdout:3/861: unlink d5/f23 0 2024-02-07T12:25:37.421 INFO:tasks.workunit.client.1.smithi138.stdout:7/891: mkdir d0/d6/d84/d10e/d125 0 2024-02-07T12:25:37.421 INFO:tasks.workunit.client.1.smithi138.stdout:0/750: dread d4/d9/f11 [0,4194304] 0 2024-02-07T12:25:37.424 INFO:tasks.workunit.client.1.smithi138.stdout:7/892: link d0/d39/dfd/d93/lb7 d0/d8/d11/d26/d90/d98/l126 0 2024-02-07T12:25:37.425 INFO:tasks.workunit.client.1.smithi138.stdout:6/770: dwrite fb [0,4194304] 0 2024-02-07T12:25:37.426 INFO:tasks.workunit.client.1.smithi138.stdout:6/771: creat dc/d13/d1e/d35/d7c/dbe/f100 x:0 0 0 2024-02-07T12:25:37.426 INFO:tasks.workunit.client.1.smithi138.stdout:6/772: chown dc/d13/d1e/d35/dc0/lf0 10456 1 2024-02-07T12:25:37.426 INFO:tasks.workunit.client.1.smithi138.stdout:6/773: fsync dc/d31/f72 0 2024-02-07T12:25:37.426 INFO:tasks.workunit.client.1.smithi138.stdout:7/893: rename d0/d8/d11/d63/dc8/dce/dd7/fe1 to d0/d8/d15/f127 0 2024-02-07T12:25:37.426 INFO:tasks.workunit.client.1.smithi138.stdout:7/894: chown d0/d8/l55 12 1 2024-02-07T12:25:37.426 INFO:tasks.workunit.client.1.smithi138.stdout:7/895: truncate d0/d6/d73/f101 215149 0 2024-02-07T12:25:37.429 INFO:tasks.workunit.client.1.smithi138.stdout:7/896: dread d0/d6/d73/f75 [0,4194304] 0 2024-02-07T12:25:37.429 INFO:tasks.workunit.client.1.smithi138.stdout:7/897: dread - d0/d8/db3/fbf zero size 2024-02-07T12:25:37.431 INFO:tasks.workunit.client.1.smithi138.stdout:7/898: symlink d0/d8/d11/d26/l128 0 2024-02-07T12:25:37.431 INFO:tasks.workunit.client.1.smithi138.stdout:3/862: write d5/d27/d35/dac/fb2 [1949251,82025] 0 2024-02-07T12:25:37.432 INFO:tasks.workunit.client.1.smithi138.stdout:1/729: dwrite d5/d8/da/d20/f90 [0,4194304] 0 2024-02-07T12:25:37.432 INFO:tasks.workunit.client.1.smithi138.stdout:7/899: stat d0/d8/d11/d26/d90/l34 0 2024-02-07T12:25:37.437 INFO:tasks.workunit.client.1.smithi138.stdout:6/774: write dc/d31/d54/ddd/df4/f3c [4470171,129981] 0 2024-02-07T12:25:37.437 INFO:tasks.workunit.client.1.smithi138.stdout:6/775: dread - dc/d13/d1e/d35/d85/dba/ff9 zero size 2024-02-07T12:25:37.437 INFO:tasks.workunit.client.1.smithi138.stdout:6/776: creat dc/d31/d38/f101 x:0 0 0 2024-02-07T12:25:37.438 INFO:tasks.workunit.client.1.smithi138.stdout:6/777: write f6 [4349976,49499] 0 2024-02-07T12:25:37.438 INFO:tasks.workunit.client.1.smithi138.stdout:6/778: truncate dc/d13/d1e/d35/d85/dba/ff9 1037952 0 2024-02-07T12:25:37.438 INFO:tasks.workunit.client.1.smithi138.stdout:7/900: rmdir d0/d39/dfd/d93 39 2024-02-07T12:25:37.441 INFO:tasks.workunit.client.1.smithi138.stdout:6/779: rename dc/d13/d1e/d35/f4c to dc/d13/d1e/d35/d85/dba/f102 0 2024-02-07T12:25:37.442 INFO:tasks.workunit.client.1.smithi138.stdout:6/780: stat dc/d13/d1e/d35/d85 0 2024-02-07T12:25:37.444 INFO:tasks.workunit.client.1.smithi138.stdout:0/751: dwrite d4/d9/d33/f4c [0,4194304] 0 2024-02-07T12:25:37.444 INFO:tasks.workunit.client.1.smithi138.stdout:0/752: write d4/d9/db/f20 [1594649,22227] 0 2024-02-07T12:25:37.444 INFO:tasks.workunit.client.1.smithi138.stdout:7/901: symlink d0/d8/d11/d63/dc8/l129 0 2024-02-07T12:25:37.444 INFO:tasks.workunit.client.1.smithi138.stdout:1/730: dread d5/d8/da/d1f/d5e/db5/d58/f74 [0,4194304] 0 2024-02-07T12:25:37.445 INFO:tasks.workunit.client.1.smithi138.stdout:1/731: creat d5/d4b/d65/ff9 x:0 0 0 2024-02-07T12:25:37.445 INFO:tasks.workunit.client.1.smithi138.stdout:6/781: link dc/d13/d1e/c21 dc/d13/d1e/d35/d6d/da6/c103 0 2024-02-07T12:25:37.445 INFO:tasks.workunit.client.1.smithi138.stdout:6/782: chown dc/d69/l7f 34433 1 2024-02-07T12:25:37.446 INFO:tasks.workunit.client.1.smithi138.stdout:6/783: read - dc/d73/d9b/fd9 zero size 2024-02-07T12:25:37.446 INFO:tasks.workunit.client.1.smithi138.stdout:4/735: sync 2024-02-07T12:25:37.446 INFO:tasks.workunit.client.1.smithi138.stdout:9/634: sync 2024-02-07T12:25:37.447 INFO:tasks.workunit.client.1.smithi138.stdout:0/753: symlink d4/d9/db/d39/lee 0 2024-02-07T12:25:37.449 INFO:tasks.workunit.client.1.smithi138.stdout:1/732: unlink d5/d8/da/d1f/d5e/db5/d58/f8b 0 2024-02-07T12:25:37.450 INFO:tasks.workunit.client.1.smithi138.stdout:6/784: creat dc/d13/d1e/d35/d85/f104 x:0 0 0 2024-02-07T12:25:37.453 INFO:tasks.workunit.client.1.smithi138.stdout:0/754: truncate d4/d9/de/d1d/d21/f4e 3475698 0 2024-02-07T12:25:37.453 INFO:tasks.workunit.client.1.smithi138.stdout:7/902: dread d0/d6/d1d/fe7 [4194304,4194304] 0 2024-02-07T12:25:37.454 INFO:tasks.workunit.client.1.smithi138.stdout:3/863: dwrite d5/d27/d35/f124 [0,4194304] 0 2024-02-07T12:25:37.455 INFO:tasks.workunit.client.1.smithi138.stdout:0/755: mkdir d4/d9/d37/db6/def 0 2024-02-07T12:25:37.455 INFO:tasks.workunit.client.1.smithi138.stdout:0/756: readlink d4/d9/l7b 0 2024-02-07T12:25:37.455 INFO:tasks.workunit.client.1.smithi138.stdout:0/757: chown d4/d9/d37/d3d/d9c/dad 19921089 1 2024-02-07T12:25:37.456 INFO:tasks.workunit.client.1.smithi138.stdout:7/903: dread d0/d6/d3e/fd1 [0,4194304] 0 2024-02-07T12:25:37.458 INFO:tasks.workunit.client.1.smithi138.stdout:0/758: symlink d4/d9/d37/d64/d9a/db0/lf0 0 2024-02-07T12:25:37.461 INFO:tasks.workunit.client.1.smithi138.stdout:9/635: write d0/d34/d45/f69 [2650783,41765] 0 2024-02-07T12:25:37.465 INFO:tasks.workunit.client.1.smithi138.stdout:6/785: write dc/d13/d1e/d35/dc0/fd1 [4071081,120306] 0 2024-02-07T12:25:37.465 INFO:tasks.workunit.client.1.smithi138.stdout:6/786: read - dc/d73/d9b/fa0 zero size 2024-02-07T12:25:37.465 INFO:tasks.workunit.client.1.smithi138.stdout:7/904: dread d0/f14 [0,4194304] 0 2024-02-07T12:25:37.465 INFO:tasks.workunit.client.1.smithi138.stdout:7/905: truncate d0/d8/d11/d26/fb9 1192575 0 2024-02-07T12:25:37.466 INFO:tasks.workunit.client.1.smithi138.stdout:7/906: dread - d0/d39/dfd/f10c zero size 2024-02-07T12:25:37.466 INFO:tasks.workunit.client.1.smithi138.stdout:3/864: write d5/d27/d35/f50 [238956,6930] 0 2024-02-07T12:25:37.467 INFO:tasks.workunit.client.1.smithi138.stdout:1/733: dread d5/f86 [0,4194304] 0 2024-02-07T12:25:37.467 INFO:tasks.workunit.client.1.smithi138.stdout:6/787: dread dc/d13/d1e/d35/d85/f89 [0,4194304] 0 2024-02-07T12:25:37.467 INFO:tasks.workunit.client.1.smithi138.stdout:1/734: fdatasync d5/d8/da/d20/f41 0 2024-02-07T12:25:37.467 INFO:tasks.workunit.client.1.smithi138.stdout:7/907: unlink d0/d8/d15/db1/fca 0 2024-02-07T12:25:37.472 INFO:tasks.workunit.client.1.smithi138.stdout:1/735: dread d5/d8/da/d1f/d5e/db5/d68/d73/d7b/f4e [0,4194304] 0 2024-02-07T12:25:37.472 INFO:tasks.workunit.client.1.smithi138.stdout:7/908: symlink d0/d6/deb/ded/l12a 0 2024-02-07T12:25:37.472 INFO:tasks.workunit.client.1.smithi138.stdout:1/736: write d5/d8/da/d1f/d60/df4/d59/f78 [5120622,127203] 0 2024-02-07T12:25:37.472 INFO:tasks.workunit.client.1.smithi138.stdout:1/737: fdatasync d5/d8/dbc/fc8 0 2024-02-07T12:25:37.474 INFO:tasks.workunit.client.1.smithi138.stdout:7/909: link d0/d8/db3/fbf d0/d39/dfd/d93/dfe/df6/f12b 0 2024-02-07T12:25:37.474 INFO:tasks.workunit.client.1.smithi138.stdout:7/910: creat d0/d8/d15/f12c x:0 0 0 2024-02-07T12:25:37.475 INFO:tasks.workunit.client.1.smithi138.stdout:1/738: creat d5/d8/ffa x:0 0 0 2024-02-07T12:25:37.477 INFO:tasks.workunit.client.1.smithi138.stdout:7/911: mkdir d0/d8/d15/d12d 0 2024-02-07T12:25:37.477 INFO:tasks.workunit.client.1.smithi138.stdout:7/912: chown d0/d8/d11/d26/d90 5182955 1 2024-02-07T12:25:37.478 INFO:tasks.workunit.client.1.smithi138.stdout:1/739: mknod d5/d5b/cfb 0 2024-02-07T12:25:37.481 INFO:tasks.workunit.client.1.smithi138.stdout:7/913: mkdir d0/d6/deb/ded/d12e 0 2024-02-07T12:25:37.481 INFO:tasks.workunit.client.1.smithi138.stdout:7/914: truncate d0/f8c 557788 0 2024-02-07T12:25:37.481 INFO:tasks.workunit.client.1.smithi138.stdout:6/788: dread dc/d13/d1e/f2f [0,4194304] 0 2024-02-07T12:25:37.484 INFO:tasks.workunit.client.1.smithi138.stdout:9/636: dread d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:37.487 INFO:tasks.workunit.client.1.smithi138.stdout:4/736: dwrite d20/d34/f4c [0,4194304] 0 2024-02-07T12:25:37.496 INFO:tasks.workunit.client.1.smithi138.stdout:7/915: write d0/d39/dfd/d93/fad [2031968,116915] 0 2024-02-07T12:25:37.496 INFO:tasks.workunit.client.1.smithi138.stdout:7/916: fdatasync d0/f14 0 2024-02-07T12:25:37.496 INFO:tasks.workunit.client.1.smithi138.stdout:7/917: truncate d0/d39/dfd/f10c 629104 0 2024-02-07T12:25:37.498 INFO:tasks.workunit.client.1.smithi138.stdout:7/918: mknod d0/d39/dfd/c12f 0 2024-02-07T12:25:37.498 INFO:tasks.workunit.client.1.smithi138.stdout:7/919: getdents d0/d6/d84/d10e/d125 0 2024-02-07T12:25:37.498 INFO:tasks.workunit.client.1.smithi138.stdout:7/920: creat d0/d6/d1d/f130 x:0 0 0 2024-02-07T12:25:37.498 INFO:tasks.workunit.client.1.smithi138.stdout:7/921: truncate d0/d8/d11/d1f/f9b 990831 0 2024-02-07T12:25:37.499 INFO:tasks.workunit.client.1.smithi138.stdout:7/922: mknod d0/d8/d11/d1f/c131 0 2024-02-07T12:25:37.499 INFO:tasks.workunit.client.1.smithi138.stdout:7/923: write d0/d6/d3e/f3f [1631756,97839] 0 2024-02-07T12:25:37.499 INFO:tasks.workunit.client.1.smithi138.stdout:7/924: chown d0/d39/dfd/d93/fbb 8126731 1 2024-02-07T12:25:37.499 INFO:tasks.workunit.client.1.smithi138.stdout:7/925: fdatasync d0/d6/d84/fff 0 2024-02-07T12:25:37.499 INFO:tasks.workunit.client.1.smithi138.stdout:7/926: getdents d0/d6/d19 0 2024-02-07T12:25:37.501 INFO:tasks.workunit.client.1.smithi138.stdout:0/759: dwrite d4/d9/d37/d64/fd2 [0,4194304] 0 2024-02-07T12:25:37.501 INFO:tasks.workunit.client.1.smithi138.stdout:0/760: write d4/d9/db/fcb [2651995,78990] 0 2024-02-07T12:25:37.503 INFO:tasks.workunit.client.1.smithi138.stdout:0/761: link d4/d9/de/d1d/d77/la1 d4/d9/d33/lf1 0 2024-02-07T12:25:37.504 INFO:tasks.workunit.client.1.smithi138.stdout:0/762: write d4/d9/db/d39/d4b/fd6 [778381,108138] 0 2024-02-07T12:25:37.507 INFO:tasks.workunit.client.1.smithi138.stdout:6/789: dread dc/d13/d1e/f2b [0,4194304] 0 2024-02-07T12:25:37.508 INFO:tasks.workunit.client.1.smithi138.stdout:7/927: write d0/d6/d73/f97 [1284291,8005] 0 2024-02-07T12:25:37.508 INFO:tasks.workunit.client.1.smithi138.stdout:6/790: mknod dc/d13/d1e/d35/d7c/c105 0 2024-02-07T12:25:37.510 INFO:tasks.workunit.client.1.smithi138.stdout:7/928: unlink d0/d6/d1d/f41 0 2024-02-07T12:25:37.511 INFO:tasks.workunit.client.1.smithi138.stdout:6/791: mkdir dc/d31/d38/d9a/daa/d106 0 2024-02-07T12:25:37.511 INFO:tasks.workunit.client.1.smithi138.stdout:6/792: fdatasync dc/d13/d1e/d35/d6d/f6e 0 2024-02-07T12:25:37.512 INFO:tasks.workunit.client.1.smithi138.stdout:3/865: dwrite d5/d34/f119 [0,4194304] 0 2024-02-07T12:25:37.516 INFO:tasks.workunit.client.1.smithi138.stdout:3/866: symlink d5/d27/d35/dac/l12b 0 2024-02-07T12:25:37.517 INFO:tasks.workunit.client.1.smithi138.stdout:3/867: stat d5/d27/dde/feb 0 2024-02-07T12:25:37.517 INFO:tasks.workunit.client.1.smithi138.stdout:3/868: write d5/d26/d5e/d86/ded/fe7 [4608892,47610] 0 2024-02-07T12:25:37.517 INFO:tasks.workunit.client.1.smithi138.stdout:6/793: dread dc/d13/d1e/f30 [0,4194304] 0 2024-02-07T12:25:37.517 INFO:tasks.workunit.client.1.smithi138.stdout:6/794: readlink dc/d31/d3f/lfc 0 2024-02-07T12:25:37.517 INFO:tasks.workunit.client.1.smithi138.stdout:6/795: readlink dc/l98 0 2024-02-07T12:25:37.518 INFO:tasks.workunit.client.1.smithi138.stdout:6/796: write dc/d31/f72 [15061,98096] 0 2024-02-07T12:25:37.518 INFO:tasks.workunit.client.1.smithi138.stdout:0/763: write d4/d69/f87 [3980335,119572] 0 2024-02-07T12:25:37.518 INFO:tasks.workunit.client.1.smithi138.stdout:0/764: chown d4/d9 14497840 1 2024-02-07T12:25:37.518 INFO:tasks.workunit.client.1.smithi138.stdout:1/740: dwrite d5/d4b/d6b/d6e/d79/fb1 [4194304,4194304] 0 2024-02-07T12:25:37.518 INFO:tasks.workunit.client.1.smithi138.stdout:9/637: dwrite d0/d6/d8/d1d/f3d [0,4194304] 0 2024-02-07T12:25:37.520 INFO:tasks.workunit.client.1.smithi138.stdout:0/765: dread d4/f1f [0,4194304] 0 2024-02-07T12:25:37.528 INFO:tasks.workunit.client.1.smithi138.stdout:7/929: dwrite d0/d6/d19/f5d [0,4194304] 0 2024-02-07T12:25:37.530 INFO:tasks.workunit.client.1.smithi138.stdout:3/869: unlink d5/d27/d35/f53 0 2024-02-07T12:25:37.531 INFO:tasks.workunit.client.1.smithi138.stdout:6/797: unlink dc/d31/d54/l82 0 2024-02-07T12:25:37.531 INFO:tasks.workunit.client.1.smithi138.stdout:7/930: write d0/d6/d3e/f68 [911959,47459] 0 2024-02-07T12:25:37.536 INFO:tasks.workunit.client.1.smithi138.stdout:1/741: creat d5/d4b/d6b/d6e/d79/ffc x:0 0 0 2024-02-07T12:25:37.541 INFO:tasks.workunit.client.1.smithi138.stdout:0/766: creat d4/d9/d37/d64/d9d/ff2 x:0 0 0 2024-02-07T12:25:37.544 INFO:tasks.workunit.client.1.smithi138.stdout:3/870: mkdir d5/d26/d5e/d86/ded/d96/d120/d12c 0 2024-02-07T12:25:37.544 INFO:tasks.workunit.client.1.smithi138.stdout:3/871: readlink d5/d27/lc8 0 2024-02-07T12:25:37.544 INFO:tasks.workunit.client.1.smithi138.stdout:3/872: stat d5/d26/d5e/d86/ded/d32/da1/fdc 0 2024-02-07T12:25:37.546 INFO:tasks.workunit.client.1.smithi138.stdout:9/638: mkdir d0/d6/d8/dbc 0 2024-02-07T12:25:37.547 INFO:tasks.workunit.client.1.smithi138.stdout:0/767: creat d4/d9/d37/dbe/ff3 x:0 0 0 2024-02-07T12:25:37.547 INFO:tasks.workunit.client.1.smithi138.stdout:0/768: write d4/d9/d37/dbe/ff3 [807834,25328] 0 2024-02-07T12:25:37.548 INFO:tasks.workunit.client.1.smithi138.stdout:7/931: dwrite d0/d8/d11/d26/fdb [0,4194304] 0 2024-02-07T12:25:37.548 INFO:tasks.workunit.client.1.smithi138.stdout:7/932: fsync d0/d6/d19/f5d 0 2024-02-07T12:25:37.548 INFO:tasks.workunit.client.1.smithi138.stdout:7/933: truncate d0/d6/d1d/f130 78521 0 2024-02-07T12:25:37.549 INFO:tasks.workunit.client.1.smithi138.stdout:7/934: write d0/d8/d11/d63/f89 [4971616,8878] 0 2024-02-07T12:25:37.549 INFO:tasks.workunit.client.1.smithi138.stdout:7/935: write d0/d6/fa [1073902,21423] 0 2024-02-07T12:25:37.549 INFO:tasks.workunit.client.1.smithi138.stdout:3/873: rmdir d5/d26/d28/db7/d11c 39 2024-02-07T12:25:37.549 INFO:tasks.workunit.client.1.smithi138.stdout:6/798: getdents dc/d13/d8e 0 2024-02-07T12:25:37.549 INFO:tasks.workunit.client.1.smithi138.stdout:6/799: fdatasync dc/d31/d38/f64 0 2024-02-07T12:25:37.550 INFO:tasks.workunit.client.1.smithi138.stdout:6/800: chown dc/d13/d8e/cea 239820449 1 2024-02-07T12:25:37.550 INFO:tasks.workunit.client.1.smithi138.stdout:6/801: chown dc/d13/d1e/d35/d6d/dfe 566457582 1 2024-02-07T12:25:37.550 INFO:tasks.workunit.client.1.smithi138.stdout:6/802: write dc/d13/d1e/d35/d7c/dbe/fd6 [4268490,54342] 0 2024-02-07T12:25:37.551 INFO:tasks.workunit.client.1.smithi138.stdout:9/639: creat d0/d6/d8/d1d/da0/fbd x:0 0 0 2024-02-07T12:25:37.555 INFO:tasks.workunit.client.1.smithi138.stdout:7/936: link d0/d6/d84/fff d0/f132 0 2024-02-07T12:25:37.558 INFO:tasks.workunit.client.1.smithi138.stdout:6/803: symlink dc/d31/d38/d9a/daa/d106/l107 0 2024-02-07T12:25:37.559 INFO:tasks.workunit.client.1.smithi138.stdout:1/742: rename d5/d8/da/d1f/d5e/d62 to d5/dfd 0 2024-02-07T12:25:37.559 INFO:tasks.workunit.client.1.smithi138.stdout:9/640: rename d0 to d0/d6/d8/d1d/dd/d41/d5e/dbe 22 2024-02-07T12:25:37.559 INFO:tasks.workunit.client.1.smithi138.stdout:9/641: write d0/d34/f51 [2723971,32156] 0 2024-02-07T12:25:37.560 INFO:tasks.workunit.client.1.smithi138.stdout:3/874: mknod d5/c12d 0 2024-02-07T12:25:37.560 INFO:tasks.workunit.client.1.smithi138.stdout:3/875: readlink d5/d26/d4e/l92 0 2024-02-07T12:25:37.560 INFO:tasks.workunit.client.1.smithi138.stdout:3/876: chown d5/d26/c46 53165 1 2024-02-07T12:25:37.560 INFO:tasks.workunit.client.1.smithi138.stdout:3/877: chown d5/d26/d5e/d86/ded/d32/fb8 0 1 2024-02-07T12:25:37.561 INFO:tasks.workunit.client.1.smithi138.stdout:0/769: dwrite d4/d9/d37/d64/d9d/ff2 [0,4194304] 0 2024-02-07T12:25:37.561 INFO:tasks.workunit.client.1.smithi138.stdout:0/770: write d4/d9/d37/d6b/d7f/f82 [4858210,124117] 0 2024-02-07T12:25:37.562 INFO:tasks.workunit.client.1.smithi138.stdout:5/730: sync 2024-02-07T12:25:37.562 INFO:tasks.workunit.client.1.smithi138.stdout:5/731: truncate da/d43/d4a/d98/fc8 805754 0 2024-02-07T12:25:37.565 INFO:tasks.workunit.client.1.smithi138.stdout:6/804: creat dc/d31/d54/dee/f108 x:0 0 0 2024-02-07T12:25:37.565 INFO:tasks.workunit.client.1.smithi138.stdout:1/743: truncate d5/d4b/fab 1424043 0 2024-02-07T12:25:37.567 INFO:tasks.workunit.client.1.smithi138.stdout:3/878: creat d5/d26/f12e x:0 0 0 2024-02-07T12:25:37.567 INFO:tasks.workunit.client.1.smithi138.stdout:3/879: write d5/d27/f7d [300209,87797] 0 2024-02-07T12:25:37.573 INFO:tasks.workunit.client.1.smithi138.stdout:7/937: dwrite d0/d39/dfd/d93/dfe/df6/f12b [0,4194304] 0 2024-02-07T12:25:37.573 INFO:tasks.workunit.client.1.smithi138.stdout:7/938: truncate d0/d8/d11/d1f/f11e 857155 0 2024-02-07T12:25:37.574 INFO:tasks.workunit.client.1.smithi138.stdout:1/744: dread d5/d8/da/f11 [0,4194304] 0 2024-02-07T12:25:37.574 INFO:tasks.workunit.client.1.smithi138.stdout:1/745: write d5/d8/da/f47 [298335,22293] 0 2024-02-07T12:25:37.575 INFO:tasks.workunit.client.1.smithi138.stdout:1/746: fdatasync d5/d8/dd0/fd4 0 2024-02-07T12:25:37.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:37 smithi047 ceph-mon[28972]: pgmap v5: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail 2024-02-07T12:25:37.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:37 smithi047 ceph-mon[28972]: mgrmap e24: smithi138.fiugmj(active, since 4s) 2024-02-07T12:25:37.576 INFO:tasks.workunit.client.1.smithi138.stdout:0/771: mknod d4/d9/d37/d3d/d9c/dad/cf4 0 2024-02-07T12:25:37.576 INFO:tasks.workunit.client.1.smithi138.stdout:6/805: mknod dc/d31/d9f/c109 0 2024-02-07T12:25:37.578 INFO:tasks.workunit.client.1.smithi138.stdout:3/880: creat d5/d26/d9b/dab/dc4/f12f x:0 0 0 2024-02-07T12:25:37.578 INFO:tasks.workunit.client.1.smithi138.stdout:3/881: fdatasync d5/d27/f3d 0 2024-02-07T12:25:37.578 INFO:tasks.workunit.client.1.smithi138.stdout:3/882: write d5/d26/d5e/d86/ded/f48 [5061697,95560] 0 2024-02-07T12:25:37.583 INFO:tasks.workunit.client.1.smithi138.stdout:7/939: link d0/d8/d11/d63/dc8/l129 d0/d39/l133 0 2024-02-07T12:25:37.583 INFO:tasks.workunit.client.1.smithi138.stdout:7/940: read - d0/d8/d15/f120 zero size 2024-02-07T12:25:37.583 INFO:tasks.workunit.client.1.smithi138.stdout:7/941: stat d0/d8/d11/d63/f104 0 2024-02-07T12:25:37.584 INFO:tasks.workunit.client.1.smithi138.stdout:1/747: creat d5/d8/da/df8/ffe x:0 0 0 2024-02-07T12:25:37.586 INFO:tasks.workunit.client.1.smithi138.stdout:0/772: truncate d4/d9/f11 327098 0 2024-02-07T12:25:37.588 INFO:tasks.workunit.client.1.smithi138.stdout:7/942: mknod d0/d8/d11/d63/dc8/dce/dd7/c134 0 2024-02-07T12:25:37.588 INFO:tasks.workunit.client.1.smithi138.stdout:7/943: stat d0/f74 0 2024-02-07T12:25:37.589 INFO:tasks.workunit.client.1.smithi138.stdout:1/748: getdents d5/d5b 0 2024-02-07T12:25:37.590 INFO:tasks.workunit.client.1.smithi138.stdout:0/773: mkdir d4/d9/d37/d64/df5 0 2024-02-07T12:25:37.590 INFO:tasks.workunit.client.1.smithi138.stdout:2/822: sync 2024-02-07T12:25:37.593 INFO:tasks.workunit.client.1.smithi138.stdout:6/806: rmdir dc/d31/d38 39 2024-02-07T12:25:37.593 INFO:tasks.workunit.client.1.smithi138.stdout:7/944: symlink d0/d8/d11/d26/l135 0 2024-02-07T12:25:37.595 INFO:tasks.workunit.client.1.smithi138.stdout:0/774: creat d4/d9/db/d39/d4b/ff6 x:0 0 0 2024-02-07T12:25:37.596 INFO:tasks.workunit.client.1.smithi138.stdout:7/945: rmdir d0/d8/d11/d5f/df8 39 2024-02-07T12:25:37.598 INFO:tasks.workunit.client.1.smithi138.stdout:0/775: link d4/d9/d33/f4c d4/d9/d37/dbe/ff7 0 2024-02-07T12:25:37.600 INFO:tasks.workunit.client.1.smithi138.stdout:7/946: getdents d0 0 2024-02-07T12:25:37.600 INFO:tasks.workunit.client.1.smithi138.stdout:7/947: stat d0/d8/d11/d1f/l81 0 2024-02-07T12:25:37.602 INFO:tasks.workunit.client.1.smithi138.stdout:0/776: creat d4/d9/d33/ff8 x:0 0 0 2024-02-07T12:25:37.604 INFO:tasks.workunit.client.1.smithi138.stdout:7/948: creat d0/d6/d73/f136 x:0 0 0 2024-02-07T12:25:37.604 INFO:tasks.workunit.client.1.smithi138.stdout:7/949: write d0/d6/d3e/f3f [567104,22159] 0 2024-02-07T12:25:37.608 INFO:tasks.workunit.client.1.smithi138.stdout:7/950: rename d0/d39/dfd/c12f to d0/d6/d84/d10e/d125/c137 0 2024-02-07T12:25:37.608 INFO:tasks.workunit.client.1.smithi138.stdout:7/951: chown d0/d6/d1d/d38/ff1 7545 1 2024-02-07T12:25:37.608 INFO:tasks.workunit.client.1.smithi138.stdout:7/952: stat d0/d39/d8a 0 2024-02-07T12:25:37.611 INFO:tasks.workunit.client.1.smithi138.stdout:7/953: creat d0/d8/d11/d63/dc8/f138 x:0 0 0 2024-02-07T12:25:37.614 INFO:tasks.workunit.client.1.smithi138.stdout:3/883: dwrite d5/d26/d90/fba [0,4194304] 0 2024-02-07T12:25:37.617 INFO:tasks.workunit.client.1.smithi138.stdout:3/884: mknod d5/d26/d9b/dab/c130 0 2024-02-07T12:25:37.619 INFO:tasks.workunit.client.1.smithi138.stdout:0/777: write d4/d9/de/fc7 [1651387,52799] 0 2024-02-07T12:25:37.619 INFO:tasks.workunit.client.1.smithi138.stdout:1/749: dwrite d5/d4b/d6b/d6e/d79/fb1 [4194304,4194304] 0 2024-02-07T12:25:37.619 INFO:tasks.workunit.client.1.smithi138.stdout:3/885: rmdir d5/d26/d9b/dab/dc4/dfb 0 2024-02-07T12:25:37.623 INFO:tasks.workunit.client.1.smithi138.stdout:3/886: rename d5/d26/d5e/d86/ded/d96/d120/d12c to d5/d26/d9b/dab/dc4/dd0/d131 0 2024-02-07T12:25:37.623 INFO:tasks.workunit.client.1.smithi138.stdout:3/887: write d5/d26/d5e/d77/fd6 [8704751,114488] 0 2024-02-07T12:25:37.624 INFO:tasks.workunit.client.1.smithi138.stdout:3/888: rename d5/d27/f80 to d5/d26/d5e/d86/dc0/f132 0 2024-02-07T12:25:37.624 INFO:tasks.workunit.client.1.smithi138.stdout:3/889: write d5/d27/f12a [327148,24537] 0 2024-02-07T12:25:37.624 INFO:tasks.workunit.client.1.smithi138.stdout:3/890: getdents d5/d26/d5e/d77 0 2024-02-07T12:25:37.624 INFO:tasks.workunit.client.1.smithi138.stdout:3/891: write d5/d34/d79/f89 [3436377,27510] 0 2024-02-07T12:25:37.631 INFO:tasks.workunit.client.1.smithi138.stdout:0/778: dread d4/d9/f12 [0,4194304] 0 2024-02-07T12:25:37.632 INFO:tasks.workunit.client.1.smithi138.stdout:2/823: dwrite d3/dd/d19/d1f/d37/f75 [0,4194304] 0 2024-02-07T12:25:37.632 INFO:tasks.workunit.client.1.smithi138.stdout:2/824: creat d3/dd/d19/f124 x:0 0 0 2024-02-07T12:25:37.632 INFO:tasks.workunit.client.1.smithi138.stdout:6/807: dwrite dc/d13/f1d [0,4194304] 0 2024-02-07T12:25:37.632 INFO:tasks.workunit.client.1.smithi138.stdout:6/808: chown dc/d31 20783212 1 2024-02-07T12:25:37.635 INFO:tasks.workunit.client.1.smithi138.stdout:7/954: rmdir d0/d6/d73 39 2024-02-07T12:25:37.642 INFO:tasks.workunit.client.1.smithi138.stdout:3/892: dwrite d5/d27/f29 [0,4194304] 0 2024-02-07T12:25:37.644 INFO:tasks.workunit.client.1.smithi138.stdout:6/809: rename dc/d31/d38/d9a to dc/d13/d1e/d35/d6d/da6/d10a 0 2024-02-07T12:25:37.644 INFO:tasks.workunit.client.1.smithi138.stdout:6/810: truncate dc/d13/d1e/dae/feb 386862 0 2024-02-07T12:25:37.645 INFO:tasks.workunit.client.1.smithi138.stdout:7/955: creat d0/d39/dfd/f139 x:0 0 0 2024-02-07T12:25:37.647 INFO:tasks.workunit.client.1.smithi138.stdout:3/893: mkdir d5/d26/d90/d133 0 2024-02-07T12:25:37.647 INFO:tasks.workunit.client.1.smithi138.stdout:3/894: dread - d5/d26/d28/fee zero size 2024-02-07T12:25:37.647 INFO:tasks.workunit.client.1.smithi138.stdout:2/825: getdents d3 0 2024-02-07T12:25:37.651 INFO:tasks.workunit.client.1.smithi138.stdout:2/826: rename d3/dd/dd2/f120 to d3/dd/d14/d8f/dbc/dfe/f125 0 2024-02-07T12:25:37.651 INFO:tasks.workunit.client.1.smithi138.stdout:2/827: fsync d3/dd/d19/d1f/fa2 0 2024-02-07T12:25:37.651 INFO:tasks.workunit.client.1.smithi138.stdout:2/828: read d3/dd/d14/d8f/dbc/df6/fce [1858021,21598] 0 2024-02-07T12:25:37.652 INFO:tasks.workunit.client.1.smithi138.stdout:3/895: mknod d5/d26/c134 0 2024-02-07T12:25:37.652 INFO:tasks.workunit.client.1.smithi138.stdout:0/779: dwrite d4/d9/de/f72 [0,4194304] 0 2024-02-07T12:25:37.653 INFO:tasks.workunit.client.1.smithi138.stdout:2/829: mknod d3/dd/d19/d1f/d46/c126 0 2024-02-07T12:25:37.654 INFO:tasks.workunit.client.1.smithi138.stdout:2/830: creat d3/dd/d14/d49/d25/f127 x:0 0 0 2024-02-07T12:25:37.654 INFO:tasks.workunit.client.1.smithi138.stdout:2/831: write d3/dd/d19/d1f/d37/f3b [158242,105607] 0 2024-02-07T12:25:37.654 INFO:tasks.workunit.client.1.smithi138.stdout:0/780: write d4/d9/db/d39/d4b/d6c/d8f/f97 [633184,112293] 0 2024-02-07T12:25:37.654 INFO:tasks.workunit.client.1.smithi138.stdout:7/956: dread d0/d8/db3/fbf [0,4194304] 0 2024-02-07T12:25:37.657 INFO:tasks.workunit.client.1.smithi138.stdout:6/811: dread dc/d31/d54/ddd/df4/f3c [0,4194304] 0 2024-02-07T12:25:37.657 INFO:tasks.workunit.client.1.smithi138.stdout:2/832: stat d3/dd/d14/d49/d29/l32 0 2024-02-07T12:25:37.659 INFO:tasks.workunit.client.1.smithi138.stdout:6/812: link dc/d73/cac dc/d13/c10b 0 2024-02-07T12:25:37.659 INFO:tasks.workunit.client.1.smithi138.stdout:6/813: fsync dc/d13/d1e/d35/d6d/da6/d10a/fdc 0 2024-02-07T12:25:37.659 INFO:tasks.workunit.client.1.smithi138.stdout:6/814: truncate dc/d13/d1e/d35/d6d/da6/d10a/daa/fef 1170106 0 2024-02-07T12:25:37.660 INFO:tasks.workunit.client.1.smithi138.stdout:2/833: creat d3/dd/d14/d82/dcc/f128 x:0 0 0 2024-02-07T12:25:37.660 INFO:tasks.workunit.client.1.smithi138.stdout:2/834: write d3/dd/d19/d1f/f5d [547272,65837] 0 2024-02-07T12:25:37.662 INFO:tasks.workunit.client.1.smithi138.stdout:6/815: creat dc/d13/d8e/f10c x:0 0 0 2024-02-07T12:25:37.663 INFO:tasks.workunit.client.1.smithi138.stdout:8/885: sync 2024-02-07T12:25:37.663 INFO:tasks.workunit.client.1.smithi138.stdout:4/737: sync 2024-02-07T12:25:37.665 INFO:tasks.workunit.client.1.smithi138.stdout:6/816: link dc/d13/d1e/d35/f40 dc/d13/d1e/d35/d7c/dbe/f10d 0 2024-02-07T12:25:37.665 INFO:tasks.workunit.client.1.smithi138.stdout:6/817: write dc/d13/d1e/f2b [1365697,5040] 0 2024-02-07T12:25:37.665 INFO:tasks.workunit.client.1.smithi138.stdout:7/957: dread d0/fdd [0,4194304] 0 2024-02-07T12:25:37.666 INFO:tasks.workunit.client.1.smithi138.stdout:4/738: mkdir d20/d47/d69/def 0 2024-02-07T12:25:37.666 INFO:tasks.workunit.client.1.smithi138.stdout:4/739: chown d20/f39 552 1 2024-02-07T12:25:37.666 INFO:tasks.workunit.client.1.smithi138.stdout:4/740: fdatasync d20/d4d/d87/fcf 0 2024-02-07T12:25:37.669 INFO:tasks.workunit.client.1.smithi138.stdout:0/781: write d4/d9/d37/f60 [2111512,17874] 0 2024-02-07T12:25:37.669 INFO:tasks.workunit.client.1.smithi138.stdout:6/818: rmdir dc/d13/d1e/d35/d85 39 2024-02-07T12:25:37.669 INFO:tasks.workunit.client.1.smithi138.stdout:6/819: chown dc/fc6 18500090 1 2024-02-07T12:25:37.671 INFO:tasks.workunit.client.1.smithi138.stdout:0/782: rename d4/d9/d37/d64/d9a/db0/lf0 to d4/d9/db/d39/d4b/d6c/dc5/de0/lf9 0 2024-02-07T12:25:37.673 INFO:tasks.workunit.client.1.smithi138.stdout:0/783: write d4/d9/d37/d64/f9b [223742,89888] 0 2024-02-07T12:25:37.673 INFO:tasks.workunit.client.1.smithi138.stdout:0/784: chown d4/d69/d85/fe6 29 1 2024-02-07T12:25:37.673 INFO:tasks.workunit.client.1.smithi138.stdout:0/785: creat d4/d9/d37/d3d/ffa x:0 0 0 2024-02-07T12:25:37.674 INFO:tasks.workunit.client.1.smithi138.stdout:0/786: write d4/d9/d37/d6b/f8b [1898505,33674] 0 2024-02-07T12:25:37.674 INFO:tasks.workunit.client.1.smithi138.stdout:6/820: link dc/d31/d38/fc3 dc/d13/d1e/d35/dc0/f10e 0 2024-02-07T12:25:37.674 INFO:tasks.workunit.client.1.smithi138.stdout:6/821: creat dc/d13/d1e/dae/f10f x:0 0 0 2024-02-07T12:25:37.674 INFO:tasks.workunit.client.1.smithi138.stdout:6/822: creat dc/d73/d9b/f110 x:0 0 0 2024-02-07T12:25:37.676 INFO:tasks.workunit.client.1.smithi138.stdout:4/741: dread d20/d47/d69/d7c/db9/dba/fc1 [0,4194304] 0 2024-02-07T12:25:37.679 INFO:tasks.workunit.client.1.smithi138.stdout:0/787: mkdir d4/d9/db/d71/dfb 0 2024-02-07T12:25:37.679 INFO:tasks.workunit.client.1.smithi138.stdout:6/823: creat dc/d31/d54/ddd/f111 x:0 0 0 2024-02-07T12:25:37.679 INFO:tasks.workunit.client.1.smithi138.stdout:0/788: dread - d4/d52/d74/fdc zero size 2024-02-07T12:25:37.680 INFO:tasks.workunit.client.1.smithi138.stdout:6/824: chown dc/d13/d1e/l56 403 1 2024-02-07T12:25:37.680 INFO:tasks.workunit.client.1.smithi138.stdout:6/825: creat dc/d31/d54/dee/f112 x:0 0 0 2024-02-07T12:25:37.680 INFO:tasks.workunit.client.1.smithi138.stdout:4/742: symlink d20/d53/dd1/lf0 0 2024-02-07T12:25:37.683 INFO:tasks.workunit.client.1.smithi138.stdout:0/789: symlink d4/d9/d37/d3d/d9c/lfc 0 2024-02-07T12:25:37.684 INFO:tasks.workunit.client.1.smithi138.stdout:0/790: fsync d4/d9/db/d71/fdf 0 2024-02-07T12:25:37.685 INFO:tasks.workunit.client.1.smithi138.stdout:2/835: dwrite d3/dd/d14/d8f/dbc/df6/fce [0,4194304] 0 2024-02-07T12:25:37.685 INFO:tasks.workunit.client.1.smithi138.stdout:2/836: chown d3/dd/d19/f124 18385826 1 2024-02-07T12:25:37.685 INFO:tasks.workunit.client.1.smithi138.stdout:2/837: stat d3/dd/d14/d49/d29/d5b/l117 0 2024-02-07T12:25:37.685 INFO:tasks.workunit.client.1.smithi138.stdout:2/838: write d3/dd/d14/d49/d25/d3d/f103 [919145,81036] 0 2024-02-07T12:25:37.686 INFO:tasks.workunit.client.1.smithi138.stdout:6/826: mknod dc/d13/c113 0 2024-02-07T12:25:37.688 INFO:tasks.workunit.client.1.smithi138.stdout:2/839: dread d3/dd/d14/d49/d29/d5b/fba [0,4194304] 0 2024-02-07T12:25:37.688 INFO:tasks.workunit.client.1.smithi138.stdout:2/840: write d3/d4e/d119/de8/fee [4011206,52290] 0 2024-02-07T12:25:37.688 INFO:tasks.workunit.client.1.smithi138.stdout:2/841: fsync d3/d4e/d119/de8/f118 0 2024-02-07T12:25:37.688 INFO:tasks.workunit.client.1.smithi138.stdout:2/842: chown d3/dd/d14/d8f 69194 1 2024-02-07T12:25:37.688 INFO:tasks.workunit.client.1.smithi138.stdout:7/958: dwrite d0/d39/d8a/fbc [0,4194304] 0 2024-02-07T12:25:37.689 INFO:tasks.workunit.client.1.smithi138.stdout:4/743: rename d20/f2f to d20/d34/d59/d88/d8e/ff1 0 2024-02-07T12:25:37.690 INFO:tasks.workunit.client.1.smithi138.stdout:6/827: symlink dc/d13/d1e/d35/d7c/dbe/l114 0 2024-02-07T12:25:37.692 INFO:tasks.workunit.client.1.smithi138.stdout:0/791: dread d4/d9/de/d1d/f54 [0,4194304] 0 2024-02-07T12:25:37.694 INFO:tasks.workunit.client.1.smithi138.stdout:4/744: symlink d20/d34/d36/d55/lf2 0 2024-02-07T12:25:37.697 INFO:tasks.workunit.client.1.smithi138.stdout:0/792: creat d4/d9/d37/d64/d9a/ffd x:0 0 0 2024-02-07T12:25:37.699 INFO:tasks.workunit.client.1.smithi138.stdout:4/745: mknod d20/d53/d71/d75/d94/cf3 0 2024-02-07T12:25:37.704 INFO:tasks.workunit.client.1.smithi138.stdout:2/843: dwrite d3/d4e/f50 [0,4194304] 0 2024-02-07T12:25:37.704 INFO:tasks.workunit.client.1.smithi138.stdout:2/844: dread - d3/d4e/fdb zero size 2024-02-07T12:25:37.709 INFO:tasks.workunit.client.1.smithi138.stdout:0/793: rename d4/d9/db/d39/d4b/d6c/fcd to d4/d9/d37/dbe/ffe 0 2024-02-07T12:25:37.709 INFO:tasks.workunit.client.1.smithi138.stdout:0/794: write d4/d69/f73 [992904,82868] 0 2024-02-07T12:25:37.709 INFO:tasks.workunit.client.1.smithi138.stdout:0/795: dread - d4/d9/de/d1d/d21/fd4 zero size 2024-02-07T12:25:37.709 INFO:tasks.workunit.client.1.smithi138.stdout:0/796: fsync d4/d9/de/d1d/d21/fd4 0 2024-02-07T12:25:37.709 INFO:tasks.workunit.client.1.smithi138.stdout:0/797: write d4/d9/d33/ff8 [493379,19762] 0 2024-02-07T12:25:37.710 INFO:tasks.workunit.client.1.smithi138.stdout:0/798: creat d4/d9/d37/d64/d9a/fff x:0 0 0 2024-02-07T12:25:37.710 INFO:tasks.workunit.client.1.smithi138.stdout:2/845: symlink d3/d4e/l129 0 2024-02-07T12:25:37.710 INFO:tasks.workunit.client.1.smithi138.stdout:2/846: fdatasync d3/d4e/f50 0 2024-02-07T12:25:37.711 INFO:tasks.workunit.client.1.smithi138.stdout:4/746: rename d20/d4d/fad to d20/d53/d71/d75/d94/ff4 0 2024-02-07T12:25:37.712 INFO:tasks.workunit.client.1.smithi138.stdout:6/828: rmdir dc/d31/d54/ddd 39 2024-02-07T12:25:37.712 INFO:tasks.workunit.client.1.smithi138.stdout:0/799: dread d4/f6 [0,4194304] 0 2024-02-07T12:25:37.713 INFO:tasks.workunit.client.1.smithi138.stdout:2/847: mkdir d3/dd/d14/d82/dcc/d12a 0 2024-02-07T12:25:37.713 INFO:tasks.workunit.client.1.smithi138.stdout:2/848: truncate d3/dd/d19/f42 1521927 0 2024-02-07T12:25:37.716 INFO:tasks.workunit.client.1.smithi138.stdout:6/829: creat dc/d13/d1e/dc7/f115 x:0 0 0 2024-02-07T12:25:37.717 INFO:tasks.workunit.client.1.smithi138.stdout:6/830: write dc/d13/d1e/d35/d85/f89 [291119,124176] 0 2024-02-07T12:25:37.717 INFO:tasks.workunit.client.1.smithi138.stdout:6/831: dread - dc/d13/d1e/d35/d7c/dbe/ff8 zero size 2024-02-07T12:25:37.722 INFO:tasks.workunit.client.1.smithi138.stdout:4/747: getdents d20/d34/d36 0 2024-02-07T12:25:37.732 INFO:tasks.workunit.client.1.smithi138.stdout:2/849: dwrite d3/d4e/d119/d7d/f91 [0,4194304] 0 2024-02-07T12:25:37.734 INFO:tasks.workunit.client.1.smithi138.stdout:4/748: getdents d20/d34/d36/d55 0 2024-02-07T12:25:37.734 INFO:tasks.workunit.client.1.smithi138.stdout:4/749: chown d20/d53/d71/d75/de8 921737 1 2024-02-07T12:25:37.734 INFO:tasks.workunit.client.1.smithi138.stdout:4/750: stat d20/d47/d69/lde 0 2024-02-07T12:25:37.756 INFO:tasks.workunit.client.1.smithi138.stdout:2/850: dwrite d3/dd/d19/d1f/d37/f7c [0,4194304] 0 2024-02-07T12:25:37.757 INFO:tasks.workunit.client.1.smithi138.stdout:4/751: dwrite d20/d34/d59/fb7 [0,4194304] 0 2024-02-07T12:25:37.759 INFO:tasks.workunit.client.1.smithi138.stdout:1/750: sync 2024-02-07T12:25:37.759 INFO:tasks.workunit.client.1.smithi138.stdout:5/732: sync 2024-02-07T12:25:37.759 INFO:tasks.workunit.client.1.smithi138.stdout:9/642: sync 2024-02-07T12:25:37.761 INFO:tasks.workunit.client.1.smithi138.stdout:4/752: write d20/d47/d69/d7c/db9/dba/fc1 [440479,1902] 0 2024-02-07T12:25:37.762 INFO:tasks.workunit.client.1.smithi138.stdout:9/643: symlink d0/d6/d8/d1d/dd/d41/d5e/da6/lbf 0 2024-02-07T12:25:37.766 INFO:tasks.workunit.client.1.smithi138.stdout:4/753: mkdir d20/d47/d69/d7c/db9/dba/df5 0 2024-02-07T12:25:37.767 INFO:tasks.workunit.client.1.smithi138.stdout:9/644: write d0/f33 [228764,15255] 0 2024-02-07T12:25:37.767 INFO:tasks.workunit.client.1.smithi138.stdout:9/645: stat d0/d6/d8/f52 0 2024-02-07T12:25:37.769 INFO:tasks.workunit.client.1.smithi138.stdout:4/754: rename d20/d34/d59/d88/d8d/lca to d20/lf6 0 2024-02-07T12:25:37.771 INFO:tasks.workunit.client.1.smithi138.stdout:9/646: link d0/d6/d8/f52 d0/d6/d8/d1d/dd/d41/d5e/da6/fc0 0 2024-02-07T12:25:37.772 INFO:tasks.workunit.client.1.smithi138.stdout:4/755: chown d20/d34/d36/d55/d74/d9a/lbc 29891 1 2024-02-07T12:25:37.774 INFO:tasks.workunit.client.1.smithi138.stdout:4/756: mknod d20/d34/d36/cf7 0 2024-02-07T12:25:37.774 INFO:tasks.workunit.client.1.smithi138.stdout:4/757: write d20/d34/d59/d72/d77/fd5 [5542857,93546] 0 2024-02-07T12:25:37.777 INFO:tasks.workunit.client.1.smithi138.stdout:4/758: rename d20/d47/d69/f6e to d20/d53/d71/d75/d94/ff8 0 2024-02-07T12:25:37.777 INFO:tasks.workunit.client.1.smithi138.stdout:2/851: dwrite d3/d4e/d119/d7d/f10c [0,4194304] 0 2024-02-07T12:25:37.777 INFO:tasks.workunit.client.1.smithi138.stdout:2/852: chown d3/d4e/d119/d7d/l95 388150374 1 2024-02-07T12:25:37.782 INFO:tasks.workunit.client.1.smithi138.stdout:5/733: dwrite da/d43/d4a/f9e [0,4194304] 0 2024-02-07T12:25:37.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:37 smithi138 ceph-mon[35528]: pgmap v5: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail 2024-02-07T12:25:37.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:37 smithi138 ceph-mon[35528]: mgrmap e24: smithi138.fiugmj(active, since 4s) 2024-02-07T12:25:37.785 INFO:tasks.workunit.client.1.smithi138.stdout:5/734: rename da/d6d/d27/d2e/c72 to da/d6d/d27/d2e/d4f/da3/cf4 0 2024-02-07T12:25:37.786 INFO:tasks.workunit.client.1.smithi138.stdout:2/853: read d3/dd/d19/d1f/d37/f7c [2313911,80385] 0 2024-02-07T12:25:37.786 INFO:tasks.workunit.client.1.smithi138.stdout:9/647: write d0/d6/d8/f73 [3801629,50196] 0 2024-02-07T12:25:37.787 INFO:tasks.workunit.client.1.smithi138.stdout:2/854: mknod d3/dd/d14/d49/d29/d5b/c12b 0 2024-02-07T12:25:37.788 INFO:tasks.workunit.client.1.smithi138.stdout:2/855: readlink d3/dd/d14/l60 0 2024-02-07T12:25:37.788 INFO:tasks.workunit.client.1.smithi138.stdout:2/856: stat d3/dd/d19/l8 0 2024-02-07T12:25:37.788 INFO:tasks.workunit.client.1.smithi138.stdout:2/857: chown d3/dd/d14/d8f/d73/f10d 1754 1 2024-02-07T12:25:37.790 INFO:tasks.workunit.client.1.smithi138.stdout:9/648: symlink d0/d6/d8/d1d/dd/d41/lc1 0 2024-02-07T12:25:37.791 INFO:tasks.workunit.client.1.smithi138.stdout:9/649: creat d0/d6/d8/d1d/da0/fc2 x:0 0 0 2024-02-07T12:25:37.791 INFO:tasks.workunit.client.1.smithi138.stdout:9/650: fsync d0/d6/d8/d1d/dd/d1f/f6a 0 2024-02-07T12:25:37.791 INFO:tasks.workunit.client.1.smithi138.stdout:9/651: getdents d0/d6/d8/d1d/dd/d1f/dbb 0 2024-02-07T12:25:37.793 INFO:tasks.workunit.client.1.smithi138.stdout:9/652: mkdir d0/d6/d8/d1d/dd/d1f/db7/db9/dc3 0 2024-02-07T12:25:37.793 INFO:tasks.workunit.client.1.smithi138.stdout:9/653: chown d0/d6/d8/f66 414353700 1 2024-02-07T12:25:37.795 INFO:tasks.workunit.client.1.smithi138.stdout:9/654: mkdir d0/d6/d8/d1d/dd/dc4 0 2024-02-07T12:25:37.796 INFO:tasks.workunit.client.1.smithi138.stdout:5/735: dread da/d34/f80 [0,4194304] 0 2024-02-07T12:25:37.796 INFO:tasks.workunit.client.1.smithi138.stdout:4/759: dwrite d20/d47/d69/d7c/db9/dba/fec [0,4194304] 0 2024-02-07T12:25:37.796 INFO:tasks.workunit.client.1.smithi138.stdout:4/760: creat d20/d4d/d87/ff9 x:0 0 0 2024-02-07T12:25:37.797 INFO:tasks.workunit.client.1.smithi138.stdout:9/655: mkdir d0/d6/d8/dc5 0 2024-02-07T12:25:37.799 INFO:tasks.workunit.client.1.smithi138.stdout:2/858: dread d3/dd/d14/d49/d25/d3d/f45 [0,4194304] 0 2024-02-07T12:25:37.799 INFO:tasks.workunit.client.1.smithi138.stdout:4/761: read d20/f32 [5264813,120863] 0 2024-02-07T12:25:37.799 INFO:tasks.workunit.client.1.smithi138.stdout:5/736: dread da/d6d/d27/d2e/f79 [0,4194304] 0 2024-02-07T12:25:37.800 INFO:tasks.workunit.client.1.smithi138.stdout:9/656: creat d0/d6/d8/d1d/fc6 x:0 0 0 2024-02-07T12:25:37.800 INFO:tasks.workunit.client.1.smithi138.stdout:2/859: mknod d3/dd/d14/d8f/dbc/c12c 0 2024-02-07T12:25:37.801 INFO:tasks.workunit.client.1.smithi138.stdout:2/860: creat d3/dd/d14/d8f/d73/f12d x:0 0 0 2024-02-07T12:25:37.802 INFO:tasks.workunit.client.1.smithi138.stdout:5/737: link da/d6d/d27/d2e/d4f/f30 da/d6d/d27/d2e/d4f/d2b/d35/d40/ff5 0 2024-02-07T12:25:37.802 INFO:tasks.workunit.client.1.smithi138.stdout:9/657: creat d0/d6/d8/dc5/fc7 x:0 0 0 2024-02-07T12:25:37.804 INFO:tasks.workunit.client.1.smithi138.stdout:2/861: mknod d3/dd/d14/c12e 0 2024-02-07T12:25:37.804 INFO:tasks.workunit.client.1.smithi138.stdout:5/738: symlink da/d22/d99/lf6 0 2024-02-07T12:25:37.808 INFO:tasks.workunit.client.1.smithi138.stdout:4/762: dread d20/d34/d36/f5f [0,4194304] 0 2024-02-07T12:25:37.808 INFO:tasks.workunit.client.1.smithi138.stdout:4/763: rename d20 to d20/d53/d71/d98/dfa 22 2024-02-07T12:25:37.809 INFO:tasks.workunit.client.1.smithi138.stdout:2/862: dread d3/dd/fdf [0,4194304] 0 2024-02-07T12:25:37.810 INFO:tasks.workunit.client.1.smithi138.stdout:4/764: creat d20/d34/d59/d72/d77/ffb x:0 0 0 2024-02-07T12:25:37.810 INFO:tasks.workunit.client.1.smithi138.stdout:9/658: dread d0/d6/d8/d1d/dd/d1f/f47 [0,4194304] 0 2024-02-07T12:25:37.812 INFO:tasks.workunit.client.1.smithi138.stdout:9/659: creat d0/d6/d8/d1d/dd/dc4/fc8 x:0 0 0 2024-02-07T12:25:37.815 INFO:tasks.workunit.client.1.smithi138.stdout:9/660: link d0/d6/d8/d1d/da0/fc2 d0/d6/d8/d1d/dd/d41/d5e/da6/fc9 0 2024-02-07T12:25:37.816 INFO:tasks.workunit.client.1.smithi138.stdout:5/739: write da/d6d/f4e [1541080,75925] 0 2024-02-07T12:25:37.816 INFO:tasks.workunit.client.1.smithi138.stdout:5/740: dread - da/d43/d4a/fbe zero size 2024-02-07T12:25:37.816 INFO:tasks.workunit.client.1.smithi138.stdout:5/741: write da/d6d/f20 [155374,49471] 0 2024-02-07T12:25:37.816 INFO:tasks.workunit.client.1.smithi138.stdout:5/742: write da/d6d/d27/d2e/d4f/d2b/f87 [1601163,83502] 0 2024-02-07T12:25:37.816 INFO:tasks.workunit.client.1.smithi138.stdout:5/743: readlink da/d6d/d27/d2e/d4f/d2b/d35/d40/lb6 0 2024-02-07T12:25:37.819 INFO:tasks.workunit.client.1.smithi138.stdout:2/863: write d3/d4e/f6e [3351465,29199] 0 2024-02-07T12:25:37.819 INFO:tasks.workunit.client.1.smithi138.stdout:2/864: write d3/dd/d14/d86/faf [289335,67858] 0 2024-02-07T12:25:37.819 INFO:tasks.workunit.client.1.smithi138.stdout:2/865: readlink d3/dd/d14/d8f/d73/la6 0 2024-02-07T12:25:37.819 INFO:tasks.workunit.client.1.smithi138.stdout:2/866: fdatasync d3/dd/d19/d1f/d46/d71/faa 0 2024-02-07T12:25:37.820 INFO:tasks.workunit.client.1.smithi138.stdout:5/744: rename da/d34/fe9 to da/d6d/d27/d2e/d4f/d2b/d35/d67/ff7 0 2024-02-07T12:25:37.824 INFO:tasks.workunit.client.1.smithi138.stdout:2/867: link d3/dd/d14/d8f/dbc/dbd/fd7 d3/d4e/d119/d7d/f12f 0 2024-02-07T12:25:37.824 INFO:tasks.workunit.client.1.smithi138.stdout:2/868: creat d3/dd/d14/d8f/d73/d80/df0/f130 x:0 0 0 2024-02-07T12:25:37.826 INFO:tasks.workunit.client.1.smithi138.stdout:5/745: dread da/f1f [0,4194304] 0 2024-02-07T12:25:37.826 INFO:tasks.workunit.client.1.smithi138.stdout:5/746: chown da/d6d/d27/d2e/d4f/d2b/d35/c46 0 1 2024-02-07T12:25:37.826 INFO:tasks.workunit.client.1.smithi138.stdout:5/747: chown da/d6d/d27/l47 53 1 2024-02-07T12:25:37.835 INFO:tasks.workunit.client.1.smithi138.stdout:9/661: dwrite d0/d34/f51 [0,4194304] 0 2024-02-07T12:25:37.836 INFO:tasks.workunit.client.1.smithi138.stdout:9/662: truncate d0/d6/d8/d1d/dd/d25/f2d 4919559 0 2024-02-07T12:25:37.836 INFO:tasks.workunit.client.1.smithi138.stdout:9/663: write d0/d6/f27 [1054653,110445] 0 2024-02-07T12:25:37.841 INFO:tasks.workunit.client.1.smithi138.stdout:3/896: sync 2024-02-07T12:25:37.842 INFO:tasks.workunit.client.1.smithi138.stdout:3/897: chown d5/d26/d28/f9e 49679175 1 2024-02-07T12:25:37.842 INFO:tasks.workunit.client.1.smithi138.stdout:3/898: dread - d5/d26/d28/f4a zero size 2024-02-07T12:25:37.842 INFO:tasks.workunit.client.1.smithi138.stdout:5/748: dread da/d6d/d27/d2e/d4f/d2b/d35/d5d/d73/fad [0,4194304] 0 2024-02-07T12:25:37.842 INFO:tasks.workunit.client.1.smithi138.stdout:5/749: read - da/d6d/fac zero size 2024-02-07T12:25:37.844 INFO:tasks.workunit.client.1.smithi138.stdout:2/869: dwrite d3/dd/dd2/f11c [0,4194304] 0 2024-02-07T12:25:37.847 INFO:tasks.workunit.client.1.smithi138.stdout:5/750: dread da/d43/d4a/d95/fb2 [0,4194304] 0 2024-02-07T12:25:37.848 INFO:tasks.workunit.client.1.smithi138.stdout:2/870: creat d3/dd/d19/d1f/d46/d71/d7e/f131 x:0 0 0 2024-02-07T12:25:37.849 INFO:tasks.workunit.client.1.smithi138.stdout:2/871: mknod d3/dd/d19/d1f/c132 0 2024-02-07T12:25:37.851 INFO:tasks.workunit.client.1.smithi138.stdout:2/872: unlink d3/dd/d14/d49/d25/d3d/d5f/f116 0 2024-02-07T12:25:37.854 INFO:tasks.workunit.client.1.smithi138.stdout:2/873: symlink d3/dd/d14/d49/l133 0 2024-02-07T12:25:37.854 INFO:tasks.workunit.client.1.smithi138.stdout:2/874: creat d3/dd/d14/d8f/d73/d80/f134 x:0 0 0 2024-02-07T12:25:37.854 INFO:tasks.workunit.client.1.smithi138.stdout:2/875: fdatasync d3/dd/d19/f124 0 2024-02-07T12:25:37.854 INFO:tasks.workunit.client.1.smithi138.stdout:2/876: creat d3/dd/d14/d8f/dbc/f135 x:0 0 0 2024-02-07T12:25:37.858 INFO:tasks.workunit.client.1.smithi138.stdout:9/664: dwrite d0/d6/d8/d1d/dd/f63 [0,4194304] 0 2024-02-07T12:25:37.859 INFO:tasks.workunit.client.1.smithi138.stdout:3/899: dwrite d5/d34/d79/f7a [0,4194304] 0 2024-02-07T12:25:37.860 INFO:tasks.workunit.client.1.smithi138.stdout:2/877: truncate d3/d4e/f6e 1960712 0 2024-02-07T12:25:37.862 INFO:tasks.workunit.client.1.smithi138.stdout:9/665: mknod d0/d6/d8/d1d/dd/d25/cca 0 2024-02-07T12:25:37.862 INFO:tasks.workunit.client.1.smithi138.stdout:9/666: chown d0/d6/d8/d1d/dd/f9c 3 1 2024-02-07T12:25:37.862 INFO:tasks.workunit.client.1.smithi138.stdout:9/667: stat d0/d6/d8/d1d/dd/dc4/fc8 0 2024-02-07T12:25:37.862 INFO:tasks.workunit.client.1.smithi138.stdout:9/668: getdents d0/d6/d8/dbc 0 2024-02-07T12:25:37.865 INFO:tasks.workunit.client.1.smithi138.stdout:9/669: truncate d0/d6/f27 3292813 0 2024-02-07T12:25:37.865 INFO:tasks.workunit.client.1.smithi138.stdout:9/670: truncate d0/d34/d45/f88 662247 0 2024-02-07T12:25:37.865 INFO:tasks.workunit.client.1.smithi138.stdout:9/671: write d0/d6/d8/fad [3503297,54282] 0 2024-02-07T12:25:37.865 INFO:tasks.workunit.client.1.smithi138.stdout:9/672: creat d0/d6/d8/d1d/dd/d25/fcb x:0 0 0 2024-02-07T12:25:37.867 INFO:tasks.workunit.client.1.smithi138.stdout:9/673: mkdir d0/d6/da3/dcc 0 2024-02-07T12:25:37.867 INFO:tasks.workunit.client.1.smithi138.stdout:9/674: dread - d0/d6/d8/d1d/fc6 zero size 2024-02-07T12:25:37.868 INFO:tasks.workunit.client.1.smithi138.stdout:9/675: read d0/d6/d8/d1d/f61 [2712129,54483] 0 2024-02-07T12:25:37.868 INFO:tasks.workunit.client.1.smithi138.stdout:9/676: creat d0/d6/d8/d1d/dd/d41/d5e/d74/fcd x:0 0 0 2024-02-07T12:25:37.868 INFO:tasks.workunit.client.1.smithi138.stdout:9/677: chown d0/d6/d8/d1d/dd/c57 3 1 2024-02-07T12:25:37.868 INFO:tasks.workunit.client.1.smithi138.stdout:3/900: dread d5/d26/d90/fba [0,4194304] 0 2024-02-07T12:25:37.871 INFO:tasks.workunit.client.1.smithi138.stdout:9/678: mkdir d0/d6/da3/dce 0 2024-02-07T12:25:37.871 INFO:tasks.workunit.client.1.smithi138.stdout:9/679: write d0/d6/d8/d1d/dd/d1f/f6a [3166156,52848] 0 2024-02-07T12:25:37.871 INFO:tasks.workunit.client.1.smithi138.stdout:9/680: fsync d0/d6/f3c 0 2024-02-07T12:25:37.871 INFO:tasks.workunit.client.1.smithi138.stdout:9/681: chown d0/d6/d8/d1d/f1c 3016409 1 2024-02-07T12:25:37.871 INFO:tasks.workunit.client.1.smithi138.stdout:9/682: chown d0/d6/d8/d1d/dd/d1f/db7 777508646 1 2024-02-07T12:25:37.871 INFO:tasks.workunit.client.1.smithi138.stdout:9/683: truncate d0/d6/d8/d1d/fc6 450197 0 2024-02-07T12:25:37.871 INFO:tasks.workunit.client.1.smithi138.stdout:3/901: creat d5/d26/d5e/d77/de3/f135 x:0 0 0 2024-02-07T12:25:37.871 INFO:tasks.workunit.client.1.smithi138.stdout:3/902: write d5/d27/f49 [2744074,25965] 0 2024-02-07T12:25:37.872 INFO:tasks.workunit.client.1.smithi138.stdout:9/684: mknod d0/d6/da3/dcc/ccf 0 2024-02-07T12:25:37.873 INFO:tasks.workunit.client.1.smithi138.stdout:3/903: dread d5/d27/f88 [0,4194304] 0 2024-02-07T12:25:37.873 INFO:tasks.workunit.client.1.smithi138.stdout:3/904: chown d5/d27/c2a 29 1 2024-02-07T12:25:37.873 INFO:tasks.workunit.client.1.smithi138.stdout:9/685: write d0/d34/d45/f69 [2399391,8531] 0 2024-02-07T12:25:37.873 INFO:tasks.workunit.client.1.smithi138.stdout:9/686: truncate d0/d34/f51 4833127 0 2024-02-07T12:25:37.875 INFO:tasks.workunit.client.1.smithi138.stdout:3/905: symlink d5/d26/d9b/dab/dc4/dd0/d131/l136 0 2024-02-07T12:25:37.875 INFO:tasks.workunit.client.1.smithi138.stdout:3/906: chown d5/d26/d28 290 1 2024-02-07T12:25:37.875 INFO:tasks.workunit.client.1.smithi138.stdout:3/907: creat d5/d26/d9b/dab/dc4/f137 x:0 0 0 2024-02-07T12:25:37.877 INFO:tasks.workunit.client.1.smithi138.stdout:9/687: rename d0/d6/c48 to d0/d6/d8/d1d/dd/d1f/db7/db9/dc3/cd0 0 2024-02-07T12:25:37.877 INFO:tasks.workunit.client.1.smithi138.stdout:9/688: chown d0/d6/l7d 40927 1 2024-02-07T12:25:37.877 INFO:tasks.workunit.client.1.smithi138.stdout:9/689: stat d0/d6/da3/dcc 0 2024-02-07T12:25:37.878 INFO:tasks.workunit.client.1.smithi138.stdout:3/908: mknod d5/d26/d9b/dab/dc4/dd0/dd1/c138 0 2024-02-07T12:25:37.887 INFO:tasks.workunit.client.1.smithi138.stdout:9/690: mkdir d0/d6/da3/dcc/dd1 0 2024-02-07T12:25:37.889 INFO:tasks.workunit.client.1.smithi138.stdout:3/909: unlink d5/d26/d5e/d86/ded/d32/da1/l114 0 2024-02-07T12:25:37.893 INFO:tasks.workunit.client.1.smithi138.stdout:9/691: read d0/d6/d8/d1d/dd/f31 [569502,87804] 0 2024-02-07T12:25:37.893 INFO:tasks.workunit.client.1.smithi138.stdout:9/692: write d0/d6/d8/fad [706205,98014] 0 2024-02-07T12:25:37.896 INFO:tasks.workunit.client.1.smithi138.stdout:3/910: write d5/d27/d35/f66 [6035907,13507] 0 2024-02-07T12:25:37.900 INFO:tasks.workunit.client.1.smithi138.stdout:9/693: symlink d0/d6/d8/d1d/dd/d1f/dbb/ld2 0 2024-02-07T12:25:37.903 INFO:tasks.workunit.client.1.smithi138.stdout:3/911: creat d5/d26/d9b/dab/dc4/dd0/dd1/f139 x:0 0 0 2024-02-07T12:25:37.903 INFO:tasks.workunit.client.1.smithi138.stdout:9/694: stat d0/lb6 0 2024-02-07T12:25:37.903 INFO:tasks.workunit.client.1.smithi138.stdout:3/912: dread d5/d27/dde/f11e [0,4194304] 0 2024-02-07T12:25:37.907 INFO:tasks.workunit.client.1.smithi138.stdout:3/913: truncate d5/d34/d79/f89 2200194 0 2024-02-07T12:25:37.909 INFO:tasks.workunit.client.1.smithi138.stdout:9/695: getdents d0/d6/d8/d1d/dd/d41 0 2024-02-07T12:25:37.910 INFO:tasks.workunit.client.1.smithi138.stdout:3/914: link d5/d26/d28/c62 d5/d26/d5e/c13a 0 2024-02-07T12:25:37.910 INFO:tasks.workunit.client.1.smithi138.stdout:3/915: dread - d5/d26/d5e/d77/de3/f135 zero size 2024-02-07T12:25:37.910 INFO:tasks.workunit.client.1.smithi138.stdout:3/916: write d5/d26/d5e/d86/d9c/d10d/f125 [90355,80236] 0 2024-02-07T12:25:37.911 INFO:tasks.workunit.client.1.smithi138.stdout:3/917: stat d5/cec 0 2024-02-07T12:25:37.911 INFO:tasks.workunit.client.1.smithi138.stdout:9/696: stat d0/d34/l72 0 2024-02-07T12:25:37.913 INFO:tasks.workunit.client.1.smithi138.stdout:3/918: rename d5/d26/d5e/d86/dae/fb1 to d5/d26/d5e/d86/ded/d96/f13b 0 2024-02-07T12:25:37.913 INFO:tasks.workunit.client.1.smithi138.stdout:3/919: read - d5/d26/d5e/d86/ded/d32/da1/fd9 zero size 2024-02-07T12:25:37.916 INFO:tasks.workunit.client.1.smithi138.stdout:8/886: sync 2024-02-07T12:25:37.916 INFO:tasks.workunit.client.1.smithi138.stdout:7/959: sync 2024-02-07T12:25:37.917 INFO:tasks.workunit.client.1.smithi138.stdout:7/960: creat d0/d8/d15/d12d/f13a x:0 0 0 2024-02-07T12:25:37.919 INFO:tasks.workunit.client.1.smithi138.stdout:8/887: symlink d1/de/db4/db8/d17/d3e/dce/l113 0 2024-02-07T12:25:37.922 INFO:tasks.workunit.client.1.smithi138.stdout:7/961: mkdir d0/d8/d15/d12d/d13b 0 2024-02-07T12:25:37.923 INFO:tasks.workunit.client.1.smithi138.stdout:9/697: dwrite d0/d6/d8/d1d/dd/d41/d5e/d74/fa4 [0,4194304] 0 2024-02-07T12:25:37.924 INFO:tasks.workunit.client.1.smithi138.stdout:9/698: chown d0/d6/d8/d1d/dd/c58 125369 1 2024-02-07T12:25:37.924 INFO:tasks.workunit.client.1.smithi138.stdout:9/699: stat d0/d34/d45/d78/la9 0 2024-02-07T12:25:37.924 INFO:tasks.workunit.client.1.smithi138.stdout:8/888: creat d1/de/db4/db8/d17/d58/f114 x:0 0 0 2024-02-07T12:25:37.931 INFO:tasks.workunit.client.1.smithi138.stdout:9/700: creat d0/d6/da3/dcc/dd1/fd3 x:0 0 0 2024-02-07T12:25:37.936 INFO:tasks.workunit.client.1.smithi138.stdout:8/889: unlink d1/de/db4/db8/d17/d3e/dce/f4b 0 2024-02-07T12:25:37.936 INFO:tasks.workunit.client.1.smithi138.stdout:7/962: mknod d0/d8/d11/d26/d90/c13c 0 2024-02-07T12:25:37.936 INFO:tasks.workunit.client.1.smithi138.stdout:7/963: stat d0/d8/c99 0 2024-02-07T12:25:37.937 INFO:tasks.workunit.client.1.smithi138.stdout:9/701: truncate d0/d6/d8/fad 878142 0 2024-02-07T12:25:37.937 INFO:tasks.workunit.client.1.smithi138.stdout:9/702: chown d0/d6/c7c 6877000 1 2024-02-07T12:25:37.937 INFO:tasks.workunit.client.1.smithi138.stdout:7/964: dread d0/d8/d11/d26/d90/f37 [0,4194304] 0 2024-02-07T12:25:37.937 INFO:tasks.workunit.client.1.smithi138.stdout:7/965: write d0/d8/d11/d26/d90/f115 [914583,82377] 0 2024-02-07T12:25:37.937 INFO:tasks.workunit.client.1.smithi138.stdout:7/966: chown d0/d6/d84/d10e 2253796 1 2024-02-07T12:25:37.938 INFO:tasks.workunit.client.1.smithi138.stdout:9/703: link d0/lb5 d0/d6/d8/d1d/dd/d41/ld4 0 2024-02-07T12:25:37.938 INFO:tasks.workunit.client.1.smithi138.stdout:9/704: getdents d0/d34 0 2024-02-07T12:25:37.941 INFO:tasks.workunit.client.1.smithi138.stdout:9/705: rmdir d0/d6/d8/d1d/dd/d41/d5e/d74 39 2024-02-07T12:25:37.941 INFO:tasks.workunit.client.1.smithi138.stdout:9/706: creat d0/d6/da3/dcc/dd1/fd5 x:0 0 0 2024-02-07T12:25:37.941 INFO:tasks.workunit.client.1.smithi138.stdout:9/707: stat d0/d6/d8/d1d/dd/d41/d5e/d74/fcd 0 2024-02-07T12:25:37.943 INFO:tasks.workunit.client.1.smithi138.stdout:9/708: write d0/d6/d8/f8e [3127577,30704] 0 2024-02-07T12:25:37.945 INFO:tasks.workunit.client.1.smithi138.stdout:9/709: symlink d0/ld6 0 2024-02-07T12:25:37.947 INFO:tasks.workunit.client.1.smithi138.stdout:9/710: mkdir d0/d6/d8/d1d/dd/d1f/db7/dd7 0 2024-02-07T12:25:37.949 INFO:tasks.workunit.client.1.smithi138.stdout:9/711: mkdir d0/d34/d45/d78/dd8 0 2024-02-07T12:25:37.952 INFO:tasks.workunit.client.1.smithi138.stdout:9/712: creat d0/d6/d8/d1d/dd/d41/d5e/da6/fd9 x:0 0 0 2024-02-07T12:25:37.952 INFO:tasks.workunit.client.1.smithi138.stdout:9/713: readlink d0/d6/d8/d1d/dd/d1f/l8c 0 2024-02-07T12:25:37.955 INFO:tasks.workunit.client.1.smithi138.stdout:9/714: creat d0/d6/da3/dcc/fda x:0 0 0 2024-02-07T12:25:37.957 INFO:tasks.workunit.client.1.smithi138.stdout:8/890: dwrite d1/de/db4/db8/d17/f8c [0,4194304] 0 2024-02-07T12:25:37.957 INFO:tasks.workunit.client.1.smithi138.stdout:8/891: fdatasync d1/d99/f6a 0 2024-02-07T12:25:37.957 INFO:tasks.workunit.client.1.smithi138.stdout:8/892: write d1/de/db4/db8/d17/d3e/d72/dda/f8 [983886,95459] 0 2024-02-07T12:25:37.957 INFO:tasks.workunit.client.1.smithi138.stdout:9/715: rename d0/d6/l7d to d0/d6/d8/d95/ldb 0 2024-02-07T12:25:37.958 INFO:tasks.workunit.client.1.smithi138.stdout:7/967: dwrite d0/d6/d3e/fd1 [0,4194304] 0 2024-02-07T12:25:37.964 INFO:tasks.workunit.client.1.smithi138.stdout:8/893: rmdir d1/de/db4/db8/d17/d8a/dd7 39 2024-02-07T12:25:37.967 INFO:tasks.workunit.client.1.smithi138.stdout:9/716: creat d0/d34/fdc x:0 0 0 2024-02-07T12:25:37.972 INFO:tasks.workunit.client.1.smithi138.stdout:0/800: sync 2024-02-07T12:25:37.973 INFO:tasks.workunit.client.1.smithi138.stdout:1/751: sync 2024-02-07T12:25:37.973 INFO:tasks.workunit.client.1.smithi138.stdout:1/752: truncate d5/d4b/d6b/d6e/d79/ffc 278262 0 2024-02-07T12:25:37.973 INFO:tasks.workunit.client.1.smithi138.stdout:6/832: sync 2024-02-07T12:25:37.973 INFO:tasks.workunit.client.1.smithi138.stdout:0/801: creat d4/d9/d37/d64/d9a/db0/f100 x:0 0 0 2024-02-07T12:25:37.974 INFO:tasks.workunit.client.1.smithi138.stdout:9/717: unlink d0/d6/d8/d1d/dd/d41/d5e/da6/fc0 0 2024-02-07T12:25:37.977 INFO:tasks.workunit.client.1.smithi138.stdout:1/753: link d5/d4b/d72/cbd d5/d4b/d91/cff 0 2024-02-07T12:25:37.979 INFO:tasks.workunit.client.1.smithi138.stdout:0/802: symlink d4/d9/db/d39/d4b/d6c/dc5/dd5/l101 0 2024-02-07T12:25:37.979 INFO:tasks.workunit.client.1.smithi138.stdout:0/803: fsync d4/d9/de/d1d/f41 0 2024-02-07T12:25:37.985 INFO:tasks.workunit.client.1.smithi138.stdout:7/968: dwrite d0/d8/d11/d26/d90/faf [4194304,4194304] 0 2024-02-07T12:25:37.988 INFO:tasks.workunit.client.1.smithi138.stdout:1/754: read d5/d8/da/f29 [1408424,22868] 0 2024-02-07T12:25:37.998 INFO:tasks.workunit.client.1.smithi138.stdout:1/755: link d5/d8/da/d1f/d5e/db5/d68/d73/d7b/f2c d5/d8/da/d1f/d5e/db5/d58/d76/f100 0 2024-02-07T12:25:38.005 INFO:tasks.workunit.client.1.smithi138.stdout:7/969: dread d0/d39/d8a/fbc [0,4194304] 0 2024-02-07T12:25:38.005 INFO:tasks.workunit.client.1.smithi138.stdout:6/833: dwrite dc/d13/f87 [0,4194304] 0 2024-02-07T12:25:38.007 INFO:tasks.workunit.client.1.smithi138.stdout:7/970: creat d0/d8/d11/d26/d90/f13d x:0 0 0 2024-02-07T12:25:38.009 INFO:tasks.workunit.client.1.smithi138.stdout:6/834: getdents dc/d13/d1e/d35/d7c 0 2024-02-07T12:25:38.009 INFO:tasks.workunit.client.1.smithi138.stdout:6/835: chown dc/d31/d54/f5c 352 1 2024-02-07T12:25:38.009 INFO:tasks.workunit.client.1.smithi138.stdout:6/836: write dc/d13/d1e/d35/fb0 [1525501,14625] 0 2024-02-07T12:25:38.013 INFO:tasks.workunit.client.1.smithi138.stdout:6/837: creat dc/d13/d1e/d35/d7c/f116 x:0 0 0 2024-02-07T12:25:38.015 INFO:tasks.workunit.client.1.smithi138.stdout:6/838: creat dc/d31/d54/ddd/f117 x:0 0 0 2024-02-07T12:25:38.016 INFO:tasks.workunit.client.1.smithi138.stdout:6/839: mknod dc/d13/d1e/d35/d6d/da6/d10a/daa/d106/c118 0 2024-02-07T12:25:38.020 INFO:tasks.workunit.client.1.smithi138.stdout:8/894: dwrite d1/de/db4/db8/f18 [0,4194304] 0 2024-02-07T12:25:38.020 INFO:tasks.workunit.client.1.smithi138.stdout:8/895: fdatasync d1/f6f 0 2024-02-07T12:25:38.020 INFO:tasks.workunit.client.1.smithi138.stdout:8/896: write d1/de/db4/db8/d17/d3e/d72/dda/f56 [3083277,52174] 0 2024-02-07T12:25:38.024 INFO:tasks.workunit.client.1.smithi138.stdout:8/897: rename d1/de/db4/db8/d17/d3e/cc3 to d1/c115 0 2024-02-07T12:25:38.025 INFO:tasks.workunit.client.1.smithi138.stdout:1/756: dwrite d5/d4b/d91/f9f [4194304,4194304] 0 2024-02-07T12:25:38.026 INFO:tasks.workunit.client.1.smithi138.stdout:6/840: dread dc/d73/d9b/fa5 [0,4194304] 0 2024-02-07T12:25:38.026 INFO:tasks.workunit.client.1.smithi138.stdout:6/841: fsync dc/d31/d54/fb6 0 2024-02-07T12:25:38.026 INFO:tasks.workunit.client.1.smithi138.stdout:6/842: write dc/d13/d1e/d35/d6d/fa8 [109337,41982] 0 2024-02-07T12:25:38.027 INFO:tasks.workunit.client.1.smithi138.stdout:0/804: dwrite d4/d9/d37/f3a [0,4194304] 0 2024-02-07T12:25:38.029 INFO:tasks.workunit.client.1.smithi138.stdout:6/843: rename dc/d13/d1e/c23 to dc/d31/d54/dee/c119 0 2024-02-07T12:25:38.034 INFO:tasks.workunit.client.1.smithi138.stdout:2/878: sync 2024-02-07T12:25:38.034 INFO:tasks.workunit.client.1.smithi138.stdout:5/751: sync 2024-02-07T12:25:38.034 INFO:tasks.workunit.client.1.smithi138.stdout:4/765: sync 2024-02-07T12:25:38.034 INFO:tasks.workunit.client.1.smithi138.stdout:8/898: dread d1/f6f [0,4194304] 0 2024-02-07T12:25:38.034 INFO:tasks.workunit.client.1.smithi138.stdout:2/879: creat d3/dd/d14/d49/d25/f136 x:0 0 0 2024-02-07T12:25:38.036 INFO:tasks.workunit.client.1.smithi138.stdout:1/757: dread d5/f2a [0,4194304] 0 2024-02-07T12:25:38.037 INFO:tasks.workunit.client.1.smithi138.stdout:7/971: dwrite d0/d8/d11/d26/d90/f4f [0,4194304] 0 2024-02-07T12:25:38.038 INFO:tasks.workunit.client.1.smithi138.stdout:2/880: write d3/dd/d19/f35 [4408438,129319] 0 2024-02-07T12:25:38.038 INFO:tasks.workunit.client.1.smithi138.stdout:2/881: read - d3/dd/d14/d8f/d73/d80/f134 zero size 2024-02-07T12:25:38.038 INFO:tasks.workunit.client.1.smithi138.stdout:7/972: dread d0/d6/d73/fc7 [0,4194304] 0 2024-02-07T12:25:38.038 INFO:tasks.workunit.client.1.smithi138.stdout:7/973: stat d0/d8/d11/f79 0 2024-02-07T12:25:38.039 INFO:tasks.workunit.client.1.smithi138.stdout:0/805: creat d4/d9/db/d71/dfb/f102 x:0 0 0 2024-02-07T12:25:38.039 INFO:tasks.workunit.client.1.smithi138.stdout:0/806: dread - d4/d9/db/d71/fdf zero size 2024-02-07T12:25:38.039 INFO:tasks.workunit.client.1.smithi138.stdout:0/807: chown d4/d9/de/l1e 163218110 1 2024-02-07T12:25:38.040 INFO:tasks.workunit.client.1.smithi138.stdout:6/844: mkdir dc/d13/d11a 0 2024-02-07T12:25:38.041 INFO:tasks.workunit.client.1.smithi138.stdout:5/752: mknod da/d6d/d27/d2e/d4f/d2b/d35/d67/cf8 0 2024-02-07T12:25:38.046 INFO:tasks.workunit.client.1.smithi138.stdout:1/758: write d5/d8/dbc/deb/fba [1169214,22074] 0 2024-02-07T12:25:38.046 INFO:tasks.workunit.client.1.smithi138.stdout:1/759: stat d5/d5c/da5 0 2024-02-07T12:25:38.047 INFO:tasks.workunit.client.1.smithi138.stdout:4/766: rename d20/d53/f60 to d20/d47/d69/d7c/db9/dba/ffc 0 2024-02-07T12:25:38.049 INFO:tasks.workunit.client.1.smithi138.stdout:8/899: mkdir d1/d8e/d116 0 2024-02-07T12:25:38.049 INFO:tasks.workunit.client.1.smithi138.stdout:8/900: chown d1/de/db4/db8/d17/d58/la9 368 1 2024-02-07T12:25:38.049 INFO:tasks.workunit.client.1.smithi138.stdout:8/901: chown d1/ddc 0 1 2024-02-07T12:25:38.053 INFO:tasks.workunit.client.1.smithi138.stdout:4/767: dread d20/d47/d69/d7c/db9/dba/fc1 [0,4194304] 0 2024-02-07T12:25:38.053 INFO:tasks.workunit.client.1.smithi138.stdout:2/882: symlink d3/dd/d14/d49/d25/l137 0 2024-02-07T12:25:38.053 INFO:tasks.workunit.client.1.smithi138.stdout:2/883: chown d3/dd/d19/d1f/d46/d71/d7e 7727759 1 2024-02-07T12:25:38.053 INFO:tasks.workunit.client.1.smithi138.stdout:2/884: readlink d3/dd/d14/d8f/dbc/df6/lf3 0 2024-02-07T12:25:38.054 INFO:tasks.workunit.client.1.smithi138.stdout:2/885: dread - d3/dd/d14/d49/d29/d5b/f9e zero size 2024-02-07T12:25:38.054 INFO:tasks.workunit.client.1.smithi138.stdout:2/886: write d3/dd/d19/d1f/d46/d71/faa [811255,113876] 0 2024-02-07T12:25:38.054 INFO:tasks.workunit.client.1.smithi138.stdout:4/768: dread d20/d47/d69/fc4 [0,4194304] 0 2024-02-07T12:25:38.055 INFO:tasks.workunit.client.1.smithi138.stdout:7/974: mkdir d0/d39/d8a/d13e 0 2024-02-07T12:25:38.059 INFO:tasks.workunit.client.1.smithi138.stdout:6/845: readlink dc/d13/d1e/d35/d7c/dbe/lf6 0 2024-02-07T12:25:38.065 INFO:tasks.workunit.client.1.smithi138.stdout:3/920: sync 2024-02-07T12:25:38.065 INFO:tasks.workunit.client.1.smithi138.stdout:3/921: write d5/d26/d9b/dab/dc4/dd0/dd1/f139 [589756,64033] 0 2024-02-07T12:25:38.065 INFO:tasks.workunit.client.1.smithi138.stdout:1/760: symlink d5/d4b/d65/de2/l101 0 2024-02-07T12:25:38.065 INFO:tasks.workunit.client.1.smithi138.stdout:1/761: write f4 [2777263,28891] 0 2024-02-07T12:25:38.065 INFO:tasks.workunit.client.1.smithi138.stdout:1/762: write d5/d8/da/d20/dc2/fce [100511,51183] 0 2024-02-07T12:25:38.067 INFO:tasks.workunit.client.1.smithi138.stdout:8/902: creat d1/d8e/d116/f117 x:0 0 0 2024-02-07T12:25:38.068 INFO:tasks.workunit.client.1.smithi138.stdout:2/887: truncate d3/dd/d14/fb0 2675042 0 2024-02-07T12:25:38.068 INFO:tasks.workunit.client.1.smithi138.stdout:2/888: chown d3/dd/d19/d1f/f5c 4378 1 2024-02-07T12:25:38.071 INFO:tasks.workunit.client.1.smithi138.stdout:4/769: creat d20/d34/d59/d88/ffd x:0 0 0 2024-02-07T12:25:38.075 INFO:tasks.workunit.client.1.smithi138.stdout:7/975: creat d0/d8/d11/d26/d90/d98/da6/f13f x:0 0 0 2024-02-07T12:25:38.075 INFO:tasks.workunit.client.1.smithi138.stdout:0/808: getdents d4/d9/db/d39 0 2024-02-07T12:25:38.075 INFO:tasks.workunit.client.1.smithi138.stdout:0/809: creat d4/d9/d37/d64/d9a/db0/f103 x:0 0 0 2024-02-07T12:25:38.076 INFO:tasks.workunit.client.1.smithi138.stdout:9/718: sync 2024-02-07T12:25:38.077 INFO:tasks.workunit.client.1.smithi138.stdout:6/846: mkdir dc/d13/d1e/d11b 0 2024-02-07T12:25:38.080 INFO:tasks.workunit.client.1.smithi138.stdout:9/719: dread d0/d6/d8/d1d/dd/d41/f79 [0,4194304] 0 2024-02-07T12:25:38.088 INFO:tasks.workunit.client.1.smithi138.stdout:3/922: dwrite d5/d26/d9b/ff0 [0,4194304] 0 2024-02-07T12:25:38.088 INFO:tasks.workunit.client.1.smithi138.stdout:3/923: chown d5/d26/d28/fee 2 1 2024-02-07T12:25:38.089 INFO:tasks.workunit.client.1.smithi138.stdout:5/753: rmdir da/d6d 39 2024-02-07T12:25:38.093 INFO:tasks.workunit.client.1.smithi138.stdout:8/903: creat d1/de/db4/db8/d17/d3e/d89/de2/f118 x:0 0 0 2024-02-07T12:25:38.095 INFO:tasks.workunit.client.1.smithi138.stdout:4/770: truncate d20/d53/d71/d75/d94/ff8 1125020 0 2024-02-07T12:25:38.101 INFO:tasks.workunit.client.1.smithi138.stdout:1/763: dwrite d5/d8/dd0/fd4 [0,4194304] 0 2024-02-07T12:25:38.105 INFO:tasks.workunit.client.1.smithi138.stdout:9/720: truncate d0/d6/f27 2661657 0 2024-02-07T12:25:38.109 INFO:tasks.workunit.client.1.smithi138.stdout:9/721: dread d0/d6/d8/d1d/f61 [0,4194304] 0 2024-02-07T12:25:38.111 INFO:tasks.workunit.client.1.smithi138.stdout:3/924: dwrite d5/d27/f3d [0,4194304] 0 2024-02-07T12:25:38.112 INFO:tasks.workunit.client.1.smithi138.stdout:8/904: mkdir d1/de/db4/db8/d17/d3e/d72/dda/d4c/d119 0 2024-02-07T12:25:38.112 INFO:tasks.workunit.client.1.smithi138.stdout:8/905: write d1/db3/df0/d106/f78 [1790877,44384] 0 2024-02-07T12:25:38.112 INFO:tasks.workunit.client.1.smithi138.stdout:1/764: write d5/f1a [4579127,41490] 0 2024-02-07T12:25:38.114 INFO:tasks.workunit.client.1.smithi138.stdout:4/771: unlink d20/d34/d59/d72/d77/fd5 0 2024-02-07T12:25:38.114 INFO:tasks.workunit.client.1.smithi138.stdout:5/754: dwrite da/f1f [0,4194304] 0 2024-02-07T12:25:38.116 INFO:tasks.workunit.client.1.smithi138.stdout:7/976: mknod d0/d8/d11/d26/d90/c140 0 2024-02-07T12:25:38.117 INFO:tasks.workunit.client.1.smithi138.stdout:0/810: rmdir d4/d52 39 2024-02-07T12:25:38.123 INFO:tasks.workunit.client.1.smithi138.stdout:9/722: mkdir d0/d34/d86/ddd 0 2024-02-07T12:25:38.125 INFO:tasks.workunit.client.1.smithi138.stdout:3/925: symlink d5/d26/d28/db7/d11c/l13c 0 2024-02-07T12:25:38.125 INFO:tasks.workunit.client.1.smithi138.stdout:3/926: dread - d5/d26/d28/f8b zero size 2024-02-07T12:25:38.127 INFO:tasks.workunit.client.1.smithi138.stdout:4/772: write f1a [2878357,77316] 0 2024-02-07T12:25:38.127 INFO:tasks.workunit.client.1.smithi138.stdout:9/723: dread d0/d6/d8/d1d/dd/d41/d5e/f75 [0,4194304] 0 2024-02-07T12:25:38.130 INFO:tasks.workunit.client.1.smithi138.stdout:1/765: dwrite d5/d8/da/d20/f90 [0,4194304] 0 2024-02-07T12:25:38.133 INFO:tasks.workunit.client.1.smithi138.stdout:7/977: link d0/d8/d11/d1f/c107 d0/d6/d84/d10e/c141 0 2024-02-07T12:25:38.135 INFO:tasks.workunit.client.1.smithi138.stdout:0/811: truncate d4/d9/d37/d6b/f8b 2566022 0 2024-02-07T12:25:38.137 INFO:tasks.workunit.client.1.smithi138.stdout:0/812: write d4/d9/f8e [550535,22035] 0 2024-02-07T12:25:38.137 INFO:tasks.workunit.client.1.smithi138.stdout:6/847: rename dc/d13/d1e/d35/dc0 to dc/d13/d1e/d11c 0 2024-02-07T12:25:38.140 INFO:tasks.workunit.client.1.smithi138.stdout:1/766: write d5/d4b/f5d [1484138,20633] 0 2024-02-07T12:25:38.140 INFO:tasks.workunit.client.1.smithi138.stdout:5/755: mknod da/d6d/d27/d2e/d4f/cf9 0 2024-02-07T12:25:38.141 INFO:tasks.workunit.client.1.smithi138.stdout:7/978: mknod d0/d6/d19/d4e/c142 0 2024-02-07T12:25:38.143 INFO:tasks.workunit.client.1.smithi138.stdout:0/813: truncate d4/d9/db/d39/d4b/d6c/d8f/fc4 2059854 0 2024-02-07T12:25:38.144 INFO:tasks.workunit.client.1.smithi138.stdout:4/773: getdents d20/d34/d59/d88 0 2024-02-07T12:25:38.146 INFO:tasks.workunit.client.1.smithi138.stdout:5/756: mknod da/d6d/d27/d2e/cfa 0 2024-02-07T12:25:38.146 INFO:tasks.workunit.client.1.smithi138.stdout:5/757: readlink da/d6d/d27/d2e/d4f/d2b/d35/d40/l53 0 2024-02-07T12:25:38.146 INFO:tasks.workunit.client.1.smithi138.stdout:1/767: mknod d5/d5c/c102 0 2024-02-07T12:25:38.146 INFO:tasks.workunit.client.1.smithi138.stdout:8/906: dwrite d1/db3/df0/d106/f78 [0,4194304] 0 2024-02-07T12:25:38.147 INFO:tasks.workunit.client.1.smithi138.stdout:5/758: dread da/d6d/d27/d2e/f79 [0,4194304] 0 2024-02-07T12:25:38.148 INFO:tasks.workunit.client.1.smithi138.stdout:0/814: write d4/f67 [1192734,31414] 0 2024-02-07T12:25:38.151 INFO:tasks.workunit.client.1.smithi138.stdout:7/979: write d0/d8/d15/f18 [2819402,52262] 0 2024-02-07T12:25:38.151 INFO:tasks.workunit.client.1.smithi138.stdout:1/768: creat d5/d8/da/d1f/d5e/db8/f103 x:0 0 0 2024-02-07T12:25:38.151 INFO:tasks.workunit.client.1.smithi138.stdout:5/759: dread da/d43/d4a/d95/fb2 [0,4194304] 0 2024-02-07T12:25:38.153 INFO:tasks.workunit.client.1.smithi138.stdout:6/848: dwrite dc/d13/f19 [4194304,4194304] 0 2024-02-07T12:25:38.154 INFO:tasks.workunit.client.1.smithi138.stdout:4/774: dread d20/d34/d36/d55/f5b [0,4194304] 0 2024-02-07T12:25:38.154 INFO:tasks.workunit.client.1.smithi138.stdout:4/775: fsync d20/d34/d59/d88/fd4 0 2024-02-07T12:25:38.154 INFO:tasks.workunit.client.1.smithi138.stdout:4/776: chown d20/d34/d59/fb7 89 1 2024-02-07T12:25:38.154 INFO:tasks.workunit.client.1.smithi138.stdout:4/777: getdents d20/d34/d36/d55 0 2024-02-07T12:25:38.154 INFO:tasks.workunit.client.1.smithi138.stdout:4/778: write d20/d34/d59/d72/d77/ffb [574002,40988] 0 2024-02-07T12:25:38.154 INFO:tasks.workunit.client.1.smithi138.stdout:8/907: mknod d1/de/db4/db8/d17/d3e/d72/dda/d4c/c11a 0 2024-02-07T12:25:38.163 INFO:tasks.workunit.client.1.smithi138.stdout:0/815: mkdir d4/d9/d37/d64/d9a/d104 0 2024-02-07T12:25:38.164 INFO:tasks.workunit.client.1.smithi138.stdout:0/816: fdatasync d4/d9/de/d1d/d21/f4e 0 2024-02-07T12:25:38.164 INFO:tasks.workunit.client.1.smithi138.stdout:0/817: read d4/d9/de/fc7 [3469798,18700] 0 2024-02-07T12:25:38.164 INFO:tasks.workunit.client.1.smithi138.stdout:0/818: fdatasync d4/d69/fbd 0 2024-02-07T12:25:38.164 INFO:tasks.workunit.client.1.smithi138.stdout:0/819: chown d4/d9/db/d39/d4b/c96 46652 1 2024-02-07T12:25:38.165 INFO:tasks.workunit.client.1.smithi138.stdout:0/820: chown d4/d69/d85/d8a/f9f 103 1 2024-02-07T12:25:38.165 INFO:tasks.workunit.client.1.smithi138.stdout:7/980: rename d0/d8/d11/d26/d90/l34 to d0/d6/d84/d10e/l143 0 2024-02-07T12:25:38.165 INFO:tasks.workunit.client.1.smithi138.stdout:7/981: stat d0/d8/d15/db1/fc9 0 2024-02-07T12:25:38.165 INFO:tasks.workunit.client.1.smithi138.stdout:4/779: dread d20/d53/d71/d75/d94/ff8 [0,4194304] 0 2024-02-07T12:25:38.171 INFO:tasks.workunit.client.1.smithi138.stdout:1/769: rename d5/d4b/d6b/d6e/lc6 to d5/d8/da/d1f/d5e/db5/l104 0 2024-02-07T12:25:38.172 INFO:tasks.workunit.client.1.smithi138.stdout:7/982: symlink d0/d6/d84/d10e/l144 0 2024-02-07T12:25:38.172 INFO:tasks.workunit.client.1.smithi138.stdout:7/983: chown d0/d8/d11/d26/d90/d98/da6 19606 1 2024-02-07T12:25:38.174 INFO:tasks.workunit.client.1.smithi138.stdout:6/849: rmdir dc/d73/dc4 39 2024-02-07T12:25:38.176 INFO:tasks.workunit.client.1.smithi138.stdout:4/780: mkdir d20/d47/d69/d7c/dfe 0 2024-02-07T12:25:38.177 INFO:tasks.workunit.client.1.smithi138.stdout:1/770: dread d5/d4b/f5d [0,4194304] 0 2024-02-07T12:25:38.177 INFO:tasks.workunit.client.1.smithi138.stdout:1/771: read - d5/d8/da/d20/fae zero size 2024-02-07T12:25:38.178 INFO:tasks.workunit.client.1.smithi138.stdout:5/760: rename da/d6d/d27/c3d to da/d22/d99/dca/dd5/de2/cfb 0 2024-02-07T12:25:38.179 INFO:tasks.workunit.client.1.smithi138.stdout:4/781: symlink d20/d53/d71/d75/d94/lff 0 2024-02-07T12:25:38.181 INFO:tasks.workunit.client.1.smithi138.stdout:1/772: creat d5/d8/da/d1f/d5e/db5/d68/d73/d7b/dda/f105 x:0 0 0 2024-02-07T12:25:38.181 INFO:tasks.workunit.client.1.smithi138.stdout:1/773: stat d5/d43 0 2024-02-07T12:25:38.182 INFO:tasks.workunit.client.1.smithi138.stdout:7/984: rename d0/d8/d15/fc0 to d0/d6/deb/f145 0 2024-02-07T12:25:38.183 INFO:tasks.workunit.client.1.smithi138.stdout:6/850: write dc/d31/fbb [1332016,19600] 0 2024-02-07T12:25:38.184 INFO:tasks.workunit.client.1.smithi138.stdout:5/761: mknod da/d6d/d27/d2e/d4f/da3/cfc 0 2024-02-07T12:25:38.186 INFO:tasks.workunit.client.1.smithi138.stdout:4/782: creat d20/d34/f100 x:0 0 0 2024-02-07T12:25:38.186 INFO:tasks.workunit.client.1.smithi138.stdout:4/783: truncate d20/d34/d36/d55/f6d 1653622 0 2024-02-07T12:25:38.186 INFO:tasks.workunit.client.1.smithi138.stdout:4/784: stat d20/d34/d59/d72 0 2024-02-07T12:25:38.186 INFO:tasks.workunit.client.1.smithi138.stdout:4/785: fdatasync f1c 0 2024-02-07T12:25:38.186 INFO:tasks.workunit.client.1.smithi138.stdout:4/786: chown d20/d47/d69/def 711 1 2024-02-07T12:25:38.186 INFO:tasks.workunit.client.1.smithi138.stdout:4/787: chown d20/l2b 87810 1 2024-02-07T12:25:38.186 INFO:tasks.workunit.client.1.smithi138.stdout:4/788: chown d20/d4d 0 1 2024-02-07T12:25:38.186 INFO:tasks.workunit.client.1.smithi138.stdout:4/789: dread - d20/d34/d36/d55/f58 zero size 2024-02-07T12:25:38.187 INFO:tasks.workunit.client.1.smithi138.stdout:5/762: creat da/d6d/d27/d2e/d4f/ffd x:0 0 0 2024-02-07T12:25:38.187 INFO:tasks.workunit.client.1.smithi138.stdout:5/763: chown da/d43/d4a/d98 277171 1 2024-02-07T12:25:38.187 INFO:tasks.workunit.client.1.smithi138.stdout:7/985: dread d0/d6/d3e/f51 [0,4194304] 0 2024-02-07T12:25:38.187 INFO:tasks.workunit.client.1.smithi138.stdout:7/986: chown d0/d8/d11/d5f/df8/l11f 628483904 1 2024-02-07T12:25:38.188 INFO:tasks.workunit.client.1.smithi138.stdout:5/764: rename da/d6d/d27/d2e/d4f/d2b/d35/d67/dd1/ldc to da/d22/d99/dca/lfe 0 2024-02-07T12:25:38.189 INFO:tasks.workunit.client.1.smithi138.stdout:7/987: mknod d0/d6/d3e/c146 0 2024-02-07T12:25:38.189 INFO:tasks.workunit.client.1.smithi138.stdout:7/988: truncate d0/d6/d19/d4e/f91 970809 0 2024-02-07T12:25:38.189 INFO:tasks.workunit.client.1.smithi138.stdout:7/989: chown d0/d6/d84/d10e/l143 0 1 2024-02-07T12:25:38.190 INFO:tasks.workunit.client.1.smithi138.stdout:7/990: write d0/d6/d3e/f51 [2328396,7063] 0 2024-02-07T12:25:38.190 INFO:tasks.workunit.client.1.smithi138.stdout:1/774: dread d5/dfd/fca [0,4194304] 0 2024-02-07T12:25:38.190 INFO:tasks.workunit.client.1.smithi138.stdout:1/775: creat d5/d8/da/d1f/d5e/f106 x:0 0 0 2024-02-07T12:25:38.191 INFO:tasks.workunit.client.1.smithi138.stdout:5/765: dread da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/f7f [0,4194304] 0 2024-02-07T12:25:38.191 INFO:tasks.workunit.client.1.smithi138.stdout:5/766: fdatasync da/d6d/d27/d2e/d4f/ffd 0 2024-02-07T12:25:38.191 INFO:tasks.workunit.client.1.smithi138.stdout:5/767: stat da/d6d/d27/d2e/d4f/d2b/d35/d40/ff5 0 2024-02-07T12:25:38.191 INFO:tasks.workunit.client.1.smithi138.stdout:5/768: stat da/d43/d4a/d69 0 2024-02-07T12:25:38.192 INFO:tasks.workunit.client.1.smithi138.stdout:5/769: chown da/d6d/d27/d2e/d4f/d2b/d35/d5d/d73/lcc 0 1 2024-02-07T12:25:38.192 INFO:tasks.workunit.client.1.smithi138.stdout:5/770: stat da/d43/d4a/f9e 0 2024-02-07T12:25:38.192 INFO:tasks.workunit.client.1.smithi138.stdout:7/991: rename d0/d8/d11/d5f/c10b to d0/d39/dfd/c147 0 2024-02-07T12:25:38.193 INFO:tasks.workunit.client.1.smithi138.stdout:4/790: dread d20/f54 [0,4194304] 0 2024-02-07T12:25:38.193 INFO:tasks.workunit.client.1.smithi138.stdout:4/791: chown d20/d34/d59/d88/ffd 10 1 2024-02-07T12:25:38.193 INFO:tasks.workunit.client.1.smithi138.stdout:6/851: dread dc/d31/d54/ddd/df4/f2c [0,4194304] 0 2024-02-07T12:25:38.193 INFO:tasks.workunit.client.1.smithi138.stdout:6/852: dread - dc/d13/d1e/d35/d7c/dbe/f100 zero size 2024-02-07T12:25:38.194 INFO:tasks.workunit.client.1.smithi138.stdout:1/776: symlink d5/d8/da/d1f/d5e/db5/d68/da7/l107 0 2024-02-07T12:25:38.197 INFO:tasks.workunit.client.1.smithi138.stdout:5/771: mkdir da/d6d/d27/d2e/d4f/d2b/d35/d67/dd1/dff 0 2024-02-07T12:25:38.197 INFO:tasks.workunit.client.1.smithi138.stdout:5/772: dread - da/d50/fe0 zero size 2024-02-07T12:25:38.198 INFO:tasks.workunit.client.1.smithi138.stdout:6/853: unlink dc/d13/d1e/d11c/fd1 0 2024-02-07T12:25:38.200 INFO:tasks.workunit.client.1.smithi138.stdout:1/777: mkdir d5/d8/da/d1f/d60/df4/d59/d108 0 2024-02-07T12:25:38.203 INFO:tasks.workunit.client.1.smithi138.stdout:5/773: creat da/d6d/d27/d2e/d4f/d2b/d35/d5d/f100 x:0 0 0 2024-02-07T12:25:38.206 INFO:tasks.workunit.client.1.smithi138.stdout:1/778: dread d5/f86 [0,4194304] 0 2024-02-07T12:25:38.210 INFO:tasks.workunit.client.1.smithi138.stdout:5/774: write da/d43/d4a/d69/fa6 [12527498,89884] 0 2024-02-07T12:25:38.224 INFO:tasks.workunit.client.1.smithi138.stdout:6/854: write dc/d31/d38/fc3 [4328527,90924] 0 2024-02-07T12:25:38.224 INFO:tasks.workunit.client.1.smithi138.stdout:6/855: chown dc/d13/d1e/d11b 576932 1 2024-02-07T12:25:38.241 INFO:tasks.workunit.client.1.smithi138.stdout:5/775: dwrite da/d6d/fac [0,4194304] 0 2024-02-07T12:25:38.241 INFO:tasks.workunit.client.1.smithi138.stdout:5/776: stat da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d96/lc5 0 2024-02-07T12:25:38.248 INFO:tasks.workunit.client.1.smithi138.stdout:1/779: dwrite d5/d8/da/d1f/d5e/d63/f64 [0,4194304] 0 2024-02-07T12:25:38.248 INFO:tasks.workunit.client.1.smithi138.stdout:1/780: stat d5/f86 0 2024-02-07T12:25:38.248 INFO:tasks.workunit.client.1.smithi138.stdout:1/781: write d5/d8/da/d1f/d60/df4/fdb [46063,54489] 0 2024-02-07T12:25:38.248 INFO:tasks.workunit.client.1.smithi138.stdout:1/782: truncate d5/d4b/d6b/d6e/d79/ffc 755388 0 2024-02-07T12:25:38.248 INFO:tasks.workunit.client.1.smithi138.stdout:1/783: write d5/d8/da/d1f/d5e/d63/f81 [744798,23269] 0 2024-02-07T12:25:38.248 INFO:tasks.workunit.client.1.smithi138.stdout:1/784: fsync d5/d4b/d6b/d6e/d79/ffc 0 2024-02-07T12:25:38.258 INFO:tasks.workunit.client.1.smithi138.stdout:6/856: dwrite dc/d31/d54/f5c [4194304,4194304] 0 2024-02-07T12:25:38.258 INFO:tasks.workunit.client.1.smithi138.stdout:6/857: write dc/d13/d1e/f2b [550152,82256] 0 2024-02-07T12:25:38.258 INFO:tasks.workunit.client.1.smithi138.stdout:6/858: truncate dc/d13/d1e/dae/f10f 856476 0 2024-02-07T12:25:38.277 INFO:tasks.workunit.client.1.smithi138.stdout:1/785: dwrite d5/d8/da/d1f/d5e/fdf [0,4194304] 0 2024-02-07T12:25:38.277 INFO:tasks.workunit.client.1.smithi138.stdout:1/786: chown d5/d4b/d72/l7e 0 1 2024-02-07T12:25:38.277 INFO:tasks.workunit.client.1.smithi138.stdout:1/787: readlink d5/d8/da/d1f/l52 0 2024-02-07T12:25:38.277 INFO:tasks.workunit.client.1.smithi138.stdout:1/788: creat d5/d4b/d6b/d6e/f109 x:0 0 0 2024-02-07T12:25:38.277 INFO:tasks.workunit.client.1.smithi138.stdout:1/789: fsync d5/d8/da/fe 0 2024-02-07T12:25:38.277 INFO:tasks.workunit.client.1.smithi138.stdout:5/777: dwrite da/d34/dbd/fc3 [0,4194304] 0 2024-02-07T12:25:38.278 INFO:tasks.workunit.client.1.smithi138.stdout:5/778: fsync da/d6d/d27/d2e/d4f/d2b/d35/d40/ff5 0 2024-02-07T12:25:38.278 INFO:tasks.workunit.client.1.smithi138.stdout:1/790: dread d5/d8/da/d1f/d60/df4/fdb [0,4194304] 0 2024-02-07T12:25:38.278 INFO:tasks.workunit.client.1.smithi138.stdout:1/791: write d5/d4b/d6b/d6e/d79/fb1 [4465912,115505] 0 2024-02-07T12:25:38.279 INFO:tasks.workunit.client.1.smithi138.stdout:1/792: chown d5/d8/da/d4a/fb0 14 1 2024-02-07T12:25:38.281 INFO:tasks.workunit.client.1.smithi138.stdout:5/779: symlink da/d22/d99/dca/dd5/l101 0 2024-02-07T12:25:38.287 INFO:tasks.workunit.client.1.smithi138.stdout:1/793: rename d5/d4b/d91/f9a to d5/d8/da/d1f/d5e/db8/f10a 0 2024-02-07T12:25:38.288 INFO:tasks.workunit.client.1.smithi138.stdout:5/780: mknod da/d6d/d27/d2e/d4f/d2b/d35/d67/dd1/c102 0 2024-02-07T12:25:38.290 INFO:tasks.workunit.client.1.smithi138.stdout:5/781: link da/d6d/d27/d2e/d4f/c3a da/d6d/d27/d2e/d4f/d2b/d35/dae/c103 0 2024-02-07T12:25:38.290 INFO:tasks.workunit.client.1.smithi138.stdout:5/782: fsync da/d43/d4a/d95/fb2 0 2024-02-07T12:25:38.293 INFO:tasks.workunit.client.1.smithi138.stdout:5/783: unlink da/d34/l39 0 2024-02-07T12:25:38.294 INFO:tasks.workunit.client.1.smithi138.stdout:5/784: mknod da/d43/d4a/d98/c104 0 2024-02-07T12:25:38.296 INFO:tasks.workunit.client.1.smithi138.stdout:5/785: creat da/d22/d99/dca/f105 x:0 0 0 2024-02-07T12:25:38.296 INFO:tasks.workunit.client.1.smithi138.stdout:5/786: truncate da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/fbf 69399 0 2024-02-07T12:25:38.296 INFO:tasks.workunit.client.1.smithi138.stdout:5/787: readlink da/d6d/d27/d2e/d4f/d2b/d35/d5d/d73/lcc 0 2024-02-07T12:25:38.301 INFO:tasks.workunit.client.1.smithi138.stdout:1/794: dwrite d5/d8/da/d1f/d5e/d63/f57 [0,4194304] 0 2024-02-07T12:25:38.301 INFO:tasks.workunit.client.1.smithi138.stdout:1/795: chown d5/d8/da/d1f/d5e/db5/d68/d73/d7b/cc7 105212277 1 2024-02-07T12:25:38.304 INFO:tasks.workunit.client.1.smithi138.stdout:1/796: symlink d5/d4b/d72/l10b 0 2024-02-07T12:25:38.304 INFO:tasks.workunit.client.1.smithi138.stdout:1/797: write d5/d8/da/d1f/d60/df4/fef [687822,75589] 0 2024-02-07T12:25:38.306 INFO:tasks.workunit.client.1.smithi138.stdout:5/788: dread da/d43/d4a/f9d [0,4194304] 0 2024-02-07T12:25:38.308 INFO:tasks.workunit.client.1.smithi138.stdout:5/789: rename da/d6d/f6b to da/d22/d99/dca/dd5/de2/f106 0 2024-02-07T12:25:38.309 INFO:tasks.workunit.client.1.smithi138.stdout:5/790: rename da/d43/d4a/cba to da/d43/d4a/c107 0 2024-02-07T12:25:38.323 INFO:tasks.workunit.client.1.smithi138.stdout:2/889: sync 2024-02-07T12:25:38.324 INFO:tasks.workunit.client.1.smithi138.stdout:9/724: sync 2024-02-07T12:25:38.324 INFO:tasks.workunit.client.1.smithi138.stdout:3/927: sync 2024-02-07T12:25:38.324 INFO:tasks.workunit.client.1.smithi138.stdout:3/928: chown d5/d27/f49 393 1 2024-02-07T12:25:38.326 INFO:tasks.workunit.client.1.smithi138.stdout:5/791: dwrite da/d6d/f7c [0,4194304] 0 2024-02-07T12:25:38.327 INFO:tasks.workunit.client.1.smithi138.stdout:1/798: dwrite d5/d8/dd0/fd4 [0,4194304] 0 2024-02-07T12:25:38.327 INFO:tasks.workunit.client.1.smithi138.stdout:9/725: link d0/d6/d8/f2a d0/d34/d45/d78/dd8/fde 0 2024-02-07T12:25:38.328 INFO:tasks.workunit.client.1.smithi138.stdout:2/890: getdents d3/dd/d14/d82 0 2024-02-07T12:25:38.328 INFO:tasks.workunit.client.1.smithi138.stdout:2/891: dread - d3/d4e/d119/d7d/d97/fb6 zero size 2024-02-07T12:25:38.328 INFO:tasks.workunit.client.1.smithi138.stdout:2/892: creat d3/dd/d14/d8f/d73/d80/df0/f138 x:0 0 0 2024-02-07T12:25:38.328 INFO:tasks.workunit.client.1.smithi138.stdout:3/929: dread d5/d26/d4e/f8c [0,4194304] 0 2024-02-07T12:25:38.328 INFO:tasks.workunit.client.1.smithi138.stdout:3/930: write d5/d27/f6b [822647,51569] 0 2024-02-07T12:25:38.328 INFO:tasks.workunit.client.1.smithi138.stdout:3/931: write d5/f8d [1162849,884] 0 2024-02-07T12:25:38.329 INFO:tasks.workunit.client.1.smithi138.stdout:3/932: chown d5/d27/dde 3770 1 2024-02-07T12:25:38.336 INFO:tasks.workunit.client.1.smithi138.stdout:1/799: creat d5/d8/f10c x:0 0 0 2024-02-07T12:25:38.336 INFO:tasks.workunit.client.1.smithi138.stdout:5/792: write da/d6d/d27/d2e/d4f/d2b/d35/d67/df0/ff2 [2553587,61547] 0 2024-02-07T12:25:38.337 INFO:tasks.workunit.client.1.smithi138.stdout:9/726: mknod d0/d6/d8/d1d/dd/d1f/db7/db9/cdf 0 2024-02-07T12:25:38.337 INFO:tasks.workunit.client.1.smithi138.stdout:9/727: dread - d0/fab zero size 2024-02-07T12:25:38.340 INFO:tasks.workunit.client.1.smithi138.stdout:2/893: link d3/d4e/d119/de8/f118 d3/dd/d14/d49/d25/df4/f139 0 2024-02-07T12:25:38.343 INFO:tasks.workunit.client.1.smithi138.stdout:3/933: rename d5/f104 to d5/d27/d35/f13d 0 2024-02-07T12:25:38.345 INFO:tasks.workunit.client.1.smithi138.stdout:1/800: dread f3 [0,4194304] 0 2024-02-07T12:25:38.347 INFO:tasks.workunit.client.1.smithi138.stdout:5/793: creat da/d6d/d27/f108 x:0 0 0 2024-02-07T12:25:38.352 INFO:tasks.workunit.client.1.smithi138.stdout:1/801: getdents d5/d4b 0 2024-02-07T12:25:38.353 INFO:tasks.workunit.client.1.smithi138.stdout:5/794: mknod da/d43/d4a/d69/c109 0 2024-02-07T12:25:38.353 INFO:tasks.workunit.client.1.smithi138.stdout:5/795: truncate da/d6d/d27/d2e/d4f/d2b/d35/d40/f9f 4741809 0 2024-02-07T12:25:38.353 INFO:tasks.workunit.client.1.smithi138.stdout:5/796: chown da/d6d/d27/d2e/d4f/d2b/d35/d40/cc6 729 1 2024-02-07T12:25:38.355 INFO:tasks.workunit.client.1.smithi138.stdout:9/728: dwrite d0/d6/f3c [4194304,4194304] 0 2024-02-07T12:25:38.356 INFO:tasks.workunit.client.1.smithi138.stdout:9/729: readlink d0/lb5 0 2024-02-07T12:25:38.356 INFO:tasks.workunit.client.1.smithi138.stdout:9/730: write d0/d6/d8/d1d/dd/d1f/faa [1026779,106552] 0 2024-02-07T12:25:38.359 INFO:tasks.workunit.client.1.smithi138.stdout:2/894: dwrite d3/dd/d14/d49/d25/f136 [0,4194304] 0 2024-02-07T12:25:38.359 INFO:tasks.workunit.client.1.smithi138.stdout:2/895: write d3/dd/d14/d8f/d73/f12d [1007925,91206] 0 2024-02-07T12:25:38.359 INFO:tasks.workunit.client.1.smithi138.stdout:2/896: creat d3/d4e/f13a x:0 0 0 2024-02-07T12:25:38.359 INFO:tasks.workunit.client.1.smithi138.stdout:2/897: write d3/dd/d14/d82/dcc/f128 [334849,21562] 0 2024-02-07T12:25:38.359 INFO:tasks.workunit.client.1.smithi138.stdout:2/898: readlink d3/d4e/d119/de8/lf7 0 2024-02-07T12:25:38.359 INFO:tasks.workunit.client.1.smithi138.stdout:9/731: mknod d0/d34/d45/d78/ce0 0 2024-02-07T12:25:38.364 INFO:tasks.workunit.client.1.smithi138.stdout:2/899: creat d3/dd/d19/d1f/d46/f13b x:0 0 0 2024-02-07T12:25:38.365 INFO:tasks.workunit.client.1.smithi138.stdout:9/732: symlink d0/d6/d8/d1d/dd/d25/le1 0 2024-02-07T12:25:38.365 INFO:tasks.workunit.client.1.smithi138.stdout:9/733: write d0/d6/d8/fad [727215,103347] 0 2024-02-07T12:25:38.365 INFO:tasks.workunit.client.1.smithi138.stdout:9/734: truncate d0/d6/da3/dcc/fda 1042598 0 2024-02-07T12:25:38.366 INFO:tasks.workunit.client.1.smithi138.stdout:2/900: mkdir d3/dd/d19/d1f/d46/d71/d7e/d13c 0 2024-02-07T12:25:38.366 INFO:tasks.workunit.client.1.smithi138.stdout:2/901: write d3/dd/d14/d49/d25/f127 [923550,19247] 0 2024-02-07T12:25:38.376 INFO:tasks.workunit.client.1.smithi138.stdout:9/735: fdatasync d0/d6/d8/d1d/f61 0 2024-02-07T12:25:38.376 INFO:tasks.workunit.client.1.smithi138.stdout:9/736: read - d0/d34/fdc zero size 2024-02-07T12:25:38.376 INFO:tasks.workunit.client.1.smithi138.stdout:5/797: dwrite da/d43/d4a/d69/f7a [4194304,4194304] 0 2024-02-07T12:25:38.376 INFO:tasks.workunit.client.1.smithi138.stdout:5/798: write da/d43/d4a/fbe [671187,82362] 0 2024-02-07T12:25:38.379 INFO:tasks.workunit.client.1.smithi138.stdout:2/902: dread d3/dd/d19/d1f/fa2 [0,4194304] 0 2024-02-07T12:25:38.380 INFO:tasks.workunit.client.1.smithi138.stdout:1/802: dwrite d5/d8/da/d1f/d5e/db5/d58/d76/f100 [0,4194304] 0 2024-02-07T12:25:38.383 INFO:tasks.workunit.client.1.smithi138.stdout:9/737: rename d0/d6/d8/d1d/dd/d1f/c81 to d0/d6/d8/d1d/dd/d1f/db7/db9/dc3/ce2 0 2024-02-07T12:25:38.383 INFO:tasks.workunit.client.1.smithi138.stdout:9/738: rename d0/d34 to d0/d34/d86/ddd/de3 22 2024-02-07T12:25:38.383 INFO:tasks.workunit.client.1.smithi138.stdout:9/739: chown d0/d34/d86 6 1 2024-02-07T12:25:38.383 INFO:tasks.workunit.client.1.smithi138.stdout:9/740: dread - d0/d6/d8/d1d/dd/d41/d5e/d74/fcd zero size 2024-02-07T12:25:38.383 INFO:tasks.workunit.client.1.smithi138.stdout:9/741: creat d0/d34/d86/fe4 x:0 0 0 2024-02-07T12:25:38.385 INFO:tasks.workunit.client.1.smithi138.stdout:5/799: mkdir da/d6d/d27/d2e/d4f/d2b/d35/d67/dd1/dff/d10a 0 2024-02-07T12:25:38.386 INFO:tasks.workunit.client.1.smithi138.stdout:2/903: dread f0 [0,4194304] 0 2024-02-07T12:25:38.399 INFO:tasks.workunit.client.1.smithi138.stdout:1/803: dwrite f4 [0,4194304] 0 2024-02-07T12:25:38.400 INFO:tasks.workunit.client.1.smithi138.stdout:1/804: readlink d5/d8/da/d1f/d5e/db5/d68/d73/laf 0 2024-02-07T12:25:38.400 INFO:tasks.workunit.client.1.smithi138.stdout:2/904: getdents d3/d4e/d119/d7d 0 2024-02-07T12:25:38.404 INFO:tasks.workunit.client.1.smithi138.stdout:8/908: sync 2024-02-07T12:25:38.404 INFO:tasks.workunit.client.1.smithi138.stdout:7/992: sync 2024-02-07T12:25:38.404 INFO:tasks.workunit.client.1.smithi138.stdout:0/821: sync 2024-02-07T12:25:38.404 INFO:tasks.workunit.client.1.smithi138.stdout:8/909: read - d1/de/ffc zero size 2024-02-07T12:25:38.407 INFO:tasks.workunit.client.1.smithi138.stdout:0/822: link d4/d69/f87 d4/d69/f105 0 2024-02-07T12:25:38.410 INFO:tasks.workunit.client.1.smithi138.stdout:8/910: rename d1/db3/df0/d106/fa4 to d1/de/db4/db8/d17/d3e/dce/f11b 0 2024-02-07T12:25:38.412 INFO:tasks.workunit.client.1.smithi138.stdout:0/823: getdents d4/d9/db/d71 0 2024-02-07T12:25:38.412 INFO:tasks.workunit.client.1.smithi138.stdout:0/824: creat d4/d9/de/d1d/d21/f106 x:0 0 0 2024-02-07T12:25:38.416 INFO:tasks.workunit.client.1.smithi138.stdout:0/825: unlink d4/d9/d37/d3d/d9c/dad/cf4 0 2024-02-07T12:25:38.416 INFO:tasks.workunit.client.1.smithi138.stdout:0/826: dread - d4/d9/d37/d64/d9a/db0/f100 zero size 2024-02-07T12:25:38.416 INFO:tasks.workunit.client.1.smithi138.stdout:0/827: write d4/d9/d37/d64/d9a/db0/fe3 [258730,108560] 0 2024-02-07T12:25:38.417 INFO:tasks.workunit.client.1.smithi138.stdout:0/828: rename d4/d9/db/d39/d4b/c96 to d4/d9/d75/c107 0 2024-02-07T12:25:38.417 INFO:tasks.workunit.client.1.smithi138.stdout:0/829: creat d4/d9/de/f108 x:0 0 0 2024-02-07T12:25:38.420 INFO:tasks.workunit.client.1.smithi138.stdout:8/911: dread d1/de/db4/db8/d17/d3e/dce/f11b [0,4194304] 0 2024-02-07T12:25:38.431 INFO:tasks.workunit.client.1.smithi138.stdout:0/830: dread d4/d9/d37/d6b/d7f/f82 [0,4194304] 0 2024-02-07T12:25:38.432 INFO:tasks.workunit.client.1.smithi138.stdout:0/831: creat d4/d9/db/d39/d4b/d6c/d8f/f109 x:0 0 0 2024-02-07T12:25:38.435 INFO:tasks.workunit.client.1.smithi138.stdout:9/742: dwrite d0/d6/d8/d1d/f61 [0,4194304] 0 2024-02-07T12:25:38.435 INFO:tasks.workunit.client.1.smithi138.stdout:1/805: dwrite f3 [8388608,4194304] 0 2024-02-07T12:25:38.435 INFO:tasks.workunit.client.1.smithi138.stdout:1/806: chown d5/d4b/d6b 63 1 2024-02-07T12:25:38.438 INFO:tasks.workunit.client.1.smithi138.stdout:9/743: truncate d0/d34/d45/f69 3069019 0 2024-02-07T12:25:38.438 INFO:tasks.workunit.client.1.smithi138.stdout:2/905: dwrite d3/dd/d14/d82/fff [0,4194304] 0 2024-02-07T12:25:38.438 INFO:tasks.workunit.client.1.smithi138.stdout:2/906: readlink d3/dd/d19/d1f/d46/d71/le6 0 2024-02-07T12:25:38.438 INFO:tasks.workunit.client.1.smithi138.stdout:2/907: dread - d3/dd/d14/d49/d25/df4/f139 zero size 2024-02-07T12:25:38.438 INFO:tasks.workunit.client.1.smithi138.stdout:5/800: dwrite da/d22/f26 [0,4194304] 0 2024-02-07T12:25:38.441 INFO:tasks.workunit.client.1.smithi138.stdout:2/908: dread d3/d4e/f88 [0,4194304] 0 2024-02-07T12:25:38.441 INFO:tasks.workunit.client.1.smithi138.stdout:0/832: write d4/d9/d37/d6b/d7f/f82 [3321886,28039] 0 2024-02-07T12:25:38.443 INFO:tasks.workunit.client.1.smithi138.stdout:5/801: creat da/d22/d99/dca/dd5/de2/f10b x:0 0 0 2024-02-07T12:25:38.443 INFO:tasks.workunit.client.1.smithi138.stdout:5/802: truncate da/d43/d4a/f74 72953 0 2024-02-07T12:25:38.443 INFO:tasks.workunit.client.1.smithi138.stdout:2/909: symlink d3/dd/d19/d1f/dc9/l13d 0 2024-02-07T12:25:38.445 INFO:tasks.workunit.client.1.smithi138.stdout:8/912: dwrite d1/de/db4/db8/d17/d3e/dce/fa7 [0,4194304] 0 2024-02-07T12:25:38.446 INFO:tasks.workunit.client.1.smithi138.stdout:8/913: readlink d1/l4f 0 2024-02-07T12:25:38.447 INFO:tasks.workunit.client.1.smithi138.stdout:2/910: rename d3/dd/d14/d8f/dbc/lca to d3/dd/d14/d8f/dbc/df6/l13e 0 2024-02-07T12:25:38.447 INFO:tasks.workunit.client.1.smithi138.stdout:2/911: write d3/d4e/d119/d7d/d97/fe9 [450805,49806] 0 2024-02-07T12:25:38.447 INFO:tasks.workunit.client.1.smithi138.stdout:2/912: fdatasync d3/d4e/d119/de8/f118 0 2024-02-07T12:25:38.449 INFO:tasks.workunit.client.1.smithi138.stdout:8/914: creat d1/db3/df0/f11c x:0 0 0 2024-02-07T12:25:38.449 INFO:tasks.workunit.client.1.smithi138.stdout:8/915: readlink d1/db3/df0/d106/d3a/la2 0 2024-02-07T12:25:38.452 INFO:tasks.workunit.client.1.smithi138.stdout:2/913: rename d3/d4e/d119/de8/f118 to d3/dd/d14/d8f/dbc/dbd/f13f 0 2024-02-07T12:25:38.455 INFO:tasks.workunit.client.1.smithi138.stdout:2/914: rename d3/dd/d14/d49/d29/ld9 to d3/dd/d14/d49/dc2/l140 0 2024-02-07T12:25:38.458 INFO:tasks.workunit.client.1.smithi138.stdout:2/915: mkdir d3/dd/d14/d86/d141 0 2024-02-07T12:25:38.461 INFO:tasks.workunit.client.1.smithi138.stdout:5/803: write da/d43/d4a/d69/f6f [3261931,70474] 0 2024-02-07T12:25:38.462 INFO:tasks.workunit.client.1.smithi138.stdout:5/804: fdatasync da/d43/d4a/da2/fb7 0 2024-02-07T12:25:38.462 INFO:tasks.workunit.client.1.smithi138.stdout:5/805: fdatasync da/d34/f80 0 2024-02-07T12:25:38.462 INFO:tasks.workunit.client.1.smithi138.stdout:2/916: getdents d3/d4e/d119/d7d/d97 0 2024-02-07T12:25:38.462 INFO:tasks.workunit.client.1.smithi138.stdout:1/807: dwrite d5/d8/da/d1f/d5e/db5/d58/f74 [0,4194304] 0 2024-02-07T12:25:38.462 INFO:tasks.workunit.client.1.smithi138.stdout:1/808: write d5/d8/da/d1f/d5e/db5/d58/d76/fbe [460537,107911] 0 2024-02-07T12:25:38.462 INFO:tasks.workunit.client.1.smithi138.stdout:1/809: stat d5/la4 0 2024-02-07T12:25:38.462 INFO:tasks.workunit.client.1.smithi138.stdout:1/810: truncate d5/d8/da/d1f/d60/df4/d59/fa9 149680 0 2024-02-07T12:25:38.462 INFO:tasks.workunit.client.1.smithi138.stdout:9/744: dwrite d0/d6/d8/d1d/dd/d41/d5e/da6/fc9 [0,4194304] 0 2024-02-07T12:25:38.465 INFO:tasks.workunit.client.1.smithi138.stdout:5/806: creat da/d22/f10c x:0 0 0 2024-02-07T12:25:38.469 INFO:tasks.workunit.client.1.smithi138.stdout:8/916: dwrite d1/fbb [0,4194304] 0 2024-02-07T12:25:38.472 INFO:tasks.workunit.client.1.smithi138.stdout:0/833: dwrite d4/d69/d85/d8a/f9f [0,4194304] 0 2024-02-07T12:25:38.472 INFO:tasks.workunit.client.1.smithi138.stdout:0/834: fdatasync d4/d9/d37/d3d/f68 0 2024-02-07T12:25:38.472 INFO:tasks.workunit.client.1.smithi138.stdout:0/835: dread - d4/d9/d37/d3d/d9c/fcc zero size 2024-02-07T12:25:38.472 INFO:tasks.workunit.client.1.smithi138.stdout:0/836: stat d4/d9/db/d71/c84 0 2024-02-07T12:25:38.473 INFO:tasks.workunit.client.1.smithi138.stdout:1/811: mknod d5/d8/da/d1f/d5e/d63/c10d 0 2024-02-07T12:25:38.473 INFO:tasks.workunit.client.1.smithi138.stdout:1/812: stat d5/f86 0 2024-02-07T12:25:38.475 INFO:tasks.workunit.client.1.smithi138.stdout:9/745: rename d0/d34/d45/f88 to d0/d6/d8/d1d/dd/d41/fe5 0 2024-02-07T12:25:38.476 INFO:tasks.workunit.client.1.smithi138.stdout:5/807: symlink da/d6d/d27/d2e/l10d 0 2024-02-07T12:25:38.477 INFO:tasks.workunit.client.1.smithi138.stdout:8/917: creat d1/de/db4/db8/d17/d3e/d72/dda/d4c/d119/f11d x:0 0 0 2024-02-07T12:25:38.486 INFO:tasks.workunit.client.1.smithi138.stdout:1/813: mknod d5/d43/c10e 0 2024-02-07T12:25:38.486 INFO:tasks.workunit.client.1.smithi138.stdout:1/814: fdatasync d5/d4b/d6b/d6e/fad 0 2024-02-07T12:25:38.488 INFO:tasks.workunit.client.1.smithi138.stdout:0/837: rename d4/d9/de/fed to d4/d52/f10a 0 2024-02-07T12:25:38.488 INFO:tasks.workunit.client.1.smithi138.stdout:9/746: dwrite d0/d6/d8/d1d/dd/d41/d5e/da6/fd9 [0,4194304] 0 2024-02-07T12:25:38.489 INFO:tasks.workunit.client.1.smithi138.stdout:5/808: creat da/d6d/d27/d2e/d4f/d2b/d35/d5d/f10e x:0 0 0 2024-02-07T12:25:38.490 INFO:tasks.workunit.client.1.smithi138.stdout:5/809: chown da/d34/dbd 0 1 2024-02-07T12:25:38.491 INFO:tasks.workunit.client.1.smithi138.stdout:8/918: creat d1/de/db4/db8/f11e x:0 0 0 2024-02-07T12:25:38.495 INFO:tasks.workunit.client.1.smithi138.stdout:1/815: read d5/d8/da/fe [2210264,124777] 0 2024-02-07T12:25:38.495 INFO:tasks.workunit.client.1.smithi138.stdout:1/816: creat d5/d8/da/f10f x:0 0 0 2024-02-07T12:25:38.496 INFO:tasks.workunit.client.1.smithi138.stdout:1/817: fsync d5/f86 0 2024-02-07T12:25:38.496 INFO:tasks.workunit.client.1.smithi138.stdout:9/747: mkdir d0/d6/d8/d1d/dd/d1f/db7/db9/de6 0 2024-02-07T12:25:38.496 INFO:tasks.workunit.client.1.smithi138.stdout:9/748: stat d0/d6/da3/dcc/ccf 0 2024-02-07T12:25:38.496 INFO:tasks.workunit.client.1.smithi138.stdout:9/749: write d0/d34/f6b [969085,60750] 0 2024-02-07T12:25:38.497 INFO:tasks.workunit.client.1.smithi138.stdout:5/810: unlink da/d6d/d27/d2e/d4f/d2b/d35/dae/db0/d96/f93 0 2024-02-07T12:25:38.498 INFO:tasks.workunit.client.1.smithi138.stdout:8/919: mknod d1/de/db4/db8/d17/d3e/c11f 0 2024-02-07T12:25:38.498 INFO:tasks.workunit.client.1.smithi138.stdout:6/859: sync 2024-02-07T12:25:38.498 INFO:tasks.workunit.client.1.smithi138.stdout:4/792: sync 2024-02-07T12:25:38.500 INFO:tasks.workunit.client.1.smithi138.stdout:0/838: dwrite d4/d9/db/d39/d4b/fd6 [0,4194304] 0 2024-02-07T12:25:38.503 INFO:tasks.workunit.client.1.smithi138.stdout:9/750: rename d0/d34/d45/d78 to d0/d6/d8/d1d/dd/d41/d5e/de7 0 2024-02-07T12:25:38.503 INFO:tasks.workunit.client.1.smithi138.stdout:9/751: dread - d0/d6/d8/dc5/fc7 zero size 2024-02-07T12:25:38.505 INFO:tasks.workunit.client.1.smithi138.stdout:5/811: mkdir da/d43/d4a/d98/d10f 0 2024-02-07T12:25:38.507 INFO:tasks.workunit.client.1.smithi138.stdout:4/793: rmdir d20/d47/d69/d7c/db9/dba 39 2024-02-07T12:25:38.509 INFO:tasks.workunit.client.1.smithi138.stdout:6/860: symlink dc/d73/l11d 0 2024-02-07T12:25:38.509 INFO:tasks.workunit.client.1.smithi138.stdout:6/861: write dc/d73/d9b/fab [1014018,110790] 0 2024-02-07T12:25:38.510 INFO:tasks.workunit.client.1.smithi138.stdout:7/993: sync 2024-02-07T12:25:38.510 INFO:tasks.workunit.client.1.smithi138.stdout:3/934: sync 2024-02-07T12:25:38.510 INFO:tasks.workunit.client.1.smithi138.stdout:7/994: dread - d0/d6/d1d/d38/ff1 zero size 2024-02-07T12:25:38.510 INFO:tasks.workunit.client.1.smithi138.stdout:7/995: readlink d0/d6/d19/l40 0 2024-02-07T12:25:38.513 INFO:tasks.workunit.client.1.smithi138.stdout:0/839: truncate d4/d9/de/f1c 1856391 0 2024-02-07T12:25:38.519 INFO:tasks.workunit.client.1.smithi138.stdout:1/818: rmdir d5/d8/da/d1f/d5e 39 2024-02-07T12:25:38.521 INFO:tasks.workunit.client.1.smithi138.stdout:5/812: mkdir da/d6d/d27/d2e/d4f/d2b/d35/d110 0 2024-02-07T12:25:38.523 INFO:tasks.workunit.client.1.smithi138.stdout:8/920: rmdir d1/db3 39 2024-02-07T12:25:38.525 INFO:tasks.workunit.client.1.smithi138.stdout:5/813: dread da/f15 [0,4194304] 0 2024-02-07T12:25:38.526 INFO:tasks.workunit.client.1.smithi138.stdout:6/862: mkdir dc/d73/dc4/d11e 0 2024-02-07T12:25:38.528 INFO:tasks.workunit.client.1.smithi138.stdout:3/935: mkdir d5/d26/d5e/d86/ded/d96/d120/d13e 0 2024-02-07T12:25:38.530 INFO:tasks.workunit.client.1.smithi138.stdout:7/996: truncate d0/d8/fe0 737422 0 2024-02-07T12:25:38.531 INFO:tasks.workunit.client.1.smithi138.stdout:6/863: read dc/d31/d38/fc3 [180817,28681] 0 2024-02-07T12:25:38.531 INFO:tasks.workunit.client.1.smithi138.stdout:0/840: unlink d4/d9/d37/d3d/fde 0 2024-02-07T12:25:38.532 INFO:tasks.workunit.client.1.smithi138.stdout:1/819: getdents d5/d43 0 2024-02-07T12:25:38.533 INFO:tasks.workunit.client.1.smithi138.stdout:1/820: chown d5/d8/da/d1f/d60/df4/d59/f8d 0 1 2024-02-07T12:25:38.534 INFO:tasks.workunit.client.1.smithi138.stdout:9/752: getdents d0 0 2024-02-07T12:25:38.534 INFO:tasks.workunit.client.1.smithi138.stdout:9/753: chown d0/d34/l62 0 1 2024-02-07T12:25:38.534 INFO:tasks.workunit.client.1.smithi138.stdout:9/754: write d0/d34/fdc [407049,44820] 0 2024-02-07T12:25:38.538 INFO:tasks.workunit.client.1.smithi138.stdout:1/821: dread d5/f86 [0,4194304] 0 2024-02-07T12:25:38.538 INFO:tasks.workunit.client.1.smithi138.stdout:1/822: readlink d5/d8/da/d1f/l52 0 2024-02-07T12:25:38.570 INFO:tasks.workunit.client.1.smithi138.stdout:5/814: symlink da/d34/l111 0 2024-02-07T12:25:38.576 INFO:tasks.workunit.client.1.smithi138.stdout:3/936: rename d5/d26/d5e/d77/f8e to d5/d26/d9d/f13f 0 2024-02-07T12:25:38.577 INFO:tasks.workunit.client.1.smithi138.stdout:3/937: fsync d5/d26/d4e/f63 0 2024-02-07T12:25:38.582 INFO:tasks.workunit.client.1.smithi138.stdout:6/864: mkdir dc/d13/d1e/dae/d11f 0 2024-02-07T12:25:38.587 INFO:tasks.workunit.client.1.smithi138.stdout:0/841: link d4/d9/de/d1d/d21/f106 d4/d9/d37/d3d/d9c/f10b 0 2024-02-07T12:25:38.589 INFO:tasks.workunit.client.1.smithi138.stdout:9/755: truncate d0/d6/d8/d1d/dd/d41/fb2 611333 0 2024-02-07T12:25:38.608 INFO:tasks.workunit.client.1.smithi138.stdout:0/842: dwrite d4/d9/db/d39/d4b/d6c/d8f/fc4 [0,4194304] 0 2024-02-07T12:25:38.612 INFO:tasks.workunit.client.1.smithi138.stdout:9/756: dwrite d0/d6/d8/fad [4194304,4194304] 0 2024-02-07T12:25:38.612 INFO:tasks.workunit.client.1.smithi138.stdout:9/757: chown d0/d6/d8/d1d/dd/d41/f79 216 1 2024-02-07T12:25:38.612 INFO:tasks.workunit.client.1.smithi138.stdout:9/758: fdatasync d0/d6/d8/d1d/dd/d25/f7f 0 2024-02-07T12:25:38.616 INFO:tasks.workunit.client.1.smithi138.stdout:1/823: dwrite d5/d8/da/d20/f41 [4194304,4194304] 0 2024-02-07T12:25:38.620 INFO:tasks.workunit.client.1.smithi138.stdout:7/997: mknod d0/d6/d19/c148 0 2024-02-07T12:25:38.625 INFO:tasks.workunit.client.1.smithi138.stdout:1/824: dread d5/d8/da/d1f/f96 [0,4194304] 0 2024-02-07T12:25:38.659 INFO:tasks.workunit.client.1.smithi138.stdout:3/938: rename d5/d34/d79/f7b to d5/d26/d90/d133/f140 0 2024-02-07T12:25:38.661 INFO:tasks.workunit.client.1.smithi138.stdout:6/865: creat dc/d73/dc4/d11e/f120 x:0 0 0 2024-02-07T12:25:38.661 INFO:tasks.workunit.client.1.smithi138.stdout:3/939: dread d5/d27/f10b [0,4194304] 0 2024-02-07T12:25:38.662 INFO:tasks.workunit.client.1.smithi138.stdout:3/940: stat d5/d26/d5e/d86/ded/d32/lbc 0 2024-02-07T12:25:38.664 INFO:tasks.workunit.client.1.smithi138.stdout:0/843: symlink d4/d52/d3f/l10c 0 2024-02-07T12:25:38.667 INFO:tasks.workunit.client.1.smithi138.stdout:0/844: dread d4/d9/d37/fae [4194304,4194304] 0 2024-02-07T12:25:38.667 INFO:tasks.workunit.client.1.smithi138.stdout:0/845: chown d4/d9/db/d39/d4b/l6a 0 1 2024-02-07T12:25:38.671 INFO:tasks.workunit.client.1.smithi138.stdout:1/825: truncate d5/d8/da/f11 14004866 0 2024-02-07T12:25:38.672 INFO:tasks.workunit.client.1.smithi138.stdout:1/826: write d5/d8/da/d1f/d60/df4/fef [100314,22726] 0 2024-02-07T12:25:38.672 INFO:tasks.workunit.client.1.smithi138.stdout:1/827: write d5/d8/da/f1d [1370001,15708] 0 2024-02-07T12:25:38.672 INFO:tasks.workunit.client.1.smithi138.stdout:1/828: readlink d5/d4b/d91/lcb 0 2024-02-07T12:25:38.676 INFO:tasks.workunit.client.1.smithi138.stdout:3/941: mknod d5/d34/d79/c141 0 2024-02-07T12:25:38.676 INFO:tasks.workunit.client.1.smithi138.stdout:3/942: truncate d5/d26/d5e/d86/d9c/f11f 405007 0 2024-02-07T12:25:38.678 INFO:tasks.workunit.client.1.smithi138.stdout:0/846: creat d4/d69/d85/f10d x:0 0 0 2024-02-07T12:25:38.678 INFO:tasks.workunit.client.1.smithi138.stdout:0/847: write d4/d9/db/d71/dfb/f102 [1014306,81071] 0 2024-02-07T12:25:38.680 INFO:tasks.workunit.client.1.smithi138.stdout:7/998: rmdir d0/d6/deb/ded 39 2024-02-07T12:25:38.680 INFO:tasks.workunit.client.1.smithi138.stdout:7/999: truncate d0/d39/dfd/d93/dfe/df6/f114 1004990 0 2024-02-07T12:25:38.683 INFO:tasks.workunit.client.1.smithi138.stdout:1/829: mknod d5/d8/da/d1f/d60/c110 0 2024-02-07T12:25:38.683 INFO:tasks.workunit.client.1.smithi138.stdout:6/866: dwrite dc/d13/d8e/f10c [0,4194304] 0 2024-02-07T12:25:38.688 INFO:tasks.workunit.client.1.smithi138.stdout:0/848: dread d4/d9/d37/d64/d9a/db0/db5/fb8 [0,4194304] 0 2024-02-07T12:25:38.688 INFO:tasks.workunit.client.1.smithi138.stdout:0/849: dread - d4/d9/d37/d6b/d7f/dcf/fec zero size 2024-02-07T12:25:38.689 INFO:tasks.workunit.client.1.smithi138.stdout:0/850: read d4/d9/f18 [4290436,52578] 0 2024-02-07T12:25:38.692 INFO:tasks.workunit.client.1.smithi138.stdout:0/851: truncate d4/d9/de/d1d/d21/f86 2350160 0 2024-02-07T12:25:38.692 INFO:tasks.workunit.client.1.smithi138.stdout:6/867: dread dc/fc1 [0,4194304] 0 2024-02-07T12:25:38.692 INFO:tasks.workunit.client.1.smithi138.stdout:6/868: readlink dc/d69/lbd 0 2024-02-07T12:25:38.698 INFO:tasks.workunit.client.1.smithi138.stdout:3/943: dwrite d5/d26/d5e/d86/d9c/d10d/f125 [0,4194304] 0 2024-02-07T12:25:38.698 INFO:tasks.workunit.client.1.smithi138.stdout:3/944: truncate d5/d34/fa0 618189 0 2024-02-07T12:25:38.698 INFO:tasks.workunit.client.1.smithi138.stdout:3/945: write d5/d27/f7d [1387815,124815] 0 2024-02-07T12:25:38.698 INFO:tasks.workunit.client.1.smithi138.stdout:3/946: creat d5/d26/d9b/dab/dc4/dd0/dd1/f142 x:0 0 0 2024-02-07T12:25:38.709 INFO:tasks.workunit.client.1.smithi138.stdout:6/869: dwrite dc/d13/f14 [0,4194304] 0 2024-02-07T12:25:38.710 INFO:tasks.workunit.client.1.smithi138.stdout:6/870: write dc/d13/d1e/d35/d85/f89 [363182,128013] 0 2024-02-07T12:25:38.726 INFO:tasks.workunit.client.1.smithi138.stdout:3/947: creat d5/d26/d28/f143 x:0 0 0 2024-02-07T12:25:38.726 INFO:tasks.workunit.client.1.smithi138.stdout:6/871: dwrite dc/fd [4194304,4194304] 0 2024-02-07T12:25:38.727 INFO:tasks.workunit.client.1.smithi138.stdout:6/872: creat dc/d73/dc4/d11e/f121 x:0 0 0 2024-02-07T12:25:38.727 INFO:tasks.workunit.client.1.smithi138.stdout:2/917: sync 2024-02-07T12:25:38.731 INFO:tasks.workunit.client.1.smithi138.stdout:2/918: symlink d3/dd/d19/d1f/dc9/l142 0 2024-02-07T12:25:38.733 INFO:tasks.workunit.client.1.smithi138.stdout:2/919: mknod d3/dd/d14/d8f/dbc/dfe/c143 0 2024-02-07T12:25:38.735 INFO:tasks.workunit.client.1.smithi138.stdout:2/920: mkdir d3/dd/d14/d82/dcc/d12a/d144 0 2024-02-07T12:25:38.736 INFO:tasks.workunit.client.1.smithi138.stdout:6/873: dread dc/f4b [0,4194304] 0 2024-02-07T12:25:38.736 INFO:tasks.workunit.client.1.smithi138.stdout:6/874: write dc/d13/f80 [25844,65971] 0 2024-02-07T12:25:38.736 INFO:tasks.workunit.client.1.smithi138.stdout:6/875: chown dc/d13/d1e/d35/d85/dba 10263228 1 2024-02-07T12:25:38.736 INFO:tasks.workunit.client.1.smithi138.stdout:2/921: mknod d3/d4e/d119/c145 0 2024-02-07T12:25:38.737 INFO:tasks.workunit.client.1.smithi138.stdout:2/922: stat d3/dd/d14/d49/d29/lb2 0 2024-02-07T12:25:38.737 INFO:tasks.workunit.client.1.smithi138.stdout:2/923: write d3/d4e/d119/d7d/d97/fe9 [758766,114977] 0 2024-02-07T12:25:38.740 INFO:tasks.workunit.client.1.smithi138.stdout:2/924: link d3/dd/d19/d1f/d46/d71/d7e/f131 d3/dd/d14/d82/dcc/f146 0 2024-02-07T12:25:38.740 INFO:tasks.workunit.client.1.smithi138.stdout:6/876: mknod dc/d13/d1e/d35/d7c/c122 0 2024-02-07T12:25:38.741 INFO:tasks.workunit.client.1.smithi138.stdout:2/925: truncate d3/dd/d14/d49/d25/d3d/fb1 241472 0 2024-02-07T12:25:38.743 INFO:tasks.workunit.client.1.smithi138.stdout:6/877: dread dc/d31/d3f/f52 [0,4194304] 0 2024-02-07T12:25:38.744 INFO:tasks.workunit.client.1.smithi138.stdout:1/830: rename d5/d8/da/d1f/l52 to d5/d4b/d6b/d6e/d79/l111 0 2024-02-07T12:25:38.751 INFO:tasks.workunit.client.1.smithi138.stdout:0/852: rename d4/d9/db/d39/d4b/d6c/dc5/dd5 to d4/d69/d85/d10e 0 2024-02-07T12:25:38.753 INFO:tasks.workunit.client.1.smithi138.stdout:3/948: rename d5/d27/f57 to d5/d26/d9b/f144 0 2024-02-07T12:25:38.763 INFO:tasks.workunit.client.0.smithi047.stdout:3/2: sync 2024-02-07T12:25:38.763 INFO:tasks.workunit.client.0.smithi047.stdout:8/56: sync 2024-02-07T12:25:38.763 INFO:tasks.workunit.client.0.smithi047.stdout:9/3: sync 2024-02-07T12:25:38.763 INFO:tasks.workunit.client.0.smithi047.stdout:4/6: sync 2024-02-07T12:25:38.763 INFO:tasks.workunit.client.0.smithi047.stdout:3/3: read - no filename 2024-02-07T12:25:38.763 INFO:tasks.workunit.client.0.smithi047.stdout:3/4: dread - no filename 2024-02-07T12:25:38.763 INFO:tasks.workunit.client.0.smithi047.stdout:2/10: sync 2024-02-07T12:25:38.764 INFO:tasks.workunit.client.0.smithi047.stdout:6/25: sync 2024-02-07T12:25:38.764 INFO:tasks.workunit.client.0.smithi047.stdout:9/4: stat l0 0 2024-02-07T12:25:38.764 INFO:tasks.workunit.client.0.smithi047.stdout:1/26: sync 2024-02-07T12:25:38.764 INFO:tasks.workunit.client.0.smithi047.stdout:8/57: write d3/d4/f12 [376432,36935] 0 2024-02-07T12:25:38.764 INFO:tasks.workunit.client.0.smithi047.stdout:2/11: creat f6 x:0 0 0 2024-02-07T12:25:38.764 INFO:tasks.workunit.client.0.smithi047.stdout:5/14: sync 2024-02-07T12:25:38.765 INFO:tasks.workunit.client.0.smithi047.stdout:7/3: sync 2024-02-07T12:25:38.765 INFO:tasks.workunit.client.0.smithi047.stdout:7/4: dwrite - no filename 2024-02-07T12:25:38.765 INFO:tasks.workunit.client.0.smithi047.stdout:7/5: dwrite - no filename 2024-02-07T12:25:38.765 INFO:tasks.workunit.client.0.smithi047.stdout:0/8: sync 2024-02-07T12:25:38.765 INFO:tasks.workunit.client.0.smithi047.stdout:2/12: write f5 [772675,64518] 0 2024-02-07T12:25:38.765 INFO:tasks.workunit.client.0.smithi047.stdout:3/5: getdents . 0 2024-02-07T12:25:38.765 INFO:tasks.workunit.client.0.smithi047.stdout:3/6: truncate - no filename 2024-02-07T12:25:38.768 INFO:tasks.workunit.client.0.smithi047.stdout:9/5: creat f1 x:0 0 0 2024-02-07T12:25:38.768 INFO:tasks.workunit.client.0.smithi047.stdout:9/6: dread - f1 zero size 2024-02-07T12:25:38.768 INFO:tasks.workunit.client.0.smithi047.stdout:9/7: write f1 [295261,120741] 0 2024-02-07T12:25:38.768 INFO:tasks.workunit.client.0.smithi047.stdout:9/8: chown l0 0 1 2024-02-07T12:25:38.768 INFO:tasks.workunit.client.0.smithi047.stdout:9/9: creat f2 x:0 0 0 2024-02-07T12:25:38.768 INFO:tasks.workunit.client.0.smithi047.stdout:9/10: stat f2 0 2024-02-07T12:25:38.768 INFO:tasks.workunit.client.0.smithi047.stdout:9/11: chown f2 21 1 2024-02-07T12:25:38.769 INFO:tasks.workunit.client.0.smithi047.stdout:5/15: rename f3 to f6 0 2024-02-07T12:25:38.770 INFO:tasks.workunit.client.1.smithi138.stdout:2/926: dwrite d3/d4e/d119/f69 [0,4194304] 0 2024-02-07T12:25:38.770 INFO:tasks.workunit.client.0.smithi047.stdout:7/6: creat d0/f1 x:0 0 0 2024-02-07T12:25:38.771 INFO:tasks.workunit.client.0.smithi047.stdout:7/7: creat d0/f2 x:0 0 0 2024-02-07T12:25:38.771 INFO:tasks.workunit.client.0.smithi047.stdout:7/8: dread - d0/f2 zero size 2024-02-07T12:25:38.771 INFO:tasks.workunit.client.0.smithi047.stdout:7/9: dread - d0/f1 zero size 2024-02-07T12:25:38.772 INFO:tasks.workunit.client.0.smithi047.stdout:0/9: creat f1 x:0 0 0 2024-02-07T12:25:38.773 INFO:tasks.workunit.client.0.smithi047.stdout:3/7: symlink l1 0 2024-02-07T12:25:38.773 INFO:tasks.workunit.client.0.smithi047.stdout:3/8: dread - no filename 2024-02-07T12:25:38.773 INFO:tasks.workunit.client.0.smithi047.stdout:3/9: dwrite - no filename 2024-02-07T12:25:38.773 INFO:tasks.workunit.client.0.smithi047.stdout:3/10: dread - no filename 2024-02-07T12:25:38.774 INFO:tasks.workunit.client.1.smithi138.stdout:6/878: dwrite dc/d13/d1e/f99 [0,4194304] 0 2024-02-07T12:25:38.778 INFO:tasks.workunit.client.0.smithi047.stdout:0/10: rename c0 to c2 0 2024-02-07T12:25:38.779 INFO:tasks.workunit.client.0.smithi047.stdout:3/11: creat f2 x:0 0 0 2024-02-07T12:25:38.779 INFO:tasks.workunit.client.0.smithi047.stdout:3/12: read - f2 zero size 2024-02-07T12:25:38.779 INFO:tasks.workunit.client.0.smithi047.stdout:3/13: chown f2 1604559 1 2024-02-07T12:25:38.780 INFO:tasks.workunit.client.0.smithi047.stdout:8/58: write d3/f14 [4153178,82840] 0 2024-02-07T12:25:38.781 INFO:tasks.workunit.client.1.smithi138.stdout:6/879: creat dc/d13/d1e/d35/d6d/da6/d10a/daa/f123 x:0 0 0 2024-02-07T12:25:38.782 INFO:tasks.workunit.client.0.smithi047.stdout:0/11: mknod c3 0 2024-02-07T12:25:38.784 INFO:tasks.workunit.client.1.smithi138.stdout:6/880: write dc/fc6 [4098639,89757] 0 2024-02-07T12:25:38.784 INFO:tasks.workunit.client.0.smithi047.stdout:8/59: mkdir d3/d16 0 2024-02-07T12:25:38.786 INFO:tasks.workunit.client.1.smithi138.stdout:3/949: rename d5/d26/d28/db7 to d5/d27/dde/d145 0 2024-02-07T12:25:38.786 INFO:tasks.workunit.client.0.smithi047.stdout:9/12: dread f1 [0,4194304] 0 2024-02-07T12:25:38.787 INFO:tasks.workunit.client.0.smithi047.stdout:0/12: mknod c4 0 2024-02-07T12:25:38.787 INFO:tasks.workunit.client.0.smithi047.stdout:0/13: write f1 [283173,67582] 0 2024-02-07T12:25:38.789 INFO:tasks.workunit.client.1.smithi138.stdout:3/950: symlink d5/d26/d5e/d86/dae/l146 0 2024-02-07T12:25:38.789 INFO:tasks.workunit.client.0.smithi047.stdout:3/14: symlink l3 0 2024-02-07T12:25:38.794 INFO:tasks.workunit.client.1.smithi138.stdout:1/831: rmdir d5 39 2024-02-07T12:25:38.794 INFO:tasks.workunit.client.1.smithi138.stdout:6/881: read dc/d31/f48 [2679735,38430] 0 2024-02-07T12:25:38.794 INFO:tasks.workunit.client.1.smithi138.stdout:6/882: chown dc/d13/f14 7444431 1 2024-02-07T12:25:38.795 INFO:tasks.workunit.client.1.smithi138.stdout:0/853: dwrite d4/d9/d37/d6b/f91 [4194304,4194304] 0 2024-02-07T12:25:38.796 INFO:tasks.workunit.client.0.smithi047.stdout:6/26: write f2 [3377593,74389] 0 2024-02-07T12:25:38.797 INFO:tasks.workunit.client.1.smithi138.stdout:8/921: sync 2024-02-07T12:25:38.797 INFO:tasks.workunit.client.1.smithi138.stdout:9/759: sync 2024-02-07T12:25:38.797 INFO:tasks.workunit.client.1.smithi138.stdout:4/794: sync 2024-02-07T12:25:38.798 INFO:tasks.workunit.client.1.smithi138.stdout:5/815: sync 2024-02-07T12:25:38.800 INFO:tasks.workunit.client.0.smithi047.stdout:6/27: link f2 d3/d5/f7 0 2024-02-07T12:25:38.803 INFO:tasks.workunit.client.1.smithi138.stdout:6/883: symlink dc/d13/d1e/d4d/l124 0 2024-02-07T12:25:38.804 INFO:tasks.workunit.client.1.smithi138.stdout:1/832: dread d5/d4b/f5d [0,4194304] 0 2024-02-07T12:25:38.804 INFO:tasks.workunit.client.1.smithi138.stdout:1/833: fsync d5/d8/da/d1f/d5e/db5/f8f 0 2024-02-07T12:25:38.804 INFO:tasks.workunit.client.1.smithi138.stdout:1/834: dread - d5/d8/da/d1f/d5e/db5/d68/d73/d7b/f75 zero size 2024-02-07T12:25:38.804 INFO:tasks.workunit.client.0.smithi047.stdout:7/10: dwrite d0/f1 [0,4194304] 0 2024-02-07T12:25:38.806 INFO:tasks.workunit.client.0.smithi047.stdout:2/13: dwrite f2 [0,4194304] 0 2024-02-07T12:25:38.815 INFO:tasks.workunit.client.1.smithi138.stdout:9/760: dread d0/d6/f12 [0,4194304] 0 2024-02-07T12:25:38.822 INFO:tasks.workunit.client.1.smithi138.stdout:8/922: creat d1/f120 x:0 0 0 2024-02-07T12:25:38.822 INFO:tasks.workunit.client.1.smithi138.stdout:4/795: truncate d20/f2e 934558 0 2024-02-07T12:25:38.822 INFO:tasks.workunit.client.1.smithi138.stdout:4/796: chown d20/d53 253649 1 2024-02-07T12:25:38.823 INFO:tasks.workunit.client.1.smithi138.stdout:1/835: mkdir d5/d8/da/d1f/d60/df4/d59/d108/d112 0 2024-02-07T12:25:38.829 INFO:tasks.workunit.client.1.smithi138.stdout:9/761: unlink d0/d6/l44 0 2024-02-07T12:25:38.833 INFO:tasks.workunit.client.1.smithi138.stdout:8/923: mknod d1/de/db4/db8/d17/d8a/db6/c121 0 2024-02-07T12:25:38.833 INFO:tasks.workunit.client.1.smithi138.stdout:9/762: dread d0/d34/f6b [0,4194304] 0 2024-02-07T12:25:38.833 INFO:tasks.workunit.client.1.smithi138.stdout:9/763: stat d0/d6/d8/d1d/dd/d1f/db7/f90 0 2024-02-07T12:25:38.834 INFO:tasks.workunit.client.1.smithi138.stdout:4/797: mknod d20/d34/d59/d72/c101 0 2024-02-07T12:25:38.834 INFO:tasks.workunit.client.1.smithi138.stdout:4/798: dread - d20/d34/d59/d72/d77/fb5 zero size 2024-02-07T12:25:38.834 INFO:tasks.workunit.client.1.smithi138.stdout:1/836: getdents d5/d8/da/d20 0 2024-02-07T12:25:38.837 INFO:tasks.workunit.client.1.smithi138.stdout:5/816: rename da/d6d/d27 to da/d43/d4a/da2/d112 0 2024-02-07T12:25:38.837 INFO:tasks.workunit.client.1.smithi138.stdout:8/924: rmdir d1/de/db4/db8/d17/d3e/d72/d95 39 2024-02-07T12:25:38.837 INFO:tasks.workunit.client.1.smithi138.stdout:8/925: getdents d1/de/db4/db8/d17/d3e/d10e 0 2024-02-07T12:25:38.837 INFO:tasks.workunit.client.1.smithi138.stdout:5/817: creat da/d50/f113 x:0 0 0 2024-02-07T12:25:38.837 INFO:tasks.workunit.client.1.smithi138.stdout:8/926: write d1/de/db4/db8/d17/d3e/d72/dda/d4c/d119/f11d [867053,59946] 0 2024-02-07T12:25:38.838 INFO:tasks.workunit.client.1.smithi138.stdout:9/764: mknod d0/ce8 0 2024-02-07T12:25:38.838 INFO:tasks.workunit.client.1.smithi138.stdout:9/765: truncate d0/d6/d8/d1d/dd/f63 4312639 0 2024-02-07T12:25:38.839 INFO:tasks.workunit.client.0.smithi047.stdout:2/14: dread f2 [0,4194304] 0 2024-02-07T12:25:38.841 INFO:tasks.workunit.client.1.smithi138.stdout:4/799: rename d20/d34/f4c to d20/d53/f102 0 2024-02-07T12:25:38.841 INFO:tasks.workunit.client.1.smithi138.stdout:4/800: write d20/d53/d71/d75/d94/fd8 [1033424,27186] 0 2024-02-07T12:25:38.841 INFO:tasks.workunit.client.1.smithi138.stdout:4/801: fdatasync d20/d47/d69/d7c/db9/dba/fc1 0 2024-02-07T12:25:38.842 INFO:tasks.workunit.client.0.smithi047.stdout:2/15: mkdir d7 0 2024-02-07T12:25:38.842 INFO:tasks.workunit.client.0.smithi047.stdout:2/16: write f5 [1108970,714] 0 2024-02-07T12:25:38.843 INFO:tasks.workunit.client.1.smithi138.stdout:8/927: creat d1/de/db4/db8/d17/d8a/dd7/f122 x:0 0 0 2024-02-07T12:25:38.843 INFO:tasks.workunit.client.1.smithi138.stdout:8/928: truncate d1/de/db4/db8/d17/d58/f97 5967129 0 2024-02-07T12:25:38.843 INFO:tasks.workunit.client.1.smithi138.stdout:8/929: write d1/de/db4/db8/d17/d8a/fb5 [1377203,130274] 0 2024-02-07T12:25:38.843 INFO:tasks.workunit.client.0.smithi047.stdout:2/17: creat d7/f8 x:0 0 0 2024-02-07T12:25:38.844 INFO:tasks.workunit.client.1.smithi138.stdout:4/802: creat d20/d47/d69/d7c/db9/dba/df5/f103 x:0 0 0 2024-02-07T12:25:38.844 INFO:tasks.workunit.client.0.smithi047.stdout:2/18: symlink d7/l9 0 2024-02-07T12:25:38.845 INFO:tasks.workunit.client.1.smithi138.stdout:0/854: dwrite d4/d9/db/fba [0,4194304] 0 2024-02-07T12:25:38.847 INFO:tasks.workunit.client.0.smithi047.stdout:8/60: write d3/d4/fa [2321433,40136] 0 2024-02-07T12:25:38.847 INFO:tasks.workunit.client.0.smithi047.stdout:8/61: chown d3/d4/l5 101642573 1 2024-02-07T12:25:38.847 INFO:tasks.workunit.client.0.smithi047.stdout:8/62: truncate d3/d4/fa 4573134 0 2024-02-07T12:25:38.849 INFO:tasks.workunit.client.0.smithi047.stdout:8/63: creat d3/f17 x:0 0 0 2024-02-07T12:25:38.849 INFO:tasks.workunit.client.0.smithi047.stdout:8/64: stat d3/d4/cb 0 2024-02-07T12:25:38.850 INFO:tasks.workunit.client.1.smithi138.stdout:4/803: creat d20/d53/dd1/f104 x:0 0 0 2024-02-07T12:25:38.851 INFO:tasks.workunit.client.1.smithi138.stdout:4/804: fdatasync d20/d53/dd1/f104 0 2024-02-07T12:25:38.866 INFO:tasks.workunit.client.0.smithi047.stdout:9/13: dwrite f1 [0,4194304] 0 2024-02-07T12:25:38.866 INFO:tasks.workunit.client.0.smithi047.stdout:9/14: chown l0 106 1 2024-02-07T12:25:38.866 INFO:tasks.workunit.client.0.smithi047.stdout:3/15: dwrite f2 [0,4194304] 0 2024-02-07T12:25:38.867 INFO:tasks.workunit.client.1.smithi138.stdout:3/951: dwrite d5/d26/d90/d133/f140 [0,4194304] 0 2024-02-07T12:25:38.870 INFO:tasks.workunit.client.0.smithi047.stdout:0/14: dwrite f1 [0,4194304] 0 2024-02-07T12:25:38.870 INFO:tasks.workunit.client.0.smithi047.stdout:0/15: stat c3 0 2024-02-07T12:25:38.873 INFO:tasks.workunit.client.0.smithi047.stdout:3/16: stat l0 0 2024-02-07T12:25:38.875 INFO:tasks.workunit.client.0.smithi047.stdout:7/11: dwrite d0/f2 [0,4194304] 0 2024-02-07T12:25:38.889 INFO:tasks.workunit.client.1.smithi138.stdout:6/884: dwrite dc/d13/d1e/f99 [0,4194304] 0 2024-02-07T12:25:38.889 INFO:tasks.workunit.client.1.smithi138.stdout:6/885: chown dc/d13/d1e/d35/d7c/c122 7473513 1 2024-02-07T12:25:38.889 INFO:tasks.workunit.client.1.smithi138.stdout:6/886: fdatasync dc/d69/f67 0 2024-02-07T12:25:38.890 INFO:tasks.workunit.client.1.smithi138.stdout:6/887: truncate dc/d13/d1e/d35/f40 1453314 0 2024-02-07T12:25:38.890 INFO:tasks.workunit.client.1.smithi138.stdout:6/888: fdatasync dc/d13/d8e/fb9 0 2024-02-07T12:25:38.890 INFO:tasks.workunit.client.1.smithi138.stdout:6/889: stat dc/d13/d1e/d35/c75 0 2024-02-07T12:25:38.891 INFO:tasks.workunit.client.1.smithi138.stdout:6/890: chown dc/d13/d1e/d35/d6d/da6/d10a/fa9 232844 1 2024-02-07T12:25:38.892 INFO:tasks.workunit.client.0.smithi047.stdout:5/16: dwrite f6 [0,4194304] 0 2024-02-07T12:25:38.903 INFO:tasks.workunit.client.0.smithi047.stdout:5/17: dread f6 [0,4194304] 0 2024-02-07T12:25:38.903 INFO:tasks.workunit.client.0.smithi047.stdout:6/28: dwrite d3/d5/f7 [0,4194304] 0 2024-02-07T12:25:38.903 INFO:tasks.workunit.client.0.smithi047.stdout:6/29: fsync d3/d5/f7 0 2024-02-07T12:25:38.903 INFO:tasks.workunit.client.0.smithi047.stdout:5/18: rename f5 to f7 0 2024-02-07T12:25:38.905 INFO:tasks.workunit.client.0.smithi047.stdout:6/30: creat d3/f8 x:0 0 0 2024-02-07T12:25:38.907 INFO:tasks.workunit.client.0.smithi047.stdout:6/31: mknod d3/c9 0 2024-02-07T12:25:38.907 INFO:tasks.workunit.client.0.smithi047.stdout:6/32: dread - d3/d5/f6 zero size 2024-02-07T12:25:38.909 INFO:tasks.workunit.client.0.smithi047.stdout:2/19: dwrite d7/f8 [0,4194304] 0 2024-02-07T12:25:38.910 INFO:tasks.workunit.client.1.smithi138.stdout:1/837: dwrite d5/d4b/d65/ff9 [0,4194304] 0 2024-02-07T12:25:38.911 INFO:tasks.workunit.client.1.smithi138.stdout:9/766: dwrite d0/d6/d8/d1d/dd/d41/fe5 [0,4194304] 0 2024-02-07T12:25:38.911 INFO:tasks.workunit.client.1.smithi138.stdout:9/767: creat d0/d6/d8/d95/fe9 x:0 0 0 2024-02-07T12:25:38.911 INFO:tasks.workunit.client.1.smithi138.stdout:9/768: readlink d0/d6/d8/d95/ldb 0 2024-02-07T12:25:38.911 INFO:tasks.workunit.client.1.smithi138.stdout:8/930: dwrite d1/f13 [0,4194304] 0 2024-02-07T12:25:38.917 INFO:tasks.workunit.client.1.smithi138.stdout:1/838: write d5/d8/ff [4027500,27039] 0 2024-02-07T12:25:38.917 INFO:tasks.workunit.client.1.smithi138.stdout:9/769: symlink d0/d6/da3/dcc/dd1/lea 0 2024-02-07T12:25:38.918 INFO:tasks.workunit.client.1.smithi138.stdout:0/855: dwrite d4/f67 [0,4194304] 0 2024-02-07T12:25:38.919 INFO:tasks.workunit.client.1.smithi138.stdout:4/805: dwrite d20/d47/d69/d7c/db9/dba/fc1 [0,4194304] 0 2024-02-07T12:25:38.919 INFO:tasks.workunit.client.1.smithi138.stdout:4/806: readlink d20/d47/l67 0 2024-02-07T12:25:38.919 INFO:tasks.workunit.client.1.smithi138.stdout:8/931: mknod d1/de/db4/db8/d17/d3e/d72/dda/dcf/ddd/d112/c123 0 2024-02-07T12:25:38.919 INFO:tasks.workunit.client.1.smithi138.stdout:1/839: getdents d5/d4b/d65/de2 0 2024-02-07T12:25:38.920 INFO:tasks.workunit.client.1.smithi138.stdout:1/840: fsync d5/d8/da/d1f/d5e/db5/d68/d73/d7b/f2c 0 2024-02-07T12:25:38.921 INFO:tasks.workunit.client.1.smithi138.stdout:3/952: dwrite d5/d27/dde/d145/fbd [0,4194304] 0 2024-02-07T12:25:38.921 INFO:tasks.workunit.client.0.smithi047.stdout:0/16: dwrite f1 [0,4194304] 0 2024-02-07T12:25:38.922 INFO:tasks.workunit.client.0.smithi047.stdout:0/17: chown c3 113171404 1 2024-02-07T12:25:38.922 INFO:tasks.workunit.client.0.smithi047.stdout:0/18: creat f5 x:0 0 0 2024-02-07T12:25:38.924 INFO:tasks.workunit.client.1.smithi138.stdout:9/770: link d0/l99 d0/d6/d8/d1d/dd/d1f/db7/db9/dc3/leb 0 2024-02-07T12:25:38.925 INFO:tasks.workunit.client.0.smithi047.stdout:3/17: dwrite f2 [0,4194304] 0 2024-02-07T12:25:38.925 INFO:tasks.workunit.client.0.smithi047.stdout:2/20: getdents d7 0 2024-02-07T12:25:38.925 INFO:tasks.workunit.client.0.smithi047.stdout:7/12: dwrite d0/f2 [0,4194304] 0 2024-02-07T12:25:38.925 INFO:tasks.workunit.client.0.smithi047.stdout:5/19: dwrite f6 [0,4194304] 0 2024-02-07T12:25:38.926 INFO:tasks.workunit.client.1.smithi138.stdout:6/891: dwrite dc/d31/fbb [0,4194304] 0 2024-02-07T12:25:38.926 INFO:tasks.workunit.client.1.smithi138.stdout:8/932: creat d1/de/db4/db8/d17/d3e/d72/dda/dcf/ddd/f124 x:0 0 0 2024-02-07T12:25:38.927 INFO:tasks.workunit.client.1.smithi138.stdout:8/933: stat d1/d99/da6 0 2024-02-07T12:25:38.928 INFO:tasks.workunit.client.1.smithi138.stdout:4/807: rmdir d20/d47/d69/d7c/db9/dba 39 2024-02-07T12:25:38.928 INFO:tasks.workunit.client.0.smithi047.stdout:2/21: link c4 d7/ca 0 2024-02-07T12:25:38.929 INFO:tasks.workunit.client.0.smithi047.stdout:0/19: dread f1 [0,4194304] 0 2024-02-07T12:25:38.931 INFO:tasks.workunit.client.0.smithi047.stdout:7/13: symlink d0/l3 0 2024-02-07T12:25:38.932 INFO:tasks.workunit.client.0.smithi047.stdout:2/22: creat d7/fb x:0 0 0 2024-02-07T12:25:38.932 INFO:tasks.workunit.client.0.smithi047.stdout:2/23: chown c4 140010 1 2024-02-07T12:25:38.934 INFO:tasks.workunit.client.0.smithi047.stdout:0/20: mknod c6 0 2024-02-07T12:25:38.935 INFO:tasks.workunit.client.0.smithi047.stdout:0/21: write f5 [907330,126257] 0 2024-02-07T12:25:38.936 INFO:tasks.workunit.client.1.smithi138.stdout:8/934: rename d1/fc0 to d1/de/f125 0 2024-02-07T12:25:38.936 INFO:tasks.workunit.client.1.smithi138.stdout:4/808: chown d20/d34/d36/d55/d74/d9a/dc0/fce 304697 1 2024-02-07T12:25:38.936 INFO:tasks.workunit.client.0.smithi047.stdout:2/24: mkdir d7/dc 0 2024-02-07T12:25:38.937 INFO:tasks.workunit.client.0.smithi047.stdout:5/20: read f6 [3454296,82178] 0 2024-02-07T12:25:38.937 INFO:tasks.workunit.client.0.smithi047.stdout:5/21: write f6 [1311534,72870] 0 2024-02-07T12:25:38.937 INFO:tasks.workunit.client.0.smithi047.stdout:5/22: write f6 [906728,11286] 0 2024-02-07T12:25:38.938 INFO:tasks.workunit.client.1.smithi138.stdout:9/771: read d0/d6/d8/d1d/f61 [7754889,58364] 0 2024-02-07T12:25:38.939 INFO:tasks.workunit.client.0.smithi047.stdout:0/22: link c2 c7 0 2024-02-07T12:25:38.939 INFO:tasks.workunit.client.0.smithi047.stdout:0/23: readlink - no filename 2024-02-07T12:25:38.940 INFO:tasks.workunit.client.1.smithi138.stdout:8/935: mkdir d1/de/d126 0 2024-02-07T12:25:38.940 INFO:tasks.workunit.client.0.smithi047.stdout:2/25: mknod d7/cd 0 2024-02-07T12:25:38.942 INFO:tasks.workunit.client.0.smithi047.stdout:6/33: truncate d3/d5/f7 2981662 0 2024-02-07T12:25:38.943 INFO:tasks.workunit.client.1.smithi138.stdout:4/809: creat d20/d53/f105 x:0 0 0 2024-02-07T12:25:38.943 INFO:tasks.workunit.client.1.smithi138.stdout:4/810: readlink d20/lf6 0 2024-02-07T12:25:38.946 INFO:tasks.workunit.client.0.smithi047.stdout:2/26: mknod d7/dc/ce 0 2024-02-07T12:25:38.946 INFO:tasks.workunit.client.0.smithi047.stdout:2/27: truncate d7/fb 383478 0 2024-02-07T12:25:38.946 INFO:tasks.workunit.client.0.smithi047.stdout:2/28: chown f2 21301 1 2024-02-07T12:25:38.947 INFO:tasks.workunit.client.0.smithi047.stdout:5/23: getdents . 0 2024-02-07T12:25:38.947 INFO:tasks.workunit.client.0.smithi047.stdout:5/24: write f6 [2804813,51249] 0 2024-02-07T12:25:38.948 INFO:tasks.workunit.client.0.smithi047.stdout:5/25: stat f6 0 2024-02-07T12:25:38.950 INFO:tasks.workunit.client.1.smithi138.stdout:8/936: symlink d1/de/d126/l127 0 2024-02-07T12:25:38.950 INFO:tasks.workunit.client.1.smithi138.stdout:9/772: mknod d0/d6/da3/dcc/cec 0 2024-02-07T12:25:38.950 INFO:tasks.workunit.client.0.smithi047.stdout:7/14: write d0/f2 [806358,65740] 0 2024-02-07T12:25:38.952 INFO:tasks.workunit.client.1.smithi138.stdout:4/811: rename d20/d34/d73/laf to d20/d34/d36/d55/l106 0 2024-02-07T12:25:38.952 INFO:tasks.workunit.client.1.smithi138.stdout:4/812: chown d20/d53/f102 3847895 1 2024-02-07T12:25:38.954 INFO:tasks.workunit.client.1.smithi138.stdout:4/813: creat d20/d34/d36/f107 x:0 0 0 2024-02-07T12:25:38.956 INFO:tasks.workunit.client.1.smithi138.stdout:4/814: link d20/f26 d20/d53/d71/d75/de8/f108 0 2024-02-07T12:25:38.958 INFO:tasks.workunit.client.1.smithi138.stdout:4/815: mknod d20/d34/d59/d72/c109 0 2024-02-07T12:25:38.958 INFO:tasks.workunit.client.1.smithi138.stdout:4/816: chown d20/d47/d69/de4/ded 11826 1 2024-02-07T12:25:38.958 INFO:tasks.workunit.client.1.smithi138.stdout:4/817: creat d20/d47/d69/d7c/db9/dba/df5/f10a x:0 0 0 2024-02-07T12:25:38.958 INFO:tasks.workunit.client.1.smithi138.stdout:4/818: creat d20/d4d/f10b x:0 0 0 2024-02-07T12:25:38.959 INFO:tasks.workunit.client.0.smithi047.stdout:2/29: write f2 [3134749,123999] 0 2024-02-07T12:25:38.962 INFO:tasks.workunit.client.0.smithi047.stdout:2/30: mknod d7/dc/cf 0 2024-02-07T12:25:38.962 INFO:tasks.workunit.client.0.smithi047.stdout:2/31: write f2 [2655828,118633] 0 2024-02-07T12:25:38.964 INFO:tasks.workunit.client.1.smithi138.stdout:4/819: symlink d20/l10c 0 2024-02-07T12:25:38.964 INFO:tasks.workunit.client.1.smithi138.stdout:4/820: read - d20/d4d/fe6 zero size 2024-02-07T12:25:38.965 INFO:tasks.workunit.client.1.smithi138.stdout:4/821: mknod d20/d34/d73/c10d 0 2024-02-07T12:25:38.965 INFO:tasks.workunit.client.1.smithi138.stdout:4/822: fsync d20/f3f 0 2024-02-07T12:25:38.965 INFO:tasks.workunit.client.1.smithi138.stdout:4/823: read - d20/d34/d59/d88/ffd zero size 2024-02-07T12:25:38.965 INFO:tasks.workunit.client.1.smithi138.stdout:4/824: read - d20/d4d/d87/fcf zero size 2024-02-07T12:25:38.965 INFO:tasks.workunit.client.1.smithi138.stdout:4/825: mknod d20/c10e 0 2024-02-07T12:25:38.966 INFO:tasks.workunit.client.1.smithi138.stdout:4/826: getdents d20/d34/d59/d88/d8d 0 2024-02-07T12:25:38.966 INFO:tasks.workunit.client.1.smithi138.stdout:0/856: dwrite d4/d9/f11 [0,4194304] 0 2024-02-07T12:25:38.969 INFO:tasks.workunit.client.1.smithi138.stdout:0/857: getdents d4/d9/db/d39/ddb 0 2024-02-07T12:25:38.969 INFO:tasks.workunit.client.1.smithi138.stdout:0/858: readlink d4/d9/db/d39/d4b/l66 0 2024-02-07T12:25:38.969 INFO:tasks.workunit.client.1.smithi138.stdout:0/859: chown d4/d9/cc6 1055 1 2024-02-07T12:25:38.969 INFO:tasks.workunit.client.1.smithi138.stdout:0/860: fdatasync d4/d9/de/d1d/f36 0 2024-02-07T12:25:38.970 INFO:tasks.workunit.client.1.smithi138.stdout:2/927: sync 2024-02-07T12:25:38.970 INFO:tasks.workunit.client.1.smithi138.stdout:2/928: creat d3/dd/d14/d82/dcc/f147 x:0 0 0 2024-02-07T12:25:38.970 INFO:tasks.workunit.client.0.smithi047.stdout:2/32: dread d7/fb [0,4194304] 0 2024-02-07T12:25:38.971 INFO:tasks.workunit.client.0.smithi047.stdout:2/33: truncate f5 1469152 0 2024-02-07T12:25:38.971 INFO:tasks.workunit.client.0.smithi047.stdout:2/34: creat d7/dc/f10 x:0 0 0 2024-02-07T12:25:38.971 INFO:tasks.workunit.client.0.smithi047.stdout:2/35: fsync d7/f8 0 2024-02-07T12:25:38.971 INFO:tasks.workunit.client.0.smithi047.stdout:2/36: symlink d7/l11 0 2024-02-07T12:25:38.971 INFO:tasks.workunit.client.0.smithi047.stdout:2/37: dread - d7/dc/f10 zero size 2024-02-07T12:25:38.971 INFO:tasks.workunit.client.0.smithi047.stdout:2/38: unlink f6 0 2024-02-07T12:25:38.971 INFO:tasks.workunit.client.0.smithi047.stdout:2/39: write f2 [2036263,82808] 0 2024-02-07T12:25:38.971 INFO:tasks.workunit.client.0.smithi047.stdout:2/40: creat d7/f12 x:0 0 0 2024-02-07T12:25:38.971 INFO:tasks.workunit.client.0.smithi047.stdout:2/41: creat d7/f13 x:0 0 0 2024-02-07T12:25:38.974 INFO:tasks.workunit.client.0.smithi047.stdout:2/42: write d7/f13 [250242,19777] 0 2024-02-07T12:25:38.974 INFO:tasks.workunit.client.0.smithi047.stdout:2/43: creat d7/f14 x:0 0 0 2024-02-07T12:25:38.974 INFO:tasks.workunit.client.0.smithi047.stdout:2/44: mknod d7/c15 0 2024-02-07T12:25:38.974 INFO:tasks.workunit.client.0.smithi047.stdout:2/45: mknod d7/dc/c16 0 2024-02-07T12:25:38.974 INFO:tasks.workunit.client.0.smithi047.stdout:2/46: symlink d7/l17 0 2024-02-07T12:25:38.975 INFO:tasks.workunit.client.1.smithi138.stdout:0/861: unlink d4/d9/d37/l79 0 2024-02-07T12:25:38.975 INFO:tasks.workunit.client.1.smithi138.stdout:0/862: read d4/d9/d37/fae [5345084,64407] 0 2024-02-07T12:25:38.975 INFO:tasks.workunit.client.1.smithi138.stdout:0/863: dread - d4/d9/d37/d64/d9a/ffd zero size 2024-02-07T12:25:38.975 INFO:tasks.workunit.client.1.smithi138.stdout:0/864: dread - d4/d52/fe2 zero size 2024-02-07T12:25:38.975 INFO:tasks.workunit.client.1.smithi138.stdout:2/929: rmdir d3/dd/d14/d8f/dbc/dbd/d101/d123 0 2024-02-07T12:25:38.975 INFO:tasks.workunit.client.1.smithi138.stdout:2/930: truncate d3/d4e/d119/d7d/f12f 396835 0 2024-02-07T12:25:38.976 INFO:tasks.workunit.client.1.smithi138.stdout:2/931: dread - d3/dd/d14/d8f/dbc/f105 zero size 2024-02-07T12:25:38.976 INFO:tasks.workunit.client.1.smithi138.stdout:0/865: mknod d4/d9/d37/d64/d9d/c10f 0 2024-02-07T12:25:38.976 INFO:tasks.workunit.client.1.smithi138.stdout:0/866: write d4/d9/d37/d3d/d9c/f10b [930687,68512] 0 2024-02-07T12:25:38.976 INFO:tasks.workunit.client.0.smithi047.stdout:2/47: symlink d7/l18 0 2024-02-07T12:25:38.976 INFO:tasks.workunit.client.0.smithi047.stdout:2/48: unlink d7/l17 0 2024-02-07T12:25:38.978 INFO:tasks.workunit.client.0.smithi047.stdout:5/26: dread f7 [0,4194304] 0 2024-02-07T12:25:38.978 INFO:tasks.workunit.client.0.smithi047.stdout:5/27: chown c4 0 1 2024-02-07T12:25:38.980 INFO:tasks.workunit.client.0.smithi047.stdout:5/28: unlink l1 0 2024-02-07T12:25:38.981 INFO:tasks.workunit.client.1.smithi138.stdout:9/773: dread d0/faf [0,4194304] 0 2024-02-07T12:25:38.983 INFO:tasks.workunit.client.1.smithi138.stdout:9/774: rename d0/d6/d8/d1d/dd/d41/lc1 to d0/d6/da3/dcc/led 0 2024-02-07T12:25:38.983 INFO:tasks.workunit.client.1.smithi138.stdout:9/775: fsync d0/d6/d8/d1d/da0/fc2 0 2024-02-07T12:25:38.984 INFO:tasks.workunit.client.1.smithi138.stdout:9/776: write d0/d6/d8/f73 [2716275,118386] 0 2024-02-07T12:25:38.984 INFO:tasks.workunit.client.1.smithi138.stdout:9/777: stat d0/d6/d8/d1d/dd/d1f/f6a 0 2024-02-07T12:25:38.984 INFO:tasks.workunit.client.1.smithi138.stdout:1/841: dwrite d5/d8/da/d1f/d5e/db5/d68/d73/d7b/f2c [0,4194304] 0 2024-02-07T12:25:38.988 INFO:tasks.workunit.client.1.smithi138.stdout:1/842: creat d5/d8/da/df8/f113 x:0 0 0 2024-02-07T12:25:38.992 INFO:tasks.workunit.client.0.smithi047.stdout:5/29: write f7 [2159986,97204] 0 2024-02-07T12:25:38.992 INFO:tasks.workunit.client.0.smithi047.stdout:5/30: write f7 [2783585,52584] 0 2024-02-07T12:25:38.998 INFO:tasks.workunit.client.1.smithi138.stdout:6/892: dwrite dc/d13/d1e/d35/d6d/da6/d10a/daa/fef [0,4194304] 0 2024-02-07T12:25:38.999 INFO:tasks.workunit.client.1.smithi138.stdout:6/893: creat dc/d13/d1e/d35/d6d/da6/f125 x:0 0 0 2024-02-07T12:25:39.000 INFO:tasks.workunit.client.1.smithi138.stdout:6/894: mknod dc/d13/d1e/d35/d6d/dfe/c126 0 2024-02-07T12:25:39.001 INFO:tasks.workunit.client.1.smithi138.stdout:6/895: truncate dc/d13/d1e/d35/d85/dba/ff9 133431 0 2024-02-07T12:25:39.002 INFO:tasks.workunit.client.1.smithi138.stdout:6/896: rmdir dc/d73/dc4/d11e 39 2024-02-07T12:25:39.002 INFO:tasks.workunit.client.1.smithi138.stdout:6/897: fdatasync dc/d13/d1e/d35/d7c/dbe/ff8 0 2024-02-07T12:25:39.014 INFO:tasks.workunit.client.0.smithi047.stdout:3/18: dwrite f2 [0,4194304] 0 2024-02-07T12:25:39.014 INFO:tasks.workunit.client.0.smithi047.stdout:3/19: fsync f2 0 2024-02-07T12:25:39.014 INFO:tasks.workunit.client.0.smithi047.stdout:3/20: fsync f2 0 2024-02-07T12:25:39.014 INFO:tasks.workunit.client.0.smithi047.stdout:3/21: chown l0 2041 1 2024-02-07T12:25:39.015 INFO:tasks.workunit.client.1.smithi138.stdout:1/843: dread d5/d8/da/d1f/d5e/d63/f57 [0,4194304] 0 2024-02-07T12:25:39.015 INFO:tasks.workunit.client.0.smithi047.stdout:3/22: mkdir d4 0 2024-02-07T12:25:39.016 INFO:tasks.workunit.client.1.smithi138.stdout:1/844: rename d5/d8/da/d1f/f51 to d5/d8/da/d1f/d60/df4/d59/d108/d112/f114 0 2024-02-07T12:25:39.017 INFO:tasks.workunit.client.1.smithi138.stdout:3/953: dwrite d5/d27/f12a [0,4194304] 0 2024-02-07T12:25:39.017 INFO:tasks.workunit.client.1.smithi138.stdout:4/827: dwrite d20/fc7 [0,4194304] 0 2024-02-07T12:25:39.017 INFO:tasks.workunit.client.0.smithi047.stdout:3/23: rmdir d4 0 2024-02-07T12:25:39.018 INFO:tasks.workunit.client.1.smithi138.stdout:1/845: creat d5/d8/da/d1f/d5e/db5/d68/da7/f115 x:0 0 0 2024-02-07T12:25:39.018 INFO:tasks.workunit.client.1.smithi138.stdout:1/846: stat d5/d8/da/d1f/d5e/db5 0 2024-02-07T12:25:39.018 INFO:tasks.workunit.client.1.smithi138.stdout:1/847: readlink d5/d4b/d91/lb2 0 2024-02-07T12:25:39.020 INFO:tasks.workunit.client.1.smithi138.stdout:4/828: dread d20/d34/d36/f41 [0,4194304] 0 2024-02-07T12:25:39.021 INFO:tasks.workunit.client.1.smithi138.stdout:2/932: dwrite d3/dd/d19/d1f/f5d [0,4194304] 0 2024-02-07T12:25:39.021 INFO:tasks.workunit.client.1.smithi138.stdout:8/937: dwrite d1/f9e [0,4194304] 0 2024-02-07T12:25:39.021 INFO:tasks.workunit.client.1.smithi138.stdout:8/938: write d1/de/db4/db8/d17/d3e/d72/dda/d4c/d62/fdb [636850,28363] 0 2024-02-07T12:25:39.021 INFO:tasks.workunit.client.1.smithi138.stdout:8/939: stat d1/de/db4/db8/d17/d3e/d72/dda/dcf/ld9 0 2024-02-07T12:25:39.022 INFO:tasks.workunit.client.1.smithi138.stdout:8/940: creat d1/ddc/f128 x:0 0 0 2024-02-07T12:25:39.022 INFO:tasks.workunit.client.1.smithi138.stdout:0/867: dwrite d4/d9/d37/d64/f9b [0,4194304] 0 2024-02-07T12:25:39.023 INFO:tasks.workunit.client.1.smithi138.stdout:0/868: chown d4/d9/d37/db6 9882758 1 2024-02-07T12:25:39.023 INFO:tasks.workunit.client.1.smithi138.stdout:0/869: creat d4/d9/d37/d6b/d7f/dcf/f110 x:0 0 0 2024-02-07T12:25:39.023 INFO:tasks.workunit.client.1.smithi138.stdout:0/870: truncate d4/d9/d37/d3d/ffa 502087 0 2024-02-07T12:25:39.023 INFO:tasks.workunit.client.0.smithi047.stdout:8/65: dwrite d3/d4/fc [4194304,4194304] 0 2024-02-07T12:25:39.023 INFO:tasks.workunit.client.0.smithi047.stdout:8/66: readlink d3/l6 0 2024-02-07T12:25:39.023 INFO:tasks.workunit.client.0.smithi047.stdout:8/67: chown d3/d4/fc 26 1 2024-02-07T12:25:39.023 INFO:tasks.workunit.client.0.smithi047.stdout:6/34: dwrite d3/f8 [0,4194304] 0 2024-02-07T12:25:39.026 INFO:tasks.workunit.client.0.smithi047.stdout:2/49: dwrite f5 [0,4194304] 0 2024-02-07T12:25:39.026 INFO:tasks.workunit.client.0.smithi047.stdout:5/31: fsync f6 0 2024-02-07T12:25:39.029 INFO:tasks.workunit.client.0.smithi047.stdout:6/35: mkdir d3/da 0 2024-02-07T12:25:39.030 INFO:tasks.workunit.client.1.smithi138.stdout:3/954: dread d5/d26/d5e/d86/ded/d32/fb8 [0,4194304] 0 2024-02-07T12:25:39.033 INFO:tasks.workunit.client.0.smithi047.stdout:5/32: rename f6 to f8 0 2024-02-07T12:25:39.033 INFO:tasks.workunit.client.0.smithi047.stdout:5/33: rmdir - no directory 2024-02-07T12:25:39.033 INFO:tasks.workunit.client.0.smithi047.stdout:5/34: readlink - no filename 2024-02-07T12:25:39.033 INFO:tasks.workunit.client.0.smithi047.stdout:5/35: readlink - no filename 2024-02-07T12:25:39.033 INFO:tasks.workunit.client.0.smithi047.stdout:5/36: read f7 [2785175,97703] 0 2024-02-07T12:25:39.036 INFO:tasks.workunit.client.0.smithi047.stdout:3/24: write f2 [1808258,16661] 0 2024-02-07T12:25:39.036 INFO:tasks.workunit.client.0.smithi047.stdout:3/25: chown l3 931015 1 2024-02-07T12:25:39.036 INFO:tasks.workunit.client.0.smithi047.stdout:7/15: dread d0/f2 [0,4194304] 0 2024-02-07T12:25:39.036 INFO:tasks.workunit.client.0.smithi047.stdout:7/16: write d0/f1 [4433680,40873] 0 2024-02-07T12:25:39.036 INFO:tasks.workunit.client.0.smithi047.stdout:5/37: creat f9 x:0 0 0 2024-02-07T12:25:39.036 INFO:tasks.workunit.client.0.smithi047.stdout:5/38: truncate f9 922983 0 2024-02-07T12:25:39.040 INFO:tasks.workunit.client.0.smithi047.stdout:5/39: mkdir da 0 2024-02-07T12:25:39.041 INFO:tasks.workunit.client.0.smithi047.stdout:3/26: mknod c5 0 2024-02-07T12:25:39.044 INFO:tasks.workunit.client.0.smithi047.stdout:5/40: rename f9 to da/fb 0 2024-02-07T12:25:39.046 INFO:tasks.workunit.client.0.smithi047.stdout:5/41: mknod da/cc 0 2024-02-07T12:25:39.046 INFO:tasks.workunit.client.0.smithi047.stdout:3/27: symlink l6 0 2024-02-07T12:25:39.049 INFO:tasks.workunit.client.0.smithi047.stdout:3/28: symlink l7 0 2024-02-07T12:25:39.049 INFO:tasks.workunit.client.0.smithi047.stdout:3/29: readlink l3 0 2024-02-07T12:25:39.050 INFO:tasks.workunit.client.1.smithi138.stdout:2/933: mkdir d3/dd/d14/d86/d148 0 2024-02-07T12:25:39.051 INFO:tasks.workunit.client.1.smithi138.stdout:6/898: dwrite dc/d13/d1e/d11c/f10e [4194304,4194304] 0 2024-02-07T12:25:39.051 INFO:tasks.workunit.client.1.smithi138.stdout:6/899: truncate dc/d73/dc4/d11e/f121 22718 0 2024-02-07T12:25:39.056 INFO:tasks.workunit.client.1.smithi138.stdout:8/941: unlink d1/db3/df0/d106/d3a/f83 0 2024-02-07T12:25:39.062 INFO:tasks.workunit.client.0.smithi047.stdout:3/30: fsync f2 0 2024-02-07T12:25:39.063 INFO:tasks.workunit.client.1.smithi138.stdout:3/955: dwrite d5/d27/d35/d7c/fef [0,4194304] 0 2024-02-07T12:25:39.064 INFO:tasks.workunit.client.1.smithi138.stdout:0/871: dwrite d4/d9/de/f1c [0,4194304] 0 2024-02-07T12:25:39.064 INFO:tasks.workunit.client.1.smithi138.stdout:0/872: stat d4/d52/d3f/lbc 0 2024-02-07T12:25:39.065 INFO:tasks.workunit.client.0.smithi047.stdout:3/31: link l7 l8 0 2024-02-07T12:25:39.068 INFO:tasks.workunit.client.1.smithi138.stdout:4/829: dwrite d20/d53/d71/d75/fbe [0,4194304] 0 2024-02-07T12:25:39.069 INFO:tasks.workunit.client.1.smithi138.stdout:4/830: readlink d20/d34/d36/d55/d74/d9a/lbc 0 2024-02-07T12:25:39.069 INFO:tasks.workunit.client.1.smithi138.stdout:4/831: write d20/d34/d36/d55/d74/d9a/dc0/fce [48878,40955] 0 2024-02-07T12:25:39.069 INFO:tasks.workunit.client.1.smithi138.stdout:4/832: creat d20/d34/d59/d72/d77/f10f x:0 0 0 2024-02-07T12:25:39.069 INFO:tasks.workunit.client.1.smithi138.stdout:6/900: link dc/d13/f42 dc/d73/f127 0 2024-02-07T12:25:39.072 INFO:tasks.workunit.client.1.smithi138.stdout:8/942: creat d1/de/db4/db8/d17/d8a/f129 x:0 0 0 2024-02-07T12:25:39.072 INFO:tasks.workunit.client.0.smithi047.stdout:7/17: truncate d0/f1 3474103 0 2024-02-07T12:25:39.072 INFO:tasks.workunit.client.0.smithi047.stdout:7/18: chown d0/l3 401138 1 2024-02-07T12:25:39.073 INFO:tasks.workunit.client.0.smithi047.stdout:3/32: dread f2 [0,4194304] 0 2024-02-07T12:25:39.074 INFO:tasks.workunit.client.0.smithi047.stdout:7/19: mkdir d0/d4 0 2024-02-07T12:25:39.075 INFO:tasks.workunit.client.0.smithi047.stdout:7/20: creat d0/d4/f5 x:0 0 0 2024-02-07T12:25:39.075 INFO:tasks.workunit.client.0.smithi047.stdout:7/21: stat d0/f2 0 2024-02-07T12:25:39.075 INFO:tasks.workunit.client.0.smithi047.stdout:7/22: write d0/d4/f5 [36491,18868] 0 2024-02-07T12:25:39.076 INFO:tasks.workunit.client.0.smithi047.stdout:7/23: write d0/f2 [724049,107099] 0 2024-02-07T12:25:39.076 INFO:tasks.workunit.client.0.smithi047.stdout:7/24: readlink d0/l3 0 2024-02-07T12:25:39.077 INFO:tasks.workunit.client.1.smithi138.stdout:0/873: rmdir d4/d9/d37/d6b 39 2024-02-07T12:25:39.078 INFO:tasks.workunit.client.0.smithi047.stdout:3/33: dread f2 [0,4194304] 0 2024-02-07T12:25:39.078 INFO:tasks.workunit.client.0.smithi047.stdout:3/34: write f2 [4786694,21456] 0 2024-02-07T12:25:39.078 INFO:tasks.workunit.client.1.smithi138.stdout:3/956: mknod d5/d26/d4e/c147 0 2024-02-07T12:25:39.080 INFO:tasks.workunit.client.0.smithi047.stdout:3/35: unlink l3 0 2024-02-07T12:25:39.083 INFO:tasks.workunit.client.1.smithi138.stdout:4/833: mknod d20/d34/d59/d88/d8d/c110 0 2024-02-07T12:25:39.084 INFO:tasks.workunit.client.1.smithi138.stdout:8/943: mknod d1/de/db4/db8/d17/d3e/d72/c12a 0 2024-02-07T12:25:39.084 INFO:tasks.workunit.client.1.smithi138.stdout:8/944: getdents d1/de/db4/db8/d17/d3e/d10e 0 2024-02-07T12:25:39.084 INFO:tasks.workunit.client.1.smithi138.stdout:3/957: write d5/d26/d5e/d86/ded/d32/fb8 [1904493,60985] 0 2024-02-07T12:25:39.086 INFO:tasks.workunit.client.1.smithi138.stdout:4/834: creat d20/d34/d73/f111 x:0 0 0 2024-02-07T12:25:39.089 INFO:tasks.workunit.client.1.smithi138.stdout:4/835: rename d20/d53/dd1/lf0 to d20/d53/d71/d75/l112 0 2024-02-07T12:25:39.089 INFO:tasks.workunit.client.1.smithi138.stdout:4/836: chown d20/d4d/f99 0 1 2024-02-07T12:25:39.091 INFO:tasks.workunit.client.1.smithi138.stdout:4/837: creat d20/d34/d59/d88/f113 x:0 0 0 2024-02-07T12:25:39.091 INFO:tasks.workunit.client.1.smithi138.stdout:4/838: stat d20/d34/d36/d55/d74/d9a/dc0/fce 0 2024-02-07T12:25:39.094 INFO:tasks.workunit.client.1.smithi138.stdout:4/839: rename d20/d47/d69/d7c/db9/dba to d20/d47/d69/d7c/dfe/d114 0 2024-02-07T12:25:39.095 INFO:tasks.workunit.client.1.smithi138.stdout:4/840: mknod d20/d53/c115 0 2024-02-07T12:25:39.096 INFO:tasks.workunit.client.1.smithi138.stdout:0/874: write d4/d9/de/d1d/d77/f88 [721543,63213] 0 2024-02-07T12:25:39.098 INFO:tasks.workunit.client.1.smithi138.stdout:4/841: creat d20/d47/d69/d7c/db9/f116 x:0 0 0 2024-02-07T12:25:39.098 INFO:tasks.workunit.client.1.smithi138.stdout:4/842: readlink d20/l10c 0 2024-02-07T12:25:39.100 INFO:tasks.workunit.client.1.smithi138.stdout:8/945: read d1/de/db4/db8/d17/f24 [6466895,36476] 0 2024-02-07T12:25:39.102 INFO:tasks.workunit.client.1.smithi138.stdout:4/843: rename d20/d34/d36/d55 to d20/d53/d71/d98/d117 0 2024-02-07T12:25:39.102 INFO:tasks.workunit.client.1.smithi138.stdout:8/946: read d1/de/db4/db8/d17/d3e/dce/fc8 [1365514,81229] 0 2024-02-07T12:25:39.103 INFO:tasks.workunit.client.0.smithi047.stdout:6/36: dwrite d3/f8 [0,4194304] 0 2024-02-07T12:25:39.104 INFO:tasks.workunit.client.1.smithi138.stdout:1/848: dwrite d5/d8/da/d1f/d5e/db5/f8f [0,4194304] 0 2024-02-07T12:25:39.104 INFO:tasks.workunit.client.1.smithi138.stdout:4/844: mknod d20/d47/d69/d76/c118 0 2024-02-07T12:25:39.104 INFO:tasks.workunit.client.1.smithi138.stdout:1/849: fdatasync d5/d8/dbc/fc8 0 2024-02-07T12:25:39.104 INFO:tasks.workunit.client.1.smithi138.stdout:4/845: dread - d20/d47/d69/d7c/db9/f116 zero size 2024-02-07T12:25:39.105 INFO:tasks.workunit.client.0.smithi047.stdout:6/37: symlink d3/lb 0 2024-02-07T12:25:39.105 INFO:tasks.workunit.client.0.smithi047.stdout:6/38: fsync f2 0 2024-02-07T12:25:39.106 INFO:tasks.workunit.client.1.smithi138.stdout:2/934: dwrite d3/dd/d14/d49/d29/f51 [0,4194304] 0 2024-02-07T12:25:39.106 INFO:tasks.workunit.client.1.smithi138.stdout:2/935: chown d3/d4e/d119/d7d/fe1 34 1 2024-02-07T12:25:39.106 INFO:tasks.workunit.client.1.smithi138.stdout:2/936: fsync d3/dd/d14/d86/f113 0 2024-02-07T12:25:39.106 INFO:tasks.workunit.client.1.smithi138.stdout:8/947: link d1/de/db4/db8/d17/l4d d1/de/db4/db8/d17/d3e/d72/d95/l12b 0 2024-02-07T12:25:39.106 INFO:tasks.workunit.client.1.smithi138.stdout:6/901: dwrite f6 [4194304,4194304] 0 2024-02-07T12:25:39.106 INFO:tasks.workunit.client.1.smithi138.stdout:6/902: write dc/d13/d1e/d35/d6d/fa8 [799201,30157] 0 2024-02-07T12:25:39.107 INFO:tasks.workunit.client.0.smithi047.stdout:6/39: link d3/c9 d3/d5/cc 0 2024-02-07T12:25:39.107 INFO:tasks.workunit.client.0.smithi047.stdout:6/40: truncate d3/d5/f6 105680 0 2024-02-07T12:25:39.107 INFO:tasks.workunit.client.0.smithi047.stdout:6/41: chown d3/d5/f7 347120809 1 2024-02-07T12:25:39.107 INFO:tasks.workunit.client.0.smithi047.stdout:6/42: readlink d3/lb 0 2024-02-07T12:25:39.108 INFO:tasks.workunit.client.1.smithi138.stdout:4/846: link d20/d4d/d87/ff9 d20/d53/d71/d75/de8/f119 0 2024-02-07T12:25:39.110 INFO:tasks.workunit.client.0.smithi047.stdout:6/43: rename l0 to d3/ld 0 2024-02-07T12:25:39.110 INFO:tasks.workunit.client.1.smithi138.stdout:6/903: rename dc/d13/d1e/d4d/l124 to dc/d13/d1e/l128 0 2024-02-07T12:25:39.110 INFO:tasks.workunit.client.1.smithi138.stdout:6/904: readlink dc/d13/d1e/d35/l50 0 2024-02-07T12:25:39.114 INFO:tasks.workunit.client.1.smithi138.stdout:6/905: dread dc/d31/f72 [0,4194304] 0 2024-02-07T12:25:39.115 INFO:tasks.workunit.client.0.smithi047.stdout:8/68: dwrite d3/d4/f7 [0,4194304] 0 2024-02-07T12:25:39.116 INFO:tasks.workunit.client.1.smithi138.stdout:3/958: dwrite d5/d26/d9b/dab/dc4/dc7/fe1 [0,4194304] 0 2024-02-07T12:25:39.116 INFO:tasks.workunit.client.1.smithi138.stdout:3/959: getdents d5/d27/dde/d109 0 2024-02-07T12:25:39.116 INFO:tasks.workunit.client.1.smithi138.stdout:3/960: fsync d5/d26/d9b/dab/dc4/f12f 0 2024-02-07T12:25:39.116 INFO:tasks.workunit.client.0.smithi047.stdout:2/50: dwrite d7/dc/f10 [0,4194304] 0 2024-02-07T12:25:39.118 INFO:tasks.workunit.client.0.smithi047.stdout:5/42: dwrite f7 [4194304,4194304] 0 2024-02-07T12:25:39.118 INFO:tasks.workunit.client.0.smithi047.stdout:5/43: chown c4 14 1 2024-02-07T12:25:39.118 INFO:tasks.workunit.client.0.smithi047.stdout:8/69: creat d3/d4/f18 x:0 0 0 2024-02-07T12:25:39.118 INFO:tasks.workunit.client.1.smithi138.stdout:2/937: dread d3/dd/d14/d8f/f68 [8388608,4194304] 0 2024-02-07T12:25:39.121 INFO:tasks.workunit.client.0.smithi047.stdout:6/44: write d3/d5/f7 [943987,108481] 0 2024-02-07T12:25:39.121 INFO:tasks.workunit.client.0.smithi047.stdout:5/44: write da/fb [319750,40384] 0 2024-02-07T12:25:39.122 INFO:tasks.workunit.client.1.smithi138.stdout:3/961: mkdir d5/d26/d28/d148 0 2024-02-07T12:25:39.123 INFO:tasks.workunit.client.0.smithi047.stdout:2/51: link d7/c15 d7/c19 0 2024-02-07T12:25:39.124 INFO:tasks.workunit.client.1.smithi138.stdout:2/938: mkdir d3/dd/d14/d49/d25/d149 0 2024-02-07T12:25:39.127 INFO:tasks.workunit.client.1.smithi138.stdout:0/875: dwrite d4/d9/d37/d6b/d7f/f82 [0,4194304] 0 2024-02-07T12:25:39.127 INFO:tasks.workunit.client.1.smithi138.stdout:0/876: chown d4/d69/lea 138925051 1 2024-02-07T12:25:39.127 INFO:tasks.workunit.client.1.smithi138.stdout:0/877: write d4/d9/de/f108 [463768,47342] 0 2024-02-07T12:25:39.127 INFO:tasks.workunit.client.0.smithi047.stdout:8/70: mknod d3/d16/c19 0 2024-02-07T12:25:39.129 INFO:tasks.workunit.client.0.smithi047.stdout:5/45: rename f8 to da/fd 0 2024-02-07T12:25:39.131 INFO:tasks.workunit.client.1.smithi138.stdout:6/906: dread dc/d13/f14 [0,4194304] 0 2024-02-07T12:25:39.132 INFO:tasks.workunit.client.1.smithi138.stdout:5/818: sync 2024-02-07T12:25:39.133 INFO:tasks.workunit.client.0.smithi047.stdout:5/46: rename c4 to da/ce 0 2024-02-07T12:25:39.135 INFO:tasks.workunit.client.0.smithi047.stdout:5/47: mkdir da/df 0 2024-02-07T12:25:39.136 INFO:tasks.workunit.client.0.smithi047.stdout:3/36: dwrite f2 [0,4194304] 0 2024-02-07T12:25:39.136 INFO:tasks.workunit.client.0.smithi047.stdout:5/48: symlink da/l10 0 2024-02-07T12:25:39.136 INFO:tasks.workunit.client.0.smithi047.stdout:5/49: fsync f7 0 2024-02-07T12:25:39.137 INFO:tasks.workunit.client.0.smithi047.stdout:5/50: chown da/cc 847 1 2024-02-07T12:25:39.137 INFO:tasks.workunit.client.1.smithi138.stdout:4/847: dwrite f1d [0,4194304] 0 2024-02-07T12:25:39.137 INFO:tasks.workunit.client.1.smithi138.stdout:4/848: readlink d20/lf6 0 2024-02-07T12:25:39.137 INFO:tasks.workunit.client.1.smithi138.stdout:4/849: stat d20/d34/d59/d88/ffd 0 2024-02-07T12:25:39.141 INFO:tasks.workunit.client.1.smithi138.stdout:0/878: mkdir d4/d69/d111 0 2024-02-07T12:25:39.143 INFO:tasks.workunit.client.0.smithi047.stdout:2/52: dread d7/f13 [0,4194304] 0 2024-02-07T12:25:39.143 INFO:tasks.workunit.client.0.smithi047.stdout:2/53: fsync d7/f13 0 2024-02-07T12:25:39.144 INFO:tasks.workunit.client.0.smithi047.stdout:2/54: dread d7/fb [0,4194304] 0 2024-02-07T12:25:39.145 INFO:tasks.workunit.client.0.smithi047.stdout:6/45: dread f2 [0,4194304] 0 2024-02-07T12:25:39.146 INFO:tasks.workunit.client.1.smithi138.stdout:6/907: rename dc/d13/f1a to dc/d13/d1e/d35/d6d/da6/f129 0 2024-02-07T12:25:39.149 INFO:tasks.workunit.client.0.smithi047.stdout:2/55: rmdir d7/dc 39 2024-02-07T12:25:39.151 INFO:tasks.workunit.client.1.smithi138.stdout:0/879: getdents d4/d52/d74 0 2024-02-07T12:25:39.155 INFO:tasks.workunit.client.1.smithi138.stdout:6/908: truncate dc/d13/d1e/d35/d85/fad 1038319 0 2024-02-07T12:25:39.155 INFO:tasks.workunit.client.1.smithi138.stdout:6/909: write dc/d13/d1e/d35/d85/d88/fa1 [173709,109737] 0 2024-02-07T12:25:39.157 INFO:tasks.workunit.client.0.smithi047.stdout:7/25: dwrite d0/f2 [0,4194304] 0 2024-02-07T12:25:39.159 INFO:tasks.workunit.client.1.smithi138.stdout:0/880: link d4/d9/d37/d64/d9d/ff2 d4/d9/d75/f112 0 2024-02-07T12:25:39.159 INFO:tasks.workunit.client.1.smithi138.stdout:0/881: write d4/d9/de/f7d [1405438,86786] 0 2024-02-07T12:25:39.159 INFO:tasks.workunit.client.0.smithi047.stdout:7/26: mknod d0/d4/c6 0 2024-02-07T12:25:39.169 INFO:tasks.workunit.client.1.smithi138.stdout:6/910: dread dc/d13/d1e/d35/d6d/da6/d10a/fa9 [0,4194304] 0 2024-02-07T12:25:39.169 INFO:tasks.workunit.client.1.smithi138.stdout:6/911: readlink dc/d13/d1e/d35/d85/dba/lc5 0 2024-02-07T12:25:39.170 INFO:tasks.workunit.client.1.smithi138.stdout:6/912: symlink dc/d13/d1e/d35/d6d/da6/d10a/daa/l12a 0 2024-02-07T12:25:39.171 INFO:tasks.workunit.client.1.smithi138.stdout:6/913: write dc/d13/d1e/d35/d7c/fec [125987,10740] 0 2024-02-07T12:25:39.173 INFO:tasks.workunit.client.0.smithi047.stdout:2/56: dwrite d7/f8 [0,4194304] 0 2024-02-07T12:25:39.173 INFO:tasks.workunit.client.0.smithi047.stdout:2/57: truncate d7/f8 4690672 0 2024-02-07T12:25:39.174 INFO:tasks.workunit.client.1.smithi138.stdout:6/914: creat dc/d31/d54/ddd/df4/f12b x:0 0 0 2024-02-07T12:25:39.174 INFO:tasks.workunit.client.1.smithi138.stdout:6/915: truncate dc/d13/d1e/d35/d85/d88/fa1 548075 0 2024-02-07T12:25:39.174 INFO:tasks.workunit.client.1.smithi138.stdout:6/916: truncate dc/d73/dc4/d11e/f120 384106 0 2024-02-07T12:25:39.177 INFO:tasks.workunit.client.1.smithi138.stdout:0/882: read d4/d9/db/fba [2502304,96216] 0 2024-02-07T12:25:39.178 INFO:tasks.workunit.client.0.smithi047.stdout:8/71: dwrite d3/f9 [4194304,4194304] 0 2024-02-07T12:25:39.178 INFO:tasks.workunit.client.1.smithi138.stdout:3/962: dwrite d5/d26/d5e/d86/d9c/d10d/f121 [0,4194304] 0 2024-02-07T12:25:39.178 INFO:tasks.workunit.client.1.smithi138.stdout:5/819: dwrite da/f85 [0,4194304] 0 2024-02-07T12:25:39.178 INFO:tasks.workunit.client.1.smithi138.stdout:3/963: fsync d5/f9 0 2024-02-07T12:25:39.178 INFO:tasks.workunit.client.1.smithi138.stdout:5/820: chown da/d43/d4a/da2/d112/f33 616642 1 2024-02-07T12:25:39.179 INFO:tasks.workunit.client.1.smithi138.stdout:0/883: write d4/f26 [824554,35097] 0 2024-02-07T12:25:39.179 INFO:tasks.workunit.client.1.smithi138.stdout:0/884: chown d4/d9/d37/d3d/d9c/dad 20 1 2024-02-07T12:25:39.182 INFO:tasks.workunit.client.1.smithi138.stdout:3/964: symlink d5/d34/d79/l149 0 2024-02-07T12:25:39.184 INFO:tasks.workunit.client.1.smithi138.stdout:5/821: creat da/d43/d4a/d69/f114 x:0 0 0 2024-02-07T12:25:39.189 INFO:tasks.workunit.client.0.smithi047.stdout:3/37: truncate f2 1577924 0 2024-02-07T12:25:39.190 INFO:tasks.workunit.client.1.smithi138.stdout:3/965: rename d5/d34/dc5/f105 to d5/d26/d9b/dab/dc4/dd0/dd1/d10f/f14a 0 2024-02-07T12:25:39.191 INFO:tasks.workunit.client.1.smithi138.stdout:5/822: getdents da/d43/d4a/da2/d112/d2e/d4f/da3 0 2024-02-07T12:25:39.191 INFO:tasks.workunit.client.1.smithi138.stdout:5/823: fdatasync da/d22/d99/f9b 0 2024-02-07T12:25:39.191 INFO:tasks.workunit.client.1.smithi138.stdout:5/824: fsync da/d43/d4a/da2/d112/d2e/d4f/d2b/fab 0 2024-02-07T12:25:39.195 INFO:tasks.workunit.client.1.smithi138.stdout:8/948: dwrite d1/db3/df0/d106/f74 [0,4194304] 0 2024-02-07T12:25:39.195 INFO:tasks.workunit.client.1.smithi138.stdout:8/949: dread - d1/de/db4/db8/d96/f111 zero size 2024-02-07T12:25:39.199 INFO:tasks.workunit.client.1.smithi138.stdout:3/966: dread d5/d27/f12a [0,4194304] 0 2024-02-07T12:25:39.199 INFO:tasks.workunit.client.1.smithi138.stdout:8/950: dread d1/db3/df0/d106/d3a/ffb [0,4194304] 0 2024-02-07T12:25:39.202 INFO:tasks.workunit.client.1.smithi138.stdout:3/967: dread d5/d34/d79/f89 [0,4194304] 0 2024-02-07T12:25:39.202 INFO:tasks.workunit.client.1.smithi138.stdout:3/968: chown d5/d26/d5e/d86/ded/fe7 5881649 1 2024-02-07T12:25:39.202 INFO:tasks.workunit.client.1.smithi138.stdout:3/969: write d5/d26/d5e/d86/dc0/ff9 [179011,35665] 0 2024-02-07T12:25:39.202 INFO:tasks.workunit.client.1.smithi138.stdout:9/778: sync 2024-02-07T12:25:39.202 INFO:tasks.workunit.client.1.smithi138.stdout:9/779: fsync d0/d6/d8/d1d/dd/d41/fb2 0 2024-02-07T12:25:39.204 INFO:tasks.workunit.client.1.smithi138.stdout:5/825: dread da/d22/f26 [0,4194304] 0 2024-02-07T12:25:39.204 INFO:tasks.workunit.client.1.smithi138.stdout:3/970: unlink d5/f24 0 2024-02-07T12:25:39.204 INFO:tasks.workunit.client.1.smithi138.stdout:3/971: dread - d5/d27/d35/f13d zero size 2024-02-07T12:25:39.207 INFO:tasks.workunit.client.1.smithi138.stdout:5/826: getdents da/d43/d4a/da2/d112/d2e/d4f/d2b/d35/d67 0 2024-02-07T12:25:39.207 INFO:tasks.workunit.client.1.smithi138.stdout:9/780: rmdir d0/d34/d86 39 2024-02-07T12:25:39.207 INFO:tasks.workunit.client.0.smithi047.stdout:7/27: dwrite d0/f2 [0,4194304] 0 2024-02-07T12:25:39.209 INFO:tasks.workunit.client.1.smithi138.stdout:6/917: dwrite dc/d13/d8e/faf [0,4194304] 0 2024-02-07T12:25:39.212 INFO:tasks.workunit.client.0.smithi047.stdout:6/46: truncate d3/d5/f6 31576 0 2024-02-07T12:25:39.212 INFO:tasks.workunit.client.0.smithi047.stdout:8/72: dwrite d3/f17 [0,4194304] 0 2024-02-07T12:25:39.216 INFO:tasks.workunit.client.1.smithi138.stdout:0/885: rmdir d4/d9/d37 39 2024-02-07T12:25:39.216 INFO:tasks.workunit.client.1.smithi138.stdout:0/886: creat d4/d9/d75/f113 x:0 0 0 2024-02-07T12:25:39.224 INFO:tasks.workunit.client.1.smithi138.stdout:8/951: dwrite d1/de/db4/db8/d17/d3e/dce/fa0 [0,4194304] 0 2024-02-07T12:25:39.227 INFO:tasks.workunit.client.1.smithi138.stdout:0/887: dread d4/d9/f22 [0,4194304] 0 2024-02-07T12:25:39.227 INFO:tasks.workunit.client.1.smithi138.stdout:0/888: rename d4/d9/d37 to d4/d9/d37/d114 22 2024-02-07T12:25:39.227 INFO:tasks.workunit.client.1.smithi138.stdout:8/952: mkdir d1/db3/df0/d106/d3a/d12c 0 2024-02-07T12:25:39.228 INFO:tasks.workunit.client.1.smithi138.stdout:8/953: mkdir d1/d99/da6/d12d 0 2024-02-07T12:25:39.234 INFO:tasks.workunit.client.1.smithi138.stdout:8/954: dread d1/de/db4/db8/d17/d3e/d72/dda/d4c/d119/f11d [0,4194304] 0 2024-02-07T12:25:39.234 INFO:tasks.workunit.client.1.smithi138.stdout:8/955: stat d1/db3/df0/d106/f78 0 2024-02-07T12:25:39.234 INFO:tasks.workunit.client.1.smithi138.stdout:8/956: chown d1/c2b 22 1 2024-02-07T12:25:39.234 INFO:tasks.workunit.client.1.smithi138.stdout:8/957: read d1/d8e/fa5 [1360613,107783] 0 2024-02-07T12:25:39.235 INFO:tasks.workunit.client.1.smithi138.stdout:8/958: mkdir d1/de/db4/db8/dd2/d12e 0 2024-02-07T12:25:39.235 INFO:tasks.workunit.client.1.smithi138.stdout:8/959: chown d1/lc 330 1 2024-02-07T12:25:39.235 INFO:tasks.workunit.client.1.smithi138.stdout:8/960: symlink d1/de/db4/db8/d96/l12f 0 2024-02-07T12:25:39.235 INFO:tasks.workunit.client.1.smithi138.stdout:8/961: write d1/de/db4/db8/d96/f111 [819386,61127] 0 2024-02-07T12:25:39.236 INFO:tasks.workunit.client.1.smithi138.stdout:8/962: mknod d1/d99/da6/de7/c130 0 2024-02-07T12:25:39.236 INFO:tasks.workunit.client.1.smithi138.stdout:8/963: dread - d1/db3/f10b zero size 2024-02-07T12:25:39.237 INFO:tasks.workunit.client.0.smithi047.stdout:8/73: dwrite d3/f9 [4194304,4194304] 0 2024-02-07T12:25:39.237 INFO:tasks.workunit.client.1.smithi138.stdout:8/964: mknod d1/c131 0 2024-02-07T12:25:39.237 INFO:tasks.workunit.client.1.smithi138.stdout:8/965: creat d1/f132 x:0 0 0 2024-02-07T12:25:39.240 INFO:tasks.workunit.client.1.smithi138.stdout:8/966: mkdir d1/de/db4/db8/d17/d3e/d72/dda/d4c/d107/d133 0 2024-02-07T12:25:39.240 INFO:tasks.workunit.client.1.smithi138.stdout:8/967: fdatasync d1/ddc/f128 0 2024-02-07T12:25:39.240 INFO:tasks.workunit.client.1.smithi138.stdout:8/968: dread - d1/de/db4/db8/d17/d3e/f5a zero size 2024-02-07T12:25:39.240 INFO:tasks.workunit.client.1.smithi138.stdout:6/918: dread dc/d13/d1e/dae/feb [0,4194304] 0 2024-02-07T12:25:39.240 INFO:tasks.workunit.client.0.smithi047.stdout:2/58: dwrite d7/fb [0,4194304] 0 2024-02-07T12:25:39.244 INFO:tasks.workunit.client.1.smithi138.stdout:8/969: link d1/de/db4/db8/d17/d58/la9 d1/d99/l134 0 2024-02-07T12:25:39.244 INFO:tasks.workunit.client.1.smithi138.stdout:8/970: write d1/de/db4/db8/f1e [5034043,18571] 0 2024-02-07T12:25:39.244 INFO:tasks.workunit.client.1.smithi138.stdout:8/971: fsync d1/f9e 0 2024-02-07T12:25:39.244 INFO:tasks.workunit.client.1.smithi138.stdout:8/972: chown d1/de/db4/db8/d17/d3e/d72/dda/d4c/f65 465 1 2024-02-07T12:25:39.244 INFO:tasks.workunit.client.1.smithi138.stdout:6/919: unlink dc/d13/d1e/d35/d7c/dbe/f10d 0 2024-02-07T12:25:39.248 INFO:tasks.workunit.client.1.smithi138.stdout:6/920: dread dc/d13/d1e/f5f [0,4194304] 0 2024-02-07T12:25:39.250 INFO:tasks.workunit.client.1.smithi138.stdout:6/921: creat dc/d13/d1e/d35/d85/dba/f12c x:0 0 0 2024-02-07T12:25:39.250 INFO:tasks.workunit.client.1.smithi138.stdout:6/922: chown dc/d13/d1e/d35/c62 6230 1 2024-02-07T12:25:39.251 INFO:tasks.workunit.client.0.smithi047.stdout:2/59: write d7/f8 [46954,120258] 0 2024-02-07T12:25:39.254 INFO:tasks.workunit.client.0.smithi047.stdout:2/60: creat d7/dc/f1a x:0 0 0 2024-02-07T12:25:39.255 INFO:tasks.workunit.client.0.smithi047.stdout:8/74: dread d3/f9 [4194304,4194304] 0 2024-02-07T12:25:39.256 INFO:tasks.workunit.client.1.smithi138.stdout:8/973: dread d1/db3/df0/d106/d3a/f66 [0,4194304] 0 2024-02-07T12:25:39.256 INFO:tasks.workunit.client.0.smithi047.stdout:2/61: symlink d7/dc/l1b 0 2024-02-07T12:25:39.256 INFO:tasks.workunit.client.0.smithi047.stdout:2/62: stat f5 0 2024-02-07T12:25:39.259 INFO:tasks.workunit.client.1.smithi138.stdout:3/972: dwrite d5/d34/fa0 [0,4194304] 0 2024-02-07T12:25:39.259 INFO:tasks.workunit.client.1.smithi138.stdout:3/973: chown d5/d27/d35/d7c 34335660 1 2024-02-07T12:25:39.278 INFO:tasks.workunit.client.0.smithi047.stdout:7/28: dwrite d0/f2 [0,4194304] 0 2024-02-07T12:25:39.278 INFO:tasks.workunit.client.0.smithi047.stdout:7/29: creat d0/d4/f7 x:0 0 0 2024-02-07T12:25:39.279 INFO:tasks.workunit.client.1.smithi138.stdout:9/781: dwrite d0/d6/d8/d1d/dd/d41/f79 [0,4194304] 0 2024-02-07T12:25:39.280 INFO:tasks.workunit.client.1.smithi138.stdout:0/889: dwrite d4/fd [0,4194304] 0 2024-02-07T12:25:39.280 INFO:tasks.workunit.client.1.smithi138.stdout:0/890: readlink d4/d9/d37/d64/d9a/db0/lc8 0 2024-02-07T12:25:39.290 INFO:tasks.workunit.client.1.smithi138.stdout:6/923: dwrite dc/d13/d1e/d35/d85/f104 [0,4194304] 0 2024-02-07T12:25:39.290 INFO:tasks.workunit.client.0.smithi047.stdout:6/47: dwrite d3/d5/f7 [0,4194304] 0 2024-02-07T12:25:39.292 INFO:tasks.workunit.client.0.smithi047.stdout:7/30: write d0/f2 [2676763,11150] 0 2024-02-07T12:25:39.292 INFO:tasks.workunit.client.1.smithi138.stdout:8/974: dwrite d1/de/f53 [0,4194304] 0 2024-02-07T12:25:39.293 INFO:tasks.workunit.client.0.smithi047.stdout:8/75: dwrite d3/f17 [0,4194304] 0 2024-02-07T12:25:39.295 INFO:tasks.workunit.client.1.smithi138.stdout:6/924: mknod dc/d13/d1e/d35/d6d/dfe/c12d 0 2024-02-07T12:25:39.295 INFO:tasks.workunit.client.1.smithi138.stdout:6/925: fdatasync dc/d13/d1e/f5f 0 2024-02-07T12:25:39.295 INFO:tasks.workunit.client.1.smithi138.stdout:6/926: truncate dc/d13/d1e/d35/d6d/da6/d10a/fcf 948120 0 2024-02-07T12:25:39.295 INFO:tasks.workunit.client.0.smithi047.stdout:8/76: mknod d3/d16/c1a 0 2024-02-07T12:25:39.296 INFO:tasks.workunit.client.0.smithi047.stdout:7/31: getdents d0 0 2024-02-07T12:25:39.296 INFO:tasks.workunit.client.0.smithi047.stdout:7/32: chown d0/d4/f5 76 1 2024-02-07T12:25:39.296 INFO:tasks.workunit.client.0.smithi047.stdout:7/33: creat d0/d4/f8 x:0 0 0 2024-02-07T12:25:39.299 INFO:tasks.workunit.client.1.smithi138.stdout:8/975: rename d1/de/db4/db8/d17/d3e/d72/dda/l10c to d1/de/db4/db8/d17/d3e/l135 0 2024-02-07T12:25:39.302 INFO:tasks.workunit.client.1.smithi138.stdout:8/976: symlink d1/de/db4/db8/d17/d8a/db6/l136 0 2024-02-07T12:25:39.303 INFO:tasks.workunit.client.1.smithi138.stdout:0/891: dwrite d4/d9/de/d1d/d21/fd4 [0,4194304] 0 2024-02-07T12:25:39.305 INFO:tasks.workunit.client.1.smithi138.stdout:8/977: mknod d1/de/db4/db8/c137 0 2024-02-07T12:25:39.308 INFO:tasks.workunit.client.1.smithi138.stdout:6/927: dread dc/d13/d1e/d35/d85/dba/f102 [0,4194304] 0 2024-02-07T12:25:39.308 INFO:tasks.workunit.client.1.smithi138.stdout:6/928: write dc/d13/d1e/d35/d7c/dbe/fd6 [5300800,75785] 0 2024-02-07T12:25:39.309 INFO:tasks.workunit.client.1.smithi138.stdout:6/929: write dc/d31/f37 [4682195,64600] 0 2024-02-07T12:25:39.309 INFO:tasks.workunit.client.1.smithi138.stdout:8/978: unlink d1/de/db4/db8/d17/ff6 0 2024-02-07T12:25:39.310 INFO:tasks.workunit.client.1.smithi138.stdout:0/892: dread d4/d9/f18 [0,4194304] 0 2024-02-07T12:25:39.312 INFO:tasks.workunit.client.1.smithi138.stdout:6/930: symlink dc/d73/l12e 0 2024-02-07T12:25:39.314 INFO:tasks.workunit.client.1.smithi138.stdout:8/979: truncate d1/de/db4/db8/d17/d58/f97 1230188 0 2024-02-07T12:25:39.314 INFO:tasks.workunit.client.1.smithi138.stdout:8/980: getdents d1/de/db4/db8/dd2/d12e 0 2024-02-07T12:25:39.315 INFO:tasks.workunit.client.1.smithi138.stdout:6/931: symlink dc/d31/d3f/l12f 0 2024-02-07T12:25:39.316 INFO:tasks.workunit.client.1.smithi138.stdout:8/981: creat d1/de/db4/db8/d17/d3e/f138 x:0 0 0 2024-02-07T12:25:39.316 INFO:tasks.workunit.client.1.smithi138.stdout:8/982: creat d1/de/db4/db8/d17/d8a/dd7/f139 x:0 0 0 2024-02-07T12:25:39.316 INFO:tasks.workunit.client.0.smithi047.stdout:7/34: dread d0/f2 [0,4194304] 0 2024-02-07T12:25:39.319 INFO:tasks.workunit.client.1.smithi138.stdout:6/932: dread dc/d13/d1e/d35/fb0 [0,4194304] 0 2024-02-07T12:25:39.321 INFO:tasks.workunit.client.0.smithi047.stdout:6/48: dwrite d3/d5/f6 [0,4194304] 0 2024-02-07T12:25:39.323 INFO:tasks.workunit.client.0.smithi047.stdout:2/63: dwrite d7/f8 [0,4194304] 0 2024-02-07T12:25:39.323 INFO:tasks.workunit.client.0.smithi047.stdout:2/64: fdatasync d7/f12 0 2024-02-07T12:25:39.326 INFO:tasks.workunit.client.0.smithi047.stdout:8/77: dwrite d3/d4/f12 [0,4194304] 0 2024-02-07T12:25:39.331 INFO:tasks.workunit.client.0.smithi047.stdout:8/78: mknod d3/d16/c1b 0 2024-02-07T12:25:39.332 INFO:tasks.workunit.client.0.smithi047.stdout:8/79: mknod d3/c1c 0 2024-02-07T12:25:39.332 INFO:tasks.workunit.client.0.smithi047.stdout:8/80: creat d3/f1d x:0 0 0 2024-02-07T12:25:39.333 INFO:tasks.workunit.client.0.smithi047.stdout:2/65: dread f2 [0,4194304] 0 2024-02-07T12:25:39.334 INFO:tasks.workunit.client.0.smithi047.stdout:8/81: rmdir d3/d16 39 2024-02-07T12:25:39.334 INFO:tasks.workunit.client.0.smithi047.stdout:8/82: chown d3/d4/le 239156 1 2024-02-07T12:25:39.334 INFO:tasks.workunit.client.0.smithi047.stdout:8/83: creat d3/d4/f1e x:0 0 0 2024-02-07T12:25:39.345 INFO:tasks.workunit.client.1.smithi138.stdout:6/933: dwrite dc/d31/d54/ddd/f111 [0,4194304] 0 2024-02-07T12:25:39.345 INFO:tasks.workunit.client.1.smithi138.stdout:6/934: write dc/d73/f127 [4691054,110749] 0 2024-02-07T12:25:39.346 INFO:tasks.workunit.client.0.smithi047.stdout:7/35: dwrite d0/d4/f5 [0,4194304] 0 2024-02-07T12:25:39.346 INFO:tasks.workunit.client.0.smithi047.stdout:7/36: readlink d0/l3 0 2024-02-07T12:25:39.346 INFO:tasks.workunit.client.0.smithi047.stdout:7/37: write d0/d4/f7 [239321,86123] 0 2024-02-07T12:25:39.346 INFO:tasks.workunit.client.0.smithi047.stdout:7/38: rename d0 to d0/d9 22 2024-02-07T12:25:39.346 INFO:tasks.workunit.client.0.smithi047.stdout:7/39: creat d0/d4/fa x:0 0 0 2024-02-07T12:25:39.348 INFO:tasks.workunit.client.0.smithi047.stdout:7/40: mknod d0/cb 0 2024-02-07T12:25:39.349 INFO:tasks.workunit.client.1.smithi138.stdout:0/893: dwrite d4/d9/f40 [4194304,4194304] 0 2024-02-07T12:25:39.349 INFO:tasks.workunit.client.1.smithi138.stdout:0/894: write d4/d9/d75/f113 [478232,36803] 0 2024-02-07T12:25:39.349 INFO:tasks.workunit.client.1.smithi138.stdout:8/983: dwrite d1/d8e/f91 [0,4194304] 0 2024-02-07T12:25:39.349 INFO:tasks.workunit.client.0.smithi047.stdout:2/66: dwrite d7/f8 [0,4194304] 0 2024-02-07T12:25:39.350 INFO:tasks.workunit.client.1.smithi138.stdout:6/935: link dc/d31/d38/f101 dc/d73/f130 0 2024-02-07T12:25:39.350 INFO:tasks.workunit.client.1.smithi138.stdout:6/936: stat dc/d13/d1e/d35/d7c/c122 0 2024-02-07T12:25:39.350 INFO:tasks.workunit.client.1.smithi138.stdout:6/937: chown dc/d13/d1e/l29 706 1 2024-02-07T12:25:39.351 INFO:tasks.workunit.client.0.smithi047.stdout:7/41: mknod d0/cc 0 2024-02-07T12:25:39.351 INFO:tasks.workunit.client.0.smithi047.stdout:7/42: fsync d0/d4/f5 0 2024-02-07T12:25:39.353 INFO:tasks.workunit.client.0.smithi047.stdout:2/67: link d7/cd d7/dc/c1c 0 2024-02-07T12:25:39.353 INFO:tasks.workunit.client.0.smithi047.stdout:2/68: dread - d7/f12 zero size 2024-02-07T12:25:39.355 INFO:tasks.workunit.client.1.smithi138.stdout:8/984: creat d1/db3/df0/d106/dcc/f13a x:0 0 0 2024-02-07T12:25:39.355 INFO:tasks.workunit.client.0.smithi047.stdout:7/43: symlink d0/ld 0 2024-02-07T12:25:39.355 INFO:tasks.workunit.client.0.smithi047.stdout:2/69: stat d7/c15 0 2024-02-07T12:25:39.356 INFO:tasks.workunit.client.0.smithi047.stdout:7/44: rename d0/d4/f7 to d0/d4/fe 0 2024-02-07T12:25:39.357 INFO:tasks.workunit.client.1.smithi138.stdout:6/938: rename dc/d13/d1e/l29 to dc/d13/d1e/d35/d6d/da6/d10a/daa/l131 0 2024-02-07T12:25:39.357 INFO:tasks.workunit.client.1.smithi138.stdout:6/939: chown dc/d13/d1e/f8c 0 1 2024-02-07T12:25:39.357 INFO:tasks.workunit.client.1.smithi138.stdout:6/940: creat dc/d13/d1e/f132 x:0 0 0 2024-02-07T12:25:39.364 INFO:tasks.workunit.client.1.smithi138.stdout:1/850: sync 2024-02-07T12:25:39.364 INFO:tasks.workunit.client.1.smithi138.stdout:1/851: dread - d5/d8/dbc/fea zero size 2024-02-07T12:25:39.364 INFO:tasks.workunit.client.1.smithi138.stdout:1/852: stat d5/d8/l4c 0 2024-02-07T12:25:39.364 INFO:tasks.workunit.client.1.smithi138.stdout:1/853: getdents d5/d4b/d6b 0 2024-02-07T12:25:39.364 INFO:tasks.workunit.client.1.smithi138.stdout:1/854: unlink f4 0 2024-02-07T12:25:39.364 INFO:tasks.workunit.client.1.smithi138.stdout:1/855: stat d5/dfd/fca 0 2024-02-07T12:25:39.365 INFO:tasks.workunit.client.1.smithi138.stdout:1/856: chown d5/d43 1524299 1 2024-02-07T12:25:39.365 INFO:tasks.workunit.client.0.smithi047.stdout:7/45: write d0/d4/f5 [4543184,82483] 0 2024-02-07T12:25:39.365 INFO:tasks.workunit.client.0.smithi047.stdout:7/46: write d0/f1 [4239449,3005] 0 2024-02-07T12:25:39.366 INFO:tasks.workunit.client.0.smithi047.stdout:7/47: mkdir d0/df 0 2024-02-07T12:25:39.366 INFO:tasks.workunit.client.0.smithi047.stdout:7/48: stat d0/f1 0 2024-02-07T12:25:39.366 INFO:tasks.workunit.client.0.smithi047.stdout:7/49: truncate d0/d4/fa 75124 0 2024-02-07T12:25:39.366 INFO:tasks.workunit.client.0.smithi047.stdout:7/50: dread - d0/d4/f8 zero size 2024-02-07T12:25:39.367 INFO:tasks.workunit.client.1.smithi138.stdout:1/857: rmdir d5/d8/da/d4a 39 2024-02-07T12:25:39.367 INFO:tasks.workunit.client.1.smithi138.stdout:1/858: mkdir d5/d4b/d6b/d116 0 2024-02-07T12:25:39.367 INFO:tasks.workunit.client.1.smithi138.stdout:1/859: truncate d5/d4b/d6b/d6e/d79/ffc 848884 0 2024-02-07T12:25:39.367 INFO:tasks.workunit.client.1.smithi138.stdout:1/860: write d5/d4b/f5d [1993585,129629] 0 2024-02-07T12:25:39.367 INFO:tasks.workunit.client.0.smithi047.stdout:2/70: rmdir d7/dc 39 2024-02-07T12:25:39.368 INFO:tasks.workunit.client.0.smithi047.stdout:2/71: readlink d7/dc/l1b 0 2024-02-07T12:25:39.368 INFO:tasks.workunit.client.0.smithi047.stdout:2/72: symlink d7/dc/l1d 0 2024-02-07T12:25:39.368 INFO:tasks.workunit.client.0.smithi047.stdout:2/73: truncate d7/f12 433773 0 2024-02-07T12:25:39.369 INFO:tasks.workunit.client.1.smithi138.stdout:8/985: dwrite d1/d99/f7d [0,4194304] 0 2024-02-07T12:25:39.371 INFO:tasks.workunit.client.1.smithi138.stdout:8/986: stat d1/d8e/f8f 0 2024-02-07T12:25:39.379 INFO:tasks.workunit.client.0.smithi047.stdout:2/74: read f5 [523587,24007] 0 2024-02-07T12:25:39.380 INFO:tasks.workunit.client.1.smithi138.stdout:8/987: dread d1/de/db4/fde [0,4194304] 0 2024-02-07T12:25:39.380 INFO:tasks.workunit.client.1.smithi138.stdout:8/988: stat d1/de/l7a 0 2024-02-07T12:25:39.382 INFO:tasks.workunit.client.1.smithi138.stdout:8/989: unlink d1/de/db4/db8/d17/d58/f97 0 2024-02-07T12:25:39.382 INFO:tasks.workunit.client.1.smithi138.stdout:8/990: dread - d1/d8e/d116/f117 zero size 2024-02-07T12:25:39.386 INFO:tasks.workunit.client.0.smithi047.stdout:7/51: dwrite d0/f2 [0,4194304] 0 2024-02-07T12:25:39.386 INFO:tasks.workunit.client.0.smithi047.stdout:7/52: readlink d0/ld 0 2024-02-07T12:25:39.390 INFO:tasks.workunit.client.1.smithi138.stdout:1/861: dwrite d5/d8/da/d1f/d60/df4/d59/fa9 [0,4194304] 0 2024-02-07T12:25:39.393 INFO:tasks.workunit.client.1.smithi138.stdout:8/991: write d1/de/db4/db8/d17/d8a/db6/fd5 [1322818,44332] 0 2024-02-07T12:25:39.398 INFO:tasks.workunit.client.1.smithi138.stdout:8/992: symlink d1/de/l13b 0 2024-02-07T12:25:39.400 INFO:tasks.workunit.client.1.smithi138.stdout:8/993: symlink d1/l13c 0 2024-02-07T12:25:39.401 INFO:tasks.workunit.client.0.smithi047.stdout:2/75: dwrite f2 [0,4194304] 0 2024-02-07T12:25:39.401 INFO:tasks.workunit.client.0.smithi047.stdout:2/76: rmdir d7/dc 39 2024-02-07T12:25:39.405 INFO:tasks.workunit.client.1.smithi138.stdout:8/994: rename d1/de/db4/db8/d17/d3e/fb1 to d1/de/db4/db8/d17/d8a/dd7/f13d 0 2024-02-07T12:25:39.417 INFO:tasks.workunit.client.0.smithi047.stdout:7/53: dwrite d0/d4/fa [0,4194304] 0 2024-02-07T12:25:39.417 INFO:tasks.workunit.client.0.smithi047.stdout:7/54: write d0/d4/fe [144657,81502] 0 2024-02-07T12:25:39.418 INFO:tasks.workunit.client.0.smithi047.stdout:7/55: truncate d0/d4/fe 576100 0 2024-02-07T12:25:39.418 INFO:tasks.workunit.client.0.smithi047.stdout:7/56: chown d0/d4/f8 1099945 1 2024-02-07T12:25:39.418 INFO:tasks.workunit.client.1.smithi138.stdout:1/862: dwrite d5/d8/da/d1f/d60/df4/fe1 [4194304,4194304] 0 2024-02-07T12:25:39.418 INFO:tasks.workunit.client.1.smithi138.stdout:1/863: write d5/d8/da/d1f/d5e/d63/fc5 [416629,39766] 0 2024-02-07T12:25:39.419 INFO:tasks.workunit.client.0.smithi047.stdout:7/57: mknod d0/df/c10 0 2024-02-07T12:25:39.421 INFO:tasks.workunit.client.0.smithi047.stdout:7/58: rmdir d0/d4 39 2024-02-07T12:25:39.422 INFO:tasks.workunit.client.0.smithi047.stdout:7/59: rmdir d0/d4 39 2024-02-07T12:25:39.424 INFO:tasks.workunit.client.1.smithi138.stdout:1/864: dread d5/d8/f14 [4194304,4194304] 0 2024-02-07T12:25:39.424 INFO:tasks.workunit.client.0.smithi047.stdout:2/77: dwrite d7/f14 [0,4194304] 0 2024-02-07T12:25:39.425 INFO:tasks.workunit.client.0.smithi047.stdout:2/78: chown d7/dc/l1b 368 1 2024-02-07T12:25:39.427 INFO:tasks.workunit.client.0.smithi047.stdout:2/79: write d7/f14 [4573698,20330] 0 2024-02-07T12:25:39.430 INFO:tasks.workunit.client.1.smithi138.stdout:1/865: unlink d5/d8/da/f2f 0 2024-02-07T12:25:39.430 INFO:tasks.workunit.client.0.smithi047.stdout:2/80: link f2 d7/f1e 0 2024-02-07T12:25:39.431 INFO:tasks.workunit.client.0.smithi047.stdout:7/60: read d0/f1 [2333579,83944] 0 2024-02-07T12:25:39.431 INFO:tasks.workunit.client.0.smithi047.stdout:7/61: write d0/f1 [985458,12236] 0 2024-02-07T12:25:39.431 INFO:tasks.workunit.client.1.smithi138.stdout:1/866: symlink d5/d8/da/d1f/d5e/db5/d68/d73/d7b/dda/l117 0 2024-02-07T12:25:39.433 INFO:tasks.workunit.client.0.smithi047.stdout:7/62: link d0/d4/f5 d0/df/f11 0 2024-02-07T12:25:39.433 INFO:tasks.workunit.client.1.smithi138.stdout:1/867: truncate d5/d8/dbc/deb/fba 110865 0 2024-02-07T12:25:39.434 INFO:tasks.workunit.client.0.smithi047.stdout:7/63: creat d0/d4/f12 x:0 0 0 2024-02-07T12:25:39.446 INFO:tasks.workunit.client.1.smithi138.stdout:1/868: write d5/d8/da/d1f/f96 [1510613,40036] 0 2024-02-07T12:25:39.448 INFO:tasks.workunit.client.1.smithi138.stdout:1/869: creat d5/d4b/d65/de2/f118 x:0 0 0 2024-02-07T12:25:39.449 INFO:tasks.workunit.client.0.smithi047.stdout:2/81: dwrite f5 [0,4194304] 0 2024-02-07T12:25:39.449 INFO:tasks.workunit.client.1.smithi138.stdout:1/870: creat d5/d4b/d91/f119 x:0 0 0 2024-02-07T12:25:39.450 INFO:tasks.workunit.client.0.smithi047.stdout:2/82: dread d7/f12 [0,4194304] 0 2024-02-07T12:25:39.450 INFO:tasks.workunit.client.0.smithi047.stdout:7/64: truncate d0/df/f11 3687833 0 2024-02-07T12:25:39.451 INFO:tasks.workunit.client.0.smithi047.stdout:2/83: link d7/dc/c1c d7/c1f 0 2024-02-07T12:25:39.455 INFO:tasks.workunit.client.0.smithi047.stdout:2/84: rename d7/f14 to d7/f20 0 2024-02-07T12:25:39.456 INFO:tasks.workunit.client.0.smithi047.stdout:2/85: symlink d7/l21 0 2024-02-07T12:25:39.460 INFO:tasks.workunit.client.1.smithi138.stdout:1/871: read d5/d8/da/d1f/d5e/d63/f64 [283818,35757] 0 2024-02-07T12:25:39.460 INFO:tasks.workunit.client.1.smithi138.stdout:1/872: write d5/d8/da/d1f/d5e/d63/fde [731905,19937] 0 2024-02-07T12:25:39.460 INFO:tasks.workunit.client.1.smithi138.stdout:1/873: fsync d5/d8/dbc/fc8 0 2024-02-07T12:25:39.460 INFO:tasks.workunit.client.0.smithi047.stdout:7/65: truncate d0/df/f11 1194021 0 2024-02-07T12:25:39.461 INFO:tasks.workunit.client.1.smithi138.stdout:1/874: rmdir d5/d8/da/d1f/d5e/db5/d58 39 2024-02-07T12:25:39.462 INFO:tasks.workunit.client.1.smithi138.stdout:1/875: symlink d5/d8/da/d1f/d60/df4/d59/d108/l11a 0 2024-02-07T12:25:39.462 INFO:tasks.workunit.client.1.smithi138.stdout:1/876: write d5/d8/da/d1f/d60/df4/fef [625961,48312] 0 2024-02-07T12:25:39.462 INFO:tasks.workunit.client.1.smithi138.stdout:1/877: chown d5/d8/da/d1f/d5e/db5/d68/da7/cd2 1173 1 2024-02-07T12:25:39.462 INFO:tasks.workunit.client.1.smithi138.stdout:1/878: fsync d5/d4b/f5d 0 2024-02-07T12:25:39.464 INFO:tasks.workunit.client.0.smithi047.stdout:7/66: unlink d0/f1 0 2024-02-07T12:25:39.466 INFO:tasks.workunit.client.0.smithi047.stdout:7/67: symlink d0/d4/l13 0 2024-02-07T12:25:39.467 INFO:tasks.workunit.client.0.smithi047.stdout:7/68: symlink d0/df/l14 0 2024-02-07T12:25:39.469 INFO:tasks.workunit.client.0.smithi047.stdout:7/69: creat d0/df/f15 x:0 0 0 2024-02-07T12:25:39.469 INFO:tasks.workunit.client.0.smithi047.stdout:7/70: dread - d0/df/f15 zero size 2024-02-07T12:25:39.469 INFO:tasks.workunit.client.0.smithi047.stdout:7/71: creat d0/d4/f16 x:0 0 0 2024-02-07T12:25:39.469 INFO:tasks.workunit.client.0.smithi047.stdout:7/72: creat d0/d4/f17 x:0 0 0 2024-02-07T12:25:39.475 INFO:tasks.workunit.client.0.smithi047.stdout:7/73: rename d0/d4/fa to d0/f18 0 2024-02-07T12:25:39.478 INFO:tasks.workunit.client.0.smithi047.stdout:7/74: dread d0/d4/f5 [0,4194304] 0 2024-02-07T12:25:39.478 INFO:tasks.workunit.client.1.smithi138.stdout:4/850: sync 2024-02-07T12:25:39.478 INFO:tasks.workunit.client.1.smithi138.stdout:2/939: sync 2024-02-07T12:25:39.478 INFO:tasks.workunit.client.1.smithi138.stdout:2/940: chown d3/d4e/d119/c145 4 1 2024-02-07T12:25:39.487 INFO:tasks.workunit.client.1.smithi138.stdout:1/879: dwrite d5/d8/da/d20/f41 [4194304,4194304] 0 2024-02-07T12:25:39.487 INFO:tasks.workunit.client.1.smithi138.stdout:4/851: write d20/d47/d69/d76/f7a [3865916,65528] 0 2024-02-07T12:25:39.502 INFO:tasks.workunit.client.0.smithi047.stdout:7/75: dread d0/f18 [0,4194304] 0 2024-02-07T12:25:39.502 INFO:tasks.workunit.client.0.smithi047.stdout:7/76: chown d0/d4/l13 55 1 2024-02-07T12:25:39.503 INFO:tasks.workunit.client.0.smithi047.stdout:7/77: truncate d0/d4/f5 1012475 0 2024-02-07T12:25:39.503 INFO:tasks.workunit.client.0.smithi047.stdout:7/78: write d0/d4/fe [225602,102599] 0 2024-02-07T12:25:39.509 INFO:tasks.workunit.client.1.smithi138.stdout:1/880: dwrite d5/d8/da/d20/dc2/fce [0,4194304] 0 2024-02-07T12:25:39.510 INFO:tasks.workunit.client.1.smithi138.stdout:4/852: dwrite d20/d53/d71/d75/d94/ff8 [0,4194304] 0 2024-02-07T12:25:39.514 INFO:tasks.workunit.client.1.smithi138.stdout:4/853: creat d20/d53/d71/d75/de8/f11a x:0 0 0 2024-02-07T12:25:39.516 INFO:tasks.workunit.client.1.smithi138.stdout:4/854: mkdir d20/d53/dd1/d11b 0 2024-02-07T12:25:39.530 INFO:tasks.workunit.client.1.smithi138.stdout:4/855: write d20/f32 [1926988,117961] 0 2024-02-07T12:25:39.530 INFO:tasks.workunit.client.1.smithi138.stdout:4/856: write d20/f2e [246031,110366] 0 2024-02-07T12:25:39.535 INFO:tasks.workunit.client.0.smithi047.stdout:7/79: dwrite d0/d4/f12 [0,4194304] 0 2024-02-07T12:25:39.535 INFO:tasks.workunit.client.1.smithi138.stdout:1/881: dwrite d5/d8/da/d1f/d5e/db5/d68/f9d [0,4194304] 0 2024-02-07T12:25:39.537 INFO:tasks.workunit.client.0.smithi047.stdout:7/80: truncate d0/f2 3305155 0 2024-02-07T12:25:39.538 INFO:tasks.workunit.client.0.smithi047.stdout:7/81: mknod d0/c19 0 2024-02-07T12:25:39.538 INFO:tasks.workunit.client.0.smithi047.stdout:7/82: chown d0/d4/l13 3 1 2024-02-07T12:25:39.545 INFO:tasks.workunit.client.1.smithi138.stdout:0/895: sync 2024-02-07T12:25:39.545 INFO:tasks.workunit.client.1.smithi138.stdout:3/974: sync 2024-02-07T12:25:39.546 INFO:tasks.workunit.client.1.smithi138.stdout:9/782: sync 2024-02-07T12:25:39.546 INFO:tasks.workunit.client.1.smithi138.stdout:5/827: sync 2024-02-07T12:25:39.546 INFO:tasks.workunit.client.1.smithi138.stdout:0/896: write d4/d9/de/d1d/d21/fb4 [950525,55692] 0 2024-02-07T12:25:39.547 INFO:tasks.workunit.client.0.smithi047.stdout:7/83: link d0/d4/f17 d0/f1a 0 2024-02-07T12:25:39.549 INFO:tasks.workunit.client.0.smithi047.stdout:7/84: mkdir d0/d4/d1b 0 2024-02-07T12:25:39.550 INFO:tasks.workunit.client.1.smithi138.stdout:5/828: rename da/d43/d4a/da2/d112/f7b to da/d43/d4a/da2/d112/d2e/d4f/d2b/d35/dae/db0/f115 0 2024-02-07T12:25:39.550 INFO:tasks.workunit.client.1.smithi138.stdout:0/897: truncate d4/f67 3832012 0 2024-02-07T12:25:39.553 INFO:tasks.workunit.client.1.smithi138.stdout:5/829: link da/d43/d4a/d69/c109 da/d43/d4a/da2/d112/d2e/d4f/d2b/d35/d67/dd1/c116 0 2024-02-07T12:25:39.553 INFO:tasks.workunit.client.1.smithi138.stdout:5/830: fsync da/d6d/f20 0 2024-02-07T12:25:39.553 INFO:tasks.workunit.client.1.smithi138.stdout:5/831: dread - da/d43/d4a/da2/d112/d2e/d4f/d2b/d35/d5d/de4/fe6 zero size 2024-02-07T12:25:39.553 INFO:tasks.workunit.client.1.smithi138.stdout:0/898: mknod d4/d9/d37/c115 0 2024-02-07T12:25:39.556 INFO:tasks.workunit.client.1.smithi138.stdout:1/882: dwrite d5/d4b/d65/ff9 [0,4194304] 0 2024-02-07T12:25:39.556 INFO:tasks.workunit.client.1.smithi138.stdout:5/832: symlink da/d43/d4a/da2/d112/d2e/d4f/d2b/d35/dae/db0/d96/l117 0 2024-02-07T12:25:39.556 INFO:tasks.workunit.client.1.smithi138.stdout:0/899: mknod d4/d9/d37/d64/df5/c116 0 2024-02-07T12:25:39.557 INFO:tasks.workunit.client.0.smithi047.stdout:7/85: write d0/f18 [241137,120714] 0 2024-02-07T12:25:39.559 INFO:tasks.workunit.client.0.smithi047.stdout:7/86: mknod d0/df/c1c 0 2024-02-07T12:25:39.559 INFO:tasks.workunit.client.1.smithi138.stdout:0/900: symlink d4/d9/de/d1d/d21/l117 0 2024-02-07T12:25:39.560 INFO:tasks.workunit.client.1.smithi138.stdout:1/883: dread d5/d8/da/d1f/d5e/d63/f57 [0,4194304] 0 2024-02-07T12:25:39.560 INFO:tasks.workunit.client.1.smithi138.stdout:1/884: stat d5/d8/da/d1f/d5e/fdf 0 2024-02-07T12:25:39.560 INFO:tasks.workunit.client.1.smithi138.stdout:1/885: write d5/d8/da/d1f/d60/df4/fa1 [821271,26736] 0 2024-02-07T12:25:39.562 INFO:tasks.workunit.client.1.smithi138.stdout:0/901: mknod d4/d9/db/d39/c118 0 2024-02-07T12:25:39.562 INFO:tasks.workunit.client.1.smithi138.stdout:0/902: write d4/d9/de/f72 [4887228,12745] 0 2024-02-07T12:25:39.562 INFO:tasks.workunit.client.1.smithi138.stdout:0/903: chown d4/d9/d33/ff8 264895 1 2024-02-07T12:25:39.562 INFO:tasks.workunit.client.1.smithi138.stdout:0/904: write d4/d9/de/d1d/d77/f88 [3374423,32422] 0 2024-02-07T12:25:39.562 INFO:tasks.workunit.client.1.smithi138.stdout:1/886: rmdir d5/d4b/d72 39 2024-02-07T12:25:39.562 INFO:tasks.workunit.client.1.smithi138.stdout:1/887: stat d5/d8/da/d1f/d5e/db5/d58/d76 0 2024-02-07T12:25:39.568 INFO:tasks.workunit.client.1.smithi138.stdout:0/905: mkdir d4/d52/d74/d119 0 2024-02-07T12:25:39.568 INFO:tasks.workunit.client.1.smithi138.stdout:0/906: getdents d4/d9/d37/d64/d9a/d104 0 2024-02-07T12:25:39.568 INFO:tasks.workunit.client.1.smithi138.stdout:1/888: unlink d5/d4b/d91/ld9 0 2024-02-07T12:25:39.568 INFO:tasks.workunit.client.1.smithi138.stdout:0/907: link d4/d9/d37/d6b/f91 d4/d9/db/d71/dfb/f11a 0 2024-02-07T12:25:39.568 INFO:tasks.workunit.client.1.smithi138.stdout:0/908: read d4/d9/db/f15 [3206669,14600] 0 2024-02-07T12:25:39.571 INFO:tasks.workunit.client.0.smithi047.stdout:7/87: dread d0/d4/f12 [0,4194304] 0 2024-02-07T12:25:39.571 INFO:tasks.workunit.client.0.smithi047.stdout:7/88: readlink d0/d4/l13 0 2024-02-07T12:25:39.571 INFO:tasks.workunit.client.0.smithi047.stdout:7/89: creat d0/df/f1d x:0 0 0 2024-02-07T12:25:39.571 INFO:tasks.workunit.client.0.smithi047.stdout:7/90: fdatasync d0/d4/f12 0 2024-02-07T12:25:39.572 INFO:tasks.workunit.client.1.smithi138.stdout:0/909: rename d4/d9/de/d1d/d21/l117 to d4/d52/d74/l11b 0 2024-02-07T12:25:39.574 INFO:tasks.workunit.client.0.smithi047.stdout:7/91: unlink d0/d4/f8 0 2024-02-07T12:25:39.574 INFO:tasks.workunit.client.0.smithi047.stdout:7/92: readlink d0/ld 0 2024-02-07T12:25:39.574 INFO:tasks.workunit.client.0.smithi047.stdout:7/93: dread - d0/df/f1d zero size 2024-02-07T12:25:39.574 INFO:tasks.workunit.client.0.smithi047.stdout:7/94: read - d0/df/f15 zero size 2024-02-07T12:25:39.574 INFO:tasks.workunit.client.1.smithi138.stdout:3/975: dwrite d5/d26/d9d/f13f [0,4194304] 0 2024-02-07T12:25:39.575 INFO:tasks.workunit.client.1.smithi138.stdout:3/976: write d5/d27/d35/d7c/f113 [774289,87799] 0 2024-02-07T12:25:39.586 INFO:tasks.workunit.client.1.smithi138.stdout:0/910: write d4/d69/d85/d8a/fab [855299,130495] 0 2024-02-07T12:25:39.586 INFO:tasks.workunit.client.1.smithi138.stdout:0/911: write d4/d9/f8e [1656238,84364] 0 2024-02-07T12:25:39.586 INFO:tasks.workunit.client.1.smithi138.stdout:0/912: fdatasync d4/d9/d37/d3d/f68 0 2024-02-07T12:25:39.586 INFO:tasks.workunit.client.1.smithi138.stdout:5/833: dwrite da/d43/d4a/fc2 [0,4194304] 0 2024-02-07T12:25:39.589 INFO:tasks.workunit.client.1.smithi138.stdout:0/913: creat d4/d69/d111/f11c x:0 0 0 2024-02-07T12:25:39.590 INFO:tasks.workunit.client.1.smithi138.stdout:0/914: creat d4/d9/db/d39/d4b/d6c/d8f/f11d x:0 0 0 2024-02-07T12:25:39.590 INFO:tasks.workunit.client.1.smithi138.stdout:0/915: chown d4/d9/d37/db6/cbf 5 1 2024-02-07T12:25:39.590 INFO:tasks.workunit.client.1.smithi138.stdout:0/916: write d4/d9/f8e [2233575,5468] 0 2024-02-07T12:25:39.591 INFO:tasks.workunit.client.1.smithi138.stdout:0/917: write d4/d52/f38 [5890248,45176] 0 2024-02-07T12:25:39.591 INFO:tasks.workunit.client.1.smithi138.stdout:0/918: read d4/d52/f2e [2800642,107190] 0 2024-02-07T12:25:39.592 INFO:tasks.workunit.client.1.smithi138.stdout:0/919: mknod d4/d9/d75/c11e 0 2024-02-07T12:25:39.592 INFO:tasks.workunit.client.1.smithi138.stdout:0/920: write d4/d9/db/fd3 [797452,119206] 0 2024-02-07T12:25:39.592 INFO:tasks.workunit.client.1.smithi138.stdout:0/921: fdatasync d4/d69/d85/f10d 0 2024-02-07T12:25:39.599 INFO:tasks.workunit.client.1.smithi138.stdout:1/889: dwrite d5/d8/da/d1f/d60/fa8 [0,4194304] 0 2024-02-07T12:25:39.600 INFO:tasks.workunit.client.1.smithi138.stdout:0/922: write d4/d9/d37/f3a [3446388,121748] 0 2024-02-07T12:25:39.600 INFO:tasks.workunit.client.1.smithi138.stdout:0/923: chown d4/d9/d33/c7e 58889 1 2024-02-07T12:25:39.600 INFO:tasks.workunit.client.1.smithi138.stdout:0/924: write d4/d9/d37/d6b/d7f/f82 [5306623,99674] 0 2024-02-07T12:25:39.601 INFO:tasks.workunit.client.0.smithi047.stdout:7/95: dwrite d0/d4/f12 [4194304,4194304] 0 2024-02-07T12:25:39.601 INFO:tasks.workunit.client.0.smithi047.stdout:7/96: creat d0/d4/f1e x:0 0 0 2024-02-07T12:25:39.602 INFO:tasks.workunit.client.1.smithi138.stdout:1/890: mknod d5/d8/da/d1f/d60/df4/d59/dd8/c11b 0 2024-02-07T12:25:39.602 INFO:tasks.workunit.client.1.smithi138.stdout:3/977: dwrite d5/d26/d28/f39 [0,4194304] 0 2024-02-07T12:25:39.602 INFO:tasks.workunit.client.1.smithi138.stdout:3/978: chown d5/d26/d5e/d86/ded/fe7 3 1 2024-02-07T12:25:39.605 INFO:tasks.workunit.client.1.smithi138.stdout:1/891: read d5/d8/da/fe [439223,80232] 0 2024-02-07T12:25:39.611 INFO:tasks.workunit.client.0.smithi047.stdout:7/97: getdents d0/d4 0 2024-02-07T12:25:39.611 INFO:tasks.workunit.client.0.smithi047.stdout:7/98: getdents d0/d4 0 2024-02-07T12:25:39.611 INFO:tasks.workunit.client.0.smithi047.stdout:7/99: dread - d0/df/f1d zero size 2024-02-07T12:25:39.613 INFO:tasks.workunit.client.0.smithi047.stdout:7/100: rmdir d0 39 2024-02-07T12:25:39.615 INFO:tasks.workunit.client.0.smithi047.stdout:7/101: symlink d0/d4/d1b/l1f 0 2024-02-07T12:25:39.616 INFO:tasks.workunit.client.1.smithi138.stdout:1/892: mknod d5/d43/c11c 0 2024-02-07T12:25:39.617 INFO:tasks.workunit.client.1.smithi138.stdout:3/979: getdents d5/d26/d9b/dab/dc4/dc7 0 2024-02-07T12:25:39.617 INFO:tasks.workunit.client.1.smithi138.stdout:0/925: dwrite d4/d9/d37/d64/d9a/db0/f103 [0,4194304] 0 2024-02-07T12:25:39.630 INFO:tasks.workunit.client.1.smithi138.stdout:0/926: rmdir d4/d52/de4 39 2024-02-07T12:25:39.630 INFO:tasks.workunit.client.1.smithi138.stdout:0/927: chown d4/d52/fa0 58283 1 2024-02-07T12:25:39.631 INFO:tasks.workunit.client.1.smithi138.stdout:1/893: dwrite d5/d8/da/d1f/d60/df4/fe1 [8388608,4194304] 0 2024-02-07T12:25:39.632 INFO:tasks.workunit.client.1.smithi138.stdout:3/980: rmdir d5/d27 39 2024-02-07T12:25:39.634 INFO:tasks.workunit.client.1.smithi138.stdout:0/928: mknod d4/d9/d37/c11f 0 2024-02-07T12:25:39.637 INFO:tasks.workunit.client.1.smithi138.stdout:1/894: rename d5/f2a to d5/d43/f11d 0 2024-02-07T12:25:39.637 INFO:tasks.workunit.client.1.smithi138.stdout:1/895: chown d5/d8/da/d1f/d5e/db5/d68/d73/d7b/lec 3597360 1 2024-02-07T12:25:39.638 INFO:tasks.workunit.client.1.smithi138.stdout:0/929: symlink d4/d9/de/d1d/d8c/l120 0 2024-02-07T12:25:39.641 INFO:tasks.workunit.client.1.smithi138.stdout:1/896: rename d5/d8/l4c to d5/d5b/l11e 0 2024-02-07T12:25:39.641 INFO:tasks.workunit.client.1.smithi138.stdout:0/930: rmdir d4/d9/d37/d64/d9d 39 2024-02-07T12:25:39.644 INFO:tasks.workunit.client.0.smithi047.stdout:7/102: dwrite d0/d4/f12 [0,4194304] 0 2024-02-07T12:25:39.644 INFO:tasks.workunit.client.1.smithi138.stdout:1/897: dread d5/d8/da/d1f/d60/df4/fef [0,4194304] 0 2024-02-07T12:25:39.646 INFO:tasks.workunit.client.0.smithi047.stdout:7/103: rename d0/f18 to d0/d4/f20 0 2024-02-07T12:25:39.646 INFO:tasks.workunit.client.0.smithi047.stdout:7/104: readlink d0/d4/d1b/l1f 0 2024-02-07T12:25:39.646 INFO:tasks.workunit.client.0.smithi047.stdout:7/105: stat d0/d4/d1b 0 2024-02-07T12:25:39.647 INFO:tasks.workunit.client.1.smithi138.stdout:1/898: link d5/d8/da/d1f/d5e/db5/d68/d73/d7b/lec d5/d8/da/d1f/d5e/db5/d68/d73/d7b/dda/l11f 0 2024-02-07T12:25:39.647 INFO:tasks.workunit.client.1.smithi138.stdout:1/899: write d5/d8/da/d1f/d60/df4/d59/f77 [3292386,85193] 0 2024-02-07T12:25:39.647 INFO:tasks.workunit.client.1.smithi138.stdout:1/900: chown d5/d5c/da5/fdd 6 1 2024-02-07T12:25:39.649 INFO:tasks.workunit.client.1.smithi138.stdout:0/931: dread d4/d9/de/f7d [0,4194304] 0 2024-02-07T12:25:39.650 INFO:tasks.workunit.client.1.smithi138.stdout:3/981: dread d5/f20 [0,4194304] 0 2024-02-07T12:25:39.651 INFO:tasks.workunit.client.1.smithi138.stdout:1/901: creat d5/d8/da/d1f/f120 x:0 0 0 2024-02-07T12:25:39.651 INFO:tasks.workunit.client.1.smithi138.stdout:1/902: chown d5 0 1 2024-02-07T12:25:39.652 INFO:tasks.workunit.client.1.smithi138.stdout:0/932: mknod d4/d52/c121 0 2024-02-07T12:25:39.652 INFO:tasks.workunit.client.1.smithi138.stdout:0/933: chown d4/d9/db/d39 51451745 1 2024-02-07T12:25:39.653 INFO:tasks.workunit.client.0.smithi047.stdout:7/106: getdents d0 0 2024-02-07T12:25:39.653 INFO:tasks.workunit.client.1.smithi138.stdout:3/982: symlink d5/d26/d5e/d86/ded/d96/l14b 0 2024-02-07T12:25:39.655 INFO:tasks.workunit.client.1.smithi138.stdout:1/903: creat d5/d5c/da5/f121 x:0 0 0 2024-02-07T12:25:39.656 INFO:tasks.workunit.client.0.smithi047.stdout:7/107: rename d0/cb to d0/d4/d1b/c21 0 2024-02-07T12:25:39.658 INFO:tasks.workunit.client.0.smithi047.stdout:7/108: creat d0/d4/d1b/f22 x:0 0 0 2024-02-07T12:25:39.658 INFO:tasks.workunit.client.0.smithi047.stdout:7/109: truncate d0/d4/f1e 460119 0 2024-02-07T12:25:39.658 INFO:tasks.workunit.client.0.smithi047.stdout:7/110: dread - d0/d4/f16 zero size 2024-02-07T12:25:39.659 INFO:tasks.workunit.client.1.smithi138.stdout:3/983: creat d5/d26/d9b/dab/d116/f14c x:0 0 0 2024-02-07T12:25:39.659 INFO:tasks.workunit.client.1.smithi138.stdout:3/984: fsync d5/d26/d9a/f102 0 2024-02-07T12:25:39.659 INFO:tasks.workunit.client.0.smithi047.stdout:7/111: readlink d0/l3 0 2024-02-07T12:25:39.659 INFO:tasks.workunit.client.0.smithi047.stdout:7/112: readlink d0/d4/d1b/l1f 0 2024-02-07T12:25:39.659 INFO:tasks.workunit.client.1.smithi138.stdout:0/934: mknod d4/d9/db/d39/d4b/d6c/d8f/c122 0 2024-02-07T12:25:39.661 INFO:tasks.workunit.client.1.smithi138.stdout:3/985: symlink d5/d27/dde/d109/l14d 0 2024-02-07T12:25:39.661 INFO:tasks.workunit.client.1.smithi138.stdout:3/986: write d5/d26/d9b/dab/d116/f14c [219821,91007] 0 2024-02-07T12:25:39.663 INFO:tasks.workunit.client.1.smithi138.stdout:1/904: dread d5/d8/da/d1f/d5e/db5/d58/d76/f100 [0,4194304] 0 2024-02-07T12:25:39.663 INFO:tasks.workunit.client.1.smithi138.stdout:1/905: dread - d5/d4b/d65/de2/f118 zero size 2024-02-07T12:25:39.663 INFO:tasks.workunit.client.1.smithi138.stdout:0/935: mkdir d4/d9/db/d123 0 2024-02-07T12:25:39.665 INFO:tasks.workunit.client.1.smithi138.stdout:1/906: mkdir d5/d8/da/d1f/d5e/db5/d68/d122 0 2024-02-07T12:25:39.665 INFO:tasks.workunit.client.1.smithi138.stdout:1/907: write d5/d8/da/d1f/d5e/db5/d58/d76/fbe [1439242,33771] 0 2024-02-07T12:25:39.666 INFO:tasks.workunit.client.1.smithi138.stdout:0/936: truncate d4/d9/d37/f60 2626829 0 2024-02-07T12:25:39.668 INFO:tasks.workunit.client.1.smithi138.stdout:3/987: dread d5/d26/d9b/dab/dc4/dc7/fe1 [0,4194304] 0 2024-02-07T12:25:39.668 INFO:tasks.workunit.client.1.smithi138.stdout:3/988: write d5/d26/d28/f4a [407093,92831] 0 2024-02-07T12:25:39.671 INFO:tasks.workunit.client.1.smithi138.stdout:1/908: creat d5/d5b/f123 x:0 0 0 2024-02-07T12:25:39.671 INFO:tasks.workunit.client.1.smithi138.stdout:6/941: sync 2024-02-07T12:25:39.671 INFO:tasks.workunit.client.1.smithi138.stdout:8/995: sync 2024-02-07T12:25:39.674 INFO:tasks.workunit.client.1.smithi138.stdout:3/989: dread d5/d27/f12a [0,4194304] 0 2024-02-07T12:25:39.674 INFO:tasks.workunit.client.1.smithi138.stdout:3/990: write d5/d26/d9b/dab/dc4/dd0/ff2 [536650,45810] 0 2024-02-07T12:25:39.676 INFO:tasks.workunit.client.1.smithi138.stdout:1/909: getdents d5/d8/dbc 0 2024-02-07T12:25:39.676 INFO:tasks.workunit.client.1.smithi138.stdout:1/910: write d5/d8/da/d1f/d5e/db5/d58/d76/fbe [2440424,85365] 0 2024-02-07T12:25:39.677 INFO:tasks.workunit.client.1.smithi138.stdout:0/937: write d4/fd [13688,26606] 0 2024-02-07T12:25:39.677 INFO:tasks.workunit.client.1.smithi138.stdout:0/938: chown d4/d9/d37/d3d/ffa 905 1 2024-02-07T12:25:39.678 INFO:tasks.workunit.client.1.smithi138.stdout:8/996: symlink d1/de/db4/db8/d17/d3e/d72/dda/d4c/d119/l13e 0 2024-02-07T12:25:39.679 INFO:tasks.workunit.client.1.smithi138.stdout:6/942: dread dc/d13/d8e/fb9 [0,4194304] 0 2024-02-07T12:25:39.681 INFO:tasks.workunit.client.1.smithi138.stdout:3/991: unlink d5/d26/d28/c62 0 2024-02-07T12:25:39.682 INFO:tasks.workunit.client.1.smithi138.stdout:1/911: rmdir d5/d8/da/d1f/d5e/db5/d58 39 2024-02-07T12:25:39.687 INFO:tasks.workunit.client.1.smithi138.stdout:0/939: creat d4/d9/db/d39/d4b/f124 x:0 0 0 2024-02-07T12:25:39.687 INFO:tasks.workunit.client.1.smithi138.stdout:0/940: fdatasync d4/d9/db/f15 0 2024-02-07T12:25:39.687 INFO:tasks.workunit.client.1.smithi138.stdout:0/941: chown d4/f26 393424079 1 2024-02-07T12:25:39.690 INFO:tasks.workunit.client.1.smithi138.stdout:6/943: mknod dc/d13/c133 0 2024-02-07T12:25:39.691 INFO:tasks.workunit.client.1.smithi138.stdout:3/992: truncate d5/d26/d9d/fc9 243371 0 2024-02-07T12:25:39.710 INFO:tasks.workunit.client.1.smithi138.stdout:1/912: dwrite d5/d8/da/d1f/d5e/db5/d68/d73/d7b/f3d [0,4194304] 0 2024-02-07T12:25:39.711 INFO:tasks.workunit.client.1.smithi138.stdout:1/913: symlink d5/d8/da/d4a/l124 0 2024-02-07T12:25:39.712 INFO:tasks.workunit.client.1.smithi138.stdout:1/914: truncate d5/d4b/d6b/d6e/fad 3640010 0 2024-02-07T12:25:39.714 INFO:tasks.workunit.client.1.smithi138.stdout:2/941: sync 2024-02-07T12:25:39.714 INFO:tasks.workunit.client.1.smithi138.stdout:4/857: sync 2024-02-07T12:25:39.716 INFO:tasks.workunit.client.1.smithi138.stdout:4/858: link d20/d53/d71/d98/d117/ca9 d20/d53/d71/d75/c11c 0 2024-02-07T12:25:39.720 INFO:tasks.workunit.client.1.smithi138.stdout:2/942: mkdir d3/dd/dd2/d14a 0 2024-02-07T12:25:39.720 INFO:tasks.workunit.client.1.smithi138.stdout:2/943: fdatasync d3/d4e/d119/d7d/d97/fe9 0 2024-02-07T12:25:39.720 INFO:tasks.workunit.client.1.smithi138.stdout:2/944: creat d3/dd/d14/d49/d25/d3d/f14b x:0 0 0 2024-02-07T12:25:39.722 INFO:tasks.workunit.client.1.smithi138.stdout:2/945: truncate d3/dd/d14/d49/d25/f136 802220 0 2024-02-07T12:25:39.723 INFO:tasks.workunit.client.1.smithi138.stdout:2/946: readlink d3/dd/d14/d49/d29/lb2 0 2024-02-07T12:25:39.724 INFO:tasks.workunit.client.1.smithi138.stdout:0/942: dwrite d4/d52/f90 [4194304,4194304] 0 2024-02-07T12:25:39.725 INFO:tasks.workunit.client.1.smithi138.stdout:2/947: rename d3/dd/d14/d8f/dbc/dfe/c143 to d3/dd/d14/d49/d29/d5b/c14c 0 2024-02-07T12:25:39.725 INFO:tasks.workunit.client.1.smithi138.stdout:3/993: dwrite d5/d26/f12e [0,4194304] 0 2024-02-07T12:25:39.725 INFO:tasks.workunit.client.1.smithi138.stdout:3/994: chown d5/d26/d5e/fe0 0 1 2024-02-07T12:25:39.725 INFO:tasks.workunit.client.1.smithi138.stdout:6/944: dwrite dc/d73/dc4/d11e/f120 [0,4194304] 0 2024-02-07T12:25:39.725 INFO:tasks.workunit.client.1.smithi138.stdout:8/997: dwrite d1/de/db4/db8/d17/f20 [0,4194304] 0 2024-02-07T12:25:39.726 INFO:tasks.workunit.client.1.smithi138.stdout:2/948: dread d3/d4e/d119/fc0 [0,4194304] 0 2024-02-07T12:25:39.727 INFO:tasks.workunit.client.1.smithi138.stdout:0/943: dread d4/d9/d37/d3d/d9c/f10b [0,4194304] 0 2024-02-07T12:25:39.727 INFO:tasks.workunit.client.1.smithi138.stdout:0/944: dread - d4/d9/d37/d64/d9a/ffd zero size 2024-02-07T12:25:39.728 INFO:tasks.workunit.client.1.smithi138.stdout:3/995: creat d5/d26/d90/d133/f14e x:0 0 0 2024-02-07T12:25:39.728 INFO:tasks.workunit.client.1.smithi138.stdout:3/996: write d5/d26/ddd/f11b [995986,117184] 0 2024-02-07T12:25:39.729 INFO:tasks.workunit.client.1.smithi138.stdout:4/859: dread d20/d47/d69/d7c/f85 [0,4194304] 0 2024-02-07T12:25:39.730 INFO:tasks.workunit.client.1.smithi138.stdout:6/945: rename dc/d13/d1e/f8c to dc/d13/d1e/d11b/f134 0 2024-02-07T12:25:39.733 INFO:tasks.workunit.client.1.smithi138.stdout:1/915: dwrite d5/d8/da/d20/f41 [4194304,4194304] 0 2024-02-07T12:25:39.736 INFO:tasks.workunit.client.1.smithi138.stdout:0/945: link d4/d9/d33/c7e d4/d9/d37/d64/d9a/db0/c125 0 2024-02-07T12:25:39.736 INFO:tasks.workunit.client.1.smithi138.stdout:0/946: write d4/d9/d37/d64/f9b [4335396,83540] 0 2024-02-07T12:25:39.737 INFO:tasks.workunit.client.1.smithi138.stdout:3/997: mknod d5/d26/d5e/d86/ded/d32/c14f 0 2024-02-07T12:25:39.745 INFO:tasks.workunit.client.1.smithi138.stdout:8/998: rmdir d1/d8e/d116 39 2024-02-07T12:25:39.745 INFO:tasks.workunit.client.1.smithi138.stdout:8/999: truncate d1/de/db4/db8/d17/fcb 657504 0 2024-02-07T12:25:39.748 INFO:tasks.workunit.client.1.smithi138.stdout:1/916: creat d5/d5c/f125 x:0 0 0 2024-02-07T12:25:39.749 INFO:tasks.workunit.client.1.smithi138.stdout:2/949: rmdir d3/dd/d14/d86 39 2024-02-07T12:25:39.751 INFO:tasks.workunit.client.1.smithi138.stdout:0/947: dwrite d4/d9/d37/fae [4194304,4194304] 0 2024-02-07T12:25:39.752 INFO:tasks.workunit.client.1.smithi138.stdout:3/998: creat d5/d26/d9d/f150 x:0 0 0 2024-02-07T12:25:39.752 INFO:tasks.workunit.client.1.smithi138.stdout:4/860: symlink d20/d53/d71/d98/d117/d74/d9a/l11d 0 2024-02-07T12:25:39.752 INFO:tasks.workunit.client.1.smithi138.stdout:4/861: chown d20/cdf 9890843 1 2024-02-07T12:25:39.752 INFO:tasks.workunit.client.1.smithi138.stdout:4/862: fsync d20/d34/d59/d88/d8d/fa2 0 2024-02-07T12:25:39.753 INFO:tasks.workunit.client.1.smithi138.stdout:4/863: fdatasync d20/d34/d59/d72/fdc 0 2024-02-07T12:25:39.753 INFO:tasks.workunit.client.1.smithi138.stdout:1/917: creat d5/d8/da/d1f/d60/df4/f126 x:0 0 0 2024-02-07T12:25:39.755 INFO:tasks.workunit.client.1.smithi138.stdout:2/950: rename d3/dd/d19/d1f/d37/l38 to d3/dd/d14/d82/dcc/d12a/l14d 0 2024-02-07T12:25:39.756 INFO:tasks.workunit.client.1.smithi138.stdout:6/946: dwrite dc/d31/d54/ddd/df4/f3c [4194304,4194304] 0 2024-02-07T12:25:39.756 INFO:tasks.workunit.client.1.smithi138.stdout:3/999: dread d5/d26/d9b/dab/dc4/dc7/fe1 [0,4194304] 0 2024-02-07T12:25:39.757 INFO:tasks.workunit.client.1.smithi138.stdout:0/948: mknod d4/d69/d85/d8a/c126 0 2024-02-07T12:25:39.760 INFO:tasks.workunit.client.1.smithi138.stdout:2/951: rmdir d3/dd/d14/d49/dc2 39 2024-02-07T12:25:39.775 INFO:tasks.workunit.client.1.smithi138.stdout:0/949: truncate d4/d9/d37/d6b/d7f/f82 1316752 0 2024-02-07T12:25:39.775 INFO:tasks.workunit.client.1.smithi138.stdout:4/864: getdents d20/d34 0 2024-02-07T12:25:39.776 INFO:tasks.workunit.client.1.smithi138.stdout:1/918: rmdir d5/d4b/d65/de2 39 2024-02-07T12:25:39.776 INFO:tasks.workunit.client.1.smithi138.stdout:1/919: fsync d5/d8/da/d1f/d5e/d63/f92 0 2024-02-07T12:25:39.776 INFO:tasks.workunit.client.1.smithi138.stdout:6/947: dwrite dc/d73/d9b/fa5 [0,4194304] 0 2024-02-07T12:25:39.778 INFO:tasks.workunit.client.1.smithi138.stdout:0/950: unlink d4/d9/d37/d3d/ffa 0 2024-02-07T12:25:39.779 INFO:tasks.workunit.client.1.smithi138.stdout:4/865: mknod d20/d53/d71/d98/c11e 0 2024-02-07T12:25:39.780 INFO:tasks.workunit.client.1.smithi138.stdout:1/920: rename d5/d43/c11c to d5/d8/da/d1f/d5e/db5/d68/da7/c127 0 2024-02-07T12:25:39.783 INFO:tasks.workunit.client.1.smithi138.stdout:6/948: mknod dc/d31/d3f/c135 0 2024-02-07T12:25:39.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:39 smithi138 ceph-mon[35528]: pgmap v6: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail 2024-02-07T12:25:39.784 INFO:tasks.workunit.client.1.smithi138.stdout:5/834: sync 2024-02-07T12:25:39.785 INFO:tasks.workunit.client.1.smithi138.stdout:4/866: read d20/d53/d71/d98/d117/f5b [782906,107839] 0 2024-02-07T12:25:39.785 INFO:tasks.workunit.client.1.smithi138.stdout:4/867: read - d20/d4d/d87/ff9 zero size 2024-02-07T12:25:39.785 INFO:tasks.workunit.client.1.smithi138.stdout:9/783: sync 2024-02-07T12:25:39.786 INFO:tasks.workunit.client.1.smithi138.stdout:9/784: stat d0/d6/d8/d1d/dd/d1f/c70 0 2024-02-07T12:25:39.789 INFO:tasks.workunit.client.1.smithi138.stdout:4/868: getdents d20/d47/d69/d7c 0 2024-02-07T12:25:39.791 INFO:tasks.workunit.client.1.smithi138.stdout:4/869: creat d20/d47/d69/def/f11f x:0 0 0 2024-02-07T12:25:39.791 INFO:tasks.workunit.client.1.smithi138.stdout:4/870: chown d20/d53/d71/d75/d94/ff4 840637844 1 2024-02-07T12:25:39.793 INFO:tasks.workunit.client.1.smithi138.stdout:4/871: rmdir d20/d47/d69 39 2024-02-07T12:25:39.793 INFO:tasks.workunit.client.1.smithi138.stdout:4/872: creat d20/d34/d73/dd0/f120 x:0 0 0 2024-02-07T12:25:39.793 INFO:tasks.workunit.client.1.smithi138.stdout:1/921: write d5/d8/da/d20/f41 [6210297,118234] 0 2024-02-07T12:25:39.793 INFO:tasks.workunit.client.1.smithi138.stdout:1/922: chown d5/d8/da/d4a 509 1 2024-02-07T12:25:39.796 INFO:tasks.workunit.client.1.smithi138.stdout:4/873: rename f1c to d20/d53/d71/d98/d117/d74/d9a/dc0/f121 0 2024-02-07T12:25:39.799 INFO:tasks.workunit.client.1.smithi138.stdout:6/949: write dc/d13/f39 [3135391,49360] 0 2024-02-07T12:25:39.799 INFO:tasks.workunit.client.1.smithi138.stdout:0/951: dwrite d4/d9/de/d1d/f36 [0,4194304] 0 2024-02-07T12:25:39.799 INFO:tasks.workunit.client.1.smithi138.stdout:4/874: mknod d20/d34/d59/d88/c122 0 2024-02-07T12:25:39.802 INFO:tasks.workunit.client.1.smithi138.stdout:6/950: truncate dc/d31/d38/f53 51627 0 2024-02-07T12:25:39.802 INFO:tasks.workunit.client.1.smithi138.stdout:6/951: creat dc/d31/f136 x:0 0 0 2024-02-07T12:25:39.802 INFO:tasks.workunit.client.1.smithi138.stdout:1/923: read d5/d8/da/d1f/d5e/d63/f92 [2283927,15562] 0 2024-02-07T12:25:39.803 INFO:tasks.workunit.client.1.smithi138.stdout:0/952: symlink d4/d9/db/d39/d4b/d6c/dc5/l127 0 2024-02-07T12:25:39.804 INFO:tasks.workunit.client.1.smithi138.stdout:1/924: truncate d5/d8/da/df8/ffe 153835 0 2024-02-07T12:25:39.805 INFO:tasks.workunit.client.1.smithi138.stdout:0/953: symlink d4/d9/d37/l128 0 2024-02-07T12:25:39.805 INFO:tasks.workunit.client.1.smithi138.stdout:0/954: write d4/d9/d37/d64/d9a/fff [95367,2156] 0 2024-02-07T12:25:39.806 INFO:tasks.workunit.client.1.smithi138.stdout:0/955: mknod d4/d9/d37/d3d/d9c/dad/c129 0 2024-02-07T12:25:39.807 INFO:tasks.workunit.client.1.smithi138.stdout:1/925: truncate d5/d8/da/f11 11785346 0 2024-02-07T12:25:39.810 INFO:tasks.workunit.client.1.smithi138.stdout:0/956: mknod d4/d9/db/d71/c12a 0 2024-02-07T12:25:39.810 INFO:tasks.workunit.client.1.smithi138.stdout:1/926: getdents d5 0 2024-02-07T12:25:39.811 INFO:tasks.workunit.client.1.smithi138.stdout:0/957: mkdir d4/d9/db/d12b 0 2024-02-07T12:25:39.811 INFO:tasks.workunit.client.1.smithi138.stdout:5/835: dwrite da/d43/d4a/f9a [0,4194304] 0 2024-02-07T12:25:39.812 INFO:tasks.workunit.client.1.smithi138.stdout:9/785: dwrite d0/d6/d8/d1d/f3d [0,4194304] 0 2024-02-07T12:25:39.812 INFO:tasks.workunit.client.1.smithi138.stdout:9/786: fsync d0/d6/d8/d1d/dd/d41/f5c 0 2024-02-07T12:25:39.812 INFO:tasks.workunit.client.1.smithi138.stdout:1/927: creat d5/dfd/f128 x:0 0 0 2024-02-07T12:25:39.813 INFO:tasks.workunit.client.1.smithi138.stdout:0/958: dread d4/d9/db/d71/f7c [0,4194304] 0 2024-02-07T12:25:39.817 INFO:tasks.workunit.client.1.smithi138.stdout:0/959: symlink d4/d9/d33/l12c 0 2024-02-07T12:25:39.819 INFO:tasks.workunit.client.1.smithi138.stdout:0/960: mknod d4/d9/db/d39/d4b/c12d 0 2024-02-07T12:25:39.823 INFO:tasks.workunit.client.1.smithi138.stdout:0/961: creat d4/d9/db/d39/d4b/d6c/f12e x:0 0 0 2024-02-07T12:25:39.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:39 smithi047 ceph-mon[28972]: pgmap v6: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail 2024-02-07T12:25:39.825 INFO:tasks.workunit.client.1.smithi138.stdout:6/952: dwrite dc/d31/d3f/f41 [0,4194304] 0 2024-02-07T12:25:39.827 INFO:tasks.workunit.client.1.smithi138.stdout:6/953: truncate dc/d31/d54/ddd/f111 1456686 0 2024-02-07T12:25:39.828 INFO:tasks.workunit.client.1.smithi138.stdout:5/836: dread da/d43/d4a/da2/d112/d2e/d4f/d2b/d35/d67/df0/ff2 [0,4194304] 0 2024-02-07T12:25:39.828 INFO:tasks.workunit.client.1.smithi138.stdout:5/837: fsync da/d43/d4a/da2/d112/d2e/d4f/d2b/d35/d40/f49 0 2024-02-07T12:25:39.830 INFO:tasks.workunit.client.1.smithi138.stdout:6/954: unlink dc/d13/d1e/d35/d6d/da6/d10a/daa/l12a 0 2024-02-07T12:25:39.833 INFO:tasks.workunit.client.1.smithi138.stdout:5/838: link da/d50/c92 da/d34/c118 0 2024-02-07T12:25:39.833 INFO:tasks.workunit.client.1.smithi138.stdout:5/839: stat da/d43/d4a/da2/d112/d2e/d4f/d2b/d35/dae/db0/f7f 0 2024-02-07T12:25:39.833 INFO:tasks.workunit.client.1.smithi138.stdout:1/928: read d5/d8/da/d1f/d60/df4/d59/d108/d112/f114 [6028503,97985] 0 2024-02-07T12:25:39.836 INFO:tasks.workunit.client.0.smithi047.stdout:8/84: sync 2024-02-07T12:25:39.836 INFO:tasks.workunit.client.0.smithi047.stdout:2/86: sync 2024-02-07T12:25:39.836 INFO:tasks.workunit.client.0.smithi047.stdout:3/38: sync 2024-02-07T12:25:39.837 INFO:tasks.workunit.client.0.smithi047.stdout:9/15: sync 2024-02-07T12:25:39.839 INFO:tasks.workunit.client.0.smithi047.stdout:1/27: sync 2024-02-07T12:25:39.839 INFO:tasks.workunit.client.0.smithi047.stdout:5/51: sync 2024-02-07T12:25:39.839 INFO:tasks.workunit.client.0.smithi047.stdout:4/7: sync 2024-02-07T12:25:39.839 INFO:tasks.workunit.client.0.smithi047.stdout:7/113: sync 2024-02-07T12:25:39.839 INFO:tasks.workunit.client.0.smithi047.stdout:0/24: sync 2024-02-07T12:25:39.839 INFO:tasks.workunit.client.0.smithi047.stdout:6/49: sync 2024-02-07T12:25:39.839 INFO:tasks.workunit.client.0.smithi047.stdout:6/50: readlink d3/ld 0 2024-02-07T12:25:39.839 INFO:tasks.workunit.client.0.smithi047.stdout:6/51: fdatasync f2 0 2024-02-07T12:25:39.840 INFO:tasks.workunit.client.1.smithi138.stdout:1/929: rmdir d5/d5c 39 2024-02-07T12:25:39.841 INFO:tasks.workunit.client.0.smithi047.stdout:8/85: mkdir d3/d4/d1f 0 2024-02-07T12:25:39.845 INFO:tasks.workunit.client.0.smithi047.stdout:1/28: unlink d1/f2 0 2024-02-07T12:25:39.845 INFO:tasks.workunit.client.1.smithi138.stdout:1/930: mknod d5/d8/da/d1f/d5e/c129 0 2024-02-07T12:25:39.845 INFO:tasks.workunit.client.1.smithi138.stdout:1/931: readlink d5/d8/l54 0 2024-02-07T12:25:39.847 INFO:tasks.workunit.client.0.smithi047.stdout:5/52: creat da/f11 x:0 0 0 2024-02-07T12:25:39.848 INFO:tasks.workunit.client.0.smithi047.stdout:0/25: stat c7 0 2024-02-07T12:25:39.848 INFO:tasks.workunit.client.0.smithi047.stdout:0/26: stat c6 0 2024-02-07T12:25:39.848 INFO:tasks.workunit.client.0.smithi047.stdout:0/27: fsync f1 0 2024-02-07T12:25:39.849 INFO:tasks.workunit.client.0.smithi047.stdout:7/114: fdatasync d0/f2 0 2024-02-07T12:25:39.849 INFO:tasks.workunit.client.0.smithi047.stdout:7/115: creat d0/d4/d1b/f23 x:0 0 0 2024-02-07T12:25:39.850 INFO:tasks.workunit.client.0.smithi047.stdout:6/52: dread d3/f8 [0,4194304] 0 2024-02-07T12:25:39.853 INFO:tasks.workunit.client.0.smithi047.stdout:8/86: symlink d3/l20 0 2024-02-07T12:25:39.853 INFO:tasks.workunit.client.0.smithi047.stdout:1/29: symlink d1/l3 0 2024-02-07T12:25:39.855 INFO:tasks.workunit.client.0.smithi047.stdout:5/53: dread da/fd [0,4194304] 0 2024-02-07T12:25:39.856 INFO:tasks.workunit.client.0.smithi047.stdout:5/54: stat da/fb 0 2024-02-07T12:25:39.856 INFO:tasks.workunit.client.0.smithi047.stdout:0/28: symlink l8 0 2024-02-07T12:25:39.858 INFO:tasks.workunit.client.0.smithi047.stdout:1/30: truncate f0 1349076 0 2024-02-07T12:25:39.862 INFO:tasks.workunit.client.0.smithi047.stdout:1/31: mknod d1/c4 0 2024-02-07T12:25:39.864 INFO:tasks.workunit.client.0.smithi047.stdout:1/32: creat d1/f5 x:0 0 0 2024-02-07T12:25:39.864 INFO:tasks.workunit.client.0.smithi047.stdout:1/33: chown d1/c4 1914825 1 2024-02-07T12:25:39.865 INFO:tasks.workunit.client.0.smithi047.stdout:1/34: chown d1 11 1 2024-02-07T12:25:39.865 INFO:tasks.workunit.client.0.smithi047.stdout:1/35: chown d1 9 1 2024-02-07T12:25:39.865 INFO:tasks.workunit.client.0.smithi047.stdout:1/36: chown d1/l3 40705 1 2024-02-07T12:25:39.865 INFO:tasks.workunit.client.0.smithi047.stdout:1/37: truncate d1/f5 833126 0 2024-02-07T12:25:39.868 INFO:tasks.workunit.client.1.smithi138.stdout:0/962: dwrite d4/d9/de/d1d/d21/f4e [0,4194304] 0 2024-02-07T12:25:39.868 INFO:tasks.workunit.client.0.smithi047.stdout:9/16: write f1 [2174789,105777] 0 2024-02-07T12:25:39.868 INFO:tasks.workunit.client.0.smithi047.stdout:9/17: truncate f2 934952 0 2024-02-07T12:25:39.871 INFO:tasks.workunit.client.0.smithi047.stdout:9/18: mkdir d3 0 2024-02-07T12:25:39.873 INFO:tasks.workunit.client.1.smithi138.stdout:0/963: truncate d4/d9/db/f20 1776825 0 2024-02-07T12:25:39.873 INFO:tasks.workunit.client.1.smithi138.stdout:0/964: write d4/d9/de/d1d/f54 [4827440,69405] 0 2024-02-07T12:25:39.875 INFO:tasks.workunit.client.1.smithi138.stdout:0/965: mkdir d4/d9/d37/d64/d9d/d12f 0 2024-02-07T12:25:39.875 INFO:tasks.workunit.client.1.smithi138.stdout:0/966: read - d4/d9/db/d39/d4b/d6c/d8f/f109 zero size 2024-02-07T12:25:39.878 INFO:tasks.workunit.client.1.smithi138.stdout:9/787: dwrite d0/d6/d8/d1d/dd/d25/f5b [4194304,4194304] 0 2024-02-07T12:25:39.885 INFO:tasks.workunit.client.1.smithi138.stdout:6/955: dwrite dc/d13/d1e/d35/ff7 [0,4194304] 0 2024-02-07T12:25:39.886 INFO:tasks.workunit.client.1.smithi138.stdout:5/840: dwrite da/d43/d4a/d69/fa6 [8388608,4194304] 0 2024-02-07T12:25:39.887 INFO:tasks.workunit.client.1.smithi138.stdout:5/841: write da/d43/d4a/da2/d112/d2e/d4f/d2b/f87 [400347,41773] 0 2024-02-07T12:25:39.888 INFO:tasks.workunit.client.1.smithi138.stdout:5/842: mkdir da/d43/d4a/da2/d112/d2e/d4f/d2b/d35/d5d/d73/d119 0 2024-02-07T12:25:39.889 INFO:tasks.workunit.client.1.smithi138.stdout:5/843: symlink da/d43/d4a/da2/d112/d2e/d4f/d2b/d35/d67/df0/l11a 0 2024-02-07T12:25:39.890 INFO:tasks.workunit.client.1.smithi138.stdout:9/788: dread d0/d6/d8/d1d/f61 [4194304,4194304] 0 2024-02-07T12:25:39.890 INFO:tasks.workunit.client.1.smithi138.stdout:9/789: chown d0/d34/d86/fe4 502 1 2024-02-07T12:25:39.891 INFO:tasks.workunit.client.1.smithi138.stdout:9/790: creat d0/d34/d86/fee x:0 0 0 2024-02-07T12:25:39.891 INFO:tasks.workunit.client.1.smithi138.stdout:5/844: rmdir da/d22/d99/dca/dd5/de2 39 2024-02-07T12:25:39.891 INFO:tasks.workunit.client.1.smithi138.stdout:5/845: getdents da/d43/d4a/d98/d10f 0 2024-02-07T12:25:39.893 INFO:tasks.workunit.client.1.smithi138.stdout:9/791: mknod d0/d6/d8/d1d/dd/d41/d5e/de7/dd8/cef 0 2024-02-07T12:25:39.894 INFO:tasks.workunit.client.1.smithi138.stdout:5/846: mknod da/d43/c11b 0 2024-02-07T12:25:39.896 INFO:tasks.workunit.client.1.smithi138.stdout:9/792: symlink d0/d6/d8/d1d/dd/dc4/lf0 0 2024-02-07T12:25:39.898 INFO:tasks.workunit.client.1.smithi138.stdout:9/793: dread d0/d34/f6b [0,4194304] 0 2024-02-07T12:25:39.899 INFO:tasks.workunit.client.1.smithi138.stdout:9/794: symlink d0/d34/d45/lf1 0 2024-02-07T12:25:39.901 INFO:tasks.workunit.client.0.smithi047.stdout:3/39: dwrite f2 [0,4194304] 0 2024-02-07T12:25:39.901 INFO:tasks.workunit.client.1.smithi138.stdout:1/932: dwrite d5/d8/da/d1f/d5e/fd3 [0,4194304] 0 2024-02-07T12:25:39.901 INFO:tasks.workunit.client.0.smithi047.stdout:6/53: dwrite f2 [4194304,4194304] 0 2024-02-07T12:25:39.902 INFO:tasks.workunit.client.1.smithi138.stdout:9/795: creat d0/ff2 x:0 0 0 2024-02-07T12:25:39.902 INFO:tasks.workunit.client.0.smithi047.stdout:3/40: creat f9 x:0 0 0 2024-02-07T12:25:39.905 INFO:tasks.workunit.client.0.smithi047.stdout:3/41: link l1 la 0 2024-02-07T12:25:39.907 INFO:tasks.workunit.client.1.smithi138.stdout:1/933: creat d5/d8/da/d1f/d5e/db8/f12a x:0 0 0 2024-02-07T12:25:39.907 INFO:tasks.workunit.client.1.smithi138.stdout:1/934: truncate d5/d8/ffa 214615 0 2024-02-07T12:25:39.909 INFO:tasks.workunit.client.1.smithi138.stdout:1/935: creat d5/d8/da/d1f/d5e/db5/d58/d76/f12b x:0 0 0 2024-02-07T12:25:39.913 INFO:tasks.workunit.client.1.smithi138.stdout:6/956: dwrite dc/d13/f80 [0,4194304] 0 2024-02-07T12:25:39.913 INFO:tasks.workunit.client.0.smithi047.stdout:8/87: dwrite d3/f9 [0,4194304] 0 2024-02-07T12:25:39.915 INFO:tasks.workunit.client.1.smithi138.stdout:1/936: link d5/d8/da/d1f/d5e/db5/d68/da7/l107 d5/d8/da/d20/l12c 0 2024-02-07T12:25:39.915 INFO:tasks.workunit.client.1.smithi138.stdout:1/937: readlink d5/d5b/l11e 0 2024-02-07T12:25:39.916 INFO:tasks.workunit.client.0.smithi047.stdout:0/29: dwrite f1 [0,4194304] 0 2024-02-07T12:25:39.916 INFO:tasks.workunit.client.0.smithi047.stdout:5/55: dwrite da/fd [0,4194304] 0 2024-02-07T12:25:39.916 INFO:tasks.workunit.client.0.smithi047.stdout:7/116: dwrite d0/d4/f20 [0,4194304] 0 2024-02-07T12:25:39.921 INFO:tasks.workunit.client.1.smithi138.stdout:1/938: creat d5/d5c/f12d x:0 0 0 2024-02-07T12:25:39.922 INFO:tasks.workunit.client.1.smithi138.stdout:1/939: creat d5/d5c/f12e x:0 0 0 2024-02-07T12:25:39.922 INFO:tasks.workunit.client.1.smithi138.stdout:1/940: chown d5/d8/da/d1f/d5e/d63/fc5 220010 1 2024-02-07T12:25:39.922 INFO:tasks.workunit.client.0.smithi047.stdout:7/117: symlink d0/df/l24 0 2024-02-07T12:25:39.922 INFO:tasks.workunit.client.0.smithi047.stdout:7/118: dread - d0/d4/d1b/f22 zero size 2024-02-07T12:25:39.925 INFO:tasks.workunit.client.1.smithi138.stdout:0/967: truncate d4/d9/de/d1d/f54 1800556 0 2024-02-07T12:25:39.926 INFO:tasks.workunit.client.0.smithi047.stdout:0/30: dread f1 [0,4194304] 0 2024-02-07T12:25:39.928 INFO:tasks.workunit.client.0.smithi047.stdout:6/54: write d3/d5/f6 [1571146,8026] 0 2024-02-07T12:25:39.929 INFO:tasks.workunit.client.0.smithi047.stdout:6/55: chown d3/d5/f6 144609 1 2024-02-07T12:25:39.930 INFO:tasks.workunit.client.0.smithi047.stdout:0/31: rename c3 to c9 0 2024-02-07T12:25:39.930 INFO:tasks.workunit.client.0.smithi047.stdout:0/32: fdatasync f5 0 2024-02-07T12:25:39.941 INFO:tasks.workunit.client.0.smithi047.stdout:5/56: dread da/fb [0,4194304] 0 2024-02-07T12:25:39.941 INFO:tasks.workunit.client.0.smithi047.stdout:5/57: readlink da/l10 0 2024-02-07T12:25:39.947 INFO:tasks.workunit.client.0.smithi047.stdout:6/56: write d3/d5/f7 [6024830,81623] 0 2024-02-07T12:25:39.947 INFO:tasks.workunit.client.0.smithi047.stdout:6/57: creat d3/fe x:0 0 0 2024-02-07T12:25:39.949 INFO:tasks.workunit.client.0.smithi047.stdout:6/58: mknod d3/d5/cf 0 2024-02-07T12:25:39.954 INFO:tasks.workunit.client.0.smithi047.stdout:6/59: dread d3/f8 [0,4194304] 0 2024-02-07T12:25:39.954 INFO:tasks.workunit.client.0.smithi047.stdout:6/60: fdatasync d3/f8 0 2024-02-07T12:25:39.956 INFO:tasks.workunit.client.0.smithi047.stdout:6/61: unlink c1 0 2024-02-07T12:25:39.958 INFO:tasks.workunit.client.0.smithi047.stdout:8/88: dread d3/f17 [0,4194304] 0 2024-02-07T12:25:39.958 INFO:tasks.workunit.client.0.smithi047.stdout:8/89: fdatasync d3/d4/f1e 0 2024-02-07T12:25:39.958 INFO:tasks.workunit.client.0.smithi047.stdout:8/90: write d3/f9 [9413369,105481] 0 2024-02-07T12:25:39.958 INFO:tasks.workunit.client.0.smithi047.stdout:8/91: fdatasync d3/f14 0 2024-02-07T12:25:39.959 INFO:tasks.workunit.client.0.smithi047.stdout:6/62: mkdir d3/d5/d10 0 2024-02-07T12:25:39.961 INFO:tasks.workunit.client.0.smithi047.stdout:6/63: rename d3/ld to d3/l11 0 2024-02-07T12:25:39.964 INFO:tasks.workunit.client.0.smithi047.stdout:6/64: rename f2 to d3/da/f12 0 2024-02-07T12:25:39.977 INFO:tasks.workunit.client.0.smithi047.stdout:5/58: dread f7 [0,4194304] 0 2024-02-07T12:25:39.981 INFO:tasks.workunit.client.0.smithi047.stdout:3/42: dwrite f9 [0,4194304] 0 2024-02-07T12:25:39.981 INFO:tasks.workunit.client.1.smithi138.stdout:1/941: dwrite d5/d8/da/d1f/d5e/db5/d68/d73/d7b/f3d [0,4194304] 0 2024-02-07T12:25:39.981 INFO:tasks.workunit.client.1.smithi138.stdout:9/796: dwrite d0/f77 [4194304,4194304] 0 2024-02-07T12:25:39.983 INFO:tasks.workunit.client.0.smithi047.stdout:9/19: dwrite f1 [0,4194304] 0 2024-02-07T12:25:39.983 INFO:tasks.workunit.client.0.smithi047.stdout:5/59: dread f7 [0,4194304] 0 2024-02-07T12:25:39.983 INFO:tasks.workunit.client.0.smithi047.stdout:5/60: creat da/f12 x:0 0 0 2024-02-07T12:25:39.985 INFO:tasks.workunit.client.1.smithi138.stdout:1/942: dread d5/d8/f14 [0,4194304] 0 2024-02-07T12:25:39.985 INFO:tasks.workunit.client.0.smithi047.stdout:9/20: creat d3/f4 x:0 0 0 2024-02-07T12:25:39.986 INFO:tasks.workunit.client.1.smithi138.stdout:9/797: rename d0/d6/da3/dce to d0/d6/d8/d1d/dd/d1f/db7/db9/dc3/df3 0 2024-02-07T12:25:39.986 INFO:tasks.workunit.client.1.smithi138.stdout:9/798: creat d0/d6/d8/d1d/dd/d25/ff4 x:0 0 0 2024-02-07T12:25:39.986 INFO:tasks.workunit.client.1.smithi138.stdout:9/799: read - d0/d6/d8/d1d/da0/fbd zero size 2024-02-07T12:25:39.987 INFO:tasks.workunit.client.0.smithi047.stdout:5/61: mkdir da/d13 0 2024-02-07T12:25:39.989 INFO:tasks.workunit.client.0.smithi047.stdout:9/21: symlink d3/l5 0 2024-02-07T12:25:39.989 INFO:tasks.workunit.client.0.smithi047.stdout:9/22: write d3/f4 [911787,92148] 0 2024-02-07T12:25:39.989 INFO:tasks.workunit.client.1.smithi138.stdout:1/943: rename d5/d8/da/d1f/d5e/db5/d68/da7/ce4 to d5/d8/da/d1f/d5e/db5/c12f 0 2024-02-07T12:25:39.990 INFO:tasks.workunit.client.0.smithi047.stdout:3/43: write f9 [1604325,68959] 0 2024-02-07T12:25:39.990 INFO:tasks.workunit.client.0.smithi047.stdout:5/62: unlink f7 0 2024-02-07T12:25:39.990 INFO:tasks.workunit.client.0.smithi047.stdout:5/63: write da/f11 [24368,82930] 0 2024-02-07T12:25:39.991 INFO:tasks.workunit.client.0.smithi047.stdout:7/119: dwrite d0/d4/f5 [0,4194304] 0 2024-02-07T12:25:39.992 INFO:tasks.workunit.client.0.smithi047.stdout:0/33: dwrite f5 [0,4194304] 0 2024-02-07T12:25:39.992 INFO:tasks.workunit.client.0.smithi047.stdout:0/34: rmdir - no directory 2024-02-07T12:25:39.994 INFO:tasks.workunit.client.0.smithi047.stdout:5/64: rmdir da/d13 0 2024-02-07T12:25:39.994 INFO:tasks.workunit.client.1.smithi138.stdout:6/957: dwrite dc/d13/d1e/d35/d7c/f116 [0,4194304] 0 2024-02-07T12:25:39.994 INFO:tasks.workunit.client.1.smithi138.stdout:6/958: stat dc/d13/d1e/d35/d6d/f7d 0 2024-02-07T12:25:39.996 INFO:tasks.workunit.client.0.smithi047.stdout:8/92: dwrite d3/d4/f12 [0,4194304] 0 2024-02-07T12:25:39.998 INFO:tasks.workunit.client.0.smithi047.stdout:0/35: dread f1 [0,4194304] 0 2024-02-07T12:25:39.999 INFO:tasks.workunit.client.1.smithi138.stdout:6/959: mknod dc/d31/d38/c137 0 2024-02-07T12:25:39.999 INFO:tasks.workunit.client.1.smithi138.stdout:6/960: fsync dc/d13/d1e/d35/d7c/dbe/fd6 0 2024-02-07T12:25:39.999 INFO:tasks.workunit.client.1.smithi138.stdout:6/961: fsync dc/d31/d38/f64 0 2024-02-07T12:25:39.999 INFO:tasks.workunit.client.1.smithi138.stdout:6/962: write dc/d13/d1e/d35/d6d/da6/d10a/fb3 [39657,52586] 0 2024-02-07T12:25:39.999 INFO:tasks.workunit.client.1.smithi138.stdout:6/963: dread - dc/d13/d1e/d35/d6d/da6/f125 zero size 2024-02-07T12:25:39.999 INFO:tasks.workunit.client.1.smithi138.stdout:2/952: sync 2024-02-07T12:25:39.999 INFO:tasks.workunit.client.1.smithi138.stdout:4/875: sync 2024-02-07T12:25:40.000 INFO:tasks.workunit.client.1.smithi138.stdout:4/876: fsync d20/d34/d36/f41 0 2024-02-07T12:25:40.001 INFO:tasks.workunit.client.0.smithi047.stdout:7/120: mknod d0/d4/d1b/c25 0 2024-02-07T12:25:40.001 INFO:tasks.workunit.client.0.smithi047.stdout:7/121: truncate d0/d4/d1b/f23 622944 0 2024-02-07T12:25:40.002 INFO:tasks.workunit.client.0.smithi047.stdout:7/122: write d0/df/f1d [811729,87726] 0 2024-02-07T12:25:40.005 INFO:tasks.workunit.client.1.smithi138.stdout:2/953: link d3/dd/d19/d1f/d37/l94 d3/d4e/d119/l14e 0 2024-02-07T12:25:40.007 INFO:tasks.workunit.client.0.smithi047.stdout:6/65: dwrite d3/f8 [0,4194304] 0 2024-02-07T12:25:40.008 INFO:tasks.workunit.client.1.smithi138.stdout:0/968: dwrite d4/d52/d74/fb1 [4194304,4194304] 0 2024-02-07T12:25:40.008 INFO:tasks.workunit.client.1.smithi138.stdout:6/964: read dc/d31/d38/f64 [599194,91002] 0 2024-02-07T12:25:40.012 INFO:tasks.workunit.client.1.smithi138.stdout:4/877: dread d20/f25 [0,4194304] 0 2024-02-07T12:25:40.012 INFO:tasks.workunit.client.1.smithi138.stdout:4/878: creat d20/d34/d36/f123 x:0 0 0 2024-02-07T12:25:40.013 INFO:tasks.workunit.client.1.smithi138.stdout:2/954: symlink d3/dd/d14/d49/d29/l14f 0 2024-02-07T12:25:40.016 INFO:tasks.workunit.client.0.smithi047.stdout:0/36: unlink c7 0 2024-02-07T12:25:40.016 INFO:tasks.workunit.client.0.smithi047.stdout:0/37: stat l8 0 2024-02-07T12:25:40.017 INFO:tasks.workunit.client.1.smithi138.stdout:4/879: unlink d20/d53/d71/d75/de8/f108 0 2024-02-07T12:25:40.019 INFO:tasks.workunit.client.1.smithi138.stdout:2/955: unlink d3/dd/d19/d1f/c23 0 2024-02-07T12:25:40.020 INFO:tasks.workunit.client.0.smithi047.stdout:7/123: symlink d0/l26 0 2024-02-07T12:25:40.021 INFO:tasks.workunit.client.1.smithi138.stdout:6/965: getdents dc/d13/d1e/d35/d7c 0 2024-02-07T12:25:40.021 INFO:tasks.workunit.client.1.smithi138.stdout:6/966: readlink dc/d13/d1e/l56 0 2024-02-07T12:25:40.022 INFO:tasks.workunit.client.0.smithi047.stdout:7/124: read - d0/f1a zero size 2024-02-07T12:25:40.025 INFO:tasks.workunit.client.0.smithi047.stdout:7/125: rename d0/df/l24 to d0/d4/d1b/l27 0 2024-02-07T12:25:40.025 INFO:tasks.workunit.client.1.smithi138.stdout:6/967: unlink dc/l66 0 2024-02-07T12:25:40.026 INFO:tasks.workunit.client.1.smithi138.stdout:6/968: chown dc/d13/c113 120 1 2024-02-07T12:25:40.026 INFO:tasks.workunit.client.1.smithi138.stdout:6/969: write dc/d13/fcc [798216,65795] 0 2024-02-07T12:25:40.027 INFO:tasks.workunit.client.1.smithi138.stdout:9/800: dwrite d0/d6/f3c [4194304,4194304] 0 2024-02-07T12:25:40.027 INFO:tasks.workunit.client.1.smithi138.stdout:9/801: chown d0/d6/da3/dcc/dd1/fd3 19 1 2024-02-07T12:25:40.027 INFO:tasks.workunit.client.1.smithi138.stdout:9/802: creat d0/d6/da3/dcc/ff5 x:0 0 0 2024-02-07T12:25:40.027 INFO:tasks.workunit.client.1.smithi138.stdout:9/803: write d0/d6/d8/d95/fe9 [257964,113320] 0 2024-02-07T12:25:40.027 INFO:tasks.workunit.client.0.smithi047.stdout:7/126: mknod d0/c28 0 2024-02-07T12:25:40.027 INFO:tasks.workunit.client.0.smithi047.stdout:7/127: readlink d0/l3 0 2024-02-07T12:25:40.029 INFO:tasks.workunit.client.0.smithi047.stdout:1/38: write f0 [617162,56943] 0 2024-02-07T12:25:40.029 INFO:tasks.workunit.client.0.smithi047.stdout:1/39: stat d1 0 2024-02-07T12:25:40.030 INFO:tasks.workunit.client.0.smithi047.stdout:7/128: dread d0/d4/d1b/f23 [0,4194304] 0 2024-02-07T12:25:40.031 INFO:tasks.workunit.client.1.smithi138.stdout:6/970: getdents dc/d13/d1e/dc7 0 2024-02-07T12:25:40.032 INFO:tasks.workunit.client.1.smithi138.stdout:6/971: rmdir dc/d31/d3f 39 2024-02-07T12:25:40.034 INFO:tasks.workunit.client.1.smithi138.stdout:6/972: symlink dc/d13/d8e/l138 0 2024-02-07T12:25:40.034 INFO:tasks.workunit.client.1.smithi138.stdout:6/973: read - dc/d31/d54/dee/f112 zero size 2024-02-07T12:25:40.035 INFO:tasks.workunit.client.1.smithi138.stdout:2/956: dread d3/dd/d14/d49/d25/d3d/f3e [0,4194304] 0 2024-02-07T12:25:40.035 INFO:tasks.workunit.client.1.smithi138.stdout:6/974: creat dc/d69/f139 x:0 0 0 2024-02-07T12:25:40.035 INFO:tasks.workunit.client.1.smithi138.stdout:6/975: chown dc/d13/d1e/d35/d6d/da6/d10a/daa/fef 19111440 1 2024-02-07T12:25:40.036 INFO:tasks.workunit.client.0.smithi047.stdout:3/44: truncate f9 3493515 0 2024-02-07T12:25:40.037 INFO:tasks.workunit.client.1.smithi138.stdout:2/957: creat d3/dd/d14/f150 x:0 0 0 2024-02-07T12:25:40.037 INFO:tasks.workunit.client.1.smithi138.stdout:2/958: rmdir d3/dd/d14/d49/d29 39 2024-02-07T12:25:40.039 INFO:tasks.workunit.client.1.smithi138.stdout:2/959: creat d3/dd/d14/d82/dcc/d12a/d144/f151 x:0 0 0 2024-02-07T12:25:40.040 INFO:tasks.workunit.client.1.smithi138.stdout:2/960: truncate d3/dd/d14/d8f/d73/f12d 510536 0 2024-02-07T12:25:40.042 INFO:tasks.workunit.client.1.smithi138.stdout:9/804: write d0/d6/d8/d1d/f61 [4178771,108960] 0 2024-02-07T12:25:40.042 INFO:tasks.workunit.client.1.smithi138.stdout:9/805: chown d0/c71 45133929 1 2024-02-07T12:25:40.042 INFO:tasks.workunit.client.1.smithi138.stdout:2/961: link d3/dd/d14/d49/c2a d3/dd/dd2/c152 0 2024-02-07T12:25:40.043 INFO:tasks.workunit.client.1.smithi138.stdout:9/806: rename d0/d6/d8/d1d/dd/d1f/f47 to d0/d6/d8/d1d/dd/d1f/db7/db9/ff6 0 2024-02-07T12:25:40.049 INFO:tasks.workunit.client.1.smithi138.stdout:2/962: dread d3/d4e/d119/d7d/d97/fe9 [0,4194304] 0 2024-02-07T12:25:40.056 INFO:tasks.workunit.client.1.smithi138.stdout:6/976: dread f6 [0,4194304] 0 2024-02-07T12:25:40.059 INFO:tasks.workunit.client.0.smithi047.stdout:8/93: dwrite d3/d4/fa [0,4194304] 0 2024-02-07T12:25:40.060 INFO:tasks.workunit.client.1.smithi138.stdout:9/807: dwrite d0/d34/d86/fee [0,4194304] 0 2024-02-07T12:25:40.061 INFO:tasks.workunit.client.1.smithi138.stdout:9/808: creat d0/d6/d8/d1d/dd/d25/ff7 x:0 0 0 2024-02-07T12:25:40.063 INFO:tasks.workunit.client.1.smithi138.stdout:1/944: dwrite d5/d8/da/d1f/d5e/fdf [0,4194304] 0 2024-02-07T12:25:40.065 INFO:tasks.workunit.client.1.smithi138.stdout:9/809: mknod d0/d34/d86/ddd/cf8 0 2024-02-07T12:25:40.066 INFO:tasks.workunit.client.0.smithi047.stdout:6/66: dread d3/da/f12 [4194304,4194304] 0 2024-02-07T12:25:40.069 INFO:tasks.workunit.client.1.smithi138.stdout:2/963: dwrite d3/dd/d19/d1f/d37/f96 [0,4194304] 0 2024-02-07T12:25:40.069 INFO:tasks.workunit.client.1.smithi138.stdout:2/964: chown d3/dd/d19/d1f/d46/d71/faa 34640403 1 2024-02-07T12:25:40.070 INFO:tasks.workunit.client.1.smithi138.stdout:4/880: dwrite d20/d53/d71/d98/d117/d74/d9a/fc5 [0,4194304] 0 2024-02-07T12:25:40.070 INFO:tasks.workunit.client.1.smithi138.stdout:4/881: chown d20/d34/d36/f63 8171280 1 2024-02-07T12:25:40.071 INFO:tasks.workunit.client.1.smithi138.stdout:0/969: dwrite d4/d9/d75/f113 [0,4194304] 0 2024-02-07T12:25:40.071 INFO:tasks.workunit.client.0.smithi047.stdout:9/23: dwrite d3/f4 [0,4194304] 0 2024-02-07T12:25:40.071 INFO:tasks.workunit.client.0.smithi047.stdout:9/24: chown f2 50683 1 2024-02-07T12:25:40.071 INFO:tasks.workunit.client.0.smithi047.stdout:5/65: dwrite da/f11 [0,4194304] 0 2024-02-07T12:25:40.071 INFO:tasks.workunit.client.0.smithi047.stdout:9/25: dread f2 [0,4194304] 0 2024-02-07T12:25:40.071 INFO:tasks.workunit.client.0.smithi047.stdout:5/66: dread - da/f12 zero size 2024-02-07T12:25:40.073 INFO:tasks.workunit.client.1.smithi138.stdout:1/945: link d5/d8/da/d1f/d60/df4/fa1 d5/d8/da/df8/f130 0 2024-02-07T12:25:40.074 INFO:tasks.workunit.client.0.smithi047.stdout:0/38: getdents . 0 2024-02-07T12:25:40.076 INFO:tasks.workunit.client.1.smithi138.stdout:9/810: mkdir d0/d6/d8/d1d/dd/d1f/db7/db9/dc3/df9 0 2024-02-07T12:25:40.077 INFO:tasks.workunit.client.0.smithi047.stdout:1/40: dread f0 [0,4194304] 0 2024-02-07T12:25:40.077 INFO:tasks.workunit.client.0.smithi047.stdout:1/41: chown d1 119234448 1 2024-02-07T12:25:40.085 INFO:tasks.workunit.client.1.smithi138.stdout:2/965: unlink d3/d4e/c77 0 2024-02-07T12:25:40.085 INFO:tasks.workunit.client.1.smithi138.stdout:2/966: fsync d3/dd/d19/d1f/d46/d71/fe4 0 2024-02-07T12:25:40.087 INFO:tasks.workunit.client.0.smithi047.stdout:5/67: rename da/l10 to da/l14 0 2024-02-07T12:25:40.089 INFO:tasks.workunit.client.0.smithi047.stdout:7/129: rename d0/d4/d1b to d0/df/d29 0 2024-02-07T12:25:40.089 INFO:tasks.workunit.client.0.smithi047.stdout:9/26: rmdir d3 39 2024-02-07T12:25:40.091 INFO:tasks.workunit.client.1.smithi138.stdout:4/882: creat d20/d53/d71/f124 x:0 0 0 2024-02-07T12:25:40.091 INFO:tasks.workunit.client.1.smithi138.stdout:4/883: creat d20/d47/d69/d7c/db9/f125 x:0 0 0 2024-02-07T12:25:40.092 INFO:tasks.workunit.client.0.smithi047.stdout:9/27: getdents d3 0 2024-02-07T12:25:40.094 INFO:tasks.workunit.client.0.smithi047.stdout:0/39: dread f5 [0,4194304] 0 2024-02-07T12:25:40.097 INFO:tasks.workunit.client.1.smithi138.stdout:0/970: mkdir d4/d52/d3f/d130 0 2024-02-07T12:25:40.097 INFO:tasks.workunit.client.1.smithi138.stdout:0/971: getdents d4/d9/d37/d64/d9d/d12f 0 2024-02-07T12:25:40.098 INFO:tasks.workunit.client.0.smithi047.stdout:8/94: dwrite d3/d4/f1e [0,4194304] 0 2024-02-07T12:25:40.099 INFO:tasks.workunit.client.0.smithi047.stdout:0/40: creat fa x:0 0 0 2024-02-07T12:25:40.102 INFO:tasks.workunit.client.0.smithi047.stdout:8/95: creat d3/d16/f21 x:0 0 0 2024-02-07T12:25:40.102 INFO:tasks.workunit.client.0.smithi047.stdout:8/96: chown d3/l15 839940 1 2024-02-07T12:25:40.102 INFO:tasks.workunit.client.0.smithi047.stdout:5/68: dread da/f11 [0,4194304] 0 2024-02-07T12:25:40.102 INFO:tasks.workunit.client.0.smithi047.stdout:5/69: read - da/f12 zero size 2024-02-07T12:25:40.103 INFO:tasks.workunit.client.0.smithi047.stdout:8/97: mknod d3/d16/c22 0 2024-02-07T12:25:40.103 INFO:tasks.workunit.client.1.smithi138.stdout:2/967: mknod d3/dd/d14/d82/c153 0 2024-02-07T12:25:40.104 INFO:tasks.workunit.client.1.smithi138.stdout:4/884: mknod d20/d47/c126 0 2024-02-07T12:25:40.106 INFO:tasks.workunit.client.0.smithi047.stdout:5/70: rename da/f12 to da/f15 0 2024-02-07T12:25:40.106 INFO:tasks.workunit.client.1.smithi138.stdout:0/972: symlink d4/d52/de4/l131 0 2024-02-07T12:25:40.107 INFO:tasks.workunit.client.0.smithi047.stdout:8/98: creat d3/d4/d1f/f23 x:0 0 0 2024-02-07T12:25:40.108 INFO:tasks.workunit.client.0.smithi047.stdout:8/99: chown d3/f17 21 1 2024-02-07T12:25:40.108 INFO:tasks.workunit.client.0.smithi047.stdout:6/67: dwrite d3/d5/f7 [4194304,4194304] 0 2024-02-07T12:25:40.108 INFO:tasks.workunit.client.0.smithi047.stdout:0/41: dread f5 [0,4194304] 0 2024-02-07T12:25:40.108 INFO:tasks.workunit.client.1.smithi138.stdout:2/968: creat d3/dd/d14/d49/dc2/f154 x:0 0 0 2024-02-07T12:25:40.108 INFO:tasks.workunit.client.1.smithi138.stdout:2/969: fsync d3/dd/d14/d82/fff 0 2024-02-07T12:25:40.108 INFO:tasks.workunit.client.1.smithi138.stdout:4/885: mknod d20/d47/d69/d7c/dfe/c127 0 2024-02-07T12:25:40.109 INFO:tasks.workunit.client.1.smithi138.stdout:4/886: write d20/d53/fd7 [484177,114228] 0 2024-02-07T12:25:40.109 INFO:tasks.workunit.client.1.smithi138.stdout:9/811: dwrite d0/faf [0,4194304] 0 2024-02-07T12:25:40.110 INFO:tasks.workunit.client.0.smithi047.stdout:1/42: dwrite d1/f5 [0,4194304] 0 2024-02-07T12:25:40.110 INFO:tasks.workunit.client.0.smithi047.stdout:1/43: fsync d1/f5 0 2024-02-07T12:25:40.110 INFO:tasks.workunit.client.0.smithi047.stdout:1/44: creat d1/f6 x:0 0 0 2024-02-07T12:25:40.110 INFO:tasks.workunit.client.0.smithi047.stdout:1/45: write d1/f6 [158587,14215] 0 2024-02-07T12:25:40.110 INFO:tasks.workunit.client.0.smithi047.stdout:1/46: write d1/f6 [185826,46895] 0 2024-02-07T12:25:40.112 INFO:tasks.workunit.client.0.smithi047.stdout:6/68: rename d3/d5/f6 to d3/d5/f13 0 2024-02-07T12:25:40.112 INFO:tasks.workunit.client.0.smithi047.stdout:0/42: mknod cb 0 2024-02-07T12:25:40.113 INFO:tasks.workunit.client.1.smithi138.stdout:2/970: mkdir d3/dd/d14/d8f/d155 0 2024-02-07T12:25:40.118 INFO:tasks.workunit.client.0.smithi047.stdout:6/69: rename d3/d5/d10 to d3/da/d14 0 2024-02-07T12:25:40.119 INFO:tasks.workunit.client.1.smithi138.stdout:4/887: rename d20/d53/fd7 to d20/d53/d71/d98/d117/f128 0 2024-02-07T12:25:40.119 INFO:tasks.workunit.client.0.smithi047.stdout:5/71: dread da/fd [0,4194304] 0 2024-02-07T12:25:40.119 INFO:tasks.workunit.client.0.smithi047.stdout:3/45: dwrite f9 [0,4194304] 0 2024-02-07T12:25:40.120 INFO:tasks.workunit.client.1.smithi138.stdout:2/971: dread d3/d4e/d119/fc0 [0,4194304] 0 2024-02-07T12:25:40.121 INFO:tasks.workunit.client.0.smithi047.stdout:8/100: write d3/f17 [29455,7262] 0 2024-02-07T12:25:40.123 INFO:tasks.workunit.client.0.smithi047.stdout:7/130: dread d0/df/f1d [0,4194304] 0 2024-02-07T12:25:40.123 INFO:tasks.workunit.client.0.smithi047.stdout:3/46: creat fb x:0 0 0 2024-02-07T12:25:40.125 INFO:tasks.workunit.client.1.smithi138.stdout:4/888: link d20/f39 d20/d53/dd1/d11b/f129 0 2024-02-07T12:25:40.125 INFO:tasks.workunit.client.1.smithi138.stdout:4/889: readlink d20/d34/d36/l78 0 2024-02-07T12:25:40.125 INFO:tasks.workunit.client.1.smithi138.stdout:5/847: sync 2024-02-07T12:25:40.125 INFO:tasks.workunit.client.1.smithi138.stdout:5/848: write da/d43/d4a/da2/d112/d2e/d4f/d2b/d35/dae/db0/d91/fde [197338,107704] 0 2024-02-07T12:25:40.127 INFO:tasks.workunit.client.0.smithi047.stdout:5/72: write da/fd [2336011,87409] 0 2024-02-07T12:25:40.136 INFO:tasks.workunit.client.0.smithi047.stdout:6/70: dread d3/d5/f13 [0,4194304] 0 2024-02-07T12:25:40.136 INFO:tasks.workunit.client.0.smithi047.stdout:6/71: chown d3/d5 80415 1 2024-02-07T12:25:40.136 INFO:tasks.workunit.client.0.smithi047.stdout:6/72: creat d3/d5/f15 x:0 0 0 2024-02-07T12:25:40.136 INFO:tasks.workunit.client.0.smithi047.stdout:8/101: rename d3/l15 to d3/d4/l24 0 2024-02-07T12:25:40.136 INFO:tasks.workunit.client.0.smithi047.stdout:8/102: creat d3/d4/f25 x:0 0 0 2024-02-07T12:25:40.136 INFO:tasks.workunit.client.0.smithi047.stdout:8/103: chown d3/d4/f25 29 1 2024-02-07T12:25:40.137 INFO:tasks.workunit.client.1.smithi138.stdout:4/890: creat d20/d47/d69/d7c/dfe/d114/df5/f12a x:0 0 0 2024-02-07T12:25:40.139 INFO:tasks.workunit.client.0.smithi047.stdout:7/131: dread d0/d4/f12 [0,4194304] 0 2024-02-07T12:25:40.140 INFO:tasks.workunit.client.1.smithi138.stdout:5/849: mkdir da/d43/d4a/da2/d112/d2e/d4f/d2b/d35/d5d/d73/d11c 0 2024-02-07T12:25:40.140 INFO:tasks.workunit.client.1.smithi138.stdout:5/850: readlink da/d43/d4a/da2/d112/d2e/d4f/d2b/d35/d40/lb9 0 2024-02-07T12:25:40.140 INFO:tasks.workunit.client.1.smithi138.stdout:5/851: chown da/d43/d4a/da2/d112/d2e/d4f/da3/cfc 494591 1 2024-02-07T12:25:40.140 INFO:tasks.workunit.client.1.smithi138.stdout:5/852: write da/d6d/f4e [3776998,101413] 0 2024-02-07T12:25:40.140 INFO:tasks.workunit.client.1.smithi138.stdout:5/853: creat da/d50/f11d x:0 0 0 2024-02-07T12:25:40.140 INFO:tasks.workunit.client.1.smithi138.stdout:5/854: write da/d6d/f4e [2552478,106390] 0 2024-02-07T12:25:40.141 INFO:tasks.workunit.client.0.smithi047.stdout:4/8: sync 2024-02-07T12:25:40.142 INFO:tasks.workunit.client.0.smithi047.stdout:2/87: sync 2024-02-07T12:25:40.146 INFO:tasks.workunit.client.1.smithi138.stdout:0/973: dwrite d4/d52/f44 [0,4194304] 0 2024-02-07T12:25:40.146 INFO:tasks.workunit.client.1.smithi138.stdout:0/974: dread - d4/d9/db/d39/d4b/ff6 zero size 2024-02-07T12:25:40.146 INFO:tasks.workunit.client.1.smithi138.stdout:0/975: readlink d4/d9/l83 0 2024-02-07T12:25:40.149 INFO:tasks.workunit.client.0.smithi047.stdout:6/73: mknod d3/d5/c16 0 2024-02-07T12:25:40.149 INFO:tasks.workunit.client.0.smithi047.stdout:6/74: chown d3/f8 78262239 1 2024-02-07T12:25:40.152 INFO:tasks.workunit.client.1.smithi138.stdout:0/976: link d4/d9/d37/d64/df5/c116 d4/d9/d37/d64/d9d/d12f/c132 0 2024-02-07T12:25:40.152 INFO:tasks.workunit.client.1.smithi138.stdout:0/977: chown d4/d9/de/f45 3431847 1 2024-02-07T12:25:40.152 INFO:tasks.workunit.client.0.smithi047.stdout:1/47: dwrite d1/f5 [0,4194304] 0 2024-02-07T12:25:40.153 INFO:tasks.workunit.client.1.smithi138.stdout:9/812: dwrite d0/f6f [4194304,4194304] 0 2024-02-07T12:25:40.153 INFO:tasks.workunit.client.1.smithi138.stdout:9/813: fsync d0/d6/d8/d1d/dd/d41/d5e/d74/fa4 0 2024-02-07T12:25:40.154 INFO:tasks.workunit.client.1.smithi138.stdout:2/972: dwrite d3/dd/d14/d49/d25/d3d/f52 [0,4194304] 0 2024-02-07T12:25:40.154 INFO:tasks.workunit.client.1.smithi138.stdout:2/973: creat d3/d4e/f156 x:0 0 0 2024-02-07T12:25:40.155 INFO:tasks.workunit.client.0.smithi047.stdout:7/132: mknod d0/df/c2a 0 2024-02-07T12:25:40.156 INFO:tasks.workunit.client.1.smithi138.stdout:4/891: dwrite d20/d53/d71/d75/d94/ff4 [0,4194304] 0 2024-02-07T12:25:40.158 INFO:tasks.workunit.client.0.smithi047.stdout:2/88: dread d7/fb [0,4194304] 0 2024-02-07T12:25:40.158 INFO:tasks.workunit.client.0.smithi047.stdout:8/104: mknod d3/c26 0 2024-02-07T12:25:40.158 INFO:tasks.workunit.client.0.smithi047.stdout:5/73: dwrite da/f11 [0,4194304] 0 2024-02-07T12:25:40.158 INFO:tasks.workunit.client.0.smithi047.stdout:4/9: creat f1 x:0 0 0 2024-02-07T12:25:40.158 INFO:tasks.workunit.client.0.smithi047.stdout:4/10: dread - f1 zero size 2024-02-07T12:25:40.158 INFO:tasks.workunit.client.0.smithi047.stdout:4/11: truncate f1 879243 0 2024-02-07T12:25:40.159 INFO:tasks.workunit.client.1.smithi138.stdout:0/978: truncate d4/d9/f18 1428290 0 2024-02-07T12:25:40.159 INFO:tasks.workunit.client.0.smithi047.stdout:0/43: getdents . 0 2024-02-07T12:25:40.162 INFO:tasks.workunit.client.1.smithi138.stdout:2/974: mknod d3/dd/d14/d86/d141/c157 0 2024-02-07T12:25:40.162 INFO:tasks.workunit.client.0.smithi047.stdout:3/47: rename fb to fc 0 2024-02-07T12:25:40.162 INFO:tasks.workunit.client.0.smithi047.stdout:3/48: write fc [251152,66500] 0 2024-02-07T12:25:40.163 INFO:tasks.workunit.client.0.smithi047.stdout:3/49: fdatasync f2 0 2024-02-07T12:25:40.163 INFO:tasks.workunit.client.0.smithi047.stdout:3/50: chown l0 126206 1 2024-02-07T12:25:40.163 INFO:tasks.workunit.client.1.smithi138.stdout:0/979: mknod d4/d9/d37/d64/d9d/c133 0 2024-02-07T12:25:40.164 INFO:tasks.workunit.client.0.smithi047.stdout:4/12: dread f1 [0,4194304] 0 2024-02-07T12:25:40.164 INFO:tasks.workunit.client.0.smithi047.stdout:4/13: chown f1 371 1 2024-02-07T12:25:40.164 INFO:tasks.workunit.client.0.smithi047.stdout:4/14: creat f2 x:0 0 0 2024-02-07T12:25:40.167 INFO:tasks.workunit.client.1.smithi138.stdout:5/855: dwrite da/d43/d4a/da2/d112/d2e/fd2 [0,4194304] 0 2024-02-07T12:25:40.168 INFO:tasks.workunit.client.1.smithi138.stdout:4/892: dread d20/d34/d36/f5f [0,4194304] 0 2024-02-07T12:25:40.168 INFO:tasks.workunit.client.1.smithi138.stdout:4/893: write d20/d34/d59/d88/d8e/ff1 [5110022,49336] 0 2024-02-07T12:25:40.169 INFO:tasks.workunit.client.0.smithi047.stdout:6/75: mknod d3/c17 0 2024-02-07T12:25:40.169 INFO:tasks.workunit.client.0.smithi047.stdout:6/76: creat d3/f18 x:0 0 0 2024-02-07T12:25:40.169 INFO:tasks.workunit.client.0.smithi047.stdout:1/48: mknod d1/c7 0 2024-02-07T12:25:40.171 INFO:tasks.workunit.client.0.smithi047.stdout:7/133: mknod d0/df/c2b 0 2024-02-07T12:25:40.171 INFO:tasks.workunit.client.0.smithi047.stdout:7/134: chown d0/c28 3 1 2024-02-07T12:25:40.173 INFO:tasks.workunit.client.1.smithi138.stdout:2/975: rename d3/dd/d19/d1f/d46/d71/d7e/f131 to d3/dd/d14/d8f/dbc/dfe/f158 0 2024-02-07T12:25:40.175 INFO:tasks.workunit.client.1.smithi138.stdout:0/980: symlink d4/d9/db/d39/d4b/d6c/dc5/de0/l134 0 2024-02-07T12:25:40.176 INFO:tasks.workunit.client.1.smithi138.stdout:0/981: stat d4/d9/d37/d3d/d9c/lfc 0 2024-02-07T12:25:40.176 INFO:tasks.workunit.client.0.smithi047.stdout:4/15: mkdir d3 0 2024-02-07T12:25:40.176 INFO:tasks.workunit.client.0.smithi047.stdout:4/16: write f1 [1684730,22470] 0 2024-02-07T12:25:40.180 INFO:tasks.workunit.client.0.smithi047.stdout:1/49: symlink d1/l8 0 2024-02-07T12:25:40.181 INFO:tasks.workunit.client.0.smithi047.stdout:6/77: creat d3/da/f19 x:0 0 0 2024-02-07T12:25:40.181 INFO:tasks.workunit.client.0.smithi047.stdout:3/51: mknod cd 0 2024-02-07T12:25:40.181 INFO:tasks.workunit.client.0.smithi047.stdout:4/17: creat d3/f4 x:0 0 0 2024-02-07T12:25:40.181 INFO:tasks.workunit.client.0.smithi047.stdout:3/52: stat l0 0 2024-02-07T12:25:40.181 INFO:tasks.workunit.client.0.smithi047.stdout:4/18: chown f2 2012 1 2024-02-07T12:25:40.184 INFO:tasks.workunit.client.0.smithi047.stdout:8/105: dwrite d3/d4/fa [0,4194304] 0 2024-02-07T12:25:40.184 INFO:tasks.workunit.client.0.smithi047.stdout:3/53: mknod ce 0 2024-02-07T12:25:40.187 INFO:tasks.workunit.client.1.smithi138.stdout:4/894: link d20/d53/d71/d98/d117/f6d d20/d53/f12b 0 2024-02-07T12:25:40.188 INFO:tasks.workunit.client.0.smithi047.stdout:8/106: link d3/d4/f12 d3/f27 0 2024-02-07T12:25:40.190 INFO:tasks.workunit.client.1.smithi138.stdout:4/895: write d20/d4d/fbf [361372,27175] 0 2024-02-07T12:25:40.190 INFO:tasks.workunit.client.1.smithi138.stdout:4/896: write d20/d34/d59/d72/d77/fb5 [482485,121635] 0 2024-02-07T12:25:40.191 INFO:tasks.workunit.client.1.smithi138.stdout:0/982: write d4/d9/d37/dbe/ff7 [2195656,45472] 0 2024-02-07T12:25:40.194 INFO:tasks.workunit.client.0.smithi047.stdout:2/89: dwrite d7/f8 [0,4194304] 0 2024-02-07T12:25:40.194 INFO:tasks.workunit.client.0.smithi047.stdout:8/107: unlink d3/c26 0 2024-02-07T12:25:40.194 INFO:tasks.workunit.client.0.smithi047.stdout:3/54: rename l7 to lf 0 2024-02-07T12:25:40.194 INFO:tasks.workunit.client.1.smithi138.stdout:5/856: rename da/d43/d4a/da2/d112/d2e to da/d22/d99/dca/d11e 0 2024-02-07T12:25:40.194 INFO:tasks.workunit.client.1.smithi138.stdout:5/857: chown da/d22/d99/dca/d11e/d4f/d2b/d35/laf 465333 1 2024-02-07T12:25:40.198 INFO:tasks.workunit.client.0.smithi047.stdout:2/90: symlink d7/l22 0 2024-02-07T12:25:40.198 INFO:tasks.workunit.client.1.smithi138.stdout:4/897: mknod d20/d47/d69/d7c/dfe/d114/df5/c12c 0 2024-02-07T12:25:40.198 INFO:tasks.workunit.client.1.smithi138.stdout:5/858: getdents da/d34/dbd 0 2024-02-07T12:25:40.198 INFO:tasks.workunit.client.1.smithi138.stdout:5/859: chown da/d22/d99/dca/d11e/c71 143137 1 2024-02-07T12:25:40.199 INFO:tasks.workunit.client.0.smithi047.stdout:3/55: rename l6 to l10 0 2024-02-07T12:25:40.201 INFO:tasks.workunit.client.1.smithi138.stdout:4/898: mkdir d20/d47/d69/de4/ded/d12d 0 2024-02-07T12:25:40.201 INFO:tasks.workunit.client.0.smithi047.stdout:1/50: write d1/f5 [1564682,14807] 0 2024-02-07T12:25:40.202 INFO:tasks.workunit.client.0.smithi047.stdout:6/78: read d3/f8 [2387694,98066] 0 2024-02-07T12:25:40.202 INFO:tasks.workunit.client.0.smithi047.stdout:6/79: rename d3/da to d3/da/d14/d1a 22 2024-02-07T12:25:40.202 INFO:tasks.workunit.client.0.smithi047.stdout:6/80: readlink d3/lb 0 2024-02-07T12:25:40.202 INFO:tasks.workunit.client.0.smithi047.stdout:6/81: readlink d3/lb 0 2024-02-07T12:25:40.203 INFO:tasks.workunit.client.1.smithi138.stdout:5/860: mkdir da/d22/d99/dca/d11e/d4f/d2b/d35/d110/d11f 0 2024-02-07T12:25:40.203 INFO:tasks.workunit.client.1.smithi138.stdout:5/861: write da/d43/d4a/da2/d112/f108 [474255,41913] 0 2024-02-07T12:25:40.204 INFO:tasks.workunit.client.0.smithi047.stdout:1/51: rename d1/l8 to d1/l9 0 2024-02-07T12:25:40.205 INFO:tasks.workunit.client.0.smithi047.stdout:6/82: unlink d3/da/f12 0 2024-02-07T12:25:40.206 INFO:tasks.workunit.client.1.smithi138.stdout:4/899: link d20/d47/f4b d20/d53/d71/d98/d117/d74/f12e 0 2024-02-07T12:25:40.210 INFO:tasks.workunit.client.0.smithi047.stdout:6/83: creat d3/da/d14/f1b x:0 0 0 2024-02-07T12:25:40.210 INFO:tasks.workunit.client.0.smithi047.stdout:6/84: stat d3/da 0 2024-02-07T12:25:40.210 INFO:tasks.workunit.client.0.smithi047.stdout:6/85: chown d3/d5/f7 153949371 1 2024-02-07T12:25:40.210 INFO:tasks.workunit.client.0.smithi047.stdout:6/86: fsync d3/d5/f7 0 2024-02-07T12:25:40.211 INFO:tasks.workunit.client.0.smithi047.stdout:7/135: dwrite d0/df/d29/f22 [0,4194304] 0 2024-02-07T12:25:40.211 INFO:tasks.workunit.client.0.smithi047.stdout:2/91: write d7/f1e [2109294,94068] 0 2024-02-07T12:25:40.211 INFO:tasks.workunit.client.0.smithi047.stdout:2/92: chown d7/f8 14 1 2024-02-07T12:25:40.212 INFO:tasks.workunit.client.1.smithi138.stdout:2/976: dwrite d3/dd/f2e [4194304,4194304] 0 2024-02-07T12:25:40.212 INFO:tasks.workunit.client.0.smithi047.stdout:6/87: link d3/da/f19 d3/da/d14/f1c 0 2024-02-07T12:25:40.212 INFO:tasks.workunit.client.1.smithi138.stdout:5/862: unlink da/f19 0 2024-02-07T12:25:40.216 INFO:tasks.workunit.client.0.smithi047.stdout:2/93: dread d7/f13 [0,4194304] 0 2024-02-07T12:25:40.216 INFO:tasks.workunit.client.0.smithi047.stdout:2/94: write d7/f1e [2696761,50334] 0 2024-02-07T12:25:40.216 INFO:tasks.workunit.client.0.smithi047.stdout:2/95: write d7/f1e [3340149,32696] 0 2024-02-07T12:25:40.216 INFO:tasks.workunit.client.0.smithi047.stdout:4/19: dwrite f2 [0,4194304] 0 2024-02-07T12:25:40.217 INFO:tasks.workunit.client.0.smithi047.stdout:3/56: dread f9 [0,4194304] 0 2024-02-07T12:25:40.219 INFO:tasks.workunit.client.1.smithi138.stdout:2/977: rename d3/dd/d19/d1f/d46/d71/d7e/l11a to d3/d4e/l159 0 2024-02-07T12:25:40.222 INFO:tasks.workunit.client.0.smithi047.stdout:3/57: creat f11 x:0 0 0 2024-02-07T12:25:40.222 INFO:tasks.workunit.client.0.smithi047.stdout:2/96: dread d7/f8 [4194304,4194304] 0 2024-02-07T12:25:40.225 INFO:tasks.workunit.client.0.smithi047.stdout:2/97: getdents d7/dc 0 2024-02-07T12:25:40.228 INFO:tasks.workunit.client.0.smithi047.stdout:7/136: read d0/d4/f12 [3186954,9250] 0 2024-02-07T12:25:40.228 INFO:tasks.workunit.client.0.smithi047.stdout:7/137: fsync d0/d4/f1e 0 2024-02-07T12:25:40.230 INFO:tasks.workunit.client.0.smithi047.stdout:7/138: creat d0/f2c x:0 0 0 2024-02-07T12:25:40.230 INFO:tasks.workunit.client.0.smithi047.stdout:7/139: write d0/f2c [925238,3663] 0 2024-02-07T12:25:40.238 INFO:tasks.workunit.client.0.smithi047.stdout:2/98: dread d7/f8 [0,4194304] 0 2024-02-07T12:25:40.239 INFO:tasks.workunit.client.1.smithi138.stdout:5/863: creat da/d22/d99/dca/d11e/d4f/d2b/d35/d110/f120 x:0 0 0 2024-02-07T12:25:40.240 INFO:tasks.workunit.client.1.smithi138.stdout:5/864: chown da/d22/d99/dca/dd5/l101 17 1 2024-02-07T12:25:40.241 INFO:tasks.workunit.client.1.smithi138.stdout:2/978: mkdir d3/dd/d19/d15a 0 2024-02-07T12:25:40.241 INFO:tasks.workunit.client.1.smithi138.stdout:2/979: fsync d3/dd/d14/d49/d25/d3d/f14b 0 2024-02-07T12:25:40.241 INFO:tasks.workunit.client.1.smithi138.stdout:2/980: getdents d3/dd/dd2/d14a 0 2024-02-07T12:25:40.241 INFO:tasks.workunit.client.1.smithi138.stdout:5/865: symlink da/d22/l121 0 2024-02-07T12:25:40.243 INFO:tasks.workunit.client.1.smithi138.stdout:2/981: creat d3/dd/d14/d8f/dbc/f15b x:0 0 0 2024-02-07T12:25:40.243 INFO:tasks.workunit.client.1.smithi138.stdout:5/866: getdents da/d22/d99/dca/d11e/d4f/d2b/d35/d67/de3 0 2024-02-07T12:25:40.244 INFO:tasks.workunit.client.1.smithi138.stdout:6/977: sync 2024-02-07T12:25:40.244 INFO:tasks.workunit.client.1.smithi138.stdout:6/978: readlink dc/d13/d1e/l128 0 2024-02-07T12:25:40.245 INFO:tasks.workunit.client.0.smithi047.stdout:2/99: write d7/dc/f10 [1348306,83053] 0 2024-02-07T12:25:40.245 INFO:tasks.workunit.client.0.smithi047.stdout:2/100: chown d7/l9 469497 1 2024-02-07T12:25:40.245 INFO:tasks.workunit.client.0.smithi047.stdout:2/101: creat d7/f23 x:0 0 0 2024-02-07T12:25:40.245 INFO:tasks.workunit.client.1.smithi138.stdout:2/982: mkdir d3/dd/d14/d8f/d15c 0 2024-02-07T12:25:40.246 INFO:tasks.workunit.client.0.smithi047.stdout:8/108: dwrite d3/f9 [0,4194304] 0 2024-02-07T12:25:40.246 INFO:tasks.workunit.client.1.smithi138.stdout:6/979: mkdir dc/d13/d1e/dae/db2/d13a 0 2024-02-07T12:25:40.247 INFO:tasks.workunit.client.1.smithi138.stdout:6/980: fsync dc/d13/d1e/d35/d6d/da6/f129 0 2024-02-07T12:25:40.247 INFO:tasks.workunit.client.1.smithi138.stdout:5/867: dread da/d22/d99/dca/d11e/d4f/d2b/fab [0,4194304] 0 2024-02-07T12:25:40.247 INFO:tasks.workunit.client.1.smithi138.stdout:5/868: readlink da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/d96/l117 0 2024-02-07T12:25:40.248 INFO:tasks.workunit.client.1.smithi138.stdout:2/983: mknod d3/dd/d14/d8f/d73/d80/df0/c15d 0 2024-02-07T12:25:40.248 INFO:tasks.workunit.client.1.smithi138.stdout:6/981: mkdir dc/d13/d1e/d35/d85/dba/d13b 0 2024-02-07T12:25:40.249 INFO:tasks.workunit.client.1.smithi138.stdout:5/869: rmdir da/d34/dbd 39 2024-02-07T12:25:40.249 INFO:tasks.workunit.client.1.smithi138.stdout:5/870: write da/d22/d99/dca/d11e/d4f/d2b/d35/d40/f5e [5286481,109220] 0 2024-02-07T12:25:40.251 INFO:tasks.workunit.client.1.smithi138.stdout:5/871: truncate da/d6d/fac 2486400 0 2024-02-07T12:25:40.252 INFO:tasks.workunit.client.0.smithi047.stdout:1/52: dwrite f0 [0,4194304] 0 2024-02-07T12:25:40.254 INFO:tasks.workunit.client.1.smithi138.stdout:2/984: dread d3/f53 [0,4194304] 0 2024-02-07T12:25:40.254 INFO:tasks.workunit.client.1.smithi138.stdout:2/985: stat d3/dd/d19/f15 0 2024-02-07T12:25:40.255 INFO:tasks.workunit.client.0.smithi047.stdout:8/109: dread d3/f9 [0,4194304] 0 2024-02-07T12:25:40.255 INFO:tasks.workunit.client.0.smithi047.stdout:8/110: write d3/d4/f25 [622706,85028] 0 2024-02-07T12:25:40.258 INFO:tasks.workunit.client.0.smithi047.stdout:8/111: mkdir d3/d16/d28 0 2024-02-07T12:25:40.260 INFO:tasks.workunit.client.0.smithi047.stdout:8/112: rename d3/c13 to d3/d16/c29 0 2024-02-07T12:25:40.260 INFO:tasks.workunit.client.0.smithi047.stdout:8/113: chown d3/l20 642 1 2024-02-07T12:25:40.267 INFO:tasks.workunit.client.0.smithi047.stdout:8/114: dread d3/d4/f12 [0,4194304] 0 2024-02-07T12:25:40.267 INFO:tasks.workunit.client.0.smithi047.stdout:6/88: dwrite d3/f18 [0,4194304] 0 2024-02-07T12:25:40.272 INFO:tasks.workunit.client.0.smithi047.stdout:6/89: mknod d3/da/c1d 0 2024-02-07T12:25:40.272 INFO:tasks.workunit.client.1.smithi138.stdout:2/986: dread d3/dd/d14/d49/d29/d5b/f8d [0,4194304] 0 2024-02-07T12:25:40.272 INFO:tasks.workunit.client.1.smithi138.stdout:2/987: dread - d3/dd/d14/d49/d25/d3d/f14b zero size 2024-02-07T12:25:40.273 INFO:tasks.workunit.client.0.smithi047.stdout:2/102: fsync d7/f1e 0 2024-02-07T12:25:40.273 INFO:tasks.workunit.client.0.smithi047.stdout:2/103: fdatasync d7/dc/f1a 0 2024-02-07T12:25:40.273 INFO:tasks.workunit.client.1.smithi138.stdout:2/988: creat d3/dd/d14/d8f/dbc/dfe/f15e x:0 0 0 2024-02-07T12:25:40.274 INFO:tasks.workunit.client.0.smithi047.stdout:3/58: write fc [94342,100887] 0 2024-02-07T12:25:40.274 INFO:tasks.workunit.client.0.smithi047.stdout:3/59: chown l1 2962821 1 2024-02-07T12:25:40.275 INFO:tasks.workunit.client.0.smithi047.stdout:4/20: dwrite f2 [0,4194304] 0 2024-02-07T12:25:40.275 INFO:tasks.workunit.client.0.smithi047.stdout:4/21: write d3/f4 [810052,79934] 0 2024-02-07T12:25:40.276 INFO:tasks.workunit.client.1.smithi138.stdout:6/982: dwrite dc/d13/d1e/d35/d85/dba/ff9 [0,4194304] 0 2024-02-07T12:25:40.276 INFO:tasks.workunit.client.1.smithi138.stdout:6/983: creat dc/d13/d1e/dae/f13c x:0 0 0 2024-02-07T12:25:40.276 INFO:tasks.workunit.client.0.smithi047.stdout:7/140: dwrite d0/d4/f5 [4194304,4194304] 0 2024-02-07T12:25:40.277 INFO:tasks.workunit.client.0.smithi047.stdout:7/141: chown d0/f1a 6059276 1 2024-02-07T12:25:40.277 INFO:tasks.workunit.client.0.smithi047.stdout:7/142: dread - d0/df/f15 zero size 2024-02-07T12:25:40.277 INFO:tasks.workunit.client.1.smithi138.stdout:2/989: symlink d3/dd/d19/d1f/dc9/l15f 0 2024-02-07T12:25:40.277 INFO:tasks.workunit.client.1.smithi138.stdout:4/900: dwrite f3 [4194304,4194304] 0 2024-02-07T12:25:40.278 INFO:tasks.workunit.client.1.smithi138.stdout:0/983: dwrite d4/d52/fd7 [0,4194304] 0 2024-02-07T12:25:40.280 INFO:tasks.workunit.client.0.smithi047.stdout:1/53: rename d1/l9 to d1/la 0 2024-02-07T12:25:40.284 INFO:tasks.workunit.client.0.smithi047.stdout:2/104: symlink d7/l24 0 2024-02-07T12:25:40.284 INFO:tasks.workunit.client.0.smithi047.stdout:2/105: readlink d7/dc/l1d 0 2024-02-07T12:25:40.286 INFO:tasks.workunit.client.0.smithi047.stdout:6/90: rmdir d3/da/d14 39 2024-02-07T12:25:40.292 INFO:tasks.workunit.client.1.smithi138.stdout:2/990: write d3/dd/d19/f35 [1971676,98833] 0 2024-02-07T12:25:40.295 INFO:tasks.workunit.client.1.smithi138.stdout:6/984: write f6 [8200219,110016] 0 2024-02-07T12:25:40.297 INFO:tasks.workunit.client.0.smithi047.stdout:6/91: mkdir d3/d1e 0 2024-02-07T12:25:40.298 INFO:tasks.workunit.client.1.smithi138.stdout:4/901: read d20/d4d/f99 [5288809,73868] 0 2024-02-07T12:25:40.300 INFO:tasks.workunit.client.0.smithi047.stdout:4/22: dread d3/f4 [0,4194304] 0 2024-02-07T12:25:40.301 INFO:tasks.workunit.client.0.smithi047.stdout:4/23: creat d3/f5 x:0 0 0 2024-02-07T12:25:40.301 INFO:tasks.workunit.client.1.smithi138.stdout:0/984: creat d4/d9/db/d39/d4b/d6c/dc5/de0/f135 x:0 0 0 2024-02-07T12:25:40.302 INFO:tasks.workunit.client.1.smithi138.stdout:2/991: mknod d3/dd/d14/d49/df8/c160 0 2024-02-07T12:25:40.306 INFO:tasks.workunit.client.0.smithi047.stdout:7/143: read d0/d4/f20 [2753126,68639] 0 2024-02-07T12:25:40.307 INFO:tasks.workunit.client.1.smithi138.stdout:4/902: creat d20/d34/d59/f12f x:0 0 0 2024-02-07T12:25:40.308 INFO:tasks.workunit.client.0.smithi047.stdout:8/115: rmdir d3/d16 39 2024-02-07T12:25:40.308 INFO:tasks.workunit.client.0.smithi047.stdout:8/116: fdatasync d3/f1d 0 2024-02-07T12:25:40.309 INFO:tasks.workunit.client.0.smithi047.stdout:1/54: dwrite d1/f6 [0,4194304] 0 2024-02-07T12:25:40.310 INFO:tasks.workunit.client.0.smithi047.stdout:3/60: dwrite f11 [0,4194304] 0 2024-02-07T12:25:40.310 INFO:tasks.workunit.client.0.smithi047.stdout:8/117: mkdir d3/d16/d2a 0 2024-02-07T12:25:40.310 INFO:tasks.workunit.client.1.smithi138.stdout:2/992: rmdir d3/dd/d19/d1f/d46/d71/d111 39 2024-02-07T12:25:40.310 INFO:tasks.workunit.client.1.smithi138.stdout:2/993: chown d3/dd/d14/d8f/d73/d80/l8c 0 1 2024-02-07T12:25:40.311 INFO:tasks.workunit.client.1.smithi138.stdout:0/985: dread d4/d9/d37/f60 [0,4194304] 0 2024-02-07T12:25:40.313 INFO:tasks.workunit.client.1.smithi138.stdout:2/994: rename d3/dd/cd4 to d3/dd/d14/d82/dcc/c161 0 2024-02-07T12:25:40.313 INFO:tasks.workunit.client.1.smithi138.stdout:2/995: write d3/f53 [1399392,1341] 0 2024-02-07T12:25:40.315 INFO:tasks.workunit.client.1.smithi138.stdout:0/986: creat d4/d9/d37/dbe/f136 x:0 0 0 2024-02-07T12:25:40.316 INFO:tasks.workunit.client.0.smithi047.stdout:1/55: rename d1/c4 to d1/cb 0 2024-02-07T12:25:40.319 INFO:tasks.workunit.client.1.smithi138.stdout:2/996: unlink d3/dd/d14/d8f/dbc/c12c 0 2024-02-07T12:25:40.320 INFO:tasks.workunit.client.1.smithi138.stdout:4/903: write d20/d53/d71/d98/d117/feb [4304755,109192] 0 2024-02-07T12:25:40.320 INFO:tasks.workunit.client.0.smithi047.stdout:8/118: creat d3/d16/d2a/f2b x:0 0 0 2024-02-07T12:25:40.321 INFO:tasks.workunit.client.1.smithi138.stdout:0/987: rename d4/d9/f8e to d4/d52/de9/f137 0 2024-02-07T12:25:40.324 INFO:tasks.workunit.client.0.smithi047.stdout:3/61: mkdir d12 0 2024-02-07T12:25:40.327 INFO:tasks.workunit.client.0.smithi047.stdout:4/24: truncate f1 1408374 0 2024-02-07T12:25:40.327 INFO:tasks.workunit.client.0.smithi047.stdout:4/25: creat d3/f6 x:0 0 0 2024-02-07T12:25:40.327 INFO:tasks.workunit.client.0.smithi047.stdout:4/26: chown f1 27772 1 2024-02-07T12:25:40.328 INFO:tasks.workunit.client.1.smithi138.stdout:4/904: creat d20/d47/f130 x:0 0 0 2024-02-07T12:25:40.328 INFO:tasks.workunit.client.1.smithi138.stdout:4/905: write d20/d47/f93 [629479,6095] 0 2024-02-07T12:25:40.329 INFO:tasks.workunit.client.0.smithi047.stdout:8/119: link d3/d4/lf d3/d16/d2a/l2c 0 2024-02-07T12:25:40.331 INFO:tasks.workunit.client.0.smithi047.stdout:3/62: creat d12/f13 x:0 0 0 2024-02-07T12:25:40.331 INFO:tasks.workunit.client.0.smithi047.stdout:3/63: fsync fc 0 2024-02-07T12:25:40.331 INFO:tasks.workunit.client.1.smithi138.stdout:6/985: dwrite dc/d31/d3f/fed [0,4194304] 0 2024-02-07T12:25:40.331 INFO:tasks.workunit.client.1.smithi138.stdout:2/997: dread d3/dd/d19/f72 [0,4194304] 0 2024-02-07T12:25:40.332 INFO:tasks.workunit.client.1.smithi138.stdout:2/998: write d3/dd/d14/d8f/dbc/dbd/d101/f11e [230726,79808] 0 2024-02-07T12:25:40.340 INFO:tasks.workunit.client.0.smithi047.stdout:1/56: dread d1/f6 [0,4194304] 0 2024-02-07T12:25:40.340 INFO:tasks.workunit.client.0.smithi047.stdout:1/57: fdatasync d1/f6 0 2024-02-07T12:25:40.340 INFO:tasks.workunit.client.0.smithi047.stdout:1/58: write d1/f5 [1423782,130356] 0 2024-02-07T12:25:40.340 INFO:tasks.workunit.client.0.smithi047.stdout:1/59: fdatasync f0 0 2024-02-07T12:25:40.341 INFO:tasks.workunit.client.0.smithi047.stdout:8/120: creat d3/d16/f2d x:0 0 0 2024-02-07T12:25:40.341 INFO:tasks.workunit.client.0.smithi047.stdout:8/121: stat d3/d16/d2a/f2b 0 2024-02-07T12:25:40.342 INFO:tasks.workunit.client.0.smithi047.stdout:6/92: getdents d3 0 2024-02-07T12:25:40.342 INFO:tasks.workunit.client.0.smithi047.stdout:6/93: chown d3/f8 181 1 2024-02-07T12:25:40.342 INFO:tasks.workunit.client.1.smithi138.stdout:1/946: sync 2024-02-07T12:25:40.342 INFO:tasks.workunit.client.1.smithi138.stdout:9/814: sync 2024-02-07T12:25:40.345 INFO:tasks.workunit.client.0.smithi047.stdout:7/144: dwrite d0/df/d29/f22 [0,4194304] 0 2024-02-07T12:25:40.347 INFO:tasks.workunit.client.1.smithi138.stdout:9/815: creat d0/d6/d8/d1d/dd/d41/d5e/de7/ffa x:0 0 0 2024-02-07T12:25:40.347 INFO:tasks.workunit.client.1.smithi138.stdout:5/872: dread da/d6d/fac [0,4194304] 0 2024-02-07T12:25:40.350 INFO:tasks.workunit.client.1.smithi138.stdout:9/816: dread d0/d6/d8/d1d/dd/f9c [0,4194304] 0 2024-02-07T12:25:40.350 INFO:tasks.workunit.client.1.smithi138.stdout:9/817: write d0/d6/d8/d1d/dd/d1f/f1b [4243281,56517] 0 2024-02-07T12:25:40.353 INFO:tasks.workunit.client.1.smithi138.stdout:9/818: unlink d0/d6/d8/d1d/dd/d1f/faa 0 2024-02-07T12:25:40.355 INFO:tasks.workunit.client.0.smithi047.stdout:3/64: truncate f11 1610668 0 2024-02-07T12:25:40.355 INFO:tasks.workunit.client.0.smithi047.stdout:3/65: chown l1 907317 1 2024-02-07T12:25:40.356 INFO:tasks.workunit.client.0.smithi047.stdout:7/145: creat d0/df/d29/f2d x:0 0 0 2024-02-07T12:25:40.356 INFO:tasks.workunit.client.0.smithi047.stdout:7/146: write d0/df/d29/f22 [4291554,56779] 0 2024-02-07T12:25:40.356 INFO:tasks.workunit.client.1.smithi138.stdout:9/819: unlink d0/l99 0 2024-02-07T12:25:40.359 INFO:tasks.workunit.client.1.smithi138.stdout:9/820: creat d0/d6/d8/d1d/dd/d1f/db7/ffb x:0 0 0 2024-02-07T12:25:40.361 INFO:tasks.workunit.client.0.smithi047.stdout:7/147: link d0/df/c1c d0/c2e 0 2024-02-07T12:25:40.361 INFO:tasks.workunit.client.1.smithi138.stdout:9/821: creat d0/d6/d8/d1d/dd/d41/d5e/de7/dd8/ffc x:0 0 0 2024-02-07T12:25:40.362 INFO:tasks.workunit.client.1.smithi138.stdout:9/822: stat d0/d6/d8/f2a 0 2024-02-07T12:25:40.364 INFO:tasks.workunit.client.0.smithi047.stdout:7/148: mkdir d0/d2f 0 2024-02-07T12:25:40.366 INFO:tasks.workunit.client.1.smithi138.stdout:9/823: read d0/d6/d8/d1d/dd/d1f/db7/f90 [138427,28781] 0 2024-02-07T12:25:40.366 INFO:tasks.workunit.client.1.smithi138.stdout:9/824: chown d0/d6/d8/d1d/dd/d1f/db7/ffb 14640268 1 2024-02-07T12:25:40.366 INFO:tasks.workunit.client.1.smithi138.stdout:9/825: creat d0/d6/d8/d95/ffd x:0 0 0 2024-02-07T12:25:40.366 INFO:tasks.workunit.client.1.smithi138.stdout:9/826: fsync d0/d6/d8/d1d/dd/d1f/db7/f90 0 2024-02-07T12:25:40.366 INFO:tasks.workunit.client.1.smithi138.stdout:9/827: write d0/d34/d86/fee [5185169,53845] 0 2024-02-07T12:25:40.366 INFO:tasks.workunit.client.0.smithi047.stdout:7/149: unlink d0/df/f15 0 2024-02-07T12:25:40.367 INFO:tasks.workunit.client.0.smithi047.stdout:7/150: write d0/df/d29/f2d [853465,49930] 0 2024-02-07T12:25:40.367 INFO:tasks.workunit.client.0.smithi047.stdout:6/94: dread d3/d5/f7 [4194304,4194304] 0 2024-02-07T12:25:40.367 INFO:tasks.workunit.client.0.smithi047.stdout:7/151: rmdir d0/d4 39 2024-02-07T12:25:40.367 INFO:tasks.workunit.client.0.smithi047.stdout:7/152: write d0/f2c [1853908,68608] 0 2024-02-07T12:25:40.368 INFO:tasks.workunit.client.0.smithi047.stdout:6/95: creat d3/d1e/f1f x:0 0 0 2024-02-07T12:25:40.368 INFO:tasks.workunit.client.0.smithi047.stdout:6/96: write d3/f8 [1436461,74206] 0 2024-02-07T12:25:40.368 INFO:tasks.workunit.client.0.smithi047.stdout:6/97: chown d3/d1e/f1f 18610912 1 2024-02-07T12:25:40.369 INFO:tasks.workunit.client.1.smithi138.stdout:9/828: symlink d0/d34/lfe 0 2024-02-07T12:25:40.369 INFO:tasks.workunit.client.0.smithi047.stdout:7/153: symlink d0/df/l30 0 2024-02-07T12:25:40.369 INFO:tasks.workunit.client.0.smithi047.stdout:7/154: truncate d0/df/d29/f23 1073851 0 2024-02-07T12:25:40.370 INFO:tasks.workunit.client.0.smithi047.stdout:7/155: fdatasync d0/df/d29/f23 0 2024-02-07T12:25:40.371 INFO:tasks.workunit.client.0.smithi047.stdout:6/98: mknod d3/da/c20 0 2024-02-07T12:25:40.371 INFO:tasks.workunit.client.0.smithi047.stdout:6/99: readlink d3/l11 0 2024-02-07T12:25:40.373 INFO:tasks.workunit.client.1.smithi138.stdout:2/999: dwrite d3/dd/d14/d86/f113 [0,4194304] 0 2024-02-07T12:25:40.373 INFO:tasks.workunit.client.1.smithi138.stdout:4/906: dwrite d20/d53/d71/d98/d117/f6d [0,4194304] 0 2024-02-07T12:25:40.374 INFO:tasks.workunit.client.0.smithi047.stdout:7/156: unlink d0/df/d29/c21 0 2024-02-07T12:25:40.375 INFO:tasks.workunit.client.1.smithi138.stdout:0/988: dwrite d4/d69/fbd [0,4194304] 0 2024-02-07T12:25:40.375 INFO:tasks.workunit.client.1.smithi138.stdout:5/873: dwrite da/d22/d99/dca/d11e/d4f/d2b/d35/fd0 [0,4194304] 0 2024-02-07T12:25:40.377 INFO:tasks.workunit.client.1.smithi138.stdout:1/947: dwrite d5/d8/da/d1f/d5e/db5/d58/f74 [0,4194304] 0 2024-02-07T12:25:40.383 INFO:tasks.workunit.client.1.smithi138.stdout:5/874: write da/f51 [2831769,113282] 0 2024-02-07T12:25:40.384 INFO:tasks.workunit.client.0.smithi047.stdout:3/66: truncate f11 2444607 0 2024-02-07T12:25:40.384 INFO:tasks.workunit.client.0.smithi047.stdout:4/27: getdents d3 0 2024-02-07T12:25:40.384 INFO:tasks.workunit.client.0.smithi047.stdout:3/67: chown l10 5 1 2024-02-07T12:25:40.384 INFO:tasks.workunit.client.0.smithi047.stdout:3/68: creat d12/f14 x:0 0 0 2024-02-07T12:25:40.384 INFO:tasks.workunit.client.0.smithi047.stdout:3/69: chown d12/f14 2572 1 2024-02-07T12:25:40.384 INFO:tasks.workunit.client.0.smithi047.stdout:8/122: rmdir d3/d16 39 2024-02-07T12:25:40.385 INFO:tasks.workunit.client.0.smithi047.stdout:8/123: chown d3/d16/c1b 13 1 2024-02-07T12:25:40.385 INFO:tasks.workunit.client.0.smithi047.stdout:8/124: creat d3/d4/d1f/f2e x:0 0 0 2024-02-07T12:25:40.386 INFO:tasks.workunit.client.0.smithi047.stdout:1/60: dread d1/f5 [0,4194304] 0 2024-02-07T12:25:40.386 INFO:tasks.workunit.client.0.smithi047.stdout:4/28: creat d3/f7 x:0 0 0 2024-02-07T12:25:40.386 INFO:tasks.workunit.client.0.smithi047.stdout:4/29: fsync d3/f6 0 2024-02-07T12:25:40.387 INFO:tasks.workunit.client.1.smithi138.stdout:9/829: dwrite d0/d6/d8/d1d/dd/d41/d5e/da6/fc9 [0,4194304] 0 2024-02-07T12:25:40.390 INFO:tasks.workunit.client.0.smithi047.stdout:6/100: link d3/d5/f15 d3/d1e/f21 0 2024-02-07T12:25:40.391 INFO:tasks.workunit.client.0.smithi047.stdout:6/101: stat d3/lb 0 2024-02-07T12:25:40.391 INFO:tasks.workunit.client.0.smithi047.stdout:6/102: chown d3/d1e/f1f 41586128 1 2024-02-07T12:25:40.394 INFO:tasks.workunit.client.1.smithi138.stdout:1/948: rename d5/d8/da/d1f/d5e/db5/d68/d73/d7b/cc7 to d5/d8/da/d1f/d5e/db5/d58/d76/c131 0 2024-02-07T12:25:40.396 INFO:tasks.workunit.client.0.smithi047.stdout:3/70: rename c5 to d12/c15 0 2024-02-07T12:25:40.397 INFO:tasks.workunit.client.1.smithi138.stdout:5/875: link da/d43/d4a/c107 da/d22/d99/dca/d11e/d4f/da3/c122 0 2024-02-07T12:25:40.398 INFO:tasks.workunit.client.1.smithi138.stdout:9/830: dread d0/d6/d8/d1d/dd/d41/d5e/d74/fa4 [0,4194304] 0 2024-02-07T12:25:40.398 INFO:tasks.workunit.client.1.smithi138.stdout:9/831: creat d0/fff x:0 0 0 2024-02-07T12:25:40.398 INFO:tasks.workunit.client.1.smithi138.stdout:9/832: fdatasync d0/faf 0 2024-02-07T12:25:40.400 INFO:tasks.workunit.client.1.smithi138.stdout:1/949: rmdir d5/d4b/d6b/d6e/d79 39 2024-02-07T12:25:40.400 INFO:tasks.workunit.client.1.smithi138.stdout:1/950: readlink d5/d8/dbc/le6 0 2024-02-07T12:25:40.400 INFO:tasks.workunit.client.1.smithi138.stdout:1/951: write d5/d8/da/d1f/f120 [1027228,36219] 0 2024-02-07T12:25:40.400 INFO:tasks.workunit.client.0.smithi047.stdout:8/125: unlink d3/l6 0 2024-02-07T12:25:40.400 INFO:tasks.workunit.client.0.smithi047.stdout:8/126: write d3/d4/d1f/f23 [187280,110841] 0 2024-02-07T12:25:40.403 INFO:tasks.workunit.client.1.smithi138.stdout:5/876: creat da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/d91/df1/f123 x:0 0 0 2024-02-07T12:25:40.403 INFO:tasks.workunit.client.1.smithi138.stdout:4/907: dwrite f1a [0,4194304] 0 2024-02-07T12:25:40.403 INFO:tasks.workunit.client.1.smithi138.stdout:4/908: creat d20/d47/d69/d7c/db9/f131 x:0 0 0 2024-02-07T12:25:40.406 INFO:tasks.workunit.client.0.smithi047.stdout:1/61: rename d1/c7 to d1/cc 0 2024-02-07T12:25:40.406 INFO:tasks.workunit.client.1.smithi138.stdout:9/833: symlink d0/d6/d8/d1d/dd/d41/d5e/d74/l100 0 2024-02-07T12:25:40.408 INFO:tasks.workunit.client.0.smithi047.stdout:3/71: dread f9 [0,4194304] 0 2024-02-07T12:25:40.415 INFO:tasks.workunit.client.0.smithi047.stdout:8/127: write d3/f9 [6799470,5128] 0 2024-02-07T12:25:40.416 INFO:tasks.workunit.client.0.smithi047.stdout:7/157: dwrite d0/f2 [0,4194304] 0 2024-02-07T12:25:40.417 INFO:tasks.workunit.client.0.smithi047.stdout:1/62: symlink d1/ld 0 2024-02-07T12:25:40.417 INFO:tasks.workunit.client.0.smithi047.stdout:1/63: chown d1/cc 21243904 1 2024-02-07T12:25:40.418 INFO:tasks.workunit.client.0.smithi047.stdout:6/103: dread d3/d5/f13 [0,4194304] 0 2024-02-07T12:25:40.418 INFO:tasks.workunit.client.1.smithi138.stdout:4/909: creat d20/d34/d59/d88/d8e/f132 x:0 0 0 2024-02-07T12:25:40.420 INFO:tasks.workunit.client.0.smithi047.stdout:4/30: dwrite d3/f5 [0,4194304] 0 2024-02-07T12:25:40.420 INFO:tasks.workunit.client.0.smithi047.stdout:4/31: chown d3/f5 6 1 2024-02-07T12:25:40.421 INFO:tasks.workunit.client.1.smithi138.stdout:9/834: creat d0/d6/f101 x:0 0 0 2024-02-07T12:25:40.423 INFO:tasks.workunit.client.0.smithi047.stdout:8/128: stat d3/d4/l24 0 2024-02-07T12:25:40.423 INFO:tasks.workunit.client.0.smithi047.stdout:8/129: fsync d3/d4/fa 0 2024-02-07T12:25:40.423 INFO:tasks.workunit.client.0.smithi047.stdout:8/130: chown d3/d16/c29 12 1 2024-02-07T12:25:40.424 INFO:tasks.workunit.client.0.smithi047.stdout:7/158: mkdir d0/df/d29/d31 0 2024-02-07T12:25:40.432 INFO:tasks.workunit.client.0.smithi047.stdout:4/32: symlink d3/l8 0 2024-02-07T12:25:40.432 INFO:tasks.workunit.client.0.smithi047.stdout:4/33: creat d3/f9 x:0 0 0 2024-02-07T12:25:40.432 INFO:tasks.workunit.client.0.smithi047.stdout:4/34: stat d3/f6 0 2024-02-07T12:25:40.432 INFO:tasks.workunit.client.0.smithi047.stdout:4/35: truncate d3/f9 749008 0 2024-02-07T12:25:40.432 INFO:tasks.workunit.client.0.smithi047.stdout:8/131: truncate d3/d4/f7 2187775 0 2024-02-07T12:25:40.432 INFO:tasks.workunit.client.0.smithi047.stdout:8/132: chown d3/d4/f25 22254 1 2024-02-07T12:25:40.433 INFO:tasks.workunit.client.1.smithi138.stdout:4/910: link d20/d53/f105 d20/d47/d69/d7c/dfe/d114/f133 0 2024-02-07T12:25:40.435 INFO:tasks.workunit.client.0.smithi047.stdout:4/36: mknod d3/ca 0 2024-02-07T12:25:40.435 INFO:tasks.workunit.client.0.smithi047.stdout:4/37: creat d3/fb x:0 0 0 2024-02-07T12:25:40.436 INFO:tasks.workunit.client.0.smithi047.stdout:4/38: fdatasync d3/fb 0 2024-02-07T12:25:40.436 INFO:tasks.workunit.client.0.smithi047.stdout:4/39: truncate d3/f6 457053 0 2024-02-07T12:25:40.436 INFO:tasks.workunit.client.1.smithi138.stdout:4/911: mknod d20/d47/d69/d7c/dfe/d114/df5/c134 0 2024-02-07T12:25:40.436 INFO:tasks.workunit.client.1.smithi138.stdout:4/912: dread - d20/d4d/fe6 zero size 2024-02-07T12:25:40.437 INFO:tasks.workunit.client.1.smithi138.stdout:4/913: fsync f14 0 2024-02-07T12:25:40.437 INFO:tasks.workunit.client.1.smithi138.stdout:4/914: write d20/d47/d69/d7c/dfe/d114/f133 [582201,42994] 0 2024-02-07T12:25:40.437 INFO:tasks.workunit.client.1.smithi138.stdout:9/835: write d0/d6/d8/d1d/dd/d25/f5b [2553718,103850] 0 2024-02-07T12:25:40.438 INFO:tasks.workunit.client.0.smithi047.stdout:4/40: dread d3/f9 [0,4194304] 0 2024-02-07T12:25:40.438 INFO:tasks.workunit.client.0.smithi047.stdout:4/41: creat d3/fc x:0 0 0 2024-02-07T12:25:40.438 INFO:tasks.workunit.client.0.smithi047.stdout:4/42: dread d3/f6 [0,4194304] 0 2024-02-07T12:25:40.441 INFO:tasks.workunit.client.0.smithi047.stdout:4/43: rename d3/f7 to d3/fd 0 2024-02-07T12:25:40.441 INFO:tasks.workunit.client.0.smithi047.stdout:4/44: fdatasync d3/f9 0 2024-02-07T12:25:40.441 INFO:tasks.workunit.client.0.smithi047.stdout:4/45: chown d3 934700514 1 2024-02-07T12:25:40.441 INFO:tasks.workunit.client.1.smithi138.stdout:9/836: dread d0/f33 [0,4194304] 0 2024-02-07T12:25:40.442 INFO:tasks.workunit.client.0.smithi047.stdout:8/133: dread d3/f14 [0,4194304] 0 2024-02-07T12:25:40.442 INFO:tasks.workunit.client.0.smithi047.stdout:8/134: write d3/f27 [5071917,122569] 0 2024-02-07T12:25:40.443 INFO:tasks.workunit.client.0.smithi047.stdout:8/135: mknod d3/d16/c2f 0 2024-02-07T12:25:40.443 INFO:tasks.workunit.client.1.smithi138.stdout:9/837: unlink d0/d6/d8/d1d/dd/d25/ff4 0 2024-02-07T12:25:40.443 INFO:tasks.workunit.client.1.smithi138.stdout:9/838: stat d0/d6/d8/d1d/dd/d1f/db7/db9 0 2024-02-07T12:25:40.446 INFO:tasks.workunit.client.1.smithi138.stdout:9/839: creat d0/d6/d8/d1d/dd/d1f/db7/db9/dc3/df3/f102 x:0 0 0 2024-02-07T12:25:40.451 INFO:tasks.workunit.client.1.smithi138.stdout:4/915: dread d20/f32 [0,4194304] 0 2024-02-07T12:25:40.463 INFO:tasks.workunit.client.0.smithi047.stdout:8/136: dread d3/f17 [0,4194304] 0 2024-02-07T12:25:40.474 INFO:tasks.workunit.client.0.smithi047.stdout:7/159: dwrite d0/f1a [0,4194304] 0 2024-02-07T12:25:40.475 INFO:tasks.workunit.client.0.smithi047.stdout:1/64: dwrite f0 [0,4194304] 0 2024-02-07T12:25:40.475 INFO:tasks.workunit.client.0.smithi047.stdout:3/72: dwrite d12/f13 [0,4194304] 0 2024-02-07T12:25:40.475 INFO:tasks.workunit.client.0.smithi047.stdout:3/73: fdatasync fc 0 2024-02-07T12:25:40.475 INFO:tasks.workunit.client.0.smithi047.stdout:3/74: creat d12/f16 x:0 0 0 2024-02-07T12:25:40.475 INFO:tasks.workunit.client.0.smithi047.stdout:3/75: truncate f11 2719112 0 2024-02-07T12:25:40.475 INFO:tasks.workunit.client.0.smithi047.stdout:3/76: truncate fc 369025 0 2024-02-07T12:25:40.475 INFO:tasks.workunit.client.1.smithi138.stdout:1/952: dwrite d5/d8/dbc/fea [0,4194304] 0 2024-02-07T12:25:40.478 INFO:tasks.workunit.client.1.smithi138.stdout:1/953: creat d5/d8/da/d1f/d5e/db5/f132 x:0 0 0 2024-02-07T12:25:40.478 INFO:tasks.workunit.client.1.smithi138.stdout:1/954: dread - d5/d8/da/d1f/d60/df4/f126 zero size 2024-02-07T12:25:40.480 INFO:tasks.workunit.client.1.smithi138.stdout:1/955: rename d5/d4b/d65/ff9 to d5/d4b/d65/f133 0 2024-02-07T12:25:40.482 INFO:tasks.workunit.client.0.smithi047.stdout:3/77: mknod d12/c17 0 2024-02-07T12:25:40.482 INFO:tasks.workunit.client.0.smithi047.stdout:3/78: stat d12/f16 0 2024-02-07T12:25:40.482 INFO:tasks.workunit.client.0.smithi047.stdout:3/79: truncate d12/f14 434335 0 2024-02-07T12:25:40.482 INFO:tasks.workunit.client.0.smithi047.stdout:3/80: creat d12/f18 x:0 0 0 2024-02-07T12:25:40.483 INFO:tasks.workunit.client.0.smithi047.stdout:4/46: dwrite d3/f4 [0,4194304] 0 2024-02-07T12:25:40.483 INFO:tasks.workunit.client.0.smithi047.stdout:4/47: creat d3/fe x:0 0 0 2024-02-07T12:25:40.484 INFO:tasks.workunit.client.0.smithi047.stdout:6/104: dwrite d3/da/d14/f1b [0,4194304] 0 2024-02-07T12:25:40.484 INFO:tasks.workunit.client.1.smithi138.stdout:1/956: link d5/d8/da/d1f/d60/df4/fa1 d5/d8/da/d1f/d5e/db5/d58/d76/f134 0 2024-02-07T12:25:40.485 INFO:tasks.workunit.client.1.smithi138.stdout:1/957: write d5/d8/da/d1f/d5e/db8/f103 [561343,7155] 0 2024-02-07T12:25:40.485 INFO:tasks.workunit.client.1.smithi138.stdout:9/840: dwrite d0/d6/d8/d1d/dd/d25/ff7 [0,4194304] 0 2024-02-07T12:25:40.485 INFO:tasks.workunit.client.1.smithi138.stdout:9/841: write d0/d6/d8/d1d/dd/d41/d5e/f8d [4404903,126015] 0 2024-02-07T12:25:40.485 INFO:tasks.workunit.client.1.smithi138.stdout:1/958: creat d5/d8/da/d20/f135 x:0 0 0 2024-02-07T12:25:40.493 INFO:tasks.workunit.client.0.smithi047.stdout:1/65: dread f0 [0,4194304] 0 2024-02-07T12:25:40.493 INFO:tasks.workunit.client.0.smithi047.stdout:1/66: chown d1/cc 15 1 2024-02-07T12:25:40.493 INFO:tasks.workunit.client.0.smithi047.stdout:4/48: rename d3/fd to d3/ff 0 2024-02-07T12:25:40.493 INFO:tasks.workunit.client.0.smithi047.stdout:7/160: write d0/df/f11 [6230714,28393] 0 2024-02-07T12:25:40.498 INFO:tasks.workunit.client.0.smithi047.stdout:3/81: dread d12/f13 [0,4194304] 0 2024-02-07T12:25:40.498 INFO:tasks.workunit.client.1.smithi138.stdout:9/842: rmdir d0/d34/d86/ddd 39 2024-02-07T12:25:40.499 INFO:tasks.workunit.client.0.smithi047.stdout:8/137: dwrite d3/f27 [0,4194304] 0 2024-02-07T12:25:40.501 INFO:tasks.workunit.client.1.smithi138.stdout:1/959: unlink d5/d8/da/df8/ffe 0 2024-02-07T12:25:40.504 INFO:tasks.workunit.client.1.smithi138.stdout:9/843: rmdir d0/d6/d8/d1d/dd/d41/d5e/d74 39 2024-02-07T12:25:40.504 INFO:tasks.workunit.client.1.smithi138.stdout:9/844: creat d0/f103 x:0 0 0 2024-02-07T12:25:40.505 INFO:tasks.workunit.client.1.smithi138.stdout:1/960: write d5/d8/da/f10f [529206,91332] 0 2024-02-07T12:25:40.508 INFO:tasks.workunit.client.0.smithi047.stdout:6/105: rename d3/d1e/f1f to d3/da/f22 0 2024-02-07T12:25:40.508 INFO:tasks.workunit.client.0.smithi047.stdout:6/106: stat d3/da/d14/f1c 0 2024-02-07T12:25:40.508 INFO:tasks.workunit.client.0.smithi047.stdout:4/49: mknod d3/c10 0 2024-02-07T12:25:40.509 INFO:tasks.workunit.client.1.smithi138.stdout:9/845: truncate d0/d6/d8/d1d/dd/f31 3134680 0 2024-02-07T12:25:40.509 INFO:tasks.workunit.client.1.smithi138.stdout:9/846: chown d0/d6/f27 2787603 1 2024-02-07T12:25:40.509 INFO:tasks.workunit.client.1.smithi138.stdout:9/847: chown d0/d6/da3/dcc/cec 61354753 1 2024-02-07T12:25:40.509 INFO:tasks.workunit.client.0.smithi047.stdout:7/161: mknod d0/d2f/c32 0 2024-02-07T12:25:40.510 INFO:tasks.workunit.client.1.smithi138.stdout:1/961: unlink d5/d8/dbc/fea 0 2024-02-07T12:25:40.512 INFO:tasks.workunit.client.0.smithi047.stdout:8/138: mkdir d3/d16/d30 0 2024-02-07T12:25:40.512 INFO:tasks.workunit.client.0.smithi047.stdout:8/139: creat d3/d4/f31 x:0 0 0 2024-02-07T12:25:40.514 INFO:tasks.workunit.client.0.smithi047.stdout:6/107: rmdir d3/da/d14 39 2024-02-07T12:25:40.517 INFO:tasks.workunit.client.0.smithi047.stdout:7/162: creat d0/d4/f33 x:0 0 0 2024-02-07T12:25:40.517 INFO:tasks.workunit.client.0.smithi047.stdout:2/106: sync 2024-02-07T12:25:40.517 INFO:tasks.workunit.client.0.smithi047.stdout:0/44: sync 2024-02-07T12:25:40.517 INFO:tasks.workunit.client.0.smithi047.stdout:5/74: sync 2024-02-07T12:25:40.517 INFO:tasks.workunit.client.0.smithi047.stdout:0/45: truncate fa 678285 0 2024-02-07T12:25:40.517 INFO:tasks.workunit.client.0.smithi047.stdout:0/46: rmdir - no directory 2024-02-07T12:25:40.519 INFO:tasks.workunit.client.0.smithi047.stdout:2/107: read d7/f12 [237847,127051] 0 2024-02-07T12:25:40.521 INFO:tasks.workunit.client.0.smithi047.stdout:7/163: creat d0/df/d29/d31/f34 x:0 0 0 2024-02-07T12:25:40.521 INFO:tasks.workunit.client.0.smithi047.stdout:7/164: write d0/df/f11 [5544701,9775] 0 2024-02-07T12:25:40.521 INFO:tasks.workunit.client.0.smithi047.stdout:9/28: sync 2024-02-07T12:25:40.522 INFO:tasks.workunit.client.0.smithi047.stdout:1/67: dwrite f0 [0,4194304] 0 2024-02-07T12:25:40.522 INFO:tasks.workunit.client.0.smithi047.stdout:5/75: mkdir da/df/d16 0 2024-02-07T12:25:40.525 INFO:tasks.workunit.client.0.smithi047.stdout:0/47: creat fc x:0 0 0 2024-02-07T12:25:40.525 INFO:tasks.workunit.client.0.smithi047.stdout:0/48: readlink l8 0 2024-02-07T12:25:40.525 INFO:tasks.workunit.client.1.smithi138.stdout:9/848: dwrite d0/d6/d8/d1d/dd/d41/d5e/d74/fcd [0,4194304] 0 2024-02-07T12:25:40.526 INFO:tasks.workunit.client.0.smithi047.stdout:2/108: mkdir d7/dc/d25 0 2024-02-07T12:25:40.530 INFO:tasks.workunit.client.1.smithi138.stdout:1/962: dread d5/d8/da/f29 [0,4194304] 0 2024-02-07T12:25:40.531 INFO:tasks.workunit.client.1.smithi138.stdout:1/963: chown d5/d8/da/d1f/d5e/db5/d68/d73/lc1 1364496623 1 2024-02-07T12:25:40.531 INFO:tasks.workunit.client.0.smithi047.stdout:7/165: rename d0/c28 to d0/df/c35 0 2024-02-07T12:25:40.532 INFO:tasks.workunit.client.0.smithi047.stdout:7/166: stat d0/d4/f16 0 2024-02-07T12:25:40.532 INFO:tasks.workunit.client.0.smithi047.stdout:7/167: fsync d0/d4/f1e 0 2024-02-07T12:25:40.534 INFO:tasks.workunit.client.0.smithi047.stdout:9/29: link d3/l5 d3/l6 0 2024-02-07T12:25:40.535 INFO:tasks.workunit.client.1.smithi138.stdout:9/849: mknod d0/d6/d8/d1d/dd/d25/c104 0 2024-02-07T12:25:40.535 INFO:tasks.workunit.client.0.smithi047.stdout:5/76: link da/l14 da/df/d16/l17 0 2024-02-07T12:25:40.536 INFO:tasks.workunit.client.0.smithi047.stdout:2/109: dread d7/f20 [0,4194304] 0 2024-02-07T12:25:40.536 INFO:tasks.workunit.client.0.smithi047.stdout:2/110: stat d7/l21 0 2024-02-07T12:25:40.537 INFO:tasks.workunit.client.1.smithi138.stdout:1/964: rename d5/d8/da/d1f/c4d to d5/d4b/d72/c136 0 2024-02-07T12:25:40.537 INFO:tasks.workunit.client.0.smithi047.stdout:8/140: dwrite d3/d4/f12 [4194304,4194304] 0 2024-02-07T12:25:40.537 INFO:tasks.workunit.client.0.smithi047.stdout:1/68: dread d1/f5 [0,4194304] 0 2024-02-07T12:25:40.537 INFO:tasks.workunit.client.0.smithi047.stdout:7/168: link d0/df/d29/f2d d0/f36 0 2024-02-07T12:25:40.538 INFO:tasks.workunit.client.1.smithi138.stdout:9/850: link d0/d6/d8/d1d/dd/f31 d0/d6/d8/dbc/f105 0 2024-02-07T12:25:40.539 INFO:tasks.workunit.client.0.smithi047.stdout:2/111: rename c3 to d7/dc/c26 0 2024-02-07T12:25:40.540 INFO:tasks.workunit.client.0.smithi047.stdout:8/141: creat d3/d16/d2a/f32 x:0 0 0 2024-02-07T12:25:40.541 INFO:tasks.workunit.client.1.smithi138.stdout:1/965: creat d5/d4b/d6b/d116/f137 x:0 0 0 2024-02-07T12:25:40.541 INFO:tasks.workunit.client.0.smithi047.stdout:7/169: symlink d0/df/d29/l37 0 2024-02-07T12:25:40.542 INFO:tasks.workunit.client.1.smithi138.stdout:9/851: fsync d0/d6/d8/d1d/dd/d41/d5e/f8d 0 2024-02-07T12:25:40.543 INFO:tasks.workunit.client.1.smithi138.stdout:5/877: sync 2024-02-07T12:25:40.543 INFO:tasks.workunit.client.1.smithi138.stdout:4/916: sync 2024-02-07T12:25:40.543 INFO:tasks.workunit.client.1.smithi138.stdout:6/986: sync 2024-02-07T12:25:40.543 INFO:tasks.workunit.client.1.smithi138.stdout:0/989: sync 2024-02-07T12:25:40.543 INFO:tasks.workunit.client.0.smithi047.stdout:1/69: rename f0 to d1/fe 0 2024-02-07T12:25:40.544 INFO:tasks.workunit.client.0.smithi047.stdout:1/70: fsync d1/f5 0 2024-02-07T12:25:40.544 INFO:tasks.workunit.client.0.smithi047.stdout:2/112: link d7/c19 d7/dc/c27 0 2024-02-07T12:25:40.544 INFO:tasks.workunit.client.0.smithi047.stdout:2/113: read f2 [1382930,81989] 0 2024-02-07T12:25:40.545 INFO:tasks.workunit.client.1.smithi138.stdout:1/966: dread d5/d8/da/d1f/d5e/d63/f57 [0,4194304] 0 2024-02-07T12:25:40.545 INFO:tasks.workunit.client.1.smithi138.stdout:5/878: creat da/d22/d99/dca/d11e/d4f/d2b/d35/d40/f124 x:0 0 0 2024-02-07T12:25:40.546 INFO:tasks.workunit.client.1.smithi138.stdout:4/917: symlink d20/d53/d71/d98/l135 0 2024-02-07T12:25:40.546 INFO:tasks.workunit.client.1.smithi138.stdout:4/918: truncate d20/d53/d71/d98/d117/d74/fb0 5367034 0 2024-02-07T12:25:40.548 INFO:tasks.workunit.client.1.smithi138.stdout:0/990: symlink d4/d52/d3f/l138 0 2024-02-07T12:25:40.548 INFO:tasks.workunit.client.1.smithi138.stdout:0/991: chown d4/d9/db/d39/d4b/d6c/faf 1 1 2024-02-07T12:25:40.548 INFO:tasks.workunit.client.1.smithi138.stdout:0/992: dread - d4/d9/db/d39/d4b/f124 zero size 2024-02-07T12:25:40.551 INFO:tasks.workunit.client.1.smithi138.stdout:9/852: unlink d0/d6/d8/fa1 0 2024-02-07T12:25:40.551 INFO:tasks.workunit.client.1.smithi138.stdout:9/853: truncate d0/d6/da3/dcc/dd1/fd3 559979 0 2024-02-07T12:25:40.551 INFO:tasks.workunit.client.1.smithi138.stdout:4/919: truncate f1d 2587065 0 2024-02-07T12:25:40.554 INFO:tasks.workunit.client.1.smithi138.stdout:0/993: rename d4/d9/de/d1d/d21/fb4 to d4/d9/db/f139 0 2024-02-07T12:25:40.554 INFO:tasks.workunit.client.0.smithi047.stdout:9/30: write f1 [1633852,63639] 0 2024-02-07T12:25:40.555 INFO:tasks.workunit.client.1.smithi138.stdout:4/920: mknod d20/d4d/c136 0 2024-02-07T12:25:40.555 INFO:tasks.workunit.client.0.smithi047.stdout:9/31: dread f2 [0,4194304] 0 2024-02-07T12:25:40.556 INFO:tasks.workunit.client.0.smithi047.stdout:9/32: write f2 [249321,78170] 0 2024-02-07T12:25:40.558 INFO:tasks.workunit.client.0.smithi047.stdout:9/33: mknod d3/c7 0 2024-02-07T12:25:40.558 INFO:tasks.workunit.client.0.smithi047.stdout:9/34: readlink d3/l6 0 2024-02-07T12:25:40.560 INFO:tasks.workunit.client.1.smithi138.stdout:9/854: rename d0/d34/d86/f89 to d0/d6/d8/dc5/f106 0 2024-02-07T12:25:40.560 INFO:tasks.workunit.client.1.smithi138.stdout:9/855: stat d0/d6/da3/dcc/dd1/fd5 0 2024-02-07T12:25:40.560 INFO:tasks.workunit.client.1.smithi138.stdout:4/921: mknod d20/d4d/d87/c137 0 2024-02-07T12:25:40.560 INFO:tasks.workunit.client.1.smithi138.stdout:6/987: write fb [226341,98392] 0 2024-02-07T12:25:40.561 INFO:tasks.workunit.client.1.smithi138.stdout:6/988: symlink dc/d13/d1e/d35/d6d/l13d 0 2024-02-07T12:25:40.562 INFO:tasks.workunit.client.1.smithi138.stdout:6/989: write dc/d73/d9b/f110 [403896,9439] 0 2024-02-07T12:25:40.562 INFO:tasks.workunit.client.1.smithi138.stdout:4/922: dread d20/d53/d71/d98/d117/d74/fb0 [4194304,4194304] 0 2024-02-07T12:25:40.563 INFO:tasks.workunit.client.0.smithi047.stdout:8/142: write d3/d4/fc [7437098,49347] 0 2024-02-07T12:25:40.563 INFO:tasks.workunit.client.0.smithi047.stdout:8/143: dread - d3/d4/d1f/f2e zero size 2024-02-07T12:25:40.566 INFO:tasks.workunit.client.1.smithi138.stdout:4/923: unlink d20/d53/d71/d98/la0 0 2024-02-07T12:25:40.567 INFO:tasks.workunit.client.1.smithi138.stdout:4/924: creat d20/d47/d69/d7c/dfe/f138 x:0 0 0 2024-02-07T12:25:40.567 INFO:tasks.workunit.client.1.smithi138.stdout:4/925: read d20/d53/d71/d98/d117/d74/d9a/dc0/fce [85170,93879] 0 2024-02-07T12:25:40.567 INFO:tasks.workunit.client.0.smithi047.stdout:7/170: dread d0/df/f11 [4194304,4194304] 0 2024-02-07T12:25:40.568 INFO:tasks.workunit.client.1.smithi138.stdout:4/926: truncate d20/d34/d59/d88/f91 2888481 0 2024-02-07T12:25:40.568 INFO:tasks.workunit.client.0.smithi047.stdout:7/171: symlink d0/df/d29/d31/l38 0 2024-02-07T12:25:40.573 INFO:tasks.workunit.client.1.smithi138.stdout:9/856: dread d0/d6/d8/d1d/dd/d41/fe5 [0,4194304] 0 2024-02-07T12:25:40.574 INFO:tasks.workunit.client.1.smithi138.stdout:9/857: creat d0/d6/d8/d1d/dd/d25/d9b/f107 x:0 0 0 2024-02-07T12:25:40.574 INFO:tasks.workunit.client.1.smithi138.stdout:9/858: chown d0/d6/d8/d1d/dd/d41/f5c 875773 1 2024-02-07T12:25:40.576 INFO:tasks.workunit.client.1.smithi138.stdout:9/859: symlink d0/d6/d8/d1d/dd/l108 0 2024-02-07T12:25:40.579 INFO:tasks.workunit.client.1.smithi138.stdout:9/860: rmdir d0/d6/d8/d1d/dd/d1f/db7 39 2024-02-07T12:25:40.581 INFO:tasks.workunit.client.1.smithi138.stdout:5/879: dwrite da/d22/d99/dca/d11e/d4f/d2b/f87 [0,4194304] 0 2024-02-07T12:25:40.582 INFO:tasks.workunit.client.0.smithi047.stdout:6/108: dwrite d3/da/d14/f1c [0,4194304] 0 2024-02-07T12:25:40.582 INFO:tasks.workunit.client.0.smithi047.stdout:6/109: readlink d3/l11 0 2024-02-07T12:25:40.582 INFO:tasks.workunit.client.0.smithi047.stdout:5/77: dwrite da/f15 [0,4194304] 0 2024-02-07T12:25:40.583 INFO:tasks.workunit.client.0.smithi047.stdout:2/114: dwrite d7/f8 [0,4194304] 0 2024-02-07T12:25:40.583 INFO:tasks.workunit.client.0.smithi047.stdout:2/115: creat d7/f28 x:0 0 0 2024-02-07T12:25:40.583 INFO:tasks.workunit.client.0.smithi047.stdout:2/116: truncate d7/dc/f1a 550350 0 2024-02-07T12:25:40.583 INFO:tasks.workunit.client.0.smithi047.stdout:0/49: dwrite fc [0,4194304] 0 2024-02-07T12:25:40.588 INFO:tasks.workunit.client.1.smithi138.stdout:5/880: mkdir da/d22/d99/dca/d11e/d4f/d2b/d35/d110/d11f/d125 0 2024-02-07T12:25:40.589 INFO:tasks.workunit.client.0.smithi047.stdout:8/144: dread d3/d4/f1e [0,4194304] 0 2024-02-07T12:25:40.589 INFO:tasks.workunit.client.0.smithi047.stdout:8/145: creat d3/d16/d2a/f33 x:0 0 0 2024-02-07T12:25:40.589 INFO:tasks.workunit.client.0.smithi047.stdout:5/78: creat da/df/f18 x:0 0 0 2024-02-07T12:25:40.593 INFO:tasks.workunit.client.1.smithi138.stdout:9/861: rename d0/d6/d8/d1d/dd/dc4 to d0/d6/d8/d1d/d109 0 2024-02-07T12:25:40.593 INFO:tasks.workunit.client.1.smithi138.stdout:9/862: chown d0/d6/da3/dcc/dd1/lea 7804 1 2024-02-07T12:25:40.594 INFO:tasks.workunit.client.0.smithi047.stdout:9/35: dread f1 [0,4194304] 0 2024-02-07T12:25:40.594 INFO:tasks.workunit.client.0.smithi047.stdout:9/36: write f1 [4427101,29809] 0 2024-02-07T12:25:40.596 INFO:tasks.workunit.client.1.smithi138.stdout:5/881: mknod da/d22/d99/dca/d11e/d4f/c126 0 2024-02-07T12:25:40.596 INFO:tasks.workunit.client.1.smithi138.stdout:5/882: chown da/d22/d99/dca/d11e/fd2 282484 1 2024-02-07T12:25:40.596 INFO:tasks.workunit.client.1.smithi138.stdout:5/883: write da/f29 [2092342,96236] 0 2024-02-07T12:25:40.597 INFO:tasks.workunit.client.0.smithi047.stdout:2/117: link d7/fb d7/dc/f29 0 2024-02-07T12:25:40.597 INFO:tasks.workunit.client.0.smithi047.stdout:2/118: read - d7/f23 zero size 2024-02-07T12:25:40.597 INFO:tasks.workunit.client.0.smithi047.stdout:0/50: write fc [30527,48680] 0 2024-02-07T12:25:40.597 INFO:tasks.workunit.client.0.smithi047.stdout:0/51: chown fc 0 1 2024-02-07T12:25:40.598 INFO:tasks.workunit.client.0.smithi047.stdout:6/110: dread d3/d5/f13 [0,4194304] 0 2024-02-07T12:25:40.599 INFO:tasks.workunit.client.1.smithi138.stdout:9/863: mknod d0/d6/d8/d1d/dd/d41/d5e/da6/c10a 0 2024-02-07T12:25:40.599 INFO:tasks.workunit.client.1.smithi138.stdout:9/864: dread - d0/d6/d8/d1d/dd/d25/d9b/f107 zero size 2024-02-07T12:25:40.599 INFO:tasks.workunit.client.1.smithi138.stdout:9/865: chown d0 5 1 2024-02-07T12:25:40.600 INFO:tasks.workunit.client.0.smithi047.stdout:7/172: dwrite d0/d4/f5 [4194304,4194304] 0 2024-02-07T12:25:40.600 INFO:tasks.workunit.client.1.smithi138.stdout:4/927: dwrite d20/d53/d71/d75/fbe [0,4194304] 0 2024-02-07T12:25:40.603 INFO:tasks.workunit.client.0.smithi047.stdout:5/79: dread da/f11 [0,4194304] 0 2024-02-07T12:25:40.604 INFO:tasks.workunit.client.1.smithi138.stdout:5/884: mkdir da/d22/d99/dca/d11e/d4f/d2b/d35/d5d/d73/d127 0 2024-02-07T12:25:40.604 INFO:tasks.workunit.client.0.smithi047.stdout:8/146: mkdir d3/d16/d30/d34 0 2024-02-07T12:25:40.605 INFO:tasks.workunit.client.0.smithi047.stdout:8/147: read - d3/d4/f18 zero size 2024-02-07T12:25:40.607 INFO:tasks.workunit.client.0.smithi047.stdout:9/37: mknod d3/c8 0 2024-02-07T12:25:40.608 INFO:tasks.workunit.client.1.smithi138.stdout:4/928: unlink f3 0 2024-02-07T12:25:40.610 INFO:tasks.workunit.client.0.smithi047.stdout:2/119: rmdir d7/dc 39 2024-02-07T12:25:40.611 INFO:tasks.workunit.client.0.smithi047.stdout:6/111: rename d3/c17 to d3/c23 0 2024-02-07T12:25:40.611 INFO:tasks.workunit.client.0.smithi047.stdout:6/112: write d3/da/f22 [489405,58540] 0 2024-02-07T12:25:40.611 INFO:tasks.workunit.client.0.smithi047.stdout:6/113: fdatasync d3/d1e/f21 0 2024-02-07T12:25:40.615 INFO:tasks.workunit.client.0.smithi047.stdout:7/173: dread d0/d4/f5 [4194304,4194304] 0 2024-02-07T12:25:40.616 INFO:tasks.workunit.client.0.smithi047.stdout:1/71: rmdir d1 39 2024-02-07T12:25:40.616 INFO:tasks.workunit.client.0.smithi047.stdout:1/72: fdatasync d1/f6 0 2024-02-07T12:25:40.620 INFO:tasks.workunit.client.1.smithi138.stdout:9/866: dwrite d0/d6/d8/d1d/dd/d41/f5c [0,4194304] 0 2024-02-07T12:25:40.621 INFO:tasks.workunit.client.1.smithi138.stdout:4/929: rmdir d20/d34/d73/dd0 39 2024-02-07T12:25:40.622 INFO:tasks.workunit.client.0.smithi047.stdout:8/148: creat d3/d16/d30/d34/f35 x:0 0 0 2024-02-07T12:25:40.624 INFO:tasks.workunit.client.0.smithi047.stdout:9/38: rmdir d3 39 2024-02-07T12:25:40.626 INFO:tasks.workunit.client.1.smithi138.stdout:9/867: fdatasync d0/d6/d8/f6d 0 2024-02-07T12:25:40.626 INFO:tasks.workunit.client.1.smithi138.stdout:9/868: stat d0/d6/d8/d1d/dd/d41/d5e/de7/ffa 0 2024-02-07T12:25:40.626 INFO:tasks.workunit.client.1.smithi138.stdout:9/869: creat d0/d6/f10b x:0 0 0 2024-02-07T12:25:40.627 INFO:tasks.workunit.client.0.smithi047.stdout:6/114: rename d3/da/d14/f1b to d3/da/f24 0 2024-02-07T12:25:40.627 INFO:tasks.workunit.client.0.smithi047.stdout:6/115: fsync d3/d1e/f21 0 2024-02-07T12:25:40.627 INFO:tasks.workunit.client.0.smithi047.stdout:6/116: readlink d3/l11 0 2024-02-07T12:25:40.628 INFO:tasks.workunit.client.0.smithi047.stdout:2/120: dwrite d7/fb [0,4194304] 0 2024-02-07T12:25:40.628 INFO:tasks.workunit.client.1.smithi138.stdout:4/930: symlink d20/d34/d73/l139 0 2024-02-07T12:25:40.628 INFO:tasks.workunit.client.1.smithi138.stdout:4/931: write d20/d34/d59/d72/d77/fb5 [1035967,31198] 0 2024-02-07T12:25:40.629 INFO:tasks.workunit.client.0.smithi047.stdout:5/80: truncate da/f15 2988075 0 2024-02-07T12:25:40.629 INFO:tasks.workunit.client.0.smithi047.stdout:5/81: chown da/df/d16/l17 60827 1 2024-02-07T12:25:40.630 INFO:tasks.workunit.client.1.smithi138.stdout:9/870: dread d0/f38 [0,4194304] 0 2024-02-07T12:25:40.632 INFO:tasks.workunit.client.0.smithi047.stdout:1/73: symlink d1/lf 0 2024-02-07T12:25:40.633 INFO:tasks.workunit.client.0.smithi047.stdout:7/174: dwrite d0/f1a [0,4194304] 0 2024-02-07T12:25:40.634 INFO:tasks.workunit.client.0.smithi047.stdout:8/149: unlink d3/f14 0 2024-02-07T12:25:40.634 INFO:tasks.workunit.client.0.smithi047.stdout:8/150: chown d3/d4/cb 580 1 2024-02-07T12:25:40.636 INFO:tasks.workunit.client.1.smithi138.stdout:9/871: rename d0/d34/d45/l68 to d0/d6/d8/dc5/l10c 0 2024-02-07T12:25:40.636 INFO:tasks.workunit.client.1.smithi138.stdout:9/872: fsync d0/d6/d8/d1d/dd/f20 0 2024-02-07T12:25:40.637 INFO:tasks.workunit.client.0.smithi047.stdout:6/117: mkdir d3/d1e/d25 0 2024-02-07T12:25:40.637 INFO:tasks.workunit.client.0.smithi047.stdout:7/175: dread d0/df/f1d [0,4194304] 0 2024-02-07T12:25:40.640 INFO:tasks.workunit.client.0.smithi047.stdout:7/176: mknod d0/df/c39 0 2024-02-07T12:25:40.640 INFO:tasks.workunit.client.0.smithi047.stdout:7/177: write d0/df/d29/d31/f34 [85628,7744] 0 2024-02-07T12:25:40.642 INFO:tasks.workunit.client.0.smithi047.stdout:8/151: rmdir d3/d16/d2a 39 2024-02-07T12:25:40.642 INFO:tasks.workunit.client.0.smithi047.stdout:8/152: truncate d3/d16/d2a/f33 986886 0 2024-02-07T12:25:40.647 INFO:tasks.workunit.client.0.smithi047.stdout:6/118: link d3/d1e/f21 d3/d5/f26 0 2024-02-07T12:25:40.649 INFO:tasks.workunit.client.0.smithi047.stdout:8/153: mkdir d3/d36 0 2024-02-07T12:25:40.649 INFO:tasks.workunit.client.0.smithi047.stdout:9/39: dwrite d3/f4 [4194304,4194304] 0 2024-02-07T12:25:40.653 INFO:tasks.workunit.client.0.smithi047.stdout:6/119: creat d3/d5/f27 x:0 0 0 2024-02-07T12:25:40.653 INFO:tasks.workunit.client.0.smithi047.stdout:6/120: dread - d3/d5/f15 zero size 2024-02-07T12:25:40.653 INFO:tasks.workunit.client.0.smithi047.stdout:6/121: stat d3/d5/f13 0 2024-02-07T12:25:40.655 INFO:tasks.workunit.client.0.smithi047.stdout:9/40: unlink d3/f4 0 2024-02-07T12:25:40.655 INFO:tasks.workunit.client.0.smithi047.stdout:9/41: readlink d3/l6 0 2024-02-07T12:25:40.656 INFO:tasks.workunit.client.0.smithi047.stdout:6/122: getdents d3 0 2024-02-07T12:25:40.659 INFO:tasks.workunit.client.0.smithi047.stdout:9/42: creat d3/f9 x:0 0 0 2024-02-07T12:25:40.660 INFO:tasks.workunit.client.0.smithi047.stdout:1/74: write d1/f6 [3191952,44506] 0 2024-02-07T12:25:40.666 INFO:tasks.workunit.client.0.smithi047.stdout:2/121: dwrite d7/dc/f29 [0,4194304] 0 2024-02-07T12:25:40.668 INFO:tasks.workunit.client.0.smithi047.stdout:2/122: symlink d7/l2a 0 2024-02-07T12:25:40.673 INFO:tasks.workunit.client.0.smithi047.stdout:6/123: dread d3/f18 [0,4194304] 0 2024-02-07T12:25:40.674 INFO:tasks.workunit.client.0.smithi047.stdout:6/124: fsync d3/d5/f13 0 2024-02-07T12:25:40.674 INFO:tasks.workunit.client.0.smithi047.stdout:6/125: mkdir d3/da/d14/d28 0 2024-02-07T12:25:40.675 INFO:tasks.workunit.client.0.smithi047.stdout:6/126: truncate d3/fe 145583 0 2024-02-07T12:25:40.675 INFO:tasks.workunit.client.0.smithi047.stdout:6/127: dread - d3/d5/f27 zero size 2024-02-07T12:25:40.680 INFO:tasks.workunit.client.0.smithi047.stdout:1/75: write d1/fe [3650395,31401] 0 2024-02-07T12:25:40.680 INFO:tasks.workunit.client.0.smithi047.stdout:1/76: rmdir d1 39 2024-02-07T12:25:40.681 INFO:tasks.workunit.client.0.smithi047.stdout:5/82: dwrite da/f11 [0,4194304] 0 2024-02-07T12:25:40.681 INFO:tasks.workunit.client.1.smithi138.stdout:5/885: dwrite da/d43/d4a/f74 [0,4194304] 0 2024-02-07T12:25:40.682 INFO:tasks.workunit.client.1.smithi138.stdout:9/873: dwrite d0/d6/d8/d1d/dd/d25/d9b/f107 [0,4194304] 0 2024-02-07T12:25:40.682 INFO:tasks.workunit.client.0.smithi047.stdout:8/154: dwrite d3/d4/d1f/f23 [0,4194304] 0 2024-02-07T12:25:40.685 INFO:tasks.workunit.client.0.smithi047.stdout:5/83: dread da/fd [0,4194304] 0 2024-02-07T12:25:40.686 INFO:tasks.workunit.client.0.smithi047.stdout:8/155: link d3/d16/c2f d3/d16/d2a/c37 0 2024-02-07T12:25:40.689 INFO:tasks.workunit.client.0.smithi047.stdout:5/84: link da/f15 da/df/f19 0 2024-02-07T12:25:40.689 INFO:tasks.workunit.client.0.smithi047.stdout:5/85: fdatasync da/f11 0 2024-02-07T12:25:40.689 INFO:tasks.workunit.client.0.smithi047.stdout:5/86: chown da/f15 82196 1 2024-02-07T12:25:40.689 INFO:tasks.workunit.client.0.smithi047.stdout:5/87: chown da/l14 171 1 2024-02-07T12:25:40.689 INFO:tasks.workunit.client.0.smithi047.stdout:5/88: fdatasync da/df/f18 0 2024-02-07T12:25:40.692 INFO:tasks.workunit.client.0.smithi047.stdout:8/156: mknod d3/d4/c38 0 2024-02-07T12:25:40.692 INFO:tasks.workunit.client.0.smithi047.stdout:8/157: truncate d3/d16/d2a/f33 1512141 0 2024-02-07T12:25:40.692 INFO:tasks.workunit.client.0.smithi047.stdout:8/158: fdatasync d3/d4/f31 0 2024-02-07T12:25:40.692 INFO:tasks.workunit.client.0.smithi047.stdout:1/77: dread d1/f5 [0,4194304] 0 2024-02-07T12:25:40.692 INFO:tasks.workunit.client.0.smithi047.stdout:1/78: chown d1/lf 8 1 2024-02-07T12:25:40.693 INFO:tasks.workunit.client.1.smithi138.stdout:5/886: symlink da/d22/d99/dca/d11e/d4f/d2b/d35/d67/dd1/dff/l128 0 2024-02-07T12:25:40.694 INFO:tasks.workunit.client.0.smithi047.stdout:1/79: mknod d1/c10 0 2024-02-07T12:25:40.694 INFO:tasks.workunit.client.0.smithi047.stdout:1/80: write d1/fe [3253504,76628] 0 2024-02-07T12:25:40.695 INFO:tasks.workunit.client.0.smithi047.stdout:6/128: rmdir d3/da 39 2024-02-07T12:25:40.695 INFO:tasks.workunit.client.0.smithi047.stdout:6/129: truncate d3/da/d14/f1c 1108511 0 2024-02-07T12:25:40.695 INFO:tasks.workunit.client.0.smithi047.stdout:6/130: rename d3/d1e/d25 to d3/d1e/d25/d29 22 2024-02-07T12:25:40.696 INFO:tasks.workunit.client.1.smithi138.stdout:9/874: dwrite d0/d6/d8/d95/fa7 [0,4194304] 0 2024-02-07T12:25:40.697 INFO:tasks.workunit.client.0.smithi047.stdout:6/131: mkdir d3/d1e/d2a 0 2024-02-07T12:25:40.698 INFO:tasks.workunit.client.1.smithi138.stdout:5/887: creat da/d22/d99/dca/d11e/d4f/d2b/d35/d5d/d73/d119/f129 x:0 0 0 2024-02-07T12:25:40.700 INFO:tasks.workunit.client.0.smithi047.stdout:1/81: fsync d1/fe 0 2024-02-07T12:25:40.701 INFO:tasks.workunit.client.1.smithi138.stdout:5/888: mkdir da/d22/d99/dca/d11e/d4f/da3/d12a 0 2024-02-07T12:25:40.702 INFO:tasks.workunit.client.1.smithi138.stdout:5/889: creat da/d22/d99/dca/d11e/d4f/d2b/d35/f12b x:0 0 0 2024-02-07T12:25:40.704 INFO:tasks.workunit.client.0.smithi047.stdout:5/89: dread da/f15 [0,4194304] 0 2024-02-07T12:25:40.708 INFO:tasks.workunit.client.0.smithi047.stdout:1/82: getdents d1 0 2024-02-07T12:25:40.708 INFO:tasks.workunit.client.0.smithi047.stdout:1/83: getdents d1 0 2024-02-07T12:25:40.708 INFO:tasks.workunit.client.0.smithi047.stdout:1/84: stat d1/fe 0 2024-02-07T12:25:40.713 INFO:tasks.workunit.client.0.smithi047.stdout:5/90: dread da/df/f19 [0,4194304] 0 2024-02-07T12:25:40.713 INFO:tasks.workunit.client.0.smithi047.stdout:5/91: creat da/f1a x:0 0 0 2024-02-07T12:25:40.713 INFO:tasks.workunit.client.0.smithi047.stdout:5/92: readlink da/df/d16/l17 0 2024-02-07T12:25:40.717 INFO:tasks.workunit.client.1.smithi138.stdout:1/967: sync 2024-02-07T12:25:40.719 INFO:tasks.workunit.client.1.smithi138.stdout:1/968: symlink d5/d43/l138 0 2024-02-07T12:25:40.719 INFO:tasks.workunit.client.1.smithi138.stdout:1/969: fsync d5/d8/da/d1f/d5e/db5/d68/d73/d7b/f4e 0 2024-02-07T12:25:40.719 INFO:tasks.workunit.client.1.smithi138.stdout:1/970: creat d5/dfd/f139 x:0 0 0 2024-02-07T12:25:40.720 INFO:tasks.workunit.client.0.smithi047.stdout:5/93: dread da/df/f19 [0,4194304] 0 2024-02-07T12:25:40.721 INFO:tasks.workunit.client.0.smithi047.stdout:6/132: write d3/da/f24 [4160705,13604] 0 2024-02-07T12:25:40.722 INFO:tasks.workunit.client.0.smithi047.stdout:6/133: mknod d3/d1e/d2a/c2b 0 2024-02-07T12:25:40.734 INFO:tasks.workunit.client.0.smithi047.stdout:8/159: dwrite d3/d4/fc [4194304,4194304] 0 2024-02-07T12:25:40.734 INFO:tasks.workunit.client.0.smithi047.stdout:8/160: dread - d3/d16/f2d zero size 2024-02-07T12:25:40.734 INFO:tasks.workunit.client.0.smithi047.stdout:8/161: fsync d3/d16/d30/d34/f35 0 2024-02-07T12:25:40.734 INFO:tasks.workunit.client.0.smithi047.stdout:8/162: readlink d3/d4/le 0 2024-02-07T12:25:40.742 INFO:tasks.workunit.client.0.smithi047.stdout:8/163: dread d3/d4/f1e [0,4194304] 0 2024-02-07T12:25:40.742 INFO:tasks.workunit.client.0.smithi047.stdout:8/164: dread - d3/d4/f31 zero size 2024-02-07T12:25:40.743 INFO:tasks.workunit.client.0.smithi047.stdout:8/165: creat d3/d16/d30/f39 x:0 0 0 2024-02-07T12:25:40.744 INFO:tasks.workunit.client.0.smithi047.stdout:8/166: symlink d3/d16/d30/l3a 0 2024-02-07T12:25:40.744 INFO:tasks.workunit.client.0.smithi047.stdout:8/167: chown d3/d16/d30/d34 2027 1 2024-02-07T12:25:40.756 INFO:tasks.workunit.client.1.smithi138.stdout:9/875: dwrite d0/d6/f10b [0,4194304] 0 2024-02-07T12:25:40.756 INFO:tasks.workunit.client.1.smithi138.stdout:5/890: dwrite da/d22/d99/dca/d11e/d4f/ffd [0,4194304] 0 2024-02-07T12:25:40.769 INFO:tasks.workunit.client.1.smithi138.stdout:1/971: dwrite d5/d8/da/d20/f90 [0,4194304] 0 2024-02-07T12:25:40.769 INFO:tasks.workunit.client.0.smithi047.stdout:1/85: dwrite d1/f5 [0,4194304] 0 2024-02-07T12:25:40.769 INFO:tasks.workunit.client.0.smithi047.stdout:5/94: dwrite da/fd [0,4194304] 0 2024-02-07T12:25:40.769 INFO:tasks.workunit.client.0.smithi047.stdout:6/134: dwrite d3/d5/f26 [0,4194304] 0 2024-02-07T12:25:40.770 INFO:tasks.workunit.client.0.smithi047.stdout:1/86: creat d1/f11 x:0 0 0 2024-02-07T12:25:40.772 INFO:tasks.workunit.client.1.smithi138.stdout:5/891: write da/d43/d4a/f74 [3415830,126292] 0 2024-02-07T12:25:40.773 INFO:tasks.workunit.client.0.smithi047.stdout:8/168: dwrite d3/d4/fc [4194304,4194304] 0 2024-02-07T12:25:40.774 INFO:tasks.workunit.client.0.smithi047.stdout:8/169: unlink d3/d16/f21 0 2024-02-07T12:25:40.775 INFO:tasks.workunit.client.1.smithi138.stdout:9/876: write d0/faf [1527464,86007] 0 2024-02-07T12:25:40.775 INFO:tasks.workunit.client.0.smithi047.stdout:8/170: creat d3/d36/f3b x:0 0 0 2024-02-07T12:25:40.777 INFO:tasks.workunit.client.1.smithi138.stdout:9/877: symlink d0/d6/d8/d1d/dd/d1f/db7/db9/dc3/df3/l10d 0 2024-02-07T12:25:40.779 INFO:tasks.workunit.client.1.smithi138.stdout:9/878: symlink d0/d6/d8/d1d/dd/d41/d5e/d74/l10e 0 2024-02-07T12:25:40.779 INFO:tasks.workunit.client.1.smithi138.stdout:9/879: creat d0/d6/da3/dcc/f10f x:0 0 0 2024-02-07T12:25:40.781 INFO:tasks.workunit.client.1.smithi138.stdout:1/972: fsync d5/dfd/f139 0 2024-02-07T12:25:40.784 INFO:tasks.workunit.client.1.smithi138.stdout:9/880: rmdir d0/d6/d8/d1d/dd/d41 39 2024-02-07T12:25:40.784 INFO:tasks.workunit.client.1.smithi138.stdout:9/881: fsync d0/d6/d8/d1d/dd/d41/d5e/de7/dd8/fde 0 2024-02-07T12:25:40.785 INFO:tasks.workunit.client.0.smithi047.stdout:8/171: dread d3/f27 [4194304,4194304] 0 2024-02-07T12:25:40.785 INFO:tasks.workunit.client.0.smithi047.stdout:8/172: chown d3/f27 74929692 1 2024-02-07T12:25:40.786 INFO:tasks.workunit.client.0.smithi047.stdout:6/135: write d3/d1e/f21 [800765,4665] 0 2024-02-07T12:25:40.789 INFO:tasks.workunit.client.1.smithi138.stdout:9/882: mkdir d0/d6/d8/d1d/dd/d41/d5e/de7/d110 0 2024-02-07T12:25:40.789 INFO:tasks.workunit.client.0.smithi047.stdout:6/136: mkdir d3/da/d2c 0 2024-02-07T12:25:40.790 INFO:tasks.workunit.client.0.smithi047.stdout:8/173: write d3/d4/f7 [1351857,69016] 0 2024-02-07T12:25:40.790 INFO:tasks.workunit.client.0.smithi047.stdout:6/137: creat d3/da/d14/f2d x:0 0 0 2024-02-07T12:25:40.793 INFO:tasks.workunit.client.0.smithi047.stdout:6/138: creat d3/da/d2c/f2e x:0 0 0 2024-02-07T12:25:40.793 INFO:tasks.workunit.client.0.smithi047.stdout:6/139: creat d3/d1e/f2f x:0 0 0 2024-02-07T12:25:40.793 INFO:tasks.workunit.client.0.smithi047.stdout:6/140: chown d3/f8 1 1 2024-02-07T12:25:40.800 INFO:tasks.workunit.client.0.smithi047.stdout:6/141: symlink d3/d5/l30 0 2024-02-07T12:25:40.801 INFO:tasks.workunit.client.0.smithi047.stdout:5/95: dwrite da/f15 [0,4194304] 0 2024-02-07T12:25:40.801 INFO:tasks.workunit.client.0.smithi047.stdout:5/96: creat da/f1b x:0 0 0 2024-02-07T12:25:40.801 INFO:tasks.workunit.client.0.smithi047.stdout:5/97: creat da/f1c x:0 0 0 2024-02-07T12:25:40.801 INFO:tasks.workunit.client.0.smithi047.stdout:5/98: readlink da/l14 0 2024-02-07T12:25:40.801 INFO:tasks.workunit.client.0.smithi047.stdout:6/142: rename d3/fe to d3/d1e/f31 0 2024-02-07T12:25:40.801 INFO:tasks.workunit.client.0.smithi047.stdout:6/143: write d3/da/d2c/f2e [224441,33773] 0 2024-02-07T12:25:40.801 INFO:tasks.workunit.client.0.smithi047.stdout:6/144: rename d3 to d3/d1e/d25/d32 22 2024-02-07T12:25:40.802 INFO:tasks.workunit.client.1.smithi138.stdout:9/883: dread d0/d6/d8/d1d/dd/f31 [0,4194304] 0 2024-02-07T12:25:40.803 INFO:tasks.workunit.client.1.smithi138.stdout:9/884: fdatasync d0/d6/d8/f2a 0 2024-02-07T12:25:40.803 INFO:tasks.workunit.client.1.smithi138.stdout:5/892: dwrite da/d43/d4a/fc2 [0,4194304] 0 2024-02-07T12:25:40.803 INFO:tasks.workunit.client.1.smithi138.stdout:5/893: dread - da/d22/d99/dca/d11e/d4f/fa9 zero size 2024-02-07T12:25:40.803 INFO:tasks.workunit.client.1.smithi138.stdout:9/885: getdents d0/d6/d8/dbc 0 2024-02-07T12:25:40.803 INFO:tasks.workunit.client.1.smithi138.stdout:5/894: rmdir da/d22/d99/dca/d11e/d4f/d2b/d35/d5d 39 2024-02-07T12:25:40.803 INFO:tasks.workunit.client.1.smithi138.stdout:9/886: rmdir d0/d34/d86/ddd 39 2024-02-07T12:25:40.803 INFO:tasks.workunit.client.1.smithi138.stdout:6/990: sync 2024-02-07T12:25:40.803 INFO:tasks.workunit.client.1.smithi138.stdout:4/932: sync 2024-02-07T12:25:40.803 INFO:tasks.workunit.client.1.smithi138.stdout:0/994: sync 2024-02-07T12:25:40.803 INFO:tasks.workunit.client.1.smithi138.stdout:0/995: truncate d4/d9/db/d39/d4b/d6c/d8f/f109 520193 0 2024-02-07T12:25:40.803 INFO:tasks.workunit.client.1.smithi138.stdout:5/895: mknod da/d22/d99/dca/d11e/d4f/d2b/d35/d5d/d73/d127/c12c 0 2024-02-07T12:25:40.803 INFO:tasks.workunit.client.1.smithi138.stdout:5/896: chown da/d43/d4a/c66 0 1 2024-02-07T12:25:40.804 INFO:tasks.workunit.client.0.smithi047.stdout:5/99: symlink da/df/l1d 0 2024-02-07T12:25:40.804 INFO:tasks.workunit.client.1.smithi138.stdout:9/887: mkdir d0/d6/d8/d1d/dd/d41/d5e/de7/dd8/d111 0 2024-02-07T12:25:40.804 INFO:tasks.workunit.client.1.smithi138.stdout:4/933: readlink d20/d53/d71/d98/d117/d74/d9a/dc0/lc8 0 2024-02-07T12:25:40.806 INFO:tasks.workunit.client.1.smithi138.stdout:5/897: creat da/d22/d99/dca/d11e/d4f/d2b/d35/d110/f12d x:0 0 0 2024-02-07T12:25:40.806 INFO:tasks.workunit.client.1.smithi138.stdout:5/898: truncate da/d22/d99/dca/d11e/f88 1281845 0 2024-02-07T12:25:40.807 INFO:tasks.workunit.client.1.smithi138.stdout:9/888: link d0/d6/d8/dc5/fc7 d0/d6/d8/dbc/f112 0 2024-02-07T12:25:40.811 INFO:tasks.workunit.client.1.smithi138.stdout:0/996: symlink d4/l13a 0 2024-02-07T12:25:40.811 INFO:tasks.workunit.client.1.smithi138.stdout:0/997: creat d4/d9/db/d39/d4b/d6c/dc5/de0/f13b x:0 0 0 2024-02-07T12:25:40.812 INFO:tasks.workunit.client.1.smithi138.stdout:1/973: dwrite d5/d8/fbb [0,4194304] 0 2024-02-07T12:25:40.812 INFO:tasks.workunit.client.1.smithi138.stdout:4/934: rename d20/d47/d69/d7c/dfe/c127 to d20/d4d/d87/c13a 0 2024-02-07T12:25:40.815 INFO:tasks.workunit.client.1.smithi138.stdout:0/998: mknod d4/d9/d37/d64/c13c 0 2024-02-07T12:25:40.817 INFO:tasks.workunit.client.0.smithi047.stdout:8/174: dwrite d3/d4/f12 [0,4194304] 0 2024-02-07T12:25:40.817 INFO:tasks.workunit.client.0.smithi047.stdout:8/175: fsync d3/d4/f12 0 2024-02-07T12:25:40.818 INFO:tasks.workunit.client.1.smithi138.stdout:1/974: creat d5/d8/da/d1f/d60/df4/d59/dd8/f13a x:0 0 0 2024-02-07T12:25:40.819 INFO:tasks.workunit.client.1.smithi138.stdout:1/975: truncate d5/d8/da/d1f/d5e/db5/d68/da7/fd6 556755 0 2024-02-07T12:25:40.820 INFO:tasks.workunit.client.1.smithi138.stdout:0/999: truncate d4/d52/de9/f137 2207057 0 2024-02-07T12:25:40.821 INFO:tasks.workunit.client.1.smithi138.stdout:1/976: symlink d5/d8/da/d4a/l13b 0 2024-02-07T12:25:40.824 INFO:tasks.workunit.client.1.smithi138.stdout:4/935: rmdir d20/d34/d59/d72/d86 0 2024-02-07T12:25:40.824 INFO:tasks.workunit.client.1.smithi138.stdout:4/936: dread - d20/d47/d69/d7c/dfe/d114/df5/f10a zero size 2024-02-07T12:25:40.824 INFO:tasks.workunit.client.1.smithi138.stdout:4/937: stat d20/d47/d69/c9c 0 2024-02-07T12:25:40.826 INFO:tasks.workunit.client.1.smithi138.stdout:1/977: dread d5/d8/da/d1f/d5e/db5/d58/f8c [0,4194304] 0 2024-02-07T12:25:40.826 INFO:tasks.workunit.client.1.smithi138.stdout:1/978: readlink d5/la4 0 2024-02-07T12:25:40.826 INFO:tasks.workunit.client.1.smithi138.stdout:1/979: chown d5/d8/da/d1f/d60/df4/d59/d108/d112/f114 13275 1 2024-02-07T12:25:40.828 INFO:tasks.workunit.client.1.smithi138.stdout:1/980: getdents d5/d8/da/d1f/d60/df4/d59 0 2024-02-07T12:25:40.836 INFO:tasks.workunit.client.0.smithi047.stdout:6/145: dwrite d3/d1e/f31 [0,4194304] 0 2024-02-07T12:25:40.840 INFO:tasks.workunit.client.1.smithi138.stdout:5/899: dwrite da/d43/d4a/f9e [0,4194304] 0 2024-02-07T12:25:40.840 INFO:tasks.workunit.client.1.smithi138.stdout:6/991: dwrite dc/d69/f67 [0,4194304] 0 2024-02-07T12:25:40.840 INFO:tasks.workunit.client.0.smithi047.stdout:5/100: dwrite da/f11 [0,4194304] 0 2024-02-07T12:25:40.840 INFO:tasks.workunit.client.0.smithi047.stdout:5/101: truncate da/f1b 768035 0 2024-02-07T12:25:40.842 INFO:tasks.workunit.client.0.smithi047.stdout:6/146: dread d3/da/f19 [0,4194304] 0 2024-02-07T12:25:40.844 INFO:tasks.workunit.client.0.smithi047.stdout:6/147: rename d3/d1e/d2a to d3/d33 0 2024-02-07T12:25:40.844 INFO:tasks.workunit.client.0.smithi047.stdout:8/176: dread d3/d4/f7 [0,4194304] 0 2024-02-07T12:25:40.845 INFO:tasks.workunit.client.1.smithi138.stdout:5/900: truncate da/d22/d99/dca/d11e/d4f/d2b/d35/d5d/d73/fad 2454422 0 2024-02-07T12:25:40.845 INFO:tasks.workunit.client.1.smithi138.stdout:5/901: dread - da/d22/d99/dca/d11e/d4f/d2b/d35/d5d/f100 zero size 2024-02-07T12:25:40.845 INFO:tasks.workunit.client.1.smithi138.stdout:9/889: dwrite d0/d6/f3c [0,4194304] 0 2024-02-07T12:25:40.846 INFO:tasks.workunit.client.0.smithi047.stdout:8/177: mkdir d3/d16/d2a/d3c 0 2024-02-07T12:25:40.848 INFO:tasks.workunit.client.1.smithi138.stdout:6/992: mknod dc/d31/d54/c13e 0 2024-02-07T12:25:40.849 INFO:tasks.workunit.client.1.smithi138.stdout:1/981: dwrite d5/d8/da/d1f/d60/df4/d59/fa9 [4194304,4194304] 0 2024-02-07T12:25:40.851 INFO:tasks.workunit.client.0.smithi047.stdout:5/102: getdents da 0 2024-02-07T12:25:40.853 INFO:tasks.workunit.client.0.smithi047.stdout:5/103: rmdir da/df/d16 39 2024-02-07T12:25:40.854 INFO:tasks.workunit.client.1.smithi138.stdout:9/890: truncate d0/d6/d8/d1d/f61 947388 0 2024-02-07T12:25:40.856 INFO:tasks.workunit.client.0.smithi047.stdout:6/148: fdatasync d3/d5/f15 0 2024-02-07T12:25:40.856 INFO:tasks.workunit.client.1.smithi138.stdout:4/938: dwrite d20/d34/d59/f6b [0,4194304] 0 2024-02-07T12:25:40.857 INFO:tasks.workunit.client.1.smithi138.stdout:6/993: link f6 dc/d13/d1e/d35/d85/dba/f13f 0 2024-02-07T12:25:40.857 INFO:tasks.workunit.client.0.smithi047.stdout:6/149: truncate d3/da/f24 947147 0 2024-02-07T12:25:40.858 INFO:tasks.workunit.client.0.smithi047.stdout:6/150: stat d3/d5/c16 0 2024-02-07T12:25:40.859 INFO:tasks.workunit.client.0.smithi047.stdout:6/151: dread - d3/d5/f27 zero size 2024-02-07T12:25:40.859 INFO:tasks.workunit.client.0.smithi047.stdout:6/152: fdatasync d3/d1e/f31 0 2024-02-07T12:25:40.860 INFO:tasks.workunit.client.1.smithi138.stdout:1/982: mkdir d5/d8/da/d1f/d60/df4/d13c 0 2024-02-07T12:25:40.860 INFO:tasks.workunit.client.1.smithi138.stdout:1/983: write f3 [4274385,123134] 0 2024-02-07T12:25:40.860 INFO:tasks.workunit.client.0.smithi047.stdout:6/153: mkdir d3/da/d34 0 2024-02-07T12:25:40.861 INFO:tasks.workunit.client.0.smithi047.stdout:8/178: dwrite d3/d4/f31 [0,4194304] 0 2024-02-07T12:25:40.863 INFO:tasks.workunit.client.0.smithi047.stdout:6/154: mkdir d3/d5/d35 0 2024-02-07T12:25:40.863 INFO:tasks.workunit.client.0.smithi047.stdout:6/155: creat d3/da/d14/f36 x:0 0 0 2024-02-07T12:25:40.863 INFO:tasks.workunit.client.1.smithi138.stdout:9/891: rename d0/d6/d8/dbc/f105 to d0/f113 0 2024-02-07T12:25:40.871 INFO:tasks.workunit.client.0.smithi047.stdout:6/156: creat d3/da/f37 x:0 0 0 2024-02-07T12:25:40.873 INFO:tasks.workunit.client.0.smithi047.stdout:6/157: dread d3/da/f19 [0,4194304] 0 2024-02-07T12:25:40.873 INFO:tasks.workunit.client.0.smithi047.stdout:6/158: chown d3/d1e 244300325 1 2024-02-07T12:25:40.873 INFO:tasks.workunit.client.0.smithi047.stdout:6/159: fdatasync d3/f8 0 2024-02-07T12:25:40.878 INFO:tasks.workunit.client.1.smithi138.stdout:4/939: dwrite d20/f54 [0,4194304] 0 2024-02-07T12:25:40.878 INFO:tasks.workunit.client.1.smithi138.stdout:4/940: fsync f1d 0 2024-02-07T12:25:40.878 INFO:tasks.workunit.client.1.smithi138.stdout:4/941: truncate d20/d34/d36/f63 65632 0 2024-02-07T12:25:40.881 INFO:tasks.workunit.client.0.smithi047.stdout:5/104: dwrite da/f11 [0,4194304] 0 2024-02-07T12:25:40.882 INFO:tasks.workunit.client.0.smithi047.stdout:5/105: link da/f1b da/f1e 0 2024-02-07T12:25:40.882 INFO:tasks.workunit.client.0.smithi047.stdout:5/106: creat da/df/f1f x:0 0 0 2024-02-07T12:25:40.893 INFO:tasks.workunit.client.0.smithi047.stdout:5/107: dread da/f11 [0,4194304] 0 2024-02-07T12:25:40.903 INFO:tasks.workunit.client.1.smithi138.stdout:6/994: mkdir dc/d73/d140 0 2024-02-07T12:25:40.904 INFO:tasks.workunit.client.0.smithi047.stdout:5/108: creat da/f20 x:0 0 0 2024-02-07T12:25:40.905 INFO:tasks.workunit.client.0.smithi047.stdout:8/179: dwrite d3/d4/f31 [0,4194304] 0 2024-02-07T12:25:40.905 INFO:tasks.workunit.client.0.smithi047.stdout:8/180: write d3/d16/d2a/f2b [640289,47829] 0 2024-02-07T12:25:40.905 INFO:tasks.workunit.client.0.smithi047.stdout:8/181: fdatasync d3/d4/f31 0 2024-02-07T12:25:40.905 INFO:tasks.workunit.client.0.smithi047.stdout:8/182: write d3/d16/d30/f39 [1014509,53458] 0 2024-02-07T12:25:40.905 INFO:tasks.workunit.client.0.smithi047.stdout:8/183: creat d3/d16/d30/d34/f3d x:0 0 0 2024-02-07T12:25:40.906 INFO:tasks.workunit.client.0.smithi047.stdout:5/109: rename da/df/d16/l17 to da/df/l21 0 2024-02-07T12:25:40.906 INFO:tasks.workunit.client.1.smithi138.stdout:6/995: dread dc/d31/d38/f64 [0,4194304] 0 2024-02-07T12:25:40.907 INFO:tasks.workunit.client.1.smithi138.stdout:1/984: symlink d5/d4b/d6b/l13d 0 2024-02-07T12:25:40.908 INFO:tasks.workunit.client.1.smithi138.stdout:9/892: rmdir d0/d6/d8/dbc 39 2024-02-07T12:25:40.913 INFO:tasks.workunit.client.0.smithi047.stdout:8/184: mkdir d3/d16/d30/d34/d3e 0 2024-02-07T12:25:40.913 INFO:tasks.workunit.client.0.smithi047.stdout:8/185: dread - d3/d16/d2a/f32 zero size 2024-02-07T12:25:40.913 INFO:tasks.workunit.client.0.smithi047.stdout:8/186: stat d3/d16/d30/d34 0 2024-02-07T12:25:40.913 INFO:tasks.workunit.client.0.smithi047.stdout:8/187: creat d3/f3f x:0 0 0 2024-02-07T12:25:40.914 INFO:tasks.workunit.client.0.smithi047.stdout:5/110: unlink da/df/f19 0 2024-02-07T12:25:40.914 INFO:tasks.workunit.client.1.smithi138.stdout:6/996: mknod dc/d13/d1e/dae/db2/c141 0 2024-02-07T12:25:40.914 INFO:tasks.workunit.client.1.smithi138.stdout:6/997: dread - dc/d31/d54/ddd/df4/f12b zero size 2024-02-07T12:25:40.914 INFO:tasks.workunit.client.1.smithi138.stdout:6/998: readlink dc/d69/lb1 0 2024-02-07T12:25:40.914 INFO:tasks.workunit.client.1.smithi138.stdout:6/999: write fb [2881214,75429] 0 2024-02-07T12:25:40.915 INFO:tasks.workunit.client.1.smithi138.stdout:1/985: mknod d5/d8/da/d1f/d5e/db5/c13e 0 2024-02-07T12:25:40.915 INFO:tasks.workunit.client.0.smithi047.stdout:8/188: symlink d3/d36/l40 0 2024-02-07T12:25:40.916 INFO:tasks.workunit.client.1.smithi138.stdout:9/893: mknod d0/d6/c114 0 2024-02-07T12:25:40.918 INFO:tasks.workunit.client.0.smithi047.stdout:8/189: truncate d3/d4/f7 2150661 0 2024-02-07T12:25:40.918 INFO:tasks.workunit.client.1.smithi138.stdout:1/986: truncate d5/d8/da/d1f/d5e/db5/d58/d76/f134 222801 0 2024-02-07T12:25:40.921 INFO:tasks.workunit.client.0.smithi047.stdout:8/190: rename d3/f1d to d3/d16/d30/d34/f41 0 2024-02-07T12:25:40.926 INFO:tasks.workunit.client.0.smithi047.stdout:8/191: symlink d3/d16/d30/d34/l42 0 2024-02-07T12:25:40.956 INFO:tasks.workunit.client.1.smithi138.stdout:9/894: dwrite d0/d6/d8/d1d/dd/d41/d5e/de7/dd8/fde [4194304,4194304] 0 2024-02-07T12:25:40.957 INFO:tasks.workunit.client.0.smithi047.stdout:5/111: dwrite da/f15 [4194304,4194304] 0 2024-02-07T12:25:40.957 INFO:tasks.workunit.client.0.smithi047.stdout:8/192: dwrite d3/d4/d1f/f2e [0,4194304] 0 2024-02-07T12:25:40.957 INFO:tasks.workunit.client.0.smithi047.stdout:8/193: dread - d3/d36/f3b zero size 2024-02-07T12:25:40.957 INFO:tasks.workunit.client.0.smithi047.stdout:8/194: fdatasync d3/d4/fa 0 2024-02-07T12:25:40.957 INFO:tasks.workunit.client.0.smithi047.stdout:8/195: readlink d3/d16/d30/l3a 0 2024-02-07T12:25:40.958 INFO:tasks.workunit.client.1.smithi138.stdout:4/942: dwrite f11 [0,4194304] 0 2024-02-07T12:25:40.959 INFO:tasks.workunit.client.1.smithi138.stdout:9/895: symlink d0/d6/d8/d1d/dd/d1f/db7/db9/l115 0 2024-02-07T12:25:40.961 INFO:tasks.workunit.client.0.smithi047.stdout:8/196: stat d3/d16/d2a/l2c 0 2024-02-07T12:25:40.961 INFO:tasks.workunit.client.1.smithi138.stdout:4/943: mknod d20/d47/d69/d7c/c13b 0 2024-02-07T12:25:40.963 INFO:tasks.workunit.client.1.smithi138.stdout:5/902: sync 2024-02-07T12:25:40.963 INFO:tasks.workunit.client.1.smithi138.stdout:5/903: getdents da/d22/d99/dca/d11e/d4f/d2b/d35/d110/d11f/d125 0 2024-02-07T12:25:40.964 INFO:tasks.workunit.client.1.smithi138.stdout:5/904: chown da/d22/d99/lf6 228 1 2024-02-07T12:25:40.964 INFO:tasks.workunit.client.1.smithi138.stdout:9/896: creat d0/d6/d8/d1d/dd/d41/f116 x:0 0 0 2024-02-07T12:25:40.966 INFO:tasks.workunit.client.1.smithi138.stdout:4/944: link d20/d47/d69/d7c/db9/f131 d20/d47/d69/d7c/dfe/f13c 0 2024-02-07T12:25:40.966 INFO:tasks.workunit.client.1.smithi138.stdout:4/945: stat d20/d53/d71/d98/d117/d74 0 2024-02-07T12:25:40.969 INFO:tasks.workunit.client.1.smithi138.stdout:4/946: mkdir d20/d47/d69/def/d13d 0 2024-02-07T12:25:40.970 INFO:tasks.workunit.client.1.smithi138.stdout:4/947: creat d20/d53/d71/f13e x:0 0 0 2024-02-07T12:25:40.970 INFO:tasks.workunit.client.1.smithi138.stdout:4/948: write d20/f33 [441848,104149] 0 2024-02-07T12:25:40.970 INFO:tasks.workunit.client.1.smithi138.stdout:4/949: write f1a [4495936,33818] 0 2024-02-07T12:25:40.972 INFO:tasks.workunit.client.1.smithi138.stdout:9/897: rename d0/d6/d8/d1d/dd/d1f/db7/db9/dc3/df3/l10d to d0/d6/d8/d1d/dd/d1f/db7/db9/dc3/df9/l117 0 2024-02-07T12:25:40.972 INFO:tasks.workunit.client.1.smithi138.stdout:9/898: chown d0/d6/d8/d1d/dd/d41 123838 1 2024-02-07T12:25:40.972 INFO:tasks.workunit.client.1.smithi138.stdout:9/899: fdatasync d0/d6/f27 0 2024-02-07T12:25:40.972 INFO:tasks.workunit.client.1.smithi138.stdout:9/900: write d0/d6/da3/dcc/fda [1491234,114646] 0 2024-02-07T12:25:40.973 INFO:tasks.workunit.client.1.smithi138.stdout:9/901: fsync d0/d6/d8/d1d/dd/f9c 0 2024-02-07T12:25:40.975 INFO:tasks.workunit.client.1.smithi138.stdout:4/950: rename d20/d34/ld6 to d20/d47/d69/d7c/db9/l13f 0 2024-02-07T12:25:40.975 INFO:tasks.workunit.client.1.smithi138.stdout:4/951: write d20/d47/d69/d7c/db9/fbd [1640536,114363] 0 2024-02-07T12:25:40.982 INFO:tasks.workunit.client.1.smithi138.stdout:9/902: dread d0/d6/d8/d1d/dd/d41/d5e/f8d [0,4194304] 0 2024-02-07T12:25:40.982 INFO:tasks.workunit.client.1.smithi138.stdout:9/903: dread - d0/d6/d8/d1d/dd/d1f/db7/ffb zero size 2024-02-07T12:25:40.988 INFO:tasks.workunit.client.1.smithi138.stdout:4/952: write d20/f21 [1986587,110821] 0 2024-02-07T12:25:40.988 INFO:tasks.workunit.client.1.smithi138.stdout:4/953: dread - d20/d4d/d87/fcf zero size 2024-02-07T12:25:41.001 INFO:tasks.workunit.client.1.smithi138.stdout:4/954: truncate d20/f26 3139064 0 2024-02-07T12:25:41.002 INFO:tasks.workunit.client.1.smithi138.stdout:4/955: creat d20/d47/d69/def/f140 x:0 0 0 2024-02-07T12:25:41.002 INFO:tasks.workunit.client.1.smithi138.stdout:4/956: write d20/d34/d59/d72/fe7 [101286,49341] 0 2024-02-07T12:25:41.005 INFO:tasks.workunit.client.0.smithi047.stdout:8/197: dwrite d3/f9 [0,4194304] 0 2024-02-07T12:25:41.005 INFO:tasks.workunit.client.0.smithi047.stdout:8/198: creat d3/d16/d30/d34/f43 x:0 0 0 2024-02-07T12:25:41.006 INFO:tasks.workunit.client.0.smithi047.stdout:5/112: dwrite da/f15 [4194304,4194304] 0 2024-02-07T12:25:41.008 INFO:tasks.workunit.client.0.smithi047.stdout:8/199: dread d3/d4/f25 [0,4194304] 0 2024-02-07T12:25:41.008 INFO:tasks.workunit.client.0.smithi047.stdout:8/200: read d3/f17 [582337,11602] 0 2024-02-07T12:25:41.009 INFO:tasks.workunit.client.1.smithi138.stdout:5/905: dwrite da/d22/d99/dca/d11e/d4f/d2b/d35/d67/ff7 [0,4194304] 0 2024-02-07T12:25:41.009 INFO:tasks.workunit.client.1.smithi138.stdout:5/906: dread - da/d50/f113 zero size 2024-02-07T12:25:41.010 INFO:tasks.workunit.client.0.smithi047.stdout:5/113: creat da/df/d16/f22 x:0 0 0 2024-02-07T12:25:41.010 INFO:tasks.workunit.client.0.smithi047.stdout:5/114: creat da/df/d16/f23 x:0 0 0 2024-02-07T12:25:41.011 INFO:tasks.workunit.client.1.smithi138.stdout:4/957: write d20/d53/d71/d98/d117/d74/d9a/fc5 [1934276,119405] 0 2024-02-07T12:25:41.011 INFO:tasks.workunit.client.1.smithi138.stdout:4/958: chown d20/d53/dd1 1 1 2024-02-07T12:25:41.011 INFO:tasks.workunit.client.1.smithi138.stdout:4/959: truncate d20/d34/d59/d88/fd4 100802 0 2024-02-07T12:25:41.011 INFO:tasks.workunit.client.0.smithi047.stdout:8/201: unlink d3/d16/d30/d34/f41 0 2024-02-07T12:25:41.016 INFO:tasks.workunit.client.1.smithi138.stdout:4/960: link d20/d47/d69/def/f11f d20/d34/f141 0 2024-02-07T12:25:41.016 INFO:tasks.workunit.client.1.smithi138.stdout:4/961: write d20/d47/d69/d7c/dfe/d114/df5/f103 [301389,104362] 0 2024-02-07T12:25:41.017 INFO:tasks.workunit.client.1.smithi138.stdout:5/907: rmdir da/d34 39 2024-02-07T12:25:41.019 INFO:tasks.workunit.client.1.smithi138.stdout:5/908: dread da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/d91/fde [0,4194304] 0 2024-02-07T12:25:41.019 INFO:tasks.workunit.client.1.smithi138.stdout:5/909: creat da/d22/f12e x:0 0 0 2024-02-07T12:25:41.027 INFO:tasks.workunit.client.1.smithi138.stdout:4/962: read d20/d53/d71/d75/d94/ff4 [2898650,3723] 0 2024-02-07T12:25:41.028 INFO:tasks.workunit.client.0.smithi047.stdout:8/202: dwrite d3/d36/f3b [0,4194304] 0 2024-02-07T12:25:41.028 INFO:tasks.workunit.client.0.smithi047.stdout:8/203: dread - d3/f3f zero size 2024-02-07T12:25:41.028 INFO:tasks.workunit.client.0.smithi047.stdout:8/204: read - d3/d16/d30/d34/f35 zero size 2024-02-07T12:25:41.028 INFO:tasks.workunit.client.0.smithi047.stdout:8/205: dread - d3/d4/f18 zero size 2024-02-07T12:25:41.029 INFO:tasks.workunit.client.0.smithi047.stdout:8/206: chown d3/f9 16683407 1 2024-02-07T12:25:41.029 INFO:tasks.workunit.client.0.smithi047.stdout:8/207: fdatasync d3/d16/f2d 0 2024-02-07T12:25:41.029 INFO:tasks.workunit.client.0.smithi047.stdout:5/115: truncate da/f15 2854300 0 2024-02-07T12:25:41.029 INFO:tasks.workunit.client.0.smithi047.stdout:5/116: write da/fb [1334781,19372] 0 2024-02-07T12:25:41.031 INFO:tasks.workunit.client.1.smithi138.stdout:5/910: write da/d43/d4a/d69/f7a [6509349,83384] 0 2024-02-07T12:25:41.034 INFO:tasks.workunit.client.1.smithi138.stdout:5/911: mknod da/d34/c12f 0 2024-02-07T12:25:41.035 INFO:tasks.workunit.client.0.smithi047.stdout:5/117: dread da/fb [0,4194304] 0 2024-02-07T12:25:41.037 INFO:tasks.workunit.client.0.smithi047.stdout:5/118: mkdir da/d24 0 2024-02-07T12:25:41.037 INFO:tasks.workunit.client.0.smithi047.stdout:8/208: read d3/d4/f31 [151464,70629] 0 2024-02-07T12:25:41.038 INFO:tasks.workunit.client.1.smithi138.stdout:5/912: creat da/d22/d99/dca/dd5/f130 x:0 0 0 2024-02-07T12:25:41.039 INFO:tasks.workunit.client.0.smithi047.stdout:8/209: symlink d3/d4/d1f/l44 0 2024-02-07T12:25:41.040 INFO:tasks.workunit.client.1.smithi138.stdout:5/913: mknod da/d43/c131 0 2024-02-07T12:25:41.054 INFO:tasks.workunit.client.0.smithi047.stdout:8/210: dread d3/d4/d1f/f23 [0,4194304] 0 2024-02-07T12:25:41.056 INFO:tasks.workunit.client.0.smithi047.stdout:8/211: dread d3/d4/f7 [0,4194304] 0 2024-02-07T12:25:41.056 INFO:tasks.workunit.client.0.smithi047.stdout:8/212: write d3/d16/d2a/f32 [669070,91550] 0 2024-02-07T12:25:41.056 INFO:tasks.workunit.client.0.smithi047.stdout:8/213: chown d3/d16/d30 40091597 1 2024-02-07T12:25:41.056 INFO:tasks.workunit.client.0.smithi047.stdout:8/214: dread - d3/d16/f2d zero size 2024-02-07T12:25:41.058 INFO:tasks.workunit.client.0.smithi047.stdout:8/215: rename d3/d4/le to d3/d16/d28/l45 0 2024-02-07T12:25:41.058 INFO:tasks.workunit.client.0.smithi047.stdout:8/216: fdatasync d3/d4/f31 0 2024-02-07T12:25:41.061 INFO:tasks.workunit.client.1.smithi138.stdout:4/963: dwrite d20/d47/d69/d7c/dfe/d114/fc1 [4194304,4194304] 0 2024-02-07T12:25:41.062 INFO:tasks.workunit.client.1.smithi138.stdout:4/964: fdatasync d20/d34/d36/f5f 0 2024-02-07T12:25:41.065 INFO:tasks.workunit.client.0.smithi047.stdout:5/119: dwrite da/f1c [0,4194304] 0 2024-02-07T12:25:41.066 INFO:tasks.workunit.client.1.smithi138.stdout:5/914: dwrite da/f29 [4194304,4194304] 0 2024-02-07T12:25:41.066 INFO:tasks.workunit.client.1.smithi138.stdout:5/915: chown da/d22/d99/dca/d11e/d4f/d2b/d35/dae/c103 176477 1 2024-02-07T12:25:41.066 INFO:tasks.workunit.client.1.smithi138.stdout:5/916: readlink da/d6d/l54 0 2024-02-07T12:25:41.068 INFO:tasks.workunit.client.0.smithi047.stdout:5/120: mkdir da/df/d16/d25 0 2024-02-07T12:25:41.068 INFO:tasks.workunit.client.0.smithi047.stdout:5/121: dread - da/f1a zero size 2024-02-07T12:25:41.068 INFO:tasks.workunit.client.0.smithi047.stdout:5/122: stat da/ce 0 2024-02-07T12:25:41.069 INFO:tasks.workunit.client.1.smithi138.stdout:5/917: link da/d22/d99/dca/d11e/d4f/d2b/d35/d5d/d73/lcc da/d22/d99/dca/l132 0 2024-02-07T12:25:41.069 INFO:tasks.workunit.client.1.smithi138.stdout:5/918: stat da/d22/d99/dca/d11e/d4f/d2b/d35/d110/f12d 0 2024-02-07T12:25:41.070 INFO:tasks.workunit.client.0.smithi047.stdout:5/123: mknod da/c26 0 2024-02-07T12:25:41.070 INFO:tasks.workunit.client.0.smithi047.stdout:5/124: write da/f1a [456092,126952] 0 2024-02-07T12:25:41.074 INFO:tasks.workunit.client.0.smithi047.stdout:5/125: dread da/fb [0,4194304] 0 2024-02-07T12:25:41.081 INFO:tasks.workunit.client.1.smithi138.stdout:5/919: dwrite da/d22/d99/dca/d11e/d4f/d2b/fab [0,4194304] 0 2024-02-07T12:25:41.083 INFO:tasks.workunit.client.0.smithi047.stdout:5/126: dread da/f1a [0,4194304] 0 2024-02-07T12:25:41.083 INFO:tasks.workunit.client.1.smithi138.stdout:5/920: mkdir da/d43/d4a/d98/d10f/d133 0 2024-02-07T12:25:41.084 INFO:tasks.workunit.client.1.smithi138.stdout:5/921: rmdir da/d43/d4a/da2/d112 39 2024-02-07T12:25:41.089 INFO:tasks.workunit.client.1.smithi138.stdout:5/922: rename da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/d91/ca7 to da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/d96/c134 0 2024-02-07T12:25:41.089 INFO:tasks.workunit.client.1.smithi138.stdout:5/923: write da/d43/d4a/fbe [5119424,40627] 0 2024-02-07T12:25:41.095 INFO:tasks.workunit.client.0.smithi047.stdout:5/127: dwrite da/df/f18 [0,4194304] 0 2024-02-07T12:25:41.096 INFO:tasks.workunit.client.1.smithi138.stdout:5/924: write da/d22/d99/dca/d11e/d4f/d2b/fab [3643554,98170] 0 2024-02-07T12:25:41.097 INFO:tasks.workunit.client.0.smithi047.stdout:5/128: mknod da/d24/c27 0 2024-02-07T12:25:41.097 INFO:tasks.workunit.client.0.smithi047.stdout:5/129: chown da/cc 7 1 2024-02-07T12:25:41.097 INFO:tasks.workunit.client.0.smithi047.stdout:5/130: dread - da/f20 zero size 2024-02-07T12:25:41.097 INFO:tasks.workunit.client.0.smithi047.stdout:5/131: creat da/df/f28 x:0 0 0 2024-02-07T12:25:41.098 INFO:tasks.workunit.client.1.smithi138.stdout:5/925: creat da/d22/d99/dca/d11e/d4f/da3/f135 x:0 0 0 2024-02-07T12:25:41.099 INFO:tasks.workunit.client.0.smithi047.stdout:5/132: mknod da/df/c29 0 2024-02-07T12:25:41.099 INFO:tasks.workunit.client.0.smithi047.stdout:5/133: chown da/df/d16/f22 3009004 1 2024-02-07T12:25:41.101 INFO:tasks.workunit.client.0.smithi047.stdout:5/134: dread da/f1a [0,4194304] 0 2024-02-07T12:25:41.101 INFO:tasks.workunit.client.0.smithi047.stdout:5/135: stat da/f15 0 2024-02-07T12:25:41.101 INFO:tasks.workunit.client.0.smithi047.stdout:5/136: chown da/df/f18 31 1 2024-02-07T12:25:41.102 INFO:tasks.workunit.client.0.smithi047.stdout:5/137: creat da/df/d16/d25/f2a x:0 0 0 2024-02-07T12:25:41.102 INFO:tasks.workunit.client.0.smithi047.stdout:5/138: stat da/df/f1f 0 2024-02-07T12:25:41.125 INFO:tasks.workunit.client.0.smithi047.stdout:5/139: dwrite da/f1c [0,4194304] 0 2024-02-07T12:25:41.125 INFO:tasks.workunit.client.1.smithi138.stdout:5/926: dwrite da/f24 [0,4194304] 0 2024-02-07T12:25:41.127 INFO:tasks.workunit.client.0.smithi047.stdout:5/140: mkdir da/d24/d2b 0 2024-02-07T12:25:41.129 INFO:tasks.workunit.client.1.smithi138.stdout:5/927: rename da/d34/f80 to da/d22/d99/dca/d11e/d4f/d2b/d35/d67/dd1/dff/f136 0 2024-02-07T12:25:41.129 INFO:tasks.workunit.client.1.smithi138.stdout:5/928: readlink da/d22/d99/dca/d11e/d4f/d2b/d35/d5d/d73/lcc 0 2024-02-07T12:25:41.129 INFO:tasks.workunit.client.1.smithi138.stdout:5/929: truncate da/d22/d99/dca/d11e/fe1 704736 0 2024-02-07T12:25:41.130 INFO:tasks.workunit.client.1.smithi138.stdout:5/930: rename da/d22/d99/dca/d11e/d4f/d2b/d35/d40/ff5 to da/d22/d99/dca/d11e/d4f/f137 0 2024-02-07T12:25:41.133 INFO:tasks.workunit.client.1.smithi138.stdout:1/987: sync 2024-02-07T12:25:41.133 INFO:tasks.workunit.client.1.smithi138.stdout:9/904: sync 2024-02-07T12:25:41.133 INFO:tasks.workunit.client.0.smithi047.stdout:5/141: write da/f11 [2252492,11901] 0 2024-02-07T12:25:41.133 INFO:tasks.workunit.client.0.smithi047.stdout:5/142: write da/df/f28 [55059,75738] 0 2024-02-07T12:25:41.134 INFO:tasks.workunit.client.0.smithi047.stdout:5/143: read da/df/f28 [35709,95853] 0 2024-02-07T12:25:41.134 INFO:tasks.workunit.client.1.smithi138.stdout:5/931: dread da/d22/d99/dca/d11e/f77 [0,4194304] 0 2024-02-07T12:25:41.134 INFO:tasks.workunit.client.1.smithi138.stdout:5/932: chown da/d22/d99/dca/dd5/de2/f106 0 1 2024-02-07T12:25:41.135 INFO:tasks.workunit.client.0.smithi047.stdout:5/144: truncate da/fd 2791178 0 2024-02-07T12:25:41.135 INFO:tasks.workunit.client.0.smithi047.stdout:5/145: dread - da/df/d16/f22 zero size 2024-02-07T12:25:41.135 INFO:tasks.workunit.client.0.smithi047.stdout:5/146: truncate da/f1e 1327038 0 2024-02-07T12:25:41.135 INFO:tasks.workunit.client.0.smithi047.stdout:5/147: rename da to da/df/d2c 22 2024-02-07T12:25:41.135 INFO:tasks.workunit.client.0.smithi047.stdout:5/148: creat da/df/d16/d25/f2d x:0 0 0 2024-02-07T12:25:41.136 INFO:tasks.workunit.client.1.smithi138.stdout:5/933: creat da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/d91/f138 x:0 0 0 2024-02-07T12:25:41.138 INFO:tasks.workunit.client.1.smithi138.stdout:5/934: rename da/d22/d99/dca/d11e/d4f/cf9 to da/d43/d4a/d98/d10f/c139 0 2024-02-07T12:25:41.144 INFO:tasks.workunit.client.0.smithi047.stdout:5/149: getdents da/d24 0 2024-02-07T12:25:41.145 INFO:tasks.workunit.client.0.smithi047.stdout:5/150: read da/f1e [737150,27606] 0 2024-02-07T12:25:41.146 INFO:tasks.workunit.client.0.smithi047.stdout:5/151: mkdir da/d24/d2b/d2e 0 2024-02-07T12:25:41.148 INFO:tasks.workunit.client.1.smithi138.stdout:5/935: write da/d6d/f13 [644656,15211] 0 2024-02-07T12:25:41.148 INFO:tasks.workunit.client.1.smithi138.stdout:5/936: creat da/d22/f13a x:0 0 0 2024-02-07T12:25:41.154 INFO:tasks.workunit.client.0.smithi047.stdout:5/152: write da/f15 [2824459,30907] 0 2024-02-07T12:25:41.157 INFO:tasks.workunit.client.1.smithi138.stdout:1/988: dwrite d5/d5c/da5/f121 [0,4194304] 0 2024-02-07T12:25:41.158 INFO:tasks.workunit.client.1.smithi138.stdout:1/989: creat d5/d8/da/df8/f13f x:0 0 0 2024-02-07T12:25:41.158 INFO:tasks.workunit.client.1.smithi138.stdout:9/905: dwrite d0/d6/d8/d1d/da0/fbd [0,4194304] 0 2024-02-07T12:25:41.158 INFO:tasks.workunit.client.1.smithi138.stdout:9/906: creat d0/d6/d8/d1d/dd/d25/f118 x:0 0 0 2024-02-07T12:25:41.162 INFO:tasks.workunit.client.0.smithi047.stdout:5/153: dread da/f15 [0,4194304] 0 2024-02-07T12:25:41.167 INFO:tasks.workunit.client.1.smithi138.stdout:1/990: write d5/d8/da/d1f/d5e/fd3 [4140911,911] 0 2024-02-07T12:25:41.167 INFO:tasks.workunit.client.1.smithi138.stdout:1/991: getdents d5/d8/da/d1f/d5e/db5/d68/d122 0 2024-02-07T12:25:41.167 INFO:tasks.workunit.client.1.smithi138.stdout:1/992: stat d5/d43/f11d 0 2024-02-07T12:25:41.167 INFO:tasks.workunit.client.1.smithi138.stdout:1/993: readlink d5/d4b/la0 0 2024-02-07T12:25:41.167 INFO:tasks.workunit.client.1.smithi138.stdout:1/994: fsync d5/d43/f11d 0 2024-02-07T12:25:41.168 INFO:tasks.workunit.client.1.smithi138.stdout:9/907: dread d0/f6f [4194304,4194304] 0 2024-02-07T12:25:41.169 INFO:tasks.workunit.client.1.smithi138.stdout:9/908: mkdir d0/d34/d119 0 2024-02-07T12:25:41.194 INFO:tasks.workunit.client.1.smithi138.stdout:9/909: dwrite d0/d34/d86/fe4 [0,4194304] 0 2024-02-07T12:25:41.194 INFO:tasks.workunit.client.1.smithi138.stdout:9/910: chown d0/d34/d45 44006341 1 2024-02-07T12:25:41.194 INFO:tasks.workunit.client.1.smithi138.stdout:1/995: dwrite d5/d8/da/f1d [0,4194304] 0 2024-02-07T12:25:41.194 INFO:tasks.workunit.client.1.smithi138.stdout:9/911: creat d0/d6/d8/d1d/dd/d41/d5e/de7/dd8/f11a x:0 0 0 2024-02-07T12:25:41.194 INFO:tasks.workunit.client.0.smithi047.stdout:5/154: dwrite da/fd [0,4194304] 0 2024-02-07T12:25:41.197 INFO:tasks.workunit.client.0.smithi047.stdout:5/155: unlink da/df/f18 0 2024-02-07T12:25:41.198 INFO:tasks.workunit.client.1.smithi138.stdout:1/996: link d5/d4b/d6b/l13d d5/d8/da/d1f/d5e/db5/d68/l140 0 2024-02-07T12:25:41.200 INFO:tasks.workunit.client.1.smithi138.stdout:9/912: truncate d0/faf 2166036 0 2024-02-07T12:25:41.200 INFO:tasks.workunit.client.1.smithi138.stdout:9/913: chown d0/d34/d86 135076 1 2024-02-07T12:25:41.200 INFO:tasks.workunit.client.0.smithi047.stdout:5/156: creat da/d24/f2f x:0 0 0 2024-02-07T12:25:41.201 INFO:tasks.workunit.client.0.smithi047.stdout:5/157: fdatasync da/df/f28 0 2024-02-07T12:25:41.201 INFO:tasks.workunit.client.0.smithi047.stdout:5/158: dread - da/df/d16/f23 zero size 2024-02-07T12:25:41.201 INFO:tasks.workunit.client.0.smithi047.stdout:5/159: symlink da/df/d16/d25/l30 0 2024-02-07T12:25:41.203 INFO:tasks.workunit.client.0.smithi047.stdout:5/160: link da/f1a da/d24/d2b/d2e/f31 0 2024-02-07T12:25:41.203 INFO:tasks.workunit.client.0.smithi047.stdout:5/161: stat da/f1b 0 2024-02-07T12:25:41.203 INFO:tasks.workunit.client.0.smithi047.stdout:5/162: fdatasync da/f1a 0 2024-02-07T12:25:41.205 INFO:tasks.workunit.client.0.smithi047.stdout:5/163: mknod da/d24/d2b/d2e/c32 0 2024-02-07T12:25:41.206 INFO:tasks.workunit.client.1.smithi138.stdout:1/997: dread d5/d8/da/f71 [0,4194304] 0 2024-02-07T12:25:41.206 INFO:tasks.workunit.client.1.smithi138.stdout:9/914: mknod d0/d34/d86/c11b 0 2024-02-07T12:25:41.206 INFO:tasks.workunit.client.1.smithi138.stdout:9/915: fdatasync d0/d6/d8/d1d/da0/fc2 0 2024-02-07T12:25:41.206 INFO:tasks.workunit.client.1.smithi138.stdout:9/916: stat d0/d6/d8/d1d/dd/d25/d9b/f107 0 2024-02-07T12:25:41.209 INFO:tasks.workunit.client.0.smithi047.stdout:3/82: sync 2024-02-07T12:25:41.209 INFO:tasks.workunit.client.1.smithi138.stdout:9/917: dread d0/d6/d8/d1d/f61 [0,4194304] 0 2024-02-07T12:25:41.210 INFO:tasks.workunit.client.0.smithi047.stdout:3/83: getdents d12 0 2024-02-07T12:25:41.211 INFO:tasks.workunit.client.1.smithi138.stdout:9/918: truncate d0/d6/d8/d1d/dd/d41/f5c 4106215 0 2024-02-07T12:25:41.213 INFO:tasks.workunit.client.0.smithi047.stdout:5/164: rmdir da/df 39 2024-02-07T12:25:41.213 INFO:tasks.workunit.client.0.smithi047.stdout:5/165: chown da/df/d16/d25 479 1 2024-02-07T12:25:41.213 INFO:tasks.workunit.client.0.smithi047.stdout:5/166: chown da/f1c 110360 1 2024-02-07T12:25:41.213 INFO:tasks.workunit.client.0.smithi047.stdout:5/167: truncate da/d24/d2b/d2e/f31 1620565 0 2024-02-07T12:25:41.213 INFO:tasks.workunit.client.0.smithi047.stdout:5/168: fsync da/f1b 0 2024-02-07T12:25:41.213 INFO:tasks.workunit.client.0.smithi047.stdout:5/169: chown da/cc 412 1 2024-02-07T12:25:41.219 INFO:tasks.workunit.client.0.smithi047.stdout:3/84: write f9 [144875,92468] 0 2024-02-07T12:25:41.221 INFO:tasks.workunit.client.0.smithi047.stdout:3/85: mkdir d12/d19 0 2024-02-07T12:25:41.226 INFO:tasks.workunit.client.1.smithi138.stdout:1/998: dwrite d5/d8/da/d20/f135 [0,4194304] 0 2024-02-07T12:25:41.229 INFO:tasks.workunit.client.1.smithi138.stdout:1/999: rmdir d5/d4b 39 2024-02-07T12:25:41.231 INFO:tasks.workunit.client.0.smithi047.stdout:3/86: read d12/f13 [2425474,61987] 0 2024-02-07T12:25:41.231 INFO:tasks.workunit.client.0.smithi047.stdout:5/170: dread da/f1c [0,4194304] 0 2024-02-07T12:25:41.231 INFO:tasks.workunit.client.0.smithi047.stdout:5/171: fsync da/f15 0 2024-02-07T12:25:41.231 INFO:tasks.workunit.client.0.smithi047.stdout:5/172: fdatasync da/d24/f2f 0 2024-02-07T12:25:41.231 INFO:tasks.workunit.client.1.smithi138.stdout:9/919: dwrite d0/f103 [0,4194304] 0 2024-02-07T12:25:41.233 INFO:tasks.workunit.client.0.smithi047.stdout:3/87: link d12/f18 d12/f1a 0 2024-02-07T12:25:41.233 INFO:tasks.workunit.client.0.smithi047.stdout:3/88: write d12/f14 [132224,123737] 0 2024-02-07T12:25:41.233 INFO:tasks.workunit.client.0.smithi047.stdout:5/173: mkdir da/df/d16/d25/d33 0 2024-02-07T12:25:41.233 INFO:tasks.workunit.client.0.smithi047.stdout:5/174: creat da/f34 x:0 0 0 2024-02-07T12:25:41.236 INFO:tasks.workunit.client.0.smithi047.stdout:3/89: truncate f2 1844574 0 2024-02-07T12:25:41.238 INFO:tasks.workunit.client.0.smithi047.stdout:5/175: rename da/df/d16/f23 to da/df/d16/d25/d33/f35 0 2024-02-07T12:25:41.240 INFO:tasks.workunit.client.0.smithi047.stdout:5/176: dread da/fb [0,4194304] 0 2024-02-07T12:25:41.240 INFO:tasks.workunit.client.0.smithi047.stdout:5/177: fsync da/df/d16/f22 0 2024-02-07T12:25:41.242 INFO:tasks.workunit.client.0.smithi047.stdout:5/178: link da/df/d16/d25/f2a da/df/d16/d25/f36 0 2024-02-07T12:25:41.242 INFO:tasks.workunit.client.0.smithi047.stdout:5/179: truncate da/d24/f2f 805682 0 2024-02-07T12:25:41.243 INFO:tasks.workunit.client.0.smithi047.stdout:5/180: rename da/cc to da/d24/c37 0 2024-02-07T12:25:41.246 INFO:tasks.workunit.client.1.smithi138.stdout:9/920: dwrite d0/d6/d8/d1d/da0/fc2 [0,4194304] 0 2024-02-07T12:25:41.246 INFO:tasks.workunit.client.1.smithi138.stdout:9/921: read d0/d6/d8/d1d/dd/f9c [21701,77617] 0 2024-02-07T12:25:41.249 INFO:tasks.workunit.client.1.smithi138.stdout:9/922: mknod d0/d6/d8/d1d/dd/d1f/c11c 0 2024-02-07T12:25:41.249 INFO:tasks.workunit.client.1.smithi138.stdout:9/923: chown d0/d6/f27 1004217864 1 2024-02-07T12:25:41.249 INFO:tasks.workunit.client.1.smithi138.stdout:9/924: chown d0/c71 29 1 2024-02-07T12:25:41.252 INFO:tasks.workunit.client.1.smithi138.stdout:9/925: creat d0/d6/d8/d1d/d109/f11d x:0 0 0 2024-02-07T12:25:41.255 INFO:tasks.workunit.client.1.smithi138.stdout:9/926: rename d0/d6/d8/f52 to d0/d6/d8/d1d/dd/d41/d5e/da6/f11e 0 2024-02-07T12:25:41.255 INFO:tasks.workunit.client.0.smithi047.stdout:4/50: sync 2024-02-07T12:25:41.256 INFO:tasks.workunit.client.0.smithi047.stdout:4/51: fsync f1 0 2024-02-07T12:25:41.256 INFO:tasks.workunit.client.0.smithi047.stdout:4/52: chown d3/l8 3162 1 2024-02-07T12:25:41.256 INFO:tasks.workunit.client.0.smithi047.stdout:0/52: sync 2024-02-07T12:25:41.256 INFO:tasks.workunit.client.0.smithi047.stdout:0/53: write f5 [5182555,109248] 0 2024-02-07T12:25:41.256 INFO:tasks.workunit.client.0.smithi047.stdout:0/54: creat fd x:0 0 0 2024-02-07T12:25:41.256 INFO:tasks.workunit.client.0.smithi047.stdout:0/55: fsync f1 0 2024-02-07T12:25:41.257 INFO:tasks.workunit.client.1.smithi138.stdout:9/927: symlink d0/d6/d8/d1d/dd/l11f 0 2024-02-07T12:25:41.257 INFO:tasks.workunit.client.1.smithi138.stdout:9/928: truncate d0/f103 5240999 0 2024-02-07T12:25:41.257 INFO:tasks.workunit.client.1.smithi138.stdout:9/929: write d0/d6/d8/d1d/dd/d41/d5e/de7/ffa [719770,69150] 0 2024-02-07T12:25:41.257 INFO:tasks.workunit.client.0.smithi047.stdout:4/53: getdents d3 0 2024-02-07T12:25:41.257 INFO:tasks.workunit.client.0.smithi047.stdout:4/54: chown d3/ca 16200242 1 2024-02-07T12:25:41.258 INFO:tasks.workunit.client.0.smithi047.stdout:4/55: getdents d3 0 2024-02-07T12:25:41.258 INFO:tasks.workunit.client.1.smithi138.stdout:9/930: unlink d0/d34/d45/f69 0 2024-02-07T12:25:41.258 INFO:tasks.workunit.client.1.smithi138.stdout:9/931: mknod d0/d6/d8/d1d/dd/d41/d5e/de7/dd8/d111/c120 0 2024-02-07T12:25:41.259 INFO:tasks.workunit.client.0.smithi047.stdout:4/56: write f1 [1169690,109678] 0 2024-02-07T12:25:41.260 INFO:tasks.workunit.client.0.smithi047.stdout:5/181: dwrite da/f20 [0,4194304] 0 2024-02-07T12:25:41.260 INFO:tasks.workunit.client.0.smithi047.stdout:4/57: dread d3/f6 [0,4194304] 0 2024-02-07T12:25:41.260 INFO:tasks.workunit.client.0.smithi047.stdout:4/58: rename d3 to d3/d11 22 2024-02-07T12:25:41.262 INFO:tasks.workunit.client.0.smithi047.stdout:0/56: fsync f5 0 2024-02-07T12:25:41.263 INFO:tasks.workunit.client.0.smithi047.stdout:3/90: dwrite f2 [0,4194304] 0 2024-02-07T12:25:41.265 INFO:tasks.workunit.client.0.smithi047.stdout:5/182: creat da/df/f38 x:0 0 0 2024-02-07T12:25:41.266 INFO:tasks.workunit.client.0.smithi047.stdout:4/59: dread f1 [0,4194304] 0 2024-02-07T12:25:41.266 INFO:tasks.workunit.client.0.smithi047.stdout:4/60: fdatasync f2 0 2024-02-07T12:25:41.272 INFO:tasks.workunit.client.1.smithi138.stdout:5/937: sync 2024-02-07T12:25:41.272 INFO:tasks.workunit.client.1.smithi138.stdout:4/965: sync 2024-02-07T12:25:41.273 INFO:tasks.workunit.client.1.smithi138.stdout:5/938: chown da/d22/d99/dca/d11e/d4f/da3 517 1 2024-02-07T12:25:41.273 INFO:tasks.workunit.client.1.smithi138.stdout:4/966: creat d20/d47/d69/d7c/dfe/f142 x:0 0 0 2024-02-07T12:25:41.273 INFO:tasks.workunit.client.0.smithi047.stdout:3/91: creat d12/d19/f1b x:0 0 0 2024-02-07T12:25:41.274 INFO:tasks.workunit.client.0.smithi047.stdout:3/92: chown d12/f13 47525863 1 2024-02-07T12:25:41.274 INFO:tasks.workunit.client.1.smithi138.stdout:5/939: rmdir da/d22/d99/dca/d11e/d4f/d2b/d35/d67/dd1 39 2024-02-07T12:25:41.275 INFO:tasks.workunit.client.0.smithi047.stdout:4/61: creat d3/f12 x:0 0 0 2024-02-07T12:25:41.275 INFO:tasks.workunit.client.0.smithi047.stdout:4/62: write d3/fc [327431,93292] 0 2024-02-07T12:25:41.276 INFO:tasks.workunit.client.0.smithi047.stdout:4/63: fsync d3/fb 0 2024-02-07T12:25:41.276 INFO:tasks.workunit.client.0.smithi047.stdout:4/64: fdatasync f1 0 2024-02-07T12:25:41.276 INFO:tasks.workunit.client.1.smithi138.stdout:4/967: write d20/d53/d71/d98/d117/f6d [4293055,102144] 0 2024-02-07T12:25:41.276 INFO:tasks.workunit.client.1.smithi138.stdout:4/968: write d20/d4d/f90 [1028222,36610] 0 2024-02-07T12:25:41.277 INFO:tasks.workunit.client.1.smithi138.stdout:4/969: chown d20/d53/d71/d98/d117/fd3 4726048 1 2024-02-07T12:25:41.277 INFO:tasks.workunit.client.0.smithi047.stdout:5/183: unlink da/f20 0 2024-02-07T12:25:41.277 INFO:tasks.workunit.client.0.smithi047.stdout:5/184: chown da/fb 0 1 2024-02-07T12:25:41.277 INFO:tasks.workunit.client.0.smithi047.stdout:5/185: creat da/f39 x:0 0 0 2024-02-07T12:25:41.278 INFO:tasks.workunit.client.0.smithi047.stdout:5/186: stat da/f11 0 2024-02-07T12:25:41.278 INFO:tasks.workunit.client.0.smithi047.stdout:5/187: chown da/f1e 2502769 1 2024-02-07T12:25:41.278 INFO:tasks.workunit.client.0.smithi047.stdout:4/65: mknod d3/c13 0 2024-02-07T12:25:41.279 INFO:tasks.workunit.client.0.smithi047.stdout:3/93: dread f11 [0,4194304] 0 2024-02-07T12:25:41.282 INFO:tasks.workunit.client.0.smithi047.stdout:5/188: stat da/df/l21 0 2024-02-07T12:25:41.284 INFO:tasks.workunit.client.1.smithi138.stdout:9/932: dwrite d0/d6/d8/d1d/dd/d41/d5e/de7/ffa [0,4194304] 0 2024-02-07T12:25:41.284 INFO:tasks.workunit.client.0.smithi047.stdout:0/57: dwrite f1 [0,4194304] 0 2024-02-07T12:25:41.284 INFO:tasks.workunit.client.0.smithi047.stdout:0/58: chown fd 96 1 2024-02-07T12:25:41.289 INFO:tasks.workunit.client.1.smithi138.stdout:9/933: rename d0/d6/d8/d1d/dd/d1f/f1b to d0/d6/d8/d95/f121 0 2024-02-07T12:25:41.289 INFO:tasks.workunit.client.1.smithi138.stdout:9/934: fsync d0/d6/d8/d1d/dd/d41/f79 0 2024-02-07T12:25:41.289 INFO:tasks.workunit.client.1.smithi138.stdout:9/935: truncate d0/d6/d8/d1d/dd/d41/d5e/da6/f11e 4409800 0 2024-02-07T12:25:41.289 INFO:tasks.workunit.client.1.smithi138.stdout:9/936: creat d0/d6/da3/dcc/dd1/f122 x:0 0 0 2024-02-07T12:25:41.289 INFO:tasks.workunit.client.1.smithi138.stdout:4/970: dread f1d [0,4194304] 0 2024-02-07T12:25:41.297 INFO:tasks.workunit.client.1.smithi138.stdout:4/971: link d20/d34/l3b d20/d47/d69/def/l143 0 2024-02-07T12:25:41.306 INFO:tasks.workunit.client.1.smithi138.stdout:9/937: write d0/d6/d8/d1d/da0/fc2 [1328372,122199] 0 2024-02-07T12:25:41.306 INFO:tasks.workunit.client.1.smithi138.stdout:9/938: creat d0/d6/d8/d1d/dd/d25/f123 x:0 0 0 2024-02-07T12:25:41.306 INFO:tasks.workunit.client.1.smithi138.stdout:9/939: dread - d0/d6/d8/dc5/fc7 zero size 2024-02-07T12:25:41.306 INFO:tasks.workunit.client.1.smithi138.stdout:9/940: chown d0/d6/d8/d1d/d109/f11d 735166518 1 2024-02-07T12:25:41.306 INFO:tasks.workunit.client.1.smithi138.stdout:9/941: write d0/d6/f27 [368968,55880] 0 2024-02-07T12:25:41.307 INFO:tasks.workunit.client.1.smithi138.stdout:9/942: rmdir d0/d6/d8/d1d/d109 39 2024-02-07T12:25:41.307 INFO:tasks.workunit.client.1.smithi138.stdout:9/943: fsync d0/d6/d8/d1d/dd/d25/f118 0 2024-02-07T12:25:41.309 INFO:tasks.workunit.client.1.smithi138.stdout:4/972: read d20/d34/d59/d88/d8e/ff1 [1461289,82474] 0 2024-02-07T12:25:41.310 INFO:tasks.workunit.client.1.smithi138.stdout:4/973: mknod d20/d53/dd1/c144 0 2024-02-07T12:25:41.314 INFO:tasks.workunit.client.0.smithi047.stdout:3/94: dwrite d12/f1a [0,4194304] 0 2024-02-07T12:25:41.315 INFO:tasks.workunit.client.0.smithi047.stdout:4/66: dwrite d3/f6 [0,4194304] 0 2024-02-07T12:25:41.316 INFO:tasks.workunit.client.0.smithi047.stdout:0/59: dwrite fc [0,4194304] 0 2024-02-07T12:25:41.317 INFO:tasks.workunit.client.0.smithi047.stdout:0/60: stat f5 0 2024-02-07T12:25:41.317 INFO:tasks.workunit.client.0.smithi047.stdout:6/160: sync 2024-02-07T12:25:41.317 INFO:tasks.workunit.client.0.smithi047.stdout:7/178: sync 2024-02-07T12:25:41.317 INFO:tasks.workunit.client.0.smithi047.stdout:6/161: fsync d3/d1e/f21 0 2024-02-07T12:25:41.317 INFO:tasks.workunit.client.0.smithi047.stdout:2/123: sync 2024-02-07T12:25:41.317 INFO:tasks.workunit.client.0.smithi047.stdout:2/124: fdatasync d7/dc/f29 0 2024-02-07T12:25:41.317 INFO:tasks.workunit.client.0.smithi047.stdout:2/125: write d7/f1e [4744891,117034] 0 2024-02-07T12:25:41.317 INFO:tasks.workunit.client.0.smithi047.stdout:9/43: sync 2024-02-07T12:25:41.317 INFO:tasks.workunit.client.0.smithi047.stdout:1/87: sync 2024-02-07T12:25:41.317 INFO:tasks.workunit.client.0.smithi047.stdout:1/88: chown d1/c10 5083 1 2024-02-07T12:25:41.317 INFO:tasks.workunit.client.0.smithi047.stdout:1/89: stat d1/c10 0 2024-02-07T12:25:41.318 INFO:tasks.workunit.client.0.smithi047.stdout:1/90: fdatasync d1/f6 0 2024-02-07T12:25:41.318 INFO:tasks.workunit.client.0.smithi047.stdout:8/217: sync 2024-02-07T12:25:41.319 INFO:tasks.workunit.client.0.smithi047.stdout:3/95: getdents d12 0 2024-02-07T12:25:41.320 INFO:tasks.workunit.client.1.smithi138.stdout:9/944: dread d0/d6/d8/d1d/dd/d41/d5e/da6/fd9 [0,4194304] 0 2024-02-07T12:25:41.321 INFO:tasks.workunit.client.0.smithi047.stdout:5/189: dwrite da/d24/d2b/d2e/f31 [0,4194304] 0 2024-02-07T12:25:41.323 INFO:tasks.workunit.client.0.smithi047.stdout:6/162: chown d3/d5/cc 10595 1 2024-02-07T12:25:41.323 INFO:tasks.workunit.client.0.smithi047.stdout:6/163: chown d3/d5/l30 690 1 2024-02-07T12:25:41.325 INFO:tasks.workunit.client.0.smithi047.stdout:2/126: rmdir d7/dc/d25 0 2024-02-07T12:25:41.325 INFO:tasks.workunit.client.0.smithi047.stdout:2/127: dread - d7/f28 zero size 2024-02-07T12:25:41.326 INFO:tasks.workunit.client.0.smithi047.stdout:9/44: mknod d3/ca 0 2024-02-07T12:25:41.326 INFO:tasks.workunit.client.0.smithi047.stdout:9/45: creat d3/fb x:0 0 0 2024-02-07T12:25:41.326 INFO:tasks.workunit.client.0.smithi047.stdout:9/46: fdatasync f1 0 2024-02-07T12:25:41.326 INFO:tasks.workunit.client.0.smithi047.stdout:9/47: fsync f2 0 2024-02-07T12:25:41.327 INFO:tasks.workunit.client.0.smithi047.stdout:2/128: write d7/f13 [194721,93091] 0 2024-02-07T12:25:41.328 INFO:tasks.workunit.client.0.smithi047.stdout:1/91: symlink d1/l12 0 2024-02-07T12:25:41.330 INFO:tasks.workunit.client.0.smithi047.stdout:3/96: creat d12/f1c x:0 0 0 2024-02-07T12:25:41.330 INFO:tasks.workunit.client.0.smithi047.stdout:3/97: creat d12/d19/f1d x:0 0 0 2024-02-07T12:25:41.334 INFO:tasks.workunit.client.0.smithi047.stdout:4/67: getdents d3 0 2024-02-07T12:25:41.335 INFO:tasks.workunit.client.0.smithi047.stdout:2/129: write d7/f8 [194988,33582] 0 2024-02-07T12:25:41.336 INFO:tasks.workunit.client.0.smithi047.stdout:2/130: dread - d7/f28 zero size 2024-02-07T12:25:41.336 INFO:tasks.workunit.client.0.smithi047.stdout:7/179: link d0/cc d0/d4/c3a 0 2024-02-07T12:25:41.338 INFO:tasks.workunit.client.0.smithi047.stdout:6/164: symlink d3/da/l38 0 2024-02-07T12:25:41.338 INFO:tasks.workunit.client.0.smithi047.stdout:6/165: readlink d3/d5/l30 0 2024-02-07T12:25:41.339 INFO:tasks.workunit.client.0.smithi047.stdout:6/166: fsync d3/da/d2c/f2e 0 2024-02-07T12:25:41.339 INFO:tasks.workunit.client.0.smithi047.stdout:6/167: creat d3/d1e/f39 x:0 0 0 2024-02-07T12:25:41.339 INFO:tasks.workunit.client.0.smithi047.stdout:6/168: readlink d3/da/l38 0 2024-02-07T12:25:41.339 INFO:tasks.workunit.client.0.smithi047.stdout:9/48: dread f1 [0,4194304] 0 2024-02-07T12:25:41.342 INFO:tasks.workunit.client.0.smithi047.stdout:3/98: rename d12/d19/f1b to d12/d19/f1e 0 2024-02-07T12:25:41.342 INFO:tasks.workunit.client.0.smithi047.stdout:3/99: creat d12/f1f x:0 0 0 2024-02-07T12:25:41.343 INFO:tasks.workunit.client.0.smithi047.stdout:4/68: creat d3/f14 x:0 0 0 2024-02-07T12:25:41.344 INFO:tasks.workunit.client.0.smithi047.stdout:7/180: symlink d0/df/d29/l3b 0 2024-02-07T12:25:41.344 INFO:tasks.workunit.client.0.smithi047.stdout:7/181: write d0/d4/f16 [481500,22351] 0 2024-02-07T12:25:41.346 INFO:tasks.workunit.client.0.smithi047.stdout:6/169: unlink d3/d5/l30 0 2024-02-07T12:25:41.346 INFO:tasks.workunit.client.0.smithi047.stdout:6/170: getdents d3/da/d14/d28 0 2024-02-07T12:25:41.347 INFO:tasks.workunit.client.0.smithi047.stdout:9/49: rename d3/c8 to d3/cc 0 2024-02-07T12:25:41.347 INFO:tasks.workunit.client.0.smithi047.stdout:9/50: creat d3/fd x:0 0 0 2024-02-07T12:25:41.347 INFO:tasks.workunit.client.1.smithi138.stdout:4/974: dwrite d20/d34/d36/f63 [0,4194304] 0 2024-02-07T12:25:41.347 INFO:tasks.workunit.client.1.smithi138.stdout:4/975: truncate d20/d53/d71/d98/d117/fd3 988162 0 2024-02-07T12:25:41.348 INFO:tasks.workunit.client.0.smithi047.stdout:3/100: unlink d12/f1a 0 2024-02-07T12:25:41.349 INFO:tasks.workunit.client.0.smithi047.stdout:0/61: dwrite fa [0,4194304] 0 2024-02-07T12:25:41.349 INFO:tasks.workunit.client.0.smithi047.stdout:0/62: creat fe x:0 0 0 2024-02-07T12:25:41.350 INFO:tasks.workunit.client.0.smithi047.stdout:8/218: dwrite d3/d16/d2a/f2b [0,4194304] 0 2024-02-07T12:25:41.352 INFO:tasks.workunit.client.0.smithi047.stdout:2/131: rmdir d7 39 2024-02-07T12:25:41.352 INFO:tasks.workunit.client.0.smithi047.stdout:2/132: chown d7/dc/f10 2001 1 2024-02-07T12:25:41.352 INFO:tasks.workunit.client.0.smithi047.stdout:2/133: write d7/f13 [756638,36670] 0 2024-02-07T12:25:41.353 INFO:tasks.workunit.client.0.smithi047.stdout:7/182: mknod d0/df/d29/d31/c3c 0 2024-02-07T12:25:41.353 INFO:tasks.workunit.client.0.smithi047.stdout:7/183: fsync d0/d4/f17 0 2024-02-07T12:25:41.353 INFO:tasks.workunit.client.0.smithi047.stdout:7/184: fsync d0/d4/f20 0 2024-02-07T12:25:41.355 INFO:tasks.workunit.client.0.smithi047.stdout:6/171: unlink d3/d1e/f39 0 2024-02-07T12:25:41.357 INFO:tasks.workunit.client.0.smithi047.stdout:1/92: getdents d1 0 2024-02-07T12:25:41.357 INFO:tasks.workunit.client.0.smithi047.stdout:0/63: dread fc [0,4194304] 0 2024-02-07T12:25:41.360 INFO:tasks.workunit.client.0.smithi047.stdout:3/101: symlink d12/l20 0 2024-02-07T12:25:41.360 INFO:tasks.workunit.client.0.smithi047.stdout:3/102: dread - d12/f1f zero size 2024-02-07T12:25:41.361 INFO:tasks.workunit.client.0.smithi047.stdout:3/103: read fc [329036,114341] 0 2024-02-07T12:25:41.375 INFO:tasks.workunit.client.0.smithi047.stdout:1/93: mkdir d1/d13 0 2024-02-07T12:25:41.378 INFO:tasks.workunit.client.0.smithi047.stdout:9/51: rename d3/fd to d3/fe 0 2024-02-07T12:25:41.378 INFO:tasks.workunit.client.0.smithi047.stdout:9/52: write d3/fe [12400,110756] 0 2024-02-07T12:25:41.378 INFO:tasks.workunit.client.0.smithi047.stdout:9/53: fdatasync f1 0 2024-02-07T12:25:41.378 INFO:tasks.workunit.client.0.smithi047.stdout:9/54: read f1 [712628,18837] 0 2024-02-07T12:25:41.378 INFO:tasks.workunit.client.0.smithi047.stdout:7/185: dwrite d0/d4/fe [0,4194304] 0 2024-02-07T12:25:41.380 INFO:tasks.workunit.client.0.smithi047.stdout:3/104: mkdir d12/d19/d21 0 2024-02-07T12:25:41.381 INFO:tasks.workunit.client.0.smithi047.stdout:2/134: dread d7/f1e [0,4194304] 0 2024-02-07T12:25:41.381 INFO:tasks.workunit.client.0.smithi047.stdout:4/69: dwrite d3/fe [0,4194304] 0 2024-02-07T12:25:41.382 INFO:tasks.workunit.client.0.smithi047.stdout:8/219: getdents d3/d16/d30 0 2024-02-07T12:25:41.383 INFO:tasks.workunit.client.0.smithi047.stdout:8/220: stat d3/d4/l24 0 2024-02-07T12:25:41.383 INFO:tasks.workunit.client.0.smithi047.stdout:8/221: creat d3/d4/d1f/f46 x:0 0 0 2024-02-07T12:25:41.387 INFO:tasks.workunit.client.0.smithi047.stdout:2/135: write d7/f20 [1661987,66464] 0 2024-02-07T12:25:41.387 INFO:tasks.workunit.client.0.smithi047.stdout:1/94: chown d1/f6 5824576 1 2024-02-07T12:25:41.391 INFO:tasks.workunit.client.0.smithi047.stdout:0/64: dwrite fd [0,4194304] 0 2024-02-07T12:25:41.391 INFO:tasks.workunit.client.0.smithi047.stdout:6/172: dwrite d3/da/f22 [0,4194304] 0 2024-02-07T12:25:41.391 INFO:tasks.workunit.client.0.smithi047.stdout:6/173: creat d3/da/f3a x:0 0 0 2024-02-07T12:25:41.391 INFO:tasks.workunit.client.0.smithi047.stdout:9/55: symlink d3/lf 0 2024-02-07T12:25:41.393 INFO:tasks.workunit.client.0.smithi047.stdout:0/65: write f5 [4383070,125920] 0 2024-02-07T12:25:41.393 INFO:tasks.workunit.client.0.smithi047.stdout:0/66: stat fa 0 2024-02-07T12:25:41.394 INFO:tasks.workunit.client.0.smithi047.stdout:7/186: mknod d0/df/d29/c3d 0 2024-02-07T12:25:41.396 INFO:tasks.workunit.client.0.smithi047.stdout:4/70: readlink d3/l8 0 2024-02-07T12:25:41.401 INFO:tasks.workunit.client.0.smithi047.stdout:8/222: rename d3/d4/f12 to d3/d4/d1f/f47 0 2024-02-07T12:25:41.402 INFO:tasks.workunit.client.0.smithi047.stdout:3/105: dwrite d12/d19/f1d [0,4194304] 0 2024-02-07T12:25:41.402 INFO:tasks.workunit.client.0.smithi047.stdout:3/106: getdents d12/d19/d21 0 2024-02-07T12:25:41.403 INFO:tasks.workunit.client.0.smithi047.stdout:2/136: creat d7/dc/f2b x:0 0 0 2024-02-07T12:25:41.403 INFO:tasks.workunit.client.0.smithi047.stdout:1/95: chown d1/l3 1 1 2024-02-07T12:25:41.404 INFO:tasks.workunit.client.0.smithi047.stdout:1/96: fdatasync d1/f6 0 2024-02-07T12:25:41.413 INFO:tasks.workunit.client.0.smithi047.stdout:9/56: dwrite d3/fb [0,4194304] 0 2024-02-07T12:25:41.413 INFO:tasks.workunit.client.0.smithi047.stdout:6/174: dwrite d3/d5/f15 [0,4194304] 0 2024-02-07T12:25:41.414 INFO:tasks.workunit.client.0.smithi047.stdout:0/67: link c4 cf 0 2024-02-07T12:25:41.415 INFO:tasks.workunit.client.0.smithi047.stdout:7/187: mkdir d0/df/d29/d3e 0 2024-02-07T12:25:41.418 INFO:tasks.workunit.client.0.smithi047.stdout:8/223: truncate d3/d16/d30/f39 382714 0 2024-02-07T12:25:41.422 INFO:tasks.workunit.client.0.smithi047.stdout:3/107: truncate f2 4122928 0 2024-02-07T12:25:41.422 INFO:tasks.workunit.client.0.smithi047.stdout:3/108: chown d12/f18 4 1 2024-02-07T12:25:41.423 INFO:tasks.workunit.client.0.smithi047.stdout:2/137: creat d7/f2c x:0 0 0 2024-02-07T12:25:41.425 INFO:tasks.workunit.client.0.smithi047.stdout:1/97: truncate d1/f6 1445827 0 2024-02-07T12:25:41.429 INFO:tasks.workunit.client.0.smithi047.stdout:9/57: truncate f1 3716610 0 2024-02-07T12:25:41.430 INFO:tasks.workunit.client.1.smithi138.stdout:5/940: sync 2024-02-07T12:25:41.432 INFO:tasks.workunit.client.1.smithi138.stdout:5/941: creat da/d22/d99/dca/d11e/d4f/d2b/f13b x:0 0 0 2024-02-07T12:25:41.434 INFO:tasks.workunit.client.1.smithi138.stdout:5/942: stat da/d34/c118 0 2024-02-07T12:25:41.437 INFO:tasks.workunit.client.1.smithi138.stdout:5/943: rename da/d22/d99/dca/dd5/de2/f106 to da/d22/d99/dca/dd5/f13c 0 2024-02-07T12:25:41.438 INFO:tasks.workunit.client.0.smithi047.stdout:7/188: unlink d0/df/f1d 0 2024-02-07T12:25:41.438 INFO:tasks.workunit.client.0.smithi047.stdout:7/189: readlink d0/df/l30 0 2024-02-07T12:25:41.439 INFO:tasks.workunit.client.0.smithi047.stdout:3/109: symlink d12/d19/d21/l22 0 2024-02-07T12:25:41.441 INFO:tasks.workunit.client.0.smithi047.stdout:7/190: dread d0/f36 [0,4194304] 0 2024-02-07T12:25:41.441 INFO:tasks.workunit.client.0.smithi047.stdout:3/110: dread d12/f14 [0,4194304] 0 2024-02-07T12:25:41.441 INFO:tasks.workunit.client.0.smithi047.stdout:1/98: rmdir d1/d13 0 2024-02-07T12:25:41.443 INFO:tasks.workunit.client.0.smithi047.stdout:7/191: mknod d0/df/d29/d31/c3f 0 2024-02-07T12:25:41.445 INFO:tasks.workunit.client.0.smithi047.stdout:3/111: rename ce to d12/d19/c23 0 2024-02-07T12:25:41.448 INFO:tasks.workunit.client.0.smithi047.stdout:7/192: mkdir d0/df/d29/d31/d40 0 2024-02-07T12:25:41.450 INFO:tasks.workunit.client.0.smithi047.stdout:7/193: mknod d0/c41 0 2024-02-07T12:25:41.451 INFO:tasks.workunit.client.0.smithi047.stdout:7/194: read d0/df/d29/f2d [735844,84933] 0 2024-02-07T12:25:41.460 INFO:tasks.workunit.client.0.smithi047.stdout:6/175: dwrite d3/d5/f7 [0,4194304] 0 2024-02-07T12:25:41.465 INFO:tasks.workunit.client.0.smithi047.stdout:7/195: write d0/f2 [1383284,61514] 0 2024-02-07T12:25:41.465 INFO:tasks.workunit.client.0.smithi047.stdout:7/196: write d0/d4/f20 [1841100,54322] 0 2024-02-07T12:25:41.465 INFO:tasks.workunit.client.0.smithi047.stdout:7/197: truncate d0/df/d29/d31/f34 194275 0 2024-02-07T12:25:41.468 INFO:tasks.workunit.client.0.smithi047.stdout:1/99: unlink d1/f6 0 2024-02-07T12:25:41.471 INFO:tasks.workunit.client.0.smithi047.stdout:4/71: dwrite d3/f4 [0,4194304] 0 2024-02-07T12:25:41.472 INFO:tasks.workunit.client.0.smithi047.stdout:0/68: dwrite fa [0,4194304] 0 2024-02-07T12:25:41.472 INFO:tasks.workunit.client.0.smithi047.stdout:2/138: dwrite d7/f12 [0,4194304] 0 2024-02-07T12:25:41.472 INFO:tasks.workunit.client.0.smithi047.stdout:2/139: fdatasync d7/dc/f29 0 2024-02-07T12:25:41.472 INFO:tasks.workunit.client.0.smithi047.stdout:2/140: write d7/dc/f1a [182207,44713] 0 2024-02-07T12:25:41.476 INFO:tasks.workunit.client.0.smithi047.stdout:4/72: symlink d3/l15 0 2024-02-07T12:25:41.476 INFO:tasks.workunit.client.0.smithi047.stdout:4/73: stat d3/f14 0 2024-02-07T12:25:41.477 INFO:tasks.workunit.client.0.smithi047.stdout:6/176: write d3/d1e/f21 [76566,41056] 0 2024-02-07T12:25:41.477 INFO:tasks.workunit.client.0.smithi047.stdout:8/224: dwrite d3/d4/d1f/f46 [0,4194304] 0 2024-02-07T12:25:41.477 INFO:tasks.workunit.client.0.smithi047.stdout:0/69: write fc [1904804,37700] 0 2024-02-07T12:25:41.483 INFO:tasks.workunit.client.0.smithi047.stdout:2/141: dread f2 [0,4194304] 0 2024-02-07T12:25:41.485 INFO:tasks.workunit.client.0.smithi047.stdout:8/225: creat d3/d16/d30/d34/d3e/f48 x:0 0 0 2024-02-07T12:25:41.487 INFO:tasks.workunit.client.0.smithi047.stdout:7/198: dread d0/df/d29/f22 [0,4194304] 0 2024-02-07T12:25:41.487 INFO:tasks.workunit.client.0.smithi047.stdout:0/70: rename fe to f10 0 2024-02-07T12:25:41.490 INFO:tasks.workunit.client.0.smithi047.stdout:1/100: dwrite d1/f11 [0,4194304] 0 2024-02-07T12:25:41.491 INFO:tasks.workunit.client.0.smithi047.stdout:8/226: truncate d3/d16/d30/f39 139394 0 2024-02-07T12:25:41.491 INFO:tasks.workunit.client.0.smithi047.stdout:8/227: fsync d3/d4/f18 0 2024-02-07T12:25:41.493 INFO:tasks.workunit.client.0.smithi047.stdout:8/228: dread d3/d4/f7 [0,4194304] 0 2024-02-07T12:25:41.494 INFO:tasks.workunit.client.0.smithi047.stdout:8/229: fdatasync d3/d4/d1f/f2e 0 2024-02-07T12:25:41.494 INFO:tasks.workunit.client.0.smithi047.stdout:4/74: write d3/f6 [1961181,13930] 0 2024-02-07T12:25:41.495 INFO:tasks.workunit.client.0.smithi047.stdout:0/71: rename c2 to c11 0 2024-02-07T12:25:41.495 INFO:tasks.workunit.client.0.smithi047.stdout:0/72: write fc [2478099,29905] 0 2024-02-07T12:25:41.496 INFO:tasks.workunit.client.0.smithi047.stdout:3/112: rmdir d12/d19 39 2024-02-07T12:25:41.500 INFO:tasks.workunit.client.0.smithi047.stdout:7/199: mkdir d0/d42 0 2024-02-07T12:25:41.500 INFO:tasks.workunit.client.0.smithi047.stdout:7/200: write d0/df/d29/f23 [1263998,115098] 0 2024-02-07T12:25:41.500 INFO:tasks.workunit.client.0.smithi047.stdout:7/201: stat d0/df/d29/c3d 0 2024-02-07T12:25:41.503 INFO:tasks.workunit.client.0.smithi047.stdout:8/230: dread d3/d16/d2a/f2b [0,4194304] 0 2024-02-07T12:25:41.503 INFO:tasks.workunit.client.0.smithi047.stdout:0/73: mknod c12 0 2024-02-07T12:25:41.503 INFO:tasks.workunit.client.1.smithi138.stdout:9/945: sync 2024-02-07T12:25:41.506 INFO:tasks.workunit.client.0.smithi047.stdout:3/113: symlink d12/d19/d21/l24 0 2024-02-07T12:25:41.506 INFO:tasks.workunit.client.0.smithi047.stdout:3/114: creat d12/f25 x:0 0 0 2024-02-07T12:25:41.509 INFO:tasks.workunit.client.0.smithi047.stdout:7/202: write d0/df/f11 [4065241,122964] 0 2024-02-07T12:25:41.509 INFO:tasks.workunit.client.0.smithi047.stdout:1/101: symlink d1/l14 0 2024-02-07T12:25:41.515 INFO:tasks.workunit.client.0.smithi047.stdout:0/74: dread fc [0,4194304] 0 2024-02-07T12:25:41.519 INFO:tasks.workunit.client.0.smithi047.stdout:8/231: rename d3/d4/f31 to d3/d36/f49 0 2024-02-07T12:25:41.519 INFO:tasks.workunit.client.0.smithi047.stdout:8/232: chown d3/d16/d30/d34 43 1 2024-02-07T12:25:41.524 INFO:tasks.workunit.client.0.smithi047.stdout:7/203: unlink d0/df/d29/l1f 0 2024-02-07T12:25:41.524 INFO:tasks.workunit.client.0.smithi047.stdout:3/115: dwrite f11 [0,4194304] 0 2024-02-07T12:25:41.525 INFO:tasks.workunit.client.0.smithi047.stdout:3/116: fsync f9 0 2024-02-07T12:25:41.525 INFO:tasks.workunit.client.0.smithi047.stdout:4/75: dwrite d3/f6 [0,4194304] 0 2024-02-07T12:25:41.526 INFO:tasks.workunit.client.0.smithi047.stdout:6/177: truncate d3/d5/f7 6752687 0 2024-02-07T12:25:41.531 INFO:tasks.workunit.client.0.smithi047.stdout:2/142: truncate d7/dc/f1a 200056 0 2024-02-07T12:25:41.531 INFO:tasks.workunit.client.0.smithi047.stdout:2/143: chown d7/c15 2125 1 2024-02-07T12:25:41.533 INFO:tasks.workunit.client.0.smithi047.stdout:1/102: mkdir d1/d15 0 2024-02-07T12:25:41.534 INFO:tasks.workunit.client.0.smithi047.stdout:6/178: mkdir d3/da/d3b 0 2024-02-07T12:25:41.536 INFO:tasks.workunit.client.0.smithi047.stdout:2/144: mkdir d7/d2d 0 2024-02-07T12:25:41.538 INFO:tasks.workunit.client.0.smithi047.stdout:4/76: getdents d3 0 2024-02-07T12:25:41.539 INFO:tasks.workunit.client.0.smithi047.stdout:1/103: write d1/fe [4253305,83929] 0 2024-02-07T12:25:41.540 INFO:tasks.workunit.client.0.smithi047.stdout:3/117: getdents d12/d19/d21 0 2024-02-07T12:25:41.541 INFO:tasks.workunit.client.0.smithi047.stdout:4/77: mknod d3/c16 0 2024-02-07T12:25:41.541 INFO:tasks.workunit.client.0.smithi047.stdout:4/78: chown d3/f14 849124 1 2024-02-07T12:25:41.544 INFO:tasks.workunit.client.0.smithi047.stdout:0/75: truncate fc 121423 0 2024-02-07T12:25:41.544 INFO:tasks.workunit.client.0.smithi047.stdout:0/76: readlink l8 0 2024-02-07T12:25:41.546 INFO:tasks.workunit.client.0.smithi047.stdout:4/79: creat d3/f17 x:0 0 0 2024-02-07T12:25:41.546 INFO:tasks.workunit.client.0.smithi047.stdout:4/80: chown f1 7090 1 2024-02-07T12:25:41.548 INFO:tasks.workunit.client.0.smithi047.stdout:1/104: link d1/l14 d1/l16 0 2024-02-07T12:25:41.548 INFO:tasks.workunit.client.0.smithi047.stdout:1/105: read d1/fe [2388143,36295] 0 2024-02-07T12:25:41.553 INFO:tasks.workunit.client.0.smithi047.stdout:9/58: truncate f1 2202619 0 2024-02-07T12:25:41.553 INFO:tasks.workunit.client.0.smithi047.stdout:3/118: getdents d12 0 2024-02-07T12:25:41.555 INFO:tasks.workunit.client.0.smithi047.stdout:1/106: mknod d1/d15/c17 0 2024-02-07T12:25:41.555 INFO:tasks.workunit.client.0.smithi047.stdout:6/179: fsync d3/d5/f7 0 2024-02-07T12:25:41.557 INFO:tasks.workunit.client.0.smithi047.stdout:9/59: unlink d3/cc 0 2024-02-07T12:25:41.558 INFO:tasks.workunit.client.0.smithi047.stdout:3/119: creat d12/d19/f26 x:0 0 0 2024-02-07T12:25:41.559 INFO:tasks.workunit.client.0.smithi047.stdout:6/180: truncate d3/da/d14/f1c 401531 0 2024-02-07T12:25:41.560 INFO:tasks.workunit.client.0.smithi047.stdout:9/60: mkdir d3/d10 0 2024-02-07T12:25:41.560 INFO:tasks.workunit.client.0.smithi047.stdout:9/61: stat f1 0 2024-02-07T12:25:41.560 INFO:tasks.workunit.client.0.smithi047.stdout:9/62: chown d3/d10 3 1 2024-02-07T12:25:41.560 INFO:tasks.workunit.client.0.smithi047.stdout:9/63: readlink l0 0 2024-02-07T12:25:41.561 INFO:tasks.workunit.client.0.smithi047.stdout:3/120: mknod d12/d19/d21/c27 0 2024-02-07T12:25:41.561 INFO:tasks.workunit.client.0.smithi047.stdout:3/121: write d12/f13 [4758727,108743] 0 2024-02-07T12:25:41.561 INFO:tasks.workunit.client.0.smithi047.stdout:3/122: stat d12/d19/d21 0 2024-02-07T12:25:41.561 INFO:tasks.workunit.client.0.smithi047.stdout:8/233: dwrite d3/d4/fa [0,4194304] 0 2024-02-07T12:25:41.562 INFO:tasks.workunit.client.0.smithi047.stdout:6/181: mkdir d3/d5/d35/d3c 0 2024-02-07T12:25:41.562 INFO:tasks.workunit.client.0.smithi047.stdout:2/145: dwrite d7/f13 [0,4194304] 0 2024-02-07T12:25:41.562 INFO:tasks.workunit.client.1.smithi138.stdout:9/946: dwrite d0/d6/d8/d1d/d109/fc8 [0,4194304] 0 2024-02-07T12:25:41.562 INFO:tasks.workunit.client.1.smithi138.stdout:9/947: truncate d0/d6/f101 497549 0 2024-02-07T12:25:41.563 INFO:tasks.workunit.client.1.smithi138.stdout:9/948: truncate d0/d6/d8/d95/f96 1642737 0 2024-02-07T12:25:41.563 INFO:tasks.workunit.client.1.smithi138.stdout:9/949: truncate d0/d6/d8/d1d/dd/d1f/db7/db9/dc3/df3/f102 975899 0 2024-02-07T12:25:41.563 INFO:tasks.workunit.client.0.smithi047.stdout:2/146: creat d7/f2e x:0 0 0 2024-02-07T12:25:41.563 INFO:tasks.workunit.client.0.smithi047.stdout:2/147: readlink d7/dc/l1d 0 2024-02-07T12:25:41.563 INFO:tasks.workunit.client.0.smithi047.stdout:2/148: readlink d7/dc/l1b 0 2024-02-07T12:25:41.563 INFO:tasks.workunit.client.0.smithi047.stdout:2/149: chown d7/d2d 467 1 2024-02-07T12:25:41.563 INFO:tasks.workunit.client.0.smithi047.stdout:7/204: dwrite d0/d4/f33 [0,4194304] 0 2024-02-07T12:25:41.563 INFO:tasks.workunit.client.0.smithi047.stdout:2/150: read d7/dc/f10 [431241,94405] 0 2024-02-07T12:25:41.564 INFO:tasks.workunit.client.0.smithi047.stdout:7/205: dread d0/d4/f1e [0,4194304] 0 2024-02-07T12:25:41.565 INFO:tasks.workunit.client.1.smithi138.stdout:9/950: mknod d0/d6/d8/d1d/dd/d41/d5e/c124 0 2024-02-07T12:25:41.565 INFO:tasks.workunit.client.1.smithi138.stdout:4/976: sync 2024-02-07T12:25:41.566 INFO:tasks.workunit.client.0.smithi047.stdout:3/123: link f2 d12/d19/f28 0 2024-02-07T12:25:41.567 INFO:tasks.workunit.client.1.smithi138.stdout:4/977: mknod d20/d53/dd1/c145 0 2024-02-07T12:25:41.570 INFO:tasks.workunit.client.0.smithi047.stdout:8/234: rename d3/d16/d30/f39 to d3/f4a 0 2024-02-07T12:25:41.570 INFO:tasks.workunit.client.0.smithi047.stdout:1/107: read d1/f11 [384930,44084] 0 2024-02-07T12:25:41.570 INFO:tasks.workunit.client.0.smithi047.stdout:2/151: write d7/f12 [3185453,111163] 0 2024-02-07T12:25:41.571 INFO:tasks.workunit.client.0.smithi047.stdout:6/182: creat d3/d5/d35/f3d x:0 0 0 2024-02-07T12:25:41.572 INFO:tasks.workunit.client.1.smithi138.stdout:4/978: creat d20/d47/d69/def/d13d/f146 x:0 0 0 2024-02-07T12:25:41.572 INFO:tasks.workunit.client.1.smithi138.stdout:4/979: write d20/d53/d71/d98/d117/fd3 [1327433,47795] 0 2024-02-07T12:25:41.572 INFO:tasks.workunit.client.1.smithi138.stdout:4/980: creat d20/d47/d69/d7c/dfe/d114/df5/f147 x:0 0 0 2024-02-07T12:25:41.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:41 smithi047 ceph-mon[28972]: pgmap v7: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 192 MiB/s rd, 199 MiB/s wr, 318 op/s 2024-02-07T12:25:41.576 INFO:tasks.workunit.client.0.smithi047.stdout:0/77: truncate fc 853704 0 2024-02-07T12:25:41.576 INFO:tasks.workunit.client.0.smithi047.stdout:0/78: fsync f1 0 2024-02-07T12:25:41.576 INFO:tasks.workunit.client.0.smithi047.stdout:0/79: creat f13 x:0 0 0 2024-02-07T12:25:41.576 INFO:tasks.workunit.client.0.smithi047.stdout:0/80: chown l8 6 1 2024-02-07T12:25:41.576 INFO:tasks.workunit.client.1.smithi138.stdout:4/981: link d20/d53/d71/d75/d94/lff d20/d53/d71/d75/d94/l148 0 2024-02-07T12:25:41.577 INFO:tasks.workunit.client.1.smithi138.stdout:4/982: getdents d20/d53/d71 0 2024-02-07T12:25:41.578 INFO:tasks.workunit.client.0.smithi047.stdout:4/81: getdents d3 0 2024-02-07T12:25:41.579 INFO:tasks.workunit.client.0.smithi047.stdout:4/82: chown d3/c10 10567521 1 2024-02-07T12:25:41.579 INFO:tasks.workunit.client.1.smithi138.stdout:4/983: mkdir d20/d149 0 2024-02-07T12:25:41.580 INFO:tasks.workunit.client.1.smithi138.stdout:4/984: mkdir d20/d47/d69/d7c/dfe/d114/df5/d14a 0 2024-02-07T12:25:41.581 INFO:tasks.workunit.client.0.smithi047.stdout:9/64: write f1 [167883,30341] 0 2024-02-07T12:25:41.581 INFO:tasks.workunit.client.1.smithi138.stdout:9/951: dwrite d0/d6/d8/d1d/dd/d1f/db7/f90 [0,4194304] 0 2024-02-07T12:25:41.582 INFO:tasks.workunit.client.0.smithi047.stdout:7/206: creat d0/df/d29/d3e/f43 x:0 0 0 2024-02-07T12:25:41.582 INFO:tasks.workunit.client.0.smithi047.stdout:7/207: creat d0/df/d29/d3e/f44 x:0 0 0 2024-02-07T12:25:41.582 INFO:tasks.workunit.client.0.smithi047.stdout:7/208: chown d0/df/c10 22439811 1 2024-02-07T12:25:41.583 INFO:tasks.workunit.client.0.smithi047.stdout:5/190: sync 2024-02-07T12:25:41.584 INFO:tasks.workunit.client.0.smithi047.stdout:3/124: mkdir d12/d19/d21/d29 0 2024-02-07T12:25:41.585 INFO:tasks.workunit.client.0.smithi047.stdout:8/235: rmdir d3/d16/d2a 39 2024-02-07T12:25:41.588 INFO:tasks.workunit.client.0.smithi047.stdout:2/152: creat d7/d2d/f2f x:0 0 0 2024-02-07T12:25:41.589 INFO:tasks.workunit.client.0.smithi047.stdout:2/153: stat d7/f23 0 2024-02-07T12:25:41.589 INFO:tasks.workunit.client.0.smithi047.stdout:2/154: creat d7/f30 x:0 0 0 2024-02-07T12:25:41.589 INFO:tasks.workunit.client.0.smithi047.stdout:2/155: fdatasync d7/dc/f2b 0 2024-02-07T12:25:41.590 INFO:tasks.workunit.client.1.smithi138.stdout:9/952: dread d0/d6/d8/d1d/dd/d41/f76 [0,4194304] 0 2024-02-07T12:25:41.590 INFO:tasks.workunit.client.1.smithi138.stdout:9/953: chown d0/d6/d8/d1d/dd/d1f/dbb/ld2 2675 1 2024-02-07T12:25:41.591 INFO:tasks.workunit.client.0.smithi047.stdout:6/183: creat d3/da/d14/d28/f3e x:0 0 0 2024-02-07T12:25:41.593 INFO:tasks.workunit.client.1.smithi138.stdout:9/954: unlink d0/d6/da3/dcc/fda 0 2024-02-07T12:25:41.594 INFO:tasks.workunit.client.1.smithi138.stdout:9/955: fdatasync d0/d6/d8/d1d/dd/d41/d5e/da6/fc9 0 2024-02-07T12:25:41.594 INFO:tasks.workunit.client.0.smithi047.stdout:4/83: symlink d3/l18 0 2024-02-07T12:25:41.595 INFO:tasks.workunit.client.0.smithi047.stdout:9/65: mkdir d3/d10/d11 0 2024-02-07T12:25:41.598 INFO:tasks.workunit.client.0.smithi047.stdout:7/209: creat d0/d42/f45 x:0 0 0 2024-02-07T12:25:41.598 INFO:tasks.workunit.client.0.smithi047.stdout:7/210: creat d0/df/d29/d3e/f46 x:0 0 0 2024-02-07T12:25:41.598 INFO:tasks.workunit.client.0.smithi047.stdout:7/211: stat d0/d4/f5 0 2024-02-07T12:25:41.598 INFO:tasks.workunit.client.0.smithi047.stdout:7/212: fdatasync d0/d4/f16 0 2024-02-07T12:25:41.599 INFO:tasks.workunit.client.1.smithi138.stdout:4/985: dread d20/d34/d59/d88/f91 [0,4194304] 0 2024-02-07T12:25:41.600 INFO:tasks.workunit.client.0.smithi047.stdout:5/191: creat da/d24/d2b/f3a x:0 0 0 2024-02-07T12:25:41.600 INFO:tasks.workunit.client.0.smithi047.stdout:5/192: chown da/df/l21 125 1 2024-02-07T12:25:41.600 INFO:tasks.workunit.client.0.smithi047.stdout:5/193: read da/f1e [740216,124501] 0 2024-02-07T12:25:41.600 INFO:tasks.workunit.client.0.smithi047.stdout:5/194: truncate da/df/d16/d25/d33/f35 844438 0 2024-02-07T12:25:41.600 INFO:tasks.workunit.client.0.smithi047.stdout:5/195: write da/df/f28 [378580,19822] 0 2024-02-07T12:25:41.600 INFO:tasks.workunit.client.0.smithi047.stdout:5/196: stat da/fb 0 2024-02-07T12:25:41.600 INFO:tasks.workunit.client.0.smithi047.stdout:5/197: chown da/d24/c37 22789 1 2024-02-07T12:25:41.601 INFO:tasks.workunit.client.0.smithi047.stdout:0/81: dwrite f5 [0,4194304] 0 2024-02-07T12:25:41.601 INFO:tasks.workunit.client.0.smithi047.stdout:0/82: fdatasync fa 0 2024-02-07T12:25:41.601 INFO:tasks.workunit.client.0.smithi047.stdout:0/83: write f10 [65777,122312] 0 2024-02-07T12:25:41.601 INFO:tasks.workunit.client.0.smithi047.stdout:3/125: mknod d12/d19/d21/d29/c2a 0 2024-02-07T12:25:41.604 INFO:tasks.workunit.client.0.smithi047.stdout:2/156: link d7/f20 d7/dc/f31 0 2024-02-07T12:25:41.604 INFO:tasks.workunit.client.0.smithi047.stdout:6/184: mkdir d3/da/d14/d3f 0 2024-02-07T12:25:41.608 INFO:tasks.workunit.client.0.smithi047.stdout:1/108: write d1/f5 [4033220,107406] 0 2024-02-07T12:25:41.608 INFO:tasks.workunit.client.0.smithi047.stdout:9/66: creat d3/d10/d11/f12 x:0 0 0 2024-02-07T12:25:41.608 INFO:tasks.workunit.client.0.smithi047.stdout:9/67: chown d3/f9 1377961 1 2024-02-07T12:25:41.608 INFO:tasks.workunit.client.0.smithi047.stdout:9/68: chown d3 299118 1 2024-02-07T12:25:41.608 INFO:tasks.workunit.client.0.smithi047.stdout:8/236: dwrite d3/d4/f25 [0,4194304] 0 2024-02-07T12:25:41.609 INFO:tasks.workunit.client.0.smithi047.stdout:8/237: creat d3/d36/f4b x:0 0 0 2024-02-07T12:25:41.609 INFO:tasks.workunit.client.0.smithi047.stdout:8/238: fsync d3/d16/f2d 0 2024-02-07T12:25:41.613 INFO:tasks.workunit.client.0.smithi047.stdout:2/157: read d7/dc/f29 [1310314,12518] 0 2024-02-07T12:25:41.613 INFO:tasks.workunit.client.0.smithi047.stdout:2/158: chown d7 37080 1 2024-02-07T12:25:41.613 INFO:tasks.workunit.client.0.smithi047.stdout:2/159: dread - d7/f23 zero size 2024-02-07T12:25:41.613 INFO:tasks.workunit.client.0.smithi047.stdout:2/160: dread - d7/f30 zero size 2024-02-07T12:25:41.613 INFO:tasks.workunit.client.0.smithi047.stdout:2/161: readlink d7/dc/l1b 0 2024-02-07T12:25:41.615 INFO:tasks.workunit.client.0.smithi047.stdout:7/213: creat d0/f47 x:0 0 0 2024-02-07T12:25:41.615 INFO:tasks.workunit.client.0.smithi047.stdout:5/198: creat da/df/d16/d25/f3b x:0 0 0 2024-02-07T12:25:41.615 INFO:tasks.workunit.client.0.smithi047.stdout:5/199: fdatasync da/d24/f2f 0 2024-02-07T12:25:41.615 INFO:tasks.workunit.client.0.smithi047.stdout:5/200: read da/fb [471535,24177] 0 2024-02-07T12:25:41.615 INFO:tasks.workunit.client.0.smithi047.stdout:5/201: readlink da/l14 0 2024-02-07T12:25:41.615 INFO:tasks.workunit.client.0.smithi047.stdout:3/126: truncate d12/f13 2985825 0 2024-02-07T12:25:41.615 INFO:tasks.workunit.client.0.smithi047.stdout:3/127: write f9 [2313461,100942] 0 2024-02-07T12:25:41.616 INFO:tasks.workunit.client.0.smithi047.stdout:6/185: symlink d3/da/d2c/l40 0 2024-02-07T12:25:41.617 INFO:tasks.workunit.client.1.smithi138.stdout:9/956: dwrite d0/d6/f3c [4194304,4194304] 0 2024-02-07T12:25:41.618 INFO:tasks.workunit.client.0.smithi047.stdout:4/84: symlink d3/l19 0 2024-02-07T12:25:41.622 INFO:tasks.workunit.client.0.smithi047.stdout:1/109: mkdir d1/d15/d18 0 2024-02-07T12:25:41.623 INFO:tasks.workunit.client.1.smithi138.stdout:9/957: unlink d0/d6/d8/d1d/dd/d1f/db7/c9a 0 2024-02-07T12:25:41.623 INFO:tasks.workunit.client.1.smithi138.stdout:9/958: creat d0/f125 x:0 0 0 2024-02-07T12:25:41.626 INFO:tasks.workunit.client.0.smithi047.stdout:9/69: mknod d3/d10/c13 0 2024-02-07T12:25:41.626 INFO:tasks.workunit.client.0.smithi047.stdout:9/70: creat d3/f14 x:0 0 0 2024-02-07T12:25:41.626 INFO:tasks.workunit.client.0.smithi047.stdout:9/71: chown d3 388874 1 2024-02-07T12:25:41.627 INFO:tasks.workunit.client.1.smithi138.stdout:9/959: rmdir d0/d6/d8/d1d/dd/d41/d5e/de7/dd8/d111 39 2024-02-07T12:25:41.629 INFO:tasks.workunit.client.0.smithi047.stdout:8/239: unlink d3/d16/c2f 0 2024-02-07T12:25:41.629 INFO:tasks.workunit.client.0.smithi047.stdout:8/240: truncate d3/f4a 526948 0 2024-02-07T12:25:41.630 INFO:tasks.workunit.client.0.smithi047.stdout:7/214: symlink d0/d42/l48 0 2024-02-07T12:25:41.633 INFO:tasks.workunit.client.0.smithi047.stdout:5/202: rename da/f1e to da/df/d16/d25/d33/f3c 0 2024-02-07T12:25:41.633 INFO:tasks.workunit.client.0.smithi047.stdout:5/203: write da/df/d16/d25/f2a [925359,789] 0 2024-02-07T12:25:41.633 INFO:tasks.workunit.client.0.smithi047.stdout:8/241: write d3/d16/d2a/f32 [572218,112510] 0 2024-02-07T12:25:41.633 INFO:tasks.workunit.client.0.smithi047.stdout:2/162: dwrite d7/f28 [0,4194304] 0 2024-02-07T12:25:41.634 INFO:tasks.workunit.client.0.smithi047.stdout:6/186: creat d3/da/d34/f41 x:0 0 0 2024-02-07T12:25:41.634 INFO:tasks.workunit.client.0.smithi047.stdout:6/187: chown d3/da/d14/d3f 23920513 1 2024-02-07T12:25:41.637 INFO:tasks.workunit.client.0.smithi047.stdout:4/85: creat d3/f1a x:0 0 0 2024-02-07T12:25:41.637 INFO:tasks.workunit.client.0.smithi047.stdout:4/86: fsync f2 0 2024-02-07T12:25:41.638 INFO:tasks.workunit.client.0.smithi047.stdout:1/110: chown d1/l12 71522 1 2024-02-07T12:25:41.638 INFO:tasks.workunit.client.0.smithi047.stdout:1/111: chown d1 27124435 1 2024-02-07T12:25:41.641 INFO:tasks.workunit.client.0.smithi047.stdout:7/215: creat d0/df/d29/d31/d40/f49 x:0 0 0 2024-02-07T12:25:41.644 INFO:tasks.workunit.client.0.smithi047.stdout:9/72: rename d3/c7 to d3/d10/c15 0 2024-02-07T12:25:41.644 INFO:tasks.workunit.client.0.smithi047.stdout:9/73: chown d3/d10 10154 1 2024-02-07T12:25:41.644 INFO:tasks.workunit.client.0.smithi047.stdout:9/74: write d3/f9 [632306,22568] 0 2024-02-07T12:25:41.646 INFO:tasks.workunit.client.0.smithi047.stdout:8/242: truncate d3/d4/f7 393681 0 2024-02-07T12:25:41.646 INFO:tasks.workunit.client.0.smithi047.stdout:8/243: fdatasync d3/d4/d1f/f46 0 2024-02-07T12:25:41.647 INFO:tasks.workunit.client.1.smithi138.stdout:5/944: sync 2024-02-07T12:25:41.647 INFO:tasks.workunit.client.1.smithi138.stdout:5/945: fdatasync da/d6d/f4e 0 2024-02-07T12:25:41.647 INFO:tasks.workunit.client.1.smithi138.stdout:5/946: fsync da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/f8b 0 2024-02-07T12:25:41.648 INFO:tasks.workunit.client.0.smithi047.stdout:3/128: dwrite d12/d19/f26 [0,4194304] 0 2024-02-07T12:25:41.648 INFO:tasks.workunit.client.0.smithi047.stdout:3/129: write d12/f25 [786804,128680] 0 2024-02-07T12:25:41.648 INFO:tasks.workunit.client.0.smithi047.stdout:2/163: symlink d7/l32 0 2024-02-07T12:25:41.648 INFO:tasks.workunit.client.0.smithi047.stdout:2/164: creat d7/dc/f33 x:0 0 0 2024-02-07T12:25:41.648 INFO:tasks.workunit.client.0.smithi047.stdout:2/165: read - d7/f30 zero size 2024-02-07T12:25:41.649 INFO:tasks.workunit.client.1.smithi138.stdout:5/947: mknod da/d22/d99/dca/d11e/d4f/d2b/d35/d67/c13d 0 2024-02-07T12:25:41.649 INFO:tasks.workunit.client.0.smithi047.stdout:1/112: mkdir d1/d15/d18/d19 0 2024-02-07T12:25:41.651 INFO:tasks.workunit.client.0.smithi047.stdout:7/216: symlink d0/d4/l4a 0 2024-02-07T12:25:41.651 INFO:tasks.workunit.client.0.smithi047.stdout:0/84: dwrite fc [0,4194304] 0 2024-02-07T12:25:41.651 INFO:tasks.workunit.client.0.smithi047.stdout:0/85: chown c6 16595600 1 2024-02-07T12:25:41.651 INFO:tasks.workunit.client.0.smithi047.stdout:0/86: stat fd 0 2024-02-07T12:25:41.652 INFO:tasks.workunit.client.0.smithi047.stdout:0/87: fdatasync fc 0 2024-02-07T12:25:41.652 INFO:tasks.workunit.client.0.smithi047.stdout:7/217: write d0/d42/f45 [350284,120225] 0 2024-02-07T12:25:41.654 INFO:tasks.workunit.client.0.smithi047.stdout:5/204: rename da/f1c to da/df/d16/f3d 0 2024-02-07T12:25:41.655 INFO:tasks.workunit.client.0.smithi047.stdout:8/244: read d3/f9 [47899,18919] 0 2024-02-07T12:25:41.655 INFO:tasks.workunit.client.0.smithi047.stdout:8/245: fsync d3/d4/d1f/f46 0 2024-02-07T12:25:41.658 INFO:tasks.workunit.client.0.smithi047.stdout:9/75: rename d3/l6 to d3/l16 0 2024-02-07T12:25:41.659 INFO:tasks.workunit.client.1.smithi138.stdout:5/948: dread da/f29 [8388608,4194304] 0 2024-02-07T12:25:41.659 INFO:tasks.workunit.client.0.smithi047.stdout:5/205: dread da/d24/f2f [0,4194304] 0 2024-02-07T12:25:41.661 INFO:tasks.workunit.client.0.smithi047.stdout:0/88: dread f1 [0,4194304] 0 2024-02-07T12:25:41.661 INFO:tasks.workunit.client.1.smithi138.stdout:5/949: rename da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/fbf to da/d22/d99/dca/d11e/d4f/d2b/d35/d67/dd1/dff/d10a/f13e 0 2024-02-07T12:25:41.663 INFO:tasks.workunit.client.1.smithi138.stdout:5/950: rmdir da/d22/d99/dca/d11e/d4f/d2b/d35/d67/dd1/dff/d10a 39 2024-02-07T12:25:41.665 INFO:tasks.workunit.client.1.smithi138.stdout:5/951: rename da/d43/d4a/d69/f7a to da/d22/d99/dca/d11e/d4f/da3/f13f 0 2024-02-07T12:25:41.665 INFO:tasks.workunit.client.0.smithi047.stdout:3/130: mkdir d12/d19/d21/d29/d2b 0 2024-02-07T12:25:41.666 INFO:tasks.workunit.client.0.smithi047.stdout:3/131: fsync d12/f18 0 2024-02-07T12:25:41.666 INFO:tasks.workunit.client.0.smithi047.stdout:3/132: fsync d12/d19/f1e 0 2024-02-07T12:25:41.666 INFO:tasks.workunit.client.0.smithi047.stdout:3/133: write f2 [4456003,20511] 0 2024-02-07T12:25:41.668 INFO:tasks.workunit.client.0.smithi047.stdout:2/166: symlink d7/d2d/l34 0 2024-02-07T12:25:41.671 INFO:tasks.workunit.client.1.smithi138.stdout:9/960: dwrite d0/d6/d8/d1d/dd/f9c [0,4194304] 0 2024-02-07T12:25:41.671 INFO:tasks.workunit.client.0.smithi047.stdout:6/188: dwrite d3/d5/f27 [0,4194304] 0 2024-02-07T12:25:41.673 INFO:tasks.workunit.client.1.smithi138.stdout:9/961: dread d0/f38 [0,4194304] 0 2024-02-07T12:25:41.673 INFO:tasks.workunit.client.0.smithi047.stdout:9/76: rename d3/lf to d3/d10/l17 0 2024-02-07T12:25:41.673 INFO:tasks.workunit.client.0.smithi047.stdout:5/206: rename da/d24/d2b to da/d24/d2b/d3e 22 2024-02-07T12:25:41.674 INFO:tasks.workunit.client.0.smithi047.stdout:9/77: truncate f2 1097641 0 2024-02-07T12:25:41.675 INFO:tasks.workunit.client.0.smithi047.stdout:0/89: unlink c12 0 2024-02-07T12:25:41.678 INFO:tasks.workunit.client.1.smithi138.stdout:5/952: dread da/d43/d4a/f9d [0,4194304] 0 2024-02-07T12:25:41.679 INFO:tasks.workunit.client.0.smithi047.stdout:3/134: creat d12/d19/d21/f2c x:0 0 0 2024-02-07T12:25:41.687 INFO:tasks.workunit.client.0.smithi047.stdout:4/87: link d3/ff d3/f1b 0 2024-02-07T12:25:41.692 INFO:tasks.workunit.client.1.smithi138.stdout:5/953: dread da/d6d/f7c [0,4194304] 0 2024-02-07T12:25:41.693 INFO:tasks.workunit.client.1.smithi138.stdout:5/954: stat da/d34/c12f 0 2024-02-07T12:25:41.694 INFO:tasks.workunit.client.1.smithi138.stdout:5/955: truncate da/d22/f26 3089627 0 2024-02-07T12:25:41.694 INFO:tasks.workunit.client.1.smithi138.stdout:5/956: write da/d6d/f4e [4904879,15575] 0 2024-02-07T12:25:41.694 INFO:tasks.workunit.client.0.smithi047.stdout:2/167: dwrite d7/dc/f2b [0,4194304] 0 2024-02-07T12:25:41.694 INFO:tasks.workunit.client.0.smithi047.stdout:2/168: write d7/dc/f33 [346662,61074] 0 2024-02-07T12:25:41.694 INFO:tasks.workunit.client.0.smithi047.stdout:2/169: chown d7/fb 8296917 1 2024-02-07T12:25:41.704 INFO:tasks.workunit.client.0.smithi047.stdout:5/207: rename da/l14 to da/df/d16/l3f 0 2024-02-07T12:25:41.705 INFO:tasks.workunit.client.0.smithi047.stdout:9/78: mkdir d3/d10/d18 0 2024-02-07T12:25:41.707 INFO:tasks.workunit.client.0.smithi047.stdout:3/135: rmdir d12/d19/d21/d29/d2b 0 2024-02-07T12:25:41.712 INFO:tasks.workunit.client.0.smithi047.stdout:3/136: dread fc [0,4194304] 0 2024-02-07T12:25:41.713 INFO:tasks.workunit.client.0.smithi047.stdout:5/208: symlink da/d24/d2b/l40 0 2024-02-07T12:25:41.714 INFO:tasks.workunit.client.0.smithi047.stdout:9/79: rename d3/f14 to d3/f19 0 2024-02-07T12:25:41.716 INFO:tasks.workunit.client.0.smithi047.stdout:4/88: symlink d3/l1c 0 2024-02-07T12:25:41.718 INFO:tasks.workunit.client.0.smithi047.stdout:3/137: unlink d12/f1c 0 2024-02-07T12:25:41.719 INFO:tasks.workunit.client.0.smithi047.stdout:5/209: write da/f1a [3852080,106086] 0 2024-02-07T12:25:41.721 INFO:tasks.workunit.client.0.smithi047.stdout:9/80: rename d3/d10/d11/f12 to d3/d10/d18/f1a 0 2024-02-07T12:25:41.721 INFO:tasks.workunit.client.0.smithi047.stdout:9/81: fsync d3/fe 0 2024-02-07T12:25:41.721 INFO:tasks.workunit.client.0.smithi047.stdout:9/82: readlink d3/l16 0 2024-02-07T12:25:41.723 INFO:tasks.workunit.client.0.smithi047.stdout:4/89: dread - d3/fb zero size 2024-02-07T12:25:41.726 INFO:tasks.workunit.client.0.smithi047.stdout:9/83: creat d3/d10/d18/f1b x:0 0 0 2024-02-07T12:25:41.726 INFO:tasks.workunit.client.1.smithi138.stdout:9/962: dwrite d0/d6/da3/dcc/dd1/fd3 [0,4194304] 0 2024-02-07T12:25:41.726 INFO:tasks.workunit.client.1.smithi138.stdout:9/963: write d0/d6/d8/d1d/d109/f11d [159576,81516] 0 2024-02-07T12:25:41.727 INFO:tasks.workunit.client.0.smithi047.stdout:0/90: dwrite fd [0,4194304] 0 2024-02-07T12:25:41.727 INFO:tasks.workunit.client.0.smithi047.stdout:0/91: fdatasync fa 0 2024-02-07T12:25:41.727 INFO:tasks.workunit.client.1.smithi138.stdout:5/957: dwrite da/d50/f113 [0,4194304] 0 2024-02-07T12:25:41.728 INFO:tasks.workunit.client.0.smithi047.stdout:7/218: dwrite d0/f2 [0,4194304] 0 2024-02-07T12:25:41.728 INFO:tasks.workunit.client.0.smithi047.stdout:5/210: dread da/f11 [0,4194304] 0 2024-02-07T12:25:41.728 INFO:tasks.workunit.client.0.smithi047.stdout:2/170: dwrite d7/f12 [0,4194304] 0 2024-02-07T12:25:41.728 INFO:tasks.workunit.client.0.smithi047.stdout:2/171: stat d7/l32 0 2024-02-07T12:25:41.728 INFO:tasks.workunit.client.0.smithi047.stdout:7/219: creat d0/d42/f4b x:0 0 0 2024-02-07T12:25:41.728 INFO:tasks.workunit.client.0.smithi047.stdout:3/138: dread f11 [0,4194304] 0 2024-02-07T12:25:41.729 INFO:tasks.workunit.client.0.smithi047.stdout:9/84: dread d3/f9 [0,4194304] 0 2024-02-07T12:25:41.729 INFO:tasks.workunit.client.0.smithi047.stdout:9/85: readlink d3/l5 0 2024-02-07T12:25:41.729 INFO:tasks.workunit.client.0.smithi047.stdout:9/86: fdatasync f2 0 2024-02-07T12:25:41.729 INFO:tasks.workunit.client.0.smithi047.stdout:9/87: fdatasync d3/fb 0 2024-02-07T12:25:41.732 INFO:tasks.workunit.client.1.smithi138.stdout:9/964: mknod d0/c126 0 2024-02-07T12:25:41.732 INFO:tasks.workunit.client.0.smithi047.stdout:5/211: mkdir da/df/d16/d41 0 2024-02-07T12:25:41.733 INFO:tasks.workunit.client.1.smithi138.stdout:5/958: creat da/d22/d99/dca/d11e/d4f/d2b/d35/d5d/d73/d11c/f140 x:0 0 0 2024-02-07T12:25:41.734 INFO:tasks.workunit.client.0.smithi047.stdout:3/139: mkdir d12/d19/d2d 0 2024-02-07T12:25:41.734 INFO:tasks.workunit.client.1.smithi138.stdout:9/965: symlink d0/d6/d8/d1d/dd/d1f/dbb/l127 0 2024-02-07T12:25:41.735 INFO:tasks.workunit.client.1.smithi138.stdout:9/966: readlink d0/d6/d8/d1d/dd/d1f/l21 0 2024-02-07T12:25:41.740 INFO:tasks.workunit.client.1.smithi138.stdout:5/959: dread da/d22/d99/dca/d11e/d4f/d2b/d35/d5d/d73/fad [0,4194304] 0 2024-02-07T12:25:41.740 INFO:tasks.workunit.client.0.smithi047.stdout:4/90: rename d3/c13 to d3/c1d 0 2024-02-07T12:25:41.741 INFO:tasks.workunit.client.0.smithi047.stdout:9/88: write d3/fb [407090,50069] 0 2024-02-07T12:25:41.742 INFO:tasks.workunit.client.1.smithi138.stdout:4/986: sync 2024-02-07T12:25:41.743 INFO:tasks.workunit.client.1.smithi138.stdout:5/960: mkdir da/d43/d141 0 2024-02-07T12:25:41.744 INFO:tasks.workunit.client.0.smithi047.stdout:5/212: creat da/df/d16/d41/f42 x:0 0 0 2024-02-07T12:25:41.744 INFO:tasks.workunit.client.0.smithi047.stdout:5/213: write da/df/d16/d25/f3b [112497,115278] 0 2024-02-07T12:25:41.744 INFO:tasks.workunit.client.0.smithi047.stdout:7/220: write d0/df/d29/f22 [3530510,51372] 0 2024-02-07T12:25:41.745 INFO:tasks.workunit.client.0.smithi047.stdout:4/91: fsync d3/f12 0 2024-02-07T12:25:41.746 INFO:tasks.workunit.client.1.smithi138.stdout:4/987: mkdir d20/d47/d69/d14b 0 2024-02-07T12:25:41.747 INFO:tasks.workunit.client.0.smithi047.stdout:0/92: read f5 [3414570,85738] 0 2024-02-07T12:25:41.748 INFO:tasks.workunit.client.0.smithi047.stdout:5/214: creat da/d24/d2b/d2e/f43 x:0 0 0 2024-02-07T12:25:41.749 INFO:tasks.workunit.client.0.smithi047.stdout:1/113: truncate d1/fe 2240816 0 2024-02-07T12:25:41.749 INFO:tasks.workunit.client.1.smithi138.stdout:5/961: creat da/d22/d99/dca/dd5/de2/f142 x:0 0 0 2024-02-07T12:25:41.749 INFO:tasks.workunit.client.1.smithi138.stdout:5/962: chown da/d22/d99/dca/d11e/fe1 10737 1 2024-02-07T12:25:41.751 INFO:tasks.workunit.client.0.smithi047.stdout:4/92: stat d3/c16 0 2024-02-07T12:25:41.753 INFO:tasks.workunit.client.1.smithi138.stdout:5/963: mkdir da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/d91/d143 0 2024-02-07T12:25:41.754 INFO:tasks.workunit.client.1.smithi138.stdout:5/964: chown da/d22/d99/dca/d11e/d4f/d2b/d35/d67/df0/ff2 239 1 2024-02-07T12:25:41.754 INFO:tasks.workunit.client.1.smithi138.stdout:9/967: dread d0/d6/d8/d1d/dd/d1f/f6a [0,4194304] 0 2024-02-07T12:25:41.754 INFO:tasks.workunit.client.1.smithi138.stdout:9/968: readlink d0/lb5 0 2024-02-07T12:25:41.754 INFO:tasks.workunit.client.0.smithi047.stdout:5/215: mkdir da/df/d16/d41/d44 0 2024-02-07T12:25:41.754 INFO:tasks.workunit.client.0.smithi047.stdout:5/216: creat da/d24/f45 x:0 0 0 2024-02-07T12:25:41.754 INFO:tasks.workunit.client.0.smithi047.stdout:5/217: creat da/df/d16/d41/f46 x:0 0 0 2024-02-07T12:25:41.754 INFO:tasks.workunit.client.0.smithi047.stdout:5/218: creat da/df/d16/d41/f47 x:0 0 0 2024-02-07T12:25:41.754 INFO:tasks.workunit.client.0.smithi047.stdout:5/219: dread - da/f39 zero size 2024-02-07T12:25:41.755 INFO:tasks.workunit.client.1.smithi138.stdout:9/969: mkdir d0/d6/d8/d95/d128 0 2024-02-07T12:25:41.755 INFO:tasks.workunit.client.1.smithi138.stdout:9/970: fsync d0/d6/d8/d1d/dd/d41/d5e/f75 0 2024-02-07T12:25:41.755 INFO:tasks.workunit.client.0.smithi047.stdout:1/114: unlink d1/l14 0 2024-02-07T12:25:41.755 INFO:tasks.workunit.client.1.smithi138.stdout:5/965: truncate da/d43/d4a/da2/fb7 213200 0 2024-02-07T12:25:41.757 INFO:tasks.workunit.client.1.smithi138.stdout:9/971: creat d0/d6/d8/d1d/dd/d1f/db7/db9/de6/f129 x:0 0 0 2024-02-07T12:25:41.757 INFO:tasks.workunit.client.1.smithi138.stdout:9/972: write d0/d6/d8/d1d/f61 [1169245,91396] 0 2024-02-07T12:25:41.757 INFO:tasks.workunit.client.1.smithi138.stdout:9/973: chown d0/d6/d8/d1d/dd/d1f/lb0 3 1 2024-02-07T12:25:41.757 INFO:tasks.workunit.client.1.smithi138.stdout:9/974: dread - d0/d6/da3/dcc/dd1/f122 zero size 2024-02-07T12:25:41.757 INFO:tasks.workunit.client.1.smithi138.stdout:5/966: symlink da/d22/d99/dca/d11e/d4f/d2b/d35/d110/l144 0 2024-02-07T12:25:41.759 INFO:tasks.workunit.client.1.smithi138.stdout:9/975: creat d0/d6/d8/d95/d128/f12a x:0 0 0 2024-02-07T12:25:41.759 INFO:tasks.workunit.client.1.smithi138.stdout:9/976: write d0/d6/d8/d1d/dd/d41/d5e/de7/dd8/ffc [230480,105337] 0 2024-02-07T12:25:41.760 INFO:tasks.workunit.client.0.smithi047.stdout:5/220: mknod da/df/d16/d41/c48 0 2024-02-07T12:25:41.761 INFO:tasks.workunit.client.0.smithi047.stdout:4/93: mknod d3/c1e 0 2024-02-07T12:25:41.767 INFO:tasks.workunit.client.0.smithi047.stdout:0/93: dread fd [0,4194304] 0 2024-02-07T12:25:41.770 INFO:tasks.workunit.client.0.smithi047.stdout:2/172: dwrite d7/dc/f33 [0,4194304] 0 2024-02-07T12:25:41.770 INFO:tasks.workunit.client.0.smithi047.stdout:2/173: creat d7/dc/f35 x:0 0 0 2024-02-07T12:25:41.770 INFO:tasks.workunit.client.1.smithi138.stdout:5/967: dread da/d6d/f13 [4194304,4194304] 0 2024-02-07T12:25:41.775 INFO:tasks.workunit.client.0.smithi047.stdout:2/174: symlink d7/d2d/l36 0 2024-02-07T12:25:41.776 INFO:tasks.workunit.client.1.smithi138.stdout:5/968: rename da/d43/d4a/d95 to da/d22/d99/dca/dd5/d145 0 2024-02-07T12:25:41.778 INFO:tasks.workunit.client.1.smithi138.stdout:5/969: creat da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/d96/f146 x:0 0 0 2024-02-07T12:25:41.779 INFO:tasks.workunit.client.0.smithi047.stdout:2/175: symlink d7/l37 0 2024-02-07T12:25:41.780 INFO:tasks.workunit.client.0.smithi047.stdout:2/176: dread - d7/f2c zero size 2024-02-07T12:25:41.780 INFO:tasks.workunit.client.0.smithi047.stdout:2/177: creat d7/f38 x:0 0 0 2024-02-07T12:25:41.780 INFO:tasks.workunit.client.0.smithi047.stdout:2/178: creat d7/f39 x:0 0 0 2024-02-07T12:25:41.780 INFO:tasks.workunit.client.0.smithi047.stdout:2/179: truncate d7/f38 146295 0 2024-02-07T12:25:41.780 INFO:tasks.workunit.client.0.smithi047.stdout:3/140: dwrite d12/d19/f28 [0,4194304] 0 2024-02-07T12:25:41.780 INFO:tasks.workunit.client.0.smithi047.stdout:3/141: stat d12/f14 0 2024-02-07T12:25:41.780 INFO:tasks.workunit.client.0.smithi047.stdout:3/142: write fc [313351,45798] 0 2024-02-07T12:25:41.780 INFO:tasks.workunit.client.0.smithi047.stdout:3/143: creat d12/d19/f2e x:0 0 0 2024-02-07T12:25:41.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:41 smithi138 ceph-mon[35528]: pgmap v7: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 192 MiB/s rd, 199 MiB/s wr, 318 op/s 2024-02-07T12:25:41.796 INFO:tasks.workunit.client.1.smithi138.stdout:4/988: dwrite d20/d53/d71/f124 [0,4194304] 0 2024-02-07T12:25:41.796 INFO:tasks.workunit.client.1.smithi138.stdout:4/989: dread - d20/d47/d69/d7c/db9/f116 zero size 2024-02-07T12:25:41.807 INFO:tasks.workunit.client.1.smithi138.stdout:4/990: write d20/d47/d69/d7c/f85 [519671,108694] 0 2024-02-07T12:25:41.809 INFO:tasks.workunit.client.1.smithi138.stdout:9/977: dwrite d0/d6/d8/d1d/dd/d25/f118 [0,4194304] 0 2024-02-07T12:25:41.809 INFO:tasks.workunit.client.1.smithi138.stdout:9/978: dread - d0/d6/da3/dcc/ff5 zero size 2024-02-07T12:25:41.809 INFO:tasks.workunit.client.1.smithi138.stdout:9/979: write d0/fab [490473,41373] 0 2024-02-07T12:25:41.810 INFO:tasks.workunit.client.1.smithi138.stdout:9/980: fdatasync d0/d6/d8/d1d/dd/d25/f2d 0 2024-02-07T12:25:41.810 INFO:tasks.workunit.client.1.smithi138.stdout:5/970: dwrite da/d22/d99/dca/d11e/d4f/ffd [0,4194304] 0 2024-02-07T12:25:41.810 INFO:tasks.workunit.client.1.smithi138.stdout:4/991: mknod d20/d47/d69/de4/c14c 0 2024-02-07T12:25:41.810 INFO:tasks.workunit.client.0.smithi047.stdout:6/189: dwrite d3/d5/f27 [4194304,4194304] 0 2024-02-07T12:25:41.811 INFO:tasks.workunit.client.0.smithi047.stdout:1/115: dwrite d1/f11 [0,4194304] 0 2024-02-07T12:25:41.811 INFO:tasks.workunit.client.0.smithi047.stdout:0/94: dwrite f10 [0,4194304] 0 2024-02-07T12:25:41.811 INFO:tasks.workunit.client.0.smithi047.stdout:6/190: dread - d3/da/d14/f2d zero size 2024-02-07T12:25:41.811 INFO:tasks.workunit.client.0.smithi047.stdout:0/95: readlink l8 0 2024-02-07T12:25:41.811 INFO:tasks.workunit.client.0.smithi047.stdout:1/116: write d1/fe [1042167,85733] 0 2024-02-07T12:25:41.811 INFO:tasks.workunit.client.0.smithi047.stdout:2/180: dwrite d7/dc/f1a [0,4194304] 0 2024-02-07T12:25:41.816 INFO:tasks.workunit.client.1.smithi138.stdout:4/992: rmdir d20/d53/d71 39 2024-02-07T12:25:41.816 INFO:tasks.workunit.client.1.smithi138.stdout:4/993: chown d20/d34/d73/dd0/fe9 1 1 2024-02-07T12:25:41.816 INFO:tasks.workunit.client.1.smithi138.stdout:4/994: creat d20/d53/d71/d75/f14d x:0 0 0 2024-02-07T12:25:41.817 INFO:tasks.workunit.client.0.smithi047.stdout:5/221: fsync da/d24/f45 0 2024-02-07T12:25:41.819 INFO:tasks.workunit.client.0.smithi047.stdout:0/96: rename fd to f14 0 2024-02-07T12:25:41.820 INFO:tasks.workunit.client.1.smithi138.stdout:4/995: creat d20/d53/d71/d98/d117/f14e x:0 0 0 2024-02-07T12:25:41.820 INFO:tasks.workunit.client.1.smithi138.stdout:9/981: write d0/d34/d86/fee [1761227,24264] 0 2024-02-07T12:25:41.823 INFO:tasks.workunit.client.0.smithi047.stdout:4/94: rmdir d3 39 2024-02-07T12:25:41.824 INFO:tasks.workunit.client.1.smithi138.stdout:9/982: dread d0/d6/d8/d1d/dd/d41/d5e/f8d [0,4194304] 0 2024-02-07T12:25:41.828 INFO:tasks.workunit.client.0.smithi047.stdout:5/222: truncate da/df/d16/d25/d33/f3c 1112774 0 2024-02-07T12:25:41.829 INFO:tasks.workunit.client.1.smithi138.stdout:9/983: getdents d0/d6/d8 0 2024-02-07T12:25:41.831 INFO:tasks.workunit.client.0.smithi047.stdout:3/144: dwrite fc [0,4194304] 0 2024-02-07T12:25:41.832 INFO:tasks.workunit.client.0.smithi047.stdout:1/117: rename d1/l3 to d1/d15/l1a 0 2024-02-07T12:25:41.835 INFO:tasks.workunit.client.0.smithi047.stdout:2/181: getdents d7/dc 0 2024-02-07T12:25:41.841 INFO:tasks.workunit.client.0.smithi047.stdout:5/223: mknod da/df/d16/d25/c49 0 2024-02-07T12:25:41.841 INFO:tasks.workunit.client.1.smithi138.stdout:9/984: dread d0/d6/d8/d1d/dd/d41/fe5 [0,4194304] 0 2024-02-07T12:25:41.843 INFO:tasks.workunit.client.1.smithi138.stdout:9/985: rmdir d0/d6/d8/d1d/dd/d1f/dbb 39 2024-02-07T12:25:41.843 INFO:tasks.workunit.client.1.smithi138.stdout:9/986: chown d0/d6/da3/dcc/dd1 1417 1 2024-02-07T12:25:41.844 INFO:tasks.workunit.client.0.smithi047.stdout:3/145: rename d12/f1f to d12/d19/d21/d29/f2f 0 2024-02-07T12:25:41.845 INFO:tasks.workunit.client.0.smithi047.stdout:4/95: read d3/fe [253361,89686] 0 2024-02-07T12:25:41.847 INFO:tasks.workunit.client.0.smithi047.stdout:1/118: creat d1/d15/f1b x:0 0 0 2024-02-07T12:25:41.848 INFO:tasks.workunit.client.1.smithi138.stdout:9/987: dread d0/d6/d8/d1d/dd/d41/fb2 [0,4194304] 0 2024-02-07T12:25:41.851 INFO:tasks.workunit.client.1.smithi138.stdout:4/996: dwrite d20/d34/d59/d88/f91 [0,4194304] 0 2024-02-07T12:25:41.851 INFO:tasks.workunit.client.1.smithi138.stdout:4/997: readlink l18 0 2024-02-07T12:25:41.851 INFO:tasks.workunit.client.0.smithi047.stdout:4/96: link d3/l19 d3/l1f 0 2024-02-07T12:25:41.856 INFO:tasks.workunit.client.0.smithi047.stdout:5/224: dread da/d24/d2b/d2e/f31 [0,4194304] 0 2024-02-07T12:25:41.856 INFO:tasks.workunit.client.0.smithi047.stdout:5/225: read - da/df/f1f zero size 2024-02-07T12:25:41.856 INFO:tasks.workunit.client.0.smithi047.stdout:5/226: truncate da/df/f38 12777 0 2024-02-07T12:25:41.856 INFO:tasks.workunit.client.0.smithi047.stdout:5/227: creat da/d24/f4a x:0 0 0 2024-02-07T12:25:41.859 INFO:tasks.workunit.client.0.smithi047.stdout:2/182: dwrite d7/dc/f29 [0,4194304] 0 2024-02-07T12:25:41.859 INFO:tasks.workunit.client.0.smithi047.stdout:2/183: truncate d7/fb 4208482 0 2024-02-07T12:25:41.859 INFO:tasks.workunit.client.0.smithi047.stdout:2/184: write d7/f2e [808754,91519] 0 2024-02-07T12:25:41.859 INFO:tasks.workunit.client.0.smithi047.stdout:3/146: dwrite d12/f14 [0,4194304] 0 2024-02-07T12:25:41.862 INFO:tasks.workunit.client.1.smithi138.stdout:4/998: dread d20/d53/d71/d98/d117/f128 [0,4194304] 0 2024-02-07T12:25:41.867 INFO:tasks.workunit.client.0.smithi047.stdout:3/147: mknod d12/d19/d2d/c30 0 2024-02-07T12:25:41.867 INFO:tasks.workunit.client.0.smithi047.stdout:3/148: dread - d12/f16 zero size 2024-02-07T12:25:41.867 INFO:tasks.workunit.client.1.smithi138.stdout:4/999: getdents d20/d47/d69/d7c/dfe/d114/df5 0 2024-02-07T12:25:41.868 INFO:tasks.workunit.client.0.smithi047.stdout:3/149: truncate d12/d19/f28 2741306 0 2024-02-07T12:25:41.869 INFO:tasks.workunit.client.0.smithi047.stdout:1/119: getdents d1/d15 0 2024-02-07T12:25:41.869 INFO:tasks.workunit.client.0.smithi047.stdout:2/185: read d7/fb [3032766,33812] 0 2024-02-07T12:25:41.871 INFO:tasks.workunit.client.0.smithi047.stdout:3/150: mkdir d12/d19/d21/d29/d31 0 2024-02-07T12:25:41.874 INFO:tasks.workunit.client.0.smithi047.stdout:3/151: getdents d12/d19/d21 0 2024-02-07T12:25:41.878 INFO:tasks.workunit.client.0.smithi047.stdout:2/186: dread d7/f1e [0,4194304] 0 2024-02-07T12:25:41.880 INFO:tasks.workunit.client.0.smithi047.stdout:2/187: link c4 d7/c3a 0 2024-02-07T12:25:41.883 INFO:tasks.workunit.client.0.smithi047.stdout:3/152: write d12/f14 [2214102,82071] 0 2024-02-07T12:25:41.883 INFO:tasks.workunit.client.0.smithi047.stdout:3/153: chown d12/f13 0 1 2024-02-07T12:25:41.883 INFO:tasks.workunit.client.0.smithi047.stdout:3/154: getdents d12/d19/d21 0 2024-02-07T12:25:41.886 INFO:tasks.workunit.client.0.smithi047.stdout:3/155: creat d12/d19/d21/d29/d31/f32 x:0 0 0 2024-02-07T12:25:41.888 INFO:tasks.workunit.client.0.smithi047.stdout:3/156: mkdir d12/d19/d2d/d33 0 2024-02-07T12:25:41.890 INFO:tasks.workunit.client.0.smithi047.stdout:3/157: creat d12/d19/d2d/f34 x:0 0 0 2024-02-07T12:25:41.893 INFO:tasks.workunit.client.0.smithi047.stdout:4/97: dwrite d3/f4 [0,4194304] 0 2024-02-07T12:25:41.893 INFO:tasks.workunit.client.0.smithi047.stdout:4/98: truncate f1 1663859 0 2024-02-07T12:25:41.894 INFO:tasks.workunit.client.1.smithi138.stdout:9/988: dwrite d0/d6/d8/d1d/f1c [0,4194304] 0 2024-02-07T12:25:41.896 INFO:tasks.workunit.client.1.smithi138.stdout:9/989: symlink d0/d6/d8/d1d/dd/d1f/db7/l12b 0 2024-02-07T12:25:41.896 INFO:tasks.workunit.client.1.smithi138.stdout:9/990: write d0/d6/d8/f73 [353108,63734] 0 2024-02-07T12:25:41.897 INFO:tasks.workunit.client.0.smithi047.stdout:5/228: dwrite da/df/d16/f22 [0,4194304] 0 2024-02-07T12:25:41.897 INFO:tasks.workunit.client.0.smithi047.stdout:5/229: creat da/d24/d2b/d2e/f4b x:0 0 0 2024-02-07T12:25:41.898 INFO:tasks.workunit.client.0.smithi047.stdout:1/120: dwrite d1/fe [0,4194304] 0 2024-02-07T12:25:41.901 INFO:tasks.workunit.client.0.smithi047.stdout:5/230: symlink da/df/d16/d25/l4c 0 2024-02-07T12:25:41.902 INFO:tasks.workunit.client.0.smithi047.stdout:1/121: creat d1/d15/f1c x:0 0 0 2024-02-07T12:25:41.903 INFO:tasks.workunit.client.0.smithi047.stdout:1/122: creat d1/d15/d18/f1d x:0 0 0 2024-02-07T12:25:41.903 INFO:tasks.workunit.client.0.smithi047.stdout:1/123: dread - d1/d15/d18/f1d zero size 2024-02-07T12:25:41.904 INFO:tasks.workunit.client.0.smithi047.stdout:1/124: rmdir d1/d15/d18/d19 0 2024-02-07T12:25:41.904 INFO:tasks.workunit.client.0.smithi047.stdout:1/125: creat d1/d15/f1e x:0 0 0 2024-02-07T12:25:41.904 INFO:tasks.workunit.client.0.smithi047.stdout:1/126: write d1/d15/f1c [796826,47183] 0 2024-02-07T12:25:41.906 INFO:tasks.workunit.client.0.smithi047.stdout:4/99: write d3/f6 [3421758,60120] 0 2024-02-07T12:25:41.907 INFO:tasks.workunit.client.0.smithi047.stdout:1/127: link d1/l16 d1/d15/d18/l1f 0 2024-02-07T12:25:41.909 INFO:tasks.workunit.client.0.smithi047.stdout:5/231: dread da/fd [0,4194304] 0 2024-02-07T12:25:41.909 INFO:tasks.workunit.client.0.smithi047.stdout:1/128: rename d1/d15/c17 to d1/d15/d18/c20 0 2024-02-07T12:25:41.910 INFO:tasks.workunit.client.0.smithi047.stdout:4/100: truncate d3/f9 77654 0 2024-02-07T12:25:41.910 INFO:tasks.workunit.client.0.smithi047.stdout:1/129: chown d1/la 439 1 2024-02-07T12:25:41.912 INFO:tasks.workunit.client.0.smithi047.stdout:1/130: unlink d1/l16 0 2024-02-07T12:25:41.913 INFO:tasks.workunit.client.0.smithi047.stdout:4/101: rename d3/fe to d3/f20 0 2024-02-07T12:25:41.914 INFO:tasks.workunit.client.0.smithi047.stdout:2/188: dwrite d7/dc/f29 [0,4194304] 0 2024-02-07T12:25:41.929 INFO:tasks.workunit.client.0.smithi047.stdout:2/189: dread d7/dc/f2b [0,4194304] 0 2024-02-07T12:25:41.929 INFO:tasks.workunit.client.0.smithi047.stdout:2/190: truncate d7/f23 328140 0 2024-02-07T12:25:41.929 INFO:tasks.workunit.client.0.smithi047.stdout:2/191: stat d7/cd 0 2024-02-07T12:25:41.942 INFO:tasks.workunit.client.0.smithi047.stdout:5/232: dwrite da/df/d16/d25/f2a [0,4194304] 0 2024-02-07T12:25:41.942 INFO:tasks.workunit.client.0.smithi047.stdout:3/158: dwrite d12/d19/d21/f2c [0,4194304] 0 2024-02-07T12:25:41.942 INFO:tasks.workunit.client.0.smithi047.stdout:3/159: fsync f11 0 2024-02-07T12:25:41.942 INFO:tasks.workunit.client.0.smithi047.stdout:3/160: dread - d12/d19/d21/d29/f2f zero size 2024-02-07T12:25:41.943 INFO:tasks.workunit.client.0.smithi047.stdout:4/102: dwrite d3/f20 [0,4194304] 0 2024-02-07T12:25:41.944 INFO:tasks.workunit.client.1.smithi138.stdout:5/971: sync 2024-02-07T12:25:41.945 INFO:tasks.workunit.client.1.smithi138.stdout:5/972: mknod da/d43/d4a/c147 0 2024-02-07T12:25:41.945 INFO:tasks.workunit.client.1.smithi138.stdout:5/973: dread - da/d22/d99/dca/dd5/de2/f10b zero size 2024-02-07T12:25:41.948 INFO:tasks.workunit.client.0.smithi047.stdout:5/233: mknod da/c4d 0 2024-02-07T12:25:41.954 INFO:tasks.workunit.client.0.smithi047.stdout:3/161: link f9 d12/d19/d2d/d33/f35 0 2024-02-07T12:25:41.958 INFO:tasks.workunit.client.1.smithi138.stdout:5/974: write da/d43/d4a/fc2 [2296377,24553] 0 2024-02-07T12:25:41.958 INFO:tasks.workunit.client.1.smithi138.stdout:5/975: write da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/f8b [35335,41336] 0 2024-02-07T12:25:41.958 INFO:tasks.workunit.client.0.smithi047.stdout:4/103: stat d3/f14 0 2024-02-07T12:25:41.960 INFO:tasks.workunit.client.0.smithi047.stdout:1/131: dwrite d1/d15/f1c [0,4194304] 0 2024-02-07T12:25:41.960 INFO:tasks.workunit.client.1.smithi138.stdout:5/976: rename da/d43/c131 to da/d22/d99/dca/d11e/d4f/d2b/d35/dae/c148 0 2024-02-07T12:25:41.962 INFO:tasks.workunit.client.0.smithi047.stdout:1/132: creat d1/f21 x:0 0 0 2024-02-07T12:25:41.962 INFO:tasks.workunit.client.0.smithi047.stdout:3/162: write d12/d19/f1d [19595,54488] 0 2024-02-07T12:25:41.963 INFO:tasks.workunit.client.0.smithi047.stdout:4/104: mknod d3/c21 0 2024-02-07T12:25:41.969 INFO:tasks.workunit.client.0.smithi047.stdout:3/163: mknod d12/d19/d21/c36 0 2024-02-07T12:25:41.974 INFO:tasks.workunit.client.0.smithi047.stdout:3/164: truncate d12/f25 354291 0 2024-02-07T12:25:41.974 INFO:tasks.workunit.client.0.smithi047.stdout:3/165: truncate d12/d19/f26 4892583 0 2024-02-07T12:25:41.976 INFO:tasks.workunit.client.0.smithi047.stdout:3/166: mkdir d12/d19/d37 0 2024-02-07T12:25:41.983 INFO:tasks.workunit.client.0.smithi047.stdout:3/167: dread d12/f13 [0,4194304] 0 2024-02-07T12:25:41.984 INFO:tasks.workunit.client.0.smithi047.stdout:3/168: mkdir d12/d19/d21/d29/d31/d38 0 2024-02-07T12:25:41.985 INFO:tasks.workunit.client.0.smithi047.stdout:5/234: dwrite da/d24/d2b/d2e/f43 [0,4194304] 0 2024-02-07T12:25:41.985 INFO:tasks.workunit.client.0.smithi047.stdout:5/235: creat da/d24/d2b/d2e/f4e x:0 0 0 2024-02-07T12:25:41.985 INFO:tasks.workunit.client.0.smithi047.stdout:5/236: readlink da/df/d16/d25/l4c 0 2024-02-07T12:25:41.988 INFO:tasks.workunit.client.0.smithi047.stdout:1/133: dwrite d1/fe [0,4194304] 0 2024-02-07T12:25:41.988 INFO:tasks.workunit.client.0.smithi047.stdout:5/237: symlink da/df/l4f 0 2024-02-07T12:25:41.988 INFO:tasks.workunit.client.0.smithi047.stdout:5/238: dread - da/d24/d2b/d2e/f4e zero size 2024-02-07T12:25:41.992 INFO:tasks.workunit.client.0.smithi047.stdout:4/105: dwrite d3/f5 [0,4194304] 0 2024-02-07T12:25:41.992 INFO:tasks.workunit.client.0.smithi047.stdout:4/106: stat d3/f1a 0 2024-02-07T12:25:41.992 INFO:tasks.workunit.client.0.smithi047.stdout:5/239: rename da/fb to da/df/d16/d25/f50 0 2024-02-07T12:25:41.992 INFO:tasks.workunit.client.0.smithi047.stdout:5/240: creat da/df/d16/d41/f51 x:0 0 0 2024-02-07T12:25:41.995 INFO:tasks.workunit.client.0.smithi047.stdout:3/169: truncate d12/d19/f1d 3489876 0 2024-02-07T12:25:41.996 INFO:tasks.workunit.client.0.smithi047.stdout:3/170: chown f2 1 1 2024-02-07T12:25:41.996 INFO:tasks.workunit.client.0.smithi047.stdout:3/171: chown d12/d19/c23 1261 1 2024-02-07T12:25:41.996 INFO:tasks.workunit.client.0.smithi047.stdout:4/107: symlink d3/l22 0 2024-02-07T12:25:41.997 INFO:tasks.workunit.client.0.smithi047.stdout:3/172: symlink d12/d19/d21/d29/d31/l39 0 2024-02-07T12:25:41.998 INFO:tasks.workunit.client.0.smithi047.stdout:1/134: rmdir d1/d15 39 2024-02-07T12:25:42.001 INFO:tasks.workunit.client.0.smithi047.stdout:3/173: creat d12/d19/d2d/d33/f3a x:0 0 0 2024-02-07T12:25:42.005 INFO:tasks.workunit.client.0.smithi047.stdout:4/108: rename d3/f1b to d3/f23 0 2024-02-07T12:25:42.006 INFO:tasks.workunit.client.0.smithi047.stdout:3/174: symlink d12/d19/d37/l3b 0 2024-02-07T12:25:42.011 INFO:tasks.workunit.client.0.smithi047.stdout:1/135: rename d1/f11 to d1/f22 0 2024-02-07T12:25:42.014 INFO:tasks.workunit.client.0.smithi047.stdout:4/109: write d3/f4 [3061346,65693] 0 2024-02-07T12:25:42.014 INFO:tasks.workunit.client.0.smithi047.stdout:4/110: dread - d3/f14 zero size 2024-02-07T12:25:42.020 INFO:tasks.workunit.client.0.smithi047.stdout:3/175: dread d12/d19/f1d [0,4194304] 0 2024-02-07T12:25:42.020 INFO:tasks.workunit.client.0.smithi047.stdout:3/176: getdents d12/d19/d37 0 2024-02-07T12:25:42.021 INFO:tasks.workunit.client.0.smithi047.stdout:4/111: link d3/f14 d3/f24 0 2024-02-07T12:25:42.022 INFO:tasks.workunit.client.0.smithi047.stdout:1/136: unlink d1/d15/d18/c20 0 2024-02-07T12:25:42.024 INFO:tasks.workunit.client.0.smithi047.stdout:4/112: creat d3/f25 x:0 0 0 2024-02-07T12:25:42.024 INFO:tasks.workunit.client.0.smithi047.stdout:4/113: readlink d3/l1c 0 2024-02-07T12:25:42.025 INFO:tasks.workunit.client.0.smithi047.stdout:3/177: read f2 [2528276,98744] 0 2024-02-07T12:25:42.026 INFO:tasks.workunit.client.0.smithi047.stdout:1/137: unlink d1/f5 0 2024-02-07T12:25:42.026 INFO:tasks.workunit.client.0.smithi047.stdout:4/114: mknod d3/c26 0 2024-02-07T12:25:42.027 INFO:tasks.workunit.client.0.smithi047.stdout:3/178: mknod d12/d19/d21/d29/d31/c3c 0 2024-02-07T12:25:42.029 INFO:tasks.workunit.client.0.smithi047.stdout:3/179: creat d12/f3d x:0 0 0 2024-02-07T12:25:42.029 INFO:tasks.workunit.client.0.smithi047.stdout:3/180: chown d12/d19/d2d/c30 862195333 1 2024-02-07T12:25:42.029 INFO:tasks.workunit.client.0.smithi047.stdout:3/181: stat d12/d19/d2d/f34 0 2024-02-07T12:25:42.031 INFO:tasks.workunit.client.0.smithi047.stdout:4/115: mkdir d3/d27 0 2024-02-07T12:25:42.031 INFO:tasks.workunit.client.0.smithi047.stdout:4/116: write d3/f1a [102445,96619] 0 2024-02-07T12:25:42.031 INFO:tasks.workunit.client.0.smithi047.stdout:4/117: write d3/f1a [850647,81061] 0 2024-02-07T12:25:42.031 INFO:tasks.workunit.client.0.smithi047.stdout:4/118: write d3/f9 [199815,81545] 0 2024-02-07T12:25:42.032 INFO:tasks.workunit.client.0.smithi047.stdout:3/182: rename d12/d19/d2d/f34 to d12/d19/d21/d29/d31/f3e 0 2024-02-07T12:25:42.034 INFO:tasks.workunit.client.0.smithi047.stdout:1/138: rmdir d1 39 2024-02-07T12:25:42.035 INFO:tasks.workunit.client.0.smithi047.stdout:1/139: write d1/d15/f1e [281213,71244] 0 2024-02-07T12:25:42.038 INFO:tasks.workunit.client.0.smithi047.stdout:4/119: getdents d3 0 2024-02-07T12:25:42.040 INFO:tasks.workunit.client.0.smithi047.stdout:1/140: dread d1/d15/f1e [0,4194304] 0 2024-02-07T12:25:42.040 INFO:tasks.workunit.client.0.smithi047.stdout:4/120: creat d3/d27/f28 x:0 0 0 2024-02-07T12:25:42.040 INFO:tasks.workunit.client.0.smithi047.stdout:4/121: chown d3/f4 147 1 2024-02-07T12:25:42.041 INFO:tasks.workunit.client.0.smithi047.stdout:1/141: creat d1/d15/d18/f23 x:0 0 0 2024-02-07T12:25:42.043 INFO:tasks.workunit.client.0.smithi047.stdout:1/142: rename d1/d15/f1b to d1/d15/d18/f24 0 2024-02-07T12:25:42.044 INFO:tasks.workunit.client.0.smithi047.stdout:1/143: rmdir d1/d15 39 2024-02-07T12:25:42.045 INFO:tasks.workunit.client.0.smithi047.stdout:4/122: rmdir d3/d27 39 2024-02-07T12:25:42.046 INFO:tasks.workunit.client.0.smithi047.stdout:1/144: symlink d1/l25 0 2024-02-07T12:25:42.047 INFO:tasks.workunit.client.0.smithi047.stdout:4/123: dread d3/fc [0,4194304] 0 2024-02-07T12:25:42.047 INFO:tasks.workunit.client.0.smithi047.stdout:4/124: stat l0 0 2024-02-07T12:25:42.047 INFO:tasks.workunit.client.0.smithi047.stdout:4/125: write d3/f1a [1516827,80860] 0 2024-02-07T12:25:42.047 INFO:tasks.workunit.client.0.smithi047.stdout:1/145: creat d1/d15/d18/f26 x:0 0 0 2024-02-07T12:25:42.048 INFO:tasks.workunit.client.0.smithi047.stdout:1/146: creat d1/d15/d18/f27 x:0 0 0 2024-02-07T12:25:42.048 INFO:tasks.workunit.client.0.smithi047.stdout:1/147: truncate d1/fe 4672554 0 2024-02-07T12:25:42.052 INFO:tasks.workunit.client.1.smithi138.stdout:9/991: sync 2024-02-07T12:25:42.052 INFO:tasks.workunit.client.1.smithi138.stdout:5/977: sync 2024-02-07T12:25:42.053 INFO:tasks.workunit.client.1.smithi138.stdout:9/992: truncate d0/d6/d8/d1d/dd/d41/f76 2198485 0 2024-02-07T12:25:42.056 INFO:tasks.workunit.client.1.smithi138.stdout:9/993: link d0/d6/f3c d0/d6/d8/d1d/dd/d41/f12c 0 2024-02-07T12:25:42.056 INFO:tasks.workunit.client.1.smithi138.stdout:9/994: dread - d0/fff zero size 2024-02-07T12:25:42.058 INFO:tasks.workunit.client.1.smithi138.stdout:9/995: getdents d0/d6/d8/d1d/dd 0 2024-02-07T12:25:42.059 INFO:tasks.workunit.client.1.smithi138.stdout:9/996: truncate d0/d6/da3/dcc/dd1/fd3 1052941 0 2024-02-07T12:25:42.069 INFO:tasks.workunit.client.1.smithi138.stdout:9/997: write d0/d6/d8/d1d/da0/fbd [448818,123228] 0 2024-02-07T12:25:42.069 INFO:tasks.workunit.client.1.smithi138.stdout:9/998: readlink d0/lb5 0 2024-02-07T12:25:42.069 INFO:tasks.workunit.client.1.smithi138.stdout:9/999: creat d0/d6/d8/d1d/dd/d25/d9b/f12d x:0 0 0 2024-02-07T12:25:42.071 INFO:tasks.workunit.client.0.smithi047.stdout:4/126: dwrite d3/f24 [0,4194304] 0 2024-02-07T12:25:42.071 INFO:tasks.workunit.client.0.smithi047.stdout:4/127: write d3/f17 [607678,113483] 0 2024-02-07T12:25:42.072 INFO:tasks.workunit.client.1.smithi138.stdout:5/978: dwrite da/d43/d4a/d98/fc8 [0,4194304] 0 2024-02-07T12:25:42.072 INFO:tasks.workunit.client.0.smithi047.stdout:4/128: unlink d3/f24 0 2024-02-07T12:25:42.073 INFO:tasks.workunit.client.0.smithi047.stdout:4/129: fsync d3/fb 0 2024-02-07T12:25:42.077 INFO:tasks.workunit.client.1.smithi138.stdout:5/979: rename da/d22/d99/dca/d11e/d4f/d2b/d35/d40/f124 to da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/d96/f149 0 2024-02-07T12:25:42.077 INFO:tasks.workunit.client.1.smithi138.stdout:5/980: fdatasync da/d43/d4a/d69/f6f 0 2024-02-07T12:25:42.077 INFO:tasks.workunit.client.1.smithi138.stdout:5/981: chown da/d50/ld7 15584 1 2024-02-07T12:25:42.078 INFO:tasks.workunit.client.0.smithi047.stdout:4/130: dread d3/f6 [0,4194304] 0 2024-02-07T12:25:42.078 INFO:tasks.workunit.client.1.smithi138.stdout:5/982: getdents da/d22/d99/dca/d11e/d4f/d2b/d35/d67/df0 0 2024-02-07T12:25:42.079 INFO:tasks.workunit.client.1.smithi138.stdout:5/983: chown da/d43/d4a/d69/f6f 27435 1 2024-02-07T12:25:42.079 INFO:tasks.workunit.client.0.smithi047.stdout:4/131: symlink d3/l29 0 2024-02-07T12:25:42.080 INFO:tasks.workunit.client.1.smithi138.stdout:5/984: rmdir da/d43/d141 0 2024-02-07T12:25:42.081 INFO:tasks.workunit.client.0.smithi047.stdout:4/132: mkdir d3/d27/d2a 0 2024-02-07T12:25:42.082 INFO:tasks.workunit.client.1.smithi138.stdout:5/985: mknod da/d22/d99/dca/c14a 0 2024-02-07T12:25:42.082 INFO:tasks.workunit.client.1.smithi138.stdout:5/986: dread - da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/d96/f149 zero size 2024-02-07T12:25:42.082 INFO:tasks.workunit.client.1.smithi138.stdout:5/987: truncate da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/d91/fde 1343911 0 2024-02-07T12:25:42.082 INFO:tasks.workunit.client.0.smithi047.stdout:4/133: truncate d3/f6 3927603 0 2024-02-07T12:25:42.082 INFO:tasks.workunit.client.0.smithi047.stdout:4/134: truncate d3/f25 253022 0 2024-02-07T12:25:42.083 INFO:tasks.workunit.client.0.smithi047.stdout:4/135: link d3/f9 d3/f2b 0 2024-02-07T12:25:42.083 INFO:tasks.workunit.client.0.smithi047.stdout:4/136: chown d3/d27 3144351 1 2024-02-07T12:25:42.083 INFO:tasks.workunit.client.0.smithi047.stdout:4/137: truncate d3/ff 806424 0 2024-02-07T12:25:42.084 INFO:tasks.workunit.client.0.smithi047.stdout:4/138: mknod d3/d27/c2c 0 2024-02-07T12:25:42.084 INFO:tasks.workunit.client.0.smithi047.stdout:4/139: mknod d3/d27/c2d 0 2024-02-07T12:25:42.084 INFO:tasks.workunit.client.0.smithi047.stdout:4/140: stat d3/fc 0 2024-02-07T12:25:42.089 INFO:tasks.workunit.client.0.smithi047.stdout:4/141: fsync d3/f6 0 2024-02-07T12:25:42.091 INFO:tasks.workunit.client.0.smithi047.stdout:4/142: dread d3/f2b [0,4194304] 0 2024-02-07T12:25:42.096 INFO:tasks.workunit.client.1.smithi138.stdout:5/988: dwrite da/d22/d99/dca/d11e/d4f/d2b/d35/d5d/d73/d11c/f140 [0,4194304] 0 2024-02-07T12:25:42.105 INFO:tasks.workunit.client.0.smithi047.stdout:4/143: dwrite d3/f1a [0,4194304] 0 2024-02-07T12:25:42.105 INFO:tasks.workunit.client.0.smithi047.stdout:4/144: fsync d3/f1a 0 2024-02-07T12:25:42.109 INFO:tasks.workunit.client.1.smithi138.stdout:5/989: dread da/d43/d4a/fc2 [0,4194304] 0 2024-02-07T12:25:42.110 INFO:tasks.workunit.client.1.smithi138.stdout:5/990: rename da/d22/d99/ld3 to da/d22/d99/dca/d11e/d4f/d2b/d35/l14b 0 2024-02-07T12:25:42.111 INFO:tasks.workunit.client.1.smithi138.stdout:5/991: mkdir da/d22/d99/dca/d11e/d4f/d2b/d14c 0 2024-02-07T12:25:42.112 INFO:tasks.workunit.client.1.smithi138.stdout:5/992: symlink da/d43/d4a/da2/l14d 0 2024-02-07T12:25:42.113 INFO:tasks.workunit.client.1.smithi138.stdout:5/993: dread da/d22/d99/dca/d11e/d4f/d2b/d35/d40/f5e [0,4194304] 0 2024-02-07T12:25:42.113 INFO:tasks.workunit.client.1.smithi138.stdout:5/994: chown da/d22/d99/dca/lce 184565 1 2024-02-07T12:25:42.113 INFO:tasks.workunit.client.1.smithi138.stdout:5/995: readlink da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/d96/lb4 0 2024-02-07T12:25:42.115 INFO:tasks.workunit.client.1.smithi138.stdout:5/996: link da/d50/f11d da/d22/d99/dca/d11e/d4f/d2b/d35/dae/db0/d91/df1/f14e 0 2024-02-07T12:25:42.115 INFO:tasks.workunit.client.1.smithi138.stdout:5/997: write da/d22/d99/dca/d11e/d4f/d2b/d35/d40/f49 [4906,123338] 0 2024-02-07T12:25:42.115 INFO:tasks.workunit.client.1.smithi138.stdout:5/998: mkdir da/d22/d99/dca/d11e/d4f/d2b/d35/d5d/d73/d14f 0 2024-02-07T12:25:42.117 INFO:tasks.workunit.client.1.smithi138.stdout:5/999: creat da/d22/d99/dca/d11e/d4f/d2b/d35/d5d/d73/f150 x:0 0 0 2024-02-07T12:25:42.120 INFO:tasks.workunit.client.1.smithi138.stderr:+ rm -rf -- ./tmp.RReK0I1Z38 2024-02-07T12:25:42.338 INFO:tasks.workunit.client.0.smithi047.stdout:2/192: sync 2024-02-07T12:25:42.338 INFO:tasks.workunit.client.0.smithi047.stdout:9/89: sync 2024-02-07T12:25:42.338 INFO:tasks.workunit.client.0.smithi047.stdout:8/246: sync 2024-02-07T12:25:42.338 INFO:tasks.workunit.client.0.smithi047.stdout:5/241: sync 2024-02-07T12:25:42.339 INFO:tasks.workunit.client.0.smithi047.stdout:2/193: chown d7/c15 8842 1 2024-02-07T12:25:42.339 INFO:tasks.workunit.client.0.smithi047.stdout:8/247: creat d3/d4/d1f/f4c x:0 0 0 2024-02-07T12:25:42.339 INFO:tasks.workunit.client.0.smithi047.stdout:2/194: creat d7/f3b x:0 0 0 2024-02-07T12:25:42.339 INFO:tasks.workunit.client.0.smithi047.stdout:6/191: sync 2024-02-07T12:25:42.339 INFO:tasks.workunit.client.0.smithi047.stdout:7/221: sync 2024-02-07T12:25:42.339 INFO:tasks.workunit.client.0.smithi047.stdout:0/97: sync 2024-02-07T12:25:42.339 INFO:tasks.workunit.client.0.smithi047.stdout:3/183: sync 2024-02-07T12:25:42.339 INFO:tasks.workunit.client.0.smithi047.stdout:3/184: fsync d12/d19/d21/d29/f2f 0 2024-02-07T12:25:42.339 INFO:tasks.workunit.client.0.smithi047.stdout:1/148: sync 2024-02-07T12:25:42.339 INFO:tasks.workunit.client.0.smithi047.stdout:4/145: sync 2024-02-07T12:25:42.340 INFO:tasks.workunit.client.0.smithi047.stdout:5/242: rmdir da/df/d16/d41/d44 0 2024-02-07T12:25:42.344 INFO:tasks.workunit.client.0.smithi047.stdout:2/195: rename d7/c15 to d7/c3c 0 2024-02-07T12:25:42.347 INFO:tasks.workunit.client.0.smithi047.stdout:6/192: rmdir d3/da/d14/d3f 0 2024-02-07T12:25:42.347 INFO:tasks.workunit.client.0.smithi047.stdout:6/193: write d3/d5/d35/f3d [815486,105491] 0 2024-02-07T12:25:42.348 INFO:tasks.workunit.client.0.smithi047.stdout:7/222: mkdir d0/df/d29/d3e/d4c 0 2024-02-07T12:25:42.349 INFO:tasks.workunit.client.0.smithi047.stdout:3/185: symlink d12/d19/d21/l3f 0 2024-02-07T12:25:42.349 INFO:tasks.workunit.client.0.smithi047.stdout:0/98: read f10 [1743378,93326] 0 2024-02-07T12:25:42.349 INFO:tasks.workunit.client.0.smithi047.stdout:0/99: creat f15 x:0 0 0 2024-02-07T12:25:42.351 INFO:tasks.workunit.client.0.smithi047.stdout:4/146: rename d3/l8 to d3/l2e 0 2024-02-07T12:25:42.352 INFO:tasks.workunit.client.0.smithi047.stdout:2/196: truncate d7/dc/f31 4394537 0 2024-02-07T12:25:42.352 INFO:tasks.workunit.client.0.smithi047.stdout:2/197: fsync d7/dc/f10 0 2024-02-07T12:25:42.352 INFO:tasks.workunit.client.0.smithi047.stdout:2/198: readlink d7/l9 0 2024-02-07T12:25:42.355 INFO:tasks.workunit.client.0.smithi047.stdout:4/147: symlink d3/d27/l2f 0 2024-02-07T12:25:42.355 INFO:tasks.workunit.client.0.smithi047.stdout:4/148: readlink d3/l1c 0 2024-02-07T12:25:42.355 INFO:tasks.workunit.client.0.smithi047.stdout:4/149: chown d3/f23 5723 1 2024-02-07T12:25:42.356 INFO:tasks.workunit.client.0.smithi047.stdout:6/194: dread d3/d5/f13 [0,4194304] 0 2024-02-07T12:25:42.357 INFO:tasks.workunit.client.0.smithi047.stdout:6/195: dread - d3/da/d14/f36 zero size 2024-02-07T12:25:42.357 INFO:tasks.workunit.client.0.smithi047.stdout:6/196: read - d3/da/d34/f41 zero size 2024-02-07T12:25:42.361 INFO:tasks.workunit.client.0.smithi047.stdout:1/149: rename d1/l12 to d1/d15/d18/l28 0 2024-02-07T12:25:42.362 INFO:tasks.workunit.client.0.smithi047.stdout:8/248: dwrite d3/d36/f4b [0,4194304] 0 2024-02-07T12:25:42.362 INFO:tasks.workunit.client.0.smithi047.stdout:4/150: unlink f2 0 2024-02-07T12:25:42.365 INFO:tasks.workunit.client.0.smithi047.stdout:5/243: rename da/df/d16/f22 to da/df/d16/d25/d33/f52 0 2024-02-07T12:25:42.365 INFO:tasks.workunit.client.0.smithi047.stdout:3/186: rename d12/d19/d37 to d12/d19/d37/d40 22 2024-02-07T12:25:42.367 INFO:tasks.workunit.client.0.smithi047.stdout:7/223: rmdir d0/df 39 2024-02-07T12:25:42.367 INFO:tasks.workunit.client.0.smithi047.stdout:9/90: dwrite d3/f9 [0,4194304] 0 2024-02-07T12:25:42.368 INFO:tasks.workunit.client.0.smithi047.stdout:6/197: write d3/d1e/f31 [3921767,121870] 0 2024-02-07T12:25:42.370 INFO:tasks.workunit.client.0.smithi047.stdout:4/151: mkdir d3/d30 0 2024-02-07T12:25:42.372 INFO:tasks.workunit.client.0.smithi047.stdout:7/224: dread d0/d4/f12 [0,4194304] 0 2024-02-07T12:25:42.374 INFO:tasks.workunit.client.0.smithi047.stdout:9/91: symlink d3/d10/l1c 0 2024-02-07T12:25:42.374 INFO:tasks.workunit.client.0.smithi047.stdout:9/92: creat d3/f1d x:0 0 0 2024-02-07T12:25:42.374 INFO:tasks.workunit.client.0.smithi047.stdout:0/100: dwrite f14 [0,4194304] 0 2024-02-07T12:25:42.374 INFO:tasks.workunit.client.0.smithi047.stdout:0/101: read - f13 zero size 2024-02-07T12:25:42.374 INFO:tasks.workunit.client.0.smithi047.stdout:4/152: mknod d3/d27/c31 0 2024-02-07T12:25:42.376 INFO:tasks.workunit.client.0.smithi047.stdout:1/150: rename d1/cc to d1/d15/c29 0 2024-02-07T12:25:42.376 INFO:tasks.workunit.client.0.smithi047.stdout:1/151: write d1/d15/d18/f27 [588294,7186] 0 2024-02-07T12:25:42.378 INFO:tasks.workunit.client.0.smithi047.stdout:7/225: mkdir d0/d42/d4d 0 2024-02-07T12:25:42.381 INFO:tasks.workunit.client.0.smithi047.stdout:3/187: dread d12/f18 [0,4194304] 0 2024-02-07T12:25:42.381 INFO:tasks.workunit.client.0.smithi047.stdout:3/188: dread - d12/d19/d21/d29/d31/f3e zero size 2024-02-07T12:25:42.381 INFO:tasks.workunit.client.0.smithi047.stdout:5/244: write da/df/d16/d25/f36 [2174332,111393] 0 2024-02-07T12:25:42.381 INFO:tasks.workunit.client.0.smithi047.stdout:9/93: symlink d3/d10/l1e 0 2024-02-07T12:25:42.382 INFO:tasks.workunit.client.0.smithi047.stdout:6/198: dread d3/da/f22 [0,4194304] 0 2024-02-07T12:25:42.383 INFO:tasks.workunit.client.0.smithi047.stdout:8/249: dread d3/d16/d2a/f32 [0,4194304] 0 2024-02-07T12:25:42.383 INFO:tasks.workunit.client.0.smithi047.stdout:8/250: truncate d3/d4/f7 831274 0 2024-02-07T12:25:42.385 INFO:tasks.workunit.client.0.smithi047.stdout:0/102: unlink cb 0 2024-02-07T12:25:42.385 INFO:tasks.workunit.client.0.smithi047.stdout:0/103: chown fa 0 1 2024-02-07T12:25:42.386 INFO:tasks.workunit.client.0.smithi047.stdout:4/153: truncate d3/f5 2027664 0 2024-02-07T12:25:42.386 INFO:tasks.workunit.client.0.smithi047.stdout:4/154: chown d3/l19 523044 1 2024-02-07T12:25:42.387 INFO:tasks.workunit.client.0.smithi047.stdout:4/155: chown d3/f6 5 1 2024-02-07T12:25:42.390 INFO:tasks.workunit.client.0.smithi047.stdout:7/226: mknod d0/df/d29/d3e/d4c/c4e 0 2024-02-07T12:25:42.390 INFO:tasks.workunit.client.0.smithi047.stdout:7/227: chown d0/df/l30 207 1 2024-02-07T12:25:42.390 INFO:tasks.workunit.client.0.smithi047.stdout:7/228: creat d0/d42/f4f x:0 0 0 2024-02-07T12:25:42.391 INFO:tasks.workunit.client.0.smithi047.stdout:7/229: dread d0/d4/f1e [0,4194304] 0 2024-02-07T12:25:42.392 INFO:tasks.workunit.client.0.smithi047.stdout:4/156: dread d3/f4 [0,4194304] 0 2024-02-07T12:25:42.392 INFO:tasks.workunit.client.0.smithi047.stdout:3/189: creat d12/d19/d21/d29/f41 x:0 0 0 2024-02-07T12:25:42.392 INFO:tasks.workunit.client.0.smithi047.stdout:3/190: truncate d12/f25 1386292 0 2024-02-07T12:25:42.394 INFO:tasks.workunit.client.0.smithi047.stdout:5/245: creat da/df/d16/f53 x:0 0 0 2024-02-07T12:25:42.397 INFO:tasks.workunit.client.0.smithi047.stdout:9/94: rename d3/fb to d3/d10/f1f 0 2024-02-07T12:25:42.399 INFO:tasks.workunit.client.0.smithi047.stdout:6/199: mkdir d3/da/d2c/d42 0 2024-02-07T12:25:42.399 INFO:tasks.workunit.client.0.smithi047.stdout:6/200: write d3/da/f37 [424616,108672] 0 2024-02-07T12:25:42.403 INFO:tasks.workunit.client.0.smithi047.stdout:8/251: mkdir d3/d4/d4d 0 2024-02-07T12:25:42.405 INFO:tasks.workunit.client.0.smithi047.stdout:7/230: dwrite d0/d4/f20 [4194304,4194304] 0 2024-02-07T12:25:42.405 INFO:tasks.workunit.client.0.smithi047.stdout:7/231: chown d0/f47 1368 1 2024-02-07T12:25:42.406 INFO:tasks.workunit.client.0.smithi047.stdout:0/104: mknod c16 0 2024-02-07T12:25:42.411 INFO:tasks.workunit.client.0.smithi047.stdout:1/152: mkdir d1/d2a 0 2024-02-07T12:25:42.416 INFO:tasks.workunit.client.0.smithi047.stdout:4/157: mknod d3/c32 0 2024-02-07T12:25:42.416 INFO:tasks.workunit.client.0.smithi047.stdout:4/158: readlink d3/l18 0 2024-02-07T12:25:42.417 INFO:tasks.workunit.client.0.smithi047.stdout:3/191: mkdir d12/d19/d2d/d42 0 2024-02-07T12:25:42.419 INFO:tasks.workunit.client.0.smithi047.stdout:5/246: mknod da/d24/d2b/c54 0 2024-02-07T12:25:42.420 INFO:tasks.workunit.client.0.smithi047.stdout:8/252: creat d3/d16/f4e x:0 0 0 2024-02-07T12:25:42.423 INFO:tasks.workunit.client.0.smithi047.stdout:9/95: dwrite d3/fe [0,4194304] 0 2024-02-07T12:25:42.424 INFO:tasks.workunit.client.0.smithi047.stdout:7/232: dwrite d0/d42/f45 [0,4194304] 0 2024-02-07T12:25:42.428 INFO:tasks.workunit.client.0.smithi047.stdout:0/105: link f13 f17 0 2024-02-07T12:25:42.428 INFO:tasks.workunit.client.0.smithi047.stdout:4/159: rename d3/l22 to d3/d27/d2a/l33 0 2024-02-07T12:25:42.428 INFO:tasks.workunit.client.0.smithi047.stdout:6/201: dwrite d3/da/f19 [0,4194304] 0 2024-02-07T12:25:42.428 INFO:tasks.workunit.client.0.smithi047.stdout:6/202: fdatasync d3/d5/f27 0 2024-02-07T12:25:42.428 INFO:tasks.workunit.client.0.smithi047.stdout:9/96: dread f2 [0,4194304] 0 2024-02-07T12:25:42.429 INFO:tasks.workunit.client.0.smithi047.stdout:5/247: mkdir da/df/d16/d25/d33/d55 0 2024-02-07T12:25:42.432 INFO:tasks.workunit.client.0.smithi047.stdout:0/106: dread f10 [0,4194304] 0 2024-02-07T12:25:42.432 INFO:tasks.workunit.client.0.smithi047.stdout:0/107: truncate f17 636387 0 2024-02-07T12:25:42.433 INFO:tasks.workunit.client.0.smithi047.stdout:0/108: readlink l8 0 2024-02-07T12:25:42.434 INFO:tasks.workunit.client.0.smithi047.stdout:0/109: creat f18 x:0 0 0 2024-02-07T12:25:42.434 INFO:tasks.workunit.client.0.smithi047.stdout:0/110: fdatasync f5 0 2024-02-07T12:25:42.434 INFO:tasks.workunit.client.0.smithi047.stdout:0/111: dread f17 [0,4194304] 0 2024-02-07T12:25:42.435 INFO:tasks.workunit.client.0.smithi047.stdout:0/112: dread f17 [0,4194304] 0 2024-02-07T12:25:42.437 INFO:tasks.workunit.client.0.smithi047.stdout:4/160: write d3/fc [191498,75278] 0 2024-02-07T12:25:42.438 INFO:tasks.workunit.client.0.smithi047.stdout:7/233: unlink d0/df/l30 0 2024-02-07T12:25:42.440 INFO:tasks.workunit.client.0.smithi047.stdout:9/97: symlink d3/d10/d11/l20 0 2024-02-07T12:25:42.442 INFO:tasks.workunit.client.0.smithi047.stdout:5/248: creat da/df/d16/d25/d33/d55/f56 x:0 0 0 2024-02-07T12:25:42.448 INFO:tasks.workunit.client.0.smithi047.stdout:8/253: rmdir d3/d16 39 2024-02-07T12:25:42.450 INFO:tasks.workunit.client.0.smithi047.stdout:0/113: mkdir d19 0 2024-02-07T12:25:42.451 INFO:tasks.workunit.client.0.smithi047.stdout:4/161: mknod d3/d30/c34 0 2024-02-07T12:25:42.453 INFO:tasks.workunit.client.0.smithi047.stdout:7/234: creat d0/df/d29/d31/d40/f50 x:0 0 0 2024-02-07T12:25:42.453 INFO:tasks.workunit.client.0.smithi047.stdout:7/235: chown d0/df/d29/l37 787034685 1 2024-02-07T12:25:42.454 INFO:tasks.workunit.client.0.smithi047.stdout:4/162: stat d3/l19 0 2024-02-07T12:25:42.457 INFO:tasks.workunit.client.0.smithi047.stdout:3/192: dwrite d12/f3d [0,4194304] 0 2024-02-07T12:25:42.457 INFO:tasks.workunit.client.0.smithi047.stdout:3/193: truncate d12/d19/d21/d29/d31/f32 533187 0 2024-02-07T12:25:42.457 INFO:tasks.workunit.client.0.smithi047.stdout:4/163: truncate d3/f17 540857 0 2024-02-07T12:25:42.460 INFO:tasks.workunit.client.0.smithi047.stdout:3/194: symlink d12/d19/d21/l43 0 2024-02-07T12:25:42.460 INFO:tasks.workunit.client.0.smithi047.stdout:3/195: write d12/d19/d2d/d33/f35 [1187329,39328] 0 2024-02-07T12:25:42.460 INFO:tasks.workunit.client.0.smithi047.stdout:3/196: write d12/d19/d21/d29/f41 [341047,91600] 0 2024-02-07T12:25:42.460 INFO:tasks.workunit.client.0.smithi047.stdout:3/197: fsync f11 0 2024-02-07T12:25:42.466 INFO:tasks.workunit.client.0.smithi047.stdout:3/198: dread d12/f14 [0,4194304] 0 2024-02-07T12:25:42.467 INFO:tasks.workunit.client.0.smithi047.stdout:3/199: getdents d12/d19 0 2024-02-07T12:25:42.468 INFO:tasks.workunit.client.0.smithi047.stdout:3/200: mkdir d12/d19/d21/d29/d44 0 2024-02-07T12:25:42.468 INFO:tasks.workunit.client.0.smithi047.stdout:3/201: creat d12/d19/d21/d29/d31/f45 x:0 0 0 2024-02-07T12:25:42.469 INFO:tasks.workunit.client.0.smithi047.stdout:1/153: dwrite d1/d15/d18/f27 [0,4194304] 0 2024-02-07T12:25:42.469 INFO:tasks.workunit.client.0.smithi047.stdout:1/154: fsync d1/fe 0 2024-02-07T12:25:42.469 INFO:tasks.workunit.client.0.smithi047.stdout:6/203: dwrite d3/d1e/f2f [0,4194304] 0 2024-02-07T12:25:42.469 INFO:tasks.workunit.client.0.smithi047.stdout:6/204: write d3/d1e/f21 [5049480,30409] 0 2024-02-07T12:25:42.470 INFO:tasks.workunit.client.0.smithi047.stdout:3/202: mkdir d12/d19/d46 0 2024-02-07T12:25:42.470 INFO:tasks.workunit.client.0.smithi047.stdout:3/203: fdatasync f2 0 2024-02-07T12:25:42.470 INFO:tasks.workunit.client.0.smithi047.stdout:9/98: dwrite d3/d10/f1f [0,4194304] 0 2024-02-07T12:25:42.470 INFO:tasks.workunit.client.0.smithi047.stdout:8/254: dwrite d3/f17 [0,4194304] 0 2024-02-07T12:25:42.476 INFO:tasks.workunit.client.0.smithi047.stdout:3/204: truncate d12/d19/f26 2560861 0 2024-02-07T12:25:42.477 INFO:tasks.workunit.client.0.smithi047.stdout:9/99: dread d3/d10/f1f [0,4194304] 0 2024-02-07T12:25:42.480 INFO:tasks.workunit.client.0.smithi047.stdout:5/249: rmdir da/df/d16 39 2024-02-07T12:25:42.485 INFO:tasks.workunit.client.0.smithi047.stdout:8/255: rename d3/d36/l40 to d3/d4/d4d/l4f 0 2024-02-07T12:25:42.485 INFO:tasks.workunit.client.0.smithi047.stdout:8/256: chown d3/f3f 3995346 1 2024-02-07T12:25:42.487 INFO:tasks.workunit.client.0.smithi047.stdout:6/205: dwrite d3/da/f37 [0,4194304] 0 2024-02-07T12:25:42.487 INFO:tasks.workunit.client.0.smithi047.stdout:6/206: write d3/d5/f13 [4329494,99600] 0 2024-02-07T12:25:42.488 INFO:tasks.workunit.client.0.smithi047.stdout:1/155: link d1/fe d1/d15/d18/f2b 0 2024-02-07T12:25:42.488 INFO:tasks.workunit.client.0.smithi047.stdout:4/164: getdents d3/d30 0 2024-02-07T12:25:42.491 INFO:tasks.workunit.client.0.smithi047.stdout:3/205: creat d12/d19/f47 x:0 0 0 2024-02-07T12:25:42.491 INFO:tasks.workunit.client.0.smithi047.stdout:7/236: fsync d0/df/d29/d31/d40/f50 0 2024-02-07T12:25:42.492 INFO:tasks.workunit.client.0.smithi047.stdout:9/100: truncate d3/fe 1957969 0 2024-02-07T12:25:42.492 INFO:tasks.workunit.client.0.smithi047.stdout:9/101: creat d3/f21 x:0 0 0 2024-02-07T12:25:42.492 INFO:tasks.workunit.client.0.smithi047.stdout:9/102: chown f2 2 1 2024-02-07T12:25:42.497 INFO:tasks.workunit.client.0.smithi047.stdout:8/257: rename d3/d16 to d3/d36/d50 0 2024-02-07T12:25:42.498 INFO:tasks.workunit.client.0.smithi047.stdout:4/165: dread d3/f17 [0,4194304] 0 2024-02-07T12:25:42.498 INFO:tasks.workunit.client.0.smithi047.stdout:5/250: dwrite da/d24/f45 [0,4194304] 0 2024-02-07T12:25:42.502 INFO:tasks.workunit.client.0.smithi047.stdout:3/206: link l10 d12/d19/d21/d29/d31/d38/l48 0 2024-02-07T12:25:42.502 INFO:tasks.workunit.client.0.smithi047.stdout:3/207: fsync d12/d19/d21/f2c 0 2024-02-07T12:25:42.505 INFO:tasks.workunit.client.0.smithi047.stdout:8/258: unlink d3/d36/d50/c29 0 2024-02-07T12:25:42.506 INFO:tasks.workunit.client.0.smithi047.stdout:4/166: creat d3/d30/f35 x:0 0 0 2024-02-07T12:25:42.508 INFO:tasks.workunit.client.0.smithi047.stdout:1/156: mknod d1/c2c 0 2024-02-07T12:25:42.508 INFO:tasks.workunit.client.0.smithi047.stdout:7/237: write d0/d4/fe [506710,14326] 0 2024-02-07T12:25:42.513 INFO:tasks.workunit.client.0.smithi047.stdout:3/208: mkdir d12/d19/d21/d29/d31/d38/d49 0 2024-02-07T12:25:42.514 INFO:tasks.workunit.client.0.smithi047.stdout:6/207: dwrite d3/d5/d35/f3d [0,4194304] 0 2024-02-07T12:25:42.514 INFO:tasks.workunit.client.0.smithi047.stdout:9/103: dwrite d3/d10/d18/f1a [0,4194304] 0 2024-02-07T12:25:42.517 INFO:tasks.workunit.client.0.smithi047.stdout:1/157: creat d1/d2a/f2d x:0 0 0 2024-02-07T12:25:42.517 INFO:tasks.workunit.client.0.smithi047.stdout:7/238: dread d0/d42/f45 [0,4194304] 0 2024-02-07T12:25:42.523 INFO:tasks.workunit.client.0.smithi047.stdout:3/209: rename d12/c17 to d12/d19/d21/d29/d31/c4a 0 2024-02-07T12:25:42.523 INFO:tasks.workunit.client.0.smithi047.stdout:8/259: dwrite d3/d4/d1f/f2e [0,4194304] 0 2024-02-07T12:25:42.528 INFO:tasks.workunit.client.0.smithi047.stdout:7/239: dread d0/df/f11 [0,4194304] 0 2024-02-07T12:25:42.529 INFO:tasks.workunit.client.0.smithi047.stdout:7/240: truncate d0/df/d29/d31/d40/f50 80258 0 2024-02-07T12:25:42.530 INFO:tasks.workunit.client.0.smithi047.stdout:6/208: symlink d3/d1e/d25/l43 0 2024-02-07T12:25:42.530 INFO:tasks.workunit.client.0.smithi047.stdout:6/209: chown d3/d5/f7 13823 1 2024-02-07T12:25:42.530 INFO:tasks.workunit.client.0.smithi047.stdout:6/210: write d3/d1e/f31 [3689871,48471] 0 2024-02-07T12:25:42.532 INFO:tasks.workunit.client.0.smithi047.stdout:9/104: dread d3/fe [0,4194304] 0 2024-02-07T12:25:42.536 INFO:tasks.workunit.client.0.smithi047.stdout:4/167: truncate d3/f14 3677692 0 2024-02-07T12:25:42.538 INFO:tasks.workunit.client.0.smithi047.stdout:3/210: mknod d12/d19/d46/c4b 0 2024-02-07T12:25:42.538 INFO:tasks.workunit.client.0.smithi047.stdout:3/211: fdatasync f9 0 2024-02-07T12:25:42.540 INFO:tasks.workunit.client.0.smithi047.stdout:8/260: rmdir d3/d36/d50/d28 39 2024-02-07T12:25:42.540 INFO:tasks.workunit.client.0.smithi047.stdout:8/261: chown d3/d4/d1f/l44 183 1 2024-02-07T12:25:42.542 INFO:tasks.workunit.client.0.smithi047.stdout:7/241: mkdir d0/df/d51 0 2024-02-07T12:25:42.542 INFO:tasks.workunit.client.0.smithi047.stdout:7/242: chown d0/df/c2b 28991754 1 2024-02-07T12:25:42.542 INFO:tasks.workunit.client.0.smithi047.stdout:9/105: dread d3/f9 [0,4194304] 0 2024-02-07T12:25:42.542 INFO:tasks.workunit.client.0.smithi047.stdout:9/106: fdatasync d3/d10/d18/f1a 0 2024-02-07T12:25:42.543 INFO:tasks.workunit.client.0.smithi047.stdout:4/168: creat d3/d27/d2a/f36 x:0 0 0 2024-02-07T12:25:42.543 INFO:tasks.workunit.client.0.smithi047.stdout:4/169: truncate d3/f12 819521 0 2024-02-07T12:25:42.544 INFO:tasks.workunit.client.0.smithi047.stdout:1/158: symlink d1/d15/d18/l2e 0 2024-02-07T12:25:42.544 INFO:tasks.workunit.client.0.smithi047.stdout:1/159: write d1/d15/d18/f26 [98161,55205] 0 2024-02-07T12:25:42.546 INFO:tasks.workunit.client.0.smithi047.stdout:3/212: mkdir d12/d19/d21/d29/d31/d38/d4c 0 2024-02-07T12:25:42.550 INFO:tasks.workunit.client.0.smithi047.stdout:8/262: rename d3/d36/d50/f4e to d3/d4/d1f/f51 0 2024-02-07T12:25:42.550 INFO:tasks.workunit.client.0.smithi047.stdout:8/263: stat d3/d36/d50/f2d 0 2024-02-07T12:25:42.551 INFO:tasks.workunit.client.0.smithi047.stdout:7/243: rmdir d0/df/d51 0 2024-02-07T12:25:42.551 INFO:tasks.workunit.client.0.smithi047.stdout:7/244: chown d0/d42/f45 157424347 1 2024-02-07T12:25:42.551 INFO:tasks.workunit.client.0.smithi047.stdout:7/245: dread - d0/df/d29/d3e/f46 zero size 2024-02-07T12:25:42.551 INFO:tasks.workunit.client.0.smithi047.stdout:7/246: write d0/d42/f4f [459983,69986] 0 2024-02-07T12:25:42.551 INFO:tasks.workunit.client.0.smithi047.stdout:7/247: write d0/f47 [596262,99111] 0 2024-02-07T12:25:42.552 INFO:tasks.workunit.client.0.smithi047.stdout:3/213: creat d12/d19/d2d/d42/f4d x:0 0 0 2024-02-07T12:25:42.552 INFO:tasks.workunit.client.0.smithi047.stdout:3/214: write d12/f16 [206765,96861] 0 2024-02-07T12:25:42.552 INFO:tasks.workunit.client.0.smithi047.stdout:3/215: chown d12/d19/d21/d29/d31/f32 3272177 1 2024-02-07T12:25:42.553 INFO:tasks.workunit.client.0.smithi047.stdout:3/216: chown d12/l20 64405752 1 2024-02-07T12:25:42.553 INFO:tasks.workunit.client.0.smithi047.stdout:3/217: fsync d12/d19/d21/d29/d31/f45 0 2024-02-07T12:25:42.553 INFO:tasks.workunit.client.0.smithi047.stdout:3/218: write d12/d19/d21/d29/d31/f45 [484451,90389] 0 2024-02-07T12:25:42.553 INFO:tasks.workunit.client.0.smithi047.stdout:7/248: chown d0/c19 93 1 2024-02-07T12:25:42.553 INFO:tasks.workunit.client.0.smithi047.stdout:7/249: creat d0/df/d29/d31/d40/f52 x:0 0 0 2024-02-07T12:25:42.555 INFO:tasks.workunit.client.0.smithi047.stdout:6/211: dwrite d3/da/d14/f1c [0,4194304] 0 2024-02-07T12:25:42.557 INFO:tasks.workunit.client.0.smithi047.stdout:9/107: write d3/d10/d18/f1a [2798319,126981] 0 2024-02-07T12:25:42.558 INFO:tasks.workunit.client.0.smithi047.stdout:7/250: write d0/d42/f45 [1657456,121990] 0 2024-02-07T12:25:42.558 INFO:tasks.workunit.client.0.smithi047.stdout:7/251: write d0/df/d29/d3e/f46 [257183,355] 0 2024-02-07T12:25:42.558 INFO:tasks.workunit.client.0.smithi047.stdout:7/252: write d0/df/d29/d31/f34 [856887,56635] 0 2024-02-07T12:25:42.559 INFO:tasks.workunit.client.0.smithi047.stdout:3/219: getdents d12/d19/d2d 0 2024-02-07T12:25:42.559 INFO:tasks.workunit.client.0.smithi047.stdout:3/220: write d12/d19/d2d/d33/f3a [550744,59541] 0 2024-02-07T12:25:42.562 INFO:tasks.workunit.client.0.smithi047.stdout:6/212: mknod d3/da/c44 0 2024-02-07T12:25:42.562 INFO:tasks.workunit.client.0.smithi047.stdout:9/108: write d3/fe [1783868,30793] 0 2024-02-07T12:25:42.563 INFO:tasks.workunit.client.0.smithi047.stdout:3/221: write d12/f18 [1907692,54314] 0 2024-02-07T12:25:42.565 INFO:tasks.workunit.client.0.smithi047.stdout:7/253: unlink d0/df/d29/d3e/f44 0 2024-02-07T12:25:42.569 INFO:tasks.workunit.client.0.smithi047.stdout:3/222: creat d12/d19/d2d/f4e x:0 0 0 2024-02-07T12:25:42.571 INFO:tasks.workunit.client.0.smithi047.stdout:7/254: unlink d0/df/d29/c25 0 2024-02-07T12:25:42.572 INFO:tasks.workunit.client.0.smithi047.stdout:7/255: getdents d0/d42/d4d 0 2024-02-07T12:25:42.573 INFO:tasks.workunit.client.0.smithi047.stdout:4/170: dwrite d3/f6 [0,4194304] 0 2024-02-07T12:25:42.573 INFO:tasks.workunit.client.0.smithi047.stdout:4/171: stat d3/c1d 0 2024-02-07T12:25:42.573 INFO:tasks.workunit.client.0.smithi047.stdout:4/172: chown d3/l15 22163 1 2024-02-07T12:25:42.573 INFO:tasks.workunit.client.0.smithi047.stdout:3/223: getdents d12/d19/d21 0 2024-02-07T12:25:42.574 INFO:tasks.workunit.client.0.smithi047.stdout:1/160: dwrite d1/d15/f1c [0,4194304] 0 2024-02-07T12:25:42.574 INFO:tasks.workunit.client.0.smithi047.stdout:7/256: mknod d0/d2f/c53 0 2024-02-07T12:25:42.575 INFO:tasks.workunit.client.0.smithi047.stdout:8/264: dwrite d3/d4/f1e [0,4194304] 0 2024-02-07T12:25:42.575 INFO:tasks.workunit.client.0.smithi047.stdout:8/265: write d3/f17 [4989308,66442] 0 2024-02-07T12:25:42.577 INFO:tasks.workunit.client.0.smithi047.stdout:4/173: mkdir d3/d30/d37 0 2024-02-07T12:25:42.577 INFO:tasks.workunit.client.0.smithi047.stdout:4/174: chown d3/d27/d2a/l33 33641019 1 2024-02-07T12:25:42.578 INFO:tasks.workunit.client.0.smithi047.stdout:3/224: creat d12/d19/d37/f4f x:0 0 0 2024-02-07T12:25:42.579 INFO:tasks.workunit.client.0.smithi047.stdout:1/161: mkdir d1/d15/d2f 0 2024-02-07T12:25:42.580 INFO:tasks.workunit.client.0.smithi047.stdout:7/257: rename d0/l26 to d0/df/l54 0 2024-02-07T12:25:42.584 INFO:tasks.workunit.client.0.smithi047.stdout:6/213: dwrite d3/da/f37 [0,4194304] 0 2024-02-07T12:25:42.585 INFO:tasks.workunit.client.0.smithi047.stdout:4/175: unlink d3/l15 0 2024-02-07T12:25:42.585 INFO:tasks.workunit.client.0.smithi047.stdout:4/176: fdatasync d3/fb 0 2024-02-07T12:25:42.586 INFO:tasks.workunit.client.0.smithi047.stdout:4/177: chown d3/d27/f28 1 1 2024-02-07T12:25:42.586 INFO:tasks.workunit.client.0.smithi047.stdout:4/178: creat d3/d30/f38 x:0 0 0 2024-02-07T12:25:42.586 INFO:tasks.workunit.client.0.smithi047.stdout:4/179: creat d3/d27/d2a/f39 x:0 0 0 2024-02-07T12:25:42.586 INFO:tasks.workunit.client.0.smithi047.stdout:4/180: write d3/f17 [631669,11684] 0 2024-02-07T12:25:42.586 INFO:tasks.workunit.client.0.smithi047.stdout:4/181: chown d3/c16 6 1 2024-02-07T12:25:42.587 INFO:tasks.workunit.client.0.smithi047.stdout:3/225: symlink d12/d19/d2d/l50 0 2024-02-07T12:25:42.591 INFO:tasks.workunit.client.0.smithi047.stdout:1/162: mkdir d1/d15/d30 0 2024-02-07T12:25:42.592 INFO:tasks.workunit.client.0.smithi047.stdout:7/258: mkdir d0/df/d29/d31/d55 0 2024-02-07T12:25:42.594 INFO:tasks.workunit.client.0.smithi047.stdout:8/266: link d3/d36/d50/d30/l3a d3/d36/d50/d2a/l52 0 2024-02-07T12:25:42.612 INFO:tasks.workunit.client.0.smithi047.stdout:1/163: mknod d1/d2a/c31 0 2024-02-07T12:25:42.613 INFO:tasks.workunit.client.0.smithi047.stdout:7/259: rename d0/df/d29/d31/d40/f52 to d0/df/d29/d3e/f56 0 2024-02-07T12:25:42.613 INFO:tasks.workunit.client.0.smithi047.stdout:1/164: dread d1/d15/f1e [0,4194304] 0 2024-02-07T12:25:42.615 INFO:tasks.workunit.client.0.smithi047.stdout:6/214: dwrite d3/d1e/f21 [0,4194304] 0 2024-02-07T12:25:42.615 INFO:tasks.workunit.client.0.smithi047.stdout:4/182: dwrite d3/f1a [0,4194304] 0 2024-02-07T12:25:42.616 INFO:tasks.workunit.client.0.smithi047.stdout:8/267: dwrite d3/d4/d1f/f51 [0,4194304] 0 2024-02-07T12:25:42.620 INFO:tasks.workunit.client.0.smithi047.stdout:7/260: rename d0/f1a to d0/d42/f57 0 2024-02-07T12:25:42.623 INFO:tasks.workunit.client.0.smithi047.stdout:1/165: unlink d1/d15/d18/l2e 0 2024-02-07T12:25:42.627 INFO:tasks.workunit.client.0.smithi047.stdout:8/268: getdents d3/d36/d50/d30/d34 0 2024-02-07T12:25:42.632 INFO:tasks.workunit.client.0.smithi047.stdout:1/166: readlink d1/ld 0 2024-02-07T12:25:42.632 INFO:tasks.workunit.client.0.smithi047.stdout:3/226: rmdir d12 39 2024-02-07T12:25:42.632 INFO:tasks.workunit.client.0.smithi047.stdout:6/215: dread d3/d5/f7 [0,4194304] 0 2024-02-07T12:25:42.632 INFO:tasks.workunit.client.0.smithi047.stdout:8/269: mknod d3/d36/d50/d2a/d3c/c53 0 2024-02-07T12:25:42.632 INFO:tasks.workunit.client.0.smithi047.stdout:3/227: creat d12/d19/d46/f51 x:0 0 0 2024-02-07T12:25:42.633 INFO:tasks.workunit.client.0.smithi047.stdout:6/216: mkdir d3/d5/d35/d3c/d45 0 2024-02-07T12:25:42.636 INFO:tasks.workunit.client.0.smithi047.stdout:6/217: write d3/d5/f26 [4497077,101404] 0 2024-02-07T12:25:42.636 INFO:tasks.workunit.client.0.smithi047.stdout:3/228: mkdir d12/d19/d2d/d52 0 2024-02-07T12:25:42.636 INFO:tasks.workunit.client.0.smithi047.stdout:3/229: fsync d12/f3d 0 2024-02-07T12:25:42.636 INFO:tasks.workunit.client.0.smithi047.stdout:3/230: write d12/d19/f47 [800944,107595] 0 2024-02-07T12:25:42.638 INFO:tasks.workunit.client.0.smithi047.stdout:1/167: dread d1/fe [0,4194304] 0 2024-02-07T12:25:42.640 INFO:tasks.workunit.client.0.smithi047.stdout:3/231: dread d12/d19/f1d [0,4194304] 0 2024-02-07T12:25:42.640 INFO:tasks.workunit.client.0.smithi047.stdout:3/232: write d12/d19/d2d/f4e [1009918,78512] 0 2024-02-07T12:25:42.640 INFO:tasks.workunit.client.0.smithi047.stdout:3/233: chown l8 718 1 2024-02-07T12:25:42.641 INFO:tasks.workunit.client.0.smithi047.stdout:8/270: unlink d3/d36/d50/d2a/f33 0 2024-02-07T12:25:42.641 INFO:tasks.workunit.client.0.smithi047.stdout:4/183: dwrite d3/f17 [0,4194304] 0 2024-02-07T12:25:42.642 INFO:tasks.workunit.client.0.smithi047.stdout:4/184: chown d3/ca 58390866 1 2024-02-07T12:25:42.642 INFO:tasks.workunit.client.0.smithi047.stdout:4/185: fsync d3/f5 0 2024-02-07T12:25:42.643 INFO:tasks.workunit.client.0.smithi047.stdout:7/261: dwrite d0/d4/f5 [4194304,4194304] 0 2024-02-07T12:25:42.643 INFO:tasks.workunit.client.0.smithi047.stdout:3/234: creat d12/d19/f53 x:0 0 0 2024-02-07T12:25:42.643 INFO:tasks.workunit.client.0.smithi047.stdout:7/262: fdatasync d0/d4/f16 0 2024-02-07T12:25:42.645 INFO:tasks.workunit.client.0.smithi047.stdout:4/186: symlink d3/l3a 0 2024-02-07T12:25:42.648 INFO:tasks.workunit.client.0.smithi047.stdout:7/263: symlink d0/d4/l58 0 2024-02-07T12:25:42.648 INFO:tasks.workunit.client.0.smithi047.stdout:1/168: dread d1/d15/f1c [0,4194304] 0 2024-02-07T12:25:42.648 INFO:tasks.workunit.client.0.smithi047.stdout:8/271: dread d3/f27 [0,4194304] 0 2024-02-07T12:25:42.650 INFO:tasks.workunit.client.0.smithi047.stdout:7/264: rename d0/df/d29/f2d to d0/df/d29/d3e/f59 0 2024-02-07T12:25:42.651 INFO:tasks.workunit.client.0.smithi047.stdout:7/265: readlink d0/df/d29/l27 0 2024-02-07T12:25:42.651 INFO:tasks.workunit.client.0.smithi047.stdout:7/266: fdatasync d0/f36 0 2024-02-07T12:25:42.651 INFO:tasks.workunit.client.0.smithi047.stdout:1/169: mknod d1/d15/d30/c32 0 2024-02-07T12:25:42.651 INFO:tasks.workunit.client.0.smithi047.stdout:1/170: chown d1/d15/d18/f26 23029 1 2024-02-07T12:25:42.653 INFO:tasks.workunit.client.0.smithi047.stdout:8/272: mknod d3/d36/d50/d30/d34/c54 0 2024-02-07T12:25:42.655 INFO:tasks.workunit.client.0.smithi047.stdout:6/218: dread d3/d5/f15 [0,4194304] 0 2024-02-07T12:25:42.655 INFO:tasks.workunit.client.0.smithi047.stdout:6/219: write d3/d1e/f31 [1795171,118697] 0 2024-02-07T12:25:42.655 INFO:tasks.workunit.client.0.smithi047.stdout:6/220: write d3/f8 [2004112,130983] 0 2024-02-07T12:25:42.657 INFO:tasks.workunit.client.0.smithi047.stdout:7/267: unlink d0/cc 0 2024-02-07T12:25:42.659 INFO:tasks.workunit.client.0.smithi047.stdout:8/273: unlink d3/d4/fc 0 2024-02-07T12:25:42.659 INFO:tasks.workunit.client.0.smithi047.stdout:8/274: creat d3/d4/f55 x:0 0 0 2024-02-07T12:25:42.659 INFO:tasks.workunit.client.0.smithi047.stdout:8/275: creat d3/f56 x:0 0 0 2024-02-07T12:25:42.659 INFO:tasks.workunit.client.0.smithi047.stdout:8/276: truncate d3/f56 844484 0 2024-02-07T12:25:42.659 INFO:tasks.workunit.client.0.smithi047.stdout:4/187: write d3/f6 [3687517,36371] 0 2024-02-07T12:25:42.659 INFO:tasks.workunit.client.0.smithi047.stdout:4/188: truncate d3/f12 1683603 0 2024-02-07T12:25:42.659 INFO:tasks.workunit.client.0.smithi047.stdout:4/189: chown d3/l29 653 1 2024-02-07T12:25:42.660 INFO:tasks.workunit.client.0.smithi047.stdout:6/221: mkdir d3/da/d14/d28/d46 0 2024-02-07T12:25:42.662 INFO:tasks.workunit.client.0.smithi047.stdout:7/268: mknod d0/d42/c5a 0 2024-02-07T12:25:42.666 INFO:tasks.workunit.client.0.smithi047.stdout:4/190: mkdir d3/d27/d3b 0 2024-02-07T12:25:42.667 INFO:tasks.workunit.client.0.smithi047.stdout:6/222: mkdir d3/da/d2c/d47 0 2024-02-07T12:25:42.670 INFO:tasks.workunit.client.0.smithi047.stdout:4/191: creat d3/d27/d3b/f3c x:0 0 0 2024-02-07T12:25:42.670 INFO:tasks.workunit.client.0.smithi047.stdout:4/192: dread - d3/d27/f28 zero size 2024-02-07T12:25:42.671 INFO:tasks.workunit.client.0.smithi047.stdout:1/171: dwrite d1/d2a/f2d [0,4194304] 0 2024-02-07T12:25:42.673 INFO:tasks.workunit.client.0.smithi047.stdout:4/193: rename d3/l18 to d3/d27/l3d 0 2024-02-07T12:25:42.675 INFO:tasks.workunit.client.0.smithi047.stdout:7/269: write d0/f2 [4021642,73723] 0 2024-02-07T12:25:42.680 INFO:tasks.workunit.client.0.smithi047.stdout:8/277: dwrite d3/d4/d1f/f51 [0,4194304] 0 2024-02-07T12:25:42.682 INFO:tasks.workunit.client.0.smithi047.stdout:3/235: truncate d12/d19/d2d/f4e 82688 0 2024-02-07T12:25:42.686 INFO:tasks.workunit.client.0.smithi047.stdout:1/172: write d1/d15/d18/f27 [3655908,35825] 0 2024-02-07T12:25:42.687 INFO:tasks.workunit.client.0.smithi047.stdout:3/236: link la d12/d19/d21/l54 0 2024-02-07T12:25:42.689 INFO:tasks.workunit.client.0.smithi047.stdout:1/173: symlink d1/d15/l33 0 2024-02-07T12:25:42.689 INFO:tasks.workunit.client.0.smithi047.stdout:1/174: fdatasync d1/d15/d18/f26 0 2024-02-07T12:25:42.689 INFO:tasks.workunit.client.0.smithi047.stdout:1/175: fdatasync d1/d15/f1e 0 2024-02-07T12:25:42.690 INFO:tasks.workunit.client.0.smithi047.stdout:1/176: read - d1/d15/d18/f1d zero size 2024-02-07T12:25:42.692 INFO:tasks.workunit.client.0.smithi047.stdout:1/177: truncate d1/fe 746627 0 2024-02-07T12:25:42.694 INFO:tasks.workunit.client.0.smithi047.stdout:1/178: rmdir d1 39 2024-02-07T12:25:42.695 INFO:tasks.workunit.client.0.smithi047.stdout:3/237: dread d12/d19/d2d/d33/f35 [0,4194304] 0 2024-02-07T12:25:42.699 INFO:tasks.workunit.client.0.smithi047.stdout:8/278: dwrite d3/d4/d1f/f46 [4194304,4194304] 0 2024-02-07T12:25:42.699 INFO:tasks.workunit.client.0.smithi047.stdout:7/270: dwrite d0/d42/f4f [0,4194304] 0 2024-02-07T12:25:42.703 INFO:tasks.workunit.client.0.smithi047.stdout:4/194: rmdir d3/d27/d3b 39 2024-02-07T12:25:42.703 INFO:tasks.workunit.client.0.smithi047.stdout:4/195: truncate d3/f14 3857454 0 2024-02-07T12:25:42.707 INFO:tasks.workunit.client.0.smithi047.stdout:8/279: creat d3/d36/d50/d2a/d3c/f57 x:0 0 0 2024-02-07T12:25:42.712 INFO:tasks.workunit.client.0.smithi047.stdout:4/196: rename d3/l3a to d3/d27/d2a/l3e 0 2024-02-07T12:25:42.715 INFO:tasks.workunit.client.0.smithi047.stdout:3/238: dwrite d12/d19/d21/d29/d31/f3e [0,4194304] 0 2024-02-07T12:25:42.722 INFO:tasks.workunit.client.0.smithi047.stdout:3/239: creat d12/d19/d2d/d42/f55 x:0 0 0 2024-02-07T12:25:42.722 INFO:tasks.workunit.client.0.smithi047.stdout:3/240: chown d12/d19/f26 48494 1 2024-02-07T12:25:42.725 INFO:tasks.workunit.client.0.smithi047.stdout:3/241: rename d12/d19/f47 to d12/d19/d2d/d42/f56 0 2024-02-07T12:25:42.725 INFO:tasks.workunit.client.0.smithi047.stdout:8/280: dwrite d3/d4/fa [4194304,4194304] 0 2024-02-07T12:25:42.730 INFO:tasks.workunit.client.0.smithi047.stdout:3/242: symlink d12/d19/d2d/d52/l57 0 2024-02-07T12:25:42.730 INFO:tasks.workunit.client.0.smithi047.stdout:3/243: truncate d12/d19/d21/d29/f2f 126604 0 2024-02-07T12:25:42.730 INFO:tasks.workunit.client.0.smithi047.stdout:3/244: chown d12/f25 136 1 2024-02-07T12:25:42.730 INFO:tasks.workunit.client.0.smithi047.stdout:3/245: truncate f11 4395620 0 2024-02-07T12:25:42.732 INFO:tasks.workunit.client.0.smithi047.stdout:8/281: symlink d3/d36/l58 0 2024-02-07T12:25:42.732 INFO:tasks.workunit.client.0.smithi047.stdout:8/282: stat d3/l20 0 2024-02-07T12:25:42.733 INFO:tasks.workunit.client.0.smithi047.stdout:3/246: symlink d12/d19/d21/d29/l58 0 2024-02-07T12:25:42.734 INFO:tasks.workunit.client.0.smithi047.stdout:3/247: stat d12/d19/d37/f4f 0 2024-02-07T12:25:42.735 INFO:tasks.workunit.client.0.smithi047.stdout:3/248: mkdir d12/d19/d21/d29/d31/d38/d59 0 2024-02-07T12:25:42.736 INFO:tasks.workunit.client.0.smithi047.stdout:8/283: rmdir d3/d36/d50/d2a/d3c 39 2024-02-07T12:25:42.738 INFO:tasks.workunit.client.0.smithi047.stdout:8/284: mkdir d3/d4/d59 0 2024-02-07T12:25:42.739 INFO:tasks.workunit.client.0.smithi047.stdout:8/285: mknod d3/d4/c5a 0 2024-02-07T12:25:42.739 INFO:tasks.workunit.client.0.smithi047.stdout:8/286: fdatasync d3/d36/d50/d30/d34/f35 0 2024-02-07T12:25:42.739 INFO:tasks.workunit.client.0.smithi047.stdout:8/287: truncate d3/d36/d50/d30/d34/d3e/f48 967334 0 2024-02-07T12:25:42.739 INFO:tasks.workunit.client.0.smithi047.stdout:4/197: dwrite d3/f23 [0,4194304] 0 2024-02-07T12:25:42.740 INFO:tasks.workunit.client.0.smithi047.stdout:1/179: dwrite d1/fe [0,4194304] 0 2024-02-07T12:25:42.740 INFO:tasks.workunit.client.0.smithi047.stdout:8/288: creat d3/d36/d50/f5b x:0 0 0 2024-02-07T12:25:42.741 INFO:tasks.workunit.client.0.smithi047.stdout:1/180: read d1/d15/f1e [73555,115541] 0 2024-02-07T12:25:42.744 INFO:tasks.workunit.client.0.smithi047.stdout:8/289: stat d3/d36/d50/d30/l3a 0 2024-02-07T12:25:42.745 INFO:tasks.workunit.client.0.smithi047.stdout:1/181: read d1/d15/f1c [38683,14629] 0 2024-02-07T12:25:42.745 INFO:tasks.workunit.client.0.smithi047.stdout:1/182: readlink d1/d15/d18/l28 0 2024-02-07T12:25:42.746 INFO:tasks.workunit.client.0.smithi047.stdout:8/290: mknod d3/d36/d50/c5c 0 2024-02-07T12:25:42.749 INFO:tasks.workunit.client.0.smithi047.stdout:8/291: rename d3/c1c to d3/d4/d4d/c5d 0 2024-02-07T12:25:42.749 INFO:tasks.workunit.client.0.smithi047.stdout:8/292: rmdir d3/d36/d50/d30/d34/d3e 39 2024-02-07T12:25:42.751 INFO:tasks.workunit.client.0.smithi047.stdout:8/293: creat d3/d36/d50/d30/f5e x:0 0 0 2024-02-07T12:25:42.751 INFO:tasks.workunit.client.0.smithi047.stdout:8/294: chown d3/f27 592469389 1 2024-02-07T12:25:42.752 INFO:tasks.workunit.client.0.smithi047.stdout:3/249: getdents d12/d19/d21/d29/d31/d38 0 2024-02-07T12:25:42.754 INFO:tasks.workunit.client.0.smithi047.stdout:3/250: write d12/f25 [1038730,48095] 0 2024-02-07T12:25:42.754 INFO:tasks.workunit.client.0.smithi047.stdout:3/251: creat d12/d19/f5a x:0 0 0 2024-02-07T12:25:42.754 INFO:tasks.workunit.client.0.smithi047.stdout:3/252: creat d12/d19/f5b x:0 0 0 2024-02-07T12:25:42.754 INFO:tasks.workunit.client.0.smithi047.stdout:3/253: write d12/d19/f53 [336444,76617] 0 2024-02-07T12:25:42.757 INFO:tasks.workunit.client.0.smithi047.stdout:1/183: dread d1/fe [0,4194304] 0 2024-02-07T12:25:42.757 INFO:tasks.workunit.client.0.smithi047.stdout:4/198: dwrite d3/d27/d3b/f3c [0,4194304] 0 2024-02-07T12:25:42.760 INFO:tasks.workunit.client.0.smithi047.stdout:3/254: rename d12/d19/d21/l22 to d12/d19/l5c 0 2024-02-07T12:25:42.761 INFO:tasks.workunit.client.0.smithi047.stdout:1/184: rmdir d1 39 2024-02-07T12:25:42.765 INFO:tasks.workunit.client.0.smithi047.stdout:1/185: chown d1/cb 298 1 2024-02-07T12:25:42.772 INFO:tasks.workunit.client.0.smithi047.stdout:3/255: dread d12/d19/d21/f2c [0,4194304] 0 2024-02-07T12:25:42.772 INFO:tasks.workunit.client.0.smithi047.stdout:8/295: dwrite d3/d36/d50/d30/d34/f43 [0,4194304] 0 2024-02-07T12:25:42.777 INFO:tasks.workunit.client.0.smithi047.stdout:3/256: link d12/d19/d2d/d42/f55 d12/d19/d46/f5d 0 2024-02-07T12:25:42.777 INFO:tasks.workunit.client.0.smithi047.stdout:4/199: dwrite d3/f23 [0,4194304] 0 2024-02-07T12:25:42.780 INFO:tasks.workunit.client.0.smithi047.stdout:4/200: symlink d3/l3f 0 2024-02-07T12:25:42.783 INFO:tasks.workunit.client.0.smithi047.stdout:4/201: mknod d3/c40 0 2024-02-07T12:25:42.792 INFO:tasks.workunit.client.0.smithi047.stdout:3/257: write d12/d19/d21/d29/d31/f3e [3557835,19939] 0 2024-02-07T12:25:42.792 INFO:tasks.workunit.client.0.smithi047.stdout:3/258: write d12/f13 [3444206,52559] 0 2024-02-07T12:25:42.793 INFO:tasks.workunit.client.0.smithi047.stdout:3/259: symlink d12/d19/d37/l5e 0 2024-02-07T12:25:42.793 INFO:tasks.workunit.client.0.smithi047.stdout:3/260: truncate d12/d19/d46/f5d 992014 0 2024-02-07T12:25:42.794 INFO:tasks.workunit.client.0.smithi047.stdout:3/261: creat d12/d19/d21/d29/d31/d38/d59/f5f x:0 0 0 2024-02-07T12:25:42.796 INFO:tasks.workunit.client.0.smithi047.stdout:3/262: truncate f9 2033447 0 2024-02-07T12:25:42.796 INFO:tasks.workunit.client.0.smithi047.stdout:3/263: stat l10 0 2024-02-07T12:25:42.797 INFO:tasks.workunit.client.0.smithi047.stdout:3/264: mknod d12/d19/d2d/d33/c60 0 2024-02-07T12:25:42.803 INFO:tasks.workunit.client.0.smithi047.stdout:1/186: dwrite d1/d2a/f2d [0,4194304] 0 2024-02-07T12:25:42.804 INFO:tasks.workunit.client.0.smithi047.stdout:8/296: dwrite d3/d4/f1e [0,4194304] 0 2024-02-07T12:25:42.804 INFO:tasks.workunit.client.0.smithi047.stdout:8/297: creat d3/d36/d50/d30/f5f x:0 0 0 2024-02-07T12:25:42.805 INFO:tasks.workunit.client.0.smithi047.stdout:4/202: dwrite d3/f4 [0,4194304] 0 2024-02-07T12:25:42.809 INFO:tasks.workunit.client.0.smithi047.stdout:1/187: rename d1/c10 to d1/c34 0 2024-02-07T12:25:42.809 INFO:tasks.workunit.client.0.smithi047.stdout:1/188: write d1/d15/d18/f1d [611322,53062] 0 2024-02-07T12:25:42.809 INFO:tasks.workunit.client.0.smithi047.stdout:1/189: read - d1/d15/d18/f23 zero size 2024-02-07T12:25:42.816 INFO:tasks.workunit.client.0.smithi047.stdout:1/190: mknod d1/d15/d18/c35 0 2024-02-07T12:25:42.817 INFO:tasks.workunit.client.0.smithi047.stdout:3/265: dwrite d12/f14 [0,4194304] 0 2024-02-07T12:25:42.819 INFO:tasks.workunit.client.0.smithi047.stdout:3/266: mkdir d12/d19/d21/d29/d31/d61 0 2024-02-07T12:25:42.819 INFO:tasks.workunit.client.0.smithi047.stdout:3/267: stat d12/d19/d2d/d42/f56 0 2024-02-07T12:25:42.819 INFO:tasks.workunit.client.0.smithi047.stdout:3/268: fdatasync d12/d19/d2d/d33/f3a 0 2024-02-07T12:25:42.819 INFO:tasks.workunit.client.0.smithi047.stdout:3/269: chown d12/d19/d2d/d42/f55 23714057 1 2024-02-07T12:25:42.821 INFO:tasks.workunit.client.0.smithi047.stdout:3/270: dread d12/d19/d2d/d42/f56 [0,4194304] 0 2024-02-07T12:25:42.821 INFO:tasks.workunit.client.0.smithi047.stdout:3/271: read - d12/d19/f5a zero size 2024-02-07T12:25:42.822 INFO:tasks.workunit.client.0.smithi047.stdout:3/272: symlink d12/d19/l62 0 2024-02-07T12:25:42.823 INFO:tasks.workunit.client.0.smithi047.stdout:3/273: rename d12/d19/d46/f51 to d12/d19/d2d/f63 0 2024-02-07T12:25:42.829 INFO:tasks.workunit.client.0.smithi047.stdout:8/298: dwrite d3/d36/d50/d2a/d3c/f57 [0,4194304] 0 2024-02-07T12:25:42.832 INFO:tasks.workunit.client.0.smithi047.stdout:8/299: link d3/l20 d3/d36/d50/d30/d34/d3e/l60 0 2024-02-07T12:25:42.833 INFO:tasks.workunit.client.0.smithi047.stdout:4/203: dwrite d3/d30/f38 [0,4194304] 0 2024-02-07T12:25:42.840 INFO:tasks.workunit.client.0.smithi047.stdout:8/300: truncate d3/f27 1295771 0 2024-02-07T12:25:42.840 INFO:tasks.workunit.client.0.smithi047.stdout:8/301: creat d3/d36/d50/d30/f61 x:0 0 0 2024-02-07T12:25:42.842 INFO:tasks.workunit.client.0.smithi047.stdout:3/274: dwrite d12/d19/f2e [0,4194304] 0 2024-02-07T12:25:42.850 INFO:tasks.workunit.client.0.smithi047.stdout:8/302: symlink d3/d36/d50/d2a/l62 0 2024-02-07T12:25:42.852 INFO:tasks.workunit.client.0.smithi047.stdout:8/303: mknod d3/d36/d50/d30/d34/c63 0 2024-02-07T12:25:42.852 INFO:tasks.workunit.client.0.smithi047.stdout:3/275: write d12/d19/f26 [1646860,46927] 0 2024-02-07T12:25:42.852 INFO:tasks.workunit.client.0.smithi047.stdout:3/276: chown d12/d19/d21/d29/l58 3215 1 2024-02-07T12:25:42.852 INFO:tasks.workunit.client.0.smithi047.stdout:3/277: stat d12 0 2024-02-07T12:25:42.852 INFO:tasks.workunit.client.0.smithi047.stdout:3/278: fsync d12/d19/d2d/d33/f35 0 2024-02-07T12:25:42.853 INFO:tasks.workunit.client.0.smithi047.stdout:8/304: creat d3/d36/d50/d2a/d3c/f64 x:0 0 0 2024-02-07T12:25:42.854 INFO:tasks.workunit.client.0.smithi047.stdout:4/204: dwrite d3/f14 [0,4194304] 0 2024-02-07T12:25:42.855 INFO:tasks.workunit.client.0.smithi047.stdout:3/279: creat d12/f64 x:0 0 0 2024-02-07T12:25:42.858 INFO:tasks.workunit.client.0.smithi047.stdout:4/205: link l0 d3/d27/d2a/l41 0 2024-02-07T12:25:42.860 INFO:tasks.workunit.client.0.smithi047.stdout:4/206: creat d3/d27/d3b/f42 x:0 0 0 2024-02-07T12:25:42.879 INFO:tasks.workunit.client.0.smithi047.stdout:4/207: dread d3/d27/d3b/f3c [0,4194304] 0 2024-02-07T12:25:42.879 INFO:tasks.workunit.client.0.smithi047.stdout:4/208: fsync d3/f4 0 2024-02-07T12:25:42.883 INFO:tasks.workunit.client.0.smithi047.stdout:8/305: dwrite d3/d4/fa [0,4194304] 0 2024-02-07T12:25:42.883 INFO:tasks.workunit.client.0.smithi047.stdout:8/306: stat d3 0 2024-02-07T12:25:42.883 INFO:tasks.workunit.client.0.smithi047.stdout:3/280: dwrite d12/d19/d21/d29/d31/f3e [0,4194304] 0 2024-02-07T12:25:42.885 INFO:tasks.workunit.client.0.smithi047.stdout:3/281: mknod d12/d19/d21/c65 0 2024-02-07T12:25:42.885 INFO:tasks.workunit.client.0.smithi047.stdout:3/282: chown d12/d19/d21/l54 20292224 1 2024-02-07T12:25:42.885 INFO:tasks.workunit.client.0.smithi047.stdout:3/283: dread - d12/d19/d21/d29/d31/d38/d59/f5f zero size 2024-02-07T12:25:42.885 INFO:tasks.workunit.client.0.smithi047.stdout:3/284: readlink d12/d19/d21/l54 0 2024-02-07T12:25:42.888 INFO:tasks.workunit.client.0.smithi047.stdout:4/209: write d3/f5 [316034,47895] 0 2024-02-07T12:25:42.888 INFO:tasks.workunit.client.0.smithi047.stdout:4/210: read - d3/fb zero size 2024-02-07T12:25:42.889 INFO:tasks.workunit.client.0.smithi047.stdout:4/211: dread d3/f25 [0,4194304] 0 2024-02-07T12:25:42.890 INFO:tasks.workunit.client.0.smithi047.stdout:4/212: mkdir d3/d27/d2a/d43 0 2024-02-07T12:25:42.891 INFO:tasks.workunit.client.0.smithi047.stdout:3/285: dread d12/d19/f28 [0,4194304] 0 2024-02-07T12:25:42.891 INFO:tasks.workunit.client.0.smithi047.stdout:3/286: readlink d12/d19/l5c 0 2024-02-07T12:25:42.891 INFO:tasks.workunit.client.0.smithi047.stdout:8/307: write d3/d4/d1f/f46 [7533331,98884] 0 2024-02-07T12:25:42.892 INFO:tasks.workunit.client.0.smithi047.stdout:4/213: rename d3/d30/f35 to d3/d30/f44 0 2024-02-07T12:25:42.892 INFO:tasks.workunit.client.0.smithi047.stdout:4/214: getdents d3/d30/d37 0 2024-02-07T12:25:42.892 INFO:tasks.workunit.client.0.smithi047.stdout:8/308: dread d3/d36/d50/d30/d34/d3e/f48 [0,4194304] 0 2024-02-07T12:25:42.894 INFO:tasks.workunit.client.0.smithi047.stdout:3/287: rename f9 to d12/d19/d21/d29/f66 0 2024-02-07T12:25:42.894 INFO:tasks.workunit.client.0.smithi047.stdout:3/288: creat d12/d19/d21/d29/d31/d38/d59/f67 x:0 0 0 2024-02-07T12:25:42.897 INFO:tasks.workunit.client.0.smithi047.stdout:3/289: getdents d12 0 2024-02-07T12:25:42.898 INFO:tasks.workunit.client.0.smithi047.stdout:3/290: creat d12/d19/d37/f68 x:0 0 0 2024-02-07T12:25:42.898 INFO:tasks.workunit.client.0.smithi047.stdout:3/291: fdatasync d12/d19/d2d/f4e 0 2024-02-07T12:25:42.898 INFO:tasks.workunit.client.0.smithi047.stdout:3/292: creat d12/d19/d21/d29/d44/f69 x:0 0 0 2024-02-07T12:25:42.904 INFO:tasks.workunit.client.0.smithi047.stdout:3/293: getdents d12/d19/d21/d29 0 2024-02-07T12:25:42.905 INFO:tasks.workunit.client.0.smithi047.stdout:3/294: mknod d12/d19/d21/d29/d31/d38/c6a 0 2024-02-07T12:25:42.907 INFO:tasks.workunit.client.0.smithi047.stdout:8/309: write d3/d36/d50/d2a/f2b [3767723,62840] 0 2024-02-07T12:25:42.907 INFO:tasks.workunit.client.0.smithi047.stdout:4/215: write d3/f20 [459518,94828] 0 2024-02-07T12:25:42.910 INFO:tasks.workunit.client.0.smithi047.stdout:8/310: rename d3/d36/d50/d2a/l52 to d3/d4/l65 0 2024-02-07T12:25:42.912 INFO:tasks.workunit.client.0.smithi047.stdout:4/216: mkdir d3/d27/d2a/d43/d45 0 2024-02-07T12:25:42.912 INFO:tasks.workunit.client.0.smithi047.stdout:4/217: stat d3/d30/d37 0 2024-02-07T12:25:42.913 INFO:tasks.workunit.client.0.smithi047.stdout:8/311: mkdir d3/d66 0 2024-02-07T12:25:42.914 INFO:tasks.workunit.client.0.smithi047.stdout:4/218: mkdir d3/d27/d2a/d43/d46 0 2024-02-07T12:25:42.915 INFO:tasks.workunit.client.0.smithi047.stdout:4/219: fdatasync d3/ff 0 2024-02-07T12:25:42.915 INFO:tasks.workunit.client.0.smithi047.stdout:4/220: dread - d3/d27/d2a/f36 zero size 2024-02-07T12:25:42.915 INFO:tasks.workunit.client.0.smithi047.stdout:4/221: truncate d3/f2b 299518 0 2024-02-07T12:25:42.915 INFO:tasks.workunit.client.0.smithi047.stdout:4/222: symlink d3/d30/l47 0 2024-02-07T12:25:42.917 INFO:tasks.workunit.client.0.smithi047.stdout:4/223: link d3/l1c d3/d27/d3b/l48 0 2024-02-07T12:25:42.923 INFO:tasks.workunit.client.0.smithi047.stdout:3/295: dwrite d12/d19/f53 [0,4194304] 0 2024-02-07T12:25:42.926 INFO:tasks.workunit.client.0.smithi047.stdout:4/224: dread d3/d27/d3b/f3c [0,4194304] 0 2024-02-07T12:25:42.928 INFO:tasks.workunit.client.0.smithi047.stdout:4/225: symlink d3/d27/d2a/d43/d46/l49 0 2024-02-07T12:25:42.928 INFO:tasks.workunit.client.0.smithi047.stdout:4/226: chown d3/f14 911175 1 2024-02-07T12:25:42.934 INFO:tasks.workunit.client.0.smithi047.stdout:8/312: dwrite d3/d36/d50/d30/d34/f3d [0,4194304] 0 2024-02-07T12:25:42.934 INFO:tasks.workunit.client.0.smithi047.stdout:8/313: write d3/f4a [1544292,98518] 0 2024-02-07T12:25:42.939 INFO:tasks.workunit.client.0.smithi047.stdout:4/227: rmdir d3/d27/d3b 39 2024-02-07T12:25:42.941 INFO:tasks.workunit.client.0.smithi047.stdout:4/228: rename d3/d27/l2f to d3/d30/d37/l4a 0 2024-02-07T12:25:42.941 INFO:tasks.workunit.client.0.smithi047.stdout:4/229: chown d3/d27/c31 901936 1 2024-02-07T12:25:42.941 INFO:tasks.workunit.client.0.smithi047.stdout:4/230: write f1 [143132,60332] 0 2024-02-07T12:25:42.943 INFO:tasks.workunit.client.0.smithi047.stdout:4/231: link d3/ca d3/d30/c4b 0 2024-02-07T12:25:42.945 INFO:tasks.workunit.client.0.smithi047.stdout:4/232: rmdir d3/d27/d3b 39 2024-02-07T12:25:42.945 INFO:tasks.workunit.client.0.smithi047.stdout:4/233: dread - d3/d30/f44 zero size 2024-02-07T12:25:42.947 INFO:tasks.workunit.client.0.smithi047.stdout:4/234: creat d3/d27/d2a/d43/f4c x:0 0 0 2024-02-07T12:25:42.950 INFO:tasks.workunit.client.0.smithi047.stdout:4/235: rename d3/d27/d2a/l41 to d3/d30/l4d 0 2024-02-07T12:25:42.950 INFO:tasks.workunit.client.0.smithi047.stdout:4/236: fsync d3/d27/d3b/f42 0 2024-02-07T12:25:42.952 INFO:tasks.workunit.client.0.smithi047.stdout:4/237: truncate d3/d30/f38 4050524 0 2024-02-07T12:25:42.955 INFO:tasks.workunit.client.0.smithi047.stdout:3/296: dwrite d12/d19/d2d/d33/f35 [0,4194304] 0 2024-02-07T12:25:42.956 INFO:tasks.workunit.client.0.smithi047.stdout:3/297: mkdir d12/d19/d2d/d42/d6b 0 2024-02-07T12:25:42.956 INFO:tasks.workunit.client.0.smithi047.stdout:3/298: chown d12/d19/d21/d29/d31/f32 0 1 2024-02-07T12:25:42.957 INFO:tasks.workunit.client.0.smithi047.stdout:8/314: dwrite d3/f17 [0,4194304] 0 2024-02-07T12:25:42.958 INFO:tasks.workunit.client.0.smithi047.stdout:3/299: mknod d12/d19/c6c 0 2024-02-07T12:25:42.960 INFO:tasks.workunit.client.0.smithi047.stdout:4/238: dread f1 [0,4194304] 0 2024-02-07T12:25:42.962 INFO:tasks.workunit.client.0.smithi047.stdout:8/315: mkdir d3/d66/d67 0 2024-02-07T12:25:42.962 INFO:tasks.workunit.client.0.smithi047.stdout:8/316: read - d3/d4/f55 zero size 2024-02-07T12:25:43.000 INFO:tasks.workunit.client.0.smithi047.stdout:4/239: dwrite d3/ff [0,4194304] 0 2024-02-07T12:25:43.000 INFO:tasks.workunit.client.0.smithi047.stdout:4/240: stat d3/d30/l47 0 2024-02-07T12:25:43.000 INFO:tasks.workunit.client.0.smithi047.stdout:8/317: dwrite d3/d4/d1f/f23 [0,4194304] 0 2024-02-07T12:25:43.000 INFO:tasks.workunit.client.0.smithi047.stdout:4/241: fdatasync d3/d27/d2a/d43/f4c 0 2024-02-07T12:25:43.000 INFO:tasks.workunit.client.0.smithi047.stdout:8/318: dread - d3/d36/d50/f5b zero size 2024-02-07T12:25:43.000 INFO:tasks.workunit.client.0.smithi047.stdout:3/300: dwrite d12/d19/d21/d29/d31/f45 [0,4194304] 0 2024-02-07T12:25:43.001 INFO:tasks.workunit.client.0.smithi047.stdout:3/301: write d12/d19/f5b [813440,21598] 0 2024-02-07T12:25:43.001 INFO:tasks.workunit.client.0.smithi047.stdout:4/242: write d3/f2b [119987,129274] 0 2024-02-07T12:25:43.001 INFO:tasks.workunit.client.0.smithi047.stdout:4/243: write d3/f5 [544024,100762] 0 2024-02-07T12:25:43.002 INFO:tasks.workunit.client.0.smithi047.stdout:3/302: truncate d12/d19/f53 29936 0 2024-02-07T12:25:43.004 INFO:tasks.workunit.client.0.smithi047.stdout:3/303: symlink d12/d19/d37/l6d 0 2024-02-07T12:25:43.006 INFO:tasks.workunit.client.0.smithi047.stdout:3/304: symlink d12/d19/d21/d29/d31/d38/l6e 0 2024-02-07T12:25:43.009 INFO:tasks.workunit.client.0.smithi047.stdout:8/319: dread d3/d36/d50/d30/d34/f43 [0,4194304] 0 2024-02-07T12:25:43.009 INFO:tasks.workunit.client.0.smithi047.stdout:3/305: rmdir d12/d19/d2d/d33 39 2024-02-07T12:25:43.009 INFO:tasks.workunit.client.0.smithi047.stdout:3/306: read d12/f25 [133318,5724] 0 2024-02-07T12:25:43.010 INFO:tasks.workunit.client.0.smithi047.stdout:3/307: mkdir d12/d19/d21/d29/d6f 0 2024-02-07T12:25:43.014 INFO:tasks.workunit.client.0.smithi047.stdout:3/308: rmdir d12/d19/d21/d29/d31/d38/d49 0 2024-02-07T12:25:43.015 INFO:tasks.workunit.client.0.smithi047.stdout:3/309: truncate d12/d19/d2d/d33/f35 4252851 0 2024-02-07T12:25:43.015 INFO:tasks.workunit.client.0.smithi047.stdout:3/310: stat d12/d19/c6c 0 2024-02-07T12:25:43.016 INFO:tasks.workunit.client.0.smithi047.stdout:3/311: mknod d12/d19/d21/d29/d6f/c70 0 2024-02-07T12:25:43.020 INFO:tasks.workunit.client.0.smithi047.stdout:8/320: dread d3/d4/d1f/f46 [4194304,4194304] 0 2024-02-07T12:25:43.021 INFO:tasks.workunit.client.0.smithi047.stdout:8/321: write d3/d36/d50/d2a/f2b [2099275,72314] 0 2024-02-07T12:25:43.021 INFO:tasks.workunit.client.0.smithi047.stdout:4/244: dwrite d3/f17 [4194304,4194304] 0 2024-02-07T12:25:43.023 INFO:tasks.workunit.client.0.smithi047.stdout:8/322: link d3/d36/d50/f5b d3/d36/f68 0 2024-02-07T12:25:43.023 INFO:tasks.workunit.client.0.smithi047.stdout:8/323: getdents d3/d66/d67 0 2024-02-07T12:25:43.025 INFO:tasks.workunit.client.0.smithi047.stdout:8/324: truncate d3/d36/f4b 849259 0 2024-02-07T12:25:43.025 INFO:tasks.workunit.client.0.smithi047.stdout:8/325: stat d3/d36 0 2024-02-07T12:25:43.028 INFO:tasks.workunit.client.0.smithi047.stdout:3/312: dread f11 [0,4194304] 0 2024-02-07T12:25:43.028 INFO:tasks.workunit.client.0.smithi047.stdout:3/313: readlink d12/d19/d21/l3f 0 2024-02-07T12:25:43.030 INFO:tasks.workunit.client.0.smithi047.stdout:3/314: creat d12/d19/d21/d29/d31/d38/f71 x:0 0 0 2024-02-07T12:25:43.030 INFO:tasks.workunit.client.0.smithi047.stdout:3/315: fsync d12/d19/d21/d29/d31/f3e 0 2024-02-07T12:25:43.030 INFO:tasks.workunit.client.0.smithi047.stdout:3/316: chown d12/d19/d37/f4f 846316320 1 2024-02-07T12:25:43.030 INFO:tasks.workunit.client.0.smithi047.stdout:3/317: chown d12/d19/f5a 0 1 2024-02-07T12:25:43.040 INFO:tasks.workunit.client.0.smithi047.stdout:3/318: dread d12/d19/d2d/d33/f35 [0,4194304] 0 2024-02-07T12:25:43.049 INFO:tasks.workunit.client.0.smithi047.stdout:4/245: dwrite d3/d27/f28 [0,4194304] 0 2024-02-07T12:25:43.049 INFO:tasks.workunit.client.0.smithi047.stdout:4/246: write d3/f5 [804657,77426] 0 2024-02-07T12:25:43.052 INFO:tasks.workunit.client.0.smithi047.stdout:4/247: creat d3/d27/d3b/f4e x:0 0 0 2024-02-07T12:25:43.058 INFO:tasks.workunit.client.0.smithi047.stdout:4/248: symlink d3/d27/d3b/l4f 0 2024-02-07T12:25:43.058 INFO:tasks.workunit.client.0.smithi047.stdout:8/326: dwrite d3/d4/fa [0,4194304] 0 2024-02-07T12:25:43.058 INFO:tasks.workunit.client.0.smithi047.stdout:8/327: chown d3/d36/d50/c5c 12 1 2024-02-07T12:25:43.058 INFO:tasks.workunit.client.0.smithi047.stdout:3/319: dwrite d12/d19/f5a [0,4194304] 0 2024-02-07T12:25:43.060 INFO:tasks.workunit.client.0.smithi047.stdout:4/249: rename d3/d30/d37/l4a to d3/d27/d2a/l50 0 2024-02-07T12:25:43.060 INFO:tasks.workunit.client.0.smithi047.stdout:4/250: write d3/f4 [4723519,89576] 0 2024-02-07T12:25:43.066 INFO:tasks.workunit.client.0.smithi047.stdout:8/328: rename d3/f3f to d3/d4/d1f/f69 0 2024-02-07T12:25:43.068 INFO:tasks.workunit.client.0.smithi047.stdout:4/251: creat d3/d27/d2a/d43/d45/f51 x:0 0 0 2024-02-07T12:25:43.068 INFO:tasks.workunit.client.0.smithi047.stdout:4/252: readlink d3/d27/d3b/l4f 0 2024-02-07T12:25:43.068 INFO:tasks.workunit.client.0.smithi047.stdout:4/253: readlink d3/d27/d3b/l4f 0 2024-02-07T12:25:43.068 INFO:tasks.workunit.client.0.smithi047.stdout:4/254: chown d3/l1f 3020 1 2024-02-07T12:25:43.068 INFO:tasks.workunit.client.0.smithi047.stdout:4/255: fsync d3/f6 0 2024-02-07T12:25:43.068 INFO:tasks.workunit.client.0.smithi047.stdout:4/256: chown d3/d27/d2a/f36 19833 1 2024-02-07T12:25:43.068 INFO:tasks.workunit.client.0.smithi047.stdout:4/257: fsync d3/f25 0 2024-02-07T12:25:43.069 INFO:tasks.workunit.client.0.smithi047.stdout:3/320: getdents d12/d19/d2d/d42 0 2024-02-07T12:25:43.081 INFO:tasks.workunit.client.0.smithi047.stdout:8/329: rename d3/d4/d1f to d3/d66/d67/d6a 0 2024-02-07T12:25:43.081 INFO:tasks.workunit.client.0.smithi047.stdout:8/330: read d3/d36/f49 [2319686,88854] 0 2024-02-07T12:25:43.082 INFO:tasks.workunit.client.0.smithi047.stdout:8/331: creat d3/d66/d67/d6a/f6b x:0 0 0 2024-02-07T12:25:43.082 INFO:tasks.workunit.client.0.smithi047.stdout:8/332: write d3/d36/d50/d30/d34/f35 [240221,92531] 0 2024-02-07T12:25:43.082 INFO:tasks.workunit.client.0.smithi047.stdout:8/333: stat d3/d4/c38 0 2024-02-07T12:25:43.083 INFO:tasks.workunit.client.0.smithi047.stdout:8/334: rename d3/f9 to d3/d36/f6c 0 2024-02-07T12:25:43.085 INFO:tasks.workunit.client.0.smithi047.stdout:8/335: symlink d3/d36/d50/d2a/l6d 0 2024-02-07T12:25:43.087 INFO:tasks.workunit.client.0.smithi047.stdout:8/336: link d3/d36/d50/d2a/c37 d3/d36/d50/d30/c6e 0 2024-02-07T12:25:43.088 INFO:tasks.workunit.client.0.smithi047.stdout:8/337: creat d3/f6f x:0 0 0 2024-02-07T12:25:43.089 INFO:tasks.workunit.client.0.smithi047.stdout:8/338: getdents d3/d36/d50/d28 0 2024-02-07T12:25:43.090 INFO:tasks.workunit.client.0.smithi047.stdout:8/339: mknod d3/d66/c70 0 2024-02-07T12:25:43.092 INFO:tasks.workunit.client.0.smithi047.stdout:8/340: mkdir d3/d66/d67/d71 0 2024-02-07T12:25:43.092 INFO:tasks.workunit.client.0.smithi047.stdout:8/341: getdents d3/d4/d4d 0 2024-02-07T12:25:43.100 INFO:tasks.workunit.client.0.smithi047.stdout:4/258: dwrite d3/d27/d3b/f4e [0,4194304] 0 2024-02-07T12:25:43.100 INFO:tasks.workunit.client.0.smithi047.stdout:3/321: dwrite d12/d19/d21/d29/d31/d38/d59/f67 [0,4194304] 0 2024-02-07T12:25:43.100 INFO:tasks.workunit.client.0.smithi047.stdout:3/322: write d12/f16 [1107435,9311] 0 2024-02-07T12:25:43.106 INFO:tasks.workunit.client.0.smithi047.stdout:4/259: mknod d3/d27/d2a/d43/d46/c52 0 2024-02-07T12:25:43.106 INFO:tasks.workunit.client.0.smithi047.stdout:4/260: creat d3/d27/d2a/d43/f53 x:0 0 0 2024-02-07T12:25:43.109 INFO:tasks.workunit.client.0.smithi047.stdout:8/342: dread d3/d66/d67/d6a/f46 [0,4194304] 0 2024-02-07T12:25:43.109 INFO:tasks.workunit.client.0.smithi047.stdout:4/261: rename d3/d27/d3b/f3c to d3/f54 0 2024-02-07T12:25:43.109 INFO:tasks.workunit.client.0.smithi047.stdout:4/262: fdatasync d3/d27/d3b/f42 0 2024-02-07T12:25:43.109 INFO:tasks.workunit.client.0.smithi047.stdout:4/263: chown d3/c10 348830545 1 2024-02-07T12:25:43.113 INFO:tasks.workunit.client.0.smithi047.stdout:4/264: unlink d3/fc 0 2024-02-07T12:25:43.115 INFO:tasks.workunit.client.0.smithi047.stdout:4/265: getdents d3/d30/d37 0 2024-02-07T12:25:43.115 INFO:tasks.workunit.client.0.smithi047.stdout:4/266: write d3/d30/f44 [1039056,68408] 0 2024-02-07T12:25:43.118 INFO:tasks.workunit.client.0.smithi047.stdout:3/323: dwrite d12/d19/d2d/d33/f3a [0,4194304] 0 2024-02-07T12:25:43.123 INFO:tasks.workunit.client.0.smithi047.stdout:3/324: link d12/d19/d21/d29/f66 d12/d19/d46/f72 0 2024-02-07T12:25:43.125 INFO:tasks.workunit.client.0.smithi047.stdout:3/325: rename d12/d19/d21/d29/d31/l39 to d12/d19/d21/d29/l73 0 2024-02-07T12:25:43.127 INFO:tasks.workunit.client.0.smithi047.stdout:4/267: dread d3/d27/f28 [0,4194304] 0 2024-02-07T12:25:43.127 INFO:tasks.workunit.client.0.smithi047.stdout:8/343: dwrite d3/d36/d50/d2a/f2b [0,4194304] 0 2024-02-07T12:25:43.127 INFO:tasks.workunit.client.0.smithi047.stdout:3/326: dread d12/d19/d2d/d42/f56 [0,4194304] 0 2024-02-07T12:25:43.128 INFO:tasks.workunit.client.0.smithi047.stdout:4/268: creat d3/d30/d37/f55 x:0 0 0 2024-02-07T12:25:43.131 INFO:tasks.workunit.client.0.smithi047.stdout:8/344: rename d3/d66/d67/d6a/f2e to d3/f72 0 2024-02-07T12:25:43.131 INFO:tasks.workunit.client.0.smithi047.stdout:8/345: chown d3/d66/d67/d6a/f4c 754678 1 2024-02-07T12:25:43.132 INFO:tasks.workunit.client.0.smithi047.stdout:3/327: rename d12/d19/d21/d29/f41 to d12/d19/d37/f74 0 2024-02-07T12:25:43.132 INFO:tasks.workunit.client.0.smithi047.stdout:4/269: rename d3/d27/d2a/d43 to d3/d27/d2a/d43/d46/d56 22 2024-02-07T12:25:43.134 INFO:tasks.workunit.client.0.smithi047.stdout:8/346: mknod d3/d66/d67/c73 0 2024-02-07T12:25:43.134 INFO:tasks.workunit.client.0.smithi047.stdout:8/347: chown d3/d4/d4d/l4f 0 1 2024-02-07T12:25:43.136 INFO:tasks.workunit.client.0.smithi047.stdout:4/270: unlink d3/f25 0 2024-02-07T12:25:43.137 INFO:tasks.workunit.client.0.smithi047.stdout:8/348: symlink d3/d4/d59/l74 0 2024-02-07T12:25:43.137 INFO:tasks.workunit.client.0.smithi047.stdout:8/349: readlink d3/d4/lf 0 2024-02-07T12:25:43.137 INFO:tasks.workunit.client.0.smithi047.stdout:8/350: fdatasync d3/d36/d50/d30/d34/f43 0 2024-02-07T12:25:43.137 INFO:tasks.workunit.client.0.smithi047.stdout:8/351: creat d3/d36/f75 x:0 0 0 2024-02-07T12:25:43.139 INFO:tasks.workunit.client.0.smithi047.stdout:4/271: symlink d3/l57 0 2024-02-07T12:25:43.141 INFO:tasks.workunit.client.0.smithi047.stdout:8/352: mkdir d3/d66/d76 0 2024-02-07T12:25:43.141 INFO:tasks.workunit.client.0.smithi047.stdout:8/353: write d3/d36/d50/d30/d34/f35 [877431,13893] 0 2024-02-07T12:25:43.141 INFO:tasks.workunit.client.0.smithi047.stdout:8/354: dread - d3/d36/d50/f5b zero size 2024-02-07T12:25:43.142 INFO:tasks.workunit.client.0.smithi047.stdout:4/272: rename d3/f1a to d3/d27/d2a/f58 0 2024-02-07T12:25:43.142 INFO:tasks.workunit.client.0.smithi047.stdout:8/355: dread d3/d4/f7 [0,4194304] 0 2024-02-07T12:25:43.143 INFO:tasks.workunit.client.0.smithi047.stdout:8/356: link d3/d36/d50/c22 d3/c77 0 2024-02-07T12:25:43.144 INFO:tasks.workunit.client.0.smithi047.stdout:8/357: creat d3/d36/d50/d30/f78 x:0 0 0 2024-02-07T12:25:43.145 INFO:tasks.workunit.client.0.smithi047.stdout:2/199: sync 2024-02-07T12:25:43.147 INFO:tasks.workunit.client.0.smithi047.stdout:4/273: fsync d3/d30/d37/f55 0 2024-02-07T12:25:43.147 INFO:tasks.workunit.client.0.smithi047.stdout:4/274: dread - d3/d27/d3b/f42 zero size 2024-02-07T12:25:43.147 INFO:tasks.workunit.client.0.smithi047.stdout:4/275: chown d3/l2e 14 1 2024-02-07T12:25:43.149 INFO:tasks.workunit.client.0.smithi047.stdout:4/276: unlink d3/l29 0 2024-02-07T12:25:43.149 INFO:tasks.workunit.client.0.smithi047.stdout:4/277: write d3/d27/d2a/f36 [555824,35808] 0 2024-02-07T12:25:43.149 INFO:tasks.workunit.client.0.smithi047.stdout:4/278: write d3/d27/d2a/d43/f4c [148004,17621] 0 2024-02-07T12:25:43.150 INFO:tasks.workunit.client.0.smithi047.stdout:4/279: chown d3/d30/c34 6 1 2024-02-07T12:25:43.150 INFO:tasks.workunit.client.0.smithi047.stdout:4/280: chown d3/d30/c34 26 1 2024-02-07T12:25:43.150 INFO:tasks.workunit.client.0.smithi047.stdout:4/281: readlink d3/d27/d3b/l4f 0 2024-02-07T12:25:43.151 INFO:tasks.workunit.client.0.smithi047.stdout:4/282: dread d3/f2b [0,4194304] 0 2024-02-07T12:25:43.152 INFO:tasks.workunit.client.0.smithi047.stdout:8/358: write d3/f72 [241061,107445] 0 2024-02-07T12:25:43.153 INFO:tasks.workunit.client.0.smithi047.stdout:4/283: rename d3/l1c to d3/d27/d3b/l59 0 2024-02-07T12:25:43.154 INFO:tasks.workunit.client.0.smithi047.stdout:2/200: dread d7/f12 [0,4194304] 0 2024-02-07T12:25:43.156 INFO:tasks.workunit.client.0.smithi047.stdout:8/359: creat d3/d66/f79 x:0 0 0 2024-02-07T12:25:43.156 INFO:tasks.workunit.client.0.smithi047.stdout:8/360: dread - d3/d36/f75 zero size 2024-02-07T12:25:43.157 INFO:tasks.workunit.client.0.smithi047.stdout:4/284: stat d3/d27/d3b/l59 0 2024-02-07T12:25:43.159 INFO:tasks.workunit.client.0.smithi047.stdout:2/201: rename d7/dc/c16 to d7/dc/c3d 0 2024-02-07T12:25:43.159 INFO:tasks.workunit.client.0.smithi047.stdout:2/202: fdatasync d7/f20 0 2024-02-07T12:25:43.164 INFO:tasks.workunit.client.0.smithi047.stdout:2/203: getdents d7/d2d 0 2024-02-07T12:25:43.164 INFO:tasks.workunit.client.0.smithi047.stdout:2/204: fsync d7/dc/f31 0 2024-02-07T12:25:43.164 INFO:tasks.workunit.client.0.smithi047.stdout:2/205: stat d7/l18 0 2024-02-07T12:25:43.164 INFO:tasks.workunit.client.0.smithi047.stdout:2/206: fdatasync d7/f2c 0 2024-02-07T12:25:43.164 INFO:tasks.workunit.client.0.smithi047.stdout:2/207: truncate d7/f2e 1736525 0 2024-02-07T12:25:43.164 INFO:tasks.workunit.client.0.smithi047.stdout:4/285: write d3/d27/d2a/f58 [780216,124108] 0 2024-02-07T12:25:43.168 INFO:tasks.workunit.client.0.smithi047.stdout:4/286: unlink d3/d27/d2a/l3e 0 2024-02-07T12:25:43.170 INFO:tasks.workunit.client.0.smithi047.stdout:4/287: symlink d3/d27/d2a/d43/d46/l5a 0 2024-02-07T12:25:43.170 INFO:tasks.workunit.client.0.smithi047.stdout:4/288: stat d3/d27/c2d 0 2024-02-07T12:25:43.172 INFO:tasks.workunit.client.0.smithi047.stdout:4/289: unlink d3/d30/c34 0 2024-02-07T12:25:43.173 INFO:tasks.workunit.client.0.smithi047.stdout:4/290: creat d3/d30/f5b x:0 0 0 2024-02-07T12:25:43.173 INFO:tasks.workunit.client.0.smithi047.stdout:4/291: dread - d3/d27/d2a/f39 zero size 2024-02-07T12:25:43.175 INFO:tasks.workunit.client.0.smithi047.stdout:4/292: truncate d3/f20 1408580 0 2024-02-07T12:25:43.175 INFO:tasks.workunit.client.0.smithi047.stdout:2/208: rmdir d7 39 2024-02-07T12:25:43.177 INFO:tasks.workunit.client.0.smithi047.stdout:4/293: mknod d3/d27/d2a/d43/d46/c5c 0 2024-02-07T12:25:43.178 INFO:tasks.workunit.client.0.smithi047.stdout:2/209: mknod d7/d2d/c3e 0 2024-02-07T12:25:43.178 INFO:tasks.workunit.client.0.smithi047.stdout:2/210: dread - d7/f3b zero size 2024-02-07T12:25:43.179 INFO:tasks.workunit.client.0.smithi047.stdout:2/211: mknod d7/d2d/c3f 0 2024-02-07T12:25:43.180 INFO:tasks.workunit.client.0.smithi047.stdout:2/212: symlink d7/dc/l40 0 2024-02-07T12:25:43.182 INFO:tasks.workunit.client.0.smithi047.stdout:2/213: mkdir d7/dc/d41 0 2024-02-07T12:25:43.184 INFO:tasks.workunit.client.0.smithi047.stdout:2/214: link d7/dc/c3d d7/c42 0 2024-02-07T12:25:43.185 INFO:tasks.workunit.client.0.smithi047.stdout:2/215: truncate d7/f20 5113698 0 2024-02-07T12:25:43.193 INFO:tasks.workunit.client.0.smithi047.stdout:4/294: dwrite d3/d30/f38 [0,4194304] 0 2024-02-07T12:25:43.204 INFO:tasks.workunit.client.0.smithi047.stdout:2/216: dwrite d7/f3b [0,4194304] 0 2024-02-07T12:25:43.204 INFO:tasks.workunit.client.0.smithi047.stdout:2/217: stat d7/f2c 0 2024-02-07T12:25:43.204 INFO:tasks.workunit.client.0.smithi047.stdout:2/218: chown d7/f38 25 1 2024-02-07T12:25:43.207 INFO:tasks.workunit.client.0.smithi047.stdout:2/219: creat d7/d2d/f43 x:0 0 0 2024-02-07T12:25:43.207 INFO:tasks.workunit.client.0.smithi047.stdout:2/220: stat d7/f23 0 2024-02-07T12:25:43.209 INFO:tasks.workunit.client.0.smithi047.stdout:2/221: unlink d7/l2a 0 2024-02-07T12:25:43.209 INFO:tasks.workunit.client.0.smithi047.stdout:2/222: dread - d7/d2d/f43 zero size 2024-02-07T12:25:43.210 INFO:tasks.workunit.client.0.smithi047.stdout:2/223: creat d7/dc/f44 x:0 0 0 2024-02-07T12:25:43.211 INFO:tasks.workunit.client.0.smithi047.stdout:2/224: rmdir d7/dc/d41 0 2024-02-07T12:25:43.212 INFO:tasks.workunit.client.0.smithi047.stdout:2/225: read d7/f38 [75995,88580] 0 2024-02-07T12:25:43.212 INFO:tasks.workunit.client.0.smithi047.stdout:2/226: chown d7/f13 64 1 2024-02-07T12:25:43.213 INFO:tasks.workunit.client.0.smithi047.stdout:4/295: dwrite d3/f4 [0,4194304] 0 2024-02-07T12:25:43.214 INFO:tasks.workunit.client.0.smithi047.stdout:4/296: truncate d3/f12 168959 0 2024-02-07T12:25:43.214 INFO:tasks.workunit.client.0.smithi047.stdout:4/297: write d3/d30/d37/f55 [852000,99718] 0 2024-02-07T12:25:43.220 INFO:tasks.workunit.client.0.smithi047.stdout:2/227: getdents d7/dc 0 2024-02-07T12:25:43.227 INFO:tasks.workunit.client.0.smithi047.stdout:2/228: write d7/dc/f29 [463865,74575] 0 2024-02-07T12:25:43.236 INFO:tasks.workunit.client.0.smithi047.stdout:2/229: dread d7/f3b [0,4194304] 0 2024-02-07T12:25:43.306 INFO:tasks.workunit.client.0.smithi047.stdout:4/298: dwrite d3/d27/d2a/d43/f53 [0,4194304] 0 2024-02-07T12:25:43.306 INFO:tasks.workunit.client.0.smithi047.stdout:4/299: fdatasync d3/fb 0 2024-02-07T12:25:43.306 INFO:tasks.workunit.client.0.smithi047.stdout:4/300: chown d3/d30/c4b 10653 1 2024-02-07T12:25:43.306 INFO:tasks.workunit.client.0.smithi047.stdout:4/301: creat d3/d30/d37/f5d x:0 0 0 2024-02-07T12:25:43.308 INFO:tasks.workunit.client.0.smithi047.stdout:4/302: mkdir d3/d27/d5e 0 2024-02-07T12:25:43.312 INFO:tasks.workunit.client.0.smithi047.stdout:2/230: dwrite d7/f2e [0,4194304] 0 2024-02-07T12:25:43.312 INFO:tasks.workunit.client.0.smithi047.stdout:4/303: rename d3/d27/d3b/l59 to d3/d27/d5e/l5f 0 2024-02-07T12:25:43.315 INFO:tasks.workunit.client.0.smithi047.stdout:4/304: rename d3/f9 to d3/d27/d2a/f60 0 2024-02-07T12:25:43.315 INFO:tasks.workunit.client.0.smithi047.stdout:4/305: write d3/f5 [578861,82256] 0 2024-02-07T12:25:43.316 INFO:tasks.workunit.client.0.smithi047.stdout:4/306: read d3/d27/d2a/d43/f4c [74638,87161] 0 2024-02-07T12:25:43.317 INFO:tasks.workunit.client.0.smithi047.stdout:2/231: getdents d7 0 2024-02-07T12:25:43.317 INFO:tasks.workunit.client.0.smithi047.stdout:2/232: write d7/dc/f35 [374694,89639] 0 2024-02-07T12:25:43.317 INFO:tasks.workunit.client.0.smithi047.stdout:2/233: creat d7/d2d/f45 x:0 0 0 2024-02-07T12:25:43.321 INFO:tasks.workunit.client.0.smithi047.stdout:2/234: link d7/dc/c3d d7/d2d/c46 0 2024-02-07T12:25:43.331 INFO:tasks.workunit.client.0.smithi047.stdout:2/235: dread d7/f28 [0,4194304] 0 2024-02-07T12:25:43.331 INFO:tasks.workunit.client.0.smithi047.stdout:4/307: dwrite d3/d27/d2a/f60 [0,4194304] 0 2024-02-07T12:25:43.341 INFO:tasks.workunit.client.0.smithi047.stdout:4/308: rename d3/d27/d2a to d3/d61 0 2024-02-07T12:25:43.346 INFO:tasks.workunit.client.0.smithi047.stdout:2/236: dwrite d7/fb [0,4194304] 0 2024-02-07T12:25:43.346 INFO:tasks.workunit.client.0.smithi047.stdout:2/237: fsync f5 0 2024-02-07T12:25:43.346 INFO:tasks.workunit.client.0.smithi047.stdout:2/238: getdents d7/dc 0 2024-02-07T12:25:43.346 INFO:tasks.workunit.client.0.smithi047.stdout:2/239: write f2 [2881080,109336] 0 2024-02-07T12:25:43.348 INFO:tasks.workunit.client.0.smithi047.stdout:2/240: rename d7/d2d/c3e to d7/c47 0 2024-02-07T12:25:43.349 INFO:tasks.workunit.client.0.smithi047.stdout:2/241: mkdir d7/d48 0 2024-02-07T12:25:43.351 INFO:tasks.workunit.client.0.smithi047.stdout:2/242: link d7/l9 d7/dc/l49 0 2024-02-07T12:25:43.353 INFO:tasks.workunit.client.0.smithi047.stdout:4/309: read d3/ff [1901822,20347] 0 2024-02-07T12:25:43.354 INFO:tasks.workunit.client.0.smithi047.stdout:4/310: dread d3/d61/f36 [0,4194304] 0 2024-02-07T12:25:43.361 INFO:tasks.workunit.client.0.smithi047.stdout:2/243: read d7/dc/f33 [1535143,11650] 0 2024-02-07T12:25:43.361 INFO:tasks.workunit.client.0.smithi047.stdout:2/244: stat d7/c47 0 2024-02-07T12:25:43.361 INFO:tasks.workunit.client.0.smithi047.stdout:2/245: dread - d7/d2d/f45 zero size 2024-02-07T12:25:43.364 INFO:tasks.workunit.client.0.smithi047.stdout:2/246: rename d7/dc/f29 to d7/d2d/f4a 0 2024-02-07T12:25:43.367 INFO:tasks.workunit.client.0.smithi047.stdout:2/247: getdents d7 0 2024-02-07T12:25:43.367 INFO:tasks.workunit.client.0.smithi047.stdout:2/248: dread - d7/d2d/f2f zero size 2024-02-07T12:25:43.368 INFO:tasks.workunit.client.0.smithi047.stdout:4/311: dwrite d3/d61/f36 [0,4194304] 0 2024-02-07T12:25:43.368 INFO:tasks.workunit.client.0.smithi047.stdout:2/249: unlink d7/f2c 0 2024-02-07T12:25:43.370 INFO:tasks.workunit.client.0.smithi047.stdout:4/312: rmdir d3/d27 39 2024-02-07T12:25:43.371 INFO:tasks.workunit.client.0.smithi047.stdout:2/250: stat d7/f2e 0 2024-02-07T12:25:43.373 INFO:tasks.workunit.client.0.smithi047.stdout:4/313: dread d3/d30/d37/f55 [0,4194304] 0 2024-02-07T12:25:43.373 INFO:tasks.workunit.client.0.smithi047.stdout:4/314: chown d3/f6 912 1 2024-02-07T12:25:43.373 INFO:tasks.workunit.client.0.smithi047.stdout:4/315: readlink d3/d27/d3b/l4f 0 2024-02-07T12:25:43.373 INFO:tasks.workunit.client.0.smithi047.stdout:4/316: fdatasync d3/ff 0 2024-02-07T12:25:43.375 INFO:tasks.workunit.client.0.smithi047.stdout:2/251: creat d7/dc/f4b x:0 0 0 2024-02-07T12:25:43.376 INFO:tasks.workunit.client.0.smithi047.stdout:4/317: symlink d3/d61/d43/d45/l62 0 2024-02-07T12:25:43.377 INFO:tasks.workunit.client.0.smithi047.stdout:2/252: readlink d7/l37 0 2024-02-07T12:25:43.378 INFO:tasks.workunit.client.0.smithi047.stdout:4/318: mkdir d3/d61/d43/d45/d63 0 2024-02-07T12:25:43.382 INFO:tasks.workunit.client.0.smithi047.stdout:2/253: dread d7/dc/f2b [0,4194304] 0 2024-02-07T12:25:43.383 INFO:tasks.workunit.client.0.smithi047.stdout:2/254: write d7/f8 [4514456,10273] 0 2024-02-07T12:25:43.384 INFO:tasks.workunit.client.0.smithi047.stdout:2/255: mkdir d7/dc/d4c 0 2024-02-07T12:25:43.387 INFO:tasks.workunit.client.0.smithi047.stdout:4/319: dread d3/f17 [4194304,4194304] 0 2024-02-07T12:25:43.402 INFO:tasks.workunit.client.0.smithi047.stdout:4/320: dwrite d3/d30/d37/f5d [0,4194304] 0 2024-02-07T12:25:43.402 INFO:tasks.workunit.client.0.smithi047.stdout:2/256: dwrite d7/f23 [0,4194304] 0 2024-02-07T12:25:43.405 INFO:tasks.workunit.client.0.smithi047.stdout:2/257: symlink d7/d48/l4d 0 2024-02-07T12:25:43.406 INFO:tasks.workunit.client.0.smithi047.stdout:2/258: dread - d7/f30 zero size 2024-02-07T12:25:43.412 INFO:tasks.workunit.client.0.smithi047.stdout:4/321: dread d3/d61/d43/f53 [0,4194304] 0 2024-02-07T12:25:43.412 INFO:tasks.workunit.client.0.smithi047.stdout:4/322: creat d3/d27/d3b/f64 x:0 0 0 2024-02-07T12:25:43.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:43 smithi138 ceph-mon[35528]: pgmap v8: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 149 MiB/s rd, 155 MiB/s wr, 247 op/s 2024-02-07T12:25:43.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:43 smithi138 ceph-mon[35528]: Standby manager daemon smithi047.zhgnrm started 2024-02-07T12:25:43.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:43 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.47:0/3647821863' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.zhgnrm/crt"}]: dispatch 2024-02-07T12:25:43.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:43 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.47:0/3647821863' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:25:43.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:43 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.47:0/3647821863' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.zhgnrm/key"}]: dispatch 2024-02-07T12:25:43.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:43 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.47:0/3647821863' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:25:43.487 INFO:tasks.workunit.client.0.smithi047.stdout:4/323: mknod d3/d61/c65 0 2024-02-07T12:25:43.488 INFO:tasks.workunit.client.0.smithi047.stdout:2/259: getdents d7/dc 0 2024-02-07T12:25:43.489 INFO:tasks.workunit.client.0.smithi047.stdout:2/260: readlink d7/l11 0 2024-02-07T12:25:43.493 INFO:tasks.workunit.client.0.smithi047.stdout:4/324: dread d3/ff [0,4194304] 0 2024-02-07T12:25:43.500 INFO:tasks.workunit.client.0.smithi047.stdout:2/261: dread d7/dc/f1a [0,4194304] 0 2024-02-07T12:25:43.500 INFO:tasks.workunit.client.0.smithi047.stdout:2/262: truncate d7/dc/f44 898563 0 2024-02-07T12:25:43.501 INFO:tasks.workunit.client.0.smithi047.stdout:2/263: readlink d7/l18 0 2024-02-07T12:25:43.502 INFO:tasks.workunit.client.0.smithi047.stdout:2/264: symlink d7/d2d/l4e 0 2024-02-07T12:25:43.502 INFO:tasks.workunit.client.0.smithi047.stdout:2/265: read f2 [3165889,63774] 0 2024-02-07T12:25:43.502 INFO:tasks.workunit.client.0.smithi047.stdout:4/325: dread d3/f17 [0,4194304] 0 2024-02-07T12:25:43.503 INFO:tasks.workunit.client.0.smithi047.stdout:2/266: rename d7/l37 to d7/d2d/l4f 0 2024-02-07T12:25:43.505 INFO:tasks.workunit.client.0.smithi047.stdout:2/267: creat d7/dc/d4c/f50 x:0 0 0 2024-02-07T12:25:43.506 INFO:tasks.workunit.client.0.smithi047.stdout:4/326: rmdir d3/d30 39 2024-02-07T12:25:43.508 INFO:tasks.workunit.client.0.smithi047.stdout:2/268: mkdir d7/dc/d51 0 2024-02-07T12:25:43.509 INFO:tasks.workunit.client.0.smithi047.stdout:4/327: rename d3/d61/d43/d46 to d3/d61/d43/d45/d66 0 2024-02-07T12:25:43.510 INFO:tasks.workunit.client.0.smithi047.stdout:2/269: mknod d7/d48/c52 0 2024-02-07T12:25:43.510 INFO:tasks.workunit.client.0.smithi047.stdout:2/270: creat d7/d2d/f53 x:0 0 0 2024-02-07T12:25:43.511 INFO:tasks.workunit.client.0.smithi047.stdout:4/328: mknod d3/d61/d43/d45/d63/c67 0 2024-02-07T12:25:43.513 INFO:tasks.workunit.client.0.smithi047.stdout:4/329: truncate d3/f6 1713407 0 2024-02-07T12:25:43.515 INFO:tasks.workunit.client.0.smithi047.stdout:4/330: unlink d3/d27/c2c 0 2024-02-07T12:25:43.528 INFO:tasks.workunit.client.0.smithi047.stdout:2/271: dwrite d7/f8 [0,4194304] 0 2024-02-07T12:25:43.536 INFO:tasks.workunit.client.0.smithi047.stdout:0/114: sync 2024-02-07T12:25:43.536 INFO:tasks.workunit.client.0.smithi047.stdout:0/115: write f1 [4679796,28256] 0 2024-02-07T12:25:43.543 INFO:tasks.workunit.client.0.smithi047.stdout:2/272: dwrite d7/f12 [4194304,4194304] 0 2024-02-07T12:25:43.548 INFO:tasks.workunit.client.0.smithi047.stdout:2/273: write d7/dc/f1a [950071,33770] 0 2024-02-07T12:25:43.567 INFO:tasks.workunit.client.0.smithi047.stdout:2/274: dwrite d7/dc/f31 [4194304,4194304] 0 2024-02-07T12:25:43.567 INFO:tasks.workunit.client.0.smithi047.stdout:2/275: chown d7/dc/cf 75 1 2024-02-07T12:25:43.567 INFO:tasks.workunit.client.0.smithi047.stdout:2/276: dread - d7/d2d/f45 zero size 2024-02-07T12:25:43.586 INFO:tasks.workunit.client.0.smithi047.stdout:2/277: dwrite d7/dc/f33 [0,4194304] 0 2024-02-07T12:25:43.587 INFO:tasks.workunit.client.0.smithi047.stdout:2/278: truncate d7/dc/f1a 4440584 0 2024-02-07T12:25:43.603 INFO:tasks.workunit.client.0.smithi047.stdout:2/279: dwrite d7/f1e [4194304,4194304] 0 2024-02-07T12:25:43.603 INFO:tasks.workunit.client.0.smithi047.stdout:2/280: fdatasync d7/f38 0 2024-02-07T12:25:43.604 INFO:tasks.workunit.client.0.smithi047.stdout:2/281: getdents d7/d48 0 2024-02-07T12:25:43.622 INFO:tasks.workunit.client.0.smithi047.stdout:2/282: dwrite d7/dc/f4b [0,4194304] 0 2024-02-07T12:25:43.626 INFO:tasks.workunit.client.0.smithi047.stdout:2/283: mknod d7/c54 0 2024-02-07T12:25:43.638 INFO:tasks.workunit.client.0.smithi047.stdout:2/284: dread d7/f20 [4194304,4194304] 0 2024-02-07T12:25:43.644 INFO:tasks.workunit.client.0.smithi047.stdout:2/285: mknod d7/c55 0 2024-02-07T12:25:43.645 INFO:tasks.workunit.client.0.smithi047.stdout:2/286: creat d7/d48/f56 x:0 0 0 2024-02-07T12:25:43.647 INFO:tasks.workunit.client.0.smithi047.stdout:5/251: sync 2024-02-07T12:25:43.647 INFO:tasks.workunit.client.0.smithi047.stdout:9/109: sync 2024-02-07T12:25:43.647 INFO:tasks.workunit.client.0.smithi047.stdout:5/252: stat da/df/f38 0 2024-02-07T12:25:43.647 INFO:tasks.workunit.client.0.smithi047.stdout:9/110: creat d3/f22 x:0 0 0 2024-02-07T12:25:43.649 INFO:tasks.workunit.client.0.smithi047.stdout:9/111: mknod d3/d10/c23 0 2024-02-07T12:25:43.649 INFO:tasks.workunit.client.0.smithi047.stdout:9/112: readlink d3/d10/d11/l20 0 2024-02-07T12:25:43.651 INFO:tasks.workunit.client.0.smithi047.stdout:9/113: rename d3/fe to d3/d10/f24 0 2024-02-07T12:25:43.671 INFO:tasks.workunit.client.0.smithi047.stdout:5/253: dwrite da/df/d16/d25/f3b [0,4194304] 0 2024-02-07T12:25:43.671 INFO:tasks.workunit.client.0.smithi047.stdout:5/254: dread - da/df/d16/d41/f47 zero size 2024-02-07T12:25:43.671 INFO:tasks.workunit.client.0.smithi047.stdout:5/255: truncate da/d24/d2b/d2e/f4e 817395 0 2024-02-07T12:25:43.671 INFO:tasks.workunit.client.0.smithi047.stdout:5/256: write da/f1b [1572864,59984] 0 2024-02-07T12:25:43.671 INFO:tasks.workunit.client.0.smithi047.stdout:2/287: dwrite d7/fb [0,4194304] 0 2024-02-07T12:25:43.671 INFO:tasks.workunit.client.0.smithi047.stdout:2/288: readlink d7/d48/l4d 0 2024-02-07T12:25:43.671 INFO:tasks.workunit.client.0.smithi047.stdout:9/114: dwrite d3/d10/f1f [0,4194304] 0 2024-02-07T12:25:43.674 INFO:tasks.workunit.client.0.smithi047.stdout:2/289: readlink d7/l22 0 2024-02-07T12:25:43.676 INFO:tasks.workunit.client.0.smithi047.stdout:9/115: rename d3/d10/c15 to d3/c25 0 2024-02-07T12:25:43.677 INFO:tasks.workunit.client.0.smithi047.stdout:9/116: chown d3/d10/f24 13793 1 2024-02-07T12:25:43.679 INFO:tasks.workunit.client.0.smithi047.stdout:2/290: symlink d7/dc/d4c/l57 0 2024-02-07T12:25:43.679 INFO:tasks.workunit.client.0.smithi047.stdout:2/291: creat d7/dc/d4c/f58 x:0 0 0 2024-02-07T12:25:43.681 INFO:tasks.workunit.client.0.smithi047.stdout:9/117: dread f1 [0,4194304] 0 2024-02-07T12:25:43.682 INFO:tasks.workunit.client.0.smithi047.stdout:9/118: truncate d3/d10/d18/f1b 891386 0 2024-02-07T12:25:43.682 INFO:tasks.workunit.client.0.smithi047.stdout:9/119: creat d3/f26 x:0 0 0 2024-02-07T12:25:43.682 INFO:tasks.workunit.client.0.smithi047.stdout:9/120: truncate d3/f22 293942 0 2024-02-07T12:25:43.682 INFO:tasks.workunit.client.0.smithi047.stdout:9/121: creat d3/d10/d18/f27 x:0 0 0 2024-02-07T12:25:43.682 INFO:tasks.workunit.client.0.smithi047.stdout:9/122: chown d3/d10/d18 0 1 2024-02-07T12:25:43.682 INFO:tasks.workunit.client.0.smithi047.stdout:9/123: chown f2 306 1 2024-02-07T12:25:43.682 INFO:tasks.workunit.client.0.smithi047.stdout:2/292: dread d7/dc/f35 [0,4194304] 0 2024-02-07T12:25:43.685 INFO:tasks.workunit.client.0.smithi047.stdout:9/124: mknod d3/d10/d18/c28 0 2024-02-07T12:25:43.687 INFO:tasks.workunit.client.0.smithi047.stdout:9/125: link d3/f1d d3/f29 0 2024-02-07T12:25:43.687 INFO:tasks.workunit.client.0.smithi047.stdout:2/293: dread d7/f20 [4194304,4194304] 0 2024-02-07T12:25:43.687 INFO:tasks.workunit.client.0.smithi047.stdout:2/294: write d7/d2d/f4a [4844248,114529] 0 2024-02-07T12:25:43.688 INFO:tasks.workunit.client.0.smithi047.stdout:5/257: dwrite da/d24/d2b/d2e/f31 [0,4194304] 0 2024-02-07T12:25:43.689 INFO:tasks.workunit.client.0.smithi047.stdout:5/258: truncate da/d24/d2b/d2e/f43 1826951 0 2024-02-07T12:25:43.690 INFO:tasks.workunit.client.0.smithi047.stdout:5/259: mkdir da/df/d16/d41/d57 0 2024-02-07T12:25:43.700 INFO:tasks.workunit.client.0.smithi047.stdout:2/295: dread d7/dc/f33 [0,4194304] 0 2024-02-07T12:25:43.700 INFO:tasks.workunit.client.0.smithi047.stdout:5/260: dread da/df/f38 [0,4194304] 0 2024-02-07T12:25:43.700 INFO:tasks.workunit.client.0.smithi047.stdout:5/261: write da/d24/d2b/d2e/f4e [1263181,14476] 0 2024-02-07T12:25:43.700 INFO:tasks.workunit.client.0.smithi047.stdout:5/262: truncate da/f11 1646017 0 2024-02-07T12:25:43.702 INFO:tasks.workunit.client.0.smithi047.stdout:5/263: symlink da/df/d16/d25/d33/d55/l58 0 2024-02-07T12:25:43.702 INFO:tasks.workunit.client.0.smithi047.stdout:5/264: read da/df/d16/d25/d33/f3c [845585,67009] 0 2024-02-07T12:25:43.702 INFO:tasks.workunit.client.0.smithi047.stdout:5/265: readlink da/df/d16/d25/l30 0 2024-02-07T12:25:43.705 INFO:tasks.workunit.client.0.smithi047.stdout:2/296: dread d7/dc/f33 [0,4194304] 0 2024-02-07T12:25:43.708 INFO:tasks.workunit.client.0.smithi047.stdout:9/126: dwrite d3/f26 [0,4194304] 0 2024-02-07T12:25:43.708 INFO:tasks.workunit.client.0.smithi047.stdout:9/127: dread - d3/f1d zero size 2024-02-07T12:25:43.711 INFO:tasks.workunit.client.0.smithi047.stdout:9/128: mknod d3/d10/d11/c2a 0 2024-02-07T12:25:43.713 INFO:tasks.workunit.client.0.smithi047.stdout:9/129: mknod d3/d10/d18/c2b 0 2024-02-07T12:25:43.713 INFO:tasks.workunit.client.0.smithi047.stdout:9/130: readlink d3/l5 0 2024-02-07T12:25:43.713 INFO:tasks.workunit.client.0.smithi047.stdout:9/131: chown d3/d10/d18 12746 1 2024-02-07T12:25:43.713 INFO:tasks.workunit.client.0.smithi047.stdout:2/297: truncate d7/fb 2200118 0 2024-02-07T12:25:43.715 INFO:tasks.workunit.client.0.smithi047.stdout:2/298: creat d7/dc/f59 x:0 0 0 2024-02-07T12:25:43.715 INFO:tasks.workunit.client.0.smithi047.stdout:2/299: chown d7/dc/ce 9817228 1 2024-02-07T12:25:43.716 INFO:tasks.workunit.client.0.smithi047.stdout:2/300: symlink d7/l5a 0 2024-02-07T12:25:43.717 INFO:tasks.workunit.client.0.smithi047.stdout:2/301: creat d7/dc/f5b x:0 0 0 2024-02-07T12:25:43.720 INFO:tasks.workunit.client.0.smithi047.stdout:9/132: write d3/d10/f1f [2926009,10291] 0 2024-02-07T12:25:43.720 INFO:tasks.workunit.client.0.smithi047.stdout:9/133: stat d3/d10/l1e 0 2024-02-07T12:25:43.720 INFO:tasks.workunit.client.0.smithi047.stdout:5/266: dwrite da/df/d16/d41/f51 [0,4194304] 0 2024-02-07T12:25:43.720 INFO:tasks.workunit.client.0.smithi047.stdout:5/267: fsync da/d24/d2b/d2e/f43 0 2024-02-07T12:25:43.720 INFO:tasks.workunit.client.0.smithi047.stdout:5/268: stat da/d24/d2b 0 2024-02-07T12:25:43.724 INFO:tasks.workunit.client.0.smithi047.stdout:2/302: dread d7/f3b [0,4194304] 0 2024-02-07T12:25:43.726 INFO:tasks.workunit.client.0.smithi047.stdout:2/303: rmdir d7/dc/d4c 39 2024-02-07T12:25:43.726 INFO:tasks.workunit.client.0.smithi047.stdout:2/304: chown d7/l18 1031 1 2024-02-07T12:25:43.727 INFO:tasks.workunit.client.0.smithi047.stdout:5/269: dread da/fd [0,4194304] 0 2024-02-07T12:25:43.728 INFO:tasks.workunit.client.0.smithi047.stdout:2/305: mkdir d7/d2d/d5c 0 2024-02-07T12:25:43.728 INFO:tasks.workunit.client.0.smithi047.stdout:2/306: chown d7/d2d/c46 6345031 1 2024-02-07T12:25:43.728 INFO:tasks.workunit.client.0.smithi047.stdout:2/307: read - d7/f30 zero size 2024-02-07T12:25:43.730 INFO:tasks.workunit.client.0.smithi047.stdout:5/270: unlink da/df/d16/d25/d33/d55/f56 0 2024-02-07T12:25:43.730 INFO:tasks.workunit.client.0.smithi047.stdout:5/271: chown da/df/d16/d41/f47 8550652 1 2024-02-07T12:25:43.732 INFO:tasks.workunit.client.0.smithi047.stdout:2/308: mknod d7/d48/c5d 0 2024-02-07T12:25:43.732 INFO:tasks.workunit.client.0.smithi047.stdout:5/272: mknod da/df/d16/d41/d57/c59 0 2024-02-07T12:25:43.733 INFO:tasks.workunit.client.0.smithi047.stdout:2/309: chown d7/c47 532577276 1 2024-02-07T12:25:43.734 INFO:tasks.workunit.client.0.smithi047.stdout:5/273: rename da/f1b to da/df/d16/d41/f5a 0 2024-02-07T12:25:43.735 INFO:tasks.workunit.client.0.smithi047.stdout:5/274: creat da/d24/d2b/f5b x:0 0 0 2024-02-07T12:25:43.736 INFO:tasks.workunit.client.0.smithi047.stdout:2/310: rename f5 to d7/dc/d4c/f5e 0 2024-02-07T12:25:43.738 INFO:tasks.workunit.client.0.smithi047.stdout:9/134: dwrite f1 [0,4194304] 0 2024-02-07T12:25:43.739 INFO:tasks.workunit.client.0.smithi047.stdout:9/135: creat d3/f2c x:0 0 0 2024-02-07T12:25:43.739 INFO:tasks.workunit.client.0.smithi047.stdout:5/275: unlink da/d24/d2b/d2e/c32 0 2024-02-07T12:25:43.739 INFO:tasks.workunit.client.0.smithi047.stdout:5/276: truncate da/f15 3390220 0 2024-02-07T12:25:43.740 INFO:tasks.workunit.client.0.smithi047.stdout:5/277: rmdir da/df/d16/d41/d57 39 2024-02-07T12:25:43.741 INFO:tasks.workunit.client.0.smithi047.stdout:9/136: rename d3/f2c to d3/d10/f2d 0 2024-02-07T12:25:43.742 INFO:tasks.workunit.client.0.smithi047.stdout:9/137: chown d3/d10/d18/f27 146858 1 2024-02-07T12:25:43.742 INFO:tasks.workunit.client.0.smithi047.stdout:5/278: mknod da/df/d16/d25/d33/d55/c5c 0 2024-02-07T12:25:43.744 INFO:tasks.workunit.client.0.smithi047.stdout:5/279: link da/df/f28 da/df/d16/d41/d57/f5d 0 2024-02-07T12:25:43.745 INFO:tasks.workunit.client.0.smithi047.stdout:5/280: link da/df/d16/d41/c48 da/df/d16/d41/d57/c5e 0 2024-02-07T12:25:43.751 INFO:tasks.workunit.client.0.smithi047.stdout:2/311: dwrite d7/fb [0,4194304] 0 2024-02-07T12:25:43.751 INFO:tasks.workunit.client.0.smithi047.stdout:2/312: chown d7/l21 1695269 1 2024-02-07T12:25:43.752 INFO:tasks.workunit.client.0.smithi047.stdout:2/313: chown d7/c1f 54990 1 2024-02-07T12:25:43.761 INFO:tasks.workunit.client.0.smithi047.stdout:2/314: dread d7/fb [0,4194304] 0 2024-02-07T12:25:43.764 INFO:tasks.workunit.client.0.smithi047.stdout:9/138: dwrite d3/f19 [0,4194304] 0 2024-02-07T12:25:43.765 INFO:tasks.workunit.client.0.smithi047.stdout:5/281: dwrite da/df/d16/d41/f51 [0,4194304] 0 2024-02-07T12:25:43.765 INFO:tasks.workunit.client.0.smithi047.stdout:5/282: readlink da/df/l21 0 2024-02-07T12:25:43.779 INFO:tasks.workunit.client.0.smithi047.stdout:5/283: truncate da/df/d16/d41/f51 54198 0 2024-02-07T12:25:43.780 INFO:tasks.workunit.client.0.smithi047.stdout:5/284: symlink da/df/d16/d41/d57/l5f 0 2024-02-07T12:25:43.782 INFO:tasks.workunit.client.0.smithi047.stdout:5/285: rmdir da/d24/d2b/d2e 39 2024-02-07T12:25:43.783 INFO:tasks.workunit.client.0.smithi047.stdout:9/139: dwrite d3/f1d [0,4194304] 0 2024-02-07T12:25:43.783 INFO:tasks.workunit.client.0.smithi047.stdout:9/140: creat d3/d10/d18/f2e x:0 0 0 2024-02-07T12:25:43.783 INFO:tasks.workunit.client.0.smithi047.stdout:9/141: write d3/d10/d18/f1b [1150704,119647] 0 2024-02-07T12:25:43.784 INFO:tasks.workunit.client.0.smithi047.stdout:2/315: dwrite d7/dc/d4c/f5e [0,4194304] 0 2024-02-07T12:25:43.784 INFO:tasks.workunit.client.0.smithi047.stdout:5/286: getdents da/df/d16/d25 0 2024-02-07T12:25:43.788 INFO:tasks.workunit.client.0.smithi047.stdout:5/287: symlink da/df/d16/d25/l60 0 2024-02-07T12:25:43.791 INFO:tasks.workunit.client.0.smithi047.stdout:5/288: link da/f39 da/df/f61 0 2024-02-07T12:25:43.793 INFO:tasks.workunit.client.0.smithi047.stdout:2/316: dread d7/f20 [0,4194304] 0 2024-02-07T12:25:43.814 INFO:tasks.workunit.client.0.smithi047.stdout:2/317: dwrite d7/dc/d4c/f58 [0,4194304] 0 2024-02-07T12:25:43.815 INFO:tasks.workunit.client.0.smithi047.stdout:5/289: dwrite da/df/d16/d41/f42 [0,4194304] 0 2024-02-07T12:25:43.815 INFO:tasks.workunit.client.0.smithi047.stdout:5/290: dread - da/d24/d2b/f3a zero size 2024-02-07T12:25:43.816 INFO:tasks.workunit.client.0.smithi047.stdout:2/318: mknod d7/d48/c5f 0 2024-02-07T12:25:43.818 INFO:tasks.workunit.client.0.smithi047.stdout:5/291: mknod da/df/d16/d25/d33/d55/c62 0 2024-02-07T12:25:43.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:43 smithi047 ceph-mon[28972]: pgmap v8: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 149 MiB/s rd, 155 MiB/s wr, 247 op/s 2024-02-07T12:25:43.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:43 smithi047 ceph-mon[28972]: Standby manager daemon smithi047.zhgnrm started 2024-02-07T12:25:43.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:43 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.47:0/3647821863' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.zhgnrm/crt"}]: dispatch 2024-02-07T12:25:43.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:43 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.47:0/3647821863' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:25:43.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:43 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.47:0/3647821863' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.zhgnrm/key"}]: dispatch 2024-02-07T12:25:43.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:43 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.47:0/3647821863' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:25:43.844 INFO:tasks.workunit.client.0.smithi047.stdout:5/292: dwrite da/df/d16/d41/d57/f5d [0,4194304] 0 2024-02-07T12:25:43.845 INFO:tasks.workunit.client.0.smithi047.stdout:5/293: chown da/df/d16/l3f 23566197 1 2024-02-07T12:25:43.849 INFO:tasks.workunit.client.0.smithi047.stdout:2/319: dwrite d7/dc/f4b [0,4194304] 0 2024-02-07T12:25:43.857 INFO:tasks.workunit.client.0.smithi047.stdout:2/320: dread d7/f1e [4194304,4194304] 0 2024-02-07T12:25:43.857 INFO:tasks.workunit.client.0.smithi047.stdout:2/321: fdatasync d7/dc/f1a 0 2024-02-07T12:25:43.864 INFO:tasks.workunit.client.0.smithi047.stdout:5/294: dwrite da/df/f61 [0,4194304] 0 2024-02-07T12:25:43.867 INFO:tasks.workunit.client.0.smithi047.stdout:5/295: mkdir da/d24/d63 0 2024-02-07T12:25:43.867 INFO:tasks.workunit.client.0.smithi047.stdout:5/296: chown da/d24/f2f 132493 1 2024-02-07T12:25:43.868 INFO:tasks.workunit.client.0.smithi047.stdout:5/297: rmdir da/df/d16/d41 39 2024-02-07T12:25:43.870 INFO:tasks.workunit.client.0.smithi047.stdout:5/298: symlink da/df/d16/d25/d33/l64 0 2024-02-07T12:25:43.870 INFO:tasks.workunit.client.0.smithi047.stdout:2/322: write d7/dc/f4b [297214,102951] 0 2024-02-07T12:25:43.870 INFO:tasks.workunit.client.0.smithi047.stdout:5/299: creat da/d24/d63/f65 x:0 0 0 2024-02-07T12:25:43.870 INFO:tasks.workunit.client.0.smithi047.stdout:5/300: fdatasync da/df/d16/d25/d33/f52 0 2024-02-07T12:25:43.871 INFO:tasks.workunit.client.0.smithi047.stdout:5/301: creat da/f66 x:0 0 0 2024-02-07T12:25:43.871 INFO:tasks.workunit.client.0.smithi047.stdout:2/323: creat d7/dc/d51/f60 x:0 0 0 2024-02-07T12:25:43.872 INFO:tasks.workunit.client.0.smithi047.stdout:5/302: read da/df/d16/d25/f2a [3741999,104511] 0 2024-02-07T12:25:43.872 INFO:tasks.workunit.client.0.smithi047.stdout:2/324: truncate d7/dc/d4c/f5e 2436495 0 2024-02-07T12:25:43.873 INFO:tasks.workunit.client.0.smithi047.stdout:2/325: write d7/d2d/f43 [1037006,13731] 0 2024-02-07T12:25:43.873 INFO:tasks.workunit.client.0.smithi047.stdout:5/303: mkdir da/d24/d2b/d2e/d67 0 2024-02-07T12:25:43.873 INFO:tasks.workunit.client.0.smithi047.stdout:5/304: read - da/f34 zero size 2024-02-07T12:25:43.873 INFO:tasks.workunit.client.0.smithi047.stdout:2/326: symlink d7/d2d/l61 0 2024-02-07T12:25:43.875 INFO:tasks.workunit.client.0.smithi047.stdout:5/305: mkdir da/d24/d2b/d2e/d68 0 2024-02-07T12:25:43.875 INFO:tasks.workunit.client.0.smithi047.stdout:5/306: read - da/f34 zero size 2024-02-07T12:25:43.875 INFO:tasks.workunit.client.0.smithi047.stdout:5/307: chown da/d24/c37 9 1 2024-02-07T12:25:43.888 INFO:tasks.workunit.client.0.smithi047.stdout:5/308: dwrite da/d24/d2b/f5b [0,4194304] 0 2024-02-07T12:25:43.890 INFO:tasks.workunit.client.0.smithi047.stdout:5/309: symlink da/df/d16/d25/d33/l69 0 2024-02-07T12:25:43.892 INFO:tasks.workunit.client.0.smithi047.stdout:5/310: truncate da/df/d16/d25/f2a 2203370 0 2024-02-07T12:25:43.892 INFO:tasks.workunit.client.0.smithi047.stdout:5/311: readlink da/df/l4f 0 2024-02-07T12:25:43.892 INFO:tasks.workunit.client.0.smithi047.stdout:5/312: fsync da/f1a 0 2024-02-07T12:25:43.899 INFO:tasks.workunit.client.0.smithi047.stdout:5/313: dread da/f15 [0,4194304] 0 2024-02-07T12:25:43.908 INFO:tasks.workunit.client.0.smithi047.stdout:5/314: write da/df/d16/d41/d57/f5d [1352366,57412] 0 2024-02-07T12:25:43.908 INFO:tasks.workunit.client.0.smithi047.stdout:5/315: chown da/d24/d2b/d2e 108 1 2024-02-07T12:25:43.923 INFO:tasks.workunit.client.0.smithi047.stdout:5/316: dwrite da/d24/f45 [0,4194304] 0 2024-02-07T12:25:43.924 INFO:tasks.workunit.client.0.smithi047.stdout:5/317: dread da/df/f38 [0,4194304] 0 2024-02-07T12:25:43.926 INFO:tasks.workunit.client.0.smithi047.stdout:5/318: creat da/df/d16/d41/d57/f6a x:0 0 0 2024-02-07T12:25:43.928 INFO:tasks.workunit.client.0.smithi047.stdout:5/319: getdents da/d24/d63 0 2024-02-07T12:25:43.928 INFO:tasks.workunit.client.0.smithi047.stdout:5/320: write da/d24/d2b/f5b [5054745,62508] 0 2024-02-07T12:25:43.928 INFO:tasks.workunit.client.0.smithi047.stdout:5/321: dread - da/d24/d2b/f3a zero size 2024-02-07T12:25:43.929 INFO:tasks.workunit.client.0.smithi047.stdout:5/322: mknod da/df/d16/d41/d57/c6b 0 2024-02-07T12:25:43.931 INFO:tasks.workunit.client.0.smithi047.stdout:5/323: rmdir da/d24/d2b/d2e/d67 0 2024-02-07T12:25:43.944 INFO:tasks.workunit.client.0.smithi047.stdout:5/324: dwrite da/f1a [0,4194304] 0 2024-02-07T12:25:43.946 INFO:tasks.workunit.client.0.smithi047.stdout:5/325: mkdir da/df/d16/d41/d57/d6c 0 2024-02-07T12:25:43.947 INFO:tasks.workunit.client.0.smithi047.stdout:5/326: mknod da/df/d16/d41/c6d 0 2024-02-07T12:25:43.948 INFO:tasks.workunit.client.0.smithi047.stdout:5/327: dread da/df/f38 [0,4194304] 0 2024-02-07T12:25:43.948 INFO:tasks.workunit.client.0.smithi047.stdout:5/328: fdatasync da/d24/d2b/d2e/f4e 0 2024-02-07T12:25:43.950 INFO:tasks.workunit.client.0.smithi047.stdout:5/329: unlink da/f66 0 2024-02-07T12:25:43.952 INFO:tasks.workunit.client.0.smithi047.stdout:5/330: mkdir da/df/d16/d25/d33/d6e 0 2024-02-07T12:25:43.969 INFO:tasks.workunit.client.0.smithi047.stdout:5/331: dwrite da/df/d16/d41/f46 [0,4194304] 0 2024-02-07T12:25:43.969 INFO:tasks.workunit.client.0.smithi047.stdout:5/332: write da/df/d16/d41/f47 [437499,3479] 0 2024-02-07T12:25:43.971 INFO:tasks.workunit.client.0.smithi047.stdout:5/333: stat da/df/d16/d25/l30 0 2024-02-07T12:25:43.971 INFO:tasks.workunit.client.0.smithi047.stdout:5/334: readlink da/df/d16/d41/d57/l5f 0 2024-02-07T12:25:44.044 INFO:tasks.workunit.client.0.smithi047.stdout:6/223: sync 2024-02-07T12:25:44.044 INFO:tasks.workunit.client.0.smithi047.stdout:6/224: stat d3/da/d2c 0 2024-02-07T12:25:44.067 INFO:tasks.workunit.client.0.smithi047.stdout:6/225: dwrite d3/da/f24 [0,4194304] 0 2024-02-07T12:25:44.069 INFO:tasks.workunit.client.0.smithi047.stdout:6/226: symlink d3/da/d2c/l48 0 2024-02-07T12:25:44.081 INFO:tasks.workunit.client.0.smithi047.stdout:6/227: write d3/d5/f27 [4661662,16450] 0 2024-02-07T12:25:44.081 INFO:tasks.workunit.client.0.smithi047.stdout:6/228: creat d3/da/f49 x:0 0 0 2024-02-07T12:25:44.083 INFO:tasks.workunit.client.0.smithi047.stdout:6/229: creat d3/d1e/d25/f4a x:0 0 0 2024-02-07T12:25:44.083 INFO:tasks.workunit.client.0.smithi047.stdout:6/230: fsync d3/da/f24 0 2024-02-07T12:25:44.085 INFO:tasks.workunit.client.0.smithi047.stdout:6/231: truncate d3/d5/f7 6167327 0 2024-02-07T12:25:44.261 INFO:tasks.workunit.client.0.smithi047.stdout:7/271: sync 2024-02-07T12:25:44.261 INFO:tasks.workunit.client.0.smithi047.stdout:7/272: chown d0/d4/f5 6952060 1 2024-02-07T12:25:44.280 INFO:tasks.workunit.client.0.smithi047.stdout:7/273: dwrite d0/df/d29/d31/f34 [0,4194304] 0 2024-02-07T12:25:44.280 INFO:tasks.workunit.client.0.smithi047.stdout:7/274: dread - d0/d42/f4b zero size 2024-02-07T12:25:44.281 INFO:tasks.workunit.client.0.smithi047.stdout:7/275: fsync d0/d4/f20 0 2024-02-07T12:25:44.281 INFO:tasks.workunit.client.0.smithi047.stdout:7/276: fdatasync d0/d42/f57 0 2024-02-07T12:25:44.290 INFO:tasks.workunit.client.0.smithi047.stdout:7/277: dread d0/d4/f33 [0,4194304] 0 2024-02-07T12:25:44.290 INFO:tasks.workunit.client.0.smithi047.stdout:7/278: creat d0/df/d29/f5b x:0 0 0 2024-02-07T12:25:44.291 INFO:tasks.workunit.client.0.smithi047.stdout:7/279: readlink d0/d4/l4a 0 2024-02-07T12:25:44.292 INFO:tasks.workunit.client.0.smithi047.stdout:7/280: mknod d0/df/d29/d31/d40/c5c 0 2024-02-07T12:25:44.308 INFO:tasks.workunit.client.0.smithi047.stdout:7/281: dwrite d0/df/d29/d31/d40/f49 [0,4194304] 0 2024-02-07T12:25:44.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:44 smithi138 ceph-mon[35528]: mgrmap e25: smithi138.fiugmj(active, since 11s), standbys: smithi047.zhgnrm 2024-02-07T12:25:44.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:44 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mgr metadata", "who": "smithi047.zhgnrm", "id": "smithi047.zhgnrm"}]: dispatch 2024-02-07T12:25:44.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:44 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:44.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:44 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:44.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:44 smithi047 ceph-mon[28972]: mgrmap e25: smithi138.fiugmj(active, since 11s), standbys: smithi047.zhgnrm 2024-02-07T12:25:44.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:44 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mgr metadata", "who": "smithi047.zhgnrm", "id": "smithi047.zhgnrm"}]: dispatch 2024-02-07T12:25:44.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:44 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:44.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:44 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:45.743 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:45 smithi047 ceph-mon[28972]: pgmap v9: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 241 MiB/s rd, 285 MiB/s wr, 414 op/s 2024-02-07T12:25:45.744 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:45 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:45.744 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:45 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:45.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:45 smithi138 ceph-mon[35528]: pgmap v9: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 241 MiB/s rd, 285 MiB/s wr, 414 op/s 2024-02-07T12:25:45.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:45 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:45.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:45 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:47.531 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:47 smithi047 ceph-mon[28972]: pgmap v10: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 221 MiB/s rd, 261 MiB/s wr, 378 op/s 2024-02-07T12:25:47.531 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:47 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:25:47.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:47 smithi138 ceph-mon[35528]: pgmap v10: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 221 MiB/s rd, 261 MiB/s wr, 378 op/s 2024-02-07T12:25:47.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:47 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:25:47.945 INFO:tasks.workunit.client.0.smithi047.stdout:5/335: sync 2024-02-07T12:25:47.945 INFO:tasks.workunit.client.0.smithi047.stdout:2/327: sync 2024-02-07T12:25:47.945 INFO:tasks.workunit.client.0.smithi047.stdout:9/142: sync 2024-02-07T12:25:47.945 INFO:tasks.workunit.client.0.smithi047.stdout:6/232: sync 2024-02-07T12:25:47.945 INFO:tasks.workunit.client.0.smithi047.stdout:9/143: chown d3/l5 2451 1 2024-02-07T12:25:47.945 INFO:tasks.workunit.client.0.smithi047.stdout:5/336: fsync da/df/d16/d41/f51 0 2024-02-07T12:25:47.945 INFO:tasks.workunit.client.0.smithi047.stdout:0/116: sync 2024-02-07T12:25:47.945 INFO:tasks.workunit.client.0.smithi047.stdout:7/282: sync 2024-02-07T12:25:47.945 INFO:tasks.workunit.client.0.smithi047.stdout:3/328: sync 2024-02-07T12:25:47.946 INFO:tasks.workunit.client.0.smithi047.stdout:1/191: sync 2024-02-07T12:25:47.946 INFO:tasks.workunit.client.0.smithi047.stdout:8/361: sync 2024-02-07T12:25:47.946 INFO:tasks.workunit.client.0.smithi047.stdout:4/331: sync 2024-02-07T12:25:47.946 INFO:tasks.workunit.client.0.smithi047.stdout:8/362: creat d3/d66/f7a x:0 0 0 2024-02-07T12:25:47.953 INFO:tasks.workunit.client.0.smithi047.stdout:5/337: write da/df/d16/f3d [3779178,130029] 0 2024-02-07T12:25:47.953 INFO:tasks.workunit.client.0.smithi047.stdout:0/117: dread fc [0,4194304] 0 2024-02-07T12:25:47.954 INFO:tasks.workunit.client.0.smithi047.stdout:6/233: dread d3/d5/f7 [4194304,4194304] 0 2024-02-07T12:25:47.975 INFO:tasks.workunit.client.0.smithi047.stdout:8/363: dwrite d3/d36/f68 [0,4194304] 0 2024-02-07T12:25:47.975 INFO:tasks.workunit.client.0.smithi047.stdout:8/364: chown d3/d36/d50/c5c 0 1 2024-02-07T12:25:47.977 INFO:tasks.workunit.client.0.smithi047.stdout:8/365: dread d3/d4/f7 [0,4194304] 0 2024-02-07T12:25:47.990 INFO:tasks.workunit.client.0.smithi047.stdout:5/338: dwrite da/d24/d63/f65 [0,4194304] 0 2024-02-07T12:25:47.990 INFO:tasks.workunit.client.0.smithi047.stdout:6/234: dwrite d3/d5/f27 [4194304,4194304] 0 2024-02-07T12:25:47.990 INFO:tasks.workunit.client.0.smithi047.stdout:6/235: fsync d3/d1e/f2f 0 2024-02-07T12:25:47.990 INFO:tasks.workunit.client.0.smithi047.stdout:6/236: read - d3/da/d14/f36 zero size 2024-02-07T12:25:48.003 INFO:tasks.workunit.client.0.smithi047.stdout:2/328: readlink d7/l24 0 2024-02-07T12:25:48.006 INFO:tasks.workunit.client.0.smithi047.stdout:7/283: link d0/d4/l4a d0/d42/d4d/l5d 0 2024-02-07T12:25:48.007 INFO:tasks.workunit.client.0.smithi047.stdout:3/329: mkdir d12/d19/d37/d75 0 2024-02-07T12:25:48.008 INFO:tasks.workunit.client.0.smithi047.stdout:3/330: write d12/d19/d2d/d42/f55 [1417846,6767] 0 2024-02-07T12:25:48.008 INFO:tasks.workunit.client.0.smithi047.stdout:3/331: write d12/d19/d37/f4f [450581,10093] 0 2024-02-07T12:25:48.009 INFO:tasks.workunit.client.0.smithi047.stdout:4/332: rmdir d3/d61/d43/d45/d66 39 2024-02-07T12:25:48.011 INFO:tasks.workunit.client.0.smithi047.stdout:2/329: dread d7/f2e [0,4194304] 0 2024-02-07T12:25:48.011 INFO:tasks.workunit.client.0.smithi047.stdout:2/330: stat d7/l21 0 2024-02-07T12:25:48.012 INFO:tasks.workunit.client.0.smithi047.stdout:1/192: symlink d1/d15/d30/l36 0 2024-02-07T12:25:48.012 INFO:tasks.workunit.client.0.smithi047.stdout:1/193: read - d1/d15/d18/f23 zero size 2024-02-07T12:25:48.014 INFO:tasks.workunit.client.0.smithi047.stdout:0/118: truncate f17 621623 0 2024-02-07T12:25:48.019 INFO:tasks.workunit.client.0.smithi047.stdout:8/366: symlink d3/d4/d4d/l7b 0 2024-02-07T12:25:48.023 INFO:tasks.workunit.client.0.smithi047.stdout:5/339: mknod da/d24/d2b/d2e/c6f 0 2024-02-07T12:25:48.031 INFO:tasks.workunit.client.0.smithi047.stdout:3/332: truncate d12/d19/d21/f2c 1043538 0 2024-02-07T12:25:48.034 INFO:tasks.workunit.client.0.smithi047.stdout:0/119: mkdir d19/d1a 0 2024-02-07T12:25:48.037 INFO:tasks.workunit.client.0.smithi047.stdout:7/284: unlink d0/d4/f1e 0 2024-02-07T12:25:48.043 INFO:tasks.workunit.client.0.smithi047.stdout:0/120: truncate f14 2333611 0 2024-02-07T12:25:48.045 INFO:tasks.workunit.client.0.smithi047.stdout:4/333: dwrite d3/f14 [0,4194304] 0 2024-02-07T12:25:48.046 INFO:tasks.workunit.client.0.smithi047.stdout:7/285: write d0/d4/f20 [6348982,22036] 0 2024-02-07T12:25:48.048 INFO:tasks.workunit.client.0.smithi047.stdout:7/286: link d0/df/d29/d31/l38 d0/d42/l5e 0 2024-02-07T12:25:48.054 INFO:tasks.workunit.client.0.smithi047.stdout:2/331: dwrite d7/dc/f33 [0,4194304] 0 2024-02-07T12:25:48.056 INFO:tasks.workunit.client.0.smithi047.stdout:5/340: dwrite da/df/d16/f53 [0,4194304] 0 2024-02-07T12:25:48.065 INFO:tasks.workunit.client.0.smithi047.stdout:5/341: symlink da/df/d16/d41/d57/l70 0 2024-02-07T12:25:48.072 INFO:tasks.workunit.client.0.smithi047.stdout:5/342: truncate da/df/d16/d25/f36 2195097 0 2024-02-07T12:25:48.075 INFO:tasks.workunit.client.0.smithi047.stdout:6/237: creat d3/f4b x:0 0 0 2024-02-07T12:25:48.075 INFO:tasks.workunit.client.0.smithi047.stdout:6/238: read d3/da/d2c/f2e [235160,84257] 0 2024-02-07T12:25:48.075 INFO:tasks.workunit.client.0.smithi047.stdout:6/239: truncate d3/d1e/d25/f4a 629853 0 2024-02-07T12:25:48.075 INFO:tasks.workunit.client.0.smithi047.stdout:6/240: chown d3/da/d2c/f2e 114472400 1 2024-02-07T12:25:48.079 INFO:tasks.workunit.client.0.smithi047.stdout:2/332: dwrite d7/dc/f4b [0,4194304] 0 2024-02-07T12:25:48.079 INFO:tasks.workunit.client.0.smithi047.stdout:2/333: chown d7/d2d/d5c 17 1 2024-02-07T12:25:48.079 INFO:tasks.workunit.client.0.smithi047.stdout:2/334: chown d7/d2d/f45 4642249 1 2024-02-07T12:25:48.079 INFO:tasks.workunit.client.0.smithi047.stdout:2/335: write d7/dc/f1a [556389,81969] 0 2024-02-07T12:25:48.081 INFO:tasks.workunit.client.0.smithi047.stdout:3/333: creat d12/f76 x:0 0 0 2024-02-07T12:25:48.086 INFO:tasks.workunit.client.0.smithi047.stdout:1/194: mkdir d1/d37 0 2024-02-07T12:25:48.086 INFO:tasks.workunit.client.0.smithi047.stdout:1/195: write d1/d15/d18/f24 [584942,61321] 0 2024-02-07T12:25:48.087 INFO:tasks.workunit.client.0.smithi047.stdout:8/367: rename d3/d36/d50/d2a/l6d to d3/d36/d50/d2a/d3c/l7c 0 2024-02-07T12:25:48.087 INFO:tasks.workunit.client.0.smithi047.stdout:8/368: creat d3/d66/f7d x:0 0 0 2024-02-07T12:25:48.096 INFO:tasks.workunit.client.0.smithi047.stdout:8/369: dread d3/d36/d50/d2a/d3c/f57 [0,4194304] 0 2024-02-07T12:25:48.096 INFO:tasks.workunit.client.0.smithi047.stdout:8/370: truncate d3/d4/fa 9411229 0 2024-02-07T12:25:48.096 INFO:tasks.workunit.client.0.smithi047.stdout:8/371: read - d3/d66/f79 zero size 2024-02-07T12:25:48.096 INFO:tasks.workunit.client.0.smithi047.stdout:8/372: chown d3/d4/d4d 19513002 1 2024-02-07T12:25:48.101 INFO:tasks.workunit.client.0.smithi047.stdout:2/336: dwrite d7/f12 [4194304,4194304] 0 2024-02-07T12:25:48.105 INFO:tasks.workunit.client.0.smithi047.stdout:2/337: creat d7/f62 x:0 0 0 2024-02-07T12:25:48.110 INFO:tasks.workunit.client.0.smithi047.stdout:2/338: truncate d7/dc/d4c/f5e 1639903 0 2024-02-07T12:25:48.114 INFO:tasks.workunit.client.0.smithi047.stdout:2/339: chown d7/f39 5161 1 2024-02-07T12:25:48.116 INFO:tasks.workunit.client.0.smithi047.stdout:2/340: unlink d7/d2d/c3f 0 2024-02-07T12:25:48.116 INFO:tasks.workunit.client.0.smithi047.stdout:2/341: read - d7/dc/d51/f60 zero size 2024-02-07T12:25:48.128 INFO:tasks.workunit.client.0.smithi047.stdout:9/144: symlink d3/l2f 0 2024-02-07T12:25:48.131 INFO:tasks.workunit.client.0.smithi047.stdout:9/145: unlink d3/f26 0 2024-02-07T12:25:48.134 INFO:tasks.workunit.client.0.smithi047.stdout:4/334: rename d3/fb to d3/d61/d43/d45/d63/f68 0 2024-02-07T12:25:48.134 INFO:tasks.workunit.client.0.smithi047.stdout:4/335: chown d3/d30/f44 20 1 2024-02-07T12:25:48.134 INFO:tasks.workunit.client.0.smithi047.stdout:4/336: chown d3/c16 7 1 2024-02-07T12:25:48.136 INFO:tasks.workunit.client.0.smithi047.stdout:8/373: creat d3/d36/f7e x:0 0 0 2024-02-07T12:25:48.138 INFO:tasks.workunit.client.0.smithi047.stdout:4/337: rename d3/l19 to d3/d61/d43/d45/l69 0 2024-02-07T12:25:48.142 INFO:tasks.workunit.client.0.smithi047.stdout:2/342: dwrite d7/dc/f2b [0,4194304] 0 2024-02-07T12:25:48.142 INFO:tasks.workunit.client.0.smithi047.stdout:8/374: write d3/d66/d67/d6a/f46 [3433161,26102] 0 2024-02-07T12:25:48.142 INFO:tasks.workunit.client.0.smithi047.stdout:7/287: rename d0/df/d29/l27 to d0/d42/l5f 0 2024-02-07T12:25:48.147 INFO:tasks.workunit.client.0.smithi047.stdout:4/338: write d3/f17 [285721,51204] 0 2024-02-07T12:25:48.147 INFO:tasks.workunit.client.0.smithi047.stdout:4/339: write d3/f20 [1360346,85610] 0 2024-02-07T12:25:48.148 INFO:tasks.workunit.client.0.smithi047.stdout:9/146: dwrite d3/d10/d18/f2e [0,4194304] 0 2024-02-07T12:25:48.149 INFO:tasks.workunit.client.0.smithi047.stdout:8/375: link d3/f6f d3/d4/f7f 0 2024-02-07T12:25:48.149 INFO:tasks.workunit.client.0.smithi047.stdout:8/376: dread - d3/d66/f79 zero size 2024-02-07T12:25:48.150 INFO:tasks.workunit.client.0.smithi047.stdout:8/377: creat d3/d66/f80 x:0 0 0 2024-02-07T12:25:48.152 INFO:tasks.workunit.client.0.smithi047.stdout:7/288: creat d0/df/d29/d3e/f60 x:0 0 0 2024-02-07T12:25:48.152 INFO:tasks.workunit.client.0.smithi047.stdout:7/289: read d0/df/d29/f22 [3943824,15162] 0 2024-02-07T12:25:48.154 INFO:tasks.workunit.client.0.smithi047.stdout:9/147: write d3/f9 [3404347,15704] 0 2024-02-07T12:25:48.154 INFO:tasks.workunit.client.0.smithi047.stdout:9/148: fsync d3/f22 0 2024-02-07T12:25:48.155 INFO:tasks.workunit.client.0.smithi047.stdout:4/340: creat d3/d30/d37/f6a x:0 0 0 2024-02-07T12:25:48.157 INFO:tasks.workunit.client.0.smithi047.stdout:4/341: read d3/d30/d37/f55 [254141,38195] 0 2024-02-07T12:25:48.161 INFO:tasks.workunit.client.0.smithi047.stdout:7/290: mknod d0/df/d29/d31/d55/c61 0 2024-02-07T12:25:48.164 INFO:tasks.workunit.client.0.smithi047.stdout:5/343: rename da/d24/d2b/d2e to da/df/d16/d25/d71 0 2024-02-07T12:25:48.164 INFO:tasks.workunit.client.0.smithi047.stdout:8/378: write d3/d4/fa [599848,127628] 0 2024-02-07T12:25:48.164 INFO:tasks.workunit.client.0.smithi047.stdout:8/379: read - d3/d36/d50/d30/f5f zero size 2024-02-07T12:25:48.172 INFO:tasks.workunit.client.0.smithi047.stdout:2/343: dread d7/dc/d4c/f5e [0,4194304] 0 2024-02-07T12:25:48.182 INFO:tasks.workunit.client.0.smithi047.stdout:8/380: dwrite d3/d4/f7 [0,4194304] 0 2024-02-07T12:25:48.200 INFO:tasks.workunit.client.0.smithi047.stdout:2/344: dwrite d7/dc/f5b [0,4194304] 0 2024-02-07T12:25:48.253 INFO:tasks.workunit.client.0.smithi047.stdout:9/149: truncate d3/d10/f24 522891 0 2024-02-07T12:25:48.255 INFO:tasks.workunit.client.0.smithi047.stdout:4/342: symlink d3/d27/l6b 0 2024-02-07T12:25:48.259 INFO:tasks.workunit.client.0.smithi047.stdout:7/291: dread d0/d4/f16 [0,4194304] 0 2024-02-07T12:25:48.260 INFO:tasks.workunit.client.0.smithi047.stdout:3/334: rename lf to d12/d19/d37/l77 0 2024-02-07T12:25:48.260 INFO:tasks.workunit.client.0.smithi047.stdout:3/335: write d12/d19/d37/f4f [1496993,108708] 0 2024-02-07T12:25:48.266 INFO:tasks.workunit.client.0.smithi047.stdout:5/344: creat da/df/d16/d25/d71/d68/f72 x:0 0 0 2024-02-07T12:25:48.267 INFO:tasks.workunit.client.0.smithi047.stdout:5/345: read da/df/f38 [11713,19409] 0 2024-02-07T12:25:48.267 INFO:tasks.workunit.client.0.smithi047.stdout:5/346: dread - da/d24/d2b/f3a zero size 2024-02-07T12:25:48.267 INFO:tasks.workunit.client.0.smithi047.stdout:5/347: readlink da/df/d16/d25/l30 0 2024-02-07T12:25:48.268 INFO:tasks.workunit.client.0.smithi047.stdout:8/381: creat d3/d36/d50/f81 x:0 0 0 2024-02-07T12:25:48.279 INFO:tasks.workunit.client.0.smithi047.stdout:9/150: symlink d3/d10/l30 0 2024-02-07T12:25:48.281 INFO:tasks.workunit.client.0.smithi047.stdout:4/343: mkdir d3/d61/d43/d45/d6c 0 2024-02-07T12:25:48.283 INFO:tasks.workunit.client.0.smithi047.stdout:7/292: symlink d0/df/d29/d31/d55/l62 0 2024-02-07T12:25:48.285 INFO:tasks.workunit.client.0.smithi047.stdout:3/336: symlink d12/d19/d2d/d42/l78 0 2024-02-07T12:25:48.288 INFO:tasks.workunit.client.0.smithi047.stdout:2/345: truncate d7/f13 3835391 0 2024-02-07T12:25:48.288 INFO:tasks.workunit.client.0.smithi047.stdout:2/346: read - d7/d2d/f45 zero size 2024-02-07T12:25:48.288 INFO:tasks.workunit.client.0.smithi047.stdout:9/151: write d3/d10/d18/f2e [668627,24353] 0 2024-02-07T12:25:48.289 INFO:tasks.workunit.client.0.smithi047.stdout:4/344: unlink d3/d30/l47 0 2024-02-07T12:25:48.290 INFO:tasks.workunit.client.0.smithi047.stdout:7/293: symlink d0/df/d29/l63 0 2024-02-07T12:25:48.291 INFO:tasks.workunit.client.0.smithi047.stdout:7/294: fdatasync d0/d4/f16 0 2024-02-07T12:25:48.291 INFO:tasks.workunit.client.0.smithi047.stdout:7/295: write d0/d4/f16 [784007,40287] 0 2024-02-07T12:25:48.291 INFO:tasks.workunit.client.0.smithi047.stdout:5/348: dwrite da/df/d16/d25/d71/f31 [0,4194304] 0 2024-02-07T12:25:48.297 INFO:tasks.workunit.client.0.smithi047.stdout:1/196: rename d1/d15/l1a to d1/l38 0 2024-02-07T12:25:48.301 INFO:tasks.workunit.client.0.smithi047.stdout:7/296: creat d0/f64 x:0 0 0 2024-02-07T12:25:48.301 INFO:tasks.workunit.client.0.smithi047.stdout:7/297: stat d0/d42/l48 0 2024-02-07T12:25:48.304 INFO:tasks.workunit.client.0.smithi047.stdout:2/347: read d7/dc/d4c/f58 [2401336,4103] 0 2024-02-07T12:25:48.305 INFO:tasks.workunit.client.0.smithi047.stdout:2/348: truncate d7/dc/f59 553281 0 2024-02-07T12:25:48.305 INFO:tasks.workunit.client.0.smithi047.stdout:2/349: read d7/dc/f1a [141056,38314] 0 2024-02-07T12:25:48.305 INFO:tasks.workunit.client.0.smithi047.stdout:2/350: truncate d7/d2d/f43 2036156 0 2024-02-07T12:25:48.305 INFO:tasks.workunit.client.0.smithi047.stdout:2/351: write d7/d2d/f53 [714620,101084] 0 2024-02-07T12:25:48.305 INFO:tasks.workunit.client.0.smithi047.stdout:2/352: creat d7/d2d/f63 x:0 0 0 2024-02-07T12:25:48.307 INFO:tasks.workunit.client.0.smithi047.stdout:2/353: write d7/f23 [4759374,87886] 0 2024-02-07T12:25:48.307 INFO:tasks.workunit.client.0.smithi047.stdout:2/354: chown d7/dc/f59 42 1 2024-02-07T12:25:48.310 INFO:tasks.workunit.client.0.smithi047.stdout:8/382: rename d3/d36/d50/d30/f78 to d3/d36/d50/d30/d34/f82 0 2024-02-07T12:25:48.311 INFO:tasks.workunit.client.0.smithi047.stdout:4/345: dread d3/ff [0,4194304] 0 2024-02-07T12:25:48.311 INFO:tasks.workunit.client.0.smithi047.stdout:4/346: write d3/d30/f5b [31587,108057] 0 2024-02-07T12:25:48.312 INFO:tasks.workunit.client.0.smithi047.stdout:4/347: read d3/f12 [4434,5415] 0 2024-02-07T12:25:48.312 INFO:tasks.workunit.client.0.smithi047.stdout:4/348: fdatasync d3/d30/d37/f5d 0 2024-02-07T12:25:48.312 INFO:tasks.workunit.client.0.smithi047.stdout:7/298: rmdir d0/d2f 39 2024-02-07T12:25:48.316 INFO:tasks.workunit.client.0.smithi047.stdout:2/355: mknod d7/d2d/d5c/c64 0 2024-02-07T12:25:48.317 INFO:tasks.workunit.client.0.smithi047.stdout:7/299: dread d0/f47 [0,4194304] 0 2024-02-07T12:25:48.318 INFO:tasks.workunit.client.0.smithi047.stdout:8/383: symlink d3/d36/d50/d28/l83 0 2024-02-07T12:25:48.318 INFO:tasks.workunit.client.0.smithi047.stdout:8/384: creat d3/d36/d50/d2a/d3c/f84 x:0 0 0 2024-02-07T12:25:48.320 INFO:tasks.workunit.client.0.smithi047.stdout:9/152: dwrite d3/f21 [0,4194304] 0 2024-02-07T12:25:48.320 INFO:tasks.workunit.client.0.smithi047.stdout:9/153: write d3/f9 [3760499,88490] 0 2024-02-07T12:25:48.321 INFO:tasks.workunit.client.0.smithi047.stdout:2/356: dread d7/dc/d4c/f58 [0,4194304] 0 2024-02-07T12:25:48.321 INFO:tasks.workunit.client.0.smithi047.stdout:3/337: dwrite d12/f64 [0,4194304] 0 2024-02-07T12:25:48.327 INFO:tasks.workunit.client.0.smithi047.stdout:4/349: rename d3/d61/f39 to d3/d61/d43/f6d 0 2024-02-07T12:25:48.327 INFO:tasks.workunit.client.0.smithi047.stdout:4/350: truncate d3/f12 968741 0 2024-02-07T12:25:48.327 INFO:tasks.workunit.client.0.smithi047.stdout:4/351: dread - d3/d30/d37/f6a zero size 2024-02-07T12:25:48.330 INFO:tasks.workunit.client.0.smithi047.stdout:7/300: creat d0/df/d29/f65 x:0 0 0 2024-02-07T12:25:48.334 INFO:tasks.workunit.client.0.smithi047.stdout:9/154: creat d3/d10/f31 x:0 0 0 2024-02-07T12:25:48.338 INFO:tasks.workunit.client.0.smithi047.stdout:4/352: creat d3/d30/f6e x:0 0 0 2024-02-07T12:25:48.341 INFO:tasks.workunit.client.0.smithi047.stdout:4/353: dread d3/d30/f44 [0,4194304] 0 2024-02-07T12:25:48.346 INFO:tasks.workunit.client.0.smithi047.stdout:3/338: dwrite d12/d19/f5b [0,4194304] 0 2024-02-07T12:25:48.357 INFO:tasks.workunit.client.0.smithi047.stdout:3/339: dread d12/f13 [0,4194304] 0 2024-02-07T12:25:48.468 INFO:tasks.workunit.client.0.smithi047.stdout:7/301: mknod d0/df/d29/c66 0 2024-02-07T12:25:48.468 INFO:tasks.workunit.client.0.smithi047.stdout:7/302: chown d0/df/d29/d31/l38 4474175 1 2024-02-07T12:25:48.470 INFO:tasks.workunit.client.0.smithi047.stdout:9/155: unlink f2 0 2024-02-07T12:25:48.471 INFO:tasks.workunit.client.0.smithi047.stdout:4/354: creat d3/d61/d43/d45/d66/f6f x:0 0 0 2024-02-07T12:25:48.477 INFO:tasks.workunit.client.0.smithi047.stdout:3/340: rename d12/d19/d37/f4f to d12/d19/d21/d29/d31/d38/f79 0 2024-02-07T12:25:48.479 INFO:tasks.workunit.client.0.smithi047.stdout:8/385: rename d3/d36/d50/d30/d34/f82 to d3/d36/d50/d30/d34/f85 0 2024-02-07T12:25:48.480 INFO:tasks.workunit.client.0.smithi047.stdout:7/303: mkdir d0/d42/d4d/d67 0 2024-02-07T12:25:48.483 INFO:tasks.workunit.client.0.smithi047.stdout:9/156: mkdir d3/d10/d11/d32 0 2024-02-07T12:25:48.485 INFO:tasks.workunit.client.0.smithi047.stdout:4/355: mkdir d3/d61/d70 0 2024-02-07T12:25:48.485 INFO:tasks.workunit.client.0.smithi047.stdout:4/356: fdatasync d3/d61/d43/f53 0 2024-02-07T12:25:48.485 INFO:tasks.workunit.client.0.smithi047.stdout:7/304: dread d0/d4/f33 [0,4194304] 0 2024-02-07T12:25:48.486 INFO:tasks.workunit.client.0.smithi047.stdout:3/341: mknod d12/d19/d21/d29/d31/d61/c7a 0 2024-02-07T12:25:48.488 INFO:tasks.workunit.client.0.smithi047.stdout:4/357: symlink d3/d61/d43/l71 0 2024-02-07T12:25:48.489 INFO:tasks.workunit.client.0.smithi047.stdout:3/342: dread d12/d19/d21/d29/d31/d38/f79 [0,4194304] 0 2024-02-07T12:25:48.490 INFO:tasks.workunit.client.0.smithi047.stdout:7/305: chown d0/d4/l58 13138 1 2024-02-07T12:25:48.492 INFO:tasks.workunit.client.0.smithi047.stdout:3/343: symlink d12/d19/l7b 0 2024-02-07T12:25:48.496 INFO:tasks.workunit.client.0.smithi047.stdout:4/358: write d3/d61/d43/f53 [2661921,47006] 0 2024-02-07T12:25:48.496 INFO:tasks.workunit.client.0.smithi047.stdout:4/359: fsync d3/d61/f58 0 2024-02-07T12:25:48.496 INFO:tasks.workunit.client.0.smithi047.stdout:4/360: truncate d3/f6 1799620 0 2024-02-07T12:25:48.497 INFO:tasks.workunit.client.0.smithi047.stdout:3/344: dread d12/d19/d21/f2c [0,4194304] 0 2024-02-07T12:25:48.498 INFO:tasks.workunit.client.0.smithi047.stdout:3/345: write d12/d19/d37/f74 [1235586,19453] 0 2024-02-07T12:25:48.498 INFO:tasks.workunit.client.0.smithi047.stdout:4/361: link d3/d30/f5b d3/d27/d3b/f72 0 2024-02-07T12:25:48.499 INFO:tasks.workunit.client.0.smithi047.stdout:4/362: mkdir d3/d61/d43/d45/d6c/d73 0 2024-02-07T12:25:48.502 INFO:tasks.workunit.client.0.smithi047.stdout:4/363: unlink d3/ff 0 2024-02-07T12:25:48.503 INFO:tasks.workunit.client.0.smithi047.stdout:3/346: dread d12/d19/d37/f74 [0,4194304] 0 2024-02-07T12:25:48.503 INFO:tasks.workunit.client.0.smithi047.stdout:3/347: readlink d12/d19/l7b 0 2024-02-07T12:25:48.503 INFO:tasks.workunit.client.0.smithi047.stdout:9/157: fsync d3/d10/f31 0 2024-02-07T12:25:48.506 INFO:tasks.workunit.client.0.smithi047.stdout:3/348: mkdir d12/d19/d21/d29/d31/d7c 0 2024-02-07T12:25:48.508 INFO:tasks.workunit.client.0.smithi047.stdout:9/158: symlink d3/d10/d11/d32/l33 0 2024-02-07T12:25:48.508 INFO:tasks.workunit.client.0.smithi047.stdout:9/159: chown d3/d10/d18 12925 1 2024-02-07T12:25:48.508 INFO:tasks.workunit.client.0.smithi047.stdout:9/160: readlink d3/l5 0 2024-02-07T12:25:48.509 INFO:tasks.workunit.client.0.smithi047.stdout:3/349: truncate d12/f3d 3437645 0 2024-02-07T12:25:48.510 INFO:tasks.workunit.client.0.smithi047.stdout:9/161: creat d3/f34 x:0 0 0 2024-02-07T12:25:48.520 INFO:tasks.workunit.client.0.smithi047.stdout:9/162: write d3/f29 [1571832,67571] 0 2024-02-07T12:25:48.522 INFO:tasks.workunit.client.0.smithi047.stdout:3/350: write fc [2046389,129890] 0 2024-02-07T12:25:48.522 INFO:tasks.workunit.client.0.smithi047.stdout:7/306: dwrite d0/d4/f33 [0,4194304] 0 2024-02-07T12:25:48.524 INFO:tasks.workunit.client.0.smithi047.stdout:9/163: unlink d3/d10/f2d 0 2024-02-07T12:25:48.524 INFO:tasks.workunit.client.0.smithi047.stdout:3/351: rmdir d12/d19/d21 39 2024-02-07T12:25:48.526 INFO:tasks.workunit.client.0.smithi047.stdout:3/352: rmdir d12/d19/d2d 39 2024-02-07T12:25:48.526 INFO:tasks.workunit.client.0.smithi047.stdout:4/364: dwrite d3/f23 [0,4194304] 0 2024-02-07T12:25:48.526 INFO:tasks.workunit.client.0.smithi047.stdout:4/365: write d3/d30/f6e [584257,125556] 0 2024-02-07T12:25:48.528 INFO:tasks.workunit.client.0.smithi047.stdout:3/353: mknod d12/d19/d2d/d33/c7d 0 2024-02-07T12:25:48.530 INFO:tasks.workunit.client.0.smithi047.stdout:3/354: dread d12/f25 [0,4194304] 0 2024-02-07T12:25:48.531 INFO:tasks.workunit.client.0.smithi047.stdout:4/366: unlink d3/d27/d3b/f64 0 2024-02-07T12:25:48.534 INFO:tasks.workunit.client.0.smithi047.stdout:3/355: creat d12/d19/d21/d29/d31/d38/f7e x:0 0 0 2024-02-07T12:25:48.534 INFO:tasks.workunit.client.0.smithi047.stdout:3/356: chown l8 31740 1 2024-02-07T12:25:48.534 INFO:tasks.workunit.client.0.smithi047.stdout:4/367: mknod d3/d61/d43/d45/d63/c74 0 2024-02-07T12:25:48.534 INFO:tasks.workunit.client.0.smithi047.stdout:4/368: chown d3/c16 34660 1 2024-02-07T12:25:48.543 INFO:tasks.workunit.client.0.smithi047.stdout:9/164: dwrite d3/f19 [0,4194304] 0 2024-02-07T12:25:48.544 INFO:tasks.workunit.client.0.smithi047.stdout:9/165: dread d3/f22 [0,4194304] 0 2024-02-07T12:25:48.545 INFO:tasks.workunit.client.0.smithi047.stdout:9/166: chown d3/d10/l1c 89 1 2024-02-07T12:25:48.545 INFO:tasks.workunit.client.0.smithi047.stdout:9/167: write d3/d10/f1f [5221419,79372] 0 2024-02-07T12:25:48.546 INFO:tasks.workunit.client.0.smithi047.stdout:9/168: symlink d3/d10/d11/l35 0 2024-02-07T12:25:48.547 INFO:tasks.workunit.client.0.smithi047.stdout:4/369: dread d3/d30/f44 [0,4194304] 0 2024-02-07T12:25:48.548 INFO:tasks.workunit.client.0.smithi047.stdout:9/169: truncate d3/f9 3821835 0 2024-02-07T12:25:48.548 INFO:tasks.workunit.client.0.smithi047.stdout:9/170: write d3/f22 [703542,95923] 0 2024-02-07T12:25:48.548 INFO:tasks.workunit.client.0.smithi047.stdout:9/171: write d3/f22 [640676,40344] 0 2024-02-07T12:25:48.548 INFO:tasks.workunit.client.0.smithi047.stdout:9/172: read d3/d10/d18/f2e [1662317,38437] 0 2024-02-07T12:25:48.549 INFO:tasks.workunit.client.0.smithi047.stdout:4/370: creat d3/f75 x:0 0 0 2024-02-07T12:25:48.552 INFO:tasks.workunit.client.0.smithi047.stdout:9/173: rename d3/d10/c23 to d3/d10/d18/c36 0 2024-02-07T12:25:48.552 INFO:tasks.workunit.client.0.smithi047.stdout:3/357: dwrite d12/d19/d2d/d42/f55 [0,4194304] 0 2024-02-07T12:25:48.552 INFO:tasks.workunit.client.0.smithi047.stdout:3/358: write d12/d19/f26 [1938592,31528] 0 2024-02-07T12:25:48.555 INFO:tasks.workunit.client.0.smithi047.stdout:4/371: rename d3/d61/d43/f6d to d3/d27/d3b/f76 0 2024-02-07T12:25:48.560 INFO:tasks.workunit.client.0.smithi047.stdout:9/174: dread d3/f22 [0,4194304] 0 2024-02-07T12:25:48.567 INFO:tasks.workunit.client.0.smithi047.stdout:3/359: dwrite d12/d19/d37/f68 [0,4194304] 0 2024-02-07T12:25:48.576 INFO:tasks.workunit.client.0.smithi047.stdout:4/372: chown d3/d61/d43/d45/d63/c74 2985628 1 2024-02-07T12:25:48.576 INFO:tasks.workunit.client.0.smithi047.stdout:3/360: dread d12/f14 [0,4194304] 0 2024-02-07T12:25:48.597 INFO:tasks.workunit.client.0.smithi047.stdout:3/361: dwrite d12/d19/d21/d29/d31/f3e [0,4194304] 0 2024-02-07T12:25:48.597 INFO:tasks.workunit.client.0.smithi047.stdout:4/373: dread d3/f14 [0,4194304] 0 2024-02-07T12:25:48.599 INFO:tasks.workunit.client.0.smithi047.stdout:3/362: creat d12/d19/d2d/d33/f7f x:0 0 0 2024-02-07T12:25:48.621 INFO:tasks.workunit.client.0.smithi047.stdout:4/374: dwrite d3/d61/d43/f4c [0,4194304] 0 2024-02-07T12:25:48.621 INFO:tasks.workunit.client.0.smithi047.stdout:3/363: dwrite d12/f16 [0,4194304] 0 2024-02-07T12:25:48.627 INFO:tasks.workunit.client.0.smithi047.stdout:3/364: unlink d12/d19/d46/f5d 0 2024-02-07T12:25:48.627 INFO:tasks.workunit.client.0.smithi047.stdout:3/365: chown d12/d19/d2d/d52/l57 3979 1 2024-02-07T12:25:48.628 INFO:tasks.workunit.client.0.smithi047.stdout:3/366: write d12/d19/d2d/f63 [70167,68320] 0 2024-02-07T12:25:48.628 INFO:tasks.workunit.client.0.smithi047.stdout:3/367: readlink d12/d19/d37/l5e 0 2024-02-07T12:25:48.630 INFO:tasks.workunit.client.0.smithi047.stdout:3/368: rename d12/d19/d21/d29/d31/d38/f79 to d12/d19/d21/d29/d31/d38/d4c/f80 0 2024-02-07T12:25:48.633 INFO:tasks.workunit.client.0.smithi047.stdout:3/369: link d12/d19/d2d/d33/f35 d12/d19/d21/d29/f81 0 2024-02-07T12:25:48.635 INFO:tasks.workunit.client.0.smithi047.stdout:3/370: mkdir d12/d19/d2d/d82 0 2024-02-07T12:25:48.635 INFO:tasks.workunit.client.0.smithi047.stdout:3/371: chown d12 96150 1 2024-02-07T12:25:48.635 INFO:tasks.workunit.client.0.smithi047.stdout:3/372: chown d12/d19/d21/d29/d31/d7c 934847932 1 2024-02-07T12:25:48.638 INFO:tasks.workunit.client.0.smithi047.stdout:4/375: dwrite d3/d30/f6e [0,4194304] 0 2024-02-07T12:25:48.642 INFO:tasks.workunit.client.0.smithi047.stdout:4/376: rename d3/d61/d43/d45/d66/c52 to d3/d27/d3b/c77 0 2024-02-07T12:25:48.643 INFO:tasks.workunit.client.0.smithi047.stdout:3/373: write d12/d19/d46/f72 [3273855,23239] 0 2024-02-07T12:25:48.644 INFO:tasks.workunit.client.0.smithi047.stdout:3/374: fdatasync d12/d19/d2d/d42/f56 0 2024-02-07T12:25:48.644 INFO:tasks.workunit.client.0.smithi047.stdout:4/377: creat d3/d61/d43/d45/d6c/d73/f78 x:0 0 0 2024-02-07T12:25:48.646 INFO:tasks.workunit.client.0.smithi047.stdout:3/375: creat d12/d19/d21/d29/d31/d61/f83 x:0 0 0 2024-02-07T12:25:48.648 INFO:tasks.workunit.client.0.smithi047.stdout:4/378: mknod d3/d61/d43/d45/d66/c79 0 2024-02-07T12:25:48.649 INFO:tasks.workunit.client.0.smithi047.stdout:4/379: write f1 [2369876,114658] 0 2024-02-07T12:25:48.650 INFO:tasks.workunit.client.0.smithi047.stdout:3/376: symlink d12/d19/d2d/d42/l84 0 2024-02-07T12:25:48.650 INFO:tasks.workunit.client.0.smithi047.stdout:3/377: chown d12/d19/d21/d29/d31/c3c 4070 1 2024-02-07T12:25:48.650 INFO:tasks.workunit.client.0.smithi047.stdout:3/378: write d12/d19/f1e [938222,64152] 0 2024-02-07T12:25:48.670 INFO:tasks.workunit.client.0.smithi047.stdout:4/380: dwrite d3/d61/d43/d45/d66/f6f [0,4194304] 0 2024-02-07T12:25:48.672 INFO:tasks.workunit.client.0.smithi047.stdout:4/381: link d3/d61/d43/l71 d3/d27/d3b/l7a 0 2024-02-07T12:25:48.674 INFO:tasks.workunit.client.0.smithi047.stdout:3/379: dwrite d12/d19/d21/d29/f66 [0,4194304] 0 2024-02-07T12:25:48.674 INFO:tasks.workunit.client.0.smithi047.stdout:3/380: fsync d12/d19/d21/d29/d31/f3e 0 2024-02-07T12:25:48.678 INFO:tasks.workunit.client.0.smithi047.stdout:3/381: creat d12/d19/d2d/d82/f85 x:0 0 0 2024-02-07T12:25:48.683 INFO:tasks.workunit.client.0.smithi047.stdout:3/382: unlink d12/d19/d21/l3f 0 2024-02-07T12:25:48.686 INFO:tasks.workunit.client.0.smithi047.stdout:3/383: rename d12/d19/f5b to d12/d19/d21/d29/d31/d61/f86 0 2024-02-07T12:25:48.688 INFO:tasks.workunit.client.0.smithi047.stdout:3/384: mkdir d12/d19/d21/d29/d31/d38/d59/d87 0 2024-02-07T12:25:48.699 INFO:tasks.workunit.client.0.smithi047.stdout:3/385: dread d12/d19/d21/d29/d31/f3e [0,4194304] 0 2024-02-07T12:25:48.704 INFO:tasks.workunit.client.0.smithi047.stdout:3/386: dread d12/f18 [0,4194304] 0 2024-02-07T12:25:48.706 INFO:tasks.workunit.client.0.smithi047.stdout:3/387: rename f2 to d12/d19/d21/d29/d44/f88 0 2024-02-07T12:25:48.708 INFO:tasks.workunit.client.0.smithi047.stdout:3/388: rename d12/d19/d2d/l50 to d12/d19/d2d/d82/l89 0 2024-02-07T12:25:48.710 INFO:tasks.workunit.client.0.smithi047.stdout:3/389: write d12/d19/f1e [390434,61230] 0 2024-02-07T12:25:48.712 INFO:tasks.workunit.client.0.smithi047.stdout:3/390: link f11 d12/d19/d21/d29/d31/f8a 0 2024-02-07T12:25:48.714 INFO:tasks.workunit.client.0.smithi047.stdout:3/391: creat d12/d19/d2d/f8b x:0 0 0 2024-02-07T12:25:48.714 INFO:tasks.workunit.client.0.smithi047.stdout:3/392: chown d12/d19/f53 1380932 1 2024-02-07T12:25:48.714 INFO:tasks.workunit.client.0.smithi047.stdout:3/393: write d12/f13 [2981547,115544] 0 2024-02-07T12:25:48.721 INFO:tasks.workunit.client.0.smithi047.stdout:3/394: dread d12/f3d [0,4194304] 0 2024-02-07T12:25:48.729 INFO:tasks.workunit.client.0.smithi047.stdout:3/395: read d12/d19/d2d/d33/f35 [3582814,62540] 0 2024-02-07T12:25:48.729 INFO:tasks.workunit.client.0.smithi047.stdout:3/396: stat d12/d19/d21/d29/f66 0 2024-02-07T12:25:48.738 INFO:tasks.workunit.client.0.smithi047.stdout:3/397: write d12/d19/d21/d29/d31/f45 [1820395,50242] 0 2024-02-07T12:25:48.743 INFO:tasks.workunit.client.0.smithi047.stdout:3/398: write d12/d19/d21/d29/d31/f3e [2276918,10359] 0 2024-02-07T12:25:48.754 INFO:tasks.workunit.client.0.smithi047.stdout:3/399: dwrite d12/d19/d21/d29/d31/d38/f71 [0,4194304] 0 2024-02-07T12:25:48.757 INFO:tasks.workunit.client.0.smithi047.stdout:3/400: dread d12/d19/d21/d29/d31/d38/d4c/f80 [0,4194304] 0 2024-02-07T12:25:48.758 INFO:tasks.workunit.client.0.smithi047.stdout:3/401: mkdir d12/d19/d21/d29/d31/d7c/d8c 0 2024-02-07T12:25:48.758 INFO:tasks.workunit.client.0.smithi047.stdout:3/402: chown d12/d19/d2d/d42/d6b 15 1 2024-02-07T12:25:48.759 INFO:tasks.workunit.client.0.smithi047.stdout:3/403: truncate d12/d19/d2d/d33/f3a 3653364 0 2024-02-07T12:25:48.759 INFO:tasks.workunit.client.0.smithi047.stdout:3/404: write d12/d19/f1e [1754307,20576] 0 2024-02-07T12:25:48.760 INFO:tasks.workunit.client.0.smithi047.stdout:3/405: write d12/f13 [3256346,21917] 0 2024-02-07T12:25:48.762 INFO:tasks.workunit.client.0.smithi047.stdout:3/406: mkdir d12/d19/d2d/d33/d8d 0 2024-02-07T12:25:48.763 INFO:tasks.workunit.client.0.smithi047.stdout:3/407: read d12/d19/f1d [1721233,85466] 0 2024-02-07T12:25:48.763 INFO:tasks.workunit.client.0.smithi047.stdout:3/408: write d12/d19/d2d/f8b [593665,93562] 0 2024-02-07T12:25:48.763 INFO:tasks.workunit.client.0.smithi047.stdout:3/409: creat d12/d19/d21/d29/d31/d61/f8e x:0 0 0 2024-02-07T12:25:48.763 INFO:tasks.workunit.client.0.smithi047.stdout:3/410: fsync d12/d19/d21/d29/d31/d38/d4c/f80 0 2024-02-07T12:25:48.766 INFO:tasks.workunit.client.0.smithi047.stdout:3/411: creat d12/d19/f8f x:0 0 0 2024-02-07T12:25:48.766 INFO:tasks.workunit.client.0.smithi047.stdout:3/412: write d12/d19/d2d/d82/f85 [452110,8194] 0 2024-02-07T12:25:48.780 INFO:tasks.workunit.client.0.smithi047.stdout:3/413: dwrite d12/d19/d21/d29/d31/d38/f71 [0,4194304] 0 2024-02-07T12:25:48.780 INFO:tasks.workunit.client.0.smithi047.stdout:3/414: write d12/d19/f1e [2475446,47592] 0 2024-02-07T12:25:48.796 INFO:tasks.workunit.client.0.smithi047.stdout:3/415: dwrite d12/f76 [0,4194304] 0 2024-02-07T12:25:48.818 INFO:tasks.workunit.client.0.smithi047.stdout:3/416: dwrite d12/d19/d2d/d42/f56 [0,4194304] 0 2024-02-07T12:25:48.825 INFO:tasks.workunit.client.0.smithi047.stdout:3/417: write d12/d19/d21/d29/d31/f8a [3866942,5126] 0 2024-02-07T12:25:48.826 INFO:tasks.workunit.client.0.smithi047.stdout:3/418: mkdir d12/d19/d21/d90 0 2024-02-07T12:25:48.834 INFO:tasks.workunit.client.0.smithi047.stdout:3/419: dread d12/d19/d37/f68 [0,4194304] 0 2024-02-07T12:25:48.842 INFO:tasks.workunit.client.0.smithi047.stdout:3/420: dread d12/f64 [0,4194304] 0 2024-02-07T12:25:48.843 INFO:tasks.workunit.client.0.smithi047.stdout:3/421: creat d12/d19/d21/d90/f91 x:0 0 0 2024-02-07T12:25:48.846 INFO:tasks.workunit.client.0.smithi047.stdout:3/422: dread d12/f25 [0,4194304] 0 2024-02-07T12:25:48.847 INFO:tasks.workunit.client.0.smithi047.stdout:3/423: unlink cd 0 2024-02-07T12:25:48.847 INFO:tasks.workunit.client.0.smithi047.stdout:3/424: readlink d12/d19/d2d/d82/l89 0 2024-02-07T12:25:48.847 INFO:tasks.workunit.client.0.smithi047.stdout:3/425: fsync d12/d19/d2d/d33/f3a 0 2024-02-07T12:25:48.865 INFO:tasks.workunit.client.0.smithi047.stdout:3/426: dwrite d12/d19/d2d/d33/f3a [4194304,4194304] 0 2024-02-07T12:25:48.865 INFO:tasks.workunit.client.0.smithi047.stdout:3/427: readlink d12/d19/d2d/d52/l57 0 2024-02-07T12:25:48.885 INFO:tasks.workunit.client.0.smithi047.stdout:3/428: dwrite d12/d19/d21/d29/f81 [0,4194304] 0 2024-02-07T12:25:48.888 INFO:tasks.workunit.client.0.smithi047.stdout:3/429: truncate d12/d19/d2d/d33/f3a 5431568 0 2024-02-07T12:25:48.910 INFO:tasks.workunit.client.0.smithi047.stdout:3/430: dwrite d12/d19/f5a [4194304,4194304] 0 2024-02-07T12:25:48.911 INFO:tasks.workunit.client.0.smithi047.stdout:3/431: link l1 d12/d19/d2d/d33/l92 0 2024-02-07T12:25:48.913 INFO:tasks.workunit.client.0.smithi047.stdout:3/432: mkdir d12/d19/d21/d29/d6f/d93 0 2024-02-07T12:25:48.913 INFO:tasks.workunit.client.0.smithi047.stdout:3/433: chown d12/d19/d21/d29/d31 232234 1 2024-02-07T12:25:48.920 INFO:tasks.workunit.client.0.smithi047.stdout:3/434: dread f11 [0,4194304] 0 2024-02-07T12:25:48.920 INFO:tasks.workunit.client.0.smithi047.stdout:3/435: chown d12/d19/d2d/f8b 724 1 2024-02-07T12:25:48.920 INFO:tasks.workunit.client.0.smithi047.stdout:3/436: fsync d12/d19/d21/d29/f2f 0 2024-02-07T12:25:48.920 INFO:tasks.workunit.client.0.smithi047.stdout:3/437: write d12/d19/d21/d29/d31/f45 [5064872,118219] 0 2024-02-07T12:25:48.920 INFO:tasks.workunit.client.0.smithi047.stdout:3/438: truncate d12/f25 2417066 0 2024-02-07T12:25:48.920 INFO:tasks.workunit.client.0.smithi047.stdout:3/439: stat d12/d19/d2d/d82/l89 0 2024-02-07T12:25:48.921 INFO:tasks.workunit.client.0.smithi047.stdout:3/440: symlink d12/d19/d2d/d82/l94 0 2024-02-07T12:25:48.936 INFO:tasks.workunit.client.0.smithi047.stdout:3/441: dwrite d12/d19/d21/d29/d31/d38/d59/f5f [0,4194304] 0 2024-02-07T12:25:48.939 INFO:tasks.workunit.client.0.smithi047.stdout:3/442: truncate d12/f18 193035 0 2024-02-07T12:25:48.956 INFO:tasks.workunit.client.0.smithi047.stdout:3/443: dwrite d12/d19/d21/d29/d31/d38/d59/f67 [0,4194304] 0 2024-02-07T12:25:48.957 INFO:tasks.workunit.client.0.smithi047.stdout:3/444: mkdir d12/d19/d46/d95 0 2024-02-07T12:25:48.958 INFO:tasks.workunit.client.0.smithi047.stdout:3/445: mknod d12/d19/d46/d95/c96 0 2024-02-07T12:25:48.958 INFO:tasks.workunit.client.0.smithi047.stdout:3/446: write d12/d19/f1d [1708082,64385] 0 2024-02-07T12:25:49.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:49 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:49.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:49 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:49.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:49 smithi138 ceph-mon[35528]: pgmap v11: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 221 MiB/s rd, 261 MiB/s wr, 378 op/s 2024-02-07T12:25:49.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:49 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:49.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:49 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:49.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:49 smithi047 ceph-mon[28972]: pgmap v11: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 221 MiB/s rd, 261 MiB/s wr, 378 op/s 2024-02-07T12:25:50.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:50.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: Adjusting osd_memory_target on smithi138 to 2581M 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:50.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:25:50.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:50 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:25:50.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:50.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:50.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: Adjusting osd_memory_target on smithi138 to 2581M 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-07T12:25:50.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:50.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:25:50.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:50 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:25:51.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: Adjusting osd_memory_target on smithi047 to 1559M 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: Updating smithi047:/etc/ceph/ceph.conf 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: pgmap v12: 65 pgs: 65 active+clean; 1.8 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 233 MiB/s rd, 278 MiB/s wr, 480 op/s 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:51 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.821 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: Adjusting osd_memory_target on smithi047 to 1559M 2024-02-07T12:25:51.822 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: Updating smithi047:/etc/ceph/ceph.conf 2024-02-07T12:25:51.822 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-07T12:25:51.822 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:25:51.822 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:25:51.822 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:25:51.822 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: pgmap v12: 65 pgs: 65 active+clean; 1.8 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 233 MiB/s rd, 278 MiB/s wr, 480 op/s 2024-02-07T12:25:51.822 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:25:51.822 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:25:51.822 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.822 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.822 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.822 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.822 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.823 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.823 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.823 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.823 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:51 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:25:51.889 INFO:tasks.workunit.client.0.smithi047.stdout:4/382: sync 2024-02-07T12:25:51.889 INFO:tasks.workunit.client.0.smithi047.stdout:6/241: sync 2024-02-07T12:25:51.889 INFO:tasks.workunit.client.0.smithi047.stdout:9/175: sync 2024-02-07T12:25:51.889 INFO:tasks.workunit.client.0.smithi047.stdout:1/197: sync 2024-02-07T12:25:51.889 INFO:tasks.workunit.client.0.smithi047.stdout:5/349: sync 2024-02-07T12:25:51.889 INFO:tasks.workunit.client.0.smithi047.stdout:2/357: sync 2024-02-07T12:25:51.889 INFO:tasks.workunit.client.0.smithi047.stdout:1/198: write d1/d15/f1e [1278860,18704] 0 2024-02-07T12:25:51.889 INFO:tasks.workunit.client.0.smithi047.stdout:0/121: sync 2024-02-07T12:25:51.889 INFO:tasks.workunit.client.0.smithi047.stdout:8/386: sync 2024-02-07T12:25:51.890 INFO:tasks.workunit.client.0.smithi047.stdout:0/122: fdatasync f18 0 2024-02-07T12:25:51.890 INFO:tasks.workunit.client.0.smithi047.stdout:3/447: sync 2024-02-07T12:25:51.890 INFO:tasks.workunit.client.0.smithi047.stdout:7/307: sync 2024-02-07T12:25:51.890 INFO:tasks.workunit.client.0.smithi047.stdout:7/308: chown d0/df 104 1 2024-02-07T12:25:51.890 INFO:tasks.workunit.client.0.smithi047.stdout:5/350: stat da/d24/c37 0 2024-02-07T12:25:51.890 INFO:tasks.workunit.client.0.smithi047.stdout:5/351: fsync da/f39 0 2024-02-07T12:25:51.891 INFO:tasks.workunit.client.0.smithi047.stdout:9/176: creat d3/d10/d11/d32/f37 x:0 0 0 2024-02-07T12:25:51.892 INFO:tasks.workunit.client.0.smithi047.stdout:2/358: mkdir d7/dc/d4c/d65 0 2024-02-07T12:25:51.892 INFO:tasks.workunit.client.0.smithi047.stdout:2/359: stat d7/d2d/l34 0 2024-02-07T12:25:51.892 INFO:tasks.workunit.client.0.smithi047.stdout:2/360: chown d7/f39 129877 1 2024-02-07T12:25:51.892 INFO:tasks.workunit.client.0.smithi047.stdout:2/361: chown d7/d2d/l61 66733 1 2024-02-07T12:25:51.892 INFO:tasks.workunit.client.0.smithi047.stdout:4/383: dread d3/f20 [0,4194304] 0 2024-02-07T12:25:51.893 INFO:tasks.workunit.client.0.smithi047.stdout:6/242: write d3/d1e/d25/f4a [1262333,5132] 0 2024-02-07T12:25:51.893 INFO:tasks.workunit.client.0.smithi047.stdout:1/199: mknod d1/d15/d30/c39 0 2024-02-07T12:25:51.893 INFO:tasks.workunit.client.0.smithi047.stdout:1/200: write d1/d15/d18/f24 [925347,91973] 0 2024-02-07T12:25:51.894 INFO:tasks.workunit.client.0.smithi047.stdout:0/123: rmdir d19/d1a 0 2024-02-07T12:25:51.897 INFO:tasks.workunit.client.0.smithi047.stdout:8/387: rename d3/d36/d50/d30/d34/d3e/f48 to d3/d36/d50/d30/d34/d3e/f86 0 2024-02-07T12:25:51.900 INFO:tasks.workunit.client.0.smithi047.stdout:3/448: rename d12/d19/d2d/d33/c60 to d12/d19/d21/d29/d31/d7c/c97 0 2024-02-07T12:25:51.900 INFO:tasks.workunit.client.0.smithi047.stdout:3/449: creat d12/d19/d37/f98 x:0 0 0 2024-02-07T12:25:51.902 INFO:tasks.workunit.client.0.smithi047.stdout:6/243: read d3/f18 [2871657,46021] 0 2024-02-07T12:25:51.902 INFO:tasks.workunit.client.0.smithi047.stdout:7/309: truncate d0/df/d29/f22 2549607 0 2024-02-07T12:25:51.903 INFO:tasks.workunit.client.0.smithi047.stdout:5/352: mkdir da/df/d16/d25/d71/d68/d73 0 2024-02-07T12:25:51.903 INFO:tasks.workunit.client.0.smithi047.stdout:5/353: chown da/df/d16/f3d 5475 1 2024-02-07T12:25:51.904 INFO:tasks.workunit.client.0.smithi047.stdout:9/177: symlink d3/d10/l38 0 2024-02-07T12:25:51.904 INFO:tasks.workunit.client.0.smithi047.stdout:9/178: stat d3/d10/d11/c2a 0 2024-02-07T12:25:51.906 INFO:tasks.workunit.client.0.smithi047.stdout:4/384: truncate d3/d61/d43/f53 2999524 0 2024-02-07T12:25:51.906 INFO:tasks.workunit.client.0.smithi047.stdout:8/388: write d3/d36/d50/f5b [2073099,60951] 0 2024-02-07T12:25:51.908 INFO:tasks.workunit.client.0.smithi047.stdout:1/201: unlink d1/d15/f1e 0 2024-02-07T12:25:51.908 INFO:tasks.workunit.client.0.smithi047.stdout:1/202: write d1/d15/d18/f23 [286435,69879] 0 2024-02-07T12:25:51.912 INFO:tasks.workunit.client.0.smithi047.stdout:2/362: rename d7/dc/c3d to d7/dc/d4c/c66 0 2024-02-07T12:25:51.912 INFO:tasks.workunit.client.0.smithi047.stdout:2/363: dread - d7/dc/d4c/f50 zero size 2024-02-07T12:25:51.912 INFO:tasks.workunit.client.0.smithi047.stdout:2/364: readlink d7/d2d/l4e 0 2024-02-07T12:25:51.918 INFO:tasks.workunit.client.0.smithi047.stdout:3/450: rmdir d12/d19/d37/d75 0 2024-02-07T12:25:51.921 INFO:tasks.workunit.client.0.smithi047.stdout:6/244: creat d3/da/d2c/d42/f4c x:0 0 0 2024-02-07T12:25:51.921 INFO:tasks.workunit.client.0.smithi047.stdout:6/245: readlink d3/da/l38 0 2024-02-07T12:25:51.922 INFO:tasks.workunit.client.0.smithi047.stdout:7/310: readlink d0/ld 0 2024-02-07T12:25:51.923 INFO:tasks.workunit.client.0.smithi047.stdout:7/311: creat d0/df/d29/f68 x:0 0 0 2024-02-07T12:25:51.925 INFO:tasks.workunit.client.0.smithi047.stdout:9/179: symlink d3/d10/l39 0 2024-02-07T12:25:51.925 INFO:tasks.workunit.client.0.smithi047.stdout:9/180: write d3/d10/d18/f27 [7685,30288] 0 2024-02-07T12:25:51.926 INFO:tasks.workunit.client.0.smithi047.stdout:4/385: mknod d3/d30/d37/c7b 0 2024-02-07T12:25:51.928 INFO:tasks.workunit.client.0.smithi047.stdout:0/124: rename c11 to d19/c1b 0 2024-02-07T12:25:51.932 INFO:tasks.workunit.client.0.smithi047.stdout:6/246: write d3/da/d14/f1c [1678495,24509] 0 2024-02-07T12:25:51.932 INFO:tasks.workunit.client.0.smithi047.stdout:5/354: dwrite da/df/d16/d41/f47 [0,4194304] 0 2024-02-07T12:25:51.935 INFO:tasks.workunit.client.0.smithi047.stdout:1/203: mknod d1/d15/d18/c3a 0 2024-02-07T12:25:51.936 INFO:tasks.workunit.client.0.smithi047.stdout:8/389: rename d3/d66/d76 to d3/d4/d87 0 2024-02-07T12:25:51.938 INFO:tasks.workunit.client.0.smithi047.stdout:3/451: dwrite d12/d19/d21/d29/d31/d38/d59/f5f [4194304,4194304] 0 2024-02-07T12:25:51.939 INFO:tasks.workunit.client.0.smithi047.stdout:3/452: fdatasync d12/d19/d21/d29/d31/d38/d4c/f80 0 2024-02-07T12:25:51.939 INFO:tasks.workunit.client.0.smithi047.stdout:3/453: chown d12/d19/d2d/d82/l89 1606290 1 2024-02-07T12:25:51.943 INFO:tasks.workunit.client.0.smithi047.stdout:6/247: mknod d3/d5/d35/c4d 0 2024-02-07T12:25:51.948 INFO:tasks.workunit.client.0.smithi047.stdout:5/355: truncate da/fd 3833047 0 2024-02-07T12:25:51.952 INFO:tasks.workunit.client.0.smithi047.stdout:9/181: rmdir d3/d10 39 2024-02-07T12:25:51.954 INFO:tasks.workunit.client.0.smithi047.stdout:9/182: write d3/d10/f1f [4239224,122372] 0 2024-02-07T12:25:51.954 INFO:tasks.workunit.client.0.smithi047.stdout:1/204: mknod d1/d15/d30/c3b 0 2024-02-07T12:25:51.954 INFO:tasks.workunit.client.0.smithi047.stdout:1/205: truncate d1/d15/d18/f23 1220557 0 2024-02-07T12:25:51.955 INFO:tasks.workunit.client.0.smithi047.stdout:1/206: fsync d1/d2a/f2d 0 2024-02-07T12:25:51.955 INFO:tasks.workunit.client.0.smithi047.stdout:1/207: chown d1/d15/d18 6834569 1 2024-02-07T12:25:51.956 INFO:tasks.workunit.client.0.smithi047.stdout:8/390: rename d3/d66/d67/d6a/f6b to d3/d36/d50/d30/d34/d3e/f88 0 2024-02-07T12:25:51.956 INFO:tasks.workunit.client.0.smithi047.stdout:8/391: dread - d3/d36/d50/d30/f61 zero size 2024-02-07T12:25:51.957 INFO:tasks.workunit.client.0.smithi047.stdout:8/392: write d3/d36/d50/d30/d34/d3e/f86 [1578104,122986] 0 2024-02-07T12:25:51.958 INFO:tasks.workunit.client.0.smithi047.stdout:6/248: creat d3/d1e/f4e x:0 0 0 2024-02-07T12:25:51.959 INFO:tasks.workunit.client.0.smithi047.stdout:7/312: dwrite d0/df/d29/d31/d40/f49 [0,4194304] 0 2024-02-07T12:25:51.960 INFO:tasks.workunit.client.0.smithi047.stdout:4/386: dwrite d3/d30/f38 [4194304,4194304] 0 2024-02-07T12:25:51.960 INFO:tasks.workunit.client.0.smithi047.stdout:4/387: creat d3/d61/d43/d45/d6c/d73/f7c x:0 0 0 2024-02-07T12:25:51.960 INFO:tasks.workunit.client.0.smithi047.stdout:4/388: write f1 [1220902,44310] 0 2024-02-07T12:25:51.960 INFO:tasks.workunit.client.0.smithi047.stdout:5/356: creat da/df/d16/f74 x:0 0 0 2024-02-07T12:25:51.960 INFO:tasks.workunit.client.0.smithi047.stdout:5/357: read da/df/d16/d25/d33/f35 [374929,13448] 0 2024-02-07T12:25:51.961 INFO:tasks.workunit.client.0.smithi047.stdout:9/183: mkdir d3/d10/d18/d3a 0 2024-02-07T12:25:51.961 INFO:tasks.workunit.client.0.smithi047.stdout:3/454: dwrite d12/d19/d21/d29/d31/d61/f8e [0,4194304] 0 2024-02-07T12:25:51.961 INFO:tasks.workunit.client.0.smithi047.stdout:1/208: chown d1/d15/d18/l1f 9 1 2024-02-07T12:25:51.961 INFO:tasks.workunit.client.0.smithi047.stdout:1/209: fdatasync d1/d15/d18/f26 0 2024-02-07T12:25:51.963 INFO:tasks.workunit.client.0.smithi047.stdout:1/210: dread d1/d15/d18/f24 [0,4194304] 0 2024-02-07T12:25:51.966 INFO:tasks.workunit.client.0.smithi047.stdout:8/393: link d3/d4/c38 d3/d36/d50/d2a/d3c/c89 0 2024-02-07T12:25:51.969 INFO:tasks.workunit.client.0.smithi047.stdout:6/249: link d3/da/f22 d3/d5/d35/f4f 0 2024-02-07T12:25:51.971 INFO:tasks.workunit.client.0.smithi047.stdout:9/184: dread d3/f21 [0,4194304] 0 2024-02-07T12:25:51.973 INFO:tasks.workunit.client.0.smithi047.stdout:7/313: creat d0/d42/d4d/f69 x:0 0 0 2024-02-07T12:25:51.973 INFO:tasks.workunit.client.0.smithi047.stdout:7/314: chown d0/df/d29 35806301 1 2024-02-07T12:25:51.982 INFO:tasks.workunit.client.0.smithi047.stdout:5/358: mkdir da/df/d16/d41/d57/d75 0 2024-02-07T12:25:51.983 INFO:tasks.workunit.client.0.smithi047.stdout:9/185: write f1 [3530933,53798] 0 2024-02-07T12:25:51.983 INFO:tasks.workunit.client.0.smithi047.stdout:9/186: chown d3/d10/d11/c2a 4138181 1 2024-02-07T12:25:51.984 INFO:tasks.workunit.client.0.smithi047.stdout:5/359: dread da/df/d16/d41/f51 [0,4194304] 0 2024-02-07T12:25:51.985 INFO:tasks.workunit.client.0.smithi047.stdout:3/455: link d12/d19/d2d/d33/f3a d12/f99 0 2024-02-07T12:25:51.989 INFO:tasks.workunit.client.0.smithi047.stdout:8/394: dwrite d3/d36/d50/d30/f61 [0,4194304] 0 2024-02-07T12:25:51.989 INFO:tasks.workunit.client.0.smithi047.stdout:0/125: dwrite f13 [0,4194304] 0 2024-02-07T12:25:51.989 INFO:tasks.workunit.client.0.smithi047.stdout:1/211: creat d1/d15/d2f/f3c x:0 0 0 2024-02-07T12:25:51.989 INFO:tasks.workunit.client.0.smithi047.stdout:1/212: readlink d1/d15/d18/l28 0 2024-02-07T12:25:51.993 INFO:tasks.workunit.client.0.smithi047.stdout:7/315: fsync d0/d4/f17 0 2024-02-07T12:25:51.995 INFO:tasks.workunit.client.0.smithi047.stdout:9/187: rmdir d3/d10/d18 39 2024-02-07T12:25:51.996 INFO:tasks.workunit.client.0.smithi047.stdout:5/360: chown da/df/d16/d25/l4c 975018 1 2024-02-07T12:25:51.996 INFO:tasks.workunit.client.0.smithi047.stdout:5/361: readlink da/df/d16/l3f 0 2024-02-07T12:25:51.996 INFO:tasks.workunit.client.0.smithi047.stdout:1/213: dread d1/d15/d18/f23 [0,4194304] 0 2024-02-07T12:25:51.996 INFO:tasks.workunit.client.0.smithi047.stdout:1/214: write d1/d15/d18/f23 [1321622,42460] 0 2024-02-07T12:25:51.997 INFO:tasks.workunit.client.0.smithi047.stdout:4/389: dwrite d3/f54 [0,4194304] 0 2024-02-07T12:25:51.998 INFO:tasks.workunit.client.0.smithi047.stdout:3/456: symlink d12/d19/d46/l9a 0 2024-02-07T12:25:52.002 INFO:tasks.workunit.client.0.smithi047.stdout:9/188: write d3/f21 [2022030,44031] 0 2024-02-07T12:25:52.005 INFO:tasks.workunit.client.0.smithi047.stdout:6/250: symlink d3/d5/l50 0 2024-02-07T12:25:52.006 INFO:tasks.workunit.client.0.smithi047.stdout:7/316: creat d0/df/d29/d3e/d4c/f6a x:0 0 0 2024-02-07T12:25:52.007 INFO:tasks.workunit.client.0.smithi047.stdout:8/395: dread d3/f17 [0,4194304] 0 2024-02-07T12:25:52.009 INFO:tasks.workunit.client.0.smithi047.stdout:4/390: mkdir d3/d27/d3b/d7d 0 2024-02-07T12:25:52.009 INFO:tasks.workunit.client.0.smithi047.stdout:0/126: dwrite fa [0,4194304] 0 2024-02-07T12:25:52.014 INFO:tasks.workunit.client.0.smithi047.stdout:3/457: mknod d12/d19/d21/d29/c9b 0 2024-02-07T12:25:52.017 INFO:tasks.workunit.client.0.smithi047.stdout:9/189: mkdir d3/d10/d18/d3b 0 2024-02-07T12:25:52.018 INFO:tasks.workunit.client.0.smithi047.stdout:1/215: dwrite d1/d15/d18/f2b [4194304,4194304] 0 2024-02-07T12:25:52.021 INFO:tasks.workunit.client.0.smithi047.stdout:6/251: mknod d3/d5/d35/d3c/c51 0 2024-02-07T12:25:52.021 INFO:tasks.workunit.client.0.smithi047.stdout:6/252: fdatasync d3/d5/f7 0 2024-02-07T12:25:52.025 INFO:tasks.workunit.client.0.smithi047.stdout:5/362: getdents da/df/d16/d41/d57 0 2024-02-07T12:25:52.026 INFO:tasks.workunit.client.0.smithi047.stdout:0/127: getdents d19 0 2024-02-07T12:25:52.031 INFO:tasks.workunit.client.0.smithi047.stdout:3/458: getdents d12/d19/d21/d29/d31 0 2024-02-07T12:25:52.032 INFO:tasks.workunit.client.0.smithi047.stdout:3/459: creat d12/d19/d46/f9c x:0 0 0 2024-02-07T12:25:52.035 INFO:tasks.workunit.client.0.smithi047.stdout:9/190: mkdir d3/d10/d18/d3b/d3c 0 2024-02-07T12:25:52.036 INFO:tasks.workunit.client.0.smithi047.stdout:8/396: dwrite d3/d4/f55 [0,4194304] 0 2024-02-07T12:25:52.038 INFO:tasks.workunit.client.0.smithi047.stdout:4/391: dwrite d3/d61/d43/d45/f51 [0,4194304] 0 2024-02-07T12:25:52.038 INFO:tasks.workunit.client.0.smithi047.stdout:4/392: creat d3/d61/d43/d45/d66/f7e x:0 0 0 2024-02-07T12:25:52.038 INFO:tasks.workunit.client.0.smithi047.stdout:4/393: creat d3/d30/d37/f7f x:0 0 0 2024-02-07T12:25:52.038 INFO:tasks.workunit.client.0.smithi047.stdout:4/394: creat d3/d61/d43/d45/d66/f80 x:0 0 0 2024-02-07T12:25:52.040 INFO:tasks.workunit.client.0.smithi047.stdout:3/460: write d12/d19/d2d/d33/f3a [907670,23573] 0 2024-02-07T12:25:52.042 INFO:tasks.workunit.client.0.smithi047.stdout:8/397: write d3/d36/d50/d30/d34/d3e/f86 [364178,14768] 0 2024-02-07T12:25:52.044 INFO:tasks.workunit.client.0.smithi047.stdout:1/216: unlink d1/d2a/f2d 0 2024-02-07T12:25:52.048 INFO:tasks.workunit.client.0.smithi047.stdout:6/253: rename d3/d33 to d3/da/d3b/d52 0 2024-02-07T12:25:52.057 INFO:tasks.workunit.client.0.smithi047.stdout:7/317: rmdir d0/df/d29/d3e/d4c 39 2024-02-07T12:25:52.057 INFO:tasks.workunit.client.0.smithi047.stdout:6/254: dread d3/d5/f13 [0,4194304] 0 2024-02-07T12:25:52.057 INFO:tasks.workunit.client.0.smithi047.stdout:5/363: creat da/d24/d2b/f76 x:0 0 0 2024-02-07T12:25:52.059 INFO:tasks.workunit.client.0.smithi047.stdout:0/128: mkdir d19/d1c 0 2024-02-07T12:25:52.069 INFO:tasks.workunit.client.0.smithi047.stdout:0/129: dread f13 [0,4194304] 0 2024-02-07T12:25:52.070 INFO:tasks.workunit.client.0.smithi047.stdout:1/217: mkdir d1/d15/d2f/d3d 0 2024-02-07T12:25:52.074 INFO:tasks.workunit.client.0.smithi047.stdout:9/191: rename d3/d10/d11/d32 to d3/d10/d18/d3d 0 2024-02-07T12:25:52.077 INFO:tasks.workunit.client.0.smithi047.stdout:7/318: symlink d0/df/d29/d31/l6b 0 2024-02-07T12:25:52.079 INFO:tasks.workunit.client.0.smithi047.stdout:5/364: creat da/df/d16/d25/d33/f77 x:0 0 0 2024-02-07T12:25:52.082 INFO:tasks.workunit.client.0.smithi047.stdout:1/218: mkdir d1/d15/d2f/d3d/d3e 0 2024-02-07T12:25:52.086 INFO:tasks.workunit.client.0.smithi047.stdout:9/192: rename d3/d10/d18/d3d/l33 to d3/d10/l3e 0 2024-02-07T12:25:52.088 INFO:tasks.workunit.client.0.smithi047.stdout:9/193: mknod d3/d10/d11/c3f 0 2024-02-07T12:25:52.088 INFO:tasks.workunit.client.0.smithi047.stdout:9/194: fsync d3/f21 0 2024-02-07T12:25:52.088 INFO:tasks.workunit.client.0.smithi047.stdout:9/195: creat d3/f40 x:0 0 0 2024-02-07T12:25:52.089 INFO:tasks.workunit.client.0.smithi047.stdout:4/395: rename d3/d61/d43/d45/d63/c67 to d3/d27/d3b/c81 0 2024-02-07T12:25:52.089 INFO:tasks.workunit.client.0.smithi047.stdout:4/396: truncate d3/d27/d3b/f42 144463 0 2024-02-07T12:25:52.091 INFO:tasks.workunit.client.0.smithi047.stdout:5/365: dread da/d24/d63/f65 [0,4194304] 0 2024-02-07T12:25:52.092 INFO:tasks.workunit.client.0.smithi047.stdout:5/366: chown da/d24/d2b/f3a 615378 1 2024-02-07T12:25:52.092 INFO:tasks.workunit.client.0.smithi047.stdout:9/196: dread d3/f22 [0,4194304] 0 2024-02-07T12:25:52.093 INFO:tasks.workunit.client.0.smithi047.stdout:4/397: creat d3/d27/d3b/d7d/f82 x:0 0 0 2024-02-07T12:25:52.093 INFO:tasks.workunit.client.0.smithi047.stdout:4/398: write d3/d30/d37/f55 [1298025,16368] 0 2024-02-07T12:25:52.094 INFO:tasks.workunit.client.0.smithi047.stdout:8/398: rename d3/d4/fa to d3/d66/d67/f8a 0 2024-02-07T12:25:52.098 INFO:tasks.workunit.client.0.smithi047.stdout:7/319: dwrite d0/df/d29/d3e/d4c/f6a [0,4194304] 0 2024-02-07T12:25:52.103 INFO:tasks.workunit.client.0.smithi047.stdout:6/255: rename d3/d1e/f31 to d3/da/d14/d28/d46/f53 0 2024-02-07T12:25:52.107 INFO:tasks.workunit.client.0.smithi047.stdout:4/399: write d3/f23 [2074133,100127] 0 2024-02-07T12:25:52.108 INFO:tasks.workunit.client.0.smithi047.stdout:6/256: creat d3/d5/d35/f54 x:0 0 0 2024-02-07T12:25:52.109 INFO:tasks.workunit.client.0.smithi047.stdout:7/320: mknod d0/c6c 0 2024-02-07T12:25:52.110 INFO:tasks.workunit.client.0.smithi047.stdout:7/321: dread - d0/df/d29/f68 zero size 2024-02-07T12:25:52.110 INFO:tasks.workunit.client.0.smithi047.stdout:6/257: read d3/da/d2c/f2e [83625,48905] 0 2024-02-07T12:25:52.111 INFO:tasks.workunit.client.0.smithi047.stdout:0/130: rename c4 to d19/c1d 0 2024-02-07T12:25:52.115 INFO:tasks.workunit.client.0.smithi047.stdout:4/400: fsync d3/f6 0 2024-02-07T12:25:52.128 INFO:tasks.workunit.client.0.smithi047.stdout:6/258: write d3/d1e/f21 [3022004,118779] 0 2024-02-07T12:25:52.129 INFO:tasks.workunit.client.0.smithi047.stdout:9/197: dwrite d3/d10/d18/d3d/f37 [0,4194304] 0 2024-02-07T12:25:52.130 INFO:tasks.workunit.client.0.smithi047.stdout:6/259: mkdir d3/da/d3b/d55 0 2024-02-07T12:25:52.137 INFO:tasks.workunit.client.0.smithi047.stdout:6/260: dread d3/f18 [0,4194304] 0 2024-02-07T12:25:52.139 INFO:tasks.workunit.client.0.smithi047.stdout:8/399: dwrite d3/d4/f1e [0,4194304] 0 2024-02-07T12:25:52.139 INFO:tasks.workunit.client.0.smithi047.stdout:8/400: fdatasync d3/d66/f79 0 2024-02-07T12:25:52.139 INFO:tasks.workunit.client.0.smithi047.stdout:8/401: dread - d3/f6f zero size 2024-02-07T12:25:52.139 INFO:tasks.workunit.client.0.smithi047.stdout:8/402: dread - d3/d66/d67/d6a/f4c zero size 2024-02-07T12:25:52.139 INFO:tasks.workunit.client.0.smithi047.stdout:8/403: chown d3/c77 107033113 1 2024-02-07T12:25:52.139 INFO:tasks.workunit.client.0.smithi047.stdout:4/401: dwrite d3/f23 [0,4194304] 0 2024-02-07T12:25:52.143 INFO:tasks.workunit.client.0.smithi047.stdout:5/367: dwrite da/df/d16/d25/d71/d68/f72 [0,4194304] 0 2024-02-07T12:25:52.145 INFO:tasks.workunit.client.0.smithi047.stdout:0/131: link d19/c1d d19/d1c/c1e 0 2024-02-07T12:25:52.145 INFO:tasks.workunit.client.0.smithi047.stdout:6/261: dread d3/f18 [0,4194304] 0 2024-02-07T12:25:52.148 INFO:tasks.workunit.client.0.smithi047.stdout:5/368: rmdir da/df/d16/d41/d57/d75 0 2024-02-07T12:25:52.149 INFO:tasks.workunit.client.0.smithi047.stdout:0/132: creat d19/d1c/f1f x:0 0 0 2024-02-07T12:25:52.149 INFO:tasks.workunit.client.0.smithi047.stdout:0/133: fsync f14 0 2024-02-07T12:25:52.150 INFO:tasks.workunit.client.0.smithi047.stdout:9/198: dwrite d3/f34 [0,4194304] 0 2024-02-07T12:25:52.150 INFO:tasks.workunit.client.0.smithi047.stdout:4/402: dread d3/d61/d43/d45/f51 [0,4194304] 0 2024-02-07T12:25:52.150 INFO:tasks.workunit.client.0.smithi047.stdout:9/199: fsync d3/d10/d18/f2e 0 2024-02-07T12:25:52.150 INFO:tasks.workunit.client.0.smithi047.stdout:9/200: write d3/d10/f1f [612003,44046] 0 2024-02-07T12:25:52.151 INFO:tasks.workunit.client.0.smithi047.stdout:6/262: mknod d3/d5/d35/c56 0 2024-02-07T12:25:52.152 INFO:tasks.workunit.client.0.smithi047.stdout:5/369: mknod da/df/c78 0 2024-02-07T12:25:52.157 INFO:tasks.workunit.client.0.smithi047.stdout:9/201: rename d3/d10/d11/l35 to d3/d10/d18/d3b/l41 0 2024-02-07T12:25:52.159 INFO:tasks.workunit.client.0.smithi047.stdout:5/370: rename da/df/d16/d25/l30 to da/df/d16/d41/d57/l79 0 2024-02-07T12:25:52.161 INFO:tasks.workunit.client.0.smithi047.stdout:5/371: symlink da/df/d16/d41/d57/d6c/l7a 0 2024-02-07T12:25:52.164 INFO:tasks.workunit.client.0.smithi047.stdout:8/404: dwrite d3/d36/d50/f5b [0,4194304] 0 2024-02-07T12:25:52.164 INFO:tasks.workunit.client.0.smithi047.stdout:8/405: chown d3/d36/d50/d2a/d3c/c89 110207382 1 2024-02-07T12:25:52.164 INFO:tasks.workunit.client.0.smithi047.stdout:4/403: dread d3/d27/f28 [0,4194304] 0 2024-02-07T12:25:52.164 INFO:tasks.workunit.client.0.smithi047.stdout:6/263: write d3/d5/d35/f4f [2573851,98539] 0 2024-02-07T12:25:52.164 INFO:tasks.workunit.client.0.smithi047.stdout:9/202: dread d3/d10/d18/f27 [0,4194304] 0 2024-02-07T12:25:52.165 INFO:tasks.workunit.client.0.smithi047.stdout:9/203: write d3/d10/d18/f1a [1097357,45570] 0 2024-02-07T12:25:52.165 INFO:tasks.workunit.client.0.smithi047.stdout:5/372: mknod da/d24/d2b/c7b 0 2024-02-07T12:25:52.170 INFO:tasks.workunit.client.0.smithi047.stdout:8/406: symlink d3/d36/d50/d30/d34/l8b 0 2024-02-07T12:25:52.173 INFO:tasks.workunit.client.0.smithi047.stdout:4/404: mkdir d3/d61/d70/d83 0 2024-02-07T12:25:52.173 INFO:tasks.workunit.client.0.smithi047.stdout:0/134: getdents d19/d1c 0 2024-02-07T12:25:52.176 INFO:tasks.workunit.client.0.smithi047.stdout:6/264: rename d3/d1e/f2f to d3/da/d2c/d42/f57 0 2024-02-07T12:25:52.178 INFO:tasks.workunit.client.0.smithi047.stdout:8/407: mknod d3/d4/d4d/c8c 0 2024-02-07T12:25:52.178 INFO:tasks.workunit.client.0.smithi047.stdout:8/408: truncate d3/d36/d50/d30/d34/d3e/f86 2227424 0 2024-02-07T12:25:52.180 INFO:tasks.workunit.client.0.smithi047.stdout:0/135: mknod d19/d1c/c20 0 2024-02-07T12:25:52.180 INFO:tasks.workunit.client.0.smithi047.stdout:0/136: write f5 [3759504,128680] 0 2024-02-07T12:25:52.181 INFO:tasks.workunit.client.0.smithi047.stdout:5/373: rename da/df/d16/d25/d71/d68/d73 to da/df/d16/d25/d33/d55/d7c 0 2024-02-07T12:25:52.183 INFO:tasks.workunit.client.0.smithi047.stdout:4/405: write d3/d30/f6e [2152578,127933] 0 2024-02-07T12:25:52.183 INFO:tasks.workunit.client.0.smithi047.stdout:9/204: dwrite d3/f21 [4194304,4194304] 0 2024-02-07T12:25:52.183 INFO:tasks.workunit.client.0.smithi047.stdout:9/205: write d3/d10/f31 [483010,13974] 0 2024-02-07T12:25:52.183 INFO:tasks.workunit.client.0.smithi047.stdout:9/206: chown d3/d10/d11/l20 875491 1 2024-02-07T12:25:52.183 INFO:tasks.workunit.client.0.smithi047.stdout:5/374: mknod da/df/d16/d41/d57/d6c/c7d 0 2024-02-07T12:25:52.186 INFO:tasks.workunit.client.0.smithi047.stdout:6/265: rename d3/d5 to d3/d5/d58 22 2024-02-07T12:25:52.186 INFO:tasks.workunit.client.0.smithi047.stdout:0/137: mknod d19/c21 0 2024-02-07T12:25:52.186 INFO:tasks.workunit.client.0.smithi047.stdout:0/138: truncate f5 5875317 0 2024-02-07T12:25:52.186 INFO:tasks.workunit.client.0.smithi047.stdout:6/266: write d3/d5/f26 [3972099,20679] 0 2024-02-07T12:25:52.186 INFO:tasks.workunit.client.0.smithi047.stdout:6/267: creat d3/f59 x:0 0 0 2024-02-07T12:25:52.186 INFO:tasks.workunit.client.0.smithi047.stdout:6/268: creat d3/da/d34/f5a x:0 0 0 2024-02-07T12:25:52.191 INFO:tasks.workunit.client.0.smithi047.stdout:8/409: dread d3/d4/f7 [0,4194304] 0 2024-02-07T12:25:52.194 INFO:tasks.workunit.client.0.smithi047.stdout:6/269: unlink d3/c23 0 2024-02-07T12:25:52.198 INFO:tasks.workunit.client.0.smithi047.stdout:5/375: dread da/df/d16/d41/d57/f5d [0,4194304] 0 2024-02-07T12:25:52.198 INFO:tasks.workunit.client.0.smithi047.stdout:0/139: mknod d19/c22 0 2024-02-07T12:25:52.200 INFO:tasks.workunit.client.0.smithi047.stdout:8/410: rename d3/d4/d4d/c8c to d3/d4/d87/c8d 0 2024-02-07T12:25:52.200 INFO:tasks.workunit.client.0.smithi047.stdout:8/411: dread - d3/d66/f79 zero size 2024-02-07T12:25:52.202 INFO:tasks.workunit.client.0.smithi047.stdout:4/406: dwrite d3/d61/d43/d45/d66/f80 [0,4194304] 0 2024-02-07T12:25:52.202 INFO:tasks.workunit.client.0.smithi047.stdout:4/407: fsync d3/d61/d43/f53 0 2024-02-07T12:25:52.206 INFO:tasks.workunit.client.0.smithi047.stdout:5/376: creat da/df/d16/d25/d71/d68/f7e x:0 0 0 2024-02-07T12:25:52.210 INFO:tasks.workunit.client.0.smithi047.stdout:8/412: getdents d3/d36/d50/d30 0 2024-02-07T12:25:52.210 INFO:tasks.workunit.client.0.smithi047.stdout:8/413: readlink d3/d36/d50/d28/l83 0 2024-02-07T12:25:52.212 INFO:tasks.workunit.client.0.smithi047.stdout:6/270: getdents d3/d1e/d25 0 2024-02-07T12:25:52.218 INFO:tasks.workunit.client.0.smithi047.stdout:5/377: read da/f39 [2028533,46260] 0 2024-02-07T12:25:52.218 INFO:tasks.workunit.client.0.smithi047.stdout:5/378: readlink da/df/d16/d41/d57/l5f 0 2024-02-07T12:25:52.220 INFO:tasks.workunit.client.0.smithi047.stdout:8/414: dread d3/d4/f55 [0,4194304] 0 2024-02-07T12:25:52.227 INFO:tasks.workunit.client.0.smithi047.stdout:6/271: dread d3/da/d14/d28/d46/f53 [0,4194304] 0 2024-02-07T12:25:52.227 INFO:tasks.workunit.client.0.smithi047.stdout:6/272: write d3/da/f49 [237203,109163] 0 2024-02-07T12:25:52.231 INFO:tasks.workunit.client.0.smithi047.stdout:0/140: mknod d19/d1c/c23 0 2024-02-07T12:25:52.235 INFO:tasks.workunit.client.0.smithi047.stdout:6/273: symlink d3/da/d34/l5b 0 2024-02-07T12:25:52.237 INFO:tasks.workunit.client.0.smithi047.stdout:6/274: symlink d3/da/d14/l5c 0 2024-02-07T12:25:52.240 INFO:tasks.workunit.client.0.smithi047.stdout:6/275: unlink d3/da/f24 0 2024-02-07T12:25:52.240 INFO:tasks.workunit.client.0.smithi047.stdout:6/276: readlink d3/d1e/d25/l43 0 2024-02-07T12:25:52.242 INFO:tasks.workunit.client.0.smithi047.stdout:8/415: dwrite d3/d36/f75 [0,4194304] 0 2024-02-07T12:25:52.245 INFO:tasks.workunit.client.0.smithi047.stdout:0/141: dread f10 [0,4194304] 0 2024-02-07T12:25:52.316 INFO:tasks.workunit.client.0.smithi047.stdout:8/416: creat d3/d66/d67/d6a/f8e x:0 0 0 2024-02-07T12:25:52.316 INFO:tasks.workunit.client.0.smithi047.stdout:0/142: getdents d19 0 2024-02-07T12:25:52.318 INFO:tasks.workunit.client.0.smithi047.stdout:8/417: mknod d3/d36/d50/d28/c8f 0 2024-02-07T12:25:52.320 INFO:tasks.workunit.client.0.smithi047.stdout:4/408: dwrite d3/f12 [0,4194304] 0 2024-02-07T12:25:52.320 INFO:tasks.workunit.client.0.smithi047.stdout:4/409: write d3/d61/d43/f53 [3218135,12188] 0 2024-02-07T12:25:52.320 INFO:tasks.workunit.client.0.smithi047.stdout:4/410: chown d3 13290 1 2024-02-07T12:25:52.321 INFO:tasks.workunit.client.0.smithi047.stdout:9/207: dwrite d3/d10/f24 [0,4194304] 0 2024-02-07T12:25:52.322 INFO:tasks.workunit.client.0.smithi047.stdout:8/418: creat d3/d36/d50/d30/f90 x:0 0 0 2024-02-07T12:25:52.326 INFO:tasks.workunit.client.0.smithi047.stdout:0/143: mkdir d19/d1c/d24 0 2024-02-07T12:25:52.326 INFO:tasks.workunit.client.0.smithi047.stdout:6/277: dwrite d3/da/d14/f36 [0,4194304] 0 2024-02-07T12:25:52.329 INFO:tasks.workunit.client.0.smithi047.stdout:0/144: rmdir d19 39 2024-02-07T12:25:52.332 INFO:tasks.workunit.client.0.smithi047.stdout:0/145: mkdir d19/d25 0 2024-02-07T12:25:52.332 INFO:tasks.workunit.client.0.smithi047.stdout:0/146: stat d19/d25 0 2024-02-07T12:25:52.332 INFO:tasks.workunit.client.0.smithi047.stdout:0/147: write f10 [4788287,76138] 0 2024-02-07T12:25:52.333 INFO:tasks.workunit.client.0.smithi047.stdout:8/419: write d3/f27 [906626,10186] 0 2024-02-07T12:25:52.335 INFO:tasks.workunit.client.0.smithi047.stdout:8/420: unlink d3/f17 0 2024-02-07T12:25:52.336 INFO:tasks.workunit.client.0.smithi047.stdout:9/208: dwrite d3/d10/d18/d3d/f37 [0,4194304] 0 2024-02-07T12:25:52.338 INFO:tasks.workunit.client.0.smithi047.stdout:6/278: dread d3/f8 [0,4194304] 0 2024-02-07T12:25:52.338 INFO:tasks.workunit.client.0.smithi047.stdout:6/279: stat d3/da/d34 0 2024-02-07T12:25:52.341 INFO:tasks.workunit.client.0.smithi047.stdout:0/148: write fc [4131759,18943] 0 2024-02-07T12:25:52.342 INFO:tasks.workunit.client.0.smithi047.stdout:9/209: creat d3/d10/d11/f42 x:0 0 0 2024-02-07T12:25:52.346 INFO:tasks.workunit.client.0.smithi047.stdout:9/210: dread d3/d10/d18/f1b [0,4194304] 0 2024-02-07T12:25:52.346 INFO:tasks.workunit.client.0.smithi047.stdout:9/211: creat d3/d10/d11/f43 x:0 0 0 2024-02-07T12:25:52.346 INFO:tasks.workunit.client.0.smithi047.stdout:6/280: dread d3/d1e/d25/f4a [0,4194304] 0 2024-02-07T12:25:52.349 INFO:tasks.workunit.client.0.smithi047.stdout:9/212: read d3/d10/f31 [242914,2390] 0 2024-02-07T12:25:52.351 INFO:tasks.workunit.client.0.smithi047.stdout:6/281: rename d3/f8 to d3/d5/f5d 0 2024-02-07T12:25:52.352 INFO:tasks.workunit.client.0.smithi047.stdout:9/213: creat d3/d10/d18/d3a/f44 x:0 0 0 2024-02-07T12:25:52.361 INFO:tasks.workunit.client.0.smithi047.stdout:8/421: dwrite d3/d36/f75 [0,4194304] 0 2024-02-07T12:25:52.363 INFO:tasks.workunit.client.0.smithi047.stdout:8/422: unlink d3/d66/d67/d6a/f47 0 2024-02-07T12:25:52.363 INFO:tasks.workunit.client.0.smithi047.stdout:8/423: chown d3/d36/d50/d30/d34/c63 2045362 1 2024-02-07T12:25:52.364 INFO:tasks.workunit.client.0.smithi047.stdout:8/424: mkdir d3/d66/d67/d6a/d91 0 2024-02-07T12:25:52.366 INFO:tasks.workunit.client.0.smithi047.stdout:8/425: rename d3/d66/f80 to d3/d66/d67/d6a/f92 0 2024-02-07T12:25:52.367 INFO:tasks.workunit.client.0.smithi047.stdout:8/426: mkdir d3/d66/d67/d71/d93 0 2024-02-07T12:25:52.368 INFO:tasks.workunit.client.0.smithi047.stdout:8/427: symlink d3/d4/d59/l94 0 2024-02-07T12:25:52.368 INFO:tasks.workunit.client.0.smithi047.stdout:8/428: fsync d3/f72 0 2024-02-07T12:25:52.371 INFO:tasks.workunit.client.0.smithi047.stdout:0/149: dwrite f15 [0,4194304] 0 2024-02-07T12:25:52.373 INFO:tasks.workunit.client.0.smithi047.stdout:4/411: dwrite d3/d27/d3b/f42 [0,4194304] 0 2024-02-07T12:25:52.374 INFO:tasks.workunit.client.0.smithi047.stdout:6/282: dwrite d3/d5/d35/f4f [0,4194304] 0 2024-02-07T12:25:52.374 INFO:tasks.workunit.client.0.smithi047.stdout:6/283: write d3/d5/d35/f54 [923971,89673] 0 2024-02-07T12:25:52.375 INFO:tasks.workunit.client.0.smithi047.stdout:6/284: dread - d3/da/d34/f41 zero size 2024-02-07T12:25:52.376 INFO:tasks.workunit.client.0.smithi047.stdout:0/150: creat d19/f26 x:0 0 0 2024-02-07T12:25:52.379 INFO:tasks.workunit.client.0.smithi047.stdout:0/151: dread f5 [4194304,4194304] 0 2024-02-07T12:25:52.382 INFO:tasks.workunit.client.0.smithi047.stdout:8/429: dwrite d3/d36/f49 [0,4194304] 0 2024-02-07T12:25:52.382 INFO:tasks.workunit.client.0.smithi047.stdout:4/412: chown d3/l3f 0 1 2024-02-07T12:25:52.383 INFO:tasks.workunit.client.0.smithi047.stdout:0/152: dread f13 [0,4194304] 0 2024-02-07T12:25:52.383 INFO:tasks.workunit.client.0.smithi047.stdout:0/153: creat d19/f27 x:0 0 0 2024-02-07T12:25:52.384 INFO:tasks.workunit.client.0.smithi047.stdout:8/430: truncate d3/d36/d50/d30/d34/f35 342442 0 2024-02-07T12:25:52.384 INFO:tasks.workunit.client.0.smithi047.stdout:8/431: write d3/d36/d50/d30/d34/f85 [63410,70635] 0 2024-02-07T12:25:52.386 INFO:tasks.workunit.client.0.smithi047.stdout:4/413: symlink d3/d61/l84 0 2024-02-07T12:25:52.394 INFO:tasks.workunit.client.0.smithi047.stdout:4/414: mkdir d3/d61/d70/d83/d85 0 2024-02-07T12:25:52.394 INFO:tasks.workunit.client.0.smithi047.stdout:4/415: creat d3/d30/f86 x:0 0 0 2024-02-07T12:25:52.397 INFO:tasks.workunit.client.0.smithi047.stdout:6/285: dwrite d3/da/f22 [0,4194304] 0 2024-02-07T12:25:52.402 INFO:tasks.workunit.client.0.smithi047.stdout:6/286: creat d3/da/d3b/f5e x:0 0 0 2024-02-07T12:25:52.402 INFO:tasks.workunit.client.0.smithi047.stdout:6/287: write d3/d1e/f4e [927677,48459] 0 2024-02-07T12:25:52.402 INFO:tasks.workunit.client.0.smithi047.stdout:4/416: rmdir d3/d30/d37 39 2024-02-07T12:25:52.406 INFO:tasks.workunit.client.0.smithi047.stdout:4/417: link d3/d27/f28 d3/d27/f87 0 2024-02-07T12:25:52.406 INFO:tasks.workunit.client.0.smithi047.stdout:4/418: creat d3/d27/d3b/f88 x:0 0 0 2024-02-07T12:25:52.407 INFO:tasks.workunit.client.0.smithi047.stdout:8/432: dwrite d3/d36/d50/f5b [0,4194304] 0 2024-02-07T12:25:52.408 INFO:tasks.workunit.client.0.smithi047.stdout:0/154: dwrite f17 [0,4194304] 0 2024-02-07T12:25:52.408 INFO:tasks.workunit.client.0.smithi047.stdout:0/155: stat f5 0 2024-02-07T12:25:52.411 INFO:tasks.workunit.client.0.smithi047.stdout:8/433: read - d3/d36/d50/d30/f90 zero size 2024-02-07T12:25:52.412 INFO:tasks.workunit.client.0.smithi047.stdout:8/434: read d3/d36/d50/d30/d34/f85 [50850,6626] 0 2024-02-07T12:25:52.416 INFO:tasks.workunit.client.0.smithi047.stdout:0/156: unlink d19/c1d 0 2024-02-07T12:25:52.417 INFO:tasks.workunit.client.0.smithi047.stdout:6/288: rmdir d3/da/d3b 39 2024-02-07T12:25:52.420 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-07T12:25:52.420 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-07T12:25:52.421 INFO:tasks.workunit.client.0.smithi047.stdout:6/289: mknod d3/da/d3b/c5f 0 2024-02-07T12:25:52.422 INFO:tasks.workunit.client.0.smithi047.stdout:8/435: creat d3/d66/d67/d71/d93/f95 x:0 0 0 2024-02-07T12:25:52.426 INFO:tasks.workunit.client.0.smithi047.stdout:6/290: dread d3/d5/f5d [0,4194304] 0 2024-02-07T12:25:52.428 INFO:tasks.workunit.client.0.smithi047.stdout:6/291: symlink d3/d5/l60 0 2024-02-07T12:25:52.428 INFO:tasks.workunit.client.0.smithi047.stdout:4/419: dwrite d3/f54 [4194304,4194304] 0 2024-02-07T12:25:52.428 INFO:tasks.workunit.client.0.smithi047.stdout:4/420: chown d3/d61/f36 4956 1 2024-02-07T12:25:52.428 INFO:tasks.workunit.client.0.smithi047.stdout:4/421: chown l0 79 1 2024-02-07T12:25:52.431 INFO:tasks.workunit.client.0.smithi047.stdout:6/292: rename d3/da/c1d to d3/d5/d35/d3c/c61 0 2024-02-07T12:25:52.431 INFO:tasks.workunit.client.0.smithi047.stdout:6/293: write d3/d5/f5d [955191,80953] 0 2024-02-07T12:25:52.444 INFO:tasks.workunit.client.0.smithi047.stdout:0/157: dwrite fc [0,4194304] 0 2024-02-07T12:25:52.452 INFO:tasks.workunit.client.0.smithi047.stdout:8/436: dwrite d3/d36/f3b [0,4194304] 0 2024-02-07T12:25:52.454 INFO:tasks.workunit.client.0.smithi047.stdout:4/422: dwrite d3/d61/d43/d45/d66/f7e [0,4194304] 0 2024-02-07T12:25:52.454 INFO:tasks.workunit.client.0.smithi047.stdout:6/294: dwrite d3/d1e/f21 [4194304,4194304] 0 2024-02-07T12:25:52.459 INFO:tasks.workunit.client.0.smithi047.stdout:4/423: mknod d3/d27/d3b/c89 0 2024-02-07T12:25:52.468 INFO:tasks.workunit.client.0.smithi047.stdout:6/295: creat d3/da/d14/f62 x:0 0 0 2024-02-07T12:25:52.468 INFO:tasks.workunit.client.0.smithi047.stdout:6/296: write d3/da/d34/f41 [1014869,101257] 0 2024-02-07T12:25:52.475 INFO:tasks.workunit.client.0.smithi047.stdout:8/437: dwrite d3/d36/f49 [4194304,4194304] 0 2024-02-07T12:25:52.477 INFO:tasks.workunit.client.0.smithi047.stdout:8/438: rmdir d3/d66/d67 39 2024-02-07T12:25:52.477 INFO:tasks.workunit.client.0.smithi047.stdout:4/424: dwrite d3/d30/f5b [0,4194304] 0 2024-02-07T12:25:52.478 INFO:tasks.workunit.client.0.smithi047.stdout:8/439: creat d3/d36/d50/d28/f96 x:0 0 0 2024-02-07T12:25:52.481 INFO:tasks.workunit.client.0.smithi047.stdout:8/440: unlink d3/d36/f49 0 2024-02-07T12:25:52.481 INFO:tasks.workunit.client.0.smithi047.stdout:8/441: write d3/d66/d67/d6a/f46 [7297259,23682] 0 2024-02-07T12:25:52.481 INFO:tasks.workunit.client.0.smithi047.stdout:8/442: write d3/d36/d50/d30/f61 [4720803,70679] 0 2024-02-07T12:25:52.481 INFO:tasks.workunit.client.0.smithi047.stdout:4/425: rename d3/c21 to d3/d61/c8a 0 2024-02-07T12:25:52.482 INFO:tasks.workunit.client.0.smithi047.stdout:4/426: dread - d3/d61/d43/d45/d6c/d73/f7c zero size 2024-02-07T12:25:52.483 INFO:tasks.workunit.client.0.smithi047.stdout:4/427: mkdir d3/d61/d70/d8b 0 2024-02-07T12:25:52.484 INFO:tasks.workunit.client.0.smithi047.stdout:8/443: rename d3/f27 to d3/d66/d67/d6a/d91/f97 0 2024-02-07T12:25:52.485 INFO:tasks.workunit.client.0.smithi047.stdout:8/444: stat d3/d36/f3b 0 2024-02-07T12:25:52.485 INFO:tasks.workunit.client.0.smithi047.stdout:4/428: symlink d3/d61/d43/l8c 0 2024-02-07T12:25:52.486 INFO:tasks.workunit.client.0.smithi047.stdout:4/429: mknod d3/d61/d43/d45/d63/c8d 0 2024-02-07T12:25:52.487 INFO:tasks.workunit.client.0.smithi047.stdout:8/445: creat d3/d4/f98 x:0 0 0 2024-02-07T12:25:52.488 INFO:tasks.workunit.client.0.smithi047.stdout:4/430: readlink d3/l1f 0 2024-02-07T12:25:52.488 INFO:tasks.workunit.client.0.smithi047.stdout:4/431: dread - d3/d61/d43/d45/d6c/d73/f7c zero size 2024-02-07T12:25:52.488 INFO:tasks.workunit.client.0.smithi047.stdout:6/297: dwrite d3/f18 [0,4194304] 0 2024-02-07T12:25:52.491 INFO:tasks.workunit.client.0.smithi047.stdout:6/298: rename d3/da/f22 to d3/d5/d35/f63 0 2024-02-07T12:25:52.491 INFO:tasks.workunit.client.0.smithi047.stdout:6/299: fdatasync d3/da/d14/f1c 0 2024-02-07T12:25:52.491 INFO:tasks.workunit.client.0.smithi047.stdout:8/446: mkdir d3/d99 0 2024-02-07T12:25:52.491 INFO:tasks.workunit.client.0.smithi047.stdout:8/447: write d3/d36/d50/f5b [5137060,71555] 0 2024-02-07T12:25:52.492 INFO:tasks.workunit.client.0.smithi047.stdout:6/300: mknod d3/d1e/d25/c64 0 2024-02-07T12:25:52.492 INFO:tasks.workunit.client.0.smithi047.stdout:6/301: stat d3/da/l38 0 2024-02-07T12:25:52.493 INFO:tasks.workunit.client.0.smithi047.stdout:6/302: symlink d3/l65 0 2024-02-07T12:25:52.500 INFO:tasks.workunit.client.0.smithi047.stdout:4/432: dread d3/d30/f38 [0,4194304] 0 2024-02-07T12:25:52.506 INFO:tasks.workunit.client.0.smithi047.stdout:8/448: truncate d3/d66/d67/d6a/f46 6479522 0 2024-02-07T12:25:52.506 INFO:tasks.workunit.client.0.smithi047.stdout:8/449: dread - d3/d36/d50/d28/f96 zero size 2024-02-07T12:25:52.508 INFO:tasks.workunit.client.0.smithi047.stdout:4/433: dread d3/d61/d43/d45/f51 [0,4194304] 0 2024-02-07T12:25:52.511 INFO:tasks.workunit.client.0.smithi047.stdout:4/434: dread d3/d30/f44 [0,4194304] 0 2024-02-07T12:25:52.513 INFO:tasks.workunit.client.0.smithi047.stdout:4/435: symlink d3/d61/d70/d83/l8e 0 2024-02-07T12:25:52.513 INFO:tasks.workunit.client.0.smithi047.stdout:4/436: write d3/d61/d43/d45/d6c/d73/f78 [898231,73035] 0 2024-02-07T12:25:52.513 INFO:tasks.workunit.client.0.smithi047.stdout:4/437: creat d3/d61/d43/d45/d66/f8f x:0 0 0 2024-02-07T12:25:52.515 INFO:tasks.workunit.client.0.smithi047.stdout:4/438: symlink d3/d61/d43/l90 0 2024-02-07T12:25:52.519 INFO:tasks.workunit.client.0.smithi047.stdout:8/450: dwrite d3/d4/f1e [4194304,4194304] 0 2024-02-07T12:25:52.522 INFO:tasks.workunit.client.0.smithi047.stdout:8/451: symlink d3/d4/l9a 0 2024-02-07T12:25:52.522 INFO:tasks.workunit.client.0.smithi047.stdout:8/452: creat d3/d36/f9b x:0 0 0 2024-02-07T12:25:52.522 INFO:tasks.workunit.client.0.smithi047.stdout:8/453: chown d3/d66/d67/c73 868 1 2024-02-07T12:25:52.525 INFO:tasks.workunit.client.0.smithi047.stdout:8/454: creat d3/d4/d87/f9c x:0 0 0 2024-02-07T12:25:52.530 INFO:tasks.workunit.client.0.smithi047.stdout:8/455: rmdir d3/d36 39 2024-02-07T12:25:52.532 INFO:tasks.workunit.client.0.smithi047.stdout:4/439: dwrite d3/f17 [0,4194304] 0 2024-02-07T12:25:52.534 INFO:tasks.workunit.client.0.smithi047.stdout:4/440: rename d3/d30/d37/f55 to d3/d61/d43/d45/d6c/d73/f91 0 2024-02-07T12:25:52.535 INFO:tasks.workunit.client.0.smithi047.stdout:4/441: mknod d3/d61/d43/d45/d6c/c92 0 2024-02-07T12:25:52.547 INFO:tasks.workunit.client.0.smithi047.stdout:8/456: dwrite d3/d36/d50/d28/f96 [0,4194304] 0 2024-02-07T12:25:52.547 INFO:tasks.workunit.client.0.smithi047.stdout:8/457: write d3/d36/d50/d2a/d3c/f64 [364447,51276] 0 2024-02-07T12:25:52.549 INFO:tasks.workunit.client.0.smithi047.stdout:8/458: unlink d3/d36/d50/d2a/c37 0 2024-02-07T12:25:52.550 INFO:tasks.workunit.client.0.smithi047.stdout:8/459: mkdir d3/d36/d9d 0 2024-02-07T12:25:52.550 INFO:tasks.workunit.client.0.smithi047.stdout:8/460: truncate d3/d36/d50/d30/f5e 308554 0 2024-02-07T12:25:52.569 INFO:tasks.workunit.client.0.smithi047.stdout:2/365: sync 2024-02-07T12:25:52.569 INFO:tasks.workunit.client.0.smithi047.stdout:3/461: sync 2024-02-07T12:25:52.570 INFO:tasks.workunit.client.0.smithi047.stdout:2/366: rename d7/d2d/l36 to d7/d48/l67 0 2024-02-07T12:25:52.571 INFO:tasks.workunit.client.0.smithi047.stdout:8/461: dwrite d3/d36/d50/d30/d34/f35 [0,4194304] 0 2024-02-07T12:25:52.572 INFO:tasks.workunit.client.0.smithi047.stdout:2/367: unlink d7/dc/f33 0 2024-02-07T12:25:52.574 INFO:tasks.workunit.client.0.smithi047.stdout:2/368: unlink d7/d48/c5f 0 2024-02-07T12:25:52.575 INFO:tasks.workunit.client.0.smithi047.stdout:8/462: mkdir d3/d36/d50/d30/d9e 0 2024-02-07T12:25:52.575 INFO:tasks.workunit.client.0.smithi047.stdout:8/463: fsync d3/d4/f55 0 2024-02-07T12:25:52.576 INFO:tasks.workunit.client.0.smithi047.stdout:8/464: chown d3/d36/d50/d30/f5f 11475710 1 2024-02-07T12:25:52.579 INFO:tasks.workunit.client.0.smithi047.stdout:8/465: mkdir d3/d66/d67/d71/d93/d9f 0 2024-02-07T12:25:52.579 INFO:tasks.workunit.client.0.smithi047.stdout:8/466: fdatasync d3/d36/f75 0 2024-02-07T12:25:52.579 INFO:tasks.workunit.client.0.smithi047.stdout:8/467: getdents d3/d99 0 2024-02-07T12:25:52.584 INFO:tasks.workunit.client.0.smithi047.stdout:8/468: symlink d3/d36/d50/d30/d34/la0 0 2024-02-07T12:25:52.584 INFO:tasks.workunit.client.0.smithi047.stdout:8/469: read - d3/d66/d67/d6a/f92 zero size 2024-02-07T12:25:52.584 INFO:tasks.workunit.client.0.smithi047.stdout:3/462: write d12/d19/d21/d29/d31/d38/d59/f67 [3372995,96834] 0 2024-02-07T12:25:52.585 INFO:tasks.workunit.client.0.smithi047.stdout:3/463: symlink d12/d19/d2d/d52/l9d 0 2024-02-07T12:25:52.585 INFO:tasks.workunit.client.0.smithi047.stdout:2/369: dread f2 [4194304,4194304] 0 2024-02-07T12:25:52.585 INFO:tasks.workunit.client.0.smithi047.stdout:3/464: creat d12/d19/d2d/d52/f9e x:0 0 0 2024-02-07T12:25:52.588 INFO:tasks.workunit.client.0.smithi047.stdout:8/470: rmdir d3/d66/d67/d71/d93 39 2024-02-07T12:25:52.588 INFO:tasks.workunit.client.0.smithi047.stdout:8/471: truncate d3/d36/d50/d2a/f32 873916 0 2024-02-07T12:25:52.588 INFO:tasks.workunit.client.0.smithi047.stdout:8/472: fdatasync d3/d36/f68 0 2024-02-07T12:25:52.590 INFO:tasks.workunit.client.0.smithi047.stdout:3/465: unlink d12/d19/d2d/c30 0 2024-02-07T12:25:52.594 INFO:tasks.workunit.client.0.smithi047.stdout:8/473: mkdir d3/d4/d87/da1 0 2024-02-07T12:25:52.595 INFO:tasks.workunit.client.0.smithi047.stdout:3/466: mknod d12/d19/d2d/d42/d6b/c9f 0 2024-02-07T12:25:52.595 INFO:tasks.workunit.client.0.smithi047.stdout:3/467: readlink d12/d19/l7b 0 2024-02-07T12:25:52.596 INFO:tasks.workunit.client.0.smithi047.stdout:3/468: symlink d12/d19/d21/d29/d31/d38/d59/la0 0 2024-02-07T12:25:52.597 INFO:tasks.workunit.client.0.smithi047.stdout:8/474: dread d3/d36/d50/d30/d34/d3e/f86 [0,4194304] 0 2024-02-07T12:25:52.597 INFO:tasks.workunit.client.0.smithi047.stdout:3/469: dread d12/d19/d2d/f63 [0,4194304] 0 2024-02-07T12:25:52.597 INFO:tasks.workunit.client.0.smithi047.stdout:8/475: write d3/d36/d50/d30/d34/f85 [309146,12251] 0 2024-02-07T12:25:52.599 INFO:tasks.workunit.client.0.smithi047.stdout:8/476: rmdir d3/d36/d50/d2a/d3c 39 2024-02-07T12:25:52.599 INFO:tasks.workunit.client.0.smithi047.stdout:8/477: write d3/d4/d87/f9c [826061,28296] 0 2024-02-07T12:25:52.599 INFO:tasks.workunit.client.0.smithi047.stdout:8/478: write d3/d66/f7d [31464,53148] 0 2024-02-07T12:25:52.599 INFO:tasks.workunit.client.0.smithi047.stdout:8/479: rmdir d3/d36/d50/d30/d34/d3e 39 2024-02-07T12:25:52.602 INFO:tasks.workunit.client.0.smithi047.stdout:2/370: dwrite d7/f3b [0,4194304] 0 2024-02-07T12:25:52.604 INFO:tasks.workunit.client.0.smithi047.stdout:2/371: mknod d7/d2d/d5c/c68 0 2024-02-07T12:25:52.609 INFO:tasks.workunit.client.0.smithi047.stdout:2/372: link d7/c19 d7/dc/d4c/d65/c69 0 2024-02-07T12:25:52.611 INFO:tasks.workunit.client.0.smithi047.stdout:2/373: creat d7/d2d/d5c/f6a x:0 0 0 2024-02-07T12:25:52.618 INFO:tasks.workunit.client.0.smithi047.stdout:3/470: dwrite d12/d19/d2d/d33/f7f [0,4194304] 0 2024-02-07T12:25:52.618 INFO:tasks.workunit.client.0.smithi047.stdout:8/480: dwrite d3/d36/d50/d30/f90 [0,4194304] 0 2024-02-07T12:25:52.618 INFO:tasks.workunit.client.0.smithi047.stdout:8/481: fdatasync d3/d4/f7 0 2024-02-07T12:25:52.618 INFO:tasks.workunit.client.0.smithi047.stdout:8/482: write d3/d36/d50/d30/d34/f35 [4443393,66349] 0 2024-02-07T12:25:52.620 INFO:tasks.workunit.client.0.smithi047.stdout:3/471: link d12/d19/f5a d12/d19/d21/d29/d44/fa1 0 2024-02-07T12:25:52.623 INFO:tasks.workunit.client.0.smithi047.stdout:8/483: creat d3/d36/d50/d30/d34/d3e/fa2 x:0 0 0 2024-02-07T12:25:52.623 INFO:tasks.workunit.client.0.smithi047.stdout:8/484: write d3/d36/d50/d2a/d3c/f64 [1389389,38760] 0 2024-02-07T12:25:52.624 INFO:tasks.workunit.client.0.smithi047.stdout:2/374: write d7/dc/f2b [2816844,80669] 0 2024-02-07T12:25:52.625 INFO:tasks.workunit.client.0.smithi047.stdout:2/375: truncate d7/dc/f59 207062 0 2024-02-07T12:25:52.628 INFO:tasks.workunit.client.0.smithi047.stdout:8/485: dread d3/d36/d50/d2a/f32 [0,4194304] 0 2024-02-07T12:25:52.638 INFO:tasks.workunit.client.0.smithi047.stdout:3/472: dwrite d12/d19/f8f [0,4194304] 0 2024-02-07T12:25:52.651 INFO:tasks.workunit.client.0.smithi047.stdout:3/473: write d12/d19/d21/f2c [737837,64807] 0 2024-02-07T12:25:52.652 INFO:tasks.workunit.client.0.smithi047.stdout:3/474: symlink d12/d19/d2d/d42/la2 0 2024-02-07T12:25:52.660 INFO:tasks.workunit.client.0.smithi047.stdout:2/376: dwrite d7/dc/f10 [0,4194304] 0 2024-02-07T12:25:52.660 INFO:tasks.workunit.client.0.smithi047.stdout:2/377: write d7/f62 [69321,49466] 0 2024-02-07T12:25:52.662 INFO:tasks.workunit.client.0.smithi047.stdout:8/486: dwrite d3/d66/d67/d6a/f51 [0,4194304] 0 2024-02-07T12:25:52.663 INFO:tasks.workunit.client.0.smithi047.stdout:8/487: chown d3/d66/d67/d6a/d91/f97 42 1 2024-02-07T12:25:52.669 INFO:tasks.workunit.client.0.smithi047.stdout:3/475: dwrite d12/d19/d2d/f4e [0,4194304] 0 2024-02-07T12:25:52.670 INFO:tasks.workunit.client.0.smithi047.stdout:3/476: fsync d12/d19/d2d/d42/f56 0 2024-02-07T12:25:52.670 INFO:tasks.workunit.client.0.smithi047.stdout:3/477: readlink d12/d19/l5c 0 2024-02-07T12:25:52.677 INFO:tasks.workunit.client.0.smithi047.stdout:8/488: dwrite d3/d66/d67/d6a/f46 [4194304,4194304] 0 2024-02-07T12:25:52.680 INFO:tasks.workunit.client.0.smithi047.stdout:8/489: creat d3/d36/d50/d28/fa3 x:0 0 0 2024-02-07T12:25:52.681 INFO:tasks.workunit.client.0.smithi047.stdout:8/490: creat d3/d66/d67/fa4 x:0 0 0 2024-02-07T12:25:52.683 INFO:tasks.workunit.client.0.smithi047.stdout:8/491: creat d3/d36/fa5 x:0 0 0 2024-02-07T12:25:52.687 INFO:tasks.workunit.client.0.smithi047.stdout:8/492: rename d3/d36/d50/d2a/d3c to d3/d36/d50/d30/d9e/da6 0 2024-02-07T12:25:52.688 INFO:tasks.workunit.client.0.smithi047.stdout:3/478: dread d12/d19/d21/d29/d31/f3e [0,4194304] 0 2024-02-07T12:25:52.694 INFO:tasks.workunit.client.0.smithi047.stdout:3/479: dread d12/d19/f26 [0,4194304] 0 2024-02-07T12:25:52.695 INFO:tasks.workunit.client.0.smithi047.stdout:8/493: dread d3/d66/d67/d6a/f46 [4194304,4194304] 0 2024-02-07T12:25:52.696 INFO:tasks.workunit.client.0.smithi047.stdout:8/494: symlink d3/d66/d67/d71/d93/d9f/la7 0 2024-02-07T12:25:52.697 INFO:tasks.workunit.client.0.smithi047.stdout:8/495: chown d3/d4/d87/f9c 16369 1 2024-02-07T12:25:52.697 INFO:tasks.workunit.client.0.smithi047.stdout:2/378: dwrite d7/f13 [0,4194304] 0 2024-02-07T12:25:52.697 INFO:tasks.workunit.client.0.smithi047.stdout:2/379: readlink d7/dc/l40 0 2024-02-07T12:25:52.698 INFO:tasks.workunit.client.0.smithi047.stdout:8/496: symlink d3/d99/la8 0 2024-02-07T12:25:52.698 INFO:tasks.workunit.client.0.smithi047.stdout:2/380: mknod d7/d2d/c6b 0 2024-02-07T12:25:52.698 INFO:tasks.workunit.client.0.smithi047.stdout:8/497: fsync d3/d36/d50/d30/f61 0 2024-02-07T12:25:52.700 INFO:tasks.workunit.client.0.smithi047.stdout:8/498: symlink d3/d4/d4d/la9 0 2024-02-07T12:25:52.702 INFO:tasks.workunit.client.0.smithi047.stdout:2/381: rmdir d7/dc/d51 39 2024-02-07T12:25:52.705 INFO:tasks.workunit.client.0.smithi047.stdout:2/382: rename d7/d2d/c6b to d7/d2d/c6c 0 2024-02-07T12:25:52.706 INFO:tasks.workunit.client.0.smithi047.stdout:2/383: stat d7/ca 0 2024-02-07T12:25:52.709 INFO:tasks.workunit.client.0.smithi047.stdout:8/499: dread d3/d36/d50/d2a/f2b [0,4194304] 0 2024-02-07T12:25:52.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:52 smithi138 ceph-mon[35528]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:25:52.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:52 smithi138 ceph-mon[35528]: Reconfiguring node-exporter.smithi047 (dependencies changed)... 2024-02-07T12:25:52.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:52 smithi138 ceph-mon[35528]: Reconfiguring daemon node-exporter.smithi047 on smithi047 2024-02-07T12:25:52.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:52 smithi047 ceph-mon[28972]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:25:52.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:52 smithi047 ceph-mon[28972]: Reconfiguring node-exporter.smithi047 (dependencies changed)... 2024-02-07T12:25:52.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:52 smithi047 ceph-mon[28972]: Reconfiguring daemon node-exporter.smithi047 on smithi047 2024-02-07T12:25:52.847 INFO:tasks.workunit.client.0.smithi047.stdout:1/219: sync 2024-02-07T12:25:52.864 INFO:tasks.workunit.client.0.smithi047.stdout:1/220: dwrite d1/f22 [0,4194304] 0 2024-02-07T12:25:52.865 INFO:tasks.workunit.client.0.smithi047.stdout:1/221: symlink d1/d2a/l3f 0 2024-02-07T12:25:52.865 INFO:tasks.workunit.client.0.smithi047.stdout:1/222: chown d1/d15/d30/l36 35 1 2024-02-07T12:25:52.866 INFO:tasks.workunit.client.0.smithi047.stdout:1/223: mkdir d1/d15/d18/d40 0 2024-02-07T12:25:52.866 INFO:tasks.workunit.client.0.smithi047.stdout:1/224: fdatasync d1/f21 0 2024-02-07T12:25:52.877 INFO:tasks.workunit.client.0.smithi047.stdout:1/225: dread d1/f22 [0,4194304] 0 2024-02-07T12:25:52.877 INFO:tasks.workunit.client.0.smithi047.stdout:1/226: chown d1 0 1 2024-02-07T12:25:52.878 INFO:tasks.workunit.client.0.smithi047.stdout:1/227: rename d1/d15/d18/f26 to d1/d15/d18/f41 0 2024-02-07T12:25:52.879 INFO:tasks.workunit.client.0.smithi047.stdout:1/228: mknod d1/d15/d18/d40/c42 0 2024-02-07T12:25:52.881 INFO:tasks.workunit.client.0.smithi047.stdout:1/229: creat d1/d15/d2f/d3d/d3e/f43 x:0 0 0 2024-02-07T12:25:52.882 INFO:tasks.workunit.client.0.smithi047.stdout:1/230: mknod d1/c44 0 2024-02-07T12:25:52.883 INFO:tasks.workunit.client.0.smithi047.stdout:1/231: symlink d1/d15/d2f/d3d/l45 0 2024-02-07T12:25:52.884 INFO:tasks.workunit.client.0.smithi047.stdout:1/232: mkdir d1/d15/d30/d46 0 2024-02-07T12:25:52.884 INFO:tasks.workunit.client.0.smithi047.stdout:1/233: dread - d1/f21 zero size 2024-02-07T12:25:52.885 INFO:tasks.workunit.client.0.smithi047.stdout:1/234: mknod d1/d15/d2f/d3d/c47 0 2024-02-07T12:25:52.885 INFO:tasks.workunit.client.0.smithi047.stdout:1/235: write d1/d15/d2f/d3d/d3e/f43 [420452,116434] 0 2024-02-07T12:25:52.901 INFO:tasks.workunit.client.0.smithi047.stdout:1/236: dwrite d1/d15/d18/f23 [0,4194304] 0 2024-02-07T12:25:52.905 INFO:tasks.workunit.client.0.smithi047.stdout:1/237: mkdir d1/d48 0 2024-02-07T12:25:52.907 INFO:tasks.workunit.client.0.smithi047.stdout:1/238: mknod d1/d37/c49 0 2024-02-07T12:25:52.909 INFO:tasks.workunit.client.0.smithi047.stdout:1/239: write d1/d15/d18/f23 [4293327,8052] 0 2024-02-07T12:25:52.909 INFO:tasks.workunit.client.0.smithi047.stdout:1/240: creat d1/d15/d2f/d3d/d3e/f4a x:0 0 0 2024-02-07T12:25:52.909 INFO:tasks.workunit.client.0.smithi047.stdout:1/241: creat d1/d15/d2f/f4b x:0 0 0 2024-02-07T12:25:52.911 INFO:tasks.workunit.client.0.smithi047.stdout:1/242: mkdir d1/d15/d30/d46/d4c 0 2024-02-07T12:25:52.911 INFO:tasks.workunit.client.0.smithi047.stdout:1/243: fdatasync d1/d15/f1c 0 2024-02-07T12:25:52.911 INFO:tasks.workunit.client.0.smithi047.stdout:1/244: getdents d1/d15/d18/d40 0 2024-02-07T12:25:52.912 INFO:tasks.workunit.client.0.smithi047.stdout:1/245: write d1/d15/d2f/d3d/d3e/f4a [831226,63809] 0 2024-02-07T12:25:52.912 INFO:tasks.workunit.client.0.smithi047.stdout:1/246: readlink d1/lf 0 2024-02-07T12:25:52.914 INFO:tasks.workunit.client.0.smithi047.stdout:1/247: truncate d1/d15/f1c 3807748 0 2024-02-07T12:25:52.915 INFO:tasks.workunit.client.0.smithi047.stdout:1/248: mknod d1/d37/c4d 0 2024-02-07T12:25:52.918 INFO:tasks.workunit.client.0.smithi047.stdout:1/249: fdatasync d1/d15/d18/f23 0 2024-02-07T12:25:52.918 INFO:tasks.workunit.client.0.smithi047.stdout:1/250: chown d1/d15/d2f/d3d/d3e/f43 14 1 2024-02-07T12:25:52.938 INFO:tasks.workunit.client.0.smithi047.stdout:1/251: dwrite d1/d15/d18/f41 [0,4194304] 0 2024-02-07T12:25:52.938 INFO:tasks.workunit.client.0.smithi047.stdout:1/252: dread - d1/d15/d2f/f4b zero size 2024-02-07T12:25:52.940 INFO:tasks.workunit.client.0.smithi047.stdout:1/253: link d1/f21 d1/d2a/f4e 0 2024-02-07T12:25:52.940 INFO:tasks.workunit.client.0.smithi047.stdout:1/254: write d1/d15/f1c [3377488,101553] 0 2024-02-07T12:25:52.943 INFO:tasks.workunit.client.0.smithi047.stdout:1/255: dread d1/d15/d2f/d3d/d3e/f4a [0,4194304] 0 2024-02-07T12:25:52.945 INFO:tasks.workunit.client.0.smithi047.stdout:1/256: rename d1/d2a/f4e to d1/d15/d18/f4f 0 2024-02-07T12:25:52.945 INFO:tasks.workunit.client.0.smithi047.stdout:1/257: write d1/d15/d18/f24 [954796,80490] 0 2024-02-07T12:25:52.946 INFO:tasks.workunit.client.0.smithi047.stdout:1/258: creat d1/d15/f50 x:0 0 0 2024-02-07T12:25:52.946 INFO:tasks.workunit.client.0.smithi047.stdout:1/259: write d1/d15/d18/f27 [3832751,40060] 0 2024-02-07T12:25:52.947 INFO:tasks.workunit.client.0.smithi047.stdout:1/260: rename d1/la to d1/d2a/l51 0 2024-02-07T12:25:52.957 INFO:tasks.workunit.client.0.smithi047.stdout:1/261: truncate d1/d15/d18/f27 1348949 0 2024-02-07T12:25:52.958 INFO:tasks.workunit.client.0.smithi047.stdout:1/262: creat d1/d15/d18/d40/f52 x:0 0 0 2024-02-07T12:25:52.974 INFO:tasks.workunit.client.0.smithi047.stdout:1/263: dwrite d1/fe [0,4194304] 0 2024-02-07T12:25:52.976 INFO:tasks.workunit.client.0.smithi047.stdout:1/264: rename d1/d15/l33 to d1/d15/d30/l53 0 2024-02-07T12:25:52.978 INFO:tasks.workunit.client.0.smithi047.stdout:1/265: dread d1/d15/d2f/d3d/d3e/f4a [0,4194304] 0 2024-02-07T12:25:52.980 INFO:tasks.workunit.client.0.smithi047.stdout:1/266: rename d1/d37/c49 to d1/c54 0 2024-02-07T12:25:52.982 INFO:tasks.workunit.client.0.smithi047.stdout:1/267: rmdir d1/d15/d2f 39 2024-02-07T12:25:52.983 INFO:tasks.workunit.client.0.smithi047.stdout:1/268: creat d1/d15/d2f/d3d/f55 x:0 0 0 2024-02-07T12:25:52.983 INFO:tasks.workunit.client.0.smithi047.stdout:1/269: creat d1/d15/d18/d40/f56 x:0 0 0 2024-02-07T12:25:52.983 INFO:tasks.workunit.client.0.smithi047.stdout:1/270: dread - d1/d15/d18/f4f zero size 2024-02-07T12:25:52.996 INFO:tasks.workunit.client.0.smithi047.stdout:1/271: dwrite d1/d15/d2f/f3c [0,4194304] 0 2024-02-07T12:25:52.997 INFO:tasks.workunit.client.0.smithi047.stdout:1/272: creat d1/d15/d2f/d3d/d3e/f57 x:0 0 0 2024-02-07T12:25:52.998 INFO:tasks.workunit.client.0.smithi047.stdout:1/273: truncate d1/d15/d18/f41 3938912 0 2024-02-07T12:25:52.998 INFO:tasks.workunit.client.0.smithi047.stdout:1/274: truncate d1/d15/d18/f4f 902361 0 2024-02-07T12:25:53.013 INFO:tasks.workunit.client.0.smithi047.stdout:1/275: dwrite d1/d15/d18/f4f [0,4194304] 0 2024-02-07T12:25:53.022 INFO:tasks.workunit.client.0.smithi047.stdout:1/276: dread d1/d15/d18/f23 [0,4194304] 0 2024-02-07T12:25:53.023 INFO:tasks.workunit.client.0.smithi047.stdout:1/277: getdents d1/d37 0 2024-02-07T12:25:53.024 INFO:tasks.workunit.client.0.smithi047.stdout:1/278: creat d1/f58 x:0 0 0 2024-02-07T12:25:53.024 INFO:tasks.workunit.client.0.smithi047.stdout:7/322: sync 2024-02-07T12:25:53.046 INFO:tasks.workunit.client.0.smithi047.stdout:7/323: dwrite d0/df/d29/d3e/f46 [0,4194304] 0 2024-02-07T12:25:53.046 INFO:tasks.workunit.client.0.smithi047.stdout:1/279: dwrite d1/d15/d18/d40/f56 [0,4194304] 0 2024-02-07T12:25:53.046 INFO:tasks.workunit.client.0.smithi047.stdout:7/324: read d0/f2 [3424478,98783] 0 2024-02-07T12:25:53.071 INFO:tasks.workunit.client.0.smithi047.stdout:7/325: dwrite d0/f47 [0,4194304] 0 2024-02-07T12:25:53.071 INFO:tasks.workunit.client.0.smithi047.stdout:7/326: dread - d0/df/d29/d3e/f56 zero size 2024-02-07T12:25:53.071 INFO:tasks.workunit.client.0.smithi047.stdout:7/327: read - d0/f64 zero size 2024-02-07T12:25:53.075 INFO:tasks.workunit.client.0.smithi047.stdout:1/280: dwrite d1/f22 [4194304,4194304] 0 2024-02-07T12:25:53.076 INFO:tasks.workunit.client.0.smithi047.stdout:7/328: rename d0/d42/l48 to d0/df/d29/d31/d40/l6d 0 2024-02-07T12:25:53.076 INFO:tasks.workunit.client.0.smithi047.stdout:7/329: creat d0/df/d29/d31/d40/f6e x:0 0 0 2024-02-07T12:25:53.076 INFO:tasks.workunit.client.0.smithi047.stdout:1/281: creat d1/d15/d30/d46/f59 x:0 0 0 2024-02-07T12:25:53.082 INFO:tasks.workunit.client.0.smithi047.stdout:7/330: mkdir d0/d6f 0 2024-02-07T12:25:53.083 INFO:tasks.workunit.client.0.smithi047.stdout:7/331: truncate d0/df/d29/d3e/d4c/f6a 1800697 0 2024-02-07T12:25:53.085 INFO:tasks.workunit.client.0.smithi047.stdout:7/332: link d0/ld d0/d2f/l70 0 2024-02-07T12:25:53.085 INFO:tasks.workunit.client.0.smithi047.stdout:7/333: dread - d0/df/d29/f5b zero size 2024-02-07T12:25:53.086 INFO:tasks.workunit.client.0.smithi047.stdout:7/334: chown d0/d42/l5e 348837 1 2024-02-07T12:25:53.095 INFO:tasks.workunit.client.0.smithi047.stdout:1/282: dwrite d1/d15/d2f/d3d/f55 [0,4194304] 0 2024-02-07T12:25:53.095 INFO:tasks.workunit.client.0.smithi047.stdout:1/283: chown d1/c54 19320 1 2024-02-07T12:25:53.099 INFO:tasks.workunit.client.0.smithi047.stdout:1/284: creat d1/d15/d30/f5a x:0 0 0 2024-02-07T12:25:53.100 INFO:tasks.workunit.client.0.smithi047.stdout:1/285: mknod d1/d15/d30/d46/d4c/c5b 0 2024-02-07T12:25:53.100 INFO:tasks.workunit.client.0.smithi047.stdout:1/286: creat d1/d15/d2f/d3d/f5c x:0 0 0 2024-02-07T12:25:53.104 INFO:tasks.workunit.client.0.smithi047.stdout:7/335: dwrite d0/df/d29/d3e/f60 [0,4194304] 0 2024-02-07T12:25:53.104 INFO:tasks.workunit.client.0.smithi047.stdout:7/336: stat d0/df/d29/d31/d55 0 2024-02-07T12:25:53.108 INFO:tasks.workunit.client.0.smithi047.stdout:7/337: creat d0/d6f/f71 x:0 0 0 2024-02-07T12:25:53.108 INFO:tasks.workunit.client.0.smithi047.stdout:7/338: chown d0/ld 530316402 1 2024-02-07T12:25:53.109 INFO:tasks.workunit.client.0.smithi047.stdout:7/339: fdatasync d0/df/d29/f65 0 2024-02-07T12:25:53.112 INFO:tasks.workunit.client.0.smithi047.stdout:7/340: mknod d0/df/c72 0 2024-02-07T12:25:53.112 INFO:tasks.workunit.client.0.smithi047.stdout:7/341: write d0/df/d29/d3e/f56 [653625,43706] 0 2024-02-07T12:25:53.114 INFO:tasks.workunit.client.0.smithi047.stdout:7/342: truncate d0/df/d29/f23 349158 0 2024-02-07T12:25:53.116 INFO:tasks.workunit.client.0.smithi047.stdout:7/343: creat d0/d42/d4d/d67/f73 x:0 0 0 2024-02-07T12:25:53.136 INFO:tasks.workunit.client.0.smithi047.stdout:7/344: dwrite d0/df/d29/f65 [0,4194304] 0 2024-02-07T12:25:53.136 INFO:tasks.workunit.client.0.smithi047.stdout:7/345: fsync d0/d4/f33 0 2024-02-07T12:25:53.136 INFO:tasks.workunit.client.0.smithi047.stdout:7/346: write d0/f64 [585591,99259] 0 2024-02-07T12:25:53.139 INFO:tasks.workunit.client.0.smithi047.stdout:7/347: mkdir d0/df/d74 0 2024-02-07T12:25:53.149 INFO:tasks.workunit.client.0.smithi047.stdout:7/348: getdents d0/d42/d4d/d67 0 2024-02-07T12:25:53.149 INFO:tasks.workunit.client.0.smithi047.stdout:7/349: rename d0/df to d0/df/d29/d3e/d4c/d75 22 2024-02-07T12:25:53.153 INFO:tasks.workunit.client.0.smithi047.stdout:7/350: mknod d0/df/d29/c76 0 2024-02-07T12:25:53.153 INFO:tasks.workunit.client.0.smithi047.stdout:7/351: truncate d0/df/d29/d3e/f56 1112597 0 2024-02-07T12:25:53.156 INFO:tasks.workunit.client.0.smithi047.stdout:7/352: getdents d0/df/d29/d31/d40 0 2024-02-07T12:25:53.156 INFO:tasks.workunit.client.0.smithi047.stdout:7/353: chown d0/df/d29/f23 253147346 1 2024-02-07T12:25:53.174 INFO:tasks.workunit.client.0.smithi047.stdout:7/354: dwrite d0/df/d29/d3e/f46 [0,4194304] 0 2024-02-07T12:25:53.174 INFO:tasks.workunit.client.0.smithi047.stdout:7/355: chown d0/df/d29/d31/l38 6200781 1 2024-02-07T12:25:53.348 INFO:tasks.workunit.client.0.smithi047.stdout:0/158: sync 2024-02-07T12:25:53.349 INFO:tasks.workunit.client.0.smithi047.stdout:5/379: sync 2024-02-07T12:25:53.349 INFO:tasks.workunit.client.0.smithi047.stdout:9/214: sync 2024-02-07T12:25:53.349 INFO:tasks.workunit.client.0.smithi047.stdout:5/380: chown da/df/d16/d41/c6d 527 1 2024-02-07T12:25:53.350 INFO:tasks.workunit.client.0.smithi047.stdout:9/215: symlink d3/d10/d18/d3a/l45 0 2024-02-07T12:25:53.351 INFO:tasks.workunit.client.0.smithi047.stdout:5/381: mknod da/df/d16/d41/d57/d6c/c7f 0 2024-02-07T12:25:53.352 INFO:tasks.workunit.client.0.smithi047.stdout:0/159: rename d19/c1b to d19/d1c/c28 0 2024-02-07T12:25:53.354 INFO:tasks.workunit.client.0.smithi047.stdout:0/160: rename d19/d1c/c20 to d19/d1c/c29 0 2024-02-07T12:25:53.354 INFO:tasks.workunit.client.0.smithi047.stdout:0/161: fdatasync fa 0 2024-02-07T12:25:53.356 INFO:tasks.workunit.client.0.smithi047.stdout:0/162: creat d19/d1c/d24/f2a x:0 0 0 2024-02-07T12:25:53.356 INFO:tasks.workunit.client.0.smithi047.stdout:0/163: dread - d19/d1c/f1f zero size 2024-02-07T12:25:53.360 INFO:tasks.workunit.client.0.smithi047.stdout:5/382: dread da/f39 [0,4194304] 0 2024-02-07T12:25:53.360 INFO:tasks.workunit.client.0.smithi047.stdout:5/383: dread - da/df/d16/d25/d71/d68/f7e zero size 2024-02-07T12:25:53.362 INFO:tasks.workunit.client.0.smithi047.stdout:5/384: mkdir da/df/d16/d25/d33/d55/d80 0 2024-02-07T12:25:53.365 INFO:tasks.workunit.client.0.smithi047.stdout:0/164: write f15 [1496344,85848] 0 2024-02-07T12:25:53.365 INFO:tasks.workunit.client.0.smithi047.stdout:0/165: chown d19/c21 40014809 1 2024-02-07T12:25:53.366 INFO:tasks.workunit.client.0.smithi047.stdout:0/166: unlink f10 0 2024-02-07T12:25:53.368 INFO:tasks.workunit.client.0.smithi047.stdout:0/167: mkdir d19/d1c/d2b 0 2024-02-07T12:25:53.385 INFO:tasks.workunit.client.0.smithi047.stdout:0/168: dwrite f14 [0,4194304] 0 2024-02-07T12:25:53.386 INFO:tasks.workunit.client.0.smithi047.stdout:0/169: mkdir d19/d1c/d2c 0 2024-02-07T12:25:53.389 INFO:tasks.workunit.client.0.smithi047.stdout:0/170: rename f5 to d19/f2d 0 2024-02-07T12:25:53.389 INFO:tasks.workunit.client.0.smithi047.stdout:0/171: creat d19/f2e x:0 0 0 2024-02-07T12:25:53.396 INFO:tasks.workunit.client.0.smithi047.stdout:0/172: dread fc [0,4194304] 0 2024-02-07T12:25:53.397 INFO:tasks.workunit.client.0.smithi047.stdout:0/173: mkdir d19/d25/d2f 0 2024-02-07T12:25:53.397 INFO:tasks.workunit.client.0.smithi047.stdout:0/174: read - d19/f26 zero size 2024-02-07T12:25:53.403 INFO:tasks.workunit.client.0.smithi047.stdout:0/175: dread f13 [0,4194304] 0 2024-02-07T12:25:53.405 INFO:tasks.workunit.client.0.smithi047.stdout:0/176: creat d19/d1c/f30 x:0 0 0 2024-02-07T12:25:53.486 INFO:tasks.workunit.client.0.smithi047.stdout:6/303: sync 2024-02-07T12:25:53.486 INFO:tasks.workunit.client.0.smithi047.stdout:2/384: sync 2024-02-07T12:25:53.487 INFO:tasks.workunit.client.0.smithi047.stdout:4/442: sync 2024-02-07T12:25:53.487 INFO:tasks.workunit.client.0.smithi047.stdout:7/356: sync 2024-02-07T12:25:53.487 INFO:tasks.workunit.client.0.smithi047.stdout:3/480: sync 2024-02-07T12:25:53.487 INFO:tasks.workunit.client.0.smithi047.stdout:1/287: sync 2024-02-07T12:25:53.487 INFO:tasks.workunit.client.0.smithi047.stdout:8/500: sync 2024-02-07T12:25:53.487 INFO:tasks.workunit.client.0.smithi047.stdout:2/385: creat d7/d2d/f6d x:0 0 0 2024-02-07T12:25:53.487 INFO:tasks.workunit.client.0.smithi047.stdout:8/501: fsync d3/d36/d50/d30/d9e/da6/f57 0 2024-02-07T12:25:53.488 INFO:tasks.workunit.client.0.smithi047.stdout:2/386: write d7/d2d/f53 [682944,46414] 0 2024-02-07T12:25:53.490 INFO:tasks.workunit.client.0.smithi047.stdout:3/481: unlink d12/d19/d2d/d82/l89 0 2024-02-07T12:25:53.493 INFO:tasks.workunit.client.0.smithi047.stdout:8/502: creat d3/d66/faa x:0 0 0 2024-02-07T12:25:53.493 INFO:tasks.workunit.client.0.smithi047.stdout:8/503: getdents d3/d4/d87/da1 0 2024-02-07T12:25:53.493 INFO:tasks.workunit.client.0.smithi047.stdout:8/504: write d3/d36/d50/d30/d34/d3e/fa2 [148962,2626] 0 2024-02-07T12:25:53.493 INFO:tasks.workunit.client.0.smithi047.stdout:8/505: truncate d3/d66/f7d 1054637 0 2024-02-07T12:25:53.494 INFO:tasks.workunit.client.0.smithi047.stdout:8/506: dread - d3/d36/d50/d28/fa3 zero size 2024-02-07T12:25:53.496 INFO:tasks.workunit.client.0.smithi047.stdout:2/387: link d7/f3b d7/d48/f6e 0 2024-02-07T12:25:53.497 INFO:tasks.workunit.client.0.smithi047.stdout:8/507: mkdir d3/d36/d50/d30/d34/dab 0 2024-02-07T12:25:53.498 INFO:tasks.workunit.client.0.smithi047.stdout:4/443: read d3/d61/d43/f4c [4087186,66700] 0 2024-02-07T12:25:53.498 INFO:tasks.workunit.client.0.smithi047.stdout:4/444: dread - d3/d27/d3b/f88 zero size 2024-02-07T12:25:53.498 INFO:tasks.workunit.client.0.smithi047.stdout:7/357: dread d0/df/d29/d31/d40/f50 [0,4194304] 0 2024-02-07T12:25:53.498 INFO:tasks.workunit.client.0.smithi047.stdout:4/445: chown d3/d61/d43/l90 120 1 2024-02-07T12:25:53.500 INFO:tasks.workunit.client.0.smithi047.stdout:2/388: mknod d7/c6f 0 2024-02-07T12:25:53.507 INFO:tasks.workunit.client.0.smithi047.stdout:4/446: write d3/f12 [1880750,89799] 0 2024-02-07T12:25:53.513 INFO:tasks.workunit.client.0.smithi047.stdout:4/447: creat d3/d61/d43/d45/d63/f93 x:0 0 0 2024-02-07T12:25:53.513 INFO:tasks.workunit.client.0.smithi047.stdout:4/448: write d3/d61/d43/d45/d66/f8f [953652,111243] 0 2024-02-07T12:25:53.514 INFO:tasks.workunit.client.0.smithi047.stdout:4/449: symlink d3/d27/d5e/l94 0 2024-02-07T12:25:53.515 INFO:tasks.workunit.client.0.smithi047.stdout:4/450: symlink d3/d61/d70/d83/l95 0 2024-02-07T12:25:53.516 INFO:tasks.workunit.client.0.smithi047.stdout:8/508: dread d3/d4/f1e [0,4194304] 0 2024-02-07T12:25:53.516 INFO:tasks.workunit.client.0.smithi047.stdout:8/509: chown d3/d66/d67/d6a/d91 0 1 2024-02-07T12:25:53.516 INFO:tasks.workunit.client.0.smithi047.stdout:8/510: stat d3/d36/d50/d30/d9e 0 2024-02-07T12:25:53.516 INFO:tasks.workunit.client.0.smithi047.stdout:8/511: write d3/d66/d67/d6a/f4c [57177,77010] 0 2024-02-07T12:25:53.517 INFO:tasks.workunit.client.0.smithi047.stdout:4/451: mknod d3/d61/d70/d83/d85/c96 0 2024-02-07T12:25:53.517 INFO:tasks.workunit.client.0.smithi047.stdout:4/452: chown d3/d27/d3b/c81 16799508 1 2024-02-07T12:25:53.518 INFO:tasks.workunit.client.0.smithi047.stdout:4/453: unlink d3/d27/d3b/f4e 0 2024-02-07T12:25:53.518 INFO:tasks.workunit.client.0.smithi047.stdout:4/454: write d3/d27/d3b/f88 [206438,105746] 0 2024-02-07T12:25:53.520 INFO:tasks.workunit.client.0.smithi047.stdout:4/455: mknod d3/d27/d5e/c97 0 2024-02-07T12:25:53.520 INFO:tasks.workunit.client.0.smithi047.stdout:4/456: stat d3/d27/c31 0 2024-02-07T12:25:53.520 INFO:tasks.workunit.client.0.smithi047.stdout:4/457: write d3/f12 [5160300,29875] 0 2024-02-07T12:25:53.520 INFO:tasks.workunit.client.0.smithi047.stdout:4/458: mknod d3/d30/c98 0 2024-02-07T12:25:53.523 INFO:tasks.workunit.client.0.smithi047.stdout:7/358: dwrite d0/df/d29/d3e/f46 [4194304,4194304] 0 2024-02-07T12:25:53.523 INFO:tasks.workunit.client.0.smithi047.stdout:4/459: dread d3/d30/f44 [0,4194304] 0 2024-02-07T12:25:53.523 INFO:tasks.workunit.client.0.smithi047.stdout:6/304: dwrite d3/d5/f13 [0,4194304] 0 2024-02-07T12:25:53.523 INFO:tasks.workunit.client.0.smithi047.stdout:4/460: chown d3/d27/d3b/d7d/f82 784 1 2024-02-07T12:25:53.523 INFO:tasks.workunit.client.0.smithi047.stdout:6/305: fsync d3/da/d34/f5a 0 2024-02-07T12:25:53.524 INFO:tasks.workunit.client.0.smithi047.stdout:7/359: fsync d0/df/d29/d31/d40/f49 0 2024-02-07T12:25:53.524 INFO:tasks.workunit.client.0.smithi047.stdout:1/288: dwrite d1/d15/d18/d40/f52 [0,4194304] 0 2024-02-07T12:25:53.524 INFO:tasks.workunit.client.0.smithi047.stdout:3/482: dwrite d12/d19/d2d/d82/f85 [0,4194304] 0 2024-02-07T12:25:53.528 INFO:tasks.workunit.client.0.smithi047.stdout:1/289: link d1/d15/d30/l36 d1/d48/l5d 0 2024-02-07T12:25:53.529 INFO:tasks.workunit.client.0.smithi047.stdout:3/483: symlink d12/d19/d2d/d52/la3 0 2024-02-07T12:25:53.531 INFO:tasks.workunit.client.0.smithi047.stdout:4/461: fsync d3/d27/d3b/f88 0 2024-02-07T12:25:53.531 INFO:tasks.workunit.client.0.smithi047.stdout:7/360: dread d0/df/d29/d3e/d4c/f6a [0,4194304] 0 2024-02-07T12:25:53.539 INFO:tasks.workunit.client.0.smithi047.stdout:6/306: read d3/da/f37 [3141202,4058] 0 2024-02-07T12:25:53.543 INFO:tasks.workunit.client.0.smithi047.stdout:1/290: creat d1/f5e x:0 0 0 2024-02-07T12:25:53.544 INFO:tasks.workunit.client.0.smithi047.stdout:7/361: dwrite d0/d42/f4f [4194304,4194304] 0 2024-02-07T12:25:53.545 INFO:tasks.workunit.client.0.smithi047.stdout:7/362: chown d0/d4/f20 15960 1 2024-02-07T12:25:53.545 INFO:tasks.workunit.client.0.smithi047.stdout:8/512: dwrite d3/d66/d67/d6a/f4c [0,4194304] 0 2024-02-07T12:25:53.546 INFO:tasks.workunit.client.0.smithi047.stdout:3/484: unlink d12/d19/d21/d29/c2a 0 2024-02-07T12:25:53.549 INFO:tasks.workunit.client.0.smithi047.stdout:6/307: rename d3/f4b to d3/d1e/f66 0 2024-02-07T12:25:53.549 INFO:tasks.workunit.client.0.smithi047.stdout:6/308: write d3/d5/d35/f3d [5107378,75909] 0 2024-02-07T12:25:53.550 INFO:tasks.workunit.client.0.smithi047.stdout:1/291: mkdir d1/d15/d30/d46/d4c/d5f 0 2024-02-07T12:25:53.552 INFO:tasks.workunit.client.0.smithi047.stdout:7/363: symlink d0/d42/d4d/d67/l77 0 2024-02-07T12:25:53.554 INFO:tasks.workunit.client.0.smithi047.stdout:8/513: mkdir d3/d66/dac 0 2024-02-07T12:25:53.554 INFO:tasks.workunit.client.0.smithi047.stdout:8/514: readlink d3/d4/d59/l94 0 2024-02-07T12:25:53.554 INFO:tasks.workunit.client.0.smithi047.stdout:4/462: dread d3/f2b [0,4194304] 0 2024-02-07T12:25:53.556 INFO:tasks.workunit.client.0.smithi047.stdout:3/485: creat d12/d19/d21/d29/fa4 x:0 0 0 2024-02-07T12:25:53.559 INFO:tasks.workunit.client.0.smithi047.stdout:6/309: creat d3/da/d3b/d52/f67 x:0 0 0 2024-02-07T12:25:53.559 INFO:tasks.workunit.client.0.smithi047.stdout:6/310: fdatasync d3/da/d14/f2d 0 2024-02-07T12:25:53.561 INFO:tasks.workunit.client.0.smithi047.stdout:1/292: creat d1/d37/f60 x:0 0 0 2024-02-07T12:25:53.562 INFO:tasks.workunit.client.0.smithi047.stdout:7/364: mknod d0/df/d74/c78 0 2024-02-07T12:25:53.562 INFO:tasks.workunit.client.0.smithi047.stdout:7/365: write d0/f2 [2742518,108538] 0 2024-02-07T12:25:53.564 INFO:tasks.workunit.client.0.smithi047.stdout:4/463: creat d3/d61/d70/f99 x:0 0 0 2024-02-07T12:25:53.566 INFO:tasks.workunit.client.0.smithi047.stdout:3/486: mkdir d12/d19/d2d/d33/da5 0 2024-02-07T12:25:53.567 INFO:tasks.workunit.client.0.smithi047.stdout:3/487: fsync d12/d19/f2e 0 2024-02-07T12:25:53.567 INFO:tasks.workunit.client.0.smithi047.stdout:3/488: fsync d12/d19/d21/d29/d31/f8a 0 2024-02-07T12:25:53.570 INFO:tasks.workunit.client.0.smithi047.stdout:6/311: write d3/da/d14/f36 [2774383,71998] 0 2024-02-07T12:25:53.570 INFO:tasks.workunit.client.0.smithi047.stdout:6/312: dread - d3/da/d2c/d42/f4c zero size 2024-02-07T12:25:53.571 INFO:tasks.workunit.client.0.smithi047.stdout:7/366: unlink d0/l3 0 2024-02-07T12:25:53.571 INFO:tasks.workunit.client.0.smithi047.stdout:7/367: readlink d0/df/l54 0 2024-02-07T12:25:53.571 INFO:tasks.workunit.client.0.smithi047.stdout:7/368: write d0/d42/f57 [4672551,49793] 0 2024-02-07T12:25:53.575 INFO:tasks.workunit.client.0.smithi047.stdout:8/515: dwrite d3/d36/d50/d28/f96 [4194304,4194304] 0 2024-02-07T12:25:53.576 INFO:tasks.workunit.client.0.smithi047.stdout:6/313: unlink d3/da/d14/d28/d46/f53 0 2024-02-07T12:25:53.576 INFO:tasks.workunit.client.0.smithi047.stdout:7/369: truncate d0/df/d29/d31/f34 920962 0 2024-02-07T12:25:53.591 INFO:tasks.workunit.client.0.smithi047.stdout:7/370: dread d0/d4/f12 [0,4194304] 0 2024-02-07T12:25:53.591 INFO:tasks.workunit.client.0.smithi047.stdout:7/371: stat d0/df/d29/d31/d40 0 2024-02-07T12:25:53.591 INFO:tasks.workunit.client.0.smithi047.stdout:7/372: write d0/d4/f20 [545134,42113] 0 2024-02-07T12:25:53.591 INFO:tasks.workunit.client.0.smithi047.stdout:1/293: dwrite d1/f58 [0,4194304] 0 2024-02-07T12:25:53.595 INFO:tasks.workunit.client.0.smithi047.stdout:4/464: dwrite d3/f17 [4194304,4194304] 0 2024-02-07T12:25:53.597 INFO:tasks.workunit.client.0.smithi047.stdout:4/465: truncate d3/f5 148629 0 2024-02-07T12:25:53.600 INFO:tasks.workunit.client.0.smithi047.stdout:4/466: mknod d3/d61/d43/d45/d66/c9a 0 2024-02-07T12:25:53.600 INFO:tasks.workunit.client.0.smithi047.stdout:4/467: truncate d3/d61/d43/d45/d63/f68 168220 0 2024-02-07T12:25:53.600 INFO:tasks.workunit.client.0.smithi047.stdout:4/468: chown d3/d27/d3b/f42 1057921566 1 2024-02-07T12:25:53.600 INFO:tasks.workunit.client.0.smithi047.stdout:4/469: write d3/d30/d37/f6a [510920,112748] 0 2024-02-07T12:25:53.600 INFO:tasks.workunit.client.0.smithi047.stdout:4/470: write d3/d61/d43/d45/d6c/d73/f7c [605298,125382] 0 2024-02-07T12:25:53.601 INFO:tasks.workunit.client.0.smithi047.stdout:1/294: dread d1/d15/d2f/f3c [0,4194304] 0 2024-02-07T12:25:53.601 INFO:tasks.workunit.client.0.smithi047.stdout:1/295: creat d1/d15/d18/d40/f61 x:0 0 0 2024-02-07T12:25:53.603 INFO:tasks.workunit.client.0.smithi047.stdout:6/314: dwrite d3/da/d2c/f2e [0,4194304] 0 2024-02-07T12:25:53.603 INFO:tasks.workunit.client.0.smithi047.stdout:6/315: write d3/da/d2c/d42/f57 [4447061,2422] 0 2024-02-07T12:25:53.603 INFO:tasks.workunit.client.0.smithi047.stdout:8/516: dwrite d3/d66/d67/d6a/d91/f97 [0,4194304] 0 2024-02-07T12:25:53.604 INFO:tasks.workunit.client.0.smithi047.stdout:7/373: dread d0/f2 [0,4194304] 0 2024-02-07T12:25:53.611 INFO:tasks.workunit.client.0.smithi047.stdout:7/374: getdents d0/df 0 2024-02-07T12:25:53.611 INFO:tasks.workunit.client.0.smithi047.stdout:7/375: dread - d0/df/d29/f68 zero size 2024-02-07T12:25:53.613 INFO:tasks.workunit.client.0.smithi047.stdout:8/517: dread d3/d36/d50/d30/d9e/da6/f57 [0,4194304] 0 2024-02-07T12:25:53.614 INFO:tasks.workunit.client.0.smithi047.stdout:1/296: dread d1/d15/d18/d40/f52 [0,4194304] 0 2024-02-07T12:25:53.616 INFO:tasks.workunit.client.0.smithi047.stdout:6/316: dwrite d3/da/d14/f2d [0,4194304] 0 2024-02-07T12:25:53.616 INFO:tasks.workunit.client.0.smithi047.stdout:6/317: truncate d3/da/d2c/d42/f4c 14227 0 2024-02-07T12:25:53.616 INFO:tasks.workunit.client.0.smithi047.stdout:7/376: creat d0/d42/d4d/d67/f79 x:0 0 0 2024-02-07T12:25:53.619 INFO:tasks.workunit.client.0.smithi047.stdout:8/518: write d3/d4/f7 [3989650,61124] 0 2024-02-07T12:25:53.621 INFO:tasks.workunit.client.0.smithi047.stdout:6/318: mknod d3/da/d14/c68 0 2024-02-07T12:25:53.623 INFO:tasks.workunit.client.0.smithi047.stdout:8/519: fsync d3/f56 0 2024-02-07T12:25:53.623 INFO:tasks.workunit.client.0.smithi047.stdout:8/520: fsync d3/d36/d50/f2d 0 2024-02-07T12:25:53.624 INFO:tasks.workunit.client.0.smithi047.stdout:6/319: rmdir d3/d5/d35/d3c/d45 0 2024-02-07T12:25:53.625 INFO:tasks.workunit.client.0.smithi047.stdout:7/377: truncate d0/df/d29/f23 360182 0 2024-02-07T12:25:53.626 INFO:tasks.workunit.client.0.smithi047.stdout:8/521: creat d3/d66/d67/fad x:0 0 0 2024-02-07T12:25:53.627 INFO:tasks.workunit.client.0.smithi047.stdout:6/320: creat d3/da/d3b/d55/f69 x:0 0 0 2024-02-07T12:25:53.629 INFO:tasks.workunit.client.0.smithi047.stdout:7/378: creat d0/f7a x:0 0 0 2024-02-07T12:25:53.629 INFO:tasks.workunit.client.0.smithi047.stdout:6/321: symlink d3/d1e/d25/l6a 0 2024-02-07T12:25:53.631 INFO:tasks.workunit.client.0.smithi047.stdout:7/379: creat d0/df/d74/f7b x:0 0 0 2024-02-07T12:25:53.631 INFO:tasks.workunit.client.0.smithi047.stdout:7/380: dread - d0/df/d74/f7b zero size 2024-02-07T12:25:53.631 INFO:tasks.workunit.client.0.smithi047.stdout:7/381: chown d0/df/d29/f23 15 1 2024-02-07T12:25:53.631 INFO:tasks.workunit.client.0.smithi047.stdout:7/382: fdatasync d0/df/d29/d31/d40/f49 0 2024-02-07T12:25:53.632 INFO:tasks.workunit.client.0.smithi047.stdout:6/322: mkdir d3/da/d3b/d52/d6b 0 2024-02-07T12:25:53.632 INFO:tasks.workunit.client.0.smithi047.stdout:6/323: chown d3/da/d14/d28/f3e 23056 1 2024-02-07T12:25:53.632 INFO:tasks.workunit.client.0.smithi047.stdout:7/383: symlink d0/d2f/l7c 0 2024-02-07T12:25:53.633 INFO:tasks.workunit.client.0.smithi047.stdout:6/324: creat d3/da/d14/d28/d46/f6c x:0 0 0 2024-02-07T12:25:53.633 INFO:tasks.workunit.client.0.smithi047.stdout:6/325: chown d3/da/d14/d28 2660 1 2024-02-07T12:25:53.633 INFO:tasks.workunit.client.0.smithi047.stdout:7/384: mknod d0/df/d29/d31/d55/c7d 0 2024-02-07T12:25:53.634 INFO:tasks.workunit.client.0.smithi047.stdout:6/326: truncate d3/d5/f27 6438761 0 2024-02-07T12:25:53.645 INFO:tasks.workunit.client.0.smithi047.stdout:7/385: write d0/df/d29/f23 [530731,130050] 0 2024-02-07T12:25:53.646 INFO:tasks.workunit.client.0.smithi047.stdout:7/386: creat d0/d4/f7e x:0 0 0 2024-02-07T12:25:53.647 INFO:tasks.workunit.client.0.smithi047.stdout:7/387: creat d0/df/d29/d31/d55/f7f x:0 0 0 2024-02-07T12:25:53.649 INFO:tasks.workunit.client.0.smithi047.stdout:7/388: unlink d0/df/d29/d31/c3f 0 2024-02-07T12:25:53.649 INFO:tasks.workunit.client.0.smithi047.stdout:7/389: dread - d0/df/d29/d3e/f43 zero size 2024-02-07T12:25:53.659 INFO:tasks.workunit.client.0.smithi047.stdout:6/327: dwrite d3/d5/f5d [0,4194304] 0 2024-02-07T12:25:53.659 INFO:tasks.workunit.client.0.smithi047.stdout:6/328: write d3/d5/d35/f3d [5793278,83132] 0 2024-02-07T12:25:53.663 INFO:tasks.workunit.client.0.smithi047.stdout:6/329: mkdir d3/da/d34/d6d 0 2024-02-07T12:25:53.664 INFO:tasks.workunit.client.0.smithi047.stdout:6/330: mknod d3/da/d3b/d52/c6e 0 2024-02-07T12:25:53.665 INFO:tasks.workunit.client.0.smithi047.stdout:6/331: truncate d3/da/d34/f5a 342323 0 2024-02-07T12:25:53.666 INFO:tasks.workunit.client.0.smithi047.stdout:6/332: getdents d3/d1e 0 2024-02-07T12:25:53.668 INFO:tasks.workunit.client.0.smithi047.stdout:6/333: write d3/da/d34/f41 [388969,86572] 0 2024-02-07T12:25:53.668 INFO:tasks.workunit.client.0.smithi047.stdout:6/334: readlink d3/d5/l50 0 2024-02-07T12:25:53.676 INFO:tasks.workunit.client.0.smithi047.stdout:6/335: write d3/d5/d35/f4f [2224444,18204] 0 2024-02-07T12:25:53.678 INFO:tasks.workunit.client.0.smithi047.stdout:6/336: creat d3/da/f6f x:0 0 0 2024-02-07T12:25:53.679 INFO:tasks.workunit.client.0.smithi047.stdout:6/337: symlink d3/d1e/l70 0 2024-02-07T12:25:53.679 INFO:tasks.workunit.client.0.smithi047.stdout:6/338: fdatasync d3/d5/f5d 0 2024-02-07T12:25:53.679 INFO:tasks.workunit.client.0.smithi047.stdout:6/339: creat d3/da/d34/f71 x:0 0 0 2024-02-07T12:25:53.680 INFO:tasks.workunit.client.0.smithi047.stdout:6/340: truncate d3/d5/f26 8027354 0 2024-02-07T12:25:53.681 INFO:tasks.workunit.client.0.smithi047.stdout:6/341: mkdir d3/d5/d35/d3c/d72 0 2024-02-07T12:25:53.681 INFO:tasks.workunit.client.0.smithi047.stdout:6/342: write d3/da/d14/f36 [140876,112584] 0 2024-02-07T12:25:53.681 INFO:tasks.workunit.client.0.smithi047.stdout:6/343: symlink d3/da/d34/d6d/l73 0 2024-02-07T12:25:53.688 INFO:tasks.workunit.client.0.smithi047.stdout:9/216: sync 2024-02-07T12:25:53.691 INFO:tasks.workunit.client.0.smithi047.stdout:9/217: dread d3/f21 [4194304,4194304] 0 2024-02-07T12:25:53.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:53 smithi138 ceph-mon[35528]: pgmap v13: 65 pgs: 65 active+clean; 1.8 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 122 MiB/s rd, 162 MiB/s wr, 295 op/s 2024-02-07T12:25:53.788 INFO:tasks.workunit.client.0.smithi047.stdout:6/344: unlink d3/da/d2c/l40 0 2024-02-07T12:25:53.792 INFO:tasks.workunit.client.0.smithi047.stdout:9/218: rename d3/d10/f1f to d3/d10/d18/d3d/f46 0 2024-02-07T12:25:53.795 INFO:tasks.workunit.client.0.smithi047.stdout:9/219: mkdir d3/d10/d18/d3b/d3c/d47 0 2024-02-07T12:25:53.797 INFO:tasks.workunit.client.0.smithi047.stdout:6/345: rename d3/d1e/f4e to d3/da/f74 0 2024-02-07T12:25:53.797 INFO:tasks.workunit.client.0.smithi047.stdout:6/346: chown d3/da/l38 87745 1 2024-02-07T12:25:53.798 INFO:tasks.workunit.client.0.smithi047.stdout:6/347: symlink d3/da/d3b/l75 0 2024-02-07T12:25:53.806 INFO:tasks.workunit.client.0.smithi047.stdout:6/348: dread d3/d1e/f21 [4194304,4194304] 0 2024-02-07T12:25:53.807 INFO:tasks.workunit.client.0.smithi047.stdout:6/349: chown d3/da/d3b/f5e 27638246 1 2024-02-07T12:25:53.807 INFO:tasks.workunit.client.0.smithi047.stdout:6/350: chown d3/lb 8372036 1 2024-02-07T12:25:53.807 INFO:tasks.workunit.client.0.smithi047.stdout:6/351: symlink d3/d1e/l76 0 2024-02-07T12:25:53.807 INFO:tasks.workunit.client.0.smithi047.stdout:6/352: dread - d3/da/d3b/f5e zero size 2024-02-07T12:25:53.807 INFO:tasks.workunit.client.0.smithi047.stdout:6/353: symlink d3/da/d2c/l77 0 2024-02-07T12:25:53.810 INFO:tasks.workunit.client.0.smithi047.stdout:9/220: dwrite d3/d10/d18/d3d/f37 [0,4194304] 0 2024-02-07T12:25:53.810 INFO:tasks.workunit.client.0.smithi047.stdout:6/354: fsync d3/da/d34/f41 0 2024-02-07T12:25:53.810 INFO:tasks.workunit.client.0.smithi047.stdout:6/355: read - d3/da/d14/d28/d46/f6c zero size 2024-02-07T12:25:53.811 INFO:tasks.workunit.client.0.smithi047.stdout:6/356: read - d3/da/d3b/f5e zero size 2024-02-07T12:25:53.811 INFO:tasks.workunit.client.0.smithi047.stdout:6/357: chown d3/d5/l50 98 1 2024-02-07T12:25:53.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:53 smithi047 ceph-mon[28972]: pgmap v13: 65 pgs: 65 active+clean; 1.8 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 122 MiB/s rd, 162 MiB/s wr, 295 op/s 2024-02-07T12:25:53.838 INFO:tasks.workunit.client.0.smithi047.stdout:6/358: dwrite d3/d1e/d25/f4a [0,4194304] 0 2024-02-07T12:25:53.838 INFO:tasks.workunit.client.0.smithi047.stdout:9/221: dwrite d3/d10/d11/f42 [0,4194304] 0 2024-02-07T12:25:53.838 INFO:tasks.workunit.client.0.smithi047.stdout:6/359: read - d3/da/d3b/d55/f69 zero size 2024-02-07T12:25:53.838 INFO:tasks.workunit.client.0.smithi047.stdout:9/222: fsync d3/d10/d18/f1a 0 2024-02-07T12:25:53.841 INFO:tasks.workunit.client.0.smithi047.stdout:6/360: dread d3/da/d34/f41 [0,4194304] 0 2024-02-07T12:25:53.841 INFO:tasks.workunit.client.0.smithi047.stdout:9/223: symlink d3/d10/d11/l48 0 2024-02-07T12:25:53.841 INFO:tasks.workunit.client.0.smithi047.stdout:6/361: write d3/da/d3b/d55/f69 [196460,121372] 0 2024-02-07T12:25:53.842 INFO:tasks.workunit.client.0.smithi047.stdout:9/224: rename d3/d10/l39 to d3/d10/d11/l49 0 2024-02-07T12:25:53.844 INFO:tasks.workunit.client.0.smithi047.stdout:9/225: write d3/d10/d18/f1b [940152,47490] 0 2024-02-07T12:25:53.849 INFO:tasks.workunit.client.0.smithi047.stdout:6/362: write d3/da/d2c/d42/f57 [1664546,115491] 0 2024-02-07T12:25:53.849 INFO:tasks.workunit.client.0.smithi047.stdout:6/363: stat d3/da/d14/f1c 0 2024-02-07T12:25:53.849 INFO:tasks.workunit.client.0.smithi047.stdout:6/364: write d3/da/d14/f36 [2079358,42239] 0 2024-02-07T12:25:53.850 INFO:tasks.workunit.client.0.smithi047.stdout:6/365: creat d3/d1e/d25/f78 x:0 0 0 2024-02-07T12:25:53.850 INFO:tasks.workunit.client.0.smithi047.stdout:6/366: creat d3/da/d3b/d52/f79 x:0 0 0 2024-02-07T12:25:53.852 INFO:tasks.workunit.client.0.smithi047.stdout:6/367: symlink d3/da/d34/l7a 0 2024-02-07T12:25:53.852 INFO:tasks.workunit.client.0.smithi047.stdout:6/368: creat d3/da/d2c/d42/f7b x:0 0 0 2024-02-07T12:25:53.852 INFO:tasks.workunit.client.0.smithi047.stdout:6/369: creat d3/da/d2c/f7c x:0 0 0 2024-02-07T12:25:53.852 INFO:tasks.workunit.client.0.smithi047.stdout:6/370: dread - d3/da/d14/d28/d46/f6c zero size 2024-02-07T12:25:53.852 INFO:tasks.workunit.client.0.smithi047.stdout:6/371: stat d3/d5/d35/c4d 0 2024-02-07T12:25:53.854 INFO:tasks.workunit.client.0.smithi047.stdout:6/372: rmdir d3/d5 39 2024-02-07T12:25:53.854 INFO:tasks.workunit.client.0.smithi047.stdout:6/373: chown d3/da/d14/f36 198541 1 2024-02-07T12:25:53.854 INFO:tasks.workunit.client.0.smithi047.stdout:6/374: dread - d3/da/d14/d28/f3e zero size 2024-02-07T12:25:53.855 INFO:tasks.workunit.client.0.smithi047.stdout:6/375: link d3/da/d2c/l77 d3/da/d3b/d52/l7d 0 2024-02-07T12:25:53.856 INFO:tasks.workunit.client.0.smithi047.stdout:6/376: creat d3/da/d3b/f7e x:0 0 0 2024-02-07T12:25:53.857 INFO:tasks.workunit.client.0.smithi047.stdout:6/377: unlink d3/d5/d35/d3c/c61 0 2024-02-07T12:25:53.857 INFO:tasks.workunit.client.0.smithi047.stdout:6/378: symlink d3/da/d2c/d47/l7f 0 2024-02-07T12:25:53.859 INFO:tasks.workunit.client.0.smithi047.stdout:6/379: unlink d3/d5/f7 0 2024-02-07T12:25:53.859 INFO:tasks.workunit.client.0.smithi047.stdout:9/226: dwrite d3/f1d [4194304,4194304] 0 2024-02-07T12:25:53.860 INFO:tasks.workunit.client.0.smithi047.stdout:6/380: mknod d3/da/d14/d28/c80 0 2024-02-07T12:25:53.860 INFO:tasks.workunit.client.0.smithi047.stdout:6/381: write d3/da/d14/f1c [4297390,56960] 0 2024-02-07T12:25:53.863 INFO:tasks.workunit.client.0.smithi047.stdout:6/382: rename d3/da/f37 to d3/da/d3b/d52/f81 0 2024-02-07T12:25:53.865 INFO:tasks.workunit.client.0.smithi047.stdout:6/383: mknod d3/da/d3b/d52/c82 0 2024-02-07T12:25:53.865 INFO:tasks.workunit.client.0.smithi047.stdout:6/384: fdatasync d3/da/d2c/d42/f4c 0 2024-02-07T12:25:53.867 INFO:tasks.workunit.client.0.smithi047.stdout:9/227: dread d3/f21 [0,4194304] 0 2024-02-07T12:25:53.867 INFO:tasks.workunit.client.0.smithi047.stdout:9/228: write d3/d10/d11/f43 [711604,79792] 0 2024-02-07T12:25:53.867 INFO:tasks.workunit.client.0.smithi047.stdout:9/229: creat d3/d10/d18/d3a/f4a x:0 0 0 2024-02-07T12:25:53.867 INFO:tasks.workunit.client.0.smithi047.stdout:9/230: getdents d3/d10/d18/d3b/d3c/d47 0 2024-02-07T12:25:53.868 INFO:tasks.workunit.client.0.smithi047.stdout:6/385: unlink d3/da/f3a 0 2024-02-07T12:25:53.868 INFO:tasks.workunit.client.0.smithi047.stdout:6/386: chown d3/d1e/f21 14254 1 2024-02-07T12:25:53.868 INFO:tasks.workunit.client.0.smithi047.stdout:6/387: chown d3/d1e/d25/l43 16 1 2024-02-07T12:25:53.868 INFO:tasks.workunit.client.0.smithi047.stdout:6/388: fsync d3/da/d14/d28/d46/f6c 0 2024-02-07T12:25:53.871 INFO:tasks.workunit.client.0.smithi047.stdout:6/389: dread d3/d5/f15 [4194304,4194304] 0 2024-02-07T12:25:53.871 INFO:tasks.workunit.client.0.smithi047.stdout:6/390: creat d3/da/f83 x:0 0 0 2024-02-07T12:25:53.871 INFO:tasks.workunit.client.0.smithi047.stdout:6/391: dread - d3/da/d3b/f7e zero size 2024-02-07T12:25:53.871 INFO:tasks.workunit.client.0.smithi047.stdout:6/392: creat d3/da/d14/d28/d46/f84 x:0 0 0 2024-02-07T12:25:53.871 INFO:tasks.workunit.client.0.smithi047.stdout:6/393: creat d3/da/d3b/f85 x:0 0 0 2024-02-07T12:25:53.877 INFO:tasks.workunit.client.0.smithi047.stdout:9/231: read d3/f19 [1496119,8515] 0 2024-02-07T12:25:53.879 INFO:tasks.workunit.client.0.smithi047.stdout:9/232: creat d3/d10/f4b x:0 0 0 2024-02-07T12:25:53.881 INFO:tasks.workunit.client.0.smithi047.stdout:9/233: mkdir d3/d10/d4c 0 2024-02-07T12:25:53.881 INFO:tasks.workunit.client.0.smithi047.stdout:5/385: sync 2024-02-07T12:25:53.881 INFO:tasks.workunit.client.0.smithi047.stdout:5/386: fsync da/d24/f45 0 2024-02-07T12:25:53.881 INFO:tasks.workunit.client.0.smithi047.stdout:5/387: write da/df/d16/d25/d71/f4b [129728,13580] 0 2024-02-07T12:25:53.881 INFO:tasks.workunit.client.0.smithi047.stdout:9/234: creat d3/d10/d4c/f4d x:0 0 0 2024-02-07T12:25:53.882 INFO:tasks.workunit.client.0.smithi047.stdout:5/388: mkdir da/df/d16/d81 0 2024-02-07T12:25:53.883 INFO:tasks.workunit.client.0.smithi047.stdout:5/389: chown da/df/d16/d25/d71/c6f 2172 1 2024-02-07T12:25:53.883 INFO:tasks.workunit.client.0.smithi047.stdout:5/390: chown da/f11 480265419 1 2024-02-07T12:25:53.883 INFO:tasks.workunit.client.0.smithi047.stdout:9/235: creat d3/d10/d18/d3b/d3c/f4e x:0 0 0 2024-02-07T12:25:53.884 INFO:tasks.workunit.client.0.smithi047.stdout:9/236: mkdir d3/d10/d18/d3b/d3c/d47/d4f 0 2024-02-07T12:25:53.885 INFO:tasks.workunit.client.0.smithi047.stdout:9/237: creat d3/d10/d18/d3b/f50 x:0 0 0 2024-02-07T12:25:53.886 INFO:tasks.workunit.client.0.smithi047.stdout:6/394: dwrite d3/da/d2c/f2e [0,4194304] 0 2024-02-07T12:25:53.886 INFO:tasks.workunit.client.0.smithi047.stdout:6/395: read - d3/da/d2c/d42/f7b zero size 2024-02-07T12:25:53.892 INFO:tasks.workunit.client.0.smithi047.stdout:6/396: rename d3/da/d14/d28/d46/f84 to d3/da/f86 0 2024-02-07T12:25:53.892 INFO:tasks.workunit.client.0.smithi047.stdout:6/397: dread - d3/d1e/d25/f78 zero size 2024-02-07T12:25:53.892 INFO:tasks.workunit.client.0.smithi047.stdout:5/391: read da/df/d16/d25/d71/f31 [2951920,50821] 0 2024-02-07T12:25:53.893 INFO:tasks.workunit.client.0.smithi047.stdout:5/392: creat da/df/d16/d25/f82 x:0 0 0 2024-02-07T12:25:53.893 INFO:tasks.workunit.client.0.smithi047.stdout:5/393: read da/f1a [261720,58214] 0 2024-02-07T12:25:53.897 INFO:tasks.workunit.client.0.smithi047.stdout:9/238: dread d3/f1d [4194304,4194304] 0 2024-02-07T12:25:53.899 INFO:tasks.workunit.client.0.smithi047.stdout:5/394: dread da/f11 [0,4194304] 0 2024-02-07T12:25:53.899 INFO:tasks.workunit.client.0.smithi047.stdout:5/395: truncate da/d24/d2b/f5b 5408610 0 2024-02-07T12:25:53.907 INFO:tasks.workunit.client.0.smithi047.stdout:5/396: dread da/df/d16/d25/f36 [0,4194304] 0 2024-02-07T12:25:53.907 INFO:tasks.workunit.client.0.smithi047.stdout:5/397: rmdir da/df/d16/d41/d57 39 2024-02-07T12:25:53.909 INFO:tasks.workunit.client.0.smithi047.stdout:5/398: getdents da/df/d16/d41 0 2024-02-07T12:25:53.909 INFO:tasks.workunit.client.0.smithi047.stdout:5/399: chown da/df/d16/d25/d33/d55/c62 6015402 1 2024-02-07T12:25:53.916 INFO:tasks.workunit.client.0.smithi047.stdout:9/239: dwrite f1 [0,4194304] 0 2024-02-07T12:25:53.917 INFO:tasks.workunit.client.0.smithi047.stdout:9/240: write d3/f1d [1585410,116526] 0 2024-02-07T12:25:53.917 INFO:tasks.workunit.client.0.smithi047.stdout:9/241: dread - d3/f40 zero size 2024-02-07T12:25:53.927 INFO:tasks.workunit.client.0.smithi047.stdout:5/400: dwrite da/d24/f45 [0,4194304] 0 2024-02-07T12:25:53.927 INFO:tasks.workunit.client.0.smithi047.stdout:5/401: fsync da/d24/f2f 0 2024-02-07T12:25:53.927 INFO:tasks.workunit.client.0.smithi047.stdout:5/402: write da/d24/f4a [89562,85976] 0 2024-02-07T12:25:53.927 INFO:tasks.workunit.client.0.smithi047.stdout:5/403: chown da/df/d16/d25/d71/d68 75563 1 2024-02-07T12:25:53.927 INFO:tasks.workunit.client.0.smithi047.stdout:5/404: readlink da/d24/d2b/l40 0 2024-02-07T12:25:53.928 INFO:tasks.workunit.client.0.smithi047.stdout:5/405: rmdir da/df/d16/d25/d33/d55 39 2024-02-07T12:25:53.930 INFO:tasks.workunit.client.0.smithi047.stdout:5/406: mknod da/df/c83 0 2024-02-07T12:25:53.930 INFO:tasks.workunit.client.0.smithi047.stdout:5/407: write da/df/d16/d25/f82 [286759,52746] 0 2024-02-07T12:25:53.930 INFO:tasks.workunit.client.0.smithi047.stdout:5/408: creat da/d24/d2b/f84 x:0 0 0 2024-02-07T12:25:53.930 INFO:tasks.workunit.client.0.smithi047.stdout:5/409: write da/df/d16/d25/d71/f31 [1517538,2742] 0 2024-02-07T12:25:53.930 INFO:tasks.workunit.client.0.smithi047.stdout:5/410: write da/df/d16/f3d [4910064,63714] 0 2024-02-07T12:25:53.931 INFO:tasks.workunit.client.0.smithi047.stdout:5/411: getdents da/df/d16/d25/d33 0 2024-02-07T12:25:53.933 INFO:tasks.workunit.client.0.smithi047.stdout:9/242: dwrite d3/f19 [4194304,4194304] 0 2024-02-07T12:25:53.941 INFO:tasks.workunit.client.0.smithi047.stdout:5/412: write da/df/d16/d25/d33/f52 [1618470,65094] 0 2024-02-07T12:25:53.941 INFO:tasks.workunit.client.0.smithi047.stdout:5/413: write da/df/d16/d25/d33/f52 [408531,82087] 0 2024-02-07T12:25:53.942 INFO:tasks.workunit.client.0.smithi047.stdout:5/414: fdatasync da/d24/d2b/f5b 0 2024-02-07T12:25:53.944 INFO:tasks.workunit.client.0.smithi047.stdout:5/415: mkdir da/d24/d63/d85 0 2024-02-07T12:25:53.945 INFO:tasks.workunit.client.0.smithi047.stdout:5/416: truncate da/df/d16/d25/f2d 333554 0 2024-02-07T12:25:53.945 INFO:tasks.workunit.client.0.smithi047.stdout:5/417: fdatasync da/d24/d2b/f84 0 2024-02-07T12:25:53.946 INFO:tasks.workunit.client.0.smithi047.stdout:5/418: symlink da/df/d16/d41/l86 0 2024-02-07T12:25:53.954 INFO:tasks.workunit.client.0.smithi047.stdout:5/419: write da/df/d16/f53 [3275229,11700] 0 2024-02-07T12:25:53.954 INFO:tasks.workunit.client.0.smithi047.stdout:5/420: chown da/d24/d2b/f84 104144384 1 2024-02-07T12:25:53.961 INFO:tasks.workunit.client.0.smithi047.stdout:5/421: dread da/df/f61 [0,4194304] 0 2024-02-07T12:25:53.961 INFO:tasks.workunit.client.0.smithi047.stdout:5/422: creat da/df/d16/d25/d71/d68/f87 x:0 0 0 2024-02-07T12:25:53.961 INFO:tasks.workunit.client.0.smithi047.stdout:5/423: getdents da/df/d16/d25/d33/d55/d80 0 2024-02-07T12:25:53.974 INFO:tasks.workunit.client.0.smithi047.stdout:5/424: dwrite da/f1a [0,4194304] 0 2024-02-07T12:25:53.986 INFO:tasks.workunit.client.0.smithi047.stdout:5/425: dread da/d24/d63/f65 [0,4194304] 0 2024-02-07T12:25:53.986 INFO:tasks.workunit.client.0.smithi047.stdout:5/426: write da/df/d16/d41/d57/f6a [81390,43651] 0 2024-02-07T12:25:54.002 INFO:tasks.workunit.client.0.smithi047.stdout:5/427: dwrite da/f39 [0,4194304] 0 2024-02-07T12:25:54.002 INFO:tasks.workunit.client.0.smithi047.stdout:5/428: truncate da/df/d16/d25/d71/f4b 922108 0 2024-02-07T12:25:54.002 INFO:tasks.workunit.client.0.smithi047.stdout:5/429: chown da/d24/d63/f65 110114 1 2024-02-07T12:25:54.004 INFO:tasks.workunit.client.0.smithi047.stdout:5/430: fdatasync da/df/d16/d41/d57/f6a 0 2024-02-07T12:25:54.004 INFO:tasks.workunit.client.0.smithi047.stdout:5/431: rename da to da/df/d16/d25/d33/d55/d88 22 2024-02-07T12:25:54.020 INFO:tasks.workunit.client.0.smithi047.stdout:5/432: dwrite da/df/d16/d25/f36 [0,4194304] 0 2024-02-07T12:25:54.022 INFO:tasks.workunit.client.0.smithi047.stdout:5/433: creat da/df/d16/d25/d33/d55/d80/f89 x:0 0 0 2024-02-07T12:25:54.022 INFO:tasks.workunit.client.0.smithi047.stdout:5/434: write da/df/d16/d25/d71/d68/f7e [472888,48890] 0 2024-02-07T12:25:54.022 INFO:tasks.workunit.client.0.smithi047.stdout:5/435: write da/df/d16/d41/d57/f6a [918365,72965] 0 2024-02-07T12:25:54.024 INFO:tasks.workunit.client.0.smithi047.stdout:5/436: rename da/df/d16/l3f to da/df/d16/d81/l8a 0 2024-02-07T12:25:54.027 INFO:tasks.workunit.client.0.smithi047.stdout:5/437: rmdir da/df/d16 39 2024-02-07T12:25:54.033 INFO:tasks.workunit.client.0.smithi047.stdout:0/177: sync 2024-02-07T12:25:54.037 INFO:tasks.workunit.client.0.smithi047.stdout:5/438: dread da/df/d16/d25/f3b [0,4194304] 0 2024-02-07T12:25:54.046 INFO:tasks.workunit.client.0.smithi047.stdout:5/439: dread da/d24/f45 [0,4194304] 0 2024-02-07T12:25:54.047 INFO:tasks.workunit.client.0.smithi047.stdout:0/178: dwrite d19/d1c/f30 [0,4194304] 0 2024-02-07T12:25:54.047 INFO:tasks.workunit.client.0.smithi047.stdout:0/179: read - d19/f27 zero size 2024-02-07T12:25:54.047 INFO:tasks.workunit.client.0.smithi047.stdout:0/180: fsync f14 0 2024-02-07T12:25:54.049 INFO:tasks.workunit.client.0.smithi047.stdout:5/440: dread da/df/d16/d25/f2d [0,4194304] 0 2024-02-07T12:25:54.049 INFO:tasks.workunit.client.0.smithi047.stdout:5/441: chown da/d24/d2b 917 1 2024-02-07T12:25:54.049 INFO:tasks.workunit.client.0.smithi047.stdout:5/442: chown da/df/d16/d41/d57/d6c/c7f 21020858 1 2024-02-07T12:25:54.077 INFO:tasks.workunit.client.0.smithi047.stdout:5/443: dwrite da/d24/f45 [4194304,4194304] 0 2024-02-07T12:25:54.077 INFO:tasks.workunit.client.0.smithi047.stdout:5/444: chown da/df 31629125 1 2024-02-07T12:25:54.077 INFO:tasks.workunit.client.0.smithi047.stdout:5/445: dread - da/df/d16/d25/d33/d55/d80/f89 zero size 2024-02-07T12:25:54.077 INFO:tasks.workunit.client.0.smithi047.stdout:5/446: chown da/d24/d2b/c54 106921 1 2024-02-07T12:25:54.077 INFO:tasks.workunit.client.0.smithi047.stdout:5/447: readlink da/df/d16/d41/d57/l79 0 2024-02-07T12:25:54.078 INFO:tasks.workunit.client.0.smithi047.stdout:0/181: dwrite f17 [4194304,4194304] 0 2024-02-07T12:25:54.085 INFO:tasks.workunit.client.0.smithi047.stdout:5/448: dread da/df/d16/d25/f3b [0,4194304] 0 2024-02-07T12:25:54.085 INFO:tasks.workunit.client.0.smithi047.stdout:5/449: fdatasync da/df/d16/d41/f42 0 2024-02-07T12:25:54.086 INFO:tasks.workunit.client.0.smithi047.stdout:0/182: write fc [3602783,21602] 0 2024-02-07T12:25:54.086 INFO:tasks.workunit.client.0.smithi047.stdout:5/450: symlink da/df/d16/d41/l8b 0 2024-02-07T12:25:54.087 INFO:tasks.workunit.client.0.smithi047.stdout:0/183: truncate d19/d1c/f30 1136109 0 2024-02-07T12:25:54.089 INFO:tasks.workunit.client.0.smithi047.stdout:5/451: mkdir da/df/d16/d25/d71/d8c 0 2024-02-07T12:25:54.089 INFO:tasks.workunit.client.0.smithi047.stdout:5/452: rename da to da/df/d16/d25/d33/d6e/d8d 22 2024-02-07T12:25:54.090 INFO:tasks.workunit.client.0.smithi047.stdout:5/453: symlink da/df/d16/d25/d33/l8e 0 2024-02-07T12:25:54.092 INFO:tasks.workunit.client.0.smithi047.stdout:5/454: link da/df/d16/d41/d57/c5e da/d24/d63/c8f 0 2024-02-07T12:25:54.093 INFO:tasks.workunit.client.0.smithi047.stdout:5/455: symlink da/l90 0 2024-02-07T12:25:54.111 INFO:tasks.workunit.client.0.smithi047.stdout:0/184: dwrite fa [0,4194304] 0 2024-02-07T12:25:54.114 INFO:tasks.workunit.client.0.smithi047.stdout:5/456: write da/df/d16/d25/f2d [431080,113012] 0 2024-02-07T12:25:54.114 INFO:tasks.workunit.client.0.smithi047.stdout:5/457: dread - da/df/d16/d25/d33/d55/d80/f89 zero size 2024-02-07T12:25:54.114 INFO:tasks.workunit.client.0.smithi047.stdout:5/458: write da/f11 [329428,35337] 0 2024-02-07T12:25:54.115 INFO:tasks.workunit.client.0.smithi047.stdout:5/459: mkdir da/df/d16/d25/d33/d91 0 2024-02-07T12:25:54.115 INFO:tasks.workunit.client.0.smithi047.stdout:5/460: write da/df/f28 [3231495,56706] 0 2024-02-07T12:25:54.115 INFO:tasks.workunit.client.0.smithi047.stdout:5/461: fdatasync da/df/d16/f74 0 2024-02-07T12:25:54.115 INFO:tasks.workunit.client.0.smithi047.stdout:5/462: chown da/df/d16/d25/d33/d55/d80/f89 38303 1 2024-02-07T12:25:54.116 INFO:tasks.workunit.client.0.smithi047.stdout:5/463: readlink da/df/d16/d25/l60 0 2024-02-07T12:25:54.118 INFO:tasks.workunit.client.0.smithi047.stdout:5/464: creat da/df/d16/d25/d33/d55/f92 x:0 0 0 2024-02-07T12:25:54.121 INFO:tasks.workunit.client.0.smithi047.stdout:5/465: dread da/df/d16/d25/f82 [0,4194304] 0 2024-02-07T12:25:54.124 INFO:tasks.workunit.client.0.smithi047.stdout:5/466: symlink da/df/d16/d25/d33/l93 0 2024-02-07T12:25:54.124 INFO:tasks.workunit.client.0.smithi047.stdout:5/467: fdatasync da/f1a 0 2024-02-07T12:25:54.124 INFO:tasks.workunit.client.0.smithi047.stdout:5/468: truncate da/df/f38 967085 0 2024-02-07T12:25:54.124 INFO:tasks.workunit.client.0.smithi047.stdout:5/469: fsync da/df/d16/d25/d33/f35 0 2024-02-07T12:25:54.124 INFO:tasks.workunit.client.0.smithi047.stdout:5/470: stat da/df/d16/d41/d57/c59 0 2024-02-07T12:25:54.124 INFO:tasks.workunit.client.0.smithi047.stdout:5/471: fdatasync da/df/d16/d25/f36 0 2024-02-07T12:25:54.124 INFO:tasks.workunit.client.0.smithi047.stdout:5/472: dread - da/d24/d2b/f76 zero size 2024-02-07T12:25:54.125 INFO:tasks.workunit.client.0.smithi047.stdout:5/473: creat da/df/f94 x:0 0 0 2024-02-07T12:25:54.127 INFO:tasks.workunit.client.0.smithi047.stdout:5/474: rename da/f15 to da/df/d16/d25/d71/d8c/f95 0 2024-02-07T12:25:54.127 INFO:tasks.workunit.client.0.smithi047.stdout:5/475: chown da/df/c83 39 1 2024-02-07T12:25:54.137 INFO:tasks.workunit.client.0.smithi047.stdout:5/476: dread da/df/f61 [0,4194304] 0 2024-02-07T12:25:54.138 INFO:tasks.workunit.client.0.smithi047.stdout:5/477: chown da/ce 32413 1 2024-02-07T12:25:54.139 INFO:tasks.workunit.client.0.smithi047.stdout:0/185: dwrite fc [0,4194304] 0 2024-02-07T12:25:54.139 INFO:tasks.workunit.client.0.smithi047.stdout:0/186: write fa [4861361,84697] 0 2024-02-07T12:25:54.139 INFO:tasks.workunit.client.0.smithi047.stdout:0/187: readlink l8 0 2024-02-07T12:25:54.140 INFO:tasks.workunit.client.0.smithi047.stdout:5/478: creat da/df/d16/d25/f96 x:0 0 0 2024-02-07T12:25:54.140 INFO:tasks.workunit.client.0.smithi047.stdout:0/188: creat d19/d1c/f31 x:0 0 0 2024-02-07T12:25:54.141 INFO:tasks.workunit.client.0.smithi047.stdout:0/189: mknod d19/c32 0 2024-02-07T12:25:54.156 INFO:tasks.workunit.client.0.smithi047.stdout:0/190: dread f14 [0,4194304] 0 2024-02-07T12:25:54.163 INFO:tasks.workunit.client.0.smithi047.stdout:5/479: dwrite da/d24/d2b/f84 [0,4194304] 0 2024-02-07T12:25:54.169 INFO:tasks.workunit.client.0.smithi047.stdout:5/480: symlink da/l97 0 2024-02-07T12:25:54.169 INFO:tasks.workunit.client.0.smithi047.stdout:5/481: fsync da/df/f61 0 2024-02-07T12:25:54.171 INFO:tasks.workunit.client.0.smithi047.stdout:5/482: unlink da/df/d16/d25/d71/c6f 0 2024-02-07T12:25:54.171 INFO:tasks.workunit.client.0.smithi047.stdout:5/483: creat da/df/f98 x:0 0 0 2024-02-07T12:25:54.171 INFO:tasks.workunit.client.0.smithi047.stdout:0/191: fsync d19/d1c/f31 0 2024-02-07T12:25:54.173 INFO:tasks.workunit.client.0.smithi047.stdout:5/484: creat da/df/d16/d81/f99 x:0 0 0 2024-02-07T12:25:54.174 INFO:tasks.workunit.client.0.smithi047.stdout:5/485: dread - da/df/f94 zero size 2024-02-07T12:25:54.175 INFO:tasks.workunit.client.0.smithi047.stdout:0/192: rename d19/d1c/f1f to d19/d1c/d2b/f33 0 2024-02-07T12:25:54.176 INFO:tasks.workunit.client.0.smithi047.stdout:0/193: rmdir d19/d1c/d2b 39 2024-02-07T12:25:54.190 INFO:tasks.workunit.client.0.smithi047.stdout:0/194: write f1 [2419561,8386] 0 2024-02-07T12:25:54.194 INFO:tasks.workunit.client.0.smithi047.stdout:5/486: dwrite da/f11 [0,4194304] 0 2024-02-07T12:25:54.201 INFO:tasks.workunit.client.0.smithi047.stdout:5/487: rename da/d24/d2b to da/d24/d63/d9a 0 2024-02-07T12:25:54.201 INFO:tasks.workunit.client.0.smithi047.stdout:5/488: write da/df/d16/d25/f2a [4345915,127524] 0 2024-02-07T12:25:54.203 INFO:tasks.workunit.client.0.smithi047.stdout:5/489: unlink da/df/d16/d25/d33/f52 0 2024-02-07T12:25:54.244 INFO:tasks.workunit.client.0.smithi047.stdout:5/490: creat da/df/d16/d25/d71/d68/f9b x:0 0 0 2024-02-07T12:25:54.264 INFO:tasks.workunit.client.0.smithi047.stdout:5/491: dwrite da/df/f98 [0,4194304] 0 2024-02-07T12:25:54.265 INFO:tasks.workunit.client.0.smithi047.stdout:5/492: stat da/df/l21 0 2024-02-07T12:25:54.266 INFO:tasks.workunit.client.0.smithi047.stdout:5/493: mkdir da/d24/d63/d9c 0 2024-02-07T12:25:54.267 INFO:tasks.workunit.client.0.smithi047.stdout:5/494: mkdir da/d24/d63/d85/d9d 0 2024-02-07T12:25:54.268 INFO:tasks.workunit.client.0.smithi047.stdout:5/495: rename da/c4d to da/df/c9e 0 2024-02-07T12:25:54.271 INFO:tasks.workunit.client.0.smithi047.stdout:5/496: rmdir da/df/d16/d25/d33 39 2024-02-07T12:25:54.272 INFO:tasks.workunit.client.0.smithi047.stdout:5/497: rename da/d24/d63/d9a/f76 to da/df/d16/d25/d71/f9f 0 2024-02-07T12:25:54.291 INFO:tasks.workunit.client.0.smithi047.stdout:5/498: dwrite da/fd [0,4194304] 0 2024-02-07T12:25:54.291 INFO:tasks.workunit.client.0.smithi047.stdout:5/499: creat da/df/d16/d25/d71/d68/fa0 x:0 0 0 2024-02-07T12:25:54.291 INFO:tasks.workunit.client.0.smithi047.stdout:5/500: write da/df/d16/d25/d33/f77 [468162,51310] 0 2024-02-07T12:25:54.291 INFO:tasks.workunit.client.0.smithi047.stdout:5/501: getdents da/df/d16/d25/d33/d6e 0 2024-02-07T12:25:54.291 INFO:tasks.workunit.client.0.smithi047.stdout:5/502: write da/df/d16/d25/d33/f3c [1637050,115196] 0 2024-02-07T12:25:54.291 INFO:tasks.workunit.client.0.smithi047.stdout:5/503: truncate da/df/d16/d41/f42 4931888 0 2024-02-07T12:25:54.297 INFO:tasks.workunit.client.0.smithi047.stdout:5/504: write da/d24/d63/f65 [1436031,32378] 0 2024-02-07T12:25:54.299 INFO:tasks.workunit.client.0.smithi047.stdout:5/505: link da/d24/d63/d9a/c7b da/df/d16/d25/ca1 0 2024-02-07T12:25:54.300 INFO:tasks.workunit.client.0.smithi047.stdout:5/506: mknod da/df/d16/d25/d33/d55/d7c/ca2 0 2024-02-07T12:25:54.301 INFO:tasks.workunit.client.0.smithi047.stdout:5/507: mkdir da/d24/d63/d9c/da3 0 2024-02-07T12:25:54.301 INFO:tasks.workunit.client.0.smithi047.stdout:5/508: getdents da/d24/d63/d85/d9d 0 2024-02-07T12:25:54.315 INFO:tasks.workunit.client.0.smithi047.stdout:5/509: dwrite da/df/f94 [0,4194304] 0 2024-02-07T12:25:54.317 INFO:tasks.workunit.client.0.smithi047.stdout:5/510: symlink da/df/d16/d41/d57/d6c/la4 0 2024-02-07T12:25:54.318 INFO:tasks.workunit.client.0.smithi047.stdout:5/511: stat da/df/d16 0 2024-02-07T12:25:54.377 INFO:tasks.workunit.client.0.smithi047.stdout:3/489: sync 2024-02-07T12:25:54.377 INFO:tasks.workunit.client.0.smithi047.stdout:2/389: sync 2024-02-07T12:25:54.380 INFO:tasks.workunit.client.0.smithi047.stdout:2/390: dread d7/dc/f35 [0,4194304] 0 2024-02-07T12:25:54.380 INFO:tasks.workunit.client.0.smithi047.stdout:2/391: stat d7/d48/f6e 0 2024-02-07T12:25:54.380 INFO:tasks.workunit.client.0.smithi047.stdout:2/392: creat d7/d2d/d5c/f70 x:0 0 0 2024-02-07T12:25:54.380 INFO:tasks.workunit.client.0.smithi047.stdout:2/393: fdatasync d7/dc/d4c/f5e 0 2024-02-07T12:25:54.381 INFO:tasks.workunit.client.0.smithi047.stdout:2/394: mkdir d7/dc/d71 0 2024-02-07T12:25:54.381 INFO:tasks.workunit.client.0.smithi047.stdout:2/395: dread - d7/d2d/f2f zero size 2024-02-07T12:25:54.381 INFO:tasks.workunit.client.0.smithi047.stdout:2/396: fdatasync d7/f38 0 2024-02-07T12:25:54.381 INFO:tasks.workunit.client.0.smithi047.stdout:2/397: dread - d7/dc/d51/f60 zero size 2024-02-07T12:25:54.382 INFO:tasks.workunit.client.0.smithi047.stdout:2/398: mkdir d7/d48/d72 0 2024-02-07T12:25:54.382 INFO:tasks.workunit.client.0.smithi047.stdout:2/399: truncate d7/f1e 7382299 0 2024-02-07T12:25:54.382 INFO:tasks.workunit.client.0.smithi047.stdout:2/400: truncate d7/f30 783491 0 2024-02-07T12:25:54.382 INFO:tasks.workunit.client.0.smithi047.stdout:2/401: write d7/f30 [1745440,57918] 0 2024-02-07T12:25:54.386 INFO:tasks.workunit.client.0.smithi047.stdout:3/490: dread d12/d19/d21/d29/d31/d38/d59/f5f [0,4194304] 0 2024-02-07T12:25:54.388 INFO:tasks.workunit.client.0.smithi047.stdout:3/491: truncate d12/f99 725108 0 2024-02-07T12:25:54.388 INFO:tasks.workunit.client.0.smithi047.stdout:3/492: chown d12/d19/d21/d29/f81 127 1 2024-02-07T12:25:54.390 INFO:tasks.workunit.client.0.smithi047.stdout:3/493: unlink d12/d19/d21/d29/d31/d61/f8e 0 2024-02-07T12:25:54.394 INFO:tasks.workunit.client.0.smithi047.stdout:3/494: symlink d12/d19/d21/d29/d31/d7c/la6 0 2024-02-07T12:25:54.398 INFO:tasks.workunit.client.0.smithi047.stdout:2/402: dread f2 [4194304,4194304] 0 2024-02-07T12:25:54.398 INFO:tasks.workunit.client.0.smithi047.stdout:2/403: unlink d7/d2d/c46 0 2024-02-07T12:25:54.399 INFO:tasks.workunit.client.0.smithi047.stdout:2/404: symlink d7/d2d/d5c/l73 0 2024-02-07T12:25:54.399 INFO:tasks.workunit.client.0.smithi047.stdout:2/405: chown d7/d2d/d5c/f70 43586 1 2024-02-07T12:25:54.400 INFO:tasks.workunit.client.0.smithi047.stdout:2/406: symlink d7/d48/l74 0 2024-02-07T12:25:54.402 INFO:tasks.workunit.client.0.smithi047.stdout:2/407: creat d7/dc/f75 x:0 0 0 2024-02-07T12:25:54.402 INFO:tasks.workunit.client.0.smithi047.stdout:2/408: write f2 [2785744,14172] 0 2024-02-07T12:25:54.412 INFO:tasks.workunit.client.0.smithi047.stdout:3/495: dwrite d12/d19/d21/d90/f91 [0,4194304] 0 2024-02-07T12:25:54.412 INFO:tasks.workunit.client.0.smithi047.stdout:2/409: dread d7/dc/d4c/f5e [0,4194304] 0 2024-02-07T12:25:54.412 INFO:tasks.workunit.client.0.smithi047.stdout:3/496: stat d12/d19/d21/f2c 0 2024-02-07T12:25:54.412 INFO:tasks.workunit.client.0.smithi047.stdout:3/497: getdents d12/d19/d21/d29/d31 0 2024-02-07T12:25:54.412 INFO:tasks.workunit.client.0.smithi047.stdout:3/498: chown d12/d19/d46/c4b 209442897 1 2024-02-07T12:25:54.412 INFO:tasks.workunit.client.0.smithi047.stdout:2/410: write d7/dc/d4c/f58 [2302375,70039] 0 2024-02-07T12:25:54.412 INFO:tasks.workunit.client.0.smithi047.stdout:2/411: fsync d7/f3b 0 2024-02-07T12:25:54.412 INFO:tasks.workunit.client.0.smithi047.stdout:2/412: dread - d7/d2d/d5c/f70 zero size 2024-02-07T12:25:54.412 INFO:tasks.workunit.client.0.smithi047.stdout:3/499: creat d12/d19/d2d/d52/fa7 x:0 0 0 2024-02-07T12:25:54.413 INFO:tasks.workunit.client.0.smithi047.stdout:3/500: fdatasync d12/d19/d21/d29/d31/f32 0 2024-02-07T12:25:54.418 INFO:tasks.workunit.client.0.smithi047.stdout:2/413: rename d7/dc/f10 to d7/dc/f76 0 2024-02-07T12:25:54.418 INFO:tasks.workunit.client.0.smithi047.stdout:2/414: fdatasync d7/f3b 0 2024-02-07T12:25:54.425 INFO:tasks.workunit.client.0.smithi047.stdout:3/501: dwrite d12/f99 [0,4194304] 0 2024-02-07T12:25:54.426 INFO:tasks.workunit.client.0.smithi047.stdout:3/502: mknod d12/d19/d46/d95/ca8 0 2024-02-07T12:25:54.426 INFO:tasks.workunit.client.0.smithi047.stdout:3/503: chown d12/d19/d2d/d42/l84 0 1 2024-02-07T12:25:54.434 INFO:tasks.workunit.client.0.smithi047.stdout:2/415: dwrite d7/dc/f31 [0,4194304] 0 2024-02-07T12:25:54.434 INFO:tasks.workunit.client.0.smithi047.stdout:2/416: chown d7/d2d/d5c/c64 3327 1 2024-02-07T12:25:54.436 INFO:tasks.workunit.client.0.smithi047.stdout:2/417: mkdir d7/d2d/d5c/d77 0 2024-02-07T12:25:54.437 INFO:tasks.workunit.client.0.smithi047.stdout:2/418: mkdir d7/d2d/d5c/d77/d78 0 2024-02-07T12:25:54.438 INFO:tasks.workunit.client.0.smithi047.stdout:2/419: mkdir d7/d48/d79 0 2024-02-07T12:25:54.438 INFO:tasks.workunit.client.0.smithi047.stdout:2/420: chown d7/d2d/d5c/f70 251 1 2024-02-07T12:25:54.440 INFO:tasks.workunit.client.0.smithi047.stdout:2/421: rmdir d7/d2d/d5c/d77/d78 0 2024-02-07T12:25:54.440 INFO:tasks.workunit.client.0.smithi047.stdout:2/422: chown d7/d48/f6e 250 1 2024-02-07T12:25:54.440 INFO:tasks.workunit.client.0.smithi047.stdout:2/423: write d7/d2d/f53 [1185602,56607] 0 2024-02-07T12:25:54.441 INFO:tasks.workunit.client.0.smithi047.stdout:3/504: dwrite d12/d19/d21/d29/f2f [0,4194304] 0 2024-02-07T12:25:54.441 INFO:tasks.workunit.client.0.smithi047.stdout:3/505: write d12/d19/d21/d29/fa4 [9673,4989] 0 2024-02-07T12:25:54.441 INFO:tasks.workunit.client.0.smithi047.stdout:2/424: stat d7/dc/f59 0 2024-02-07T12:25:54.441 INFO:tasks.workunit.client.0.smithi047.stdout:2/425: write d7/d2d/f63 [651999,114976] 0 2024-02-07T12:25:54.441 INFO:tasks.workunit.client.0.smithi047.stdout:2/426: dread - d7/f39 zero size 2024-02-07T12:25:54.443 INFO:tasks.workunit.client.0.smithi047.stdout:3/506: mkdir d12/d19/d21/d29/da9 0 2024-02-07T12:25:54.443 INFO:tasks.workunit.client.0.smithi047.stdout:3/507: creat d12/d19/faa x:0 0 0 2024-02-07T12:25:54.467 INFO:tasks.workunit.client.0.smithi047.stdout:2/427: dwrite d7/dc/f2b [0,4194304] 0 2024-02-07T12:25:54.468 INFO:tasks.workunit.client.0.smithi047.stdout:3/508: dwrite d12/d19/d2d/d82/f85 [0,4194304] 0 2024-02-07T12:25:54.468 INFO:tasks.workunit.client.0.smithi047.stdout:2/428: creat d7/dc/d4c/f7a x:0 0 0 2024-02-07T12:25:54.468 INFO:tasks.workunit.client.0.smithi047.stdout:2/429: creat d7/dc/d4c/f7b x:0 0 0 2024-02-07T12:25:54.472 INFO:tasks.workunit.client.0.smithi047.stdout:2/430: mkdir d7/d2d/d7c 0 2024-02-07T12:25:54.476 INFO:tasks.workunit.client.0.smithi047.stdout:3/509: dread d12/d19/d21/d29/d31/f8a [0,4194304] 0 2024-02-07T12:25:54.476 INFO:tasks.workunit.client.0.smithi047.stdout:3/510: write d12/d19/f28 [2542377,116780] 0 2024-02-07T12:25:54.476 INFO:tasks.workunit.client.0.smithi047.stdout:3/511: getdents d12/d19/d21/d29/d6f/d93 0 2024-02-07T12:25:54.476 INFO:tasks.workunit.client.0.smithi047.stdout:3/512: chown d12/d19/d2d/f63 3584 1 2024-02-07T12:25:54.478 INFO:tasks.workunit.client.0.smithi047.stdout:2/431: rename d7/dc/l1b to d7/d2d/d5c/l7d 0 2024-02-07T12:25:54.479 INFO:tasks.workunit.client.0.smithi047.stdout:3/513: link d12/d19/d21/f2c d12/d19/d21/d29/d31/d7c/fab 0 2024-02-07T12:25:54.483 INFO:tasks.workunit.client.0.smithi047.stdout:3/514: mkdir d12/d19/d21/d29/d6f/d93/dac 0 2024-02-07T12:25:54.483 INFO:tasks.workunit.client.0.smithi047.stdout:2/432: dread d7/d2d/f43 [0,4194304] 0 2024-02-07T12:25:54.484 INFO:tasks.workunit.client.0.smithi047.stdout:2/433: creat d7/d48/f7e x:0 0 0 2024-02-07T12:25:54.492 INFO:tasks.workunit.client.0.smithi047.stdout:2/434: dread d7/dc/f2b [0,4194304] 0 2024-02-07T12:25:54.494 INFO:tasks.workunit.client.0.smithi047.stdout:2/435: getdents d7 0 2024-02-07T12:25:54.495 INFO:tasks.workunit.client.0.smithi047.stdout:2/436: creat d7/d2d/d7c/f7f x:0 0 0 2024-02-07T12:25:54.497 INFO:tasks.workunit.client.0.smithi047.stdout:2/437: unlink d7/dc/ce 0 2024-02-07T12:25:54.497 INFO:tasks.workunit.client.0.smithi047.stdout:2/438: creat d7/d2d/d5c/f80 x:0 0 0 2024-02-07T12:25:54.497 INFO:tasks.workunit.client.0.smithi047.stdout:2/439: truncate d7/d2d/f6d 448075 0 2024-02-07T12:25:54.498 INFO:tasks.workunit.client.0.smithi047.stdout:2/440: write d7/f38 [961510,103834] 0 2024-02-07T12:25:54.498 INFO:tasks.workunit.client.0.smithi047.stdout:2/441: stat d7/d48/f7e 0 2024-02-07T12:25:54.498 INFO:tasks.workunit.client.0.smithi047.stdout:2/442: truncate d7/d2d/d5c/f70 974961 0 2024-02-07T12:25:54.498 INFO:tasks.workunit.client.0.smithi047.stdout:2/443: getdents d7/dc/d71 0 2024-02-07T12:25:54.498 INFO:tasks.workunit.client.0.smithi047.stdout:2/444: symlink d7/d2d/l81 0 2024-02-07T12:25:54.498 INFO:tasks.workunit.client.0.smithi047.stdout:2/445: creat d7/d2d/d7c/f82 x:0 0 0 2024-02-07T12:25:54.504 INFO:tasks.workunit.client.0.smithi047.stdout:3/515: dwrite d12/d19/d2d/d42/f56 [0,4194304] 0 2024-02-07T12:25:54.505 INFO:tasks.workunit.client.0.smithi047.stdout:3/516: mkdir d12/d19/d21/d90/dad 0 2024-02-07T12:25:54.506 INFO:tasks.workunit.client.0.smithi047.stdout:2/446: dread d7/f12 [4194304,4194304] 0 2024-02-07T12:25:54.506 INFO:tasks.workunit.client.0.smithi047.stdout:3/517: truncate d12/f14 3833310 0 2024-02-07T12:25:54.507 INFO:tasks.workunit.client.0.smithi047.stdout:2/447: mknod d7/d2d/d5c/d77/c83 0 2024-02-07T12:25:54.509 INFO:tasks.workunit.client.0.smithi047.stdout:3/518: unlink d12/d19/d21/d29/d31/d38/d59/la0 0 2024-02-07T12:25:54.509 INFO:tasks.workunit.client.0.smithi047.stdout:3/519: readlink d12/d19/d21/l43 0 2024-02-07T12:25:54.509 INFO:tasks.workunit.client.0.smithi047.stdout:3/520: dread - d12/d19/d46/f9c zero size 2024-02-07T12:25:54.511 INFO:tasks.workunit.client.0.smithi047.stdout:2/448: rmdir d7/d48 39 2024-02-07T12:25:54.519 INFO:tasks.workunit.client.0.smithi047.stdout:2/449: getdents d7/d2d/d5c/d77 0 2024-02-07T12:25:54.519 INFO:tasks.workunit.client.0.smithi047.stdout:2/450: chown d7/dc/d4c/f50 100 1 2024-02-07T12:25:54.519 INFO:tasks.workunit.client.0.smithi047.stdout:2/451: creat d7/dc/f84 x:0 0 0 2024-02-07T12:25:54.519 INFO:tasks.workunit.client.0.smithi047.stdout:2/452: readlink d7/l5a 0 2024-02-07T12:25:54.519 INFO:tasks.workunit.client.0.smithi047.stdout:2/453: stat d7/dc/d4c/f5e 0 2024-02-07T12:25:54.519 INFO:tasks.workunit.client.0.smithi047.stdout:2/454: chown d7/d48 0 1 2024-02-07T12:25:54.522 INFO:tasks.workunit.client.0.smithi047.stdout:2/455: creat d7/d2d/d5c/d77/f85 x:0 0 0 2024-02-07T12:25:54.523 INFO:tasks.workunit.client.0.smithi047.stdout:2/456: mknod d7/dc/d71/c86 0 2024-02-07T12:25:54.524 INFO:tasks.workunit.client.0.smithi047.stdout:2/457: creat d7/dc/d71/f87 x:0 0 0 2024-02-07T12:25:54.525 INFO:tasks.workunit.client.0.smithi047.stdout:3/521: dwrite d12/d19/d2d/d52/f9e [0,4194304] 0 2024-02-07T12:25:54.525 INFO:tasks.workunit.client.0.smithi047.stdout:3/522: dread - d12/d19/d21/d29/d31/d61/f83 zero size 2024-02-07T12:25:54.525 INFO:tasks.workunit.client.0.smithi047.stdout:3/523: creat d12/d19/d46/fae x:0 0 0 2024-02-07T12:25:54.525 INFO:tasks.workunit.client.0.smithi047.stdout:3/524: getdents d12/d19/d21/d29/da9 0 2024-02-07T12:25:54.526 INFO:tasks.workunit.client.0.smithi047.stdout:2/458: creat d7/f88 x:0 0 0 2024-02-07T12:25:54.526 INFO:tasks.workunit.client.0.smithi047.stdout:2/459: write d7/f39 [155390,24727] 0 2024-02-07T12:25:54.528 INFO:tasks.workunit.client.0.smithi047.stdout:2/460: rename d7/d48/l67 to d7/d2d/d7c/l89 0 2024-02-07T12:25:54.528 INFO:tasks.workunit.client.0.smithi047.stdout:2/461: dread - d7/dc/d4c/f7a zero size 2024-02-07T12:25:54.529 INFO:tasks.workunit.client.0.smithi047.stdout:2/462: truncate d7/f28 630267 0 2024-02-07T12:25:54.530 INFO:tasks.workunit.client.0.smithi047.stdout:2/463: read - d7/dc/d4c/f50 zero size 2024-02-07T12:25:54.532 INFO:tasks.workunit.client.0.smithi047.stdout:2/464: mkdir d7/dc/d8a 0 2024-02-07T12:25:54.532 INFO:tasks.workunit.client.0.smithi047.stdout:2/465: creat d7/d2d/d5c/f8b x:0 0 0 2024-02-07T12:25:54.532 INFO:tasks.workunit.client.0.smithi047.stdout:2/466: write d7/d48/f7e [771900,60307] 0 2024-02-07T12:25:54.532 INFO:tasks.workunit.client.0.smithi047.stdout:2/467: dread - d7/d2d/d5c/f80 zero size 2024-02-07T12:25:54.535 INFO:tasks.workunit.client.0.smithi047.stdout:2/468: symlink d7/dc/l8c 0 2024-02-07T12:25:54.536 INFO:tasks.workunit.client.0.smithi047.stdout:3/525: write d12/d19/d2d/f4e [937153,125014] 0 2024-02-07T12:25:54.536 INFO:tasks.workunit.client.0.smithi047.stdout:2/469: truncate d7/f12 4486238 0 2024-02-07T12:25:54.536 INFO:tasks.workunit.client.0.smithi047.stdout:2/470: write d7/dc/d4c/f50 [137095,55442] 0 2024-02-07T12:25:54.538 INFO:tasks.workunit.client.0.smithi047.stdout:3/526: rename d12/d19/d46/d95/c96 to d12/d19/d21/d90/dad/caf 0 2024-02-07T12:25:54.538 INFO:tasks.workunit.client.0.smithi047.stdout:2/471: symlink d7/dc/l8d 0 2024-02-07T12:25:54.550 INFO:tasks.workunit.client.0.smithi047.stdout:3/527: write d12/d19/d2d/d42/f55 [2622646,21810] 0 2024-02-07T12:25:54.550 INFO:tasks.workunit.client.0.smithi047.stdout:3/528: chown d12/d19/l62 33412137 1 2024-02-07T12:25:54.552 INFO:tasks.workunit.client.0.smithi047.stdout:3/529: link d12/d19/d2d/d33/c7d d12/d19/d2d/d42/d6b/cb0 0 2024-02-07T12:25:54.553 INFO:tasks.workunit.client.0.smithi047.stdout:2/472: dwrite d7/dc/f44 [0,4194304] 0 2024-02-07T12:25:54.561 INFO:tasks.workunit.client.0.smithi047.stdout:2/473: truncate d7/d2d/d5c/f70 804752 0 2024-02-07T12:25:54.562 INFO:tasks.workunit.client.0.smithi047.stdout:7/390: sync 2024-02-07T12:25:54.562 INFO:tasks.workunit.client.0.smithi047.stdout:9/243: sync 2024-02-07T12:25:54.562 INFO:tasks.workunit.client.0.smithi047.stdout:6/398: sync 2024-02-07T12:25:54.562 INFO:tasks.workunit.client.0.smithi047.stdout:8/522: sync 2024-02-07T12:25:54.562 INFO:tasks.workunit.client.0.smithi047.stdout:9/244: chown d3/d10/d18/d3b/d3c/d47 30 1 2024-02-07T12:25:54.563 INFO:tasks.workunit.client.0.smithi047.stdout:8/523: chown d3/d4/f18 17 1 2024-02-07T12:25:54.563 INFO:tasks.workunit.client.0.smithi047.stdout:9/245: read - d3/f40 zero size 2024-02-07T12:25:54.563 INFO:tasks.workunit.client.0.smithi047.stdout:8/524: write d3/d66/d67/d6a/f69 [262235,17541] 0 2024-02-07T12:25:54.563 INFO:tasks.workunit.client.0.smithi047.stdout:9/246: creat d3/f51 x:0 0 0 2024-02-07T12:25:54.563 INFO:tasks.workunit.client.0.smithi047.stdout:1/297: sync 2024-02-07T12:25:54.563 INFO:tasks.workunit.client.0.smithi047.stdout:1/298: creat d1/d15/d18/d40/f62 x:0 0 0 2024-02-07T12:25:54.563 INFO:tasks.workunit.client.0.smithi047.stdout:4/471: sync 2024-02-07T12:25:54.563 INFO:tasks.workunit.client.0.smithi047.stdout:1/299: write d1/d15/d2f/f4b [1023446,92408] 0 2024-02-07T12:25:54.563 INFO:tasks.workunit.client.0.smithi047.stdout:7/391: rmdir d0/df/d29/d31/d40 39 2024-02-07T12:25:54.563 INFO:tasks.workunit.client.0.smithi047.stdout:7/392: chown d0/df/d29/f68 18715 1 2024-02-07T12:25:54.564 INFO:tasks.workunit.client.0.smithi047.stdout:0/195: sync 2024-02-07T12:25:54.564 INFO:tasks.workunit.client.0.smithi047.stdout:5/512: sync 2024-02-07T12:25:54.570 INFO:tasks.workunit.client.0.smithi047.stdout:9/247: mkdir d3/d10/d18/d3b/d52 0 2024-02-07T12:25:54.572 INFO:tasks.workunit.client.0.smithi047.stdout:4/472: mknod d3/d61/c9b 0 2024-02-07T12:25:54.574 INFO:tasks.workunit.client.0.smithi047.stdout:1/300: symlink d1/d15/d30/d46/d4c/d5f/l63 0 2024-02-07T12:25:54.574 INFO:tasks.workunit.client.0.smithi047.stdout:1/301: readlink d1/d48/l5d 0 2024-02-07T12:25:54.575 INFO:tasks.workunit.client.0.smithi047.stdout:7/393: read d0/df/d29/d3e/f60 [94108,102337] 0 2024-02-07T12:25:54.575 INFO:tasks.workunit.client.0.smithi047.stdout:6/399: read d3/da/d2c/f2e [2088262,109321] 0 2024-02-07T12:25:54.575 INFO:tasks.workunit.client.0.smithi047.stdout:5/513: symlink da/df/d16/d25/d33/d55/d80/la5 0 2024-02-07T12:25:54.576 INFO:tasks.workunit.client.0.smithi047.stdout:8/525: rmdir d3/d36/d50/d28 39 2024-02-07T12:25:54.576 INFO:tasks.workunit.client.0.smithi047.stdout:8/526: readlink d3/d36/d50/d28/l83 0 2024-02-07T12:25:54.577 INFO:tasks.workunit.client.0.smithi047.stdout:4/473: mknod d3/d61/d70/d83/c9c 0 2024-02-07T12:25:54.578 INFO:tasks.workunit.client.0.smithi047.stdout:1/302: truncate d1/d15/d18/f27 341123 0 2024-02-07T12:25:54.580 INFO:tasks.workunit.client.0.smithi047.stdout:6/400: mkdir d3/da/d3b/d87 0 2024-02-07T12:25:54.580 INFO:tasks.workunit.client.0.smithi047.stdout:6/401: creat d3/da/d14/f88 x:0 0 0 2024-02-07T12:25:54.580 INFO:tasks.workunit.client.0.smithi047.stdout:6/402: dread - d3/f59 zero size 2024-02-07T12:25:54.580 INFO:tasks.workunit.client.0.smithi047.stdout:6/403: read d3/d5/f15 [1890082,49695] 0 2024-02-07T12:25:54.580 INFO:tasks.workunit.client.0.smithi047.stdout:6/404: chown d3/da/d34/d6d 13156 1 2024-02-07T12:25:54.581 INFO:tasks.workunit.client.0.smithi047.stdout:5/514: mkdir da/df/d16/d25/d33/d55/d80/da6 0 2024-02-07T12:25:54.581 INFO:tasks.workunit.client.0.smithi047.stdout:5/515: write da/df/d16/d25/f2d [1000037,127270] 0 2024-02-07T12:25:54.581 INFO:tasks.workunit.client.0.smithi047.stdout:0/196: dwrite d19/d1c/f30 [0,4194304] 0 2024-02-07T12:25:54.581 INFO:tasks.workunit.client.0.smithi047.stdout:0/197: write d19/d1c/d2b/f33 [308941,87954] 0 2024-02-07T12:25:54.581 INFO:tasks.workunit.client.0.smithi047.stdout:0/198: dread - d19/d1c/f31 zero size 2024-02-07T12:25:54.583 INFO:tasks.workunit.client.0.smithi047.stdout:7/394: truncate d0/df/d29/d31/f34 1747396 0 2024-02-07T12:25:54.586 INFO:tasks.workunit.client.0.smithi047.stdout:1/303: getdents d1/d15 0 2024-02-07T12:25:54.587 INFO:tasks.workunit.client.0.smithi047.stdout:6/405: getdents d3/d5/d35/d3c 0 2024-02-07T12:25:54.590 INFO:tasks.workunit.client.0.smithi047.stdout:0/199: rmdir d19/d1c/d24 39 2024-02-07T12:25:54.591 INFO:tasks.workunit.client.0.smithi047.stdout:1/304: getdents d1/d15/d2f 0 2024-02-07T12:25:54.593 INFO:tasks.workunit.client.0.smithi047.stdout:0/200: rename f13 to d19/f34 0 2024-02-07T12:25:54.595 INFO:tasks.workunit.client.0.smithi047.stdout:5/516: dread da/df/f94 [0,4194304] 0 2024-02-07T12:25:54.595 INFO:tasks.workunit.client.0.smithi047.stdout:5/517: readlink da/l90 0 2024-02-07T12:25:54.596 INFO:tasks.workunit.client.0.smithi047.stdout:1/305: creat d1/d15/d30/d46/d4c/d5f/f64 x:0 0 0 2024-02-07T12:25:54.596 INFO:tasks.workunit.client.0.smithi047.stdout:1/306: fsync d1/d15/d30/d46/f59 0 2024-02-07T12:25:54.597 INFO:tasks.workunit.client.0.smithi047.stdout:5/518: symlink da/d24/d63/d9c/da3/la7 0 2024-02-07T12:25:54.600 INFO:tasks.workunit.client.0.smithi047.stdout:5/519: dread da/df/d16/d25/d33/f77 [0,4194304] 0 2024-02-07T12:25:54.600 INFO:tasks.workunit.client.0.smithi047.stdout:5/520: chown da/df/d16/d25/d33/f3c 1828 1 2024-02-07T12:25:54.601 INFO:tasks.workunit.client.0.smithi047.stdout:5/521: chown da/df/d16/d25/d71/d68/f9b 1 1 2024-02-07T12:25:54.601 INFO:tasks.workunit.client.0.smithi047.stdout:9/248: dwrite d3/f22 [0,4194304] 0 2024-02-07T12:25:54.603 INFO:tasks.workunit.client.0.smithi047.stdout:5/522: mkdir da/df/d16/d25/d33/d6e/da8 0 2024-02-07T12:25:54.606 INFO:tasks.workunit.client.0.smithi047.stdout:9/249: link d3/d10/d11/l20 d3/d10/d18/d3b/d3c/d47/l53 0 2024-02-07T12:25:54.607 INFO:tasks.workunit.client.0.smithi047.stdout:5/523: rmdir da/d24/d63/d85 39 2024-02-07T12:25:54.609 INFO:tasks.workunit.client.0.smithi047.stdout:5/524: creat da/df/d16/d25/d33/d55/d80/fa9 x:0 0 0 2024-02-07T12:25:54.609 INFO:tasks.workunit.client.0.smithi047.stdout:5/525: mkdir da/d24/daa 0 2024-02-07T12:25:54.610 INFO:tasks.workunit.client.0.smithi047.stdout:5/526: stat da/f1a 0 2024-02-07T12:25:54.620 INFO:tasks.workunit.client.0.smithi047.stdout:9/250: write d3/d10/f24 [3624738,115329] 0 2024-02-07T12:25:54.620 INFO:tasks.workunit.client.0.smithi047.stdout:9/251: creat d3/d10/d18/d3b/d52/f54 x:0 0 0 2024-02-07T12:25:54.621 INFO:tasks.workunit.client.0.smithi047.stdout:6/406: dwrite d3/d5/f13 [0,4194304] 0 2024-02-07T12:25:54.621 INFO:tasks.workunit.client.0.smithi047.stdout:1/307: dwrite d1/d15/d2f/d3d/d3e/f4a [0,4194304] 0 2024-02-07T12:25:54.622 INFO:tasks.workunit.client.0.smithi047.stdout:9/252: unlink d3/d10/d11/l48 0 2024-02-07T12:25:54.622 INFO:tasks.workunit.client.0.smithi047.stdout:9/253: creat d3/d10/d18/d3b/d3c/f55 x:0 0 0 2024-02-07T12:25:54.624 INFO:tasks.workunit.client.0.smithi047.stdout:6/407: mknod d3/da/d2c/c89 0 2024-02-07T12:25:54.628 INFO:tasks.workunit.client.0.smithi047.stdout:9/254: symlink d3/d10/l56 0 2024-02-07T12:25:54.628 INFO:tasks.workunit.client.0.smithi047.stdout:9/255: fdatasync d3/d10/d18/f2e 0 2024-02-07T12:25:54.632 INFO:tasks.workunit.client.0.smithi047.stdout:1/308: rename d1/d15/d30/d46/d4c/d5f to d1/d15/d18/d65 0 2024-02-07T12:25:54.633 INFO:tasks.workunit.client.0.smithi047.stdout:1/309: rmdir d1/d48 39 2024-02-07T12:25:54.648 INFO:tasks.workunit.client.0.smithi047.stdout:1/310: dwrite d1/d15/d2f/d3d/f5c [0,4194304] 0 2024-02-07T12:25:54.648 INFO:tasks.workunit.client.0.smithi047.stdout:6/408: dwrite d3/da/d2c/d42/f57 [4194304,4194304] 0 2024-02-07T12:25:54.648 INFO:tasks.workunit.client.0.smithi047.stdout:6/409: fdatasync d3/da/d3b/f7e 0 2024-02-07T12:25:54.649 INFO:tasks.workunit.client.0.smithi047.stdout:1/311: mkdir d1/d15/d30/d46/d66 0 2024-02-07T12:25:54.649 INFO:tasks.workunit.client.0.smithi047.stdout:1/312: dread - d1/d37/f60 zero size 2024-02-07T12:25:54.652 INFO:tasks.workunit.client.0.smithi047.stdout:1/313: dread d1/d15/d18/f24 [0,4194304] 0 2024-02-07T12:25:54.652 INFO:tasks.workunit.client.0.smithi047.stdout:1/314: readlink d1/d15/d18/l1f 0 2024-02-07T12:25:54.652 INFO:tasks.workunit.client.0.smithi047.stdout:1/315: mknod d1/d15/d18/d40/c67 0 2024-02-07T12:25:54.652 INFO:tasks.workunit.client.0.smithi047.stdout:1/316: fdatasync d1/d15/d18/f1d 0 2024-02-07T12:25:54.653 INFO:tasks.workunit.client.0.smithi047.stdout:6/410: dread d3/d5/d35/f63 [0,4194304] 0 2024-02-07T12:25:54.653 INFO:tasks.workunit.client.0.smithi047.stdout:1/317: write d1/d15/d2f/d3d/d3e/f43 [91883,62211] 0 2024-02-07T12:25:54.654 INFO:tasks.workunit.client.0.smithi047.stdout:6/411: creat d3/da/d3b/d52/d6b/f8a x:0 0 0 2024-02-07T12:25:54.654 INFO:tasks.workunit.client.0.smithi047.stdout:6/412: creat d3/da/d2c/f8b x:0 0 0 2024-02-07T12:25:54.728 INFO:tasks.workunit.client.0.smithi047.stdout:1/318: symlink d1/d15/d30/d46/l68 0 2024-02-07T12:25:54.729 INFO:tasks.workunit.client.0.smithi047.stdout:9/256: fsync d3/d10/f24 0 2024-02-07T12:25:54.729 INFO:tasks.workunit.client.0.smithi047.stdout:9/257: creat d3/d10/d18/d3b/f57 x:0 0 0 2024-02-07T12:25:54.730 INFO:tasks.workunit.client.0.smithi047.stdout:2/474: dwrite d7/f3b [4194304,4194304] 0 2024-02-07T12:25:54.731 INFO:tasks.workunit.client.0.smithi047.stdout:2/475: chown d7/d2d/d5c/c68 51627 1 2024-02-07T12:25:54.731 INFO:tasks.workunit.client.0.smithi047.stdout:2/476: dread - d7/d2d/d5c/d77/f85 zero size 2024-02-07T12:25:54.732 INFO:tasks.workunit.client.0.smithi047.stdout:1/319: symlink d1/d15/d30/l69 0 2024-02-07T12:25:54.732 INFO:tasks.workunit.client.0.smithi047.stdout:1/320: truncate d1/d15/d2f/d3d/d3e/f57 226341 0 2024-02-07T12:25:54.732 INFO:tasks.workunit.client.0.smithi047.stdout:1/321: chown d1/d15/d30/d46/f59 58520563 1 2024-02-07T12:25:54.732 INFO:tasks.workunit.client.0.smithi047.stdout:1/322: chown d1/f5e 0 1 2024-02-07T12:25:54.740 INFO:tasks.workunit.client.0.smithi047.stdout:5/527: dread da/d24/d63/d9a/f5b [0,4194304] 0 2024-02-07T12:25:54.740 INFO:tasks.workunit.client.0.smithi047.stdout:5/528: fsync da/df/d16/f3d 0 2024-02-07T12:25:54.740 INFO:tasks.workunit.client.0.smithi047.stdout:9/258: mknod d3/d10/d18/d3a/c58 0 2024-02-07T12:25:54.740 INFO:tasks.workunit.client.0.smithi047.stdout:4/474: dwrite d3/d61/d43/d45/d6c/d73/f7c [0,4194304] 0 2024-02-07T12:25:54.741 INFO:tasks.workunit.client.0.smithi047.stdout:7/395: dwrite d0/d4/f7e [0,4194304] 0 2024-02-07T12:25:54.741 INFO:tasks.workunit.client.0.smithi047.stdout:7/396: truncate d0/df/d29/f23 1241496 0 2024-02-07T12:25:54.743 INFO:tasks.workunit.client.0.smithi047.stdout:9/259: rmdir d3/d10/d18/d3d 39 2024-02-07T12:25:54.743 INFO:tasks.workunit.client.0.smithi047.stdout:8/527: dwrite d3/d36/d50/d2a/f2b [0,4194304] 0 2024-02-07T12:25:54.743 INFO:tasks.workunit.client.0.smithi047.stdout:5/529: dread da/df/d16/d25/d71/f4e [0,4194304] 0 2024-02-07T12:25:54.746 INFO:tasks.workunit.client.0.smithi047.stdout:4/475: creat d3/d30/f9d x:0 0 0 2024-02-07T12:25:54.749 INFO:tasks.workunit.client.0.smithi047.stdout:7/397: write d0/d42/f4f [8030436,28098] 0 2024-02-07T12:25:54.749 INFO:tasks.workunit.client.0.smithi047.stdout:7/398: write d0/d42/d4d/f69 [1018967,40692] 0 2024-02-07T12:25:54.749 INFO:tasks.workunit.client.0.smithi047.stdout:7/399: fsync d0/d4/f5 0 2024-02-07T12:25:54.750 INFO:tasks.workunit.client.0.smithi047.stdout:6/413: rename d3/da/d3b/d52/d6b to d3/d5/d35/d3c/d72/d8c 0 2024-02-07T12:25:54.751 INFO:tasks.workunit.client.0.smithi047.stdout:9/260: link d3/f1d d3/d10/d18/f59 0 2024-02-07T12:25:54.752 INFO:tasks.workunit.client.0.smithi047.stdout:8/528: getdents d3 0 2024-02-07T12:25:54.752 INFO:tasks.workunit.client.0.smithi047.stdout:8/529: chown d3/d66/d67/d6a/f8e 97590818 1 2024-02-07T12:25:54.752 INFO:tasks.workunit.client.0.smithi047.stdout:8/530: chown d3/d36/d50/d28/l45 4 1 2024-02-07T12:25:54.752 INFO:tasks.workunit.client.0.smithi047.stdout:4/476: dread d3/d30/f44 [0,4194304] 0 2024-02-07T12:25:54.752 INFO:tasks.workunit.client.0.smithi047.stdout:4/477: creat d3/d61/d43/d45/d63/f9e x:0 0 0 2024-02-07T12:25:54.752 INFO:tasks.workunit.client.0.smithi047.stdout:5/530: mkdir da/df/d16/dab 0 2024-02-07T12:25:54.753 INFO:tasks.workunit.client.0.smithi047.stdout:7/400: getdents d0/df/d29/d3e/d4c 0 2024-02-07T12:25:54.754 INFO:tasks.workunit.client.0.smithi047.stdout:1/323: dwrite d1/d15/d18/f23 [0,4194304] 0 2024-02-07T12:25:54.754 INFO:tasks.workunit.client.0.smithi047.stdout:1/324: dread - d1/d15/d30/d46/f59 zero size 2024-02-07T12:25:54.754 INFO:tasks.workunit.client.0.smithi047.stdout:2/477: dwrite d7/dc/f31 [0,4194304] 0 2024-02-07T12:25:54.754 INFO:tasks.workunit.client.0.smithi047.stdout:6/414: creat d3/da/d3b/d87/f8d x:0 0 0 2024-02-07T12:25:54.755 INFO:tasks.workunit.client.0.smithi047.stdout:9/261: symlink d3/d10/d18/d3b/l5a 0 2024-02-07T12:25:54.759 INFO:tasks.workunit.client.0.smithi047.stdout:8/531: rename d3/d4/d4d/l4f to d3/d66/dac/lae 0 2024-02-07T12:25:54.761 INFO:tasks.workunit.client.0.smithi047.stdout:1/325: write d1/d15/d2f/d3d/d3e/f4a [2512088,60911] 0 2024-02-07T12:25:54.761 INFO:tasks.workunit.client.0.smithi047.stdout:1/326: creat d1/d15/d30/f6a x:0 0 0 2024-02-07T12:25:54.761 INFO:tasks.workunit.client.0.smithi047.stdout:4/478: creat d3/d27/d5e/f9f x:0 0 0 2024-02-07T12:25:54.762 INFO:tasks.workunit.client.0.smithi047.stdout:5/531: write da/df/d16/d25/f50 [1732947,107528] 0 2024-02-07T12:25:54.764 INFO:tasks.workunit.client.0.smithi047.stdout:6/415: link d3/da/d2c/d42/f7b d3/da/d34/f8e 0 2024-02-07T12:25:54.764 INFO:tasks.workunit.client.0.smithi047.stdout:5/532: dread da/df/d16/d25/d71/f4b [0,4194304] 0 2024-02-07T12:25:54.764 INFO:tasks.workunit.client.0.smithi047.stdout:5/533: truncate da/df/d16/d81/f99 834215 0 2024-02-07T12:25:54.765 INFO:tasks.workunit.client.0.smithi047.stdout:9/262: rmdir d3/d10/d18 39 2024-02-07T12:25:54.765 INFO:tasks.workunit.client.0.smithi047.stdout:5/534: read da/df/d16/d25/f2d [499605,69922] 0 2024-02-07T12:25:54.768 INFO:tasks.workunit.client.0.smithi047.stdout:8/532: stat d3/d36/d50/d30/d9e/da6/c89 0 2024-02-07T12:25:54.769 INFO:tasks.workunit.client.0.smithi047.stdout:9/263: read d3/f29 [4838985,98659] 0 2024-02-07T12:25:54.769 INFO:tasks.workunit.client.0.smithi047.stdout:9/264: creat d3/d10/d4c/f5b x:0 0 0 2024-02-07T12:25:54.770 INFO:tasks.workunit.client.0.smithi047.stdout:1/327: truncate d1/f22 7306812 0 2024-02-07T12:25:54.771 INFO:tasks.workunit.client.0.smithi047.stdout:7/401: rmdir d0/df/d74 39 2024-02-07T12:25:54.774 INFO:tasks.workunit.client.0.smithi047.stdout:6/416: mkdir d3/da/d34/d6d/d8f 0 2024-02-07T12:25:54.776 INFO:tasks.workunit.client.0.smithi047.stdout:5/535: symlink da/df/d16/d25/d71/d68/lac 0 2024-02-07T12:25:54.780 INFO:tasks.workunit.client.0.smithi047.stdout:2/478: rename d7/d2d/d7c/f82 to d7/d2d/d5c/d77/f8e 0 2024-02-07T12:25:54.780 INFO:tasks.workunit.client.0.smithi047.stdout:2/479: creat d7/dc/f8f x:0 0 0 2024-02-07T12:25:54.780 INFO:tasks.workunit.client.0.smithi047.stdout:2/480: creat d7/dc/d71/f90 x:0 0 0 2024-02-07T12:25:54.781 INFO:tasks.workunit.client.0.smithi047.stdout:8/533: getdents d3/d66/d67/d6a/d91 0 2024-02-07T12:25:54.782 INFO:tasks.workunit.client.0.smithi047.stdout:5/536: write da/f39 [654654,89799] 0 2024-02-07T12:25:54.782 INFO:tasks.workunit.client.0.smithi047.stdout:5/537: chown da/df/d16/d41/f46 27 1 2024-02-07T12:25:54.782 INFO:tasks.workunit.client.0.smithi047.stdout:5/538: readlink da/df/d16/d41/d57/l79 0 2024-02-07T12:25:54.782 INFO:tasks.workunit.client.0.smithi047.stdout:5/539: dread - da/df/d16/d25/d33/d55/f92 zero size 2024-02-07T12:25:54.782 INFO:tasks.workunit.client.0.smithi047.stdout:5/540: getdents da/d24/daa 0 2024-02-07T12:25:54.783 INFO:tasks.workunit.client.0.smithi047.stdout:9/265: mknod d3/d10/d18/d3b/d3c/d47/d4f/c5c 0 2024-02-07T12:25:54.785 INFO:tasks.workunit.client.0.smithi047.stdout:6/417: read d3/d5/f5d [3871442,52854] 0 2024-02-07T12:25:54.786 INFO:tasks.workunit.client.0.smithi047.stdout:2/481: mknod d7/dc/d8a/c91 0 2024-02-07T12:25:54.788 INFO:tasks.workunit.client.0.smithi047.stdout:5/541: creat da/df/d16/d25/fad x:0 0 0 2024-02-07T12:25:54.788 INFO:tasks.workunit.client.0.smithi047.stdout:5/542: read da/f39 [2188096,11530] 0 2024-02-07T12:25:54.788 INFO:tasks.workunit.client.0.smithi047.stdout:7/402: getdents d0/df/d29/d31/d55 0 2024-02-07T12:25:54.789 INFO:tasks.workunit.client.0.smithi047.stdout:7/403: chown d0/c19 10507808 1 2024-02-07T12:25:54.789 INFO:tasks.workunit.client.0.smithi047.stdout:7/404: creat d0/df/d29/d3e/f80 x:0 0 0 2024-02-07T12:25:54.789 INFO:tasks.workunit.client.0.smithi047.stdout:7/405: readlink d0/ld 0 2024-02-07T12:25:54.790 INFO:tasks.workunit.client.0.smithi047.stdout:1/328: dwrite d1/d15/d18/f24 [0,4194304] 0 2024-02-07T12:25:54.791 INFO:tasks.workunit.client.0.smithi047.stdout:6/418: mkdir d3/d5/d35/d3c/d90 0 2024-02-07T12:25:54.792 INFO:tasks.workunit.client.0.smithi047.stdout:1/329: dread d1/d15/d2f/f4b [0,4194304] 0 2024-02-07T12:25:54.793 INFO:tasks.workunit.client.0.smithi047.stdout:1/330: write d1/d15/d2f/d3d/d3e/f57 [374021,33254] 0 2024-02-07T12:25:54.795 INFO:tasks.workunit.client.0.smithi047.stdout:9/266: dread d3/f1d [0,4194304] 0 2024-02-07T12:25:54.798 INFO:tasks.workunit.client.0.smithi047.stdout:8/534: dread d3/d66/d67/d6a/f51 [0,4194304] 0 2024-02-07T12:25:54.798 INFO:tasks.workunit.client.0.smithi047.stdout:7/406: mknod d0/d6f/c81 0 2024-02-07T12:25:54.800 INFO:tasks.workunit.client.0.smithi047.stdout:4/479: rename d3/d30 to d3/d27/d5e/da0 0 2024-02-07T12:25:54.800 INFO:tasks.workunit.client.0.smithi047.stdout:4/480: fsync d3/d27/d5e/da0/d37/f5d 0 2024-02-07T12:25:54.804 INFO:tasks.workunit.client.0.smithi047.stdout:5/543: dread da/df/f28 [0,4194304] 0 2024-02-07T12:25:54.807 INFO:tasks.workunit.client.0.smithi047.stdout:6/419: mkdir d3/d5/d35/d3c/d72/d8c/d91 0 2024-02-07T12:25:54.809 INFO:tasks.workunit.client.0.smithi047.stdout:4/481: read d3/d27/d5e/da0/d37/f5d [4188801,81837] 0 2024-02-07T12:25:54.813 INFO:tasks.workunit.client.0.smithi047.stdout:1/331: dwrite d1/d15/d18/d40/f61 [0,4194304] 0 2024-02-07T12:25:54.813 INFO:tasks.workunit.client.0.smithi047.stdout:1/332: chown d1/d15/d30/c39 382785124 1 2024-02-07T12:25:54.814 INFO:tasks.workunit.client.0.smithi047.stdout:8/535: creat d3/faf x:0 0 0 2024-02-07T12:25:54.816 INFO:tasks.workunit.client.0.smithi047.stdout:7/407: rename d0/f36 to d0/d42/d4d/d67/f82 0 2024-02-07T12:25:54.818 INFO:tasks.workunit.client.0.smithi047.stdout:4/482: creat d3/d61/fa1 x:0 0 0 2024-02-07T12:25:54.818 INFO:tasks.workunit.client.0.smithi047.stdout:4/483: chown d3/l1f 12978 1 2024-02-07T12:25:54.819 INFO:tasks.workunit.client.0.smithi047.stdout:9/267: dwrite d3/f22 [0,4194304] 0 2024-02-07T12:25:54.821 INFO:tasks.workunit.client.0.smithi047.stdout:1/333: creat d1/d15/d2f/f6b x:0 0 0 2024-02-07T12:25:54.822 INFO:tasks.workunit.client.0.smithi047.stdout:8/536: symlink d3/d66/d67/d71/lb0 0 2024-02-07T12:25:54.826 INFO:tasks.workunit.client.0.smithi047.stdout:5/544: rename da/df/d16/d41/d57/f6a to da/df/d16/d25/d33/d55/d80/fae 0 2024-02-07T12:25:54.827 INFO:tasks.workunit.client.0.smithi047.stdout:7/408: mknod d0/d42/d4d/d67/c83 0 2024-02-07T12:25:54.831 INFO:tasks.workunit.client.0.smithi047.stdout:6/420: getdents d3/d5 0 2024-02-07T12:25:54.833 INFO:tasks.workunit.client.0.smithi047.stdout:4/484: mkdir d3/d27/d3b/d7d/da2 0 2024-02-07T12:25:54.833 INFO:tasks.workunit.client.0.smithi047.stdout:4/485: readlink d3/d61/d43/l90 0 2024-02-07T12:25:54.833 INFO:tasks.workunit.client.0.smithi047.stdout:4/486: fdatasync f1 0 2024-02-07T12:25:54.834 INFO:tasks.workunit.client.0.smithi047.stdout:4/487: write d3/d27/d3b/f88 [847978,34914] 0 2024-02-07T12:25:54.840 INFO:tasks.workunit.client.0.smithi047.stdout:9/268: rename d3/d10/d18/d3b/d3c/d47/d4f to d3/d10/d18/d3b/d3c/d5d 0 2024-02-07T12:25:54.842 INFO:tasks.workunit.client.0.smithi047.stdout:5/545: creat da/d24/daa/faf x:0 0 0 2024-02-07T12:25:54.844 INFO:tasks.workunit.client.0.smithi047.stdout:7/409: rmdir d0/df/d29/d3e/d4c 39 2024-02-07T12:25:54.845 INFO:tasks.workunit.client.0.smithi047.stdout:6/421: getdents d3/d1e 0 2024-02-07T12:25:54.845 INFO:tasks.workunit.client.0.smithi047.stdout:6/422: chown d3/d1e/d25/f78 63142425 1 2024-02-07T12:25:54.845 INFO:tasks.workunit.client.0.smithi047.stdout:6/423: write d3/da/f6f [375543,27719] 0 2024-02-07T12:25:54.846 INFO:tasks.workunit.client.0.smithi047.stdout:1/334: rmdir d1/d15/d2f/d3d/d3e 39 2024-02-07T12:25:54.847 INFO:tasks.workunit.client.0.smithi047.stdout:1/335: creat d1/d15/d2f/f6c x:0 0 0 2024-02-07T12:25:54.847 INFO:tasks.workunit.client.0.smithi047.stdout:8/537: dwrite d3/d66/f79 [0,4194304] 0 2024-02-07T12:25:54.849 INFO:tasks.workunit.client.0.smithi047.stdout:9/269: mknod d3/d10/d18/d3b/d3c/c5e 0 2024-02-07T12:25:54.850 INFO:tasks.workunit.client.0.smithi047.stdout:5/546: creat da/df/d16/dab/fb0 x:0 0 0 2024-02-07T12:25:54.850 INFO:tasks.workunit.client.0.smithi047.stdout:5/547: write da/df/f94 [4715742,2143] 0 2024-02-07T12:25:54.853 INFO:tasks.workunit.client.0.smithi047.stdout:7/410: mknod d0/df/d29/d31/c84 0 2024-02-07T12:25:54.856 INFO:tasks.workunit.client.0.smithi047.stdout:1/336: link d1/d15/d18/f27 d1/d15/d30/d46/d4c/f6d 0 2024-02-07T12:25:54.858 INFO:tasks.workunit.client.0.smithi047.stdout:9/270: truncate d3/d10/d18/f59 3194661 0 2024-02-07T12:25:54.859 INFO:tasks.workunit.client.0.smithi047.stdout:5/548: mkdir da/df/d16/d41/d57/d6c/db1 0 2024-02-07T12:25:54.860 INFO:tasks.workunit.client.0.smithi047.stdout:8/538: getdents d3/d36/d50/d30/d34/d3e 0 2024-02-07T12:25:54.861 INFO:tasks.workunit.client.0.smithi047.stdout:8/539: readlink d3/d36/d50/d30/d34/l42 0 2024-02-07T12:25:54.862 INFO:tasks.workunit.client.0.smithi047.stdout:9/271: rename d3/d10/d18/d3b/d3c/c5e to d3/c5f 0 2024-02-07T12:25:54.862 INFO:tasks.workunit.client.0.smithi047.stdout:9/272: write d3/d10/d18/d3a/f4a [564503,103212] 0 2024-02-07T12:25:54.862 INFO:tasks.workunit.client.0.smithi047.stdout:9/273: stat d3/d10/d18/d3b/d52/f54 0 2024-02-07T12:25:54.863 INFO:tasks.workunit.client.0.smithi047.stdout:9/274: creat d3/d10/f60 x:0 0 0 2024-02-07T12:25:54.864 INFO:tasks.workunit.client.0.smithi047.stdout:8/540: link d3/f56 d3/d4/d4d/fb1 0 2024-02-07T12:25:54.864 INFO:tasks.workunit.client.0.smithi047.stdout:8/541: chown d3/d36/d50/d30/d34/d3e/f86 106296 1 2024-02-07T12:25:54.867 INFO:tasks.workunit.client.0.smithi047.stdout:8/542: mknod d3/d36/d50/d30/cb2 0 2024-02-07T12:25:54.867 INFO:tasks.workunit.client.0.smithi047.stdout:8/543: fsync d3/d66/f7d 0 2024-02-07T12:25:54.867 INFO:tasks.workunit.client.0.smithi047.stdout:8/544: write d3/d66/faa [511597,26224] 0 2024-02-07T12:25:54.868 INFO:tasks.workunit.client.0.smithi047.stdout:4/488: dwrite d3/f14 [4194304,4194304] 0 2024-02-07T12:25:54.869 INFO:tasks.workunit.client.0.smithi047.stdout:7/411: dread d0/df/d29/d31/d40/f49 [0,4194304] 0 2024-02-07T12:25:54.874 INFO:tasks.workunit.client.0.smithi047.stdout:8/545: unlink d3/d36/d50/d30/d9e/da6/c53 0 2024-02-07T12:25:54.876 INFO:tasks.workunit.client.0.smithi047.stdout:7/412: read d0/df/d29/d31/d40/f49 [3926500,8918] 0 2024-02-07T12:25:54.877 INFO:tasks.workunit.client.0.smithi047.stdout:8/546: mknod d3/d36/d50/d30/d34/dab/cb3 0 2024-02-07T12:25:54.879 INFO:tasks.workunit.client.0.smithi047.stdout:7/413: rename d0/d4/l58 to d0/df/d29/d3e/l85 0 2024-02-07T12:25:54.879 INFO:tasks.workunit.client.0.smithi047.stdout:7/414: fsync d0/d42/f57 0 2024-02-07T12:25:54.879 INFO:tasks.workunit.client.0.smithi047.stdout:7/415: stat d0/df/c72 0 2024-02-07T12:25:54.881 INFO:tasks.workunit.client.0.smithi047.stdout:8/547: mknod d3/d36/d50/d30/d34/dab/cb4 0 2024-02-07T12:25:54.881 INFO:tasks.workunit.client.0.smithi047.stdout:8/548: write d3/d36/d50/f81 [179548,38359] 0 2024-02-07T12:25:54.881 INFO:tasks.workunit.client.0.smithi047.stdout:8/549: dread - d3/d36/d50/d30/d9e/da6/f84 zero size 2024-02-07T12:25:54.883 INFO:tasks.workunit.client.0.smithi047.stdout:7/416: rename d0/df/d29/d31/d40/f50 to d0/d2f/f86 0 2024-02-07T12:25:54.885 INFO:tasks.workunit.client.0.smithi047.stdout:1/337: dwrite d1/d15/d18/d40/f52 [0,4194304] 0 2024-02-07T12:25:54.885 INFO:tasks.workunit.client.0.smithi047.stdout:9/275: dwrite d3/d10/d11/f43 [0,4194304] 0 2024-02-07T12:25:54.891 INFO:tasks.workunit.client.0.smithi047.stdout:5/549: fsync da/d24/daa/faf 0 2024-02-07T12:25:54.893 INFO:tasks.workunit.client.0.smithi047.stdout:9/276: mknod d3/d10/d18/d3b/d3c/d5d/c61 0 2024-02-07T12:25:54.895 INFO:tasks.workunit.client.0.smithi047.stdout:4/489: dwrite d3/d61/d43/d45/d66/f80 [0,4194304] 0 2024-02-07T12:25:54.897 INFO:tasks.workunit.client.0.smithi047.stdout:9/277: rename d3/d10/d18/d3b/l5a to d3/d10/d18/l62 0 2024-02-07T12:25:54.905 INFO:tasks.workunit.client.0.smithi047.stdout:7/417: dread d0/d4/fe [0,4194304] 0 2024-02-07T12:25:54.907 INFO:tasks.workunit.client.0.smithi047.stdout:7/418: truncate d0/d4/f20 6289891 0 2024-02-07T12:25:54.907 INFO:tasks.workunit.client.0.smithi047.stdout:7/419: chown d0/df/c2b 0 1 2024-02-07T12:25:54.907 INFO:tasks.workunit.client.0.smithi047.stdout:7/420: read - d0/d6f/f71 zero size 2024-02-07T12:25:54.916 INFO:tasks.workunit.client.0.smithi047.stdout:6/424: write d3/d5/f27 [5368660,101449] 0 2024-02-07T12:25:54.917 INFO:tasks.workunit.client.0.smithi047.stdout:6/425: getdents d3/da/d34/d6d 0 2024-02-07T12:25:54.917 INFO:tasks.workunit.client.0.smithi047.stdout:6/426: truncate d3/da/d14/d28/f3e 458861 0 2024-02-07T12:25:54.917 INFO:tasks.workunit.client.0.smithi047.stdout:6/427: dread - d3/da/d3b/f85 zero size 2024-02-07T12:25:54.924 INFO:tasks.workunit.client.0.smithi047.stdout:1/338: dwrite d1/d15/d18/d40/f56 [0,4194304] 0 2024-02-07T12:25:54.924 INFO:tasks.workunit.client.0.smithi047.stdout:8/550: dwrite d3/d66/d67/d71/d93/f95 [0,4194304] 0 2024-02-07T12:25:54.925 INFO:tasks.workunit.client.0.smithi047.stdout:4/490: dwrite d3/d61/d43/d45/d63/f9e [0,4194304] 0 2024-02-07T12:25:54.925 INFO:tasks.workunit.client.0.smithi047.stdout:4/491: chown d3/d61/c65 231210 1 2024-02-07T12:25:54.926 INFO:tasks.workunit.client.0.smithi047.stdout:4/492: truncate d3/d27/d5e/da0/d37/f7f 297731 0 2024-02-07T12:25:54.926 INFO:tasks.workunit.client.0.smithi047.stdout:5/550: dwrite da/df/d16/d25/d33/d55/d80/f89 [0,4194304] 0 2024-02-07T12:25:54.926 INFO:tasks.workunit.client.0.smithi047.stdout:9/278: dwrite d3/d10/d18/f2e [0,4194304] 0 2024-02-07T12:25:54.927 INFO:tasks.workunit.client.0.smithi047.stdout:8/551: creat d3/d36/d50/fb5 x:0 0 0 2024-02-07T12:25:54.928 INFO:tasks.workunit.client.0.smithi047.stdout:1/339: mkdir d1/d6e 0 2024-02-07T12:25:54.931 INFO:tasks.workunit.client.0.smithi047.stdout:6/428: dread d3/d5/f15 [0,4194304] 0 2024-02-07T12:25:54.932 INFO:tasks.workunit.client.0.smithi047.stdout:7/421: rename d0/df/d29/d3e/l85 to d0/df/l87 0 2024-02-07T12:25:54.932 INFO:tasks.workunit.client.0.smithi047.stdout:7/422: write d0/d4/f16 [904808,34699] 0 2024-02-07T12:25:54.932 INFO:tasks.workunit.client.0.smithi047.stdout:7/423: truncate d0/f64 1660984 0 2024-02-07T12:25:54.932 INFO:tasks.workunit.client.0.smithi047.stdout:7/424: write d0/df/d29/d3e/f56 [1505824,121043] 0 2024-02-07T12:25:54.940 INFO:tasks.workunit.client.0.smithi047.stdout:5/551: mkdir da/df/d16/d25/d33/d55/d80/db2 0 2024-02-07T12:25:54.941 INFO:tasks.workunit.client.0.smithi047.stdout:4/493: write d3/d61/d43/d45/d63/f9e [2678541,14694] 0 2024-02-07T12:25:54.945 INFO:tasks.workunit.client.0.smithi047.stdout:7/425: dread d0/df/d29/f65 [0,4194304] 0 2024-02-07T12:25:54.946 INFO:tasks.workunit.client.0.smithi047.stdout:9/279: unlink d3/d10/d18/d3b/d3c/d5d/c61 0 2024-02-07T12:25:54.946 INFO:tasks.workunit.client.0.smithi047.stdout:4/494: dread d3/d27/d5e/da0/f44 [0,4194304] 0 2024-02-07T12:25:54.947 INFO:tasks.workunit.client.0.smithi047.stdout:4/495: write d3/d61/d43/d45/d6c/d73/f91 [1169295,34880] 0 2024-02-07T12:25:54.948 INFO:tasks.workunit.client.0.smithi047.stdout:1/340: dwrite d1/d15/d2f/f6c [0,4194304] 0 2024-02-07T12:25:54.961 INFO:tasks.workunit.client.0.smithi047.stdout:8/552: rename d3/d36/d50/d30/d34/d3e/f88 to d3/d36/d50/d30/d9e/da6/fb6 0 2024-02-07T12:25:54.961 INFO:tasks.workunit.client.0.smithi047.stdout:5/552: mkdir da/d24/d63/d85/db3 0 2024-02-07T12:25:54.961 INFO:tasks.workunit.client.0.smithi047.stdout:5/553: fdatasync da/d24/f2f 0 2024-02-07T12:25:54.964 INFO:tasks.workunit.client.0.smithi047.stdout:1/341: symlink d1/d15/d18/d65/l6f 0 2024-02-07T12:25:54.965 INFO:tasks.workunit.client.0.smithi047.stdout:6/429: rename d3/d5/l60 to d3/da/d14/d28/l92 0 2024-02-07T12:25:54.967 INFO:tasks.workunit.client.0.smithi047.stdout:8/553: mkdir d3/d4/d4d/db7 0 2024-02-07T12:25:54.967 INFO:tasks.workunit.client.0.smithi047.stdout:8/554: fdatasync d3/d66/d67/d6a/f23 0 2024-02-07T12:25:54.967 INFO:tasks.workunit.client.0.smithi047.stdout:8/555: fsync d3/d36/d50/d30/d34/f43 0 2024-02-07T12:25:54.968 INFO:tasks.workunit.client.0.smithi047.stdout:1/342: mknod d1/d48/c70 0 2024-02-07T12:25:54.968 INFO:tasks.workunit.client.0.smithi047.stdout:1/343: write d1/d15/d18/d40/f62 [92408,44643] 0 2024-02-07T12:25:54.970 INFO:tasks.workunit.client.0.smithi047.stdout:7/426: rename d0/d2f/f86 to d0/df/d29/d3e/f88 0 2024-02-07T12:25:54.971 INFO:tasks.workunit.client.0.smithi047.stdout:6/430: creat d3/d5/d35/d3c/d72/d8c/f93 x:0 0 0 2024-02-07T12:25:54.973 INFO:tasks.workunit.client.0.smithi047.stdout:8/556: creat d3/d4/d4d/fb8 x:0 0 0 2024-02-07T12:25:54.973 INFO:tasks.workunit.client.0.smithi047.stdout:8/557: write d3/d36/f7e [233704,89932] 0 2024-02-07T12:25:54.974 INFO:tasks.workunit.client.0.smithi047.stdout:5/554: getdents da/df/d16/dab 0 2024-02-07T12:25:54.975 INFO:tasks.workunit.client.0.smithi047.stdout:6/431: dread d3/d5/f15 [4194304,4194304] 0 2024-02-07T12:25:54.975 INFO:tasks.workunit.client.0.smithi047.stdout:1/344: link d1/d15/d30/l69 d1/d48/l71 0 2024-02-07T12:25:54.977 INFO:tasks.workunit.client.0.smithi047.stdout:9/280: rename d3/d10/d18/c36 to d3/d10/d18/d3b/d3c/d47/c63 0 2024-02-07T12:25:54.977 INFO:tasks.workunit.client.0.smithi047.stdout:9/281: dread - d3/d10/d18/d3b/d3c/f55 zero size 2024-02-07T12:25:54.980 INFO:tasks.workunit.client.0.smithi047.stdout:8/558: mknod d3/d36/d50/d30/d9e/da6/cb9 0 2024-02-07T12:25:54.980 INFO:tasks.workunit.client.0.smithi047.stdout:8/559: chown d3/d36/f7e 65036852 1 2024-02-07T12:25:54.980 INFO:tasks.workunit.client.0.smithi047.stdout:8/560: truncate d3/d4/d4d/fb1 1491109 0 2024-02-07T12:25:54.981 INFO:tasks.workunit.client.0.smithi047.stdout:5/555: symlink da/d24/daa/lb4 0 2024-02-07T12:25:54.985 INFO:tasks.workunit.client.0.smithi047.stdout:1/345: unlink d1/d15/d2f/f4b 0 2024-02-07T12:25:54.985 INFO:tasks.workunit.client.0.smithi047.stdout:1/346: fsync d1/d15/d30/d46/f59 0 2024-02-07T12:25:54.985 INFO:tasks.workunit.client.0.smithi047.stdout:1/347: getdents d1/d6e 0 2024-02-07T12:25:54.985 INFO:tasks.workunit.client.0.smithi047.stdout:1/348: truncate d1/d15/d30/d46/d4c/f6d 642842 0 2024-02-07T12:25:54.987 INFO:tasks.workunit.client.0.smithi047.stdout:4/496: rename d3/d27/d3b/f76 to d3/d61/d70/d8b/fa3 0 2024-02-07T12:25:54.988 INFO:tasks.workunit.client.0.smithi047.stdout:4/497: stat d3/d27 0 2024-02-07T12:25:54.988 INFO:tasks.workunit.client.0.smithi047.stdout:4/498: fsync d3/d61/fa1 0 2024-02-07T12:25:54.990 INFO:tasks.workunit.client.0.smithi047.stdout:9/282: unlink d3/f22 0 2024-02-07T12:25:54.992 INFO:tasks.workunit.client.0.smithi047.stdout:7/427: getdents d0 0 2024-02-07T12:25:54.992 INFO:tasks.workunit.client.0.smithi047.stdout:7/428: creat d0/df/d29/f89 x:0 0 0 2024-02-07T12:25:54.992 INFO:tasks.workunit.client.0.smithi047.stdout:7/429: chown d0/d4/f12 5451 1 2024-02-07T12:25:54.994 INFO:tasks.workunit.client.0.smithi047.stdout:5/556: mknod da/df/d16/d25/d33/d6e/da8/cb5 0 2024-02-07T12:25:54.999 INFO:tasks.workunit.client.0.smithi047.stdout:6/432: getdents d3/da/d34 0 2024-02-07T12:25:54.999 INFO:tasks.workunit.client.0.smithi047.stdout:1/349: dwrite d1/d15/d18/d40/f56 [0,4194304] 0 2024-02-07T12:25:55.003 INFO:tasks.workunit.client.0.smithi047.stdout:4/499: creat d3/d61/d70/d8b/fa4 x:0 0 0 2024-02-07T12:25:55.004 INFO:tasks.workunit.client.0.smithi047.stdout:9/283: mknod d3/d10/d11/c64 0 2024-02-07T12:25:55.006 INFO:tasks.workunit.client.0.smithi047.stdout:5/557: mkdir da/df/d16/d25/d33/d6e/da8/db6 0 2024-02-07T12:25:55.008 INFO:tasks.workunit.client.0.smithi047.stdout:5/558: rename da/df/d16/d41/d57/l70 to da/df/d16/d25/d71/d8c/lb7 0 2024-02-07T12:25:55.009 INFO:tasks.workunit.client.0.smithi047.stdout:6/433: getdents d3/da/d3b/d55 0 2024-02-07T12:25:55.012 INFO:tasks.workunit.client.0.smithi047.stdout:5/559: symlink da/lb8 0 2024-02-07T12:25:55.012 INFO:tasks.workunit.client.0.smithi047.stdout:5/560: readlink da/df/d16/d41/d57/d6c/la4 0 2024-02-07T12:25:55.013 INFO:tasks.workunit.client.0.smithi047.stdout:5/561: dread da/df/d16/d25/f82 [0,4194304] 0 2024-02-07T12:25:55.013 INFO:tasks.workunit.client.0.smithi047.stdout:5/562: write da/df/d16/d25/d71/d68/f87 [984238,81792] 0 2024-02-07T12:25:55.014 INFO:tasks.workunit.client.0.smithi047.stdout:7/430: dwrite d0/d42/d4d/d67/f73 [0,4194304] 0 2024-02-07T12:25:55.014 INFO:tasks.workunit.client.0.smithi047.stdout:1/350: write d1/f21 [1263674,45102] 0 2024-02-07T12:25:55.014 INFO:tasks.workunit.client.0.smithi047.stdout:1/351: chown d1/d15/d18/d40 1106115961 1 2024-02-07T12:25:55.015 INFO:tasks.workunit.client.0.smithi047.stdout:1/352: write d1/d15/d30/d46/f59 [321467,50665] 0 2024-02-07T12:25:55.015 INFO:tasks.workunit.client.0.smithi047.stdout:6/434: mkdir d3/da/d14/d28/d46/d94 0 2024-02-07T12:25:55.015 INFO:tasks.workunit.client.0.smithi047.stdout:6/435: chown d3/da/l38 22313 1 2024-02-07T12:25:55.018 INFO:tasks.workunit.client.0.smithi047.stdout:4/500: dread d3/f17 [4194304,4194304] 0 2024-02-07T12:25:55.018 INFO:tasks.workunit.client.0.smithi047.stdout:5/563: rename da/df/f61 to da/df/d16/d25/d71/d8c/fb9 0 2024-02-07T12:25:55.018 INFO:tasks.workunit.client.0.smithi047.stdout:5/564: chown da/df/d16/d25/d71/d68/fa0 999109 1 2024-02-07T12:25:55.018 INFO:tasks.workunit.client.0.smithi047.stdout:5/565: fdatasync da/f1a 0 2024-02-07T12:25:55.022 INFO:tasks.workunit.client.0.smithi047.stdout:1/353: read d1/d15/d2f/f3c [168422,80758] 0 2024-02-07T12:25:55.022 INFO:tasks.workunit.client.0.smithi047.stdout:1/354: dread - d1/d15/d2f/f6b zero size 2024-02-07T12:25:55.022 INFO:tasks.workunit.client.0.smithi047.stdout:1/355: creat d1/d37/f72 x:0 0 0 2024-02-07T12:25:55.022 INFO:tasks.workunit.client.0.smithi047.stdout:1/356: getdents d1/d6e 0 2024-02-07T12:25:55.023 INFO:tasks.workunit.client.0.smithi047.stdout:7/431: dread d0/df/d29/d31/d40/f49 [0,4194304] 0 2024-02-07T12:25:55.023 INFO:tasks.workunit.client.0.smithi047.stdout:4/501: symlink d3/d27/d3b/d7d/da2/la5 0 2024-02-07T12:25:55.023 INFO:tasks.workunit.client.0.smithi047.stdout:4/502: creat d3/d61/fa6 x:0 0 0 2024-02-07T12:25:55.026 INFO:tasks.workunit.client.0.smithi047.stdout:4/503: dread d3/f12 [4194304,4194304] 0 2024-02-07T12:25:55.026 INFO:tasks.workunit.client.0.smithi047.stdout:5/566: creat da/df/d16/d25/d33/d55/d80/da6/fba x:0 0 0 2024-02-07T12:25:55.028 INFO:tasks.workunit.client.0.smithi047.stdout:5/567: dread da/df/d16/d25/d33/f35 [0,4194304] 0 2024-02-07T12:25:55.031 INFO:tasks.workunit.client.0.smithi047.stdout:1/357: dread d1/d15/d2f/d3d/f5c [0,4194304] 0 2024-02-07T12:25:55.032 INFO:tasks.workunit.client.0.smithi047.stdout:4/504: symlink d3/d27/d3b/d7d/da2/la7 0 2024-02-07T12:25:55.034 INFO:tasks.workunit.client.0.smithi047.stdout:6/436: rename d3/d1e/d25 to d3/d5/d35/d3c/d72/d8c/d95 0 2024-02-07T12:25:55.039 INFO:tasks.workunit.client.0.smithi047.stdout:7/432: rename d0/c2e to d0/d42/d4d/c8a 0 2024-02-07T12:25:55.039 INFO:tasks.workunit.client.0.smithi047.stdout:7/433: dread - d0/d42/f4b zero size 2024-02-07T12:25:55.039 INFO:tasks.workunit.client.0.smithi047.stdout:1/358: dread d1/d15/d18/d40/f61 [0,4194304] 0 2024-02-07T12:25:55.039 INFO:tasks.workunit.client.0.smithi047.stdout:1/359: truncate d1/d15/d18/f1d 1653034 0 2024-02-07T12:25:55.040 INFO:tasks.workunit.client.0.smithi047.stdout:6/437: creat d3/d1e/f96 x:0 0 0 2024-02-07T12:25:55.041 INFO:tasks.workunit.client.0.smithi047.stdout:6/438: write d3/da/d14/f88 [13360,94681] 0 2024-02-07T12:25:55.042 INFO:tasks.workunit.client.0.smithi047.stdout:7/434: creat d0/df/f8b x:0 0 0 2024-02-07T12:25:55.044 INFO:tasks.workunit.client.0.smithi047.stdout:1/360: dread d1/d15/d2f/d3d/f5c [0,4194304] 0 2024-02-07T12:25:55.044 INFO:tasks.workunit.client.0.smithi047.stdout:1/361: stat d1/d15/d2f/d3d/f5c 0 2024-02-07T12:25:55.044 INFO:tasks.workunit.client.0.smithi047.stdout:1/362: stat d1/d15/d18/d65/l6f 0 2024-02-07T12:25:55.044 INFO:tasks.workunit.client.0.smithi047.stdout:6/439: creat d3/d5/d35/d3c/d90/f97 x:0 0 0 2024-02-07T12:25:55.045 INFO:tasks.workunit.client.0.smithi047.stdout:6/440: write d3/da/d3b/d52/f81 [3563604,47038] 0 2024-02-07T12:25:55.045 INFO:tasks.workunit.client.0.smithi047.stdout:6/441: dread - d3/da/d14/f62 zero size 2024-02-07T12:25:55.045 INFO:tasks.workunit.client.0.smithi047.stdout:6/442: chown d3/da/d2c/l77 78 1 2024-02-07T12:25:55.046 INFO:tasks.workunit.client.0.smithi047.stdout:1/363: truncate d1/d15/d18/f24 2080552 0 2024-02-07T12:25:55.046 INFO:tasks.workunit.client.0.smithi047.stdout:1/364: fsync d1/d15/d18/d65/f64 0 2024-02-07T12:25:55.047 INFO:tasks.workunit.client.0.smithi047.stdout:6/443: creat d3/da/d2c/d47/f98 x:0 0 0 2024-02-07T12:25:55.048 INFO:tasks.workunit.client.0.smithi047.stdout:6/444: unlink d3/da/d2c/d42/f4c 0 2024-02-07T12:25:55.050 INFO:tasks.workunit.client.0.smithi047.stdout:6/445: link d3/da/d2c/d42/f57 d3/d5/d35/d3c/d90/f99 0 2024-02-07T12:25:55.052 INFO:tasks.workunit.client.0.smithi047.stdout:7/435: read d0/d42/d4d/d67/f73 [744890,72530] 0 2024-02-07T12:25:55.052 INFO:tasks.workunit.client.0.smithi047.stdout:7/436: write d0/d42/d4d/d67/f79 [238380,101777] 0 2024-02-07T12:25:55.055 INFO:tasks.workunit.client.0.smithi047.stdout:1/365: write d1/d15/d18/f2b [6298048,30097] 0 2024-02-07T12:25:55.058 INFO:tasks.workunit.client.0.smithi047.stdout:1/366: rename d1/d2a/l51 to d1/d15/d30/d46/d66/l73 0 2024-02-07T12:25:55.058 INFO:tasks.workunit.client.0.smithi047.stdout:1/367: fsync d1/d15/d2f/d3d/d3e/f4a 0 2024-02-07T12:25:55.059 INFO:tasks.workunit.client.0.smithi047.stdout:1/368: mkdir d1/d48/d74 0 2024-02-07T12:25:55.061 INFO:tasks.workunit.client.0.smithi047.stdout:1/369: mkdir d1/d6e/d75 0 2024-02-07T12:25:55.061 INFO:tasks.workunit.client.0.smithi047.stdout:1/370: creat d1/d15/d2f/f76 x:0 0 0 2024-02-07T12:25:55.062 INFO:tasks.workunit.client.0.smithi047.stdout:1/371: symlink d1/d37/l77 0 2024-02-07T12:25:55.067 INFO:tasks.workunit.client.0.smithi047.stdout:7/437: write d0/d42/f4f [1475121,91348] 0 2024-02-07T12:25:55.067 INFO:tasks.workunit.client.0.smithi047.stdout:7/438: stat d0/d6f 0 2024-02-07T12:25:55.069 INFO:tasks.workunit.client.0.smithi047.stdout:7/439: creat d0/df/d29/d31/d40/f8c x:0 0 0 2024-02-07T12:25:55.070 INFO:tasks.workunit.client.0.smithi047.stdout:7/440: rename d0/df/d29/d31/d55/c61 to d0/df/d74/c8d 0 2024-02-07T12:25:55.071 INFO:tasks.workunit.client.0.smithi047.stdout:1/372: dread d1/d15/d18/d40/f56 [0,4194304] 0 2024-02-07T12:25:55.072 INFO:tasks.workunit.client.0.smithi047.stdout:7/441: creat d0/df/d29/d3e/d4c/f8e x:0 0 0 2024-02-07T12:25:55.072 INFO:tasks.workunit.client.0.smithi047.stdout:7/442: fsync d0/d4/f17 0 2024-02-07T12:25:55.074 INFO:tasks.workunit.client.0.smithi047.stdout:1/373: mknod d1/d15/d2f/d3d/d3e/c78 0 2024-02-07T12:25:55.074 INFO:tasks.workunit.client.0.smithi047.stdout:6/446: dwrite d3/d5/d35/d3c/d90/f99 [4194304,4194304] 0 2024-02-07T12:25:55.075 INFO:tasks.workunit.client.0.smithi047.stdout:7/443: mknod d0/d42/d4d/d67/c8f 0 2024-02-07T12:25:55.076 INFO:tasks.workunit.client.0.smithi047.stdout:1/374: creat d1/d15/f79 x:0 0 0 2024-02-07T12:25:55.076 INFO:tasks.workunit.client.0.smithi047.stdout:1/375: read - d1/d37/f60 zero size 2024-02-07T12:25:55.077 INFO:tasks.workunit.client.0.smithi047.stdout:1/376: dread - d1/d15/d2f/f76 zero size 2024-02-07T12:25:55.077 INFO:tasks.workunit.client.0.smithi047.stdout:1/377: stat d1/d15/d30/d46/d4c/f6d 0 2024-02-07T12:25:55.077 INFO:tasks.workunit.client.0.smithi047.stdout:1/378: readlink d1/l38 0 2024-02-07T12:25:55.077 INFO:tasks.workunit.client.0.smithi047.stdout:6/447: mkdir d3/da/d14/d28/d9a 0 2024-02-07T12:25:55.077 INFO:tasks.workunit.client.0.smithi047.stdout:6/448: dread - d3/da/d3b/f85 zero size 2024-02-07T12:25:55.077 INFO:tasks.workunit.client.0.smithi047.stdout:6/449: dread - d3/da/d14/d28/d46/f6c zero size 2024-02-07T12:25:55.080 INFO:tasks.workunit.client.0.smithi047.stdout:1/379: creat d1/d15/d2f/d3d/d3e/f7a x:0 0 0 2024-02-07T12:25:55.080 INFO:tasks.workunit.client.0.smithi047.stdout:1/380: chown d1/d15/d30/f6a 484898370 1 2024-02-07T12:25:55.081 INFO:tasks.workunit.client.0.smithi047.stdout:6/450: mknod d3/d5/d35/d3c/d72/c9b 0 2024-02-07T12:25:55.081 INFO:tasks.workunit.client.0.smithi047.stdout:6/451: fdatasync d3/d5/d35/d3c/d72/d8c/d95/f78 0 2024-02-07T12:25:55.081 INFO:tasks.workunit.client.0.smithi047.stdout:1/381: dread d1/d15/d2f/d3d/d3e/f57 [0,4194304] 0 2024-02-07T12:25:55.082 INFO:tasks.workunit.client.0.smithi047.stdout:6/452: mknod d3/da/d3b/d55/c9c 0 2024-02-07T12:25:55.082 INFO:tasks.workunit.client.0.smithi047.stdout:6/453: chown d3/d5/d35/d3c/d72/d8c/d91 6290 1 2024-02-07T12:25:55.083 INFO:tasks.workunit.client.0.smithi047.stdout:1/382: mknod d1/d15/d2f/d3d/d3e/c7b 0 2024-02-07T12:25:55.083 INFO:tasks.workunit.client.0.smithi047.stdout:1/383: write d1/d15/d18/d40/f61 [5107888,57048] 0 2024-02-07T12:25:55.085 INFO:tasks.workunit.client.0.smithi047.stdout:6/454: unlink d3/da/d3b/l75 0 2024-02-07T12:25:55.085 INFO:tasks.workunit.client.0.smithi047.stdout:6/455: creat d3/da/d3b/f9d x:0 0 0 2024-02-07T12:25:55.086 INFO:tasks.workunit.client.0.smithi047.stdout:6/456: chown d3/da/d14 63992 1 2024-02-07T12:25:55.093 INFO:tasks.workunit.client.0.smithi047.stdout:7/444: dwrite d0/df/d29/d3e/f56 [0,4194304] 0 2024-02-07T12:25:55.095 INFO:tasks.workunit.client.0.smithi047.stdout:7/445: unlink d0/df/l87 0 2024-02-07T12:25:55.095 INFO:tasks.workunit.client.0.smithi047.stdout:7/446: symlink d0/d6f/l90 0 2024-02-07T12:25:55.098 INFO:tasks.workunit.client.0.smithi047.stdout:7/447: rmdir d0/df/d29/d31/d40 39 2024-02-07T12:25:55.098 INFO:tasks.workunit.client.0.smithi047.stdout:7/448: truncate d0/d42/f4f 9405335 0 2024-02-07T12:25:55.098 INFO:tasks.workunit.client.0.smithi047.stdout:7/449: chown d0/d2f/l7c 1421485093 1 2024-02-07T12:25:55.098 INFO:tasks.workunit.client.0.smithi047.stdout:7/450: truncate d0/f7a 627405 0 2024-02-07T12:25:55.099 INFO:tasks.workunit.client.0.smithi047.stdout:6/457: dread d3/d5/f27 [0,4194304] 0 2024-02-07T12:25:55.099 INFO:tasks.workunit.client.0.smithi047.stdout:7/451: mknod d0/df/d29/d3e/d4c/c91 0 2024-02-07T12:25:55.100 INFO:tasks.workunit.client.0.smithi047.stdout:6/458: mkdir d3/da/d14/d9e 0 2024-02-07T12:25:55.101 INFO:tasks.workunit.client.0.smithi047.stdout:7/452: mknod d0/d6f/c92 0 2024-02-07T12:25:55.102 INFO:tasks.workunit.client.0.smithi047.stdout:7/453: stat d0/f2 0 2024-02-07T12:25:55.146 INFO:tasks.workunit.client.0.smithi047.stdout:6/459: dwrite d3/d1e/f21 [8388608,4194304] 0 2024-02-07T12:25:55.147 INFO:tasks.workunit.client.0.smithi047.stdout:6/460: mkdir d3/da/d34/d6d/d9f 0 2024-02-07T12:25:55.154 INFO:tasks.workunit.client.0.smithi047.stdout:7/454: dwrite d0/df/d29/f68 [0,4194304] 0 2024-02-07T12:25:55.156 INFO:tasks.workunit.client.0.smithi047.stdout:7/455: read d0/d4/f16 [41948,82304] 0 2024-02-07T12:25:55.156 INFO:tasks.workunit.client.0.smithi047.stdout:7/456: write d0/df/f8b [537486,62286] 0 2024-02-07T12:25:55.161 INFO:tasks.workunit.client.0.smithi047.stdout:6/461: dwrite d3/da/f74 [0,4194304] 0 2024-02-07T12:25:55.161 INFO:tasks.workunit.client.0.smithi047.stdout:6/462: creat d3/da/d14/fa0 x:0 0 0 2024-02-07T12:25:55.163 INFO:tasks.workunit.client.0.smithi047.stdout:6/463: mknod d3/da/d14/ca1 0 2024-02-07T12:25:55.163 INFO:tasks.workunit.client.0.smithi047.stdout:7/457: dread d0/df/f8b [0,4194304] 0 2024-02-07T12:25:55.165 INFO:tasks.workunit.client.0.smithi047.stdout:6/464: symlink d3/d5/d35/d3c/la2 0 2024-02-07T12:25:55.165 INFO:tasks.workunit.client.0.smithi047.stdout:7/458: getdents d0/df/d74 0 2024-02-07T12:25:55.166 INFO:tasks.workunit.client.0.smithi047.stdout:6/465: link d3/da/d14/c68 d3/ca3 0 2024-02-07T12:25:55.167 INFO:tasks.workunit.client.0.smithi047.stdout:7/459: symlink d0/df/d29/d31/l93 0 2024-02-07T12:25:55.168 INFO:tasks.workunit.client.0.smithi047.stdout:7/460: chown d0/f64 11112 1 2024-02-07T12:25:55.168 INFO:tasks.workunit.client.0.smithi047.stdout:7/461: write d0/d42/d4d/f69 [1818863,47758] 0 2024-02-07T12:25:55.168 INFO:tasks.workunit.client.0.smithi047.stdout:7/462: write d0/d4/f20 [4492631,44715] 0 2024-02-07T12:25:55.168 INFO:tasks.workunit.client.0.smithi047.stdout:7/463: readlink d0/df/d29/l63 0 2024-02-07T12:25:55.168 INFO:tasks.workunit.client.0.smithi047.stdout:6/466: mknod d3/da/d2c/d42/ca4 0 2024-02-07T12:25:55.169 INFO:tasks.workunit.client.0.smithi047.stdout:7/464: rename d0/df/d29/d31/l38 to d0/df/d29/d3e/l94 0 2024-02-07T12:25:55.170 INFO:tasks.workunit.client.0.smithi047.stdout:6/467: symlink d3/da/d34/d6d/d9f/la5 0 2024-02-07T12:25:55.170 INFO:tasks.workunit.client.0.smithi047.stdout:6/468: chown d3/da/l38 1101 1 2024-02-07T12:25:55.171 INFO:tasks.workunit.client.0.smithi047.stdout:6/469: rename d3/d5/d35/d3c/d72/d8c/d95/l43 to d3/d5/d35/d3c/d72/d8c/la6 0 2024-02-07T12:25:55.172 INFO:tasks.workunit.client.0.smithi047.stdout:6/470: creat d3/da/d34/d6d/fa7 x:0 0 0 2024-02-07T12:25:55.172 INFO:tasks.workunit.client.0.smithi047.stdout:6/471: chown d3/d5/f13 2178 1 2024-02-07T12:25:55.172 INFO:tasks.workunit.client.0.smithi047.stdout:6/472: dread d3/da/d34/f5a [0,4194304] 0 2024-02-07T12:25:55.173 INFO:tasks.workunit.client.0.smithi047.stdout:6/473: mkdir d3/d5/d35/da8 0 2024-02-07T12:25:55.178 INFO:tasks.workunit.client.0.smithi047.stdout:7/465: dread d0/df/d29/d31/d40/f49 [0,4194304] 0 2024-02-07T12:25:55.179 INFO:tasks.workunit.client.0.smithi047.stdout:7/466: unlink d0/df/d29/f65 0 2024-02-07T12:25:55.188 INFO:tasks.workunit.client.0.smithi047.stdout:7/467: write d0/d4/f5 [6855928,28939] 0 2024-02-07T12:25:55.189 INFO:tasks.workunit.client.0.smithi047.stdout:7/468: chown d0/df/d29/d31/d55/l62 1063574642 1 2024-02-07T12:25:55.189 INFO:tasks.workunit.client.0.smithi047.stdout:7/469: chown d0/df/d29/c3d 86 1 2024-02-07T12:25:55.189 INFO:tasks.workunit.client.0.smithi047.stdout:7/470: write d0/d4/f20 [2038768,67104] 0 2024-02-07T12:25:55.189 INFO:tasks.workunit.client.0.smithi047.stdout:7/471: symlink d0/d2f/l95 0 2024-02-07T12:25:55.190 INFO:tasks.workunit.client.0.smithi047.stdout:7/472: creat d0/df/d29/d31/f96 x:0 0 0 2024-02-07T12:25:55.191 INFO:tasks.workunit.client.0.smithi047.stdout:7/473: rmdir d0/d6f 39 2024-02-07T12:25:55.192 INFO:tasks.workunit.client.0.smithi047.stdout:7/474: mkdir d0/df/d29/d3e/d4c/d97 0 2024-02-07T12:25:55.192 INFO:tasks.workunit.client.0.smithi047.stdout:7/475: readlink d0/df/l54 0 2024-02-07T12:25:55.192 INFO:tasks.workunit.client.0.smithi047.stdout:7/476: dread - d0/df/d29/d3e/d4c/f8e zero size 2024-02-07T12:25:55.192 INFO:tasks.workunit.client.0.smithi047.stdout:7/477: read - d0/df/d29/f5b zero size 2024-02-07T12:25:55.194 INFO:tasks.workunit.client.0.smithi047.stdout:7/478: truncate d0/df/d29/d31/f34 1790549 0 2024-02-07T12:25:55.194 INFO:tasks.workunit.client.0.smithi047.stdout:7/479: stat d0/f64 0 2024-02-07T12:25:55.202 INFO:tasks.workunit.client.0.smithi047.stdout:7/480: dread d0/df/d29/d3e/f56 [0,4194304] 0 2024-02-07T12:25:55.204 INFO:tasks.workunit.client.0.smithi047.stdout:7/481: unlink d0/df/d29/d3e/d4c/f6a 0 2024-02-07T12:25:55.204 INFO:tasks.workunit.client.0.smithi047.stdout:7/482: stat d0/df/d29/c76 0 2024-02-07T12:25:55.204 INFO:tasks.workunit.client.0.smithi047.stdout:7/483: creat d0/d42/d4d/d67/f98 x:0 0 0 2024-02-07T12:25:55.207 INFO:tasks.workunit.client.0.smithi047.stdout:7/484: unlink d0/f7a 0 2024-02-07T12:25:55.207 INFO:tasks.workunit.client.0.smithi047.stdout:7/485: creat d0/df/d29/d31/f99 x:0 0 0 2024-02-07T12:25:55.214 INFO:tasks.workunit.client.0.smithi047.stdout:7/486: truncate d0/d4/f5 149196 0 2024-02-07T12:25:55.216 INFO:tasks.workunit.client.0.smithi047.stdout:7/487: truncate d0/df/d29/d31/f34 1314137 0 2024-02-07T12:25:55.218 INFO:tasks.workunit.client.0.smithi047.stdout:7/488: mknod d0/d6f/c9a 0 2024-02-07T12:25:55.228 INFO:tasks.workunit.client.0.smithi047.stdout:7/489: dread d0/d4/f33 [0,4194304] 0 2024-02-07T12:25:55.234 INFO:tasks.workunit.client.0.smithi047.stdout:7/490: write d0/d4/f17 [2455129,118508] 0 2024-02-07T12:25:55.236 INFO:tasks.workunit.client.0.smithi047.stdout:7/491: getdents d0/d42/d4d 0 2024-02-07T12:25:55.237 INFO:tasks.workunit.client.0.smithi047.stdout:7/492: creat d0/d6f/f9b x:0 0 0 2024-02-07T12:25:55.247 INFO:tasks.workunit.client.0.smithi047.stdout:7/493: dwrite d0/d4/f5 [0,4194304] 0 2024-02-07T12:25:55.247 INFO:tasks.workunit.client.0.smithi047.stdout:7/494: write d0/d6f/f71 [1034944,97108] 0 2024-02-07T12:25:55.248 INFO:tasks.workunit.client.0.smithi047.stdout:7/495: unlink d0/f64 0 2024-02-07T12:25:55.248 INFO:tasks.workunit.client.0.smithi047.stdout:7/496: readlink d0/d2f/l70 0 2024-02-07T12:25:55.249 INFO:tasks.workunit.client.0.smithi047.stdout:7/497: creat d0/d4/f9c x:0 0 0 2024-02-07T12:25:55.249 INFO:tasks.workunit.client.0.smithi047.stdout:7/498: fsync d0/d42/d4d/d67/f82 0 2024-02-07T12:25:55.249 INFO:tasks.workunit.client.0.smithi047.stdout:7/499: chown d0/d42/d4d/d67/c8f 21 1 2024-02-07T12:25:55.250 INFO:tasks.workunit.client.0.smithi047.stdout:7/500: symlink d0/df/d74/l9d 0 2024-02-07T12:25:55.252 INFO:tasks.workunit.client.0.smithi047.stdout:7/501: fsync d0/d42/f57 0 2024-02-07T12:25:55.252 INFO:tasks.workunit.client.0.smithi047.stdout:7/502: chown d0/df/d74/c8d 34487530 1 2024-02-07T12:25:55.252 INFO:tasks.workunit.client.0.smithi047.stdout:7/503: readlink d0/df/d29/l3b 0 2024-02-07T12:25:55.252 INFO:tasks.workunit.client.0.smithi047.stdout:7/504: getdents d0/d42/d4d 0 2024-02-07T12:25:55.254 INFO:tasks.workunit.client.0.smithi047.stdout:7/505: rename d0/d4/f33 to d0/df/d29/d31/d40/f9e 0 2024-02-07T12:25:55.268 INFO:tasks.workunit.client.0.smithi047.stdout:7/506: dwrite d0/df/d29/f89 [0,4194304] 0 2024-02-07T12:25:55.268 INFO:tasks.workunit.client.0.smithi047.stdout:7/507: write d0/df/d29/f23 [1384148,80359] 0 2024-02-07T12:25:55.271 INFO:tasks.workunit.client.0.smithi047.stdout:7/508: symlink d0/df/d29/d3e/d4c/l9f 0 2024-02-07T12:25:55.273 INFO:tasks.workunit.client.0.smithi047.stdout:7/509: mknod d0/ca0 0 2024-02-07T12:25:55.273 INFO:tasks.workunit.client.0.smithi047.stdout:7/510: chown d0/df/c72 3 1 2024-02-07T12:25:55.273 INFO:tasks.workunit.client.0.smithi047.stdout:7/511: creat d0/df/d29/d3e/d4c/fa1 x:0 0 0 2024-02-07T12:25:55.275 INFO:tasks.workunit.client.0.smithi047.stdout:7/512: truncate d0/d42/d4d/f69 57472 0 2024-02-07T12:25:55.276 INFO:tasks.workunit.client.0.smithi047.stdout:7/513: unlink d0/d42/d4d/d67/f82 0 2024-02-07T12:25:55.276 INFO:tasks.workunit.client.0.smithi047.stdout:7/514: fdatasync d0/df/d29/d3e/f60 0 2024-02-07T12:25:55.288 INFO:tasks.workunit.client.0.smithi047.stdout:2/482: sync 2024-02-07T12:25:55.288 INFO:tasks.workunit.client.0.smithi047.stdout:0/201: sync 2024-02-07T12:25:55.288 INFO:tasks.workunit.client.0.smithi047.stdout:3/530: sync 2024-02-07T12:25:55.288 INFO:tasks.workunit.client.0.smithi047.stdout:0/202: fdatasync fa 0 2024-02-07T12:25:55.288 INFO:tasks.workunit.client.0.smithi047.stdout:0/203: truncate d19/d1c/d24/f2a 781098 0 2024-02-07T12:25:55.289 INFO:tasks.workunit.client.0.smithi047.stdout:3/531: symlink d12/d19/d2d/d33/d8d/lb1 0 2024-02-07T12:25:55.291 INFO:tasks.workunit.client.0.smithi047.stdout:0/204: creat d19/d1c/d24/f35 x:0 0 0 2024-02-07T12:25:55.291 INFO:tasks.workunit.client.0.smithi047.stdout:0/205: chown d19/d1c/d24/f35 419311 1 2024-02-07T12:25:55.291 INFO:tasks.workunit.client.0.smithi047.stdout:0/206: write d19/f2d [6372280,128477] 0 2024-02-07T12:25:55.296 INFO:tasks.workunit.client.0.smithi047.stdout:2/483: write d7/dc/f76 [2424516,74498] 0 2024-02-07T12:25:55.297 INFO:tasks.workunit.client.0.smithi047.stdout:7/515: dwrite d0/d42/f57 [0,4194304] 0 2024-02-07T12:25:55.300 INFO:tasks.workunit.client.0.smithi047.stdout:2/484: mkdir d7/d2d/d5c/d77/d92 0 2024-02-07T12:25:55.301 INFO:tasks.workunit.client.0.smithi047.stdout:3/532: write d12/d19/d21/d29/d31/d38/f71 [413980,106610] 0 2024-02-07T12:25:55.302 INFO:tasks.workunit.client.0.smithi047.stdout:7/516: mkdir d0/d4/da2 0 2024-02-07T12:25:55.302 INFO:tasks.workunit.client.0.smithi047.stdout:7/517: creat d0/d42/fa3 x:0 0 0 2024-02-07T12:25:55.303 INFO:tasks.workunit.client.0.smithi047.stdout:0/207: write f14 [540888,13636] 0 2024-02-07T12:25:55.304 INFO:tasks.workunit.client.0.smithi047.stdout:3/533: mknod d12/d19/d21/d29/d31/d7c/d8c/cb2 0 2024-02-07T12:25:55.306 INFO:tasks.workunit.client.0.smithi047.stdout:7/518: creat d0/fa4 x:0 0 0 2024-02-07T12:25:55.306 INFO:tasks.workunit.client.0.smithi047.stdout:7/519: write d0/f2 [4731785,115180] 0 2024-02-07T12:25:55.307 INFO:tasks.workunit.client.0.smithi047.stdout:7/520: symlink d0/la5 0 2024-02-07T12:25:55.307 INFO:tasks.workunit.client.0.smithi047.stdout:7/521: write d0/d4/f20 [4250131,53311] 0 2024-02-07T12:25:55.309 INFO:tasks.workunit.client.0.smithi047.stdout:7/522: link d0/df/d29/f23 d0/df/d29/fa6 0 2024-02-07T12:25:55.310 INFO:tasks.workunit.client.0.smithi047.stdout:7/523: chown d0/d42/d4d/c8a 364771491 1 2024-02-07T12:25:55.310 INFO:tasks.workunit.client.0.smithi047.stdout:7/524: fsync d0/d42/d4d/d67/f79 0 2024-02-07T12:25:55.311 INFO:tasks.workunit.client.0.smithi047.stdout:7/525: unlink d0/df/d74/c78 0 2024-02-07T12:25:55.311 INFO:tasks.workunit.client.0.smithi047.stdout:7/526: chown d0/d42 86 1 2024-02-07T12:25:55.317 INFO:tasks.workunit.client.0.smithi047.stdout:0/208: dread fa [0,4194304] 0 2024-02-07T12:25:55.317 INFO:tasks.workunit.client.0.smithi047.stdout:0/209: creat d19/d1c/d24/f36 x:0 0 0 2024-02-07T12:25:55.319 INFO:tasks.workunit.client.0.smithi047.stdout:0/210: mkdir d19/d25/d2f/d37 0 2024-02-07T12:25:55.320 INFO:tasks.workunit.client.0.smithi047.stdout:0/211: creat d19/d1c/d2c/f38 x:0 0 0 2024-02-07T12:25:55.324 INFO:tasks.workunit.client.0.smithi047.stdout:7/527: write d0/df/d29/d3e/f46 [3353878,62773] 0 2024-02-07T12:25:55.324 INFO:tasks.workunit.client.0.smithi047.stdout:7/528: creat d0/d42/fa7 x:0 0 0 2024-02-07T12:25:55.325 INFO:tasks.workunit.client.0.smithi047.stdout:7/529: mkdir d0/da8 0 2024-02-07T12:25:55.326 INFO:tasks.workunit.client.0.smithi047.stdout:2/485: dwrite d7/dc/f84 [0,4194304] 0 2024-02-07T12:25:55.326 INFO:tasks.workunit.client.0.smithi047.stdout:2/486: dread - d7/dc/d71/f87 zero size 2024-02-07T12:25:55.326 INFO:tasks.workunit.client.0.smithi047.stdout:3/534: dwrite d12/d19/d21/d29/d31/f3e [4194304,4194304] 0 2024-02-07T12:25:55.328 INFO:tasks.workunit.client.0.smithi047.stdout:2/487: unlink d7/dc/f35 0 2024-02-07T12:25:55.329 INFO:tasks.workunit.client.0.smithi047.stdout:7/530: write d0/df/d29/d3e/f56 [4107538,34086] 0 2024-02-07T12:25:55.331 INFO:tasks.workunit.client.0.smithi047.stdout:3/535: creat d12/d19/d21/d29/d31/d7c/fb3 x:0 0 0 2024-02-07T12:25:55.333 INFO:tasks.workunit.client.0.smithi047.stdout:2/488: symlink d7/d2d/d5c/d77/d92/l93 0 2024-02-07T12:25:55.333 INFO:tasks.workunit.client.0.smithi047.stdout:2/489: creat d7/dc/d4c/f94 x:0 0 0 2024-02-07T12:25:55.336 INFO:tasks.workunit.client.0.smithi047.stdout:7/531: mkdir d0/da9 0 2024-02-07T12:25:55.341 INFO:tasks.workunit.client.0.smithi047.stdout:0/212: fsync d19/d1c/d24/f36 0 2024-02-07T12:25:55.342 INFO:tasks.workunit.client.0.smithi047.stdout:0/213: read - d19/d1c/d24/f36 zero size 2024-02-07T12:25:55.346 INFO:tasks.workunit.client.0.smithi047.stdout:7/532: rename d0/df/d29/d31/d55/l62 to d0/df/d29/d3e/d4c/d97/laa 0 2024-02-07T12:25:55.347 INFO:tasks.workunit.client.0.smithi047.stdout:7/533: stat d0/df/c35 0 2024-02-07T12:25:55.349 INFO:tasks.workunit.client.0.smithi047.stdout:0/214: creat d19/d25/d2f/d37/f39 x:0 0 0 2024-02-07T12:25:55.350 INFO:tasks.workunit.client.0.smithi047.stdout:0/215: write d19/d1c/d24/f36 [501957,45950] 0 2024-02-07T12:25:55.350 INFO:tasks.workunit.client.0.smithi047.stdout:0/216: rename d19 to d19/d25/d2f/d37/d3a 22 2024-02-07T12:25:55.357 INFO:tasks.workunit.client.0.smithi047.stdout:0/217: dread f15 [0,4194304] 0 2024-02-07T12:25:55.358 INFO:tasks.workunit.client.0.smithi047.stdout:0/218: symlink d19/d25/l3b 0 2024-02-07T12:25:55.363 INFO:tasks.workunit.client.0.smithi047.stdout:7/534: dwrite d0/df/d29/d31/d40/f8c [0,4194304] 0 2024-02-07T12:25:55.368 INFO:tasks.workunit.client.0.smithi047.stdout:0/219: rename d19/d25/d2f to d19/d1c/d3c 0 2024-02-07T12:25:55.373 INFO:tasks.workunit.client.0.smithi047.stdout:7/535: rmdir d0/df 39 2024-02-07T12:25:55.374 INFO:tasks.workunit.client.0.smithi047.stdout:0/220: mkdir d19/d1c/d3c/d37/d3d 0 2024-02-07T12:25:55.376 INFO:tasks.workunit.client.0.smithi047.stdout:0/221: rmdir d19/d25 39 2024-02-07T12:25:55.378 INFO:tasks.workunit.client.0.smithi047.stdout:0/222: fdatasync d19/d1c/d24/f36 0 2024-02-07T12:25:55.381 INFO:tasks.workunit.client.0.smithi047.stdout:7/536: rmdir d0 39 2024-02-07T12:25:55.382 INFO:tasks.workunit.client.0.smithi047.stdout:7/537: mknod d0/d42/cab 0 2024-02-07T12:25:55.382 INFO:tasks.workunit.client.0.smithi047.stdout:7/538: stat d0/df/d29/d3e/l94 0 2024-02-07T12:25:55.384 INFO:tasks.workunit.client.0.smithi047.stdout:0/223: dread f14 [0,4194304] 0 2024-02-07T12:25:55.384 INFO:tasks.workunit.client.0.smithi047.stdout:0/224: fsync d19/f27 0 2024-02-07T12:25:55.384 INFO:tasks.workunit.client.0.smithi047.stdout:0/225: truncate d19/f34 9238020 0 2024-02-07T12:25:55.385 INFO:tasks.workunit.client.0.smithi047.stdout:0/226: symlink d19/d1c/l3e 0 2024-02-07T12:25:55.389 INFO:tasks.workunit.client.0.smithi047.stdout:0/227: rmdir d19/d1c 39 2024-02-07T12:25:55.389 INFO:tasks.workunit.client.0.smithi047.stdout:0/228: write d19/d1c/f31 [969176,123322] 0 2024-02-07T12:25:55.390 INFO:tasks.workunit.client.0.smithi047.stdout:7/539: write d0/df/f11 [3573546,43842] 0 2024-02-07T12:25:55.390 INFO:tasks.workunit.client.0.smithi047.stdout:7/540: chown d0/df/d29/d31 2515 1 2024-02-07T12:25:55.390 INFO:tasks.workunit.client.0.smithi047.stdout:7/541: dread - d0/df/d29/d3e/f43 zero size 2024-02-07T12:25:55.391 INFO:tasks.workunit.client.0.smithi047.stdout:0/229: unlink d19/d1c/d24/f36 0 2024-02-07T12:25:55.391 INFO:tasks.workunit.client.0.smithi047.stdout:0/230: chown d19/d25 236 1 2024-02-07T12:25:55.392 INFO:tasks.workunit.client.0.smithi047.stdout:0/231: mkdir d19/d1c/d3c/d37/d3d/d3f 0 2024-02-07T12:25:55.392 INFO:tasks.workunit.client.0.smithi047.stdout:0/232: stat d19/d1c/d3c/d37/f39 0 2024-02-07T12:25:55.406 INFO:tasks.workunit.client.0.smithi047.stdout:0/233: dwrite f15 [0,4194304] 0 2024-02-07T12:25:55.419 INFO:tasks.workunit.client.0.smithi047.stdout:0/234: dwrite fc [4194304,4194304] 0 2024-02-07T12:25:55.421 INFO:tasks.workunit.client.0.smithi047.stdout:0/235: getdents d19/d1c/d2b 0 2024-02-07T12:25:55.421 INFO:tasks.workunit.client.0.smithi047.stdout:0/236: chown fa 5800 1 2024-02-07T12:25:55.421 INFO:tasks.workunit.client.0.smithi047.stdout:0/237: mkdir d19/d40 0 2024-02-07T12:25:55.421 INFO:tasks.workunit.client.0.smithi047.stdout:0/238: stat d19/f2e 0 2024-02-07T12:25:55.422 INFO:tasks.workunit.client.0.smithi047.stdout:0/239: mknod d19/d1c/c41 0 2024-02-07T12:25:55.424 INFO:tasks.workunit.client.0.smithi047.stdout:0/240: rmdir d19/d1c/d3c/d37/d3d/d3f 0 2024-02-07T12:25:55.424 INFO:tasks.workunit.client.0.smithi047.stdout:0/241: fdatasync d19/d1c/f30 0 2024-02-07T12:25:55.424 INFO:tasks.workunit.client.0.smithi047.stdout:0/242: write d19/d1c/d3c/d37/f39 [464424,76418] 0 2024-02-07T12:25:55.424 INFO:tasks.workunit.client.0.smithi047.stdout:0/243: chown d19/d1c/d2c/f38 13374 1 2024-02-07T12:25:55.425 INFO:tasks.workunit.client.0.smithi047.stdout:0/244: creat d19/d1c/d2c/f42 x:0 0 0 2024-02-07T12:25:55.425 INFO:tasks.workunit.client.0.smithi047.stdout:0/245: fsync f14 0 2024-02-07T12:25:55.440 INFO:tasks.workunit.client.0.smithi047.stdout:0/246: dwrite f15 [0,4194304] 0 2024-02-07T12:25:55.440 INFO:tasks.workunit.client.0.smithi047.stdout:0/247: readlink d19/d25/l3b 0 2024-02-07T12:25:55.451 INFO:tasks.workunit.client.0.smithi047.stdout:0/248: dwrite d19/f27 [0,4194304] 0 2024-02-07T12:25:55.453 INFO:tasks.workunit.client.0.smithi047.stdout:0/249: truncate f1 3754933 0 2024-02-07T12:25:55.454 INFO:tasks.workunit.client.0.smithi047.stdout:0/250: getdents d19/d1c/d3c/d37/d3d 0 2024-02-07T12:25:55.455 INFO:tasks.workunit.client.0.smithi047.stdout:0/251: truncate d19/f27 4768863 0 2024-02-07T12:25:55.470 INFO:tasks.workunit.client.0.smithi047.stdout:0/252: dwrite f15 [0,4194304] 0 2024-02-07T12:25:55.470 INFO:tasks.workunit.client.0.smithi047.stdout:0/253: write d19/d1c/d24/f35 [489015,77293] 0 2024-02-07T12:25:55.470 INFO:tasks.workunit.client.0.smithi047.stdout:0/254: creat d19/d1c/f43 x:0 0 0 2024-02-07T12:25:55.471 INFO:tasks.workunit.client.0.smithi047.stdout:0/255: rename d19/d25/l3b to d19/d40/l44 0 2024-02-07T12:25:55.471 INFO:tasks.workunit.client.0.smithi047.stdout:0/256: write f14 [1263974,113637] 0 2024-02-07T12:25:55.471 INFO:tasks.workunit.client.0.smithi047.stdout:0/257: stat c9 0 2024-02-07T12:25:55.472 INFO:tasks.workunit.client.0.smithi047.stdout:0/258: rename f17 to d19/f45 0 2024-02-07T12:25:55.472 INFO:tasks.workunit.client.0.smithi047.stdout:0/259: truncate d19/f2e 485452 0 2024-02-07T12:25:55.473 INFO:tasks.workunit.client.0.smithi047.stdout:0/260: mkdir d19/d1c/d3c/d37/d3d/d46 0 2024-02-07T12:25:55.474 INFO:tasks.workunit.client.0.smithi047.stdout:0/261: rename d19/d1c/c28 to d19/d1c/d2b/c47 0 2024-02-07T12:25:55.475 INFO:tasks.workunit.client.0.smithi047.stdout:0/262: mkdir d19/d1c/d3c/d48 0 2024-02-07T12:25:55.476 INFO:tasks.workunit.client.0.smithi047.stdout:0/263: mkdir d19/d1c/d2c/d49 0 2024-02-07T12:25:55.476 INFO:tasks.workunit.client.0.smithi047.stdout:0/264: write d19/d1c/f31 [2081699,47267] 0 2024-02-07T12:25:55.490 INFO:tasks.workunit.client.0.smithi047.stdout:0/265: dwrite d19/f45 [8388608,4194304] 0 2024-02-07T12:25:55.502 INFO:tasks.workunit.client.0.smithi047.stdout:0/266: dwrite d19/d1c/d24/f2a [0,4194304] 0 2024-02-07T12:25:55.504 INFO:tasks.workunit.client.0.smithi047.stdout:0/267: mknod d19/d40/c4a 0 2024-02-07T12:25:55.504 INFO:tasks.workunit.client.0.smithi047.stdout:0/268: symlink d19/d1c/d24/l4b 0 2024-02-07T12:25:55.504 INFO:tasks.workunit.client.0.smithi047.stdout:0/269: write d19/d1c/d2c/f38 [535470,19666] 0 2024-02-07T12:25:55.514 INFO:tasks.workunit.client.0.smithi047.stdout:0/270: dread f14 [0,4194304] 0 2024-02-07T12:25:55.523 INFO:tasks.workunit.client.0.smithi047.stdout:0/271: symlink d19/d1c/d24/l4c 0 2024-02-07T12:25:55.524 INFO:tasks.workunit.client.0.smithi047.stdout:0/272: getdents d19/d1c/d3c 0 2024-02-07T12:25:55.526 INFO:tasks.workunit.client.0.smithi047.stdout:0/273: rename d19/d1c/c23 to d19/d1c/d3c/c4d 0 2024-02-07T12:25:55.526 INFO:tasks.workunit.client.0.smithi047.stdout:0/274: write f14 [3255622,106495] 0 2024-02-07T12:25:55.526 INFO:tasks.workunit.client.0.smithi047.stdout:0/275: chown cf 0 1 2024-02-07T12:25:55.538 INFO:tasks.workunit.client.0.smithi047.stdout:0/276: dwrite f18 [0,4194304] 0 2024-02-07T12:25:55.550 INFO:tasks.workunit.client.0.smithi047.stdout:0/277: dwrite f1 [0,4194304] 0 2024-02-07T12:25:55.630 INFO:tasks.workunit.client.0.smithi047.stdout:0/278: creat d19/d1c/d3c/d48/f4e x:0 0 0 2024-02-07T12:25:55.637 INFO:tasks.workunit.client.0.smithi047.stdout:0/279: write f15 [378963,79746] 0 2024-02-07T12:25:55.638 INFO:tasks.workunit.client.0.smithi047.stdout:0/280: write d19/d1c/f31 [441691,109391] 0 2024-02-07T12:25:55.639 INFO:tasks.workunit.client.0.smithi047.stdout:0/281: symlink d19/d40/l4f 0 2024-02-07T12:25:55.640 INFO:tasks.workunit.client.0.smithi047.stdout:0/282: chown d19/d1c/l3e 6235 1 2024-02-07T12:25:55.640 INFO:tasks.workunit.client.0.smithi047.stdout:0/283: write fa [4895250,103203] 0 2024-02-07T12:25:55.640 INFO:tasks.workunit.client.0.smithi047.stdout:0/284: write fc [8662636,23212] 0 2024-02-07T12:25:55.641 INFO:tasks.workunit.client.0.smithi047.stdout:0/285: mknod d19/d1c/d3c/c50 0 2024-02-07T12:25:55.641 INFO:tasks.workunit.client.0.smithi047.stdout:0/286: creat d19/d1c/d3c/d37/d3d/f51 x:0 0 0 2024-02-07T12:25:55.641 INFO:tasks.workunit.client.0.smithi047.stdout:0/287: symlink d19/d1c/d3c/l52 0 2024-02-07T12:25:55.645 INFO:tasks.workunit.client.0.smithi047.stdout:0/288: truncate fa 1265352 0 2024-02-07T12:25:55.645 INFO:tasks.workunit.client.0.smithi047.stdout:0/289: chown d19/d1c/c29 1812 1 2024-02-07T12:25:55.646 INFO:tasks.workunit.client.0.smithi047.stdout:0/290: rename d19/d1c/d2b/f33 to d19/d40/f53 0 2024-02-07T12:25:55.649 INFO:tasks.workunit.client.0.smithi047.stdout:0/291: link c9 d19/c54 0 2024-02-07T12:25:55.651 INFO:tasks.workunit.client.0.smithi047.stdout:0/292: fsync f15 0 2024-02-07T12:25:55.653 INFO:tasks.workunit.client.0.smithi047.stdout:0/293: creat d19/d25/f55 x:0 0 0 2024-02-07T12:25:55.654 INFO:tasks.workunit.client.0.smithi047.stdout:0/294: link d19/f26 d19/d1c/d24/f56 0 2024-02-07T12:25:55.657 INFO:tasks.workunit.client.0.smithi047.stdout:8/561: sync 2024-02-07T12:25:55.658 INFO:tasks.workunit.client.0.smithi047.stdout:8/562: dread d3/f56 [0,4194304] 0 2024-02-07T12:25:55.660 INFO:tasks.workunit.client.0.smithi047.stdout:8/563: read d3/d36/f7e [136543,44631] 0 2024-02-07T12:25:55.661 INFO:tasks.workunit.client.0.smithi047.stdout:8/564: creat d3/d36/d50/d30/d34/d3e/fba x:0 0 0 2024-02-07T12:25:55.664 INFO:tasks.workunit.client.0.smithi047.stdout:8/565: rename d3/d66/d67/d6a/f69 to d3/d4/fbb 0 2024-02-07T12:25:55.664 INFO:tasks.workunit.client.0.smithi047.stdout:8/566: readlink d3/d36/d50/d30/d34/d3e/l60 0 2024-02-07T12:25:55.665 INFO:tasks.workunit.client.0.smithi047.stdout:8/567: truncate d3/d36/d50/d28/f96 1925029 0 2024-02-07T12:25:55.665 INFO:tasks.workunit.client.0.smithi047.stdout:8/568: truncate d3/d36/d50/f2d 340863 0 2024-02-07T12:25:55.665 INFO:tasks.workunit.client.0.smithi047.stdout:8/569: creat d3/d36/d50/fbc x:0 0 0 2024-02-07T12:25:55.665 INFO:tasks.workunit.client.0.smithi047.stdout:8/570: dread - d3/d36/d50/d30/d9e/da6/fb6 zero size 2024-02-07T12:25:55.673 INFO:tasks.workunit.client.0.smithi047.stdout:0/295: dwrite d19/f34 [8388608,4194304] 0 2024-02-07T12:25:55.674 INFO:tasks.workunit.client.0.smithi047.stdout:0/296: mknod d19/d1c/d2c/c57 0 2024-02-07T12:25:55.676 INFO:tasks.workunit.client.0.smithi047.stdout:0/297: link d19/c21 d19/d1c/d3c/c58 0 2024-02-07T12:25:55.693 INFO:tasks.workunit.client.0.smithi047.stdout:8/571: dwrite d3/d36/d50/d30/f5e [0,4194304] 0 2024-02-07T12:25:55.693 INFO:tasks.workunit.client.0.smithi047.stdout:8/572: stat d3/d4/f55 0 2024-02-07T12:25:55.693 INFO:tasks.workunit.client.0.smithi047.stdout:0/298: dwrite d19/d1c/d2c/f38 [0,4194304] 0 2024-02-07T12:25:55.696 INFO:tasks.workunit.client.0.smithi047.stdout:8/573: mkdir d3/dbd 0 2024-02-07T12:25:55.696 INFO:tasks.workunit.client.0.smithi047.stdout:8/574: write d3/d36/d50/d2a/f32 [1380455,60234] 0 2024-02-07T12:25:55.696 INFO:tasks.workunit.client.0.smithi047.stdout:8/575: mkdir d3/d36/d9d/dbe 0 2024-02-07T12:25:55.702 INFO:tasks.workunit.client.0.smithi047.stdout:0/299: write d19/f34 [8770453,84018] 0 2024-02-07T12:25:55.704 INFO:tasks.workunit.client.0.smithi047.stdout:0/300: write fa [1122305,22239] 0 2024-02-07T12:25:55.705 INFO:tasks.workunit.client.0.smithi047.stdout:0/301: fsync d19/d1c/d24/f56 0 2024-02-07T12:25:55.723 INFO:tasks.workunit.client.0.smithi047.stdout:0/302: dwrite d19/d1c/d3c/d37/d3d/f51 [0,4194304] 0 2024-02-07T12:25:55.727 INFO:tasks.workunit.client.0.smithi047.stdout:0/303: rmdir d19/d1c/d3c 39 2024-02-07T12:25:55.727 INFO:tasks.workunit.client.0.smithi047.stdout:0/304: creat d19/d1c/d24/f59 x:0 0 0 2024-02-07T12:25:55.728 INFO:tasks.workunit.client.0.smithi047.stdout:0/305: symlink d19/d1c/d2c/d49/l5a 0 2024-02-07T12:25:55.728 INFO:tasks.workunit.client.0.smithi047.stdout:0/306: write d19/d1c/d2c/f42 [910868,32820] 0 2024-02-07T12:25:55.733 INFO:tasks.workunit.client.0.smithi047.stdout:0/307: dread f15 [0,4194304] 0 2024-02-07T12:25:55.741 INFO:tasks.workunit.client.0.smithi047.stdout:0/308: read d19/f45 [7713249,84992] 0 2024-02-07T12:25:55.744 INFO:tasks.workunit.client.0.smithi047.stdout:0/309: fdatasync fa 0 2024-02-07T12:25:55.745 INFO:tasks.workunit.client.0.smithi047.stdout:0/310: getdents d19/d40 0 2024-02-07T12:25:55.745 INFO:tasks.workunit.client.0.smithi047.stdout:0/311: creat d19/d1c/d24/f5b x:0 0 0 2024-02-07T12:25:55.751 INFO:tasks.workunit.client.0.smithi047.stdout:0/312: dread d19/d1c/f30 [0,4194304] 0 2024-02-07T12:25:55.751 INFO:tasks.workunit.client.0.smithi047.stdout:0/313: truncate d19/d1c/f43 473269 0 2024-02-07T12:25:55.751 INFO:tasks.workunit.client.0.smithi047.stdout:0/314: truncate d19/f26 836617 0 2024-02-07T12:25:55.752 INFO:tasks.workunit.client.0.smithi047.stdout:0/315: creat d19/d1c/d2c/d49/f5c x:0 0 0 2024-02-07T12:25:55.753 INFO:tasks.workunit.client.0.smithi047.stdout:0/316: rename d19/d1c/d24/l4b to d19/d1c/d3c/d37/d3d/d46/l5d 0 2024-02-07T12:25:55.769 INFO:tasks.workunit.client.0.smithi047.stdout:0/317: dwrite d19/d1c/f30 [0,4194304] 0 2024-02-07T12:25:55.775 INFO:tasks.workunit.client.0.smithi047.stdout:0/318: rmdir d19/d1c/d3c/d37/d3d 39 2024-02-07T12:25:55.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:55 smithi138 ceph-mon[35528]: pgmap v14: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 145 MiB/s rd, 194 MiB/s wr, 401 op/s 2024-02-07T12:25:55.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:55 smithi047 ceph-mon[28972]: pgmap v14: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 145 MiB/s rd, 194 MiB/s wr, 401 op/s 2024-02-07T12:25:55.844 INFO:tasks.workunit.client.0.smithi047.stdout:9/284: sync 2024-02-07T12:25:55.862 INFO:tasks.workunit.client.0.smithi047.stdout:9/285: dwrite d3/d10/d18/f1a [0,4194304] 0 2024-02-07T12:25:55.862 INFO:tasks.workunit.client.0.smithi047.stdout:9/286: stat d3/d10/l38 0 2024-02-07T12:25:55.878 INFO:tasks.workunit.client.0.smithi047.stdout:9/287: dwrite d3/d10/d18/f1b [0,4194304] 0 2024-02-07T12:25:55.881 INFO:tasks.workunit.client.0.smithi047.stdout:9/288: rename d3/f21 to d3/d10/d18/d3d/f65 0 2024-02-07T12:25:55.881 INFO:tasks.workunit.client.0.smithi047.stdout:9/289: stat d3/f51 0 2024-02-07T12:25:55.881 INFO:tasks.workunit.client.0.smithi047.stdout:9/290: creat d3/d10/d4c/f66 x:0 0 0 2024-02-07T12:25:55.882 INFO:tasks.workunit.client.0.smithi047.stdout:9/291: rmdir d3/d10/d18/d3d 39 2024-02-07T12:25:55.882 INFO:tasks.workunit.client.0.smithi047.stdout:9/292: creat d3/d10/f67 x:0 0 0 2024-02-07T12:25:55.882 INFO:tasks.workunit.client.0.smithi047.stdout:9/293: stat d3/d10/d4c 0 2024-02-07T12:25:55.883 INFO:tasks.workunit.client.0.smithi047.stdout:9/294: mkdir d3/d10/d18/d3b/d3c/d5d/d68 0 2024-02-07T12:25:55.883 INFO:tasks.workunit.client.0.smithi047.stdout:9/295: creat d3/d10/d18/d3b/f69 x:0 0 0 2024-02-07T12:25:55.883 INFO:tasks.workunit.client.0.smithi047.stdout:9/296: chown l0 0 1 2024-02-07T12:25:55.885 INFO:tasks.workunit.client.0.smithi047.stdout:9/297: rename d3/d10/d18/d3b/d3c/d47/l53 to d3/d10/d18/d3a/l6a 0 2024-02-07T12:25:55.885 INFO:tasks.workunit.client.0.smithi047.stdout:9/298: fdatasync f1 0 2024-02-07T12:25:55.886 INFO:tasks.workunit.client.0.smithi047.stdout:9/299: truncate d3/d10/f4b 335330 0 2024-02-07T12:25:55.897 INFO:tasks.workunit.client.0.smithi047.stdout:9/300: dwrite d3/f40 [0,4194304] 0 2024-02-07T12:25:55.898 INFO:tasks.workunit.client.0.smithi047.stdout:9/301: mkdir d3/d10/d18/d3b/d52/d6b 0 2024-02-07T12:25:55.899 INFO:tasks.workunit.client.0.smithi047.stdout:9/302: mknod d3/d10/d18/d3b/d52/d6b/c6c 0 2024-02-07T12:25:55.900 INFO:tasks.workunit.client.0.smithi047.stdout:9/303: symlink d3/d10/d18/d3b/d52/d6b/l6d 0 2024-02-07T12:25:55.901 INFO:tasks.workunit.client.0.smithi047.stdout:9/304: mkdir d3/d10/d18/d6e 0 2024-02-07T12:25:56.004 INFO:tasks.workunit.client.0.smithi047.stdout:4/505: sync 2024-02-07T12:25:56.004 INFO:tasks.workunit.client.0.smithi047.stdout:5/568: sync 2024-02-07T12:25:56.006 INFO:tasks.workunit.client.0.smithi047.stdout:4/506: mknod d3/d27/d3b/ca8 0 2024-02-07T12:25:56.007 INFO:tasks.workunit.client.0.smithi047.stdout:4/507: mkdir d3/d27/d5e/da0/d37/da9 0 2024-02-07T12:25:56.008 INFO:tasks.workunit.client.0.smithi047.stdout:4/508: truncate d3/f75 237715 0 2024-02-07T12:25:56.008 INFO:tasks.workunit.client.0.smithi047.stdout:4/509: fsync d3/d61/d43/d45/d66/f80 0 2024-02-07T12:25:56.008 INFO:tasks.workunit.client.0.smithi047.stdout:4/510: creat d3/d61/faa x:0 0 0 2024-02-07T12:25:56.010 INFO:tasks.workunit.client.0.smithi047.stdout:4/511: dread d3/d61/d43/d45/d63/f68 [0,4194304] 0 2024-02-07T12:25:56.010 INFO:tasks.workunit.client.0.smithi047.stdout:4/512: creat d3/d27/d5e/fab x:0 0 0 2024-02-07T12:25:56.010 INFO:tasks.workunit.client.0.smithi047.stdout:4/513: write d3/d27/d5e/da0/f5b [4640581,30021] 0 2024-02-07T12:25:56.010 INFO:tasks.workunit.client.0.smithi047.stdout:4/514: stat d3/d61/fa6 0 2024-02-07T12:25:56.010 INFO:tasks.workunit.client.0.smithi047.stdout:4/515: dread - d3/d27/d5e/f9f zero size 2024-02-07T12:25:56.013 INFO:tasks.workunit.client.0.smithi047.stdout:4/516: rmdir d3/d61/d43/d45/d63 39 2024-02-07T12:25:56.013 INFO:tasks.workunit.client.0.smithi047.stdout:4/517: write d3/d61/d43/d45/d63/f9e [153490,80588] 0 2024-02-07T12:25:56.014 INFO:tasks.workunit.client.0.smithi047.stdout:4/518: mknod d3/d27/d5e/cac 0 2024-02-07T12:25:56.028 INFO:tasks.workunit.client.0.smithi047.stdout:4/519: write d3/d27/d3b/f42 [2779193,2871] 0 2024-02-07T12:25:56.028 INFO:tasks.workunit.client.0.smithi047.stdout:4/520: readlink d3/d27/d5e/da0/l4d 0 2024-02-07T12:25:56.028 INFO:tasks.workunit.client.0.smithi047.stdout:5/569: dwrite da/df/d16/d25/d33/d55/d80/fa9 [0,4194304] 0 2024-02-07T12:25:56.028 INFO:tasks.workunit.client.0.smithi047.stdout:4/521: fdatasync d3/f23 0 2024-02-07T12:25:56.029 INFO:tasks.workunit.client.0.smithi047.stdout:5/570: dread da/df/d16/d81/f99 [0,4194304] 0 2024-02-07T12:25:56.040 INFO:tasks.workunit.client.0.smithi047.stdout:5/571: write da/d24/f45 [7165016,6151] 0 2024-02-07T12:25:56.042 INFO:tasks.workunit.client.0.smithi047.stdout:5/572: mkdir da/df/d16/d25/d33/d6e/dbb 0 2024-02-07T12:25:56.043 INFO:tasks.workunit.client.0.smithi047.stdout:5/573: symlink da/d24/lbc 0 2024-02-07T12:25:56.043 INFO:tasks.workunit.client.0.smithi047.stdout:5/574: write da/df/d16/d25/d33/d55/f92 [456167,112647] 0 2024-02-07T12:25:56.043 INFO:tasks.workunit.client.0.smithi047.stdout:5/575: truncate da/df/d16/d25/d33/d55/f92 818824 0 2024-02-07T12:25:56.044 INFO:tasks.workunit.client.0.smithi047.stdout:4/522: dwrite d3/d27/d5e/da0/d37/f6a [0,4194304] 0 2024-02-07T12:25:56.044 INFO:tasks.workunit.client.0.smithi047.stdout:4/523: fdatasync d3/d27/d5e/da0/f44 0 2024-02-07T12:25:56.045 INFO:tasks.workunit.client.0.smithi047.stdout:5/576: rename da/df/d16/d25/d71/d68/f72 to da/df/d16/fbd 0 2024-02-07T12:25:56.047 INFO:tasks.workunit.client.0.smithi047.stdout:5/577: creat da/df/d16/d25/d33/d91/fbe x:0 0 0 2024-02-07T12:25:56.048 INFO:tasks.workunit.client.0.smithi047.stdout:5/578: write da/df/d16/d81/f99 [340004,5477] 0 2024-02-07T12:25:56.049 INFO:tasks.workunit.client.0.smithi047.stdout:5/579: truncate da/df/f94 325665 0 2024-02-07T12:25:56.054 INFO:tasks.workunit.client.0.smithi047.stdout:4/524: dread d3/d27/d3b/f72 [0,4194304] 0 2024-02-07T12:25:56.054 INFO:tasks.workunit.client.0.smithi047.stdout:4/525: creat d3/d61/d43/d45/d66/fad x:0 0 0 2024-02-07T12:25:56.058 INFO:tasks.workunit.client.0.smithi047.stdout:4/526: rmdir d3 39 2024-02-07T12:25:56.058 INFO:tasks.workunit.client.0.smithi047.stdout:4/527: chown d3/f12 2491762 1 2024-02-07T12:25:56.062 INFO:tasks.workunit.client.0.smithi047.stdout:4/528: dread d3/f20 [0,4194304] 0 2024-02-07T12:25:56.064 INFO:tasks.workunit.client.0.smithi047.stdout:4/529: rename d3/d27/d5e/da0/d37/f7f to d3/d61/d43/d45/d6c/fae 0 2024-02-07T12:25:56.066 INFO:tasks.workunit.client.0.smithi047.stdout:5/580: dwrite da/df/d16/d41/f51 [0,4194304] 0 2024-02-07T12:25:56.066 INFO:tasks.workunit.client.0.smithi047.stdout:5/581: truncate da/df/d16/d25/f50 2621777 0 2024-02-07T12:25:56.066 INFO:tasks.workunit.client.0.smithi047.stdout:4/530: rename d3/d61/d43/d45/d66/fad to d3/d27/d3b/d7d/faf 0 2024-02-07T12:25:56.068 INFO:tasks.workunit.client.0.smithi047.stdout:4/531: symlink d3/d27/d5e/da0/d37/lb0 0 2024-02-07T12:25:56.076 INFO:tasks.workunit.client.0.smithi047.stdout:4/532: rename d3/d27/d5e/da0 to d3/db1 0 2024-02-07T12:25:56.076 INFO:tasks.workunit.client.0.smithi047.stdout:4/533: chown d3/d61/l84 4 1 2024-02-07T12:25:56.092 INFO:tasks.workunit.client.0.smithi047.stdout:4/534: dwrite d3/f6 [0,4194304] 0 2024-02-07T12:25:56.094 INFO:tasks.workunit.client.0.smithi047.stdout:4/535: symlink d3/d27/d5e/lb2 0 2024-02-07T12:25:56.094 INFO:tasks.workunit.client.0.smithi047.stdout:4/536: mkdir d3/d61/d43/d45/d63/db3 0 2024-02-07T12:25:56.095 INFO:tasks.workunit.client.0.smithi047.stdout:4/537: creat d3/d61/d43/d45/d6c/fb4 x:0 0 0 2024-02-07T12:25:56.097 INFO:tasks.workunit.client.0.smithi047.stdout:4/538: write d3/f12 [5066025,78360] 0 2024-02-07T12:25:56.099 INFO:tasks.workunit.client.0.smithi047.stdout:4/539: getdents d3/d61/d70/d8b 0 2024-02-07T12:25:56.099 INFO:tasks.workunit.client.0.smithi047.stdout:4/540: readlink d3/d61/d43/l90 0 2024-02-07T12:25:56.101 INFO:tasks.workunit.client.0.smithi047.stdout:4/541: rmdir d3/d61/d43/d45/d66 39 2024-02-07T12:25:56.101 INFO:tasks.workunit.client.0.smithi047.stdout:4/542: stat d3/f23 0 2024-02-07T12:25:56.109 INFO:tasks.workunit.client.0.smithi047.stdout:4/543: dread d3/db1/d37/f6a [0,4194304] 0 2024-02-07T12:25:56.110 INFO:tasks.workunit.client.0.smithi047.stdout:4/544: truncate d3/db1/f38 384324 0 2024-02-07T12:25:56.111 INFO:tasks.workunit.client.0.smithi047.stdout:4/545: link d3/d27/d3b/f88 d3/d27/d3b/d7d/fb5 0 2024-02-07T12:25:56.129 INFO:tasks.workunit.client.0.smithi047.stdout:4/546: dwrite d3/d61/d43/d45/d66/f6f [0,4194304] 0 2024-02-07T12:25:56.129 INFO:tasks.workunit.client.0.smithi047.stdout:4/547: write d3/d61/d70/d8b/fa3 [973855,129491] 0 2024-02-07T12:25:56.132 INFO:tasks.workunit.client.0.smithi047.stdout:4/548: read d3/f5 [143489,6674] 0 2024-02-07T12:25:56.135 INFO:tasks.workunit.client.0.smithi047.stdout:4/549: rmdir d3/d27/d3b/d7d 39 2024-02-07T12:25:56.136 INFO:tasks.workunit.client.0.smithi047.stdout:4/550: mknod d3/d61/d43/d45/d63/cb6 0 2024-02-07T12:25:56.136 INFO:tasks.workunit.client.0.smithi047.stdout:4/551: fsync d3/f12 0 2024-02-07T12:25:56.140 INFO:tasks.workunit.client.0.smithi047.stdout:4/552: mkdir d3/d61/d43/d45/db7 0 2024-02-07T12:25:56.147 INFO:tasks.workunit.client.0.smithi047.stdout:4/553: dread d3/d27/d3b/f42 [0,4194304] 0 2024-02-07T12:25:56.149 INFO:tasks.workunit.client.0.smithi047.stdout:4/554: rename d3/db1/f44 to d3/d27/d3b/d7d/da2/fb8 0 2024-02-07T12:25:56.149 INFO:tasks.workunit.client.0.smithi047.stdout:4/555: stat d3/d61/d43/d45/db7 0 2024-02-07T12:25:56.149 INFO:tasks.workunit.client.0.smithi047.stdout:4/556: chown d3/d61/c8a 12569 1 2024-02-07T12:25:56.150 INFO:tasks.workunit.client.0.smithi047.stdout:4/557: getdents d3/d61/d43 0 2024-02-07T12:25:56.152 INFO:tasks.workunit.client.0.smithi047.stdout:4/558: symlink d3/d61/d43/d45/d63/lb9 0 2024-02-07T12:25:56.153 INFO:tasks.workunit.client.0.smithi047.stdout:4/559: creat d3/d27/fba x:0 0 0 2024-02-07T12:25:56.153 INFO:tasks.workunit.client.0.smithi047.stdout:4/560: chown d3/db1/c4b 165615 1 2024-02-07T12:25:56.153 INFO:tasks.workunit.client.0.smithi047.stdout:4/561: dread - d3/d27/d3b/d7d/f82 zero size 2024-02-07T12:25:56.153 INFO:tasks.workunit.client.0.smithi047.stdout:4/562: read - d3/d61/d43/d45/d6c/fb4 zero size 2024-02-07T12:25:56.154 INFO:tasks.workunit.client.0.smithi047.stdout:4/563: fdatasync d3/d27/d3b/d7d/da2/fb8 0 2024-02-07T12:25:56.156 INFO:tasks.workunit.client.0.smithi047.stdout:4/564: symlink d3/d27/d3b/d7d/lbb 0 2024-02-07T12:25:56.172 INFO:tasks.workunit.client.0.smithi047.stdout:4/565: dwrite d3/f12 [0,4194304] 0 2024-02-07T12:25:56.191 INFO:tasks.workunit.client.0.smithi047.stdout:4/566: dwrite d3/d27/d3b/f42 [0,4194304] 0 2024-02-07T12:25:56.193 INFO:tasks.workunit.client.0.smithi047.stdout:4/567: mkdir d3/d27/dbc 0 2024-02-07T12:25:56.193 INFO:tasks.workunit.client.0.smithi047.stdout:4/568: write d3/d27/f28 [5022162,44598] 0 2024-02-07T12:25:56.209 INFO:tasks.workunit.client.0.smithi047.stdout:4/569: dwrite d3/d27/d3b/d7d/faf [0,4194304] 0 2024-02-07T12:25:56.209 INFO:tasks.workunit.client.0.smithi047.stdout:4/570: write d3/d27/d3b/f42 [5099306,52604] 0 2024-02-07T12:25:56.209 INFO:tasks.workunit.client.0.smithi047.stdout:4/571: write d3/d27/d5e/fab [510571,121776] 0 2024-02-07T12:25:56.215 INFO:tasks.workunit.client.0.smithi047.stdout:4/572: unlink d3/d61/d70/d8b/fa3 0 2024-02-07T12:25:56.225 INFO:tasks.workunit.client.0.smithi047.stdout:1/384: sync 2024-02-07T12:25:56.225 INFO:tasks.workunit.client.0.smithi047.stdout:1/385: write d1/d15/f50 [765555,38637] 0 2024-02-07T12:25:56.244 INFO:tasks.workunit.client.0.smithi047.stdout:1/386: dwrite d1/d15/d18/f27 [0,4194304] 0 2024-02-07T12:25:56.260 INFO:tasks.workunit.client.0.smithi047.stdout:1/387: dwrite d1/d15/d18/f23 [0,4194304] 0 2024-02-07T12:25:56.261 INFO:tasks.workunit.client.0.smithi047.stdout:1/388: link d1/d2a/l3f d1/d15/d18/d65/l7c 0 2024-02-07T12:25:56.261 INFO:tasks.workunit.client.0.smithi047.stdout:1/389: dread - d1/d15/d30/f5a zero size 2024-02-07T12:25:56.262 INFO:tasks.workunit.client.0.smithi047.stdout:1/390: truncate d1/d15/d2f/f3c 3999028 0 2024-02-07T12:25:56.263 INFO:tasks.workunit.client.0.smithi047.stdout:1/391: symlink d1/d6e/d75/l7d 0 2024-02-07T12:25:56.263 INFO:tasks.workunit.client.0.smithi047.stdout:1/392: write d1/d15/d18/d65/f64 [417190,70846] 0 2024-02-07T12:25:56.263 INFO:tasks.workunit.client.0.smithi047.stdout:1/393: creat d1/d15/d30/d46/f7e x:0 0 0 2024-02-07T12:25:56.264 INFO:tasks.workunit.client.0.smithi047.stdout:1/394: symlink d1/d6e/l7f 0 2024-02-07T12:25:56.268 INFO:tasks.workunit.client.0.smithi047.stdout:1/395: dread d1/d15/d18/d40/f56 [0,4194304] 0 2024-02-07T12:25:56.277 INFO:tasks.workunit.client.0.smithi047.stdout:1/396: dread d1/f58 [0,4194304] 0 2024-02-07T12:25:56.278 INFO:tasks.workunit.client.0.smithi047.stdout:1/397: mkdir d1/d15/d18/d80 0 2024-02-07T12:25:56.286 INFO:tasks.workunit.client.0.smithi047.stdout:1/398: dread d1/f21 [0,4194304] 0 2024-02-07T12:25:56.288 INFO:tasks.workunit.client.0.smithi047.stdout:1/399: dread d1/d15/d30/d46/f59 [0,4194304] 0 2024-02-07T12:25:56.288 INFO:tasks.workunit.client.0.smithi047.stdout:1/400: getdents d1/d48/d74 0 2024-02-07T12:25:56.293 INFO:tasks.workunit.client.0.smithi047.stdout:1/401: dread d1/f58 [0,4194304] 0 2024-02-07T12:25:56.293 INFO:tasks.workunit.client.0.smithi047.stdout:1/402: mkdir d1/d48/d81 0 2024-02-07T12:25:56.294 INFO:tasks.workunit.client.0.smithi047.stdout:1/403: getdents d1/d6e/d75 0 2024-02-07T12:25:56.308 INFO:tasks.workunit.client.0.smithi047.stdout:1/404: dwrite d1/d15/d18/d40/f56 [0,4194304] 0 2024-02-07T12:25:56.309 INFO:tasks.workunit.client.0.smithi047.stdout:1/405: unlink d1/d15/d18/d65/l7c 0 2024-02-07T12:25:56.311 INFO:tasks.workunit.client.0.smithi047.stdout:1/406: dread d1/d15/d18/d40/f62 [0,4194304] 0 2024-02-07T12:25:56.312 INFO:tasks.workunit.client.0.smithi047.stdout:1/407: truncate d1/d15/d18/f4f 194976 0 2024-02-07T12:25:56.313 INFO:tasks.workunit.client.0.smithi047.stdout:1/408: symlink d1/d48/l82 0 2024-02-07T12:25:56.313 INFO:tasks.workunit.client.0.smithi047.stdout:1/409: readlink d1/d48/l82 0 2024-02-07T12:25:56.318 INFO:tasks.workunit.client.0.smithi047.stdout:1/410: write d1/f22 [6760163,98440] 0 2024-02-07T12:25:56.318 INFO:tasks.workunit.client.0.smithi047.stdout:1/411: chown d1/f21 4 1 2024-02-07T12:25:56.319 INFO:tasks.workunit.client.0.smithi047.stdout:1/412: truncate d1/d15/d2f/d3d/d3e/f57 1091179 0 2024-02-07T12:25:56.335 INFO:tasks.workunit.client.0.smithi047.stdout:1/413: dwrite d1/d15/f50 [0,4194304] 0 2024-02-07T12:25:56.351 INFO:tasks.workunit.client.0.smithi047.stdout:1/414: dwrite d1/d15/d30/d46/f7e [0,4194304] 0 2024-02-07T12:25:56.352 INFO:tasks.workunit.client.0.smithi047.stdout:1/415: chown d1/d15/d30/d46/f7e 1713587 1 2024-02-07T12:25:56.353 INFO:tasks.workunit.client.0.smithi047.stdout:1/416: read d1/d15/d18/d65/f64 [339083,96389] 0 2024-02-07T12:25:56.353 INFO:tasks.workunit.client.0.smithi047.stdout:1/417: write d1/d37/f72 [905165,88599] 0 2024-02-07T12:25:56.353 INFO:tasks.workunit.client.0.smithi047.stdout:1/418: fdatasync d1/d15/d18/d40/f62 0 2024-02-07T12:25:56.353 INFO:tasks.workunit.client.0.smithi047.stdout:1/419: unlink d1/d15/d30/l53 0 2024-02-07T12:25:56.354 INFO:tasks.workunit.client.0.smithi047.stdout:1/420: mknod d1/d15/c83 0 2024-02-07T12:25:56.355 INFO:tasks.workunit.client.0.smithi047.stdout:1/421: mkdir d1/d15/d2f/d3d/d84 0 2024-02-07T12:25:56.355 INFO:tasks.workunit.client.0.smithi047.stdout:1/422: fsync d1/fe 0 2024-02-07T12:25:56.355 INFO:tasks.workunit.client.0.smithi047.stdout:1/423: write d1/d15/d2f/d3d/f5c [4815582,55938] 0 2024-02-07T12:25:56.356 INFO:tasks.workunit.client.0.smithi047.stdout:1/424: mknod d1/d15/d18/d40/c85 0 2024-02-07T12:25:56.356 INFO:tasks.workunit.client.0.smithi047.stdout:1/425: stat d1/d15/d18/d40/f61 0 2024-02-07T12:25:56.356 INFO:tasks.workunit.client.0.smithi047.stdout:1/426: write d1/d15/d2f/d3d/d3e/f7a [514909,1920] 0 2024-02-07T12:25:56.364 INFO:tasks.workunit.client.0.smithi047.stdout:1/427: dread d1/d15/d18/f2b [0,4194304] 0 2024-02-07T12:25:56.364 INFO:tasks.workunit.client.0.smithi047.stdout:1/428: truncate d1/d15/d18/d40/f52 4418915 0 2024-02-07T12:25:56.364 INFO:tasks.workunit.client.0.smithi047.stdout:1/429: chown d1/d15/d30/d46/d66 3479908 1 2024-02-07T12:25:56.364 INFO:tasks.workunit.client.0.smithi047.stdout:1/430: write d1/d15/f1c [2248260,38880] 0 2024-02-07T12:25:56.366 INFO:tasks.workunit.client.0.smithi047.stdout:1/431: mknod d1/c86 0 2024-02-07T12:25:56.371 INFO:tasks.workunit.client.0.smithi047.stdout:1/432: getdents d1/d15/d30/d46 0 2024-02-07T12:25:56.371 INFO:tasks.workunit.client.0.smithi047.stdout:1/433: fdatasync d1/d15/d18/d40/f56 0 2024-02-07T12:25:56.373 INFO:tasks.workunit.client.0.smithi047.stdout:6/474: sync 2024-02-07T12:25:56.373 INFO:tasks.workunit.client.0.smithi047.stdout:6/475: readlink d3/da/d14/d28/l92 0 2024-02-07T12:25:56.388 INFO:tasks.workunit.client.0.smithi047.stdout:1/434: write d1/d15/d30/d46/d4c/f6d [2039663,94512] 0 2024-02-07T12:25:56.393 INFO:tasks.workunit.client.0.smithi047.stdout:6/476: dwrite d3/da/d34/f71 [0,4194304] 0 2024-02-07T12:25:56.393 INFO:tasks.workunit.client.0.smithi047.stdout:6/477: truncate d3/d5/d35/d3c/d72/d8c/d95/f78 851895 0 2024-02-07T12:25:56.397 INFO:tasks.workunit.client.0.smithi047.stdout:6/478: rename d3/d5/d35/da8 to d3/da/da9 0 2024-02-07T12:25:56.402 INFO:tasks.workunit.client.0.smithi047.stdout:1/435: write d1/d15/f50 [1619346,97716] 0 2024-02-07T12:25:56.402 INFO:tasks.workunit.client.0.smithi047.stdout:1/436: stat d1/fe 0 2024-02-07T12:25:56.402 INFO:tasks.workunit.client.0.smithi047.stdout:6/479: dread d3/d5/d35/f54 [0,4194304] 0 2024-02-07T12:25:56.403 INFO:tasks.workunit.client.0.smithi047.stdout:1/437: creat d1/f87 x:0 0 0 2024-02-07T12:25:56.404 INFO:tasks.workunit.client.0.smithi047.stdout:1/438: creat d1/d15/d2f/d3d/d84/f88 x:0 0 0 2024-02-07T12:25:56.406 INFO:tasks.workunit.client.0.smithi047.stdout:1/439: unlink d1/d15/d2f/f76 0 2024-02-07T12:25:56.423 INFO:tasks.workunit.client.0.smithi047.stdout:1/440: dwrite d1/d15/d18/d40/f61 [4194304,4194304] 0 2024-02-07T12:25:56.423 INFO:tasks.workunit.client.0.smithi047.stdout:1/441: rename d1 to d1/d15/d30/d46/d66/d89 22 2024-02-07T12:25:56.425 INFO:tasks.workunit.client.0.smithi047.stdout:1/442: getdents d1/d37 0 2024-02-07T12:25:56.425 INFO:tasks.workunit.client.0.smithi047.stdout:1/443: fsync d1/d15/d2f/f6c 0 2024-02-07T12:25:56.425 INFO:tasks.workunit.client.0.smithi047.stdout:1/444: write d1/d15/d2f/d3d/d3e/f4a [4388883,91100] 0 2024-02-07T12:25:56.426 INFO:tasks.workunit.client.0.smithi047.stdout:1/445: mkdir d1/d8a 0 2024-02-07T12:25:56.441 INFO:tasks.workunit.client.0.smithi047.stdout:1/446: dwrite d1/d15/d2f/d3d/d3e/f57 [0,4194304] 0 2024-02-07T12:25:56.443 INFO:tasks.workunit.client.0.smithi047.stdout:1/447: unlink d1/d15/d2f/d3d/c47 0 2024-02-07T12:25:56.443 INFO:tasks.workunit.client.0.smithi047.stdout:1/448: chown d1/d15/d18/d40/f56 179817 1 2024-02-07T12:25:56.443 INFO:tasks.workunit.client.0.smithi047.stdout:1/449: chown d1/d37/c4d 7518 1 2024-02-07T12:25:56.443 INFO:tasks.workunit.client.0.smithi047.stdout:1/450: write d1/d15/d18/d65/f64 [1444874,97467] 0 2024-02-07T12:25:56.444 INFO:tasks.workunit.client.0.smithi047.stdout:1/451: truncate d1/f58 3886524 0 2024-02-07T12:25:56.444 INFO:tasks.workunit.client.0.smithi047.stdout:1/452: creat d1/d15/d2f/d3d/f8b x:0 0 0 2024-02-07T12:25:56.446 INFO:tasks.workunit.client.0.smithi047.stdout:1/453: unlink d1/d15/d18/d40/c42 0 2024-02-07T12:25:56.462 INFO:tasks.workunit.client.0.smithi047.stdout:1/454: dwrite d1/d15/d18/f4f [0,4194304] 0 2024-02-07T12:25:56.464 INFO:tasks.workunit.client.0.smithi047.stdout:1/455: symlink d1/d15/d30/l8c 0 2024-02-07T12:25:56.480 INFO:tasks.workunit.client.0.smithi047.stdout:1/456: dwrite d1/d15/d18/d40/f62 [0,4194304] 0 2024-02-07T12:25:56.480 INFO:tasks.workunit.client.0.smithi047.stdout:1/457: write d1/d15/d2f/d3d/d84/f88 [422089,51241] 0 2024-02-07T12:25:56.482 INFO:tasks.workunit.client.0.smithi047.stdout:1/458: mknod d1/d15/d2f/d3d/d84/c8d 0 2024-02-07T12:25:56.484 INFO:tasks.workunit.client.0.smithi047.stdout:1/459: write d1/d15/d18/f1d [1335449,75922] 0 2024-02-07T12:25:56.484 INFO:tasks.workunit.client.0.smithi047.stdout:1/460: fdatasync d1/d15/d18/f24 0 2024-02-07T12:25:56.540 INFO:tasks.workunit.client.0.smithi047.stdout:2/490: sync 2024-02-07T12:25:56.540 INFO:tasks.workunit.client.0.smithi047.stdout:3/536: sync 2024-02-07T12:25:56.542 INFO:tasks.workunit.client.0.smithi047.stdout:3/537: rename d12/d19/d21/d29/d31/d61/f83 to d12/d19/d21/d29/fb4 0 2024-02-07T12:25:56.547 INFO:tasks.workunit.client.0.smithi047.stdout:3/538: rename d12/d19/f53 to d12/d19/d2d/d33/d8d/fb5 0 2024-02-07T12:25:56.547 INFO:tasks.workunit.client.0.smithi047.stdout:3/539: chown d12/d19/d21/d29/d31/d38/d4c/f80 25113 1 2024-02-07T12:25:56.548 INFO:tasks.workunit.client.0.smithi047.stdout:3/540: link d12/f3d d12/d19/d21/d29/d6f/fb6 0 2024-02-07T12:25:56.548 INFO:tasks.workunit.client.0.smithi047.stdout:3/541: symlink d12/d19/d21/d29/d31/d38/d59/d87/lb7 0 2024-02-07T12:25:56.548 INFO:tasks.workunit.client.0.smithi047.stdout:2/491: dread d7/dc/f31 [0,4194304] 0 2024-02-07T12:25:56.548 INFO:tasks.workunit.client.0.smithi047.stdout:3/542: symlink d12/d19/d21/d90/lb8 0 2024-02-07T12:25:56.549 INFO:tasks.workunit.client.0.smithi047.stdout:2/492: getdents d7/d2d/d5c/d77/d92 0 2024-02-07T12:25:56.549 INFO:tasks.workunit.client.0.smithi047.stdout:3/543: creat d12/d19/d2d/d42/d6b/fb9 x:0 0 0 2024-02-07T12:25:56.550 INFO:tasks.workunit.client.0.smithi047.stdout:2/493: rename d7/dc/d71/c86 to d7/dc/c95 0 2024-02-07T12:25:56.552 INFO:tasks.workunit.client.0.smithi047.stdout:2/494: creat d7/d2d/d5c/d77/d92/f96 x:0 0 0 2024-02-07T12:25:56.552 INFO:tasks.workunit.client.0.smithi047.stdout:3/544: rmdir d12/d19/d46 39 2024-02-07T12:25:56.553 INFO:tasks.workunit.client.0.smithi047.stdout:2/495: truncate d7/dc/f2b 1037735 0 2024-02-07T12:25:56.555 INFO:tasks.workunit.client.0.smithi047.stdout:3/545: mkdir d12/d19/d21/d29/d6f/d93/dba 0 2024-02-07T12:25:56.557 INFO:tasks.workunit.client.0.smithi047.stdout:3/546: dread d12/d19/d2d/f8b [0,4194304] 0 2024-02-07T12:25:56.557 INFO:tasks.workunit.client.0.smithi047.stdout:3/547: creat d12/d19/d21/d29/d31/d38/fbb x:0 0 0 2024-02-07T12:25:56.560 INFO:tasks.workunit.client.0.smithi047.stdout:3/548: mkdir d12/d19/d2d/d82/dbc 0 2024-02-07T12:25:56.561 INFO:tasks.workunit.client.0.smithi047.stdout:2/496: write d7/f8 [1012262,123242] 0 2024-02-07T12:25:56.571 INFO:tasks.workunit.client.0.smithi047.stdout:2/497: dread d7/dc/f2b [0,4194304] 0 2024-02-07T12:25:56.572 INFO:tasks.workunit.client.0.smithi047.stdout:2/498: truncate d7/f2e 4256113 0 2024-02-07T12:25:56.576 INFO:tasks.workunit.client.0.smithi047.stdout:3/549: rmdir d12/d19 39 2024-02-07T12:25:56.576 INFO:tasks.workunit.client.0.smithi047.stdout:3/550: write d12/d19/d2d/f63 [710872,115707] 0 2024-02-07T12:25:56.578 INFO:tasks.workunit.client.0.smithi047.stdout:2/499: creat d7/d48/f97 x:0 0 0 2024-02-07T12:25:56.578 INFO:tasks.workunit.client.0.smithi047.stdout:2/500: write d7/d48/f56 [514863,122981] 0 2024-02-07T12:25:56.578 INFO:tasks.workunit.client.0.smithi047.stdout:2/501: chown d7/d2d/d5c/d77/d92/l93 54 1 2024-02-07T12:25:56.578 INFO:tasks.workunit.client.0.smithi047.stdout:3/551: mknod d12/d19/d21/d29/d31/d61/cbd 0 2024-02-07T12:25:56.604 INFO:tasks.workunit.client.0.smithi047.stdout:3/552: dwrite d12/f13 [0,4194304] 0 2024-02-07T12:25:56.604 INFO:tasks.workunit.client.0.smithi047.stdout:2/502: dwrite f2 [4194304,4194304] 0 2024-02-07T12:25:56.605 INFO:tasks.workunit.client.0.smithi047.stdout:3/553: mknod d12/d19/d2d/d33/d8d/cbe 0 2024-02-07T12:25:56.607 INFO:tasks.workunit.client.0.smithi047.stdout:3/554: rename d12/d19/d21/d29/d31/d38/d4c to d12/d19/d21/d29/d6f/d93/dba/dbf 0 2024-02-07T12:25:56.607 INFO:tasks.workunit.client.0.smithi047.stdout:3/555: creat d12/fc0 x:0 0 0 2024-02-07T12:25:56.607 INFO:tasks.workunit.client.0.smithi047.stdout:2/503: rmdir d7/d2d/d5c/d77/d92 39 2024-02-07T12:25:56.607 INFO:tasks.workunit.client.0.smithi047.stdout:2/504: stat d7/dc/d71 0 2024-02-07T12:25:56.609 INFO:tasks.workunit.client.0.smithi047.stdout:2/505: mknod d7/dc/d8a/c98 0 2024-02-07T12:25:56.639 INFO:tasks.workunit.client.0.smithi047.stdout:2/506: dwrite d7/d48/f7e [0,4194304] 0 2024-02-07T12:25:56.639 INFO:tasks.workunit.client.0.smithi047.stdout:3/556: dwrite d12/d19/d46/f72 [0,4194304] 0 2024-02-07T12:25:56.641 INFO:tasks.workunit.client.0.smithi047.stdout:2/507: mkdir d7/d2d/d99 0 2024-02-07T12:25:56.641 INFO:tasks.workunit.client.0.smithi047.stdout:3/557: creat d12/d19/d21/d29/fc1 x:0 0 0 2024-02-07T12:25:56.642 INFO:tasks.workunit.client.0.smithi047.stdout:3/558: creat d12/d19/d21/d29/da9/fc2 x:0 0 0 2024-02-07T12:25:56.644 INFO:tasks.workunit.client.0.smithi047.stdout:3/559: dread d12/d19/d21/d29/fa4 [0,4194304] 0 2024-02-07T12:25:56.644 INFO:tasks.workunit.client.0.smithi047.stdout:3/560: fdatasync d12/d19/d2d/d82/f85 0 2024-02-07T12:25:56.644 INFO:tasks.workunit.client.0.smithi047.stdout:2/508: rename d7/c3a to d7/d2d/d5c/d77/c9a 0 2024-02-07T12:25:56.644 INFO:tasks.workunit.client.0.smithi047.stdout:2/509: read - d7/dc/d4c/f7b zero size 2024-02-07T12:25:56.649 INFO:tasks.workunit.client.0.smithi047.stdout:2/510: mkdir d7/d2d/d5c/d77/d9b 0 2024-02-07T12:25:56.649 INFO:tasks.workunit.client.0.smithi047.stdout:2/511: write d7/f88 [904057,116533] 0 2024-02-07T12:25:56.649 INFO:tasks.workunit.client.0.smithi047.stdout:2/512: getdents d7/dc/d8a 0 2024-02-07T12:25:56.653 INFO:tasks.workunit.client.0.smithi047.stdout:2/513: creat d7/dc/d51/f9c x:0 0 0 2024-02-07T12:25:56.653 INFO:tasks.workunit.client.0.smithi047.stdout:2/514: write d7/d2d/f53 [1953998,207] 0 2024-02-07T12:25:56.653 INFO:tasks.workunit.client.0.smithi047.stdout:2/515: fsync d7/d2d/d5c/f8b 0 2024-02-07T12:25:56.653 INFO:tasks.workunit.client.0.smithi047.stdout:3/561: dread d12/f14 [0,4194304] 0 2024-02-07T12:25:56.658 INFO:tasks.workunit.client.0.smithi047.stdout:4/573: sync 2024-02-07T12:25:56.659 INFO:tasks.workunit.client.0.smithi047.stdout:7/542: sync 2024-02-07T12:25:56.659 INFO:tasks.workunit.client.0.smithi047.stdout:0/319: sync 2024-02-07T12:25:56.659 INFO:tasks.workunit.client.0.smithi047.stdout:8/576: sync 2024-02-07T12:25:56.659 INFO:tasks.workunit.client.0.smithi047.stdout:6/480: sync 2024-02-07T12:25:56.659 INFO:tasks.workunit.client.0.smithi047.stdout:9/305: sync 2024-02-07T12:25:56.659 INFO:tasks.workunit.client.0.smithi047.stdout:5/582: sync 2024-02-07T12:25:56.663 INFO:tasks.workunit.client.0.smithi047.stdout:7/543: write d0/d6f/f71 [659933,46217] 0 2024-02-07T12:25:56.664 INFO:tasks.workunit.client.0.smithi047.stdout:2/516: dread d7/dc/f5b [0,4194304] 0 2024-02-07T12:25:56.669 INFO:tasks.workunit.client.0.smithi047.stdout:3/562: write d12/d19/d2d/d42/f56 [1831019,27737] 0 2024-02-07T12:25:56.672 INFO:tasks.workunit.client.0.smithi047.stdout:4/574: dread d3/f2b [0,4194304] 0 2024-02-07T12:25:56.673 INFO:tasks.workunit.client.0.smithi047.stdout:0/320: rename d19/d1c/d24/f5b to d19/d1c/d3c/d37/d3d/d46/f5e 0 2024-02-07T12:25:56.673 INFO:tasks.workunit.client.0.smithi047.stdout:7/544: creat d0/df/d29/d3e/fac x:0 0 0 2024-02-07T12:25:56.673 INFO:tasks.workunit.client.0.smithi047.stdout:0/321: getdents d19/d40 0 2024-02-07T12:25:56.686 INFO:tasks.workunit.client.0.smithi047.stdout:7/545: rmdir d0/da9 0 2024-02-07T12:25:56.686 INFO:tasks.workunit.client.0.smithi047.stdout:8/577: dread d3/d36/f6c [0,4194304] 0 2024-02-07T12:25:56.687 INFO:tasks.workunit.client.0.smithi047.stdout:0/322: mkdir d19/d1c/d2b/d5f 0 2024-02-07T12:25:56.688 INFO:tasks.workunit.client.0.smithi047.stdout:9/306: dwrite d3/d10/f4b [0,4194304] 0 2024-02-07T12:25:56.689 INFO:tasks.workunit.client.0.smithi047.stdout:2/517: dwrite d7/d2d/d7c/f7f [0,4194304] 0 2024-02-07T12:25:56.689 INFO:tasks.workunit.client.0.smithi047.stdout:2/518: truncate d7/d48/f97 743793 0 2024-02-07T12:25:56.689 INFO:tasks.workunit.client.0.smithi047.stdout:2/519: chown d7/d2d/d5c/l7d 0 1 2024-02-07T12:25:56.689 INFO:tasks.workunit.client.0.smithi047.stdout:2/520: fdatasync d7/dc/f8f 0 2024-02-07T12:25:56.689 INFO:tasks.workunit.client.0.smithi047.stdout:8/578: truncate d3/d36/f6c 1440745 0 2024-02-07T12:25:56.689 INFO:tasks.workunit.client.0.smithi047.stdout:0/323: mkdir d19/d1c/d3c/d60 0 2024-02-07T12:25:56.692 INFO:tasks.workunit.client.0.smithi047.stdout:9/307: truncate d3/f29 2261567 0 2024-02-07T12:25:56.694 INFO:tasks.workunit.client.0.smithi047.stdout:8/579: mknod d3/d36/d50/d30/d9e/da6/cbf 0 2024-02-07T12:25:56.694 INFO:tasks.workunit.client.0.smithi047.stdout:5/583: dwrite da/df/d16/d25/d71/d68/f87 [0,4194304] 0 2024-02-07T12:25:56.698 INFO:tasks.workunit.client.0.smithi047.stdout:4/575: dwrite d3/d61/f58 [0,4194304] 0 2024-02-07T12:25:56.699 INFO:tasks.workunit.client.0.smithi047.stdout:5/584: creat da/d24/d63/d9c/da3/fbf x:0 0 0 2024-02-07T12:25:56.701 INFO:tasks.workunit.client.0.smithi047.stdout:9/308: write d3/d10/d11/f42 [1213492,13405] 0 2024-02-07T12:25:56.701 INFO:tasks.workunit.client.0.smithi047.stdout:3/563: dwrite d12/d19/d21/d29/d31/d38/f7e [0,4194304] 0 2024-02-07T12:25:56.701 INFO:tasks.workunit.client.0.smithi047.stdout:3/564: readlink d12/d19/d37/l5e 0 2024-02-07T12:25:56.701 INFO:tasks.workunit.client.0.smithi047.stdout:0/324: rename d19/d1c/d3c/d37/d3d to d19/d1c/d3c/d60/d61 0 2024-02-07T12:25:56.703 INFO:tasks.workunit.client.0.smithi047.stdout:5/585: creat da/df/d16/fc0 x:0 0 0 2024-02-07T12:25:56.703 INFO:tasks.workunit.client.0.smithi047.stdout:5/586: fsync da/d24/d63/f65 0 2024-02-07T12:25:56.705 INFO:tasks.workunit.client.0.smithi047.stdout:9/309: creat d3/d10/d18/d3b/d52/d6b/f6f x:0 0 0 2024-02-07T12:25:56.705 INFO:tasks.workunit.client.0.smithi047.stdout:9/310: chown d3/d10/d18/d3b/d3c/d47/c63 174707512 1 2024-02-07T12:25:56.705 INFO:tasks.workunit.client.0.smithi047.stdout:9/311: getdents d3/d10/d18/d3b/d3c/d5d/d68 0 2024-02-07T12:25:56.705 INFO:tasks.workunit.client.0.smithi047.stdout:2/521: dread d7/f3b [0,4194304] 0 2024-02-07T12:25:56.705 INFO:tasks.workunit.client.0.smithi047.stdout:8/580: dread d3/d4/d87/f9c [0,4194304] 0 2024-02-07T12:25:56.713 INFO:tasks.workunit.client.0.smithi047.stdout:3/565: creat d12/d19/d21/d29/d6f/d93/dba/fc3 x:0 0 0 2024-02-07T12:25:56.714 INFO:tasks.workunit.client.0.smithi047.stdout:0/325: link d19/d1c/c29 d19/d1c/d3c/d60/d61/c62 0 2024-02-07T12:25:56.717 INFO:tasks.workunit.client.0.smithi047.stdout:9/312: mkdir d3/d10/d18/d3b/d3c/d5d/d70 0 2024-02-07T12:25:56.717 INFO:tasks.workunit.client.0.smithi047.stdout:9/313: chown d3/d10/d18/d6e 1061043 1 2024-02-07T12:25:56.719 INFO:tasks.workunit.client.0.smithi047.stdout:2/522: unlink d7/dc/c95 0 2024-02-07T12:25:56.719 INFO:tasks.workunit.client.0.smithi047.stdout:2/523: creat d7/d2d/d7c/f9d x:0 0 0 2024-02-07T12:25:56.719 INFO:tasks.workunit.client.0.smithi047.stdout:2/524: fdatasync d7/dc/f59 0 2024-02-07T12:25:56.721 INFO:tasks.workunit.client.0.smithi047.stdout:8/581: mkdir d3/d4/d4d/dc0 0 2024-02-07T12:25:56.722 INFO:tasks.workunit.client.0.smithi047.stdout:3/566: creat d12/d19/d21/d29/d6f/d93/dba/dbf/fc4 x:0 0 0 2024-02-07T12:25:56.724 INFO:tasks.workunit.client.0.smithi047.stdout:5/587: mkdir da/df/d16/d25/dc1 0 2024-02-07T12:25:56.724 INFO:tasks.workunit.client.0.smithi047.stdout:5/588: creat da/df/d16/d25/d33/d55/d80/da6/fc2 x:0 0 0 2024-02-07T12:25:56.724 INFO:tasks.workunit.client.0.smithi047.stdout:5/589: write da/df/d16/d25/f50 [3381198,40784] 0 2024-02-07T12:25:56.729 INFO:tasks.workunit.client.0.smithi047.stdout:2/525: rmdir d7/d2d/d99 0 2024-02-07T12:25:56.729 INFO:tasks.workunit.client.0.smithi047.stdout:2/526: creat d7/dc/f9e x:0 0 0 2024-02-07T12:25:56.729 INFO:tasks.workunit.client.0.smithi047.stdout:2/527: chown d7/d2d/d5c 1915356 1 2024-02-07T12:25:56.729 INFO:tasks.workunit.client.0.smithi047.stdout:8/582: readlink d3/d36/d50/d2a/l2c 0 2024-02-07T12:25:56.732 INFO:tasks.workunit.client.0.smithi047.stdout:1/461: sync 2024-02-07T12:25:56.735 INFO:tasks.workunit.client.0.smithi047.stdout:2/528: unlink f2 0 2024-02-07T12:25:56.738 INFO:tasks.workunit.client.0.smithi047.stdout:8/583: rename d3/d66/d67/fad to d3/d66/dac/fc1 0 2024-02-07T12:25:56.738 INFO:tasks.workunit.client.0.smithi047.stdout:8/584: truncate d3/f72 5074618 0 2024-02-07T12:25:56.740 INFO:tasks.workunit.client.0.smithi047.stdout:5/590: dwrite da/df/d16/d81/f99 [0,4194304] 0 2024-02-07T12:25:56.740 INFO:tasks.workunit.client.0.smithi047.stdout:5/591: fsync da/df/d16/d25/f2a 0 2024-02-07T12:25:56.741 INFO:tasks.workunit.client.0.smithi047.stdout:8/585: mknod d3/dbd/cc2 0 2024-02-07T12:25:56.741 INFO:tasks.workunit.client.0.smithi047.stdout:8/586: readlink d3/d4/l5 0 2024-02-07T12:25:56.741 INFO:tasks.workunit.client.0.smithi047.stdout:8/587: chown d3/d66/d67 310746 1 2024-02-07T12:25:56.745 INFO:tasks.workunit.client.0.smithi047.stdout:8/588: read d3/d36/d50/f81 [152683,16958] 0 2024-02-07T12:25:56.747 INFO:tasks.workunit.client.0.smithi047.stdout:5/592: symlink da/df/d16/d25/d33/lc3 0 2024-02-07T12:25:56.747 INFO:tasks.workunit.client.0.smithi047.stdout:5/593: creat da/df/d16/d25/d33/d55/d80/da6/fc4 x:0 0 0 2024-02-07T12:25:56.747 INFO:tasks.workunit.client.0.smithi047.stdout:5/594: creat da/df/d16/d25/d33/d55/d80/fc5 x:0 0 0 2024-02-07T12:25:56.747 INFO:tasks.workunit.client.0.smithi047.stdout:5/595: truncate da/df/d16/f74 798126 0 2024-02-07T12:25:56.747 INFO:tasks.workunit.client.0.smithi047.stdout:5/596: write da/d24/d63/d9c/da3/fbf [74287,93276] 0 2024-02-07T12:25:56.748 INFO:tasks.workunit.client.0.smithi047.stdout:8/589: creat d3/d66/d67/d6a/d91/fc3 x:0 0 0 2024-02-07T12:25:56.756 INFO:tasks.workunit.client.0.smithi047.stdout:5/597: rename da/df/d16/d25/f36 to da/df/fc6 0 2024-02-07T12:25:56.757 INFO:tasks.workunit.client.0.smithi047.stdout:2/529: dwrite d7/dc/f4b [0,4194304] 0 2024-02-07T12:25:56.762 INFO:tasks.workunit.client.0.smithi047.stdout:2/530: dread d7/f88 [0,4194304] 0 2024-02-07T12:25:56.763 INFO:tasks.workunit.client.0.smithi047.stdout:8/590: dread d3/d36/d50/d30/d34/f35 [0,4194304] 0 2024-02-07T12:25:56.765 INFO:tasks.workunit.client.0.smithi047.stdout:8/591: dread d3/d66/f7d [0,4194304] 0 2024-02-07T12:25:56.765 INFO:tasks.workunit.client.0.smithi047.stdout:8/592: readlink d3/d4/d4d/la9 0 2024-02-07T12:25:56.766 INFO:tasks.workunit.client.0.smithi047.stdout:8/593: fdatasync d3/d36/d50/f5b 0 2024-02-07T12:25:56.766 INFO:tasks.workunit.client.0.smithi047.stdout:8/594: chown d3/d66/d67/d71/d93 30 1 2024-02-07T12:25:56.771 INFO:tasks.workunit.client.0.smithi047.stdout:8/595: mknod d3/d66/d67/cc4 0 2024-02-07T12:25:56.772 INFO:tasks.workunit.client.0.smithi047.stdout:2/531: rename d7/c6f to d7/d2d/c9f 0 2024-02-07T12:25:56.774 INFO:tasks.workunit.client.0.smithi047.stdout:2/532: mkdir d7/dc/d4c/da0 0 2024-02-07T12:25:56.777 INFO:tasks.workunit.client.0.smithi047.stdout:2/533: rename d7/d2d/d7c/f9d to d7/dc/d4c/d65/fa1 0 2024-02-07T12:25:56.777 INFO:tasks.workunit.client.0.smithi047.stdout:2/534: creat d7/dc/d4c/fa2 x:0 0 0 2024-02-07T12:25:56.778 INFO:tasks.workunit.client.0.smithi047.stdout:2/535: creat d7/d48/fa3 x:0 0 0 2024-02-07T12:25:56.780 INFO:tasks.workunit.client.0.smithi047.stdout:5/598: dwrite da/df/d16/d25/f2a [0,4194304] 0 2024-02-07T12:25:56.781 INFO:tasks.workunit.client.0.smithi047.stdout:3/567: dwrite d12/d19/d21/d29/d6f/fb6 [4194304,4194304] 0 2024-02-07T12:25:56.781 INFO:tasks.workunit.client.0.smithi047.stdout:3/568: read d12/d19/d21/f2c [122994,10026] 0 2024-02-07T12:25:56.782 INFO:tasks.workunit.client.0.smithi047.stdout:8/596: read d3/d66/f79 [3216026,118892] 0 2024-02-07T12:25:56.783 INFO:tasks.workunit.client.0.smithi047.stdout:8/597: write d3/d4/f25 [4218670,105938] 0 2024-02-07T12:25:56.783 INFO:tasks.workunit.client.0.smithi047.stdout:3/569: mkdir d12/d19/d21/d29/d31/d38/d59/d87/dc5 0 2024-02-07T12:25:56.788 INFO:tasks.workunit.client.0.smithi047.stdout:2/536: getdents d7 0 2024-02-07T12:25:56.788 INFO:tasks.workunit.client.0.smithi047.stdout:2/537: fdatasync d7/dc/d4c/f50 0 2024-02-07T12:25:56.788 INFO:tasks.workunit.client.0.smithi047.stdout:2/538: getdents d7/dc/d8a 0 2024-02-07T12:25:56.788 INFO:tasks.workunit.client.0.smithi047.stdout:2/539: write d7/dc/d4c/fa2 [22508,10070] 0 2024-02-07T12:25:56.788 INFO:tasks.workunit.client.0.smithi047.stdout:2/540: stat d7/dc 0 2024-02-07T12:25:56.788 INFO:tasks.workunit.client.0.smithi047.stdout:2/541: creat d7/dc/fa4 x:0 0 0 2024-02-07T12:25:56.800 INFO:tasks.workunit.client.0.smithi047.stdout:2/542: rmdir d7/dc 39 2024-02-07T12:25:56.800 INFO:tasks.workunit.client.0.smithi047.stdout:2/543: write d7/d48/fa3 [646733,15001] 0 2024-02-07T12:25:56.801 INFO:tasks.workunit.client.0.smithi047.stdout:2/544: link d7/l22 d7/d2d/d7c/la5 0 2024-02-07T12:25:56.802 INFO:tasks.workunit.client.0.smithi047.stdout:2/545: rmdir d7/d48/d79 0 2024-02-07T12:25:56.802 INFO:tasks.workunit.client.0.smithi047.stdout:2/546: creat d7/d2d/d5c/fa6 x:0 0 0 2024-02-07T12:25:56.803 INFO:tasks.workunit.client.0.smithi047.stdout:8/598: dwrite d3/f56 [0,4194304] 0 2024-02-07T12:25:56.803 INFO:tasks.workunit.client.0.smithi047.stdout:8/599: chown d3/d36/d50/d30/d34/dab/cb3 12709 1 2024-02-07T12:25:56.803 INFO:tasks.workunit.client.0.smithi047.stdout:8/600: creat d3/d4/d4d/fc5 x:0 0 0 2024-02-07T12:25:56.803 INFO:tasks.workunit.client.0.smithi047.stdout:3/570: dwrite d12/d19/d21/d29/d31/d38/f7e [0,4194304] 0 2024-02-07T12:25:56.803 INFO:tasks.workunit.client.0.smithi047.stdout:2/547: mknod d7/dc/d8a/ca7 0 2024-02-07T12:25:56.807 INFO:tasks.workunit.client.0.smithi047.stdout:8/601: symlink d3/d36/d50/d28/lc6 0 2024-02-07T12:25:56.807 INFO:tasks.workunit.client.0.smithi047.stdout:8/602: fsync d3/d36/d50/fb5 0 2024-02-07T12:25:56.807 INFO:tasks.workunit.client.0.smithi047.stdout:8/603: creat d3/d36/d50/d30/d34/d3e/fc7 x:0 0 0 2024-02-07T12:25:56.807 INFO:tasks.workunit.client.0.smithi047.stdout:8/604: readlink d3/d4/l9a 0 2024-02-07T12:25:56.811 INFO:tasks.workunit.client.0.smithi047.stdout:3/571: unlink d12/d19/d2d/d42/f56 0 2024-02-07T12:25:56.812 INFO:tasks.workunit.client.0.smithi047.stdout:2/548: symlink d7/d2d/d5c/d77/d9b/la8 0 2024-02-07T12:25:56.814 INFO:tasks.workunit.client.0.smithi047.stdout:8/605: write d3/d66/d67/f8a [7301190,68688] 0 2024-02-07T12:25:56.814 INFO:tasks.workunit.client.0.smithi047.stdout:2/549: write d7/d48/fa3 [282582,54123] 0 2024-02-07T12:25:56.817 INFO:tasks.workunit.client.0.smithi047.stdout:3/572: creat d12/d19/d21/d29/d31/d7c/fc6 x:0 0 0 2024-02-07T12:25:56.818 INFO:tasks.workunit.client.0.smithi047.stdout:2/550: mknod d7/dc/ca9 0 2024-02-07T12:25:56.836 INFO:tasks.workunit.client.0.smithi047.stdout:2/551: dwrite d7/d2d/d5c/f6a [0,4194304] 0 2024-02-07T12:25:56.836 INFO:tasks.workunit.client.0.smithi047.stdout:2/552: write d7/dc/f75 [748199,36663] 0 2024-02-07T12:25:56.845 INFO:tasks.workunit.client.0.smithi047.stdout:8/606: dwrite d3/d36/d50/f5b [0,4194304] 0 2024-02-07T12:25:56.845 INFO:tasks.workunit.client.0.smithi047.stdout:3/573: dwrite d12/d19/d21/d29/d6f/fb6 [4194304,4194304] 0 2024-02-07T12:25:56.846 INFO:tasks.workunit.client.0.smithi047.stdout:8/607: creat d3/d36/d50/d30/d9e/da6/fc8 x:0 0 0 2024-02-07T12:25:56.846 INFO:tasks.workunit.client.0.smithi047.stdout:8/608: fdatasync d3/d36/d50/d30/d34/f35 0 2024-02-07T12:25:56.846 INFO:tasks.workunit.client.0.smithi047.stdout:8/609: getdents d3/d36/d9d/dbe 0 2024-02-07T12:25:56.848 INFO:tasks.workunit.client.0.smithi047.stdout:8/610: creat d3/d4/d4d/dc0/fc9 x:0 0 0 2024-02-07T12:25:56.848 INFO:tasks.workunit.client.0.smithi047.stdout:8/611: read - d3/d36/d50/d30/d34/d3e/fba zero size 2024-02-07T12:25:56.848 INFO:tasks.workunit.client.0.smithi047.stdout:8/612: stat d3/d36/fa5 0 2024-02-07T12:25:56.856 INFO:tasks.workunit.client.0.smithi047.stdout:3/574: rename d12/d19/d21 to d12/dc7 0 2024-02-07T12:25:56.858 INFO:tasks.workunit.client.0.smithi047.stdout:3/575: mknod d12/dc7/d90/cc8 0 2024-02-07T12:25:56.859 INFO:tasks.workunit.client.0.smithi047.stdout:3/576: mknod d12/d19/d37/cc9 0 2024-02-07T12:25:56.860 INFO:tasks.workunit.client.0.smithi047.stdout:3/577: mknod d12/d19/d37/cca 0 2024-02-07T12:25:56.862 INFO:tasks.workunit.client.0.smithi047.stdout:8/613: dwrite d3/d66/d67/d6a/f51 [4194304,4194304] 0 2024-02-07T12:25:56.865 INFO:tasks.workunit.client.0.smithi047.stdout:8/614: mkdir d3/d66/d67/d6a/dca 0 2024-02-07T12:25:56.868 INFO:tasks.workunit.client.0.smithi047.stdout:8/615: mkdir d3/d36/d50/d30/d9e/dcb 0 2024-02-07T12:25:56.868 INFO:tasks.workunit.client.0.smithi047.stdout:8/616: fsync d3/d36/d50/d30/d34/d3e/f86 0 2024-02-07T12:25:56.868 INFO:tasks.workunit.client.0.smithi047.stdout:8/617: fdatasync d3/faf 0 2024-02-07T12:25:56.873 INFO:tasks.workunit.client.0.smithi047.stdout:2/553: dwrite d7/f2e [4194304,4194304] 0 2024-02-07T12:25:56.890 INFO:tasks.workunit.client.0.smithi047.stdout:2/554: dwrite d7/d2d/d5c/d77/f8e [0,4194304] 0 2024-02-07T12:25:56.890 INFO:tasks.workunit.client.0.smithi047.stdout:2/555: dread - d7/d2d/d5c/f8b zero size 2024-02-07T12:25:56.893 INFO:tasks.workunit.client.0.smithi047.stdout:2/556: symlink d7/laa 0 2024-02-07T12:25:56.894 INFO:tasks.workunit.client.0.smithi047.stdout:2/557: symlink d7/d2d/d5c/lab 0 2024-02-07T12:25:56.895 INFO:tasks.workunit.client.0.smithi047.stdout:2/558: symlink d7/dc/d71/lac 0 2024-02-07T12:25:56.895 INFO:tasks.workunit.client.0.smithi047.stdout:2/559: chown d7/dc/l8d 101534 1 2024-02-07T12:25:56.896 INFO:tasks.workunit.client.0.smithi047.stdout:2/560: mknod d7/cad 0 2024-02-07T12:25:56.896 INFO:tasks.workunit.client.0.smithi047.stdout:2/561: rmdir d7/dc/d51 39 2024-02-07T12:25:56.898 INFO:tasks.workunit.client.0.smithi047.stdout:2/562: creat d7/dc/d4c/da0/fae x:0 0 0 2024-02-07T12:25:56.898 INFO:tasks.workunit.client.0.smithi047.stdout:2/563: dread - d7/dc/fa4 zero size 2024-02-07T12:25:56.898 INFO:tasks.workunit.client.0.smithi047.stdout:2/564: symlink d7/d48/d72/laf 0 2024-02-07T12:25:56.899 INFO:tasks.workunit.client.0.smithi047.stdout:2/565: chown d7/dc/f59 63 1 2024-02-07T12:25:56.899 INFO:tasks.workunit.client.0.smithi047.stdout:2/566: write d7/dc/f1a [5443981,124414] 0 2024-02-07T12:25:56.907 INFO:tasks.workunit.client.0.smithi047.stdout:2/567: dread d7/f23 [0,4194304] 0 2024-02-07T12:25:56.908 INFO:tasks.workunit.client.0.smithi047.stdout:2/568: symlink d7/dc/d51/lb0 0 2024-02-07T12:25:56.910 INFO:tasks.workunit.client.0.smithi047.stdout:2/569: rename d7/c55 to d7/d48/cb1 0 2024-02-07T12:25:56.919 INFO:tasks.workunit.client.0.smithi047.stdout:2/570: dread d7/d48/f7e [0,4194304] 0 2024-02-07T12:25:56.920 INFO:tasks.workunit.client.0.smithi047.stdout:2/571: mknod d7/dc/cb2 0 2024-02-07T12:25:56.920 INFO:tasks.workunit.client.0.smithi047.stdout:2/572: stat d7/dc/d4c/fa2 0 2024-02-07T12:25:56.922 INFO:tasks.workunit.client.0.smithi047.stdout:2/573: link d7/d2d/d5c/d77/d92/l93 d7/d48/d72/lb3 0 2024-02-07T12:25:56.922 INFO:tasks.workunit.client.0.smithi047.stdout:2/574: dread - d7/dc/d4c/f7b zero size 2024-02-07T12:25:56.924 INFO:tasks.workunit.client.0.smithi047.stdout:2/575: getdents d7/d2d/d5c/d77 0 2024-02-07T12:25:56.925 INFO:tasks.workunit.client.0.smithi047.stdout:2/576: mknod d7/d2d/cb4 0 2024-02-07T12:25:56.927 INFO:tasks.workunit.client.0.smithi047.stdout:2/577: rename d7/d2d/l61 to d7/d2d/lb5 0 2024-02-07T12:25:56.932 INFO:tasks.workunit.client.0.smithi047.stdout:2/578: creat d7/d2d/d5c/d77/d92/fb6 x:0 0 0 2024-02-07T12:25:56.932 INFO:tasks.workunit.client.0.smithi047.stdout:2/579: fsync d7/d48/fa3 0 2024-02-07T12:25:56.933 INFO:tasks.workunit.client.0.smithi047.stdout:2/580: mkdir d7/d48/d72/db7 0 2024-02-07T12:25:56.933 INFO:tasks.workunit.client.0.smithi047.stdout:2/581: truncate d7/f2e 8733457 0 2024-02-07T12:25:56.945 INFO:tasks.workunit.client.0.smithi047.stdout:2/582: dwrite d7/dc/d4c/f94 [0,4194304] 0 2024-02-07T12:25:56.945 INFO:tasks.workunit.client.0.smithi047.stdout:2/583: dread - d7/d2d/d5c/fa6 zero size 2024-02-07T12:25:56.946 INFO:tasks.workunit.client.0.smithi047.stdout:2/584: symlink d7/dc/d4c/d65/lb8 0 2024-02-07T12:25:56.947 INFO:tasks.workunit.client.0.smithi047.stdout:2/585: mknod d7/dc/d8a/cb9 0 2024-02-07T12:25:56.954 INFO:tasks.workunit.client.0.smithi047.stdout:2/586: dread d7/dc/f44 [0,4194304] 0 2024-02-07T12:25:56.971 INFO:tasks.workunit.client.0.smithi047.stdout:2/587: dwrite d7/dc/f31 [4194304,4194304] 0 2024-02-07T12:25:56.971 INFO:tasks.workunit.client.0.smithi047.stdout:2/588: getdents d7/dc/d51 0 2024-02-07T12:25:56.972 INFO:tasks.workunit.client.0.smithi047.stdout:2/589: mkdir d7/d48/d72/dba 0 2024-02-07T12:25:56.973 INFO:tasks.workunit.client.0.smithi047.stdout:2/590: truncate d7/dc/d4c/f5e 898120 0 2024-02-07T12:25:56.980 INFO:tasks.workunit.client.0.smithi047.stdout:2/591: write d7/f28 [326202,13344] 0 2024-02-07T12:25:56.980 INFO:tasks.workunit.client.0.smithi047.stdout:2/592: dread - d7/dc/d4c/d65/fa1 zero size 2024-02-07T12:25:56.989 INFO:tasks.workunit.client.0.smithi047.stdout:2/593: dread d7/dc/f84 [0,4194304] 0 2024-02-07T12:25:56.990 INFO:tasks.workunit.client.0.smithi047.stdout:2/594: rename d7/dc/l8d to d7/dc/d8a/lbb 0 2024-02-07T12:25:56.990 INFO:tasks.workunit.client.0.smithi047.stdout:2/595: creat d7/d2d/d7c/fbc x:0 0 0 2024-02-07T12:25:57.423 INFO:tasks.workunit.client.0.smithi047.stdout:6/481: sync 2024-02-07T12:25:57.423 INFO:tasks.workunit.client.0.smithi047.stdout:6/482: chown d3/da/d2c/f2e 89698886 1 2024-02-07T12:25:57.423 INFO:tasks.workunit.client.0.smithi047.stdout:6/483: write d3/da/d14/fa0 [1026941,47575] 0 2024-02-07T12:25:57.424 INFO:tasks.workunit.client.0.smithi047.stdout:6/484: truncate d3/da/d3b/d52/f81 409860 0 2024-02-07T12:25:57.435 INFO:tasks.workunit.client.0.smithi047.stdout:6/485: dread d3/da/d14/f36 [0,4194304] 0 2024-02-07T12:25:57.435 INFO:tasks.workunit.client.0.smithi047.stdout:6/486: write d3/da/d3b/d55/f69 [413459,62223] 0 2024-02-07T12:25:57.436 INFO:tasks.workunit.client.0.smithi047.stdout:6/487: symlink d3/d5/d35/laa 0 2024-02-07T12:25:57.443 INFO:tasks.workunit.client.0.smithi047.stdout:6/488: read d3/d5/d35/d3c/d72/d8c/d95/f4a [1204115,125732] 0 2024-02-07T12:25:57.444 INFO:tasks.workunit.client.0.smithi047.stdout:6/489: creat d3/da/da9/fab x:0 0 0 2024-02-07T12:25:57.444 INFO:tasks.workunit.client.0.smithi047.stdout:6/490: getdents d3/da/d34 0 2024-02-07T12:25:57.445 INFO:tasks.workunit.client.0.smithi047.stdout:6/491: mknod d3/da/d34/d6d/d8f/cac 0 2024-02-07T12:25:57.446 INFO:tasks.workunit.client.0.smithi047.stdout:6/492: mknod d3/da/d3b/d52/cad 0 2024-02-07T12:25:57.462 INFO:tasks.workunit.client.0.smithi047.stdout:6/493: dwrite d3/da/d34/f5a [0,4194304] 0 2024-02-07T12:25:57.462 INFO:tasks.workunit.client.0.smithi047.stdout:6/494: write d3/da/d14/fa0 [1572343,279] 0 2024-02-07T12:25:57.478 INFO:tasks.workunit.client.0.smithi047.stdout:6/495: dwrite d3/d5/f13 [0,4194304] 0 2024-02-07T12:25:57.479 INFO:tasks.workunit.client.0.smithi047.stdout:6/496: write d3/d1e/f21 [13496499,73087] 0 2024-02-07T12:25:57.479 INFO:tasks.workunit.client.0.smithi047.stdout:6/497: read - d3/da/d3b/d52/f67 zero size 2024-02-07T12:25:57.481 INFO:tasks.workunit.client.0.smithi047.stdout:6/498: getdents d3/da/d2c/d42 0 2024-02-07T12:25:57.482 INFO:tasks.workunit.client.0.smithi047.stdout:6/499: rename d3/d5/d35/d3c/d90/f99 to d3/d5/d35/d3c/d90/fae 0 2024-02-07T12:25:57.483 INFO:tasks.workunit.client.0.smithi047.stdout:6/500: write d3/da/d2c/d47/f98 [223955,66862] 0 2024-02-07T12:25:57.501 INFO:tasks.workunit.client.0.smithi047.stdout:4/576: sync 2024-02-07T12:25:57.501 INFO:tasks.workunit.client.0.smithi047.stdout:7/546: sync 2024-02-07T12:25:57.503 INFO:tasks.workunit.client.0.smithi047.stdout:4/577: creat d3/d61/d43/d45/db7/fbd x:0 0 0 2024-02-07T12:25:57.506 INFO:tasks.workunit.client.0.smithi047.stdout:4/578: creat d3/d27/dbc/fbe x:0 0 0 2024-02-07T12:25:57.511 INFO:tasks.workunit.client.0.smithi047.stdout:4/579: rmdir d3/d27/dbc 39 2024-02-07T12:25:57.512 INFO:tasks.workunit.client.0.smithi047.stdout:4/580: symlink d3/d61/d43/d45/db7/lbf 0 2024-02-07T12:25:57.512 INFO:tasks.workunit.client.0.smithi047.stdout:4/581: chown d3/f14 380 1 2024-02-07T12:25:57.514 INFO:tasks.workunit.client.0.smithi047.stdout:7/547: dwrite d0/df/d29/f89 [0,4194304] 0 2024-02-07T12:25:57.516 INFO:tasks.workunit.client.0.smithi047.stdout:7/548: rename d0/df/d29/f89 to d0/da8/fad 0 2024-02-07T12:25:57.516 INFO:tasks.workunit.client.0.smithi047.stdout:7/549: fsync d0/df/d29/d31/d40/f8c 0 2024-02-07T12:25:57.517 INFO:tasks.workunit.client.0.smithi047.stdout:7/550: mknod d0/df/d29/d31/d55/cae 0 2024-02-07T12:25:57.526 INFO:tasks.workunit.client.0.smithi047.stdout:7/551: write d0/df/d29/d31/d40/f9e [2328154,60750] 0 2024-02-07T12:25:57.526 INFO:tasks.workunit.client.0.smithi047.stdout:7/552: fdatasync d0/d4/fe 0 2024-02-07T12:25:57.527 INFO:tasks.workunit.client.0.smithi047.stdout:7/553: creat d0/df/d29/d31/faf x:0 0 0 2024-02-07T12:25:57.529 INFO:tasks.workunit.client.0.smithi047.stdout:4/582: dwrite d3/f14 [8388608,4194304] 0 2024-02-07T12:25:57.529 INFO:tasks.workunit.client.0.smithi047.stdout:4/583: mknod d3/d61/d43/d45/d6c/cc0 0 2024-02-07T12:25:57.529 INFO:tasks.workunit.client.0.smithi047.stdout:4/584: creat d3/d27/fc1 x:0 0 0 2024-02-07T12:25:57.530 INFO:tasks.workunit.client.0.smithi047.stdout:4/585: symlink d3/d27/d5e/lc2 0 2024-02-07T12:25:57.532 INFO:tasks.workunit.client.0.smithi047.stdout:4/586: link d3/d27/d3b/d7d/f82 d3/d61/d43/d45/d63/fc3 0 2024-02-07T12:25:57.532 INFO:tasks.workunit.client.0.smithi047.stdout:4/587: write d3/d27/d3b/d7d/f82 [739503,39437] 0 2024-02-07T12:25:57.533 INFO:tasks.workunit.client.0.smithi047.stdout:4/588: creat d3/d61/d70/d83/fc4 x:0 0 0 2024-02-07T12:25:57.533 INFO:tasks.workunit.client.0.smithi047.stdout:4/589: fsync d3/f75 0 2024-02-07T12:25:57.534 INFO:tasks.workunit.client.0.smithi047.stdout:4/590: rmdir d3/d27/dbc 39 2024-02-07T12:25:57.541 INFO:tasks.workunit.client.0.smithi047.stdout:4/591: rename d3/d61/d43/d45/d6c to d3/d27/dc5 0 2024-02-07T12:25:57.541 INFO:tasks.workunit.client.0.smithi047.stdout:4/592: truncate d3/d61/d43/d45/d66/f8f 1730270 0 2024-02-07T12:25:57.542 INFO:tasks.workunit.client.0.smithi047.stdout:4/593: symlink d3/d61/d43/d45/d63/db3/lc6 0 2024-02-07T12:25:57.544 INFO:tasks.workunit.client.0.smithi047.stdout:7/554: dwrite d0/d42/d4d/d67/f73 [4194304,4194304] 0 2024-02-07T12:25:57.544 INFO:tasks.workunit.client.0.smithi047.stdout:7/555: write d0/df/d29/d3e/d4c/fa1 [978733,101647] 0 2024-02-07T12:25:57.545 INFO:tasks.workunit.client.0.smithi047.stdout:7/556: mkdir d0/db0 0 2024-02-07T12:25:57.546 INFO:tasks.workunit.client.0.smithi047.stdout:7/557: creat d0/df/d29/fb1 x:0 0 0 2024-02-07T12:25:57.566 INFO:tasks.workunit.client.0.smithi047.stdout:4/594: dwrite d3/d27/fc1 [0,4194304] 0 2024-02-07T12:25:57.566 INFO:tasks.workunit.client.0.smithi047.stdout:7/558: dwrite d0/df/d29/f22 [0,4194304] 0 2024-02-07T12:25:57.566 INFO:tasks.workunit.client.0.smithi047.stdout:7/559: rename d0/df to d0/df/d29/d3e/db2 22 2024-02-07T12:25:57.573 INFO:tasks.workunit.client.0.smithi047.stdout:4/595: dread d3/f17 [0,4194304] 0 2024-02-07T12:25:57.575 INFO:tasks.workunit.client.0.smithi047.stdout:4/596: link d3/d27/d5e/lb2 d3/d61/d70/d83/d85/lc7 0 2024-02-07T12:25:57.576 INFO:tasks.workunit.client.0.smithi047.stdout:4/597: mknod d3/d61/cc8 0 2024-02-07T12:25:57.576 INFO:tasks.workunit.client.0.smithi047.stdout:4/598: creat d3/d27/d3b/d7d/da2/fc9 x:0 0 0 2024-02-07T12:25:57.581 INFO:tasks.workunit.client.0.smithi047.stdout:7/560: dwrite d0/df/d29/d3e/f56 [4194304,4194304] 0 2024-02-07T12:25:57.583 INFO:tasks.workunit.client.0.smithi047.stdout:4/599: dread d3/f2b [0,4194304] 0 2024-02-07T12:25:57.592 INFO:tasks.workunit.client.0.smithi047.stdout:7/561: creat d0/d42/d4d/d67/fb3 x:0 0 0 2024-02-07T12:25:57.594 INFO:tasks.workunit.client.0.smithi047.stdout:4/600: creat d3/d61/d43/d45/d66/fca x:0 0 0 2024-02-07T12:25:57.597 INFO:tasks.workunit.client.0.smithi047.stdout:4/601: mkdir d3/db1/d37/da9/dcb 0 2024-02-07T12:25:57.601 INFO:tasks.workunit.client.0.smithi047.stdout:7/562: rmdir d0/df/d29 39 2024-02-07T12:25:57.602 INFO:tasks.workunit.client.0.smithi047.stdout:7/563: creat d0/df/d29/d31/fb4 x:0 0 0 2024-02-07T12:25:57.616 INFO:tasks.workunit.client.0.smithi047.stdout:4/602: dwrite d3/f54 [0,4194304] 0 2024-02-07T12:25:57.617 INFO:tasks.workunit.client.0.smithi047.stdout:4/603: rename d3/db1/f38 to d3/d61/d43/d45/d63/db3/fcc 0 2024-02-07T12:25:57.617 INFO:tasks.workunit.client.0.smithi047.stdout:4/604: chown d3/d27/l6b 3826 1 2024-02-07T12:25:57.619 INFO:tasks.workunit.client.0.smithi047.stdout:4/605: link d3/c32 d3/d61/d43/d45/ccd 0 2024-02-07T12:25:57.620 INFO:tasks.workunit.client.0.smithi047.stdout:4/606: rename d3/db1/d37/c7b to d3/d61/d43/d45/cce 0 2024-02-07T12:25:57.622 INFO:tasks.workunit.client.0.smithi047.stdout:4/607: dread d3/d27/d3b/d7d/f82 [0,4194304] 0 2024-02-07T12:25:57.622 INFO:tasks.workunit.client.0.smithi047.stdout:4/608: dread - d3/db1/f86 zero size 2024-02-07T12:25:57.622 INFO:tasks.workunit.client.0.smithi047.stdout:7/564: dwrite d0/df/d29/fa6 [0,4194304] 0 2024-02-07T12:25:57.627 INFO:tasks.workunit.client.0.smithi047.stdout:4/609: link d3/d61/d43/d45/d63/db3/fcc d3/fcf 0 2024-02-07T12:25:57.631 INFO:tasks.workunit.client.0.smithi047.stdout:7/565: dread d0/df/d29/d31/d40/f9e [0,4194304] 0 2024-02-07T12:25:57.632 INFO:tasks.workunit.client.0.smithi047.stdout:7/566: creat d0/d42/fb5 x:0 0 0 2024-02-07T12:25:57.632 INFO:tasks.workunit.client.0.smithi047.stdout:7/567: chown d0/c6c 42726392 1 2024-02-07T12:25:57.639 INFO:tasks.workunit.client.0.smithi047.stdout:7/568: dread d0/d6f/f71 [0,4194304] 0 2024-02-07T12:25:57.640 INFO:tasks.workunit.client.0.smithi047.stdout:7/569: link d0/df/c35 d0/df/d29/cb6 0 2024-02-07T12:25:57.641 INFO:tasks.workunit.client.0.smithi047.stdout:7/570: creat d0/df/d29/d3e/d4c/fb7 x:0 0 0 2024-02-07T12:25:57.643 INFO:tasks.workunit.client.0.smithi047.stdout:7/571: creat d0/df/d29/fb8 x:0 0 0 2024-02-07T12:25:57.643 INFO:tasks.workunit.client.0.smithi047.stdout:7/572: write d0/d4/f5 [505548,18807] 0 2024-02-07T12:25:57.643 INFO:tasks.workunit.client.0.smithi047.stdout:7/573: creat d0/d42/fb9 x:0 0 0 2024-02-07T12:25:57.645 INFO:tasks.workunit.client.0.smithi047.stdout:7/574: creat d0/d4/da2/fba x:0 0 0 2024-02-07T12:25:57.645 INFO:tasks.workunit.client.0.smithi047.stdout:7/575: write d0/d6f/f9b [924574,90410] 0 2024-02-07T12:25:57.646 INFO:tasks.workunit.client.0.smithi047.stdout:7/576: creat d0/da8/fbb x:0 0 0 2024-02-07T12:25:57.649 INFO:tasks.workunit.client.0.smithi047.stdout:4/610: dwrite d3/d27/dc5/d73/f91 [0,4194304] 0 2024-02-07T12:25:57.649 INFO:tasks.workunit.client.0.smithi047.stdout:4/611: truncate d3/f12 5302714 0 2024-02-07T12:25:57.649 INFO:tasks.workunit.client.0.smithi047.stdout:7/577: dread d0/d4/f16 [0,4194304] 0 2024-02-07T12:25:57.651 INFO:tasks.workunit.client.0.smithi047.stdout:4/612: mkdir d3/d27/d5e/dd0 0 2024-02-07T12:25:57.654 INFO:tasks.workunit.client.0.smithi047.stdout:7/578: truncate d0/df/d29/d3e/f59 162977 0 2024-02-07T12:25:57.654 INFO:tasks.workunit.client.0.smithi047.stdout:7/579: fdatasync d0/df/f8b 0 2024-02-07T12:25:57.654 INFO:tasks.workunit.client.0.smithi047.stdout:7/580: creat d0/da8/fbc x:0 0 0 2024-02-07T12:25:57.655 INFO:tasks.workunit.client.0.smithi047.stdout:7/581: write d0/d42/fa3 [819539,53886] 0 2024-02-07T12:25:57.659 INFO:tasks.workunit.client.0.smithi047.stdout:7/582: rename d0/df/f8b to d0/db0/fbd 0 2024-02-07T12:25:57.660 INFO:tasks.workunit.client.0.smithi047.stdout:7/583: truncate d0/df/d29/d31/d55/f7f 861023 0 2024-02-07T12:25:57.661 INFO:tasks.workunit.client.0.smithi047.stdout:0/326: sync 2024-02-07T12:25:57.661 INFO:tasks.workunit.client.0.smithi047.stdout:1/462: sync 2024-02-07T12:25:57.661 INFO:tasks.workunit.client.0.smithi047.stdout:9/314: sync 2024-02-07T12:25:57.661 INFO:tasks.workunit.client.0.smithi047.stdout:0/327: readlink d19/d40/l44 0 2024-02-07T12:25:57.661 INFO:tasks.workunit.client.0.smithi047.stdout:9/315: readlink l0 0 2024-02-07T12:25:57.662 INFO:tasks.workunit.client.0.smithi047.stdout:1/463: write d1/d15/f79 [419209,107493] 0 2024-02-07T12:25:57.662 INFO:tasks.workunit.client.0.smithi047.stdout:1/464: getdents d1/d48/d81 0 2024-02-07T12:25:57.662 INFO:tasks.workunit.client.0.smithi047.stdout:1/465: chown d1/d15/d30/f5a 55569237 1 2024-02-07T12:25:57.662 INFO:tasks.workunit.client.0.smithi047.stdout:7/584: rename d0/d42/d4d/d67/f98 to d0/df/d29/d3e/d4c/d97/fbe 0 2024-02-07T12:25:57.663 INFO:tasks.workunit.client.0.smithi047.stdout:4/613: dwrite d3/d27/d3b/f88 [0,4194304] 0 2024-02-07T12:25:57.665 INFO:tasks.workunit.client.0.smithi047.stdout:9/316: symlink d3/d10/d18/d3b/d3c/d5d/l71 0 2024-02-07T12:25:57.665 INFO:tasks.workunit.client.0.smithi047.stdout:9/317: fdatasync d3/d10/d18/d3b/d52/f54 0 2024-02-07T12:25:57.665 INFO:tasks.workunit.client.0.smithi047.stdout:9/318: write d3/d10/f60 [302310,65820] 0 2024-02-07T12:25:57.669 INFO:tasks.workunit.client.0.smithi047.stdout:9/319: mknod d3/d10/d18/d3b/d3c/d5d/c72 0 2024-02-07T12:25:57.669 INFO:tasks.workunit.client.0.smithi047.stdout:9/320: stat d3/d10/f67 0 2024-02-07T12:25:57.669 INFO:tasks.workunit.client.0.smithi047.stdout:9/321: truncate d3/d10/d18/d3a/f44 846173 0 2024-02-07T12:25:57.670 INFO:tasks.workunit.client.0.smithi047.stdout:0/328: dread d19/f45 [0,4194304] 0 2024-02-07T12:25:57.670 INFO:tasks.workunit.client.0.smithi047.stdout:4/614: rename d3/c1d to d3/db1/d37/da9/dcb/cd1 0 2024-02-07T12:25:57.671 INFO:tasks.workunit.client.0.smithi047.stdout:7/585: dread d0/d4/f7e [0,4194304] 0 2024-02-07T12:25:57.672 INFO:tasks.workunit.client.0.smithi047.stdout:9/322: symlink d3/d10/l73 0 2024-02-07T12:25:57.672 INFO:tasks.workunit.client.0.smithi047.stdout:9/323: write d3/d10/d18/f59 [830142,79831] 0 2024-02-07T12:25:57.672 INFO:tasks.workunit.client.0.smithi047.stdout:9/324: write d3/d10/f60 [328638,105800] 0 2024-02-07T12:25:57.672 INFO:tasks.workunit.client.0.smithi047.stdout:9/325: chown d3/d10/d18/f1a 1927788 1 2024-02-07T12:25:57.672 INFO:tasks.workunit.client.0.smithi047.stdout:1/466: read d1/d15/d18/d40/f52 [3734782,99370] 0 2024-02-07T12:25:57.673 INFO:tasks.workunit.client.0.smithi047.stdout:1/467: write d1/f22 [7739685,49638] 0 2024-02-07T12:25:57.673 INFO:tasks.workunit.client.0.smithi047.stdout:7/586: write d0/d42/f57 [4412595,124739] 0 2024-02-07T12:25:57.674 INFO:tasks.workunit.client.0.smithi047.stdout:7/587: truncate d0/d42/d4d/d67/fb3 57055 0 2024-02-07T12:25:57.674 INFO:tasks.workunit.client.0.smithi047.stdout:0/329: creat d19/d1c/d3c/d60/d61/f63 x:0 0 0 2024-02-07T12:25:57.675 INFO:tasks.workunit.client.0.smithi047.stdout:9/326: symlink d3/d10/d18/d3d/l74 0 2024-02-07T12:25:57.675 INFO:tasks.workunit.client.0.smithi047.stdout:9/327: fsync d3/d10/d18/d3b/d52/d6b/f6f 0 2024-02-07T12:25:57.676 INFO:tasks.workunit.client.0.smithi047.stdout:9/328: readlink d3/d10/l30 0 2024-02-07T12:25:57.676 INFO:tasks.workunit.client.0.smithi047.stdout:9/329: chown d3/d10/l38 1335 1 2024-02-07T12:25:57.677 INFO:tasks.workunit.client.0.smithi047.stdout:1/468: getdents d1/d48 0 2024-02-07T12:25:57.679 INFO:tasks.workunit.client.0.smithi047.stdout:7/588: rename d0/df/c2b to d0/d6f/cbf 0 2024-02-07T12:25:57.681 INFO:tasks.workunit.client.0.smithi047.stdout:7/589: dread d0/db0/fbd [0,4194304] 0 2024-02-07T12:25:57.682 INFO:tasks.workunit.client.0.smithi047.stdout:1/469: mknod d1/d15/d2f/d3d/d84/c8e 0 2024-02-07T12:25:57.684 INFO:tasks.workunit.client.0.smithi047.stdout:0/330: rename d19/d1c/d3c/c4d to d19/d1c/d2c/d49/c64 0 2024-02-07T12:25:57.685 INFO:tasks.workunit.client.0.smithi047.stdout:7/590: fdatasync d0/d4/f17 0 2024-02-07T12:25:57.686 INFO:tasks.workunit.client.0.smithi047.stdout:1/470: rename d1/d15/d18/d65/f64 to d1/d6e/d75/f8f 0 2024-02-07T12:25:57.686 INFO:tasks.workunit.client.0.smithi047.stdout:4/615: dwrite d3/d27/d3b/d7d/faf [4194304,4194304] 0 2024-02-07T12:25:57.687 INFO:tasks.workunit.client.0.smithi047.stdout:7/591: getdents d0/db0 0 2024-02-07T12:25:57.697 INFO:tasks.workunit.client.0.smithi047.stdout:9/330: truncate d3/d10/d18/d3a/f44 81897 0 2024-02-07T12:25:57.697 INFO:tasks.workunit.client.0.smithi047.stdout:9/331: write d3/d10/d18/d3b/d52/d6b/f6f [314251,78319] 0 2024-02-07T12:25:57.703 INFO:tasks.workunit.client.0.smithi047.stdout:4/616: link d3/f2b d3/d27/dc5/d73/fd2 0 2024-02-07T12:25:57.703 INFO:tasks.workunit.client.0.smithi047.stdout:4/617: readlink d3/d61/d43/l90 0 2024-02-07T12:25:57.703 INFO:tasks.workunit.client.0.smithi047.stdout:0/331: getdents d19/d1c/d24 0 2024-02-07T12:25:57.705 INFO:tasks.workunit.client.0.smithi047.stdout:9/332: mknod d3/d10/c75 0 2024-02-07T12:25:57.706 INFO:tasks.workunit.client.0.smithi047.stdout:4/618: mknod d3/d61/d43/d45/cd3 0 2024-02-07T12:25:57.708 INFO:tasks.workunit.client.0.smithi047.stdout:0/332: link d19/f34 d19/d1c/d2c/d49/f65 0 2024-02-07T12:25:57.708 INFO:tasks.workunit.client.0.smithi047.stdout:4/619: getdents d3/d27/dbc 0 2024-02-07T12:25:57.709 INFO:tasks.workunit.client.0.smithi047.stdout:0/333: write d19/f26 [339382,48674] 0 2024-02-07T12:25:57.710 INFO:tasks.workunit.client.0.smithi047.stdout:1/471: dwrite d1/f87 [0,4194304] 0 2024-02-07T12:25:57.712 INFO:tasks.workunit.client.0.smithi047.stdout:4/620: dread d3/d61/d43/d45/d66/f8f [0,4194304] 0 2024-02-07T12:25:57.712 INFO:tasks.workunit.client.0.smithi047.stdout:7/592: dwrite d0/d6f/f71 [0,4194304] 0 2024-02-07T12:25:57.712 INFO:tasks.workunit.client.0.smithi047.stdout:7/593: write d0/df/d29/d3e/f43 [329026,106895] 0 2024-02-07T12:25:57.712 INFO:tasks.workunit.client.0.smithi047.stdout:7/594: write d0/f2 [3403701,6952] 0 2024-02-07T12:25:57.712 INFO:tasks.workunit.client.0.smithi047.stdout:7/595: chown d0/d2f/c32 89365 1 2024-02-07T12:25:57.713 INFO:tasks.workunit.client.0.smithi047.stdout:1/472: symlink d1/d15/d2f/d3d/d3e/l90 0 2024-02-07T12:25:57.714 INFO:tasks.workunit.client.0.smithi047.stdout:1/473: write d1/d15/d30/f6a [817812,72894] 0 2024-02-07T12:25:57.715 INFO:tasks.workunit.client.0.smithi047.stdout:4/621: mkdir d3/d61/d43/d45/d63/db3/dd4 0 2024-02-07T12:25:57.723 INFO:tasks.workunit.client.0.smithi047.stdout:0/334: dread d19/d1c/d2c/f38 [0,4194304] 0 2024-02-07T12:25:57.723 INFO:tasks.workunit.client.0.smithi047.stdout:7/596: rename d0/d42/d4d/c8a to d0/df/cc0 0 2024-02-07T12:25:57.724 INFO:tasks.workunit.client.0.smithi047.stdout:7/597: write d0/df/d29/d3e/d4c/fa1 [1931753,103966] 0 2024-02-07T12:25:57.724 INFO:tasks.workunit.client.0.smithi047.stdout:7/598: write d0/d42/f45 [141988,45204] 0 2024-02-07T12:25:57.725 INFO:tasks.workunit.client.0.smithi047.stdout:4/622: dread d3/db1/f6e [0,4194304] 0 2024-02-07T12:25:57.725 INFO:tasks.workunit.client.0.smithi047.stdout:4/623: creat d3/d27/d3b/d7d/da2/fd5 x:0 0 0 2024-02-07T12:25:57.725 INFO:tasks.workunit.client.0.smithi047.stdout:1/474: creat d1/d48/d81/f91 x:0 0 0 2024-02-07T12:25:57.728 INFO:tasks.workunit.client.0.smithi047.stdout:7/599: rename d0/df/d29/f5b to d0/d6f/fc1 0 2024-02-07T12:25:57.730 INFO:tasks.workunit.client.0.smithi047.stdout:9/333: dwrite d3/f29 [0,4194304] 0 2024-02-07T12:25:57.730 INFO:tasks.workunit.client.0.smithi047.stdout:9/334: write d3/d10/d18/d3b/d3c/f55 [482933,74904] 0 2024-02-07T12:25:57.735 INFO:tasks.workunit.client.0.smithi047.stdout:0/335: dread fc [0,4194304] 0 2024-02-07T12:25:57.736 INFO:tasks.workunit.client.0.smithi047.stdout:0/336: read d19/d1c/d24/f56 [696978,4849] 0 2024-02-07T12:25:57.737 INFO:tasks.workunit.client.0.smithi047.stdout:7/600: mknod d0/df/d29/d3e/d4c/d97/cc2 0 2024-02-07T12:25:57.739 INFO:tasks.workunit.client.0.smithi047.stdout:9/335: symlink d3/d10/l76 0 2024-02-07T12:25:57.740 INFO:tasks.workunit.client.0.smithi047.stdout:8/618: sync 2024-02-07T12:25:57.740 INFO:tasks.workunit.client.0.smithi047.stdout:8/619: fdatasync d3/d36/d50/d28/fa3 0 2024-02-07T12:25:57.740 INFO:tasks.workunit.client.0.smithi047.stdout:2/596: sync 2024-02-07T12:25:57.740 INFO:tasks.workunit.client.0.smithi047.stdout:5/599: sync 2024-02-07T12:25:57.740 INFO:tasks.workunit.client.0.smithi047.stdout:3/578: sync 2024-02-07T12:25:57.740 INFO:tasks.workunit.client.0.smithi047.stdout:5/600: readlink da/d24/d63/d9a/l40 0 2024-02-07T12:25:57.743 INFO:tasks.workunit.client.0.smithi047.stdout:9/336: creat d3/d10/d18/d3b/d3c/d47/f77 x:0 0 0 2024-02-07T12:25:57.743 INFO:tasks.workunit.client.0.smithi047.stdout:9/337: write d3/f40 [4827347,127391] 0 2024-02-07T12:25:57.744 INFO:tasks.workunit.client.0.smithi047.stdout:2/597: dread d7/f39 [0,4194304] 0 2024-02-07T12:25:57.744 INFO:tasks.workunit.client.0.smithi047.stdout:2/598: dread - d7/d2d/d5c/f80 zero size 2024-02-07T12:25:57.744 INFO:tasks.workunit.client.0.smithi047.stdout:2/599: chown d7/dc/d4c/d65/lb8 28 1 2024-02-07T12:25:57.745 INFO:tasks.workunit.client.0.smithi047.stdout:3/579: unlink d12/dc7/l24 0 2024-02-07T12:25:57.746 INFO:tasks.workunit.client.0.smithi047.stdout:3/580: read d12/dc7/d29/d31/f45 [3007650,109871] 0 2024-02-07T12:25:57.746 INFO:tasks.workunit.client.0.smithi047.stdout:1/475: dwrite d1/d15/d18/d40/f56 [4194304,4194304] 0 2024-02-07T12:25:57.747 INFO:tasks.workunit.client.0.smithi047.stdout:1/476: write d1/d15/d18/f27 [646954,12447] 0 2024-02-07T12:25:57.747 INFO:tasks.workunit.client.0.smithi047.stdout:1/477: fdatasync d1/d15/d2f/d3d/d3e/f57 0 2024-02-07T12:25:57.749 INFO:tasks.workunit.client.0.smithi047.stdout:7/601: dread d0/df/d29/d31/d40/f49 [0,4194304] 0 2024-02-07T12:25:57.751 INFO:tasks.workunit.client.0.smithi047.stdout:8/620: dread d3/d4/d4d/fb1 [0,4194304] 0 2024-02-07T12:25:57.751 INFO:tasks.workunit.client.0.smithi047.stdout:8/621: creat d3/d66/d67/d6a/d91/fcc x:0 0 0 2024-02-07T12:25:57.751 INFO:tasks.workunit.client.0.smithi047.stdout:8/622: chown d3/d36/f3b 0 1 2024-02-07T12:25:57.751 INFO:tasks.workunit.client.0.smithi047.stdout:4/624: dwrite d3/d27/d3b/d7d/faf [0,4194304] 0 2024-02-07T12:25:57.753 INFO:tasks.workunit.client.0.smithi047.stdout:9/338: creat d3/d10/d18/d3b/d3c/d5d/f78 x:0 0 0 2024-02-07T12:25:57.758 INFO:tasks.workunit.client.0.smithi047.stdout:6/501: sync 2024-02-07T12:25:57.759 INFO:tasks.workunit.client.0.smithi047.stdout:0/337: rename d19/d1c/d3c/d60/d61 to d19/d40/d66 0 2024-02-07T12:25:57.760 INFO:tasks.workunit.client.0.smithi047.stdout:5/601: dwrite da/df/d16/d25/d71/f9f [0,4194304] 0 2024-02-07T12:25:57.760 INFO:tasks.workunit.client.0.smithi047.stdout:5/602: fsync da/d24/f45 0 2024-02-07T12:25:57.762 INFO:tasks.workunit.client.0.smithi047.stdout:7/602: creat d0/df/d29/d3e/d4c/d97/fc3 x:0 0 0 2024-02-07T12:25:57.762 INFO:tasks.workunit.client.0.smithi047.stdout:7/603: chown d0/df/d29/d31/faf 1 1 2024-02-07T12:25:57.762 INFO:tasks.workunit.client.0.smithi047.stdout:7/604: stat d0/df/d29/d31/d40/f8c 0 2024-02-07T12:25:57.763 INFO:tasks.workunit.client.0.smithi047.stdout:7/605: fdatasync d0/d4/f20 0 2024-02-07T12:25:57.763 INFO:tasks.workunit.client.0.smithi047.stdout:7/606: chown d0/df/d29/d3e/d4c/fa1 158 1 2024-02-07T12:25:57.764 INFO:tasks.workunit.client.0.smithi047.stdout:8/623: mkdir d3/d36/d50/d30/d9e/dcb/dcd 0 2024-02-07T12:25:57.767 INFO:tasks.workunit.client.0.smithi047.stdout:4/625: link d3/d61/d43/d45/f51 d3/d61/d70/d83/d85/fd6 0 2024-02-07T12:25:57.768 INFO:tasks.workunit.client.0.smithi047.stdout:4/626: write d3/db1/d37/f5d [1145093,7992] 0 2024-02-07T12:25:57.769 INFO:tasks.workunit.client.0.smithi047.stdout:9/339: mkdir d3/d10/d18/d3d/d79 0 2024-02-07T12:25:57.769 INFO:tasks.workunit.client.0.smithi047.stdout:3/581: dwrite d12/dc7/d29/f66 [0,4194304] 0 2024-02-07T12:25:57.771 INFO:tasks.workunit.client.0.smithi047.stdout:1/478: rmdir d1/d15/d30 39 2024-02-07T12:25:57.773 INFO:tasks.workunit.client.0.smithi047.stdout:6/502: truncate d3/d5/f15 1606193 0 2024-02-07T12:25:57.778 INFO:tasks.workunit.client.0.smithi047.stdout:5/603: mknod da/df/d16/d25/d33/d55/d80/da6/cc7 0 2024-02-07T12:25:57.780 INFO:tasks.workunit.client.0.smithi047.stdout:7/607: rename d0/f2 to d0/d2f/fc4 0 2024-02-07T12:25:57.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:57 smithi138 ceph-mon[35528]: pgmap v15: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 36 MiB/s rd, 49 MiB/s wr, 207 op/s 2024-02-07T12:25:57.784 INFO:tasks.workunit.client.0.smithi047.stdout:3/582: dread d12/f16 [0,4194304] 0 2024-02-07T12:25:57.785 INFO:tasks.workunit.client.0.smithi047.stdout:6/503: creat d3/d5/faf x:0 0 0 2024-02-07T12:25:57.785 INFO:tasks.workunit.client.0.smithi047.stdout:6/504: fsync d3/d5/d35/d3c/d72/d8c/d95/f4a 0 2024-02-07T12:25:57.785 INFO:tasks.workunit.client.0.smithi047.stdout:6/505: chown d3/da/d2c/d42/ca4 1101 1 2024-02-07T12:25:57.786 INFO:tasks.workunit.client.0.smithi047.stdout:7/608: unlink d0/df/d74/f7b 0 2024-02-07T12:25:57.789 INFO:tasks.workunit.client.0.smithi047.stdout:7/609: getdents d0/da8 0 2024-02-07T12:25:57.789 INFO:tasks.workunit.client.0.smithi047.stdout:7/610: chown d0/d4/f5 454 1 2024-02-07T12:25:57.791 INFO:tasks.workunit.client.0.smithi047.stdout:5/604: dread da/df/d16/d25/d71/d68/f87 [0,4194304] 0 2024-02-07T12:25:57.793 INFO:tasks.workunit.client.0.smithi047.stdout:1/479: dwrite d1/d6e/d75/f8f [0,4194304] 0 2024-02-07T12:25:57.793 INFO:tasks.workunit.client.0.smithi047.stdout:5/605: symlink da/df/d16/d25/d33/d6e/dbb/lc8 0 2024-02-07T12:25:57.794 INFO:tasks.workunit.client.0.smithi047.stdout:7/611: write d0/d4/f7e [786004,119574] 0 2024-02-07T12:25:57.794 INFO:tasks.workunit.client.0.smithi047.stdout:7/612: creat d0/d42/d4d/d67/fc5 x:0 0 0 2024-02-07T12:25:57.794 INFO:tasks.workunit.client.0.smithi047.stdout:7/613: truncate d0/df/d29/d3e/d4c/f8e 838845 0 2024-02-07T12:25:57.796 INFO:tasks.workunit.client.0.smithi047.stdout:1/480: creat d1/d15/d18/d65/f92 x:0 0 0 2024-02-07T12:25:57.798 INFO:tasks.workunit.client.0.smithi047.stdout:5/606: truncate da/f1a 1589404 0 2024-02-07T12:25:57.798 INFO:tasks.workunit.client.0.smithi047.stdout:6/506: dread d3/d5/f13 [0,4194304] 0 2024-02-07T12:25:57.798 INFO:tasks.workunit.client.0.smithi047.stdout:5/607: dread - da/df/d16/fc0 zero size 2024-02-07T12:25:57.798 INFO:tasks.workunit.client.0.smithi047.stdout:5/608: write da/df/d16/d25/d33/d55/d80/fc5 [893072,14487] 0 2024-02-07T12:25:57.798 INFO:tasks.workunit.client.0.smithi047.stdout:5/609: chown da/df/d16/d25/d33/d55/l58 485330 1 2024-02-07T12:25:57.800 INFO:tasks.workunit.client.0.smithi047.stdout:1/481: unlink d1/d15/d2f/d3d/d3e/l90 0 2024-02-07T12:25:57.802 INFO:tasks.workunit.client.0.smithi047.stdout:5/610: creat da/d24/d63/d9c/fc9 x:0 0 0 2024-02-07T12:25:57.802 INFO:tasks.workunit.client.0.smithi047.stdout:7/614: write d0/d42/f57 [839158,97091] 0 2024-02-07T12:25:57.817 INFO:tasks.workunit.client.0.smithi047.stdout:5/611: dread da/f39 [0,4194304] 0 2024-02-07T12:25:57.817 INFO:tasks.workunit.client.0.smithi047.stdout:1/482: dread d1/d15/d18/f4f [0,4194304] 0 2024-02-07T12:25:57.818 INFO:tasks.workunit.client.0.smithi047.stdout:5/612: creat da/df/d16/d25/d33/d55/d7c/fca x:0 0 0 2024-02-07T12:25:57.818 INFO:tasks.workunit.client.0.smithi047.stdout:5/613: truncate da/df/d16/d25/d33/d55/d80/da6/fc4 577049 0 2024-02-07T12:25:57.818 INFO:tasks.workunit.client.0.smithi047.stdout:5/614: stat da/df/d16/d25/d33/d55 0 2024-02-07T12:25:57.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:57 smithi047 ceph-mon[28972]: pgmap v15: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 36 MiB/s rd, 49 MiB/s wr, 207 op/s 2024-02-07T12:25:57.865 INFO:tasks.workunit.client.0.smithi047.stdout:4/627: read d3/d61/f58 [1780069,21253] 0 2024-02-07T12:25:57.867 INFO:tasks.workunit.client.0.smithi047.stdout:0/338: dwrite d19/f27 [0,4194304] 0 2024-02-07T12:25:57.869 INFO:tasks.workunit.client.0.smithi047.stdout:0/339: mknod d19/d1c/d2b/c67 0 2024-02-07T12:25:57.869 INFO:tasks.workunit.client.0.smithi047.stdout:0/340: creat d19/d1c/d2c/d49/f68 x:0 0 0 2024-02-07T12:25:57.874 INFO:tasks.workunit.client.0.smithi047.stdout:4/628: dread d3/f12 [0,4194304] 0 2024-02-07T12:25:57.877 INFO:tasks.workunit.client.0.smithi047.stdout:9/340: dwrite d3/d10/f4b [0,4194304] 0 2024-02-07T12:25:57.877 INFO:tasks.workunit.client.0.smithi047.stdout:9/341: write d3/f51 [497636,103632] 0 2024-02-07T12:25:57.877 INFO:tasks.workunit.client.0.smithi047.stdout:9/342: read - d3/d10/d4c/f5b zero size 2024-02-07T12:25:57.885 INFO:tasks.workunit.client.0.smithi047.stdout:4/629: write d3/f54 [6379831,34850] 0 2024-02-07T12:25:57.885 INFO:tasks.workunit.client.0.smithi047.stdout:0/341: dwrite d19/d1c/d24/f56 [0,4194304] 0 2024-02-07T12:25:57.885 INFO:tasks.workunit.client.0.smithi047.stdout:0/342: write d19/d1c/d2c/d49/f68 [440846,2998] 0 2024-02-07T12:25:57.892 INFO:tasks.workunit.client.0.smithi047.stdout:9/343: dwrite d3/d10/d11/f43 [0,4194304] 0 2024-02-07T12:25:57.894 INFO:tasks.workunit.client.0.smithi047.stdout:4/630: dread d3/d27/f28 [0,4194304] 0 2024-02-07T12:25:57.894 INFO:tasks.workunit.client.0.smithi047.stdout:4/631: read d3/d27/d5e/fab [554286,119171] 0 2024-02-07T12:25:57.894 INFO:tasks.workunit.client.0.smithi047.stdout:4/632: creat d3/d61/d70/d83/fd7 x:0 0 0 2024-02-07T12:25:57.894 INFO:tasks.workunit.client.0.smithi047.stdout:9/344: mkdir d3/d10/d18/d3b/d3c/d5d/d70/d7a 0 2024-02-07T12:25:57.895 INFO:tasks.workunit.client.0.smithi047.stdout:0/343: dread d19/d1c/f30 [0,4194304] 0 2024-02-07T12:25:57.895 INFO:tasks.workunit.client.0.smithi047.stdout:0/344: fsync d19/f34 0 2024-02-07T12:25:57.896 INFO:tasks.workunit.client.0.smithi047.stdout:4/633: fsync d3/f4 0 2024-02-07T12:25:57.896 INFO:tasks.workunit.client.0.smithi047.stdout:4/634: stat d3/d61/d70/d8b/fa4 0 2024-02-07T12:25:57.897 INFO:tasks.workunit.client.0.smithi047.stdout:9/345: symlink d3/d10/d18/l7b 0 2024-02-07T12:25:57.898 INFO:tasks.workunit.client.0.smithi047.stdout:0/345: getdents d19/d1c/d3c/d60 0 2024-02-07T12:25:57.899 INFO:tasks.workunit.client.0.smithi047.stdout:4/635: mkdir d3/d27/dd8 0 2024-02-07T12:25:57.899 INFO:tasks.workunit.client.0.smithi047.stdout:4/636: chown d3/d61/d70/d83/l95 3455 1 2024-02-07T12:25:57.901 INFO:tasks.workunit.client.0.smithi047.stdout:9/346: link d3/d10/f24 d3/d10/d18/d3b/d3c/d5d/f7c 0 2024-02-07T12:25:57.901 INFO:tasks.workunit.client.0.smithi047.stdout:9/347: write d3/d10/d18/f59 [4900340,20181] 0 2024-02-07T12:25:57.903 INFO:tasks.workunit.client.0.smithi047.stdout:0/346: rename d19/c22 to d19/d1c/d24/c69 0 2024-02-07T12:25:57.904 INFO:tasks.workunit.client.0.smithi047.stdout:4/637: creat d3/d27/dbc/fd9 x:0 0 0 2024-02-07T12:25:57.904 INFO:tasks.workunit.client.0.smithi047.stdout:4/638: truncate d3/d61/d70/f99 143012 0 2024-02-07T12:25:57.906 INFO:tasks.workunit.client.0.smithi047.stdout:9/348: rename d3/d10/d18/d3a/c58 to d3/d10/d18/d3b/d3c/d5d/d68/c7d 0 2024-02-07T12:25:57.906 INFO:tasks.workunit.client.0.smithi047.stdout:9/349: chown d3/d10/d18/d3b/d3c/d5d/c72 112934586 1 2024-02-07T12:25:57.907 INFO:tasks.workunit.client.0.smithi047.stdout:4/639: mkdir d3/d61/d43/d45/d63/dda 0 2024-02-07T12:25:57.910 INFO:tasks.workunit.client.0.smithi047.stdout:0/347: rename d19/d40/d66/c62 to d19/d40/c6a 0 2024-02-07T12:25:57.912 INFO:tasks.workunit.client.0.smithi047.stdout:9/350: rename d3/d10/d18/l62 to d3/d10/d18/d3b/d52/l7e 0 2024-02-07T12:25:57.913 INFO:tasks.workunit.client.0.smithi047.stdout:0/348: creat d19/d1c/d2b/d5f/f6b x:0 0 0 2024-02-07T12:25:57.914 INFO:tasks.workunit.client.0.smithi047.stdout:9/351: symlink d3/d10/d18/d3b/l7f 0 2024-02-07T12:25:57.915 INFO:tasks.workunit.client.0.smithi047.stdout:4/640: dread d3/d27/dc5/d73/f7c [0,4194304] 0 2024-02-07T12:25:57.916 INFO:tasks.workunit.client.0.smithi047.stdout:0/349: rename f14 to d19/d1c/d2b/d5f/f6c 0 2024-02-07T12:25:57.916 INFO:tasks.workunit.client.0.smithi047.stdout:0/350: truncate d19/d40/d66/f63 664723 0 2024-02-07T12:25:57.916 INFO:tasks.workunit.client.0.smithi047.stdout:9/352: truncate d3/d10/d18/d3d/f65 7895999 0 2024-02-07T12:25:57.931 INFO:tasks.workunit.client.0.smithi047.stdout:9/353: dwrite d3/d10/d18/d3b/d3c/d47/f77 [0,4194304] 0 2024-02-07T12:25:57.946 INFO:tasks.workunit.client.0.smithi047.stdout:4/641: rename d3/d61/d43/d45 to d3/d61/d70/d8b/ddb 0 2024-02-07T12:25:57.974 INFO:tasks.workunit.client.0.smithi047.stdout:9/354: creat d3/d10/d18/d3b/d3c/d5d/d70/f80 x:0 0 0 2024-02-07T12:25:57.995 INFO:tasks.workunit.client.0.smithi047.stdout:4/642: link d3/f14 d3/d27/dc5/d73/fdc 0 2024-02-07T12:25:57.995 INFO:tasks.workunit.client.0.smithi047.stdout:4/643: readlink d3/d61/d70/d8b/ddb/d66/l5a 0 2024-02-07T12:25:57.996 INFO:tasks.workunit.client.0.smithi047.stdout:9/355: symlink d3/d10/d4c/l81 0 2024-02-07T12:25:57.996 INFO:tasks.workunit.client.0.smithi047.stdout:9/356: dread - d3/d10/d18/d3b/d3c/f4e zero size 2024-02-07T12:25:57.997 INFO:tasks.workunit.client.0.smithi047.stdout:4/644: rmdir d3/d27/dc5/d73 39 2024-02-07T12:25:58.008 INFO:tasks.workunit.client.0.smithi047.stdout:9/357: write f1 [2847026,34989] 0 2024-02-07T12:25:58.008 INFO:tasks.workunit.client.0.smithi047.stdout:9/358: write d3/d10/d4c/f5b [559129,97534] 0 2024-02-07T12:25:58.009 INFO:tasks.workunit.client.0.smithi047.stdout:9/359: write d3/d10/d18/f27 [501640,128773] 0 2024-02-07T12:25:58.048 INFO:tasks.workunit.client.0.smithi047.stdout:4/645: creat d3/db1/d37/da9/fdd x:0 0 0 2024-02-07T12:25:58.052 INFO:tasks.workunit.client.0.smithi047.stdout:9/360: mkdir d3/d10/d18/d3b/d52/d82 0 2024-02-07T12:25:58.052 INFO:tasks.workunit.client.0.smithi047.stdout:9/361: stat d3/d10/d18/d3b/d3c/d5d/d70/d7a 0 2024-02-07T12:25:58.053 INFO:tasks.workunit.client.0.smithi047.stdout:4/646: link d3/d27/c2d d3/db1/d37/da9/dcb/cde 0 2024-02-07T12:25:58.053 INFO:tasks.workunit.client.0.smithi047.stdout:4/647: readlink d3/d27/l6b 0 2024-02-07T12:25:58.055 INFO:tasks.workunit.client.0.smithi047.stdout:9/362: creat d3/d10/d18/d3d/f83 x:0 0 0 2024-02-07T12:25:58.056 INFO:tasks.workunit.client.0.smithi047.stdout:9/363: stat d3/f19 0 2024-02-07T12:25:58.056 INFO:tasks.workunit.client.0.smithi047.stdout:9/364: creat d3/d10/d18/d3b/d52/f84 x:0 0 0 2024-02-07T12:25:58.056 INFO:tasks.workunit.client.0.smithi047.stdout:9/365: write d3/d10/d4c/f5b [1135104,19102] 0 2024-02-07T12:25:58.057 INFO:tasks.workunit.client.0.smithi047.stdout:4/648: creat d3/d61/d70/d8b/ddb/d63/db3/dd4/fdf x:0 0 0 2024-02-07T12:25:58.061 INFO:tasks.workunit.client.0.smithi047.stdout:4/649: link d3/d61/d70/d8b/ddb/d66/f6f d3/d61/d70/d8b/ddb/d66/fe0 0 2024-02-07T12:25:58.061 INFO:tasks.workunit.client.0.smithi047.stdout:4/650: chown d3/d27/l6b 9741088 1 2024-02-07T12:25:58.079 INFO:tasks.workunit.client.0.smithi047.stdout:0/351: rename d19/d1c/d2b/d5f/f6c to d19/f6d 0 2024-02-07T12:25:58.079 INFO:tasks.workunit.client.0.smithi047.stdout:4/651: dwrite d3/d61/d70/d8b/ddb/d66/f7e [0,4194304] 0 2024-02-07T12:25:58.080 INFO:tasks.workunit.client.0.smithi047.stdout:0/352: symlink d19/d25/l6e 0 2024-02-07T12:25:58.099 INFO:tasks.workunit.client.0.smithi047.stdout:9/366: creat d3/f85 x:0 0 0 2024-02-07T12:25:58.099 INFO:tasks.workunit.client.0.smithi047.stdout:9/367: truncate d3/d10/d18/d3b/d3c/f4e 339494 0 2024-02-07T12:25:58.099 INFO:tasks.workunit.client.0.smithi047.stdout:9/368: creat d3/d10/d18/d3b/d52/f86 x:0 0 0 2024-02-07T12:25:58.099 INFO:tasks.workunit.client.0.smithi047.stdout:9/369: creat d3/d10/d18/d3b/d3c/d5d/d70/f87 x:0 0 0 2024-02-07T12:25:58.099 INFO:tasks.workunit.client.0.smithi047.stdout:9/370: fsync d3/d10/d18/d3b/d3c/f4e 0 2024-02-07T12:25:58.102 INFO:tasks.workunit.client.0.smithi047.stdout:9/371: symlink d3/d10/d18/d3b/d52/d82/l88 0 2024-02-07T12:25:58.102 INFO:tasks.workunit.client.0.smithi047.stdout:9/372: creat d3/d10/d18/d3d/f89 x:0 0 0 2024-02-07T12:25:58.104 INFO:tasks.workunit.client.0.smithi047.stdout:9/373: mkdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8a 0 2024-02-07T12:25:58.104 INFO:tasks.workunit.client.0.smithi047.stdout:9/374: readlink d3/l5 0 2024-02-07T12:25:58.129 INFO:tasks.workunit.client.0.smithi047.stdout:9/375: dwrite d3/d10/d18/d3b/d3c/d5d/d70/f87 [0,4194304] 0 2024-02-07T12:25:58.129 INFO:tasks.workunit.client.0.smithi047.stdout:9/376: write d3/d10/d18/d3b/d3c/d5d/f7c [2334347,10066] 0 2024-02-07T12:25:58.129 INFO:tasks.workunit.client.0.smithi047.stdout:9/377: rename d3/d10 to d3/d10/d18/d3b/d3c/d5d/d8b 22 2024-02-07T12:25:58.131 INFO:tasks.workunit.client.0.smithi047.stdout:4/652: dwrite d3/d61/d70/d8b/ddb/d63/f68 [0,4194304] 0 2024-02-07T12:25:58.132 INFO:tasks.workunit.client.0.smithi047.stdout:9/378: mkdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c 0 2024-02-07T12:25:58.134 INFO:tasks.workunit.client.0.smithi047.stdout:4/653: creat d3/d27/d3b/fe1 x:0 0 0 2024-02-07T12:25:58.136 INFO:tasks.workunit.client.0.smithi047.stdout:9/379: link d3/d10/d11/f42 d3/d10/d4c/f8d 0 2024-02-07T12:25:58.142 INFO:tasks.workunit.client.0.smithi047.stdout:4/654: dread d3/d27/f28 [0,4194304] 0 2024-02-07T12:25:58.143 INFO:tasks.workunit.client.0.smithi047.stdout:4/655: mkdir d3/d27/dc5/de2 0 2024-02-07T12:25:58.145 INFO:tasks.workunit.client.0.smithi047.stdout:4/656: link d3/d61/fa1 d3/d27/dc5/d73/fe3 0 2024-02-07T12:25:58.146 INFO:tasks.workunit.client.0.smithi047.stdout:4/657: mknod d3/d61/d70/d8b/ddb/d63/ce4 0 2024-02-07T12:25:58.149 INFO:tasks.workunit.client.0.smithi047.stdout:4/658: rmdir d3/d61/d70 39 2024-02-07T12:25:58.157 INFO:tasks.workunit.client.0.smithi047.stdout:9/380: dwrite d3/d10/d18/d3b/d52/f86 [0,4194304] 0 2024-02-07T12:25:58.157 INFO:tasks.workunit.client.0.smithi047.stdout:9/381: creat d3/d10/d4c/f8e x:0 0 0 2024-02-07T12:25:58.175 INFO:tasks.workunit.client.0.smithi047.stdout:9/382: dwrite d3/f40 [0,4194304] 0 2024-02-07T12:25:58.175 INFO:tasks.workunit.client.0.smithi047.stdout:9/383: chown d3/d10/d18/d3b/d3c 1072636959 1 2024-02-07T12:25:58.198 INFO:tasks.workunit.client.0.smithi047.stdout:9/384: dwrite d3/d10/d18/d3a/f44 [0,4194304] 0 2024-02-07T12:25:58.199 INFO:tasks.workunit.client.0.smithi047.stdout:9/385: write d3/d10/d18/d3b/d3c/d5d/f78 [496652,16499] 0 2024-02-07T12:25:58.200 INFO:tasks.workunit.client.0.smithi047.stdout:9/386: getdents d3/d10/d18/d3b/d3c/d5d/d70/d7a 0 2024-02-07T12:25:58.202 INFO:tasks.workunit.client.0.smithi047.stdout:9/387: rename d3/d10/l38 to d3/d10/d18/d3a/l8f 0 2024-02-07T12:25:58.274 INFO:tasks.workunit.client.0.smithi047.stdout:9/388: rename d3/d10/d18/d3b/d52 to d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90 0 2024-02-07T12:25:58.275 INFO:tasks.workunit.client.0.smithi047.stdout:9/389: truncate d3/d10/d18/f27 122334 0 2024-02-07T12:25:58.276 INFO:tasks.workunit.client.0.smithi047.stdout:9/390: mkdir d3/d10/d18/d3d/d91 0 2024-02-07T12:25:58.277 INFO:tasks.workunit.client.0.smithi047.stdout:9/391: write d3/d10/f24 [3213050,40576] 0 2024-02-07T12:25:58.277 INFO:tasks.workunit.client.0.smithi047.stdout:9/392: rename d3 to d3/d10/d18/d6e/d92 22 2024-02-07T12:25:58.278 INFO:tasks.workunit.client.0.smithi047.stdout:9/393: symlink d3/d10/d18/d3d/l93 0 2024-02-07T12:25:58.294 INFO:tasks.workunit.client.0.smithi047.stdout:9/394: dwrite d3/d10/d18/d3b/f69 [0,4194304] 0 2024-02-07T12:25:58.294 INFO:tasks.workunit.client.0.smithi047.stdout:9/395: read d3/d10/d18/d3d/f46 [1913718,24227] 0 2024-02-07T12:25:58.294 INFO:tasks.workunit.client.0.smithi047.stdout:9/396: readlink d3/d10/d4c/l81 0 2024-02-07T12:25:58.298 INFO:tasks.workunit.client.0.smithi047.stdout:9/397: rmdir d3/d10/d18/d3d/d91 0 2024-02-07T12:25:58.298 INFO:tasks.workunit.client.0.smithi047.stdout:9/398: creat d3/d10/d18/d3a/f94 x:0 0 0 2024-02-07T12:25:58.298 INFO:tasks.workunit.client.0.smithi047.stdout:9/399: dread - d3/d10/d18/d3b/f50 zero size 2024-02-07T12:25:58.315 INFO:tasks.workunit.client.0.smithi047.stdout:9/400: dwrite d3/d10/d18/d3b/f69 [0,4194304] 0 2024-02-07T12:25:58.316 INFO:tasks.workunit.client.0.smithi047.stdout:9/401: mknod d3/c95 0 2024-02-07T12:25:58.316 INFO:tasks.workunit.client.0.smithi047.stdout:9/402: truncate d3/d10/d4c/f66 853799 0 2024-02-07T12:25:58.322 INFO:tasks.workunit.client.0.smithi047.stdout:9/403: dread d3/f9 [0,4194304] 0 2024-02-07T12:25:58.324 INFO:tasks.workunit.client.0.smithi047.stdout:9/404: dread d3/d10/d18/d3a/f4a [0,4194304] 0 2024-02-07T12:25:58.324 INFO:tasks.workunit.client.0.smithi047.stdout:9/405: chown l0 1854251 1 2024-02-07T12:25:58.325 INFO:tasks.workunit.client.0.smithi047.stdout:9/406: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/f96 x:0 0 0 2024-02-07T12:25:58.326 INFO:tasks.workunit.client.0.smithi047.stdout:9/407: mknod d3/d10/d18/d3b/d3c/d47/c97 0 2024-02-07T12:25:58.326 INFO:tasks.workunit.client.0.smithi047.stdout:9/408: mknod d3/d10/d18/d3b/d3c/d5d/d70/d7a/c98 0 2024-02-07T12:25:58.344 INFO:tasks.workunit.client.0.smithi047.stdout:9/409: dwrite d3/d10/d18/f27 [0,4194304] 0 2024-02-07T12:25:58.348 INFO:tasks.workunit.client.0.smithi047.stdout:9/410: mknod d3/d10/d18/d3b/d3c/c99 0 2024-02-07T12:25:58.348 INFO:tasks.workunit.client.0.smithi047.stdout:9/411: write d3/d10/d18/d3b/d3c/d5d/f7c [646250,112198] 0 2024-02-07T12:25:58.359 INFO:tasks.workunit.client.0.smithi047.stdout:9/412: dwrite d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/f96 [0,4194304] 0 2024-02-07T12:25:58.359 INFO:tasks.workunit.client.0.smithi047.stdout:9/413: dread - d3/d10/d18/d3d/f83 zero size 2024-02-07T12:25:58.359 INFO:tasks.workunit.client.0.smithi047.stdout:9/414: chown d3/d10/d18/d3b/d3c/d5d/d70/f80 130471539 1 2024-02-07T12:25:58.375 INFO:tasks.workunit.client.0.smithi047.stdout:9/415: dwrite d3/d10/d18/d3b/d3c/d5d/f78 [0,4194304] 0 2024-02-07T12:25:58.375 INFO:tasks.workunit.client.0.smithi047.stdout:9/416: chown d3/d10/d18/d6e 8690 1 2024-02-07T12:25:58.376 INFO:tasks.workunit.client.0.smithi047.stdout:9/417: dread d3/d10/f31 [0,4194304] 0 2024-02-07T12:25:58.377 INFO:tasks.workunit.client.0.smithi047.stdout:9/418: mkdir d3/d10/d18/d6e/d9a 0 2024-02-07T12:25:58.379 INFO:tasks.workunit.client.0.smithi047.stdout:9/419: rename d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8a to d3/d10/d18/d3b/d3c/d5d/d9b 0 2024-02-07T12:25:58.379 INFO:tasks.workunit.client.0.smithi047.stdout:9/420: write d3/d10/d4c/f8e [805038,1364] 0 2024-02-07T12:25:58.380 INFO:tasks.workunit.client.0.smithi047.stdout:9/421: symlink d3/d10/d18/d3d/l9c 0 2024-02-07T12:25:58.380 INFO:tasks.workunit.client.0.smithi047.stdout:9/422: mknod d3/d10/d11/c9d 0 2024-02-07T12:25:58.381 INFO:tasks.workunit.client.0.smithi047.stdout:9/423: mknod d3/c9e 0 2024-02-07T12:25:58.383 INFO:tasks.workunit.client.0.smithi047.stdout:9/424: dread d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/f6f [0,4194304] 0 2024-02-07T12:25:58.383 INFO:tasks.workunit.client.0.smithi047.stdout:9/425: truncate d3/d10/d18/d3b/f57 247025 0 2024-02-07T12:25:58.385 INFO:tasks.workunit.client.0.smithi047.stdout:9/426: rename d3/d10/d18/d3b/d3c/f55 to d3/d10/d18/d6e/f9f 0 2024-02-07T12:25:58.386 INFO:tasks.workunit.client.0.smithi047.stdout:9/427: write d3/f51 [152537,119860] 0 2024-02-07T12:25:58.386 INFO:tasks.workunit.client.0.smithi047.stdout:9/428: creat d3/fa0 x:0 0 0 2024-02-07T12:25:58.398 INFO:tasks.workunit.client.0.smithi047.stdout:9/429: dwrite d3/d10/d18/d3d/f37 [0,4194304] 0 2024-02-07T12:25:58.759 INFO:tasks.workunit.client.0.smithi047.stdout:2/600: sync 2024-02-07T12:25:58.759 INFO:tasks.workunit.client.0.smithi047.stdout:2/601: symlink d7/dc/d51/lbd 0 2024-02-07T12:25:58.761 INFO:tasks.workunit.client.0.smithi047.stdout:2/602: creat d7/dc/d4c/fbe x:0 0 0 2024-02-07T12:25:58.767 INFO:tasks.workunit.client.0.smithi047.stdout:2/603: dread d7/f2e [4194304,4194304] 0 2024-02-07T12:25:58.769 INFO:tasks.workunit.client.0.smithi047.stdout:2/604: dread d7/dc/f75 [0,4194304] 0 2024-02-07T12:25:58.769 INFO:tasks.workunit.client.0.smithi047.stdout:2/605: dread - d7/d2d/d7c/fbc zero size 2024-02-07T12:25:58.769 INFO:tasks.workunit.client.0.smithi047.stdout:2/606: write d7/dc/d71/f90 [486403,114044] 0 2024-02-07T12:25:58.771 INFO:tasks.workunit.client.0.smithi047.stdout:2/607: mkdir d7/d48/d72/dbf 0 2024-02-07T12:25:58.772 INFO:tasks.workunit.client.0.smithi047.stdout:2/608: rename d7/d2d/d5c/d77/f8e to d7/d2d/fc0 0 2024-02-07T12:25:58.776 INFO:tasks.workunit.client.0.smithi047.stdout:2/609: dread d7/dc/d71/f90 [0,4194304] 0 2024-02-07T12:25:58.795 INFO:tasks.workunit.client.0.smithi047.stdout:2/610: dwrite d7/f39 [0,4194304] 0 2024-02-07T12:25:58.796 INFO:tasks.workunit.client.0.smithi047.stdout:2/611: read d7/d2d/f43 [382884,83733] 0 2024-02-07T12:25:58.812 INFO:tasks.workunit.client.0.smithi047.stdout:2/612: dwrite d7/d2d/d7c/f7f [0,4194304] 0 2024-02-07T12:25:58.825 INFO:tasks.workunit.client.0.smithi047.stdout:2/613: dread d7/dc/f1a [0,4194304] 0 2024-02-07T12:25:58.825 INFO:tasks.workunit.client.0.smithi047.stdout:2/614: truncate d7/dc/d4c/fbe 182077 0 2024-02-07T12:25:58.833 INFO:tasks.workunit.client.0.smithi047.stdout:2/615: dread d7/dc/f84 [0,4194304] 0 2024-02-07T12:25:58.834 INFO:tasks.workunit.client.0.smithi047.stdout:2/616: write d7/dc/d4c/f7b [617512,130807] 0 2024-02-07T12:25:58.836 INFO:tasks.workunit.client.0.smithi047.stdout:2/617: unlink d7/d2d/d5c/d77/d92/fb6 0 2024-02-07T12:25:58.842 INFO:tasks.workunit.client.0.smithi047.stdout:2/618: dread d7/d2d/d5c/f6a [0,4194304] 0 2024-02-07T12:25:58.843 INFO:tasks.workunit.client.0.smithi047.stdout:2/619: symlink d7/d2d/d5c/lc1 0 2024-02-07T12:25:58.843 INFO:tasks.workunit.client.0.smithi047.stdout:2/620: fdatasync d7/dc/f2b 0 2024-02-07T12:25:58.843 INFO:tasks.workunit.client.0.smithi047.stdout:2/621: readlink d7/l5a 0 2024-02-07T12:25:58.844 INFO:tasks.workunit.client.0.smithi047.stdout:2/622: symlink d7/dc/d51/lc2 0 2024-02-07T12:25:58.860 INFO:tasks.workunit.client.0.smithi047.stdout:2/623: dwrite d7/d2d/f4a [0,4194304] 0 2024-02-07T12:25:58.860 INFO:tasks.workunit.client.0.smithi047.stdout:2/624: write d7/dc/fa4 [499516,24670] 0 2024-02-07T12:25:58.860 INFO:tasks.workunit.client.0.smithi047.stdout:2/625: creat d7/d48/fc3 x:0 0 0 2024-02-07T12:25:58.861 INFO:tasks.workunit.client.0.smithi047.stdout:2/626: mkdir d7/d2d/d5c/d77/d9b/dc4 0 2024-02-07T12:25:58.862 INFO:tasks.workunit.client.0.smithi047.stdout:2/627: rmdir d7 39 2024-02-07T12:25:58.862 INFO:tasks.workunit.client.0.smithi047.stdout:2/628: write d7/d2d/d5c/f70 [420417,36249] 0 2024-02-07T12:25:58.864 INFO:tasks.workunit.client.0.smithi047.stdout:2/629: creat d7/dc/d8a/fc5 x:0 0 0 2024-02-07T12:25:58.865 INFO:tasks.workunit.client.0.smithi047.stdout:2/630: mkdir d7/dc/d8a/dc6 0 2024-02-07T12:25:58.866 INFO:tasks.workunit.client.0.smithi047.stdout:2/631: write d7/f88 [68845,76542] 0 2024-02-07T12:25:58.867 INFO:tasks.workunit.client.0.smithi047.stdout:2/632: symlink d7/d2d/lc7 0 2024-02-07T12:25:58.869 INFO:tasks.workunit.client.0.smithi047.stdout:2/633: creat d7/d2d/d5c/d77/d9b/fc8 x:0 0 0 2024-02-07T12:25:58.871 INFO:tasks.workunit.client.0.smithi047.stdout:2/634: rename d7/dc/d51/f9c to d7/d48/fc9 0 2024-02-07T12:25:58.871 INFO:tasks.workunit.client.0.smithi047.stdout:2/635: chown d7/dc/d4c/f94 365513 1 2024-02-07T12:25:58.872 INFO:tasks.workunit.client.0.smithi047.stdout:2/636: read d7/dc/f75 [696657,4912] 0 2024-02-07T12:25:58.884 INFO:tasks.workunit.client.0.smithi047.stdout:2/637: dwrite d7/dc/f44 [0,4194304] 0 2024-02-07T12:25:58.884 INFO:tasks.workunit.client.0.smithi047.stdout:2/638: chown d7/dc/c27 0 1 2024-02-07T12:25:58.906 INFO:tasks.workunit.client.0.smithi047.stdout:2/639: dwrite d7/f13 [0,4194304] 0 2024-02-07T12:25:58.908 INFO:tasks.workunit.client.0.smithi047.stdout:2/640: rename d7/dc/d4c/f5e to d7/d48/d72/dbf/fca 0 2024-02-07T12:25:58.924 INFO:tasks.workunit.client.0.smithi047.stdout:8/624: sync 2024-02-07T12:25:58.924 INFO:tasks.workunit.client.0.smithi047.stdout:3/583: sync 2024-02-07T12:25:58.924 INFO:tasks.workunit.client.0.smithi047.stdout:8/625: stat d3/d36/d50/d30/d34/l8b 0 2024-02-07T12:25:58.925 INFO:tasks.workunit.client.0.smithi047.stdout:3/584: mknod d12/dc7/d29/d31/d38/d59/d87/dc5/ccb 0 2024-02-07T12:25:58.925 INFO:tasks.workunit.client.0.smithi047.stdout:3/585: fdatasync d12/dc7/d29/d31/d38/d59/f5f 0 2024-02-07T12:25:58.928 INFO:tasks.workunit.client.0.smithi047.stdout:8/626: rename d3/d66/d67/fa4 to d3/d36/d50/d30/d9e/da6/fce 0 2024-02-07T12:25:58.931 INFO:tasks.workunit.client.0.smithi047.stdout:3/586: link d12/d19/d2d/d33/f3a d12/d19/d2d/d82/fcc 0 2024-02-07T12:25:58.931 INFO:tasks.workunit.client.0.smithi047.stdout:3/587: stat d12/d19/d2d/d33/d8d/lb1 0 2024-02-07T12:25:58.932 INFO:tasks.workunit.client.0.smithi047.stdout:8/627: creat d3/d36/d50/d2a/fcf x:0 0 0 2024-02-07T12:25:58.933 INFO:tasks.workunit.client.0.smithi047.stdout:3/588: creat d12/fcd x:0 0 0 2024-02-07T12:25:58.935 INFO:tasks.workunit.client.0.smithi047.stdout:3/589: dread d12/d19/d37/f74 [0,4194304] 0 2024-02-07T12:25:58.937 INFO:tasks.workunit.client.0.smithi047.stdout:3/590: creat d12/d19/d46/d95/fce x:0 0 0 2024-02-07T12:25:58.938 INFO:tasks.workunit.client.0.smithi047.stdout:3/591: truncate d12/d19/d2d/d82/f85 3724993 0 2024-02-07T12:25:58.938 INFO:tasks.workunit.client.0.smithi047.stdout:3/592: truncate d12/dc7/d29/da9/fc2 287283 0 2024-02-07T12:25:58.938 INFO:tasks.workunit.client.0.smithi047.stdout:3/593: fdatasync d12/d19/f28 0 2024-02-07T12:25:58.939 INFO:tasks.workunit.client.0.smithi047.stdout:3/594: mknod d12/dc7/d29/ccf 0 2024-02-07T12:25:58.939 INFO:tasks.workunit.client.0.smithi047.stdout:3/595: truncate d12/dc7/d29/da9/fc2 436802 0 2024-02-07T12:25:58.944 INFO:tasks.workunit.client.0.smithi047.stdout:3/596: unlink d12/d19/c6c 0 2024-02-07T12:25:58.945 INFO:tasks.workunit.client.0.smithi047.stdout:3/597: chown f11 1099661122 1 2024-02-07T12:25:58.945 INFO:tasks.workunit.client.0.smithi047.stdout:3/598: creat d12/dc7/d29/d44/fd0 x:0 0 0 2024-02-07T12:25:58.945 INFO:tasks.workunit.client.0.smithi047.stdout:3/599: fdatasync d12/d19/f28 0 2024-02-07T12:25:58.946 INFO:tasks.workunit.client.0.smithi047.stdout:3/600: mknod d12/dc7/cd1 0 2024-02-07T12:25:58.947 INFO:tasks.workunit.client.0.smithi047.stdout:3/601: fsync d12/dc7/d29/d44/fa1 0 2024-02-07T12:25:58.947 INFO:tasks.workunit.client.0.smithi047.stdout:3/602: stat fc 0 2024-02-07T12:25:58.947 INFO:tasks.workunit.client.0.smithi047.stdout:3/603: dread d12/f18 [0,4194304] 0 2024-02-07T12:25:58.947 INFO:tasks.workunit.client.0.smithi047.stdout:3/604: symlink d12/d19/d2d/d33/da5/ld2 0 2024-02-07T12:25:58.947 INFO:tasks.workunit.client.0.smithi047.stdout:3/605: write d12/d19/d2d/d42/f55 [2498699,84958] 0 2024-02-07T12:25:58.958 INFO:tasks.workunit.client.0.smithi047.stdout:3/606: dread f11 [0,4194304] 0 2024-02-07T12:25:58.958 INFO:tasks.workunit.client.0.smithi047.stdout:3/607: dread d12/dc7/d29/da9/fc2 [0,4194304] 0 2024-02-07T12:25:58.965 INFO:tasks.workunit.client.0.smithi047.stdout:3/608: write d12/dc7/d29/d31/d61/f86 [2779941,96717] 0 2024-02-07T12:25:58.967 INFO:tasks.workunit.client.0.smithi047.stdout:3/609: write d12/d19/d46/f9c [797004,54981] 0 2024-02-07T12:25:58.967 INFO:tasks.workunit.client.0.smithi047.stdout:3/610: readlink d12/dc7/d90/lb8 0 2024-02-07T12:25:58.984 INFO:tasks.workunit.client.0.smithi047.stdout:3/611: dwrite d12/dc7/d29/d31/d7c/fab [0,4194304] 0 2024-02-07T12:25:58.986 INFO:tasks.workunit.client.0.smithi047.stdout:3/612: creat d12/d19/d2d/d33/da5/fd3 x:0 0 0 2024-02-07T12:25:58.988 INFO:tasks.workunit.client.0.smithi047.stdout:3/613: mknod d12/dc7/d29/d6f/cd4 0 2024-02-07T12:25:58.989 INFO:tasks.workunit.client.0.smithi047.stdout:3/614: mkdir d12/d19/d37/dd5 0 2024-02-07T12:25:58.991 INFO:tasks.workunit.client.0.smithi047.stdout:3/615: rename d12/d19/d2d/d52/l57 to d12/dc7/d29/d31/d38/d59/ld6 0 2024-02-07T12:25:58.991 INFO:tasks.workunit.client.0.smithi047.stdout:3/616: truncate d12/d19/d2d/d33/d8d/fb5 772552 0 2024-02-07T12:25:58.992 INFO:tasks.workunit.client.0.smithi047.stdout:3/617: chown d12/dc7/d29/d31/d7c/fb3 151152529 1 2024-02-07T12:25:58.993 INFO:tasks.workunit.client.0.smithi047.stdout:3/618: creat d12/dc7/d29/d31/d7c/fd7 x:0 0 0 2024-02-07T12:25:58.994 INFO:tasks.workunit.client.0.smithi047.stdout:3/619: mknod d12/dc7/d29/d6f/d93/cd8 0 2024-02-07T12:25:58.994 INFO:tasks.workunit.client.0.smithi047.stdout:3/620: chown d12/d19/d46/fae 1068370451 1 2024-02-07T12:25:58.994 INFO:tasks.workunit.client.0.smithi047.stdout:3/621: stat d12/dc7/d29 0 2024-02-07T12:25:58.995 INFO:tasks.workunit.client.0.smithi047.stdout:3/622: creat d12/d19/d2d/d42/d6b/fd9 x:0 0 0 2024-02-07T12:25:59.022 INFO:tasks.workunit.client.0.smithi047.stdout:3/623: dwrite d12/dc7/f2c [0,4194304] 0 2024-02-07T12:25:59.022 INFO:tasks.workunit.client.0.smithi047.stdout:3/624: chown d12/dc7/d29/d6f/d93 0 1 2024-02-07T12:25:59.022 INFO:tasks.workunit.client.0.smithi047.stdout:3/625: fdatasync d12/dc7/d29/d31/d7c/fb3 0 2024-02-07T12:25:59.033 INFO:tasks.workunit.client.0.smithi047.stdout:3/626: dread d12/dc7/d29/d31/d7c/fab [0,4194304] 0 2024-02-07T12:25:59.038 INFO:tasks.workunit.client.0.smithi047.stdout:6/507: sync 2024-02-07T12:25:59.038 INFO:tasks.workunit.client.0.smithi047.stdout:7/615: sync 2024-02-07T12:25:59.038 INFO:tasks.workunit.client.0.smithi047.stdout:6/508: dread - d3/d5/d35/d3c/d72/d8c/f93 zero size 2024-02-07T12:25:59.038 INFO:tasks.workunit.client.0.smithi047.stdout:6/509: chown d3/d5/d35/d3c/d72/d8c 13610 1 2024-02-07T12:25:59.039 INFO:tasks.workunit.client.0.smithi047.stdout:7/616: write d0/d42/d4d/f69 [1013148,67866] 0 2024-02-07T12:25:59.039 INFO:tasks.workunit.client.0.smithi047.stdout:7/617: readlink d0/df/d29/d3e/d4c/d97/laa 0 2024-02-07T12:25:59.039 INFO:tasks.workunit.client.0.smithi047.stdout:7/618: chown d0/d42/fb5 18 1 2024-02-07T12:25:59.039 INFO:tasks.workunit.client.0.smithi047.stdout:7/619: write d0/d2f/fc4 [1414088,102570] 0 2024-02-07T12:25:59.042 INFO:tasks.workunit.client.0.smithi047.stdout:3/627: write d12/d19/f8f [2587202,12407] 0 2024-02-07T12:25:59.065 INFO:tasks.workunit.client.0.smithi047.stdout:7/620: dwrite d0/d42/d4d/d67/f73 [4194304,4194304] 0 2024-02-07T12:25:59.065 INFO:tasks.workunit.client.0.smithi047.stdout:6/510: dwrite d3/da/d3b/f7e [0,4194304] 0 2024-02-07T12:25:59.065 INFO:tasks.workunit.client.0.smithi047.stdout:6/511: dread - d3/da/d3b/d87/f8d zero size 2024-02-07T12:25:59.066 INFO:tasks.workunit.client.0.smithi047.stdout:7/621: symlink d0/d2f/lc6 0 2024-02-07T12:25:59.070 INFO:tasks.workunit.client.0.smithi047.stdout:6/512: creat d3/d5/fb0 x:0 0 0 2024-02-07T12:25:59.074 INFO:tasks.workunit.client.0.smithi047.stdout:6/513: rename d3/da/c20 to d3/d5/d35/d3c/d72/d8c/d91/cb1 0 2024-02-07T12:25:59.074 INFO:tasks.workunit.client.0.smithi047.stdout:7/622: rmdir d0/df/d29/d3e/d4c/d97 39 2024-02-07T12:25:59.077 INFO:tasks.workunit.client.0.smithi047.stdout:7/623: dread d0/d42/fa3 [0,4194304] 0 2024-02-07T12:25:59.078 INFO:tasks.workunit.client.0.smithi047.stdout:6/514: creat d3/da/d14/d9e/fb2 x:0 0 0 2024-02-07T12:25:59.078 INFO:tasks.workunit.client.0.smithi047.stdout:7/624: getdents d0/df/d29/d31 0 2024-02-07T12:25:59.079 INFO:tasks.workunit.client.0.smithi047.stdout:6/515: dread d3/da/f49 [0,4194304] 0 2024-02-07T12:25:59.079 INFO:tasks.workunit.client.0.smithi047.stdout:6/516: dread - d3/d5/d35/d3c/d72/d8c/f93 zero size 2024-02-07T12:25:59.079 INFO:tasks.workunit.client.0.smithi047.stdout:6/517: write d3/da/f49 [1125174,27509] 0 2024-02-07T12:25:59.079 INFO:tasks.workunit.client.0.smithi047.stdout:6/518: dread - d3/da/f83 zero size 2024-02-07T12:25:59.080 INFO:tasks.workunit.client.0.smithi047.stdout:7/625: truncate d0/df/d29/d31/d40/f8c 3467829 0 2024-02-07T12:25:59.083 INFO:tasks.workunit.client.0.smithi047.stdout:6/519: mkdir d3/da/d34/d6d/d8f/db3 0 2024-02-07T12:25:59.083 INFO:tasks.workunit.client.0.smithi047.stdout:6/520: chown d3/da/d3b/d55 9705 1 2024-02-07T12:25:59.083 INFO:tasks.workunit.client.0.smithi047.stdout:6/521: fsync d3/da/d3b/f5e 0 2024-02-07T12:25:59.083 INFO:tasks.workunit.client.0.smithi047.stdout:6/522: write d3/d5/f15 [334078,78731] 0 2024-02-07T12:25:59.083 INFO:tasks.workunit.client.0.smithi047.stdout:6/523: stat d3/da/d14/d28/d46/d94 0 2024-02-07T12:25:59.105 INFO:tasks.workunit.client.0.smithi047.stdout:7/626: dwrite d0/df/d29/d3e/f60 [0,4194304] 0 2024-02-07T12:25:59.105 INFO:tasks.workunit.client.0.smithi047.stdout:7/627: fdatasync d0/df/d29/d3e/f60 0 2024-02-07T12:25:59.106 INFO:tasks.workunit.client.0.smithi047.stdout:6/524: dwrite d3/da/d3b/f85 [0,4194304] 0 2024-02-07T12:25:59.106 INFO:tasks.workunit.client.0.smithi047.stdout:6/525: write d3/da/d2c/d42/f7b [925201,83794] 0 2024-02-07T12:25:59.107 INFO:tasks.workunit.client.0.smithi047.stdout:7/628: symlink d0/da8/lc7 0 2024-02-07T12:25:59.110 INFO:tasks.workunit.client.0.smithi047.stdout:7/629: creat d0/d2f/fc8 x:0 0 0 2024-02-07T12:25:59.110 INFO:tasks.workunit.client.0.smithi047.stdout:7/630: truncate d0/d4/da2/fba 893520 0 2024-02-07T12:25:59.112 INFO:tasks.workunit.client.0.smithi047.stdout:7/631: creat d0/da8/fc9 x:0 0 0 2024-02-07T12:25:59.112 INFO:tasks.workunit.client.0.smithi047.stdout:7/632: chown d0/df/d74/c8d 20 1 2024-02-07T12:25:59.113 INFO:tasks.workunit.client.0.smithi047.stdout:7/633: read d0/d4/da2/fba [332302,27269] 0 2024-02-07T12:25:59.115 INFO:tasks.workunit.client.0.smithi047.stdout:7/634: link d0/df/d29/d3e/f80 d0/da8/fca 0 2024-02-07T12:25:59.115 INFO:tasks.workunit.client.0.smithi047.stdout:7/635: write d0/d42/fa7 [752250,119809] 0 2024-02-07T12:25:59.117 INFO:tasks.workunit.client.0.smithi047.stdout:7/636: link d0/df/d29/d31/d55/cae d0/df/d29/d31/d55/ccb 0 2024-02-07T12:25:59.117 INFO:tasks.workunit.client.0.smithi047.stdout:7/637: write d0/df/d29/d31/d40/f6e [320473,14763] 0 2024-02-07T12:25:59.121 INFO:tasks.workunit.client.0.smithi047.stdout:7/638: dread d0/d42/f57 [0,4194304] 0 2024-02-07T12:25:59.122 INFO:tasks.workunit.client.0.smithi047.stdout:7/639: rename d0/d42/d4d/d67/f73 to d0/d42/fcc 0 2024-02-07T12:25:59.123 INFO:tasks.workunit.client.0.smithi047.stdout:7/640: mkdir d0/df/d74/dcd 0 2024-02-07T12:25:59.141 INFO:tasks.workunit.client.0.smithi047.stdout:7/641: dwrite d0/df/d29/d3e/f56 [4194304,4194304] 0 2024-02-07T12:25:59.142 INFO:tasks.workunit.client.0.smithi047.stdout:7/642: creat d0/df/fce x:0 0 0 2024-02-07T12:25:59.142 INFO:tasks.workunit.client.0.smithi047.stdout:7/643: fsync d0/d6f/fc1 0 2024-02-07T12:25:59.146 INFO:tasks.workunit.client.0.smithi047.stdout:7/644: fdatasync d0/d42/fa7 0 2024-02-07T12:25:59.148 INFO:tasks.workunit.client.0.smithi047.stdout:7/645: unlink d0/d6f/cbf 0 2024-02-07T12:25:59.150 INFO:tasks.workunit.client.0.smithi047.stdout:7/646: symlink d0/d42/d4d/lcf 0 2024-02-07T12:25:59.157 INFO:tasks.workunit.client.0.smithi047.stdout:7/647: rename d0/df/d29/d31/d55 to d0/dd0 0 2024-02-07T12:25:59.160 INFO:tasks.workunit.client.0.smithi047.stdout:7/648: rmdir d0/d6f 39 2024-02-07T12:25:59.162 INFO:tasks.workunit.client.0.smithi047.stdout:7/649: mkdir d0/df/dd1 0 2024-02-07T12:25:59.164 INFO:tasks.workunit.client.0.smithi047.stdout:7/650: symlink d0/d4/da2/ld2 0 2024-02-07T12:25:59.165 INFO:tasks.workunit.client.0.smithi047.stdout:7/651: creat d0/df/dd1/fd3 x:0 0 0 2024-02-07T12:25:59.254 INFO:tasks.workunit.client.0.smithi047.stdout:0/353: sync 2024-02-07T12:25:59.254 INFO:tasks.workunit.client.0.smithi047.stdout:5/615: sync 2024-02-07T12:25:59.254 INFO:tasks.workunit.client.0.smithi047.stdout:0/354: fdatasync d19/d40/f53 0 2024-02-07T12:25:59.254 INFO:tasks.workunit.client.0.smithi047.stdout:1/483: sync 2024-02-07T12:25:59.254 INFO:tasks.workunit.client.0.smithi047.stdout:4/659: sync 2024-02-07T12:25:59.254 INFO:tasks.workunit.client.0.smithi047.stdout:5/616: stat da/df/d16/d25/d71/d68 0 2024-02-07T12:25:59.254 INFO:tasks.workunit.client.0.smithi047.stdout:9/430: sync 2024-02-07T12:25:59.254 INFO:tasks.workunit.client.0.smithi047.stdout:5/617: chown da/df/d16/d25/d71/d68 96 1 2024-02-07T12:25:59.254 INFO:tasks.workunit.client.0.smithi047.stdout:9/431: chown d3/d10/d4c/f4d 10612637 1 2024-02-07T12:25:59.255 INFO:tasks.workunit.client.0.smithi047.stdout:0/355: mkdir d19/d1c/d3c/d60/d6f 0 2024-02-07T12:25:59.258 INFO:tasks.workunit.client.0.smithi047.stdout:5/618: link da/d24/daa/faf da/df/d16/d25/d33/d91/fcb 0 2024-02-07T12:25:59.259 INFO:tasks.workunit.client.0.smithi047.stdout:9/432: creat d3/d10/d18/fa1 x:0 0 0 2024-02-07T12:25:59.259 INFO:tasks.workunit.client.0.smithi047.stdout:9/433: stat d3/d10/d18/d3b 0 2024-02-07T12:25:59.261 INFO:tasks.workunit.client.0.smithi047.stdout:5/619: symlink da/lcc 0 2024-02-07T12:25:59.262 INFO:tasks.workunit.client.0.smithi047.stdout:1/484: dread d1/d15/d30/d46/d4c/f6d [0,4194304] 0 2024-02-07T12:25:59.262 INFO:tasks.workunit.client.0.smithi047.stdout:9/434: rename l0 to d3/d10/d18/d3a/la2 0 2024-02-07T12:25:59.264 INFO:tasks.workunit.client.0.smithi047.stdout:0/356: rmdir d19/d1c/d2c/d49 39 2024-02-07T12:25:59.264 INFO:tasks.workunit.client.0.smithi047.stdout:0/357: write d19/d40/d66/f63 [1605054,10505] 0 2024-02-07T12:25:59.267 INFO:tasks.workunit.client.0.smithi047.stdout:1/485: mknod d1/d15/d30/d46/d4c/c93 0 2024-02-07T12:25:59.267 INFO:tasks.workunit.client.0.smithi047.stdout:1/486: creat d1/d15/d2f/d3d/d3e/f94 x:0 0 0 2024-02-07T12:25:59.268 INFO:tasks.workunit.client.0.smithi047.stdout:0/358: mkdir d19/d1c/d3c/d60/d6f/d70 0 2024-02-07T12:25:59.270 INFO:tasks.workunit.client.0.smithi047.stdout:1/487: rmdir d1/d37 39 2024-02-07T12:25:59.270 INFO:tasks.workunit.client.0.smithi047.stdout:0/359: creat d19/d1c/d2b/f71 x:0 0 0 2024-02-07T12:25:59.271 INFO:tasks.workunit.client.0.smithi047.stdout:1/488: symlink d1/d2a/l95 0 2024-02-07T12:25:59.276 INFO:tasks.workunit.client.0.smithi047.stdout:4/660: dwrite d3/d27/fc1 [4194304,4194304] 0 2024-02-07T12:25:59.277 INFO:tasks.workunit.client.0.smithi047.stdout:4/661: truncate d3/d27/dbc/fd9 483303 0 2024-02-07T12:25:59.288 INFO:tasks.workunit.client.0.smithi047.stdout:0/360: write d19/f26 [3448074,120387] 0 2024-02-07T12:25:59.288 INFO:tasks.workunit.client.0.smithi047.stdout:0/361: chown d19/d40/d66/f51 22 1 2024-02-07T12:25:59.298 INFO:tasks.workunit.client.0.smithi047.stdout:9/435: dwrite d3/d10/f67 [0,4194304] 0 2024-02-07T12:25:59.300 INFO:tasks.workunit.client.0.smithi047.stdout:9/436: write d3/f29 [4530262,103729] 0 2024-02-07T12:25:59.300 INFO:tasks.workunit.client.0.smithi047.stdout:5/620: dwrite da/df/d16/d41/f5a [0,4194304] 0 2024-02-07T12:25:59.305 INFO:tasks.workunit.client.0.smithi047.stdout:4/662: dwrite d3/d61/d70/d8b/ddb/d63/f93 [0,4194304] 0 2024-02-07T12:25:59.306 INFO:tasks.workunit.client.0.smithi047.stdout:0/362: dwrite fa [0,4194304] 0 2024-02-07T12:25:59.306 INFO:tasks.workunit.client.0.smithi047.stdout:0/363: chown d19/d40/d66 2793791 1 2024-02-07T12:25:59.306 INFO:tasks.workunit.client.0.smithi047.stdout:0/364: write d19/d1c/d24/f56 [1443911,109180] 0 2024-02-07T12:25:59.307 INFO:tasks.workunit.client.0.smithi047.stdout:9/437: unlink d3/d10/d11/f43 0 2024-02-07T12:25:59.311 INFO:tasks.workunit.client.0.smithi047.stdout:4/663: getdents d3/d27/dc5/d73 0 2024-02-07T12:25:59.313 INFO:tasks.workunit.client.0.smithi047.stdout:0/365: link f1 d19/d1c/d3c/d60/f72 0 2024-02-07T12:25:59.315 INFO:tasks.workunit.client.0.smithi047.stdout:4/664: mkdir d3/db1/de5 0 2024-02-07T12:25:59.316 INFO:tasks.workunit.client.0.smithi047.stdout:0/366: link d19/d1c/d2c/d49/c64 d19/d1c/d2b/d5f/c73 0 2024-02-07T12:25:59.318 INFO:tasks.workunit.client.0.smithi047.stdout:4/665: mknod d3/d61/d70/d8b/ddb/db7/ce6 0 2024-02-07T12:25:59.318 INFO:tasks.workunit.client.0.smithi047.stdout:4/666: chown d3/d27/d5e/lb2 16 1 2024-02-07T12:25:59.318 INFO:tasks.workunit.client.0.smithi047.stdout:4/667: truncate d3/db1/d37/da9/fdd 267024 0 2024-02-07T12:25:59.318 INFO:tasks.workunit.client.0.smithi047.stdout:4/668: write d3/d27/dbc/fd9 [726112,130909] 0 2024-02-07T12:25:59.319 INFO:tasks.workunit.client.0.smithi047.stdout:4/669: write d3/d27/d3b/fe1 [182620,4964] 0 2024-02-07T12:25:59.319 INFO:tasks.workunit.client.0.smithi047.stdout:4/670: fsync d3/d61/d70/d83/d85/fd6 0 2024-02-07T12:25:59.319 INFO:tasks.workunit.client.0.smithi047.stdout:4/671: fdatasync d3/d61/d70/d8b/ddb/d66/f8f 0 2024-02-07T12:25:59.319 INFO:tasks.workunit.client.0.smithi047.stdout:4/672: write d3/d61/d70/d83/fc4 [254018,61479] 0 2024-02-07T12:25:59.319 INFO:tasks.workunit.client.0.smithi047.stdout:4/673: chown d3/db1/d37/da9 339 1 2024-02-07T12:25:59.319 INFO:tasks.workunit.client.0.smithi047.stdout:4/674: readlink d3/d61/d43/l8c 0 2024-02-07T12:25:59.319 INFO:tasks.workunit.client.0.smithi047.stdout:4/675: dread - d3/d61/d70/d8b/ddb/d63/db3/dd4/fdf zero size 2024-02-07T12:25:59.323 INFO:tasks.workunit.client.0.smithi047.stdout:9/438: dread d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/f86 [0,4194304] 0 2024-02-07T12:25:59.325 INFO:tasks.workunit.client.0.smithi047.stdout:9/439: rename d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/f84 to d3/d10/d18/fa3 0 2024-02-07T12:25:59.325 INFO:tasks.workunit.client.0.smithi047.stdout:9/440: stat d3/d10/d18/d3b/d3c/d5d/d70/d7a 0 2024-02-07T12:25:59.325 INFO:tasks.workunit.client.0.smithi047.stdout:9/441: chown d3/d10/d18/f2e 3 1 2024-02-07T12:25:59.325 INFO:tasks.workunit.client.0.smithi047.stdout:5/621: dwrite da/d24/d63/f65 [0,4194304] 0 2024-02-07T12:25:59.325 INFO:tasks.workunit.client.0.smithi047.stdout:5/622: truncate da/df/d16/d25/d33/d91/fbe 89299 0 2024-02-07T12:25:59.329 INFO:tasks.workunit.client.0.smithi047.stdout:5/623: rename da/df/d16/d25/d33/d55/d80/f89 to da/df/d16/d25/d33/d55/d7c/fcd 0 2024-02-07T12:25:59.330 INFO:tasks.workunit.client.0.smithi047.stdout:5/624: link da/d24/f45 da/df/d16/d25/d33/d6e/da8/fce 0 2024-02-07T12:25:59.330 INFO:tasks.workunit.client.0.smithi047.stdout:5/625: creat da/df/d16/d25/d33/d55/d80/da6/fcf x:0 0 0 2024-02-07T12:25:59.330 INFO:tasks.workunit.client.0.smithi047.stdout:4/676: write d3/db1/d37/f6a [2676792,211] 0 2024-02-07T12:25:59.331 INFO:tasks.workunit.client.0.smithi047.stdout:5/626: mkdir da/dd0 0 2024-02-07T12:25:59.332 INFO:tasks.workunit.client.0.smithi047.stdout:4/677: chown d3/c26 91239 1 2024-02-07T12:25:59.332 INFO:tasks.workunit.client.0.smithi047.stdout:4/678: fdatasync d3/d27/d3b/f72 0 2024-02-07T12:25:59.334 INFO:tasks.workunit.client.0.smithi047.stdout:5/627: creat da/df/d16/d25/fd1 x:0 0 0 2024-02-07T12:25:59.334 INFO:tasks.workunit.client.0.smithi047.stdout:5/628: mkdir da/df/d16/d25/d71/dd2 0 2024-02-07T12:25:59.336 INFO:tasks.workunit.client.0.smithi047.stdout:5/629: getdents da/d24/d63/d9c 0 2024-02-07T12:25:59.344 INFO:tasks.workunit.client.0.smithi047.stdout:5/630: read da/df/d16/d25/d71/f43 [1466387,10679] 0 2024-02-07T12:25:59.347 INFO:tasks.workunit.client.0.smithi047.stdout:0/367: dwrite d19/f27 [4194304,4194304] 0 2024-02-07T12:25:59.347 INFO:tasks.workunit.client.0.smithi047.stdout:0/368: creat d19/d1c/d3c/d48/f74 x:0 0 0 2024-02-07T12:25:59.347 INFO:tasks.workunit.client.0.smithi047.stdout:0/369: write d19/d1c/f43 [1490570,86482] 0 2024-02-07T12:25:59.349 INFO:tasks.workunit.client.0.smithi047.stdout:4/679: dwrite d3/d61/d70/d8b/ddb/d66/fca [0,4194304] 0 2024-02-07T12:25:59.349 INFO:tasks.workunit.client.0.smithi047.stdout:4/680: truncate d3/d27/dc5/fb4 456251 0 2024-02-07T12:25:59.350 INFO:tasks.workunit.client.0.smithi047.stdout:4/681: dread - d3/d61/d70/d8b/ddb/d63/db3/dd4/fdf zero size 2024-02-07T12:25:59.350 INFO:tasks.workunit.client.0.smithi047.stdout:4/682: chown d3/d27/d3b/ca8 610493 1 2024-02-07T12:25:59.354 INFO:tasks.workunit.client.0.smithi047.stdout:5/631: write da/df/d16/d41/f42 [823217,4660] 0 2024-02-07T12:25:59.354 INFO:tasks.workunit.client.0.smithi047.stdout:5/632: truncate da/df/d16/d25/d33/d55/d80/fa9 5197153 0 2024-02-07T12:25:59.360 INFO:tasks.workunit.client.0.smithi047.stdout:4/683: write d3/d61/d70/d8b/ddb/d66/fe0 [2519281,114884] 0 2024-02-07T12:25:59.360 INFO:tasks.workunit.client.0.smithi047.stdout:4/684: creat d3/d27/dbc/fe7 x:0 0 0 2024-02-07T12:25:59.367 INFO:tasks.workunit.client.0.smithi047.stdout:5/633: rename da/f39 to da/d24/fd3 0 2024-02-07T12:25:59.370 INFO:tasks.workunit.client.0.smithi047.stdout:4/685: unlink d3/d61/d70/d8b/ddb/d63/c74 0 2024-02-07T12:25:59.370 INFO:tasks.workunit.client.0.smithi047.stdout:4/686: chown d3/d61/d70/d8b/ddb/l69 168557 1 2024-02-07T12:25:59.371 INFO:tasks.workunit.client.0.smithi047.stdout:0/370: dwrite fc [0,4194304] 0 2024-02-07T12:25:59.371 INFO:tasks.workunit.client.0.smithi047.stdout:0/371: truncate d19/f2e 650212 0 2024-02-07T12:25:59.371 INFO:tasks.workunit.client.0.smithi047.stdout:5/634: symlink da/d24/d63/d85/db3/ld4 0 2024-02-07T12:25:59.373 INFO:tasks.workunit.client.0.smithi047.stdout:4/687: unlink d3/d27/d3b/l48 0 2024-02-07T12:25:59.373 INFO:tasks.workunit.client.0.smithi047.stdout:4/688: readlink d3/d61/d70/d8b/ddb/l62 0 2024-02-07T12:25:59.377 INFO:tasks.workunit.client.0.smithi047.stdout:4/689: creat d3/db1/de5/fe8 x:0 0 0 2024-02-07T12:25:59.379 INFO:tasks.workunit.client.0.smithi047.stdout:0/372: symlink d19/d1c/l75 0 2024-02-07T12:25:59.379 INFO:tasks.workunit.client.0.smithi047.stdout:0/373: fsync d19/d1c/d24/f35 0 2024-02-07T12:25:59.381 INFO:tasks.workunit.client.0.smithi047.stdout:4/690: link d3/d27/d3b/d7d/da2/la5 d3/d61/d70/d8b/ddb/d63/dda/le9 0 2024-02-07T12:25:59.381 INFO:tasks.workunit.client.0.smithi047.stdout:4/691: dread - d3/d27/dbc/fbe zero size 2024-02-07T12:25:59.381 INFO:tasks.workunit.client.0.smithi047.stdout:4/692: write d3/d61/d70/d8b/fa4 [910054,16356] 0 2024-02-07T12:25:59.383 INFO:tasks.workunit.client.0.smithi047.stdout:0/374: dread d19/d1c/d2c/d49/f68 [0,4194304] 0 2024-02-07T12:25:59.383 INFO:tasks.workunit.client.0.smithi047.stdout:2/641: sync 2024-02-07T12:25:59.383 INFO:tasks.workunit.client.0.smithi047.stdout:2/642: write d7/f28 [1232649,77352] 0 2024-02-07T12:25:59.383 INFO:tasks.workunit.client.0.smithi047.stdout:2/643: fsync d7/f88 0 2024-02-07T12:25:59.383 INFO:tasks.workunit.client.0.smithi047.stdout:2/644: write d7/dc/d4c/fa2 [188151,69991] 0 2024-02-07T12:25:59.385 INFO:tasks.workunit.client.0.smithi047.stdout:4/693: link d3/d27/d5e/cac d3/db1/d37/da9/cea 0 2024-02-07T12:25:59.386 INFO:tasks.workunit.client.0.smithi047.stdout:0/375: creat d19/d1c/d3c/d60/d6f/d70/f76 x:0 0 0 2024-02-07T12:25:59.388 INFO:tasks.workunit.client.0.smithi047.stdout:5/635: dwrite da/df/d16/d25/d71/d68/f9b [0,4194304] 0 2024-02-07T12:25:59.388 INFO:tasks.workunit.client.0.smithi047.stdout:2/645: rename d7/c3c to d7/dc/d8a/ccb 0 2024-02-07T12:25:59.390 INFO:tasks.workunit.client.0.smithi047.stdout:2/646: mknod d7/dc/d8a/ccc 0 2024-02-07T12:25:59.392 INFO:tasks.workunit.client.0.smithi047.stdout:0/376: dread d19/d1c/d2c/f42 [0,4194304] 0 2024-02-07T12:25:59.396 INFO:tasks.workunit.client.0.smithi047.stdout:5/636: rename da/df/d16/d25/d71/d8c to da/df/d16/d25/d33/d6e/da8/db6/dd5 0 2024-02-07T12:25:59.396 INFO:tasks.workunit.client.0.smithi047.stdout:2/647: creat d7/dc/d71/fcd x:0 0 0 2024-02-07T12:25:59.412 INFO:tasks.workunit.client.0.smithi047.stdout:5/637: dread da/df/d16/d25/d33/d55/d7c/fcd [0,4194304] 0 2024-02-07T12:25:59.422 INFO:tasks.workunit.client.0.smithi047.stdout:4/694: dwrite d3/d61/d70/d8b/ddb/d63/f93 [0,4194304] 0 2024-02-07T12:25:59.422 INFO:tasks.workunit.client.0.smithi047.stdout:4/695: chown d3/db1/d37/lb0 7403 1 2024-02-07T12:25:59.422 INFO:tasks.workunit.client.0.smithi047.stdout:4/696: dread - d3/d61/d70/d83/fd7 zero size 2024-02-07T12:25:59.422 INFO:tasks.workunit.client.0.smithi047.stdout:4/697: chown d3/d61/cc8 573 1 2024-02-07T12:25:59.423 INFO:tasks.workunit.client.0.smithi047.stdout:4/698: chown d3/d27/d3b/l4f 0 1 2024-02-07T12:25:59.423 INFO:tasks.workunit.client.0.smithi047.stdout:0/377: dwrite d19/f6d [0,4194304] 0 2024-02-07T12:25:59.424 INFO:tasks.workunit.client.0.smithi047.stdout:4/699: creat d3/d61/d70/feb x:0 0 0 2024-02-07T12:25:59.426 INFO:tasks.workunit.client.0.smithi047.stdout:0/378: dread d19/d1c/d3c/d37/f39 [0,4194304] 0 2024-02-07T12:25:59.426 INFO:tasks.workunit.client.0.smithi047.stdout:0/379: read d19/f26 [1580908,56987] 0 2024-02-07T12:25:59.427 INFO:tasks.workunit.client.0.smithi047.stdout:0/380: chown d19/f27 247 1 2024-02-07T12:25:59.428 INFO:tasks.workunit.client.0.smithi047.stdout:4/700: link d3/d27/d3b/d7d/faf d3/d61/d70/d8b/ddb/d66/fec 0 2024-02-07T12:25:59.428 INFO:tasks.workunit.client.0.smithi047.stdout:4/701: fsync d3/d27/f28 0 2024-02-07T12:25:59.428 INFO:tasks.workunit.client.0.smithi047.stdout:4/702: creat d3/db1/de5/fed x:0 0 0 2024-02-07T12:25:59.428 INFO:tasks.workunit.client.0.smithi047.stdout:0/381: truncate d19/f26 590279 0 2024-02-07T12:25:59.429 INFO:tasks.workunit.client.0.smithi047.stdout:0/382: creat d19/d1c/d2b/f77 x:0 0 0 2024-02-07T12:25:59.430 INFO:tasks.workunit.client.0.smithi047.stdout:2/648: dwrite d7/dc/f8f [0,4194304] 0 2024-02-07T12:25:59.433 INFO:tasks.workunit.client.0.smithi047.stdout:5/638: dwrite da/df/d16/d25/d71/f4e [0,4194304] 0 2024-02-07T12:25:59.434 INFO:tasks.workunit.client.0.smithi047.stdout:5/639: getdents da/d24/d63/d9c 0 2024-02-07T12:25:59.435 INFO:tasks.workunit.client.0.smithi047.stdout:2/649: mknod d7/d2d/d5c/d77/d92/cce 0 2024-02-07T12:25:59.445 INFO:tasks.workunit.client.0.smithi047.stdout:5/640: rmdir da/d24/d63/d85/db3 39 2024-02-07T12:25:59.454 INFO:tasks.workunit.client.0.smithi047.stdout:0/383: dread d19/d1c/d24/f56 [0,4194304] 0 2024-02-07T12:25:59.457 INFO:tasks.workunit.client.0.smithi047.stdout:4/703: dwrite d3/d61/d43/f53 [0,4194304] 0 2024-02-07T12:25:59.458 INFO:tasks.workunit.client.0.smithi047.stdout:4/704: mkdir d3/d61/d70/d83/d85/dee 0 2024-02-07T12:25:59.460 INFO:tasks.workunit.client.0.smithi047.stdout:4/705: link d3/d27/d3b/f88 d3/d61/d70/d8b/ddb/d63/db3/fef 0 2024-02-07T12:25:59.461 INFO:tasks.workunit.client.0.smithi047.stdout:4/706: write d3/d27/d3b/d7d/da2/fb8 [1277680,87889] 0 2024-02-07T12:25:59.462 INFO:tasks.workunit.client.0.smithi047.stdout:4/707: creat d3/d61/d70/d83/d85/dee/ff0 x:0 0 0 2024-02-07T12:25:59.462 INFO:tasks.workunit.client.0.smithi047.stdout:2/650: dwrite d7/dc/f76 [0,4194304] 0 2024-02-07T12:25:59.464 INFO:tasks.workunit.client.0.smithi047.stdout:4/708: creat d3/db1/ff1 x:0 0 0 2024-02-07T12:25:59.466 INFO:tasks.workunit.client.0.smithi047.stdout:2/651: rename d7/dc/cf to d7/d48/d72/db7/ccf 0 2024-02-07T12:25:59.485 INFO:tasks.workunit.client.0.smithi047.stdout:0/384: dwrite d19/d1c/d2c/f42 [0,4194304] 0 2024-02-07T12:25:59.486 INFO:tasks.workunit.client.0.smithi047.stdout:5/641: dwrite da/f34 [0,4194304] 0 2024-02-07T12:25:59.486 INFO:tasks.workunit.client.0.smithi047.stdout:2/652: dwrite d7/dc/f2b [0,4194304] 0 2024-02-07T12:25:59.486 INFO:tasks.workunit.client.0.smithi047.stdout:2/653: write d7/d2d/f45 [887731,76954] 0 2024-02-07T12:25:59.492 INFO:tasks.workunit.client.0.smithi047.stdout:0/385: dread d19/f2e [0,4194304] 0 2024-02-07T12:25:59.492 INFO:tasks.workunit.client.0.smithi047.stdout:0/386: chown d19/d1c/d2b 1926269 1 2024-02-07T12:25:59.493 INFO:tasks.workunit.client.0.smithi047.stdout:2/654: mknod d7/dc/d8a/cd0 0 2024-02-07T12:25:59.495 INFO:tasks.workunit.client.0.smithi047.stdout:2/655: dread d7/dc/f59 [0,4194304] 0 2024-02-07T12:25:59.495 INFO:tasks.workunit.client.0.smithi047.stdout:2/656: readlink d7/dc/d71/lac 0 2024-02-07T12:25:59.495 INFO:tasks.workunit.client.0.smithi047.stdout:2/657: stat d7/dc/f1a 0 2024-02-07T12:25:59.501 INFO:tasks.workunit.client.0.smithi047.stdout:2/658: dread d7/dc/f31 [0,4194304] 0 2024-02-07T12:25:59.504 INFO:tasks.workunit.client.0.smithi047.stdout:2/659: creat d7/d48/d72/db7/fd1 x:0 0 0 2024-02-07T12:25:59.504 INFO:tasks.workunit.client.0.smithi047.stdout:2/660: read d7/f8 [171682,98981] 0 2024-02-07T12:25:59.504 INFO:tasks.workunit.client.0.smithi047.stdout:2/661: read - d7/d48/fc9 zero size 2024-02-07T12:25:59.517 INFO:tasks.workunit.client.0.smithi047.stdout:2/662: write d7/dc/d4c/f94 [3975610,118487] 0 2024-02-07T12:25:59.517 INFO:tasks.workunit.client.0.smithi047.stdout:2/663: chown d7/dc/d51/f60 3339 1 2024-02-07T12:25:59.518 INFO:tasks.workunit.client.0.smithi047.stdout:2/664: unlink d7/d48/f6e 0 2024-02-07T12:25:59.519 INFO:tasks.workunit.client.0.smithi047.stdout:2/665: truncate d7/f12 3057991 0 2024-02-07T12:25:59.520 INFO:tasks.workunit.client.0.smithi047.stdout:5/642: dwrite da/df/d16/d25/d33/f3c [0,4194304] 0 2024-02-07T12:25:59.520 INFO:tasks.workunit.client.0.smithi047.stdout:0/387: dwrite d19/d40/f53 [0,4194304] 0 2024-02-07T12:25:59.523 INFO:tasks.workunit.client.0.smithi047.stdout:5/643: truncate da/d24/fd3 4133217 0 2024-02-07T12:25:59.526 INFO:tasks.workunit.client.0.smithi047.stdout:0/388: symlink d19/d40/d66/d46/l78 0 2024-02-07T12:25:59.526 INFO:tasks.workunit.client.0.smithi047.stdout:0/389: chown fc 77 1 2024-02-07T12:25:59.526 INFO:tasks.workunit.client.0.smithi047.stdout:5/644: getdents da/df/d16/d25/d33/d6e 0 2024-02-07T12:25:59.528 INFO:tasks.workunit.client.0.smithi047.stdout:5/645: truncate da/df/d16/d25/d33/d55/d80/da6/fc4 11829 0 2024-02-07T12:25:59.528 INFO:tasks.workunit.client.0.smithi047.stdout:5/646: getdents da/df/d16/d25/d33/d55/d80/db2 0 2024-02-07T12:25:59.530 INFO:tasks.workunit.client.0.smithi047.stdout:5/647: mknod da/df/d16/d25/d33/d55/d80/cd6 0 2024-02-07T12:25:59.536 INFO:tasks.workunit.client.0.smithi047.stdout:5/648: creat da/df/d16/d25/d33/d55/d80/db2/fd7 x:0 0 0 2024-02-07T12:25:59.538 INFO:tasks.workunit.client.0.smithi047.stdout:5/649: mkdir da/df/d16/d41/dd8 0 2024-02-07T12:25:59.538 INFO:tasks.workunit.client.0.smithi047.stdout:5/650: readlink da/df/d16/d25/l60 0 2024-02-07T12:25:59.549 INFO:tasks.workunit.client.0.smithi047.stdout:0/390: dwrite d19/f2d [4194304,4194304] 0 2024-02-07T12:25:59.551 INFO:tasks.workunit.client.0.smithi047.stdout:0/391: creat d19/d1c/d2c/d49/f79 x:0 0 0 2024-02-07T12:25:59.551 INFO:tasks.workunit.client.0.smithi047.stdout:0/392: truncate d19/d1c/d2b/f77 816585 0 2024-02-07T12:25:59.561 INFO:tasks.workunit.client.0.smithi047.stdout:0/393: dread d19/d1c/d3c/d60/f72 [0,4194304] 0 2024-02-07T12:25:59.561 INFO:tasks.workunit.client.0.smithi047.stdout:0/394: chown d19/d1c/d2c/c57 4 1 2024-02-07T12:25:59.562 INFO:tasks.workunit.client.0.smithi047.stdout:0/395: truncate d19/d1c/d3c/d60/d6f/d70/f76 689276 0 2024-02-07T12:25:59.562 INFO:tasks.workunit.client.0.smithi047.stdout:0/396: symlink d19/d1c/d2b/l7a 0 2024-02-07T12:25:59.563 INFO:tasks.workunit.client.0.smithi047.stdout:2/666: dwrite d7/d2d/f45 [0,4194304] 0 2024-02-07T12:25:59.564 INFO:tasks.workunit.client.0.smithi047.stdout:0/397: mknod d19/d1c/d3c/c7b 0 2024-02-07T12:25:59.566 INFO:tasks.workunit.client.0.smithi047.stdout:5/651: dwrite da/df/d16/d25/d71/d68/f87 [0,4194304] 0 2024-02-07T12:25:59.571 INFO:tasks.workunit.client.0.smithi047.stdout:5/652: rename da/df/d16/d25/d33/d6e/da8/db6/dd5/lb7 to da/df/d16/ld9 0 2024-02-07T12:25:59.573 INFO:tasks.workunit.client.0.smithi047.stdout:5/653: mkdir da/df/d16/d25/d71/d68/dda 0 2024-02-07T12:25:59.581 INFO:tasks.workunit.client.0.smithi047.stdout:2/667: dwrite d7/dc/f8f [4194304,4194304] 0 2024-02-07T12:25:59.582 INFO:tasks.workunit.client.0.smithi047.stdout:2/668: stat d7/dc/d8a/cd0 0 2024-02-07T12:25:59.582 INFO:tasks.workunit.client.0.smithi047.stdout:8/628: sync 2024-02-07T12:25:59.582 INFO:tasks.workunit.client.0.smithi047.stdout:2/669: chown d7/d2d/f45 3 1 2024-02-07T12:25:59.582 INFO:tasks.workunit.client.0.smithi047.stdout:0/398: dwrite d19/d1c/d24/f35 [0,4194304] 0 2024-02-07T12:25:59.583 INFO:tasks.workunit.client.0.smithi047.stdout:0/399: chown d19/d1c/f31 4758237 1 2024-02-07T12:25:59.583 INFO:tasks.workunit.client.0.smithi047.stdout:0/400: stat d19/d25/l6e 0 2024-02-07T12:25:59.584 INFO:tasks.workunit.client.0.smithi047.stdout:2/670: rename d7/l24 to d7/d48/d72/ld2 0 2024-02-07T12:25:59.584 INFO:tasks.workunit.client.0.smithi047.stdout:2/671: dread - d7/dc/f9e zero size 2024-02-07T12:25:59.585 INFO:tasks.workunit.client.0.smithi047.stdout:8/629: mkdir d3/d36/d50/d30/d9e/dcb/dcd/dd0 0 2024-02-07T12:25:59.585 INFO:tasks.workunit.client.0.smithi047.stdout:8/630: fdatasync d3/d4/f55 0 2024-02-07T12:25:59.592 INFO:tasks.workunit.client.0.smithi047.stdout:2/672: symlink d7/d48/d72/ld3 0 2024-02-07T12:25:59.594 INFO:tasks.workunit.client.0.smithi047.stdout:2/673: rmdir d7/d48/d72/dba 0 2024-02-07T12:25:59.594 INFO:tasks.workunit.client.0.smithi047.stdout:2/674: dread - d7/dc/d4c/f7a zero size 2024-02-07T12:25:59.605 INFO:tasks.workunit.client.0.smithi047.stdout:0/401: dwrite d19/d40/d66/d46/f5e [0,4194304] 0 2024-02-07T12:25:59.606 INFO:tasks.workunit.client.0.smithi047.stdout:8/631: dwrite d3/d36/d50/d30/d34/d3e/fa2 [0,4194304] 0 2024-02-07T12:25:59.609 INFO:tasks.workunit.client.0.smithi047.stdout:0/402: symlink d19/l7c 0 2024-02-07T12:25:59.609 INFO:tasks.workunit.client.0.smithi047.stdout:8/632: dread d3/d36/d50/d30/d34/d3e/f86 [0,4194304] 0 2024-02-07T12:25:59.610 INFO:tasks.workunit.client.0.smithi047.stdout:2/675: dwrite d7/dc/f44 [0,4194304] 0 2024-02-07T12:25:59.611 INFO:tasks.workunit.client.0.smithi047.stdout:8/633: getdents d3/d99 0 2024-02-07T12:25:59.613 INFO:tasks.workunit.client.0.smithi047.stdout:2/676: rename d7/dc/d4c/f58 to d7/d48/d72/dbf/fd4 0 2024-02-07T12:25:59.616 INFO:tasks.workunit.client.0.smithi047.stdout:2/677: symlink d7/dc/d4c/d65/ld5 0 2024-02-07T12:25:59.619 INFO:tasks.workunit.client.0.smithi047.stdout:8/634: getdents d3/d36/d50/d30/d9e/da6 0 2024-02-07T12:25:59.619 INFO:tasks.workunit.client.0.smithi047.stdout:8/635: readlink d3/d4/l24 0 2024-02-07T12:25:59.620 INFO:tasks.workunit.client.0.smithi047.stdout:0/403: dread d19/d40/f53 [0,4194304] 0 2024-02-07T12:25:59.620 INFO:tasks.workunit.client.0.smithi047.stdout:0/404: creat d19/d1c/d2c/f7d x:0 0 0 2024-02-07T12:25:59.621 INFO:tasks.workunit.client.0.smithi047.stdout:2/678: mkdir d7/dc/dd6 0 2024-02-07T12:25:59.628 INFO:tasks.workunit.client.0.smithi047.stdout:0/405: mknod d19/d1c/c7e 0 2024-02-07T12:25:59.628 INFO:tasks.workunit.client.0.smithi047.stdout:2/679: rmdir d7/d2d/d5c/d77/d9b 39 2024-02-07T12:25:59.631 INFO:tasks.workunit.client.0.smithi047.stdout:2/680: mknod d7/d2d/d5c/d77/d9b/cd7 0 2024-02-07T12:25:59.633 INFO:tasks.workunit.client.0.smithi047.stdout:0/406: mknod d19/d1c/c7f 0 2024-02-07T12:25:59.634 INFO:tasks.workunit.client.0.smithi047.stdout:0/407: rmdir d19/d1c/d3c/d60 39 2024-02-07T12:25:59.635 INFO:tasks.workunit.client.0.smithi047.stdout:8/636: dwrite d3/d36/d50/d28/f96 [0,4194304] 0 2024-02-07T12:25:59.638 INFO:tasks.workunit.client.0.smithi047.stdout:8/637: rename d3/d36/d50/d30/d34/d3e/fa2 to d3/d36/d9d/dbe/fd1 0 2024-02-07T12:25:59.643 INFO:tasks.workunit.client.0.smithi047.stdout:8/638: getdents d3/d36/d9d/dbe 0 2024-02-07T12:25:59.643 INFO:tasks.workunit.client.0.smithi047.stdout:8/639: chown d3/d4/l24 63591292 1 2024-02-07T12:25:59.643 INFO:tasks.workunit.client.0.smithi047.stdout:8/640: write d3/d66/f7a [929304,53746] 0 2024-02-07T12:25:59.649 INFO:tasks.workunit.client.0.smithi047.stdout:2/681: dwrite d7/d2d/d5c/f80 [0,4194304] 0 2024-02-07T12:25:59.649 INFO:tasks.workunit.client.0.smithi047.stdout:0/408: dwrite f1 [0,4194304] 0 2024-02-07T12:25:59.650 INFO:tasks.workunit.client.0.smithi047.stdout:0/409: creat d19/d1c/d2b/d5f/f80 x:0 0 0 2024-02-07T12:25:59.651 INFO:tasks.workunit.client.0.smithi047.stdout:0/410: dread d19/d1c/d3c/d60/d6f/d70/f76 [0,4194304] 0 2024-02-07T12:25:59.655 INFO:tasks.workunit.client.0.smithi047.stdout:0/411: rmdir d19/d25 39 2024-02-07T12:25:59.655 INFO:tasks.workunit.client.0.smithi047.stdout:0/412: fsync f18 0 2024-02-07T12:25:59.655 INFO:tasks.workunit.client.0.smithi047.stdout:0/413: chown d19/d40/d66/d46/f5e 176 1 2024-02-07T12:25:59.656 INFO:tasks.workunit.client.0.smithi047.stdout:0/414: mkdir d19/d40/d66/d81 0 2024-02-07T12:25:59.660 INFO:tasks.workunit.client.0.smithi047.stdout:0/415: dread d19/d40/d66/f63 [0,4194304] 0 2024-02-07T12:25:59.661 INFO:tasks.workunit.client.0.smithi047.stdout:0/416: mkdir d19/d40/d66/d81/d82 0 2024-02-07T12:25:59.661 INFO:tasks.workunit.client.0.smithi047.stdout:0/417: chown d19/d1c/d3c/c50 26288920 1 2024-02-07T12:25:59.662 INFO:tasks.workunit.client.0.smithi047.stdout:0/418: creat d19/f83 x:0 0 0 2024-02-07T12:25:59.663 INFO:tasks.workunit.client.0.smithi047.stdout:0/419: mknod d19/c84 0 2024-02-07T12:25:59.664 INFO:tasks.workunit.client.0.smithi047.stdout:0/420: symlink d19/d1c/d2c/l85 0 2024-02-07T12:25:59.664 INFO:tasks.workunit.client.0.smithi047.stdout:0/421: creat d19/d1c/d3c/d60/d6f/d70/f86 x:0 0 0 2024-02-07T12:25:59.668 INFO:tasks.workunit.client.0.smithi047.stdout:8/641: dwrite d3/d36/d50/d2a/f2b [0,4194304] 0 2024-02-07T12:25:59.668 INFO:tasks.workunit.client.0.smithi047.stdout:2/682: dwrite d7/d2d/f63 [0,4194304] 0 2024-02-07T12:25:59.669 INFO:tasks.workunit.client.0.smithi047.stdout:8/642: creat d3/d66/d67/d6a/fd2 x:0 0 0 2024-02-07T12:25:59.669 INFO:tasks.workunit.client.0.smithi047.stdout:8/643: chown d3/d66/d67/d6a/d91/fcc 88497 1 2024-02-07T12:25:59.671 INFO:tasks.workunit.client.0.smithi047.stdout:2/683: rename d7/dc/d8a/fc5 to d7/dc/d8a/fd8 0 2024-02-07T12:25:59.671 INFO:tasks.workunit.client.0.smithi047.stdout:2/684: write d7/d2d/d5c/d77/d9b/fc8 [312097,130723] 0 2024-02-07T12:25:59.672 INFO:tasks.workunit.client.0.smithi047.stdout:0/422: dread d19/f27 [4194304,4194304] 0 2024-02-07T12:25:59.672 INFO:tasks.workunit.client.0.smithi047.stdout:0/423: fdatasync d19/d40/d66/f51 0 2024-02-07T12:25:59.672 INFO:tasks.workunit.client.0.smithi047.stdout:0/424: fdatasync d19/d1c/d2b/d5f/f80 0 2024-02-07T12:25:59.674 INFO:tasks.workunit.client.0.smithi047.stdout:2/685: creat d7/d2d/d5c/d77/d9b/dc4/fd9 x:0 0 0 2024-02-07T12:25:59.675 INFO:tasks.workunit.client.0.smithi047.stdout:8/644: rmdir d3/d66/d67/d6a/d91 39 2024-02-07T12:25:59.676 INFO:tasks.workunit.client.0.smithi047.stdout:2/686: mkdir d7/dc/d51/dda 0 2024-02-07T12:25:59.676 INFO:tasks.workunit.client.0.smithi047.stdout:2/687: write d7/d2d/d5c/d77/d92/f96 [143870,106935] 0 2024-02-07T12:25:59.677 INFO:tasks.workunit.client.0.smithi047.stdout:8/645: dread d3/d66/faa [0,4194304] 0 2024-02-07T12:25:59.695 INFO:tasks.workunit.client.0.smithi047.stdout:0/425: dwrite d19/d1c/d3c/d48/f74 [0,4194304] 0 2024-02-07T12:25:59.698 INFO:tasks.workunit.client.0.smithi047.stdout:8/646: dwrite d3/d36/d50/d30/d9e/da6/f84 [0,4194304] 0 2024-02-07T12:25:59.698 INFO:tasks.workunit.client.0.smithi047.stdout:2/688: dwrite d7/f1e [4194304,4194304] 0 2024-02-07T12:25:59.698 INFO:tasks.workunit.client.0.smithi047.stdout:0/426: creat d19/d1c/d3c/d60/f87 x:0 0 0 2024-02-07T12:25:59.698 INFO:tasks.workunit.client.0.smithi047.stdout:0/427: stat d19/d1c/d2b/l7a 0 2024-02-07T12:25:59.701 INFO:tasks.workunit.client.0.smithi047.stdout:2/689: stat d7/d2d/d7c/la5 0 2024-02-07T12:25:59.702 INFO:tasks.workunit.client.0.smithi047.stdout:0/428: truncate d19/d1c/d3c/d37/f39 414453 0 2024-02-07T12:25:59.702 INFO:tasks.workunit.client.0.smithi047.stdout:0/429: readlink d19/d1c/d24/l4c 0 2024-02-07T12:25:59.702 INFO:tasks.workunit.client.0.smithi047.stdout:0/430: creat d19/d1c/d2b/f88 x:0 0 0 2024-02-07T12:25:59.703 INFO:tasks.workunit.client.0.smithi047.stdout:0/431: truncate d19/d1c/d2c/d49/f5c 213963 0 2024-02-07T12:25:59.703 INFO:tasks.workunit.client.0.smithi047.stdout:2/690: symlink d7/d2d/d5c/d77/d9b/dc4/ldb 0 2024-02-07T12:25:59.715 INFO:tasks.workunit.client.0.smithi047.stdout:2/691: dread d7/d2d/d5c/d77/d92/f96 [0,4194304] 0 2024-02-07T12:25:59.716 INFO:tasks.workunit.client.0.smithi047.stdout:8/647: dwrite d3/f72 [4194304,4194304] 0 2024-02-07T12:25:59.719 INFO:tasks.workunit.client.0.smithi047.stdout:2/692: mkdir d7/d2d/ddc 0 2024-02-07T12:25:59.719 INFO:tasks.workunit.client.0.smithi047.stdout:0/432: dwrite d19/d1c/d2c/d49/f68 [0,4194304] 0 2024-02-07T12:25:59.719 INFO:tasks.workunit.client.0.smithi047.stdout:0/433: fsync d19/d1c/d2b/f71 0 2024-02-07T12:25:59.719 INFO:tasks.workunit.client.0.smithi047.stdout:0/434: creat d19/d1c/d2b/d5f/f89 x:0 0 0 2024-02-07T12:25:59.720 INFO:tasks.workunit.client.0.smithi047.stdout:2/693: dread d7/dc/f75 [0,4194304] 0 2024-02-07T12:25:59.721 INFO:tasks.workunit.client.0.smithi047.stdout:0/435: dread d19/d1c/f43 [0,4194304] 0 2024-02-07T12:25:59.730 INFO:tasks.workunit.client.0.smithi047.stdout:3/628: sync 2024-02-07T12:25:59.730 INFO:tasks.workunit.client.0.smithi047.stdout:3/629: fdatasync d12/d19/d2d/d42/d6b/fb9 0 2024-02-07T12:25:59.731 INFO:tasks.workunit.client.0.smithi047.stdout:2/694: write d7/d2d/d7c/f7f [2082667,55255] 0 2024-02-07T12:25:59.731 INFO:tasks.workunit.client.0.smithi047.stdout:3/630: symlink d12/dc7/d29/d31/d61/lda 0 2024-02-07T12:25:59.732 INFO:tasks.workunit.client.0.smithi047.stdout:3/631: readlink d12/d19/d2d/d33/l92 0 2024-02-07T12:25:59.732 INFO:tasks.workunit.client.0.smithi047.stdout:3/632: fsync d12/d19/d37/f98 0 2024-02-07T12:25:59.732 INFO:tasks.workunit.client.0.smithi047.stdout:3/633: symlink d12/dc7/d29/d31/d38/d59/d87/dc5/ldb 0 2024-02-07T12:25:59.739 INFO:tasks.workunit.client.0.smithi047.stdout:8/648: dwrite d3/d66/f7d [0,4194304] 0 2024-02-07T12:25:59.740 INFO:tasks.workunit.client.0.smithi047.stdout:3/634: dread d12/f3d [0,4194304] 0 2024-02-07T12:25:59.740 INFO:tasks.workunit.client.0.smithi047.stdout:0/436: dwrite d19/d1c/d2c/d49/f68 [0,4194304] 0 2024-02-07T12:25:59.741 INFO:tasks.workunit.client.0.smithi047.stdout:3/635: read d12/d19/d2d/f8b [299626,129028] 0 2024-02-07T12:25:59.742 INFO:tasks.workunit.client.0.smithi047.stdout:8/649: mknod d3/d36/d50/d30/d34/cd3 0 2024-02-07T12:25:59.744 INFO:tasks.workunit.client.0.smithi047.stdout:0/437: unlink d19/d1c/d2c/d49/l5a 0 2024-02-07T12:25:59.744 INFO:tasks.workunit.client.0.smithi047.stdout:0/438: write d19/f26 [1208278,10129] 0 2024-02-07T12:25:59.745 INFO:tasks.workunit.client.0.smithi047.stdout:8/650: mknod d3/d4/d87/cd4 0 2024-02-07T12:25:59.745 INFO:tasks.workunit.client.0.smithi047.stdout:8/651: truncate d3/d66/d67/d6a/f92 904448 0 2024-02-07T12:25:59.747 INFO:tasks.workunit.client.0.smithi047.stdout:2/695: dwrite d7/dc/f44 [0,4194304] 0 2024-02-07T12:25:59.747 INFO:tasks.workunit.client.0.smithi047.stdout:2/696: write d7/dc/d8a/fd8 [316641,33082] 0 2024-02-07T12:25:59.747 INFO:tasks.workunit.client.0.smithi047.stdout:2/697: dread - d7/dc/d71/f87 zero size 2024-02-07T12:25:59.747 INFO:tasks.workunit.client.0.smithi047.stdout:0/439: write d19/d40/d66/f63 [36337,96124] 0 2024-02-07T12:25:59.747 INFO:tasks.workunit.client.0.smithi047.stdout:0/440: chown d19/d1c/c29 188466803 1 2024-02-07T12:25:59.747 INFO:tasks.workunit.client.0.smithi047.stdout:0/441: chown d19/d1c/d3c/d48/f74 87689029 1 2024-02-07T12:25:59.751 INFO:tasks.workunit.client.0.smithi047.stdout:2/698: truncate d7/f20 6328453 0 2024-02-07T12:25:59.753 INFO:tasks.workunit.client.0.smithi047.stdout:0/442: unlink d19/d25/f55 0 2024-02-07T12:25:59.753 INFO:tasks.workunit.client.0.smithi047.stdout:8/652: dread d3/d66/d67/d6a/f51 [4194304,4194304] 0 2024-02-07T12:25:59.759 INFO:tasks.workunit.client.0.smithi047.stdout:0/443: link d19/d1c/d2b/l7a d19/d1c/d3c/d48/l8a 0 2024-02-07T12:25:59.759 INFO:tasks.workunit.client.0.smithi047.stdout:0/444: creat d19/f8b x:0 0 0 2024-02-07T12:25:59.760 INFO:tasks.workunit.client.0.smithi047.stdout:8/653: creat d3/d66/d67/d6a/dca/fd5 x:0 0 0 2024-02-07T12:25:59.760 INFO:tasks.workunit.client.0.smithi047.stdout:8/654: dread - d3/d36/d50/d30/d34/d3e/fc7 zero size 2024-02-07T12:25:59.760 INFO:tasks.workunit.client.0.smithi047.stdout:8/655: creat d3/d4/d4d/dc0/fd6 x:0 0 0 2024-02-07T12:25:59.760 INFO:tasks.workunit.client.0.smithi047.stdout:2/699: write d7/dc/f2b [1338701,16667] 0 2024-02-07T12:25:59.760 INFO:tasks.workunit.client.0.smithi047.stdout:2/700: chown d7/f38 14 1 2024-02-07T12:25:59.761 INFO:tasks.workunit.client.0.smithi047.stdout:9/442: sync 2024-02-07T12:25:59.761 INFO:tasks.workunit.client.0.smithi047.stdout:6/526: sync 2024-02-07T12:25:59.761 INFO:tasks.workunit.client.0.smithi047.stdout:7/652: sync 2024-02-07T12:25:59.761 INFO:tasks.workunit.client.0.smithi047.stdout:1/489: sync 2024-02-07T12:25:59.761 INFO:tasks.workunit.client.0.smithi047.stdout:6/527: readlink d3/lb 0 2024-02-07T12:25:59.761 INFO:tasks.workunit.client.0.smithi047.stdout:7/653: chown d0/d42/d4d/d67/c83 48779 1 2024-02-07T12:25:59.761 INFO:tasks.workunit.client.0.smithi047.stdout:1/490: fdatasync d1/d15/d2f/f6b 0 2024-02-07T12:25:59.761 INFO:tasks.workunit.client.0.smithi047.stdout:7/654: write d0/df/d29/fa6 [4781656,50368] 0 2024-02-07T12:25:59.762 INFO:tasks.workunit.client.0.smithi047.stdout:9/443: write d3/f19 [4152825,111569] 0 2024-02-07T12:25:59.762 INFO:tasks.workunit.client.0.smithi047.stdout:0/445: mkdir d19/d1c/d2c/d8c 0 2024-02-07T12:25:59.762 INFO:tasks.workunit.client.0.smithi047.stdout:0/446: stat d19/d1c/d3c/l52 0 2024-02-07T12:25:59.768 INFO:tasks.workunit.client.0.smithi047.stdout:8/656: creat d3/dbd/fd7 x:0 0 0 2024-02-07T12:25:59.770 INFO:tasks.workunit.client.0.smithi047.stdout:7/655: dread d0/d4/f7e [0,4194304] 0 2024-02-07T12:25:59.770 INFO:tasks.workunit.client.0.smithi047.stdout:7/656: readlink d0/df/d29/d31/l93 0 2024-02-07T12:25:59.770 INFO:tasks.workunit.client.0.smithi047.stdout:2/701: rmdir d7/dc/d8a/dc6 0 2024-02-07T12:25:59.770 INFO:tasks.workunit.client.0.smithi047.stdout:2/702: creat d7/dc/d4c/da0/fdd x:0 0 0 2024-02-07T12:25:59.770 INFO:tasks.workunit.client.0.smithi047.stdout:2/703: dread - d7/dc/d4c/da0/fae zero size 2024-02-07T12:25:59.771 INFO:tasks.workunit.client.0.smithi047.stdout:6/528: mknod d3/d5/d35/d3c/d72/d8c/cb4 0 2024-02-07T12:25:59.772 INFO:tasks.workunit.client.0.smithi047.stdout:1/491: symlink d1/d2a/l96 0 2024-02-07T12:25:59.773 INFO:tasks.workunit.client.0.smithi047.stdout:4/709: sync 2024-02-07T12:25:59.773 INFO:tasks.workunit.client.0.smithi047.stdout:5/654: sync 2024-02-07T12:25:59.773 INFO:tasks.workunit.client.0.smithi047.stdout:4/710: fdatasync d3/f12 0 2024-02-07T12:25:59.773 INFO:tasks.workunit.client.0.smithi047.stdout:4/711: write d3/db1/d37/f5d [312126,94610] 0 2024-02-07T12:25:59.774 INFO:tasks.workunit.client.0.smithi047.stdout:0/447: symlink d19/d1c/d3c/l8d 0 2024-02-07T12:25:59.776 INFO:tasks.workunit.client.0.smithi047.stdout:9/444: dwrite d3/d10/d18/d3d/f37 [0,4194304] 0 2024-02-07T12:25:59.776 INFO:tasks.workunit.client.0.smithi047.stdout:8/657: mkdir d3/d66/d67/d71/d93/dd8 0 2024-02-07T12:25:59.778 INFO:tasks.workunit.client.0.smithi047.stdout:2/704: mkdir d7/dc/d71/dde 0 2024-02-07T12:25:59.778 INFO:tasks.workunit.client.0.smithi047.stdout:2/705: creat d7/dc/d71/fdf x:0 0 0 2024-02-07T12:25:59.779 INFO:tasks.workunit.client.0.smithi047.stdout:6/529: write d3/da/d3b/f7e [513706,130935] 0 2024-02-07T12:25:59.779 INFO:tasks.workunit.client.0.smithi047.stdout:6/530: creat d3/d5/d35/d3c/d90/fb5 x:0 0 0 2024-02-07T12:25:59.779 INFO:tasks.workunit.client.0.smithi047.stdout:6/531: write d3/d5/d35/d3c/d90/fae [2593829,23493] 0 2024-02-07T12:25:59.780 INFO:tasks.workunit.client.0.smithi047.stdout:4/712: creat d3/db1/d37/ff2 x:0 0 0 2024-02-07T12:25:59.781 INFO:tasks.workunit.client.0.smithi047.stdout:9/445: mknod d3/d10/ca4 0 2024-02-07T12:25:59.784 INFO:tasks.workunit.client.0.smithi047.stdout:8/658: link d3/l20 d3/d36/d9d/ld9 0 2024-02-07T12:25:59.784 INFO:tasks.workunit.client.0.smithi047.stdout:0/448: write d19/f6d [3486206,18540] 0 2024-02-07T12:25:59.784 INFO:tasks.workunit.client.0.smithi047.stdout:0/449: dread - d19/d1c/d2c/d49/f79 zero size 2024-02-07T12:25:59.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:25:59 smithi138 ceph-mon[35528]: pgmap v16: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 36 MiB/s rd, 49 MiB/s wr, 207 op/s 2024-02-07T12:25:59.785 INFO:tasks.workunit.client.0.smithi047.stdout:0/450: write d19/d40/d66/f63 [810598,89601] 0 2024-02-07T12:25:59.786 INFO:tasks.workunit.client.0.smithi047.stdout:7/657: rename d0/d4/c6 to d0/df/d74/cd4 0 2024-02-07T12:25:59.790 INFO:tasks.workunit.client.0.smithi047.stdout:2/706: symlink d7/dc/d51/le0 0 2024-02-07T12:25:59.792 INFO:tasks.workunit.client.0.smithi047.stdout:5/655: getdents da/d24/d63/d9c/da3 0 2024-02-07T12:25:59.792 INFO:tasks.workunit.client.0.smithi047.stdout:0/451: dread d19/d40/d66/f63 [0,4194304] 0 2024-02-07T12:25:59.798 INFO:tasks.workunit.client.0.smithi047.stdout:8/659: symlink d3/d66/d67/d71/d93/lda 0 2024-02-07T12:25:59.801 INFO:tasks.workunit.client.0.smithi047.stdout:1/492: rename d1/d15/d2f/d3d/d3e/f57 to d1/d2a/f97 0 2024-02-07T12:25:59.804 INFO:tasks.workunit.client.0.smithi047.stdout:7/658: rmdir d0/d4 39 2024-02-07T12:25:59.806 INFO:tasks.workunit.client.0.smithi047.stdout:9/446: dwrite d3/f51 [0,4194304] 0 2024-02-07T12:25:59.806 INFO:tasks.workunit.client.0.smithi047.stdout:9/447: creat d3/d10/d18/d3b/fa5 x:0 0 0 2024-02-07T12:25:59.806 INFO:tasks.workunit.client.0.smithi047.stdout:9/448: creat d3/d10/d18/d3b/d3c/d5d/fa6 x:0 0 0 2024-02-07T12:25:59.806 INFO:tasks.workunit.client.0.smithi047.stdout:2/707: truncate d7/d48/d72/dbf/fd4 2334991 0 2024-02-07T12:25:59.806 INFO:tasks.workunit.client.0.smithi047.stdout:4/713: dwrite d3/f20 [0,4194304] 0 2024-02-07T12:25:59.811 INFO:tasks.workunit.client.0.smithi047.stdout:5/656: link da/d24/d63/d9a/l40 da/df/ldb 0 2024-02-07T12:25:59.811 INFO:tasks.workunit.client.0.smithi047.stdout:5/657: chown da/df/d16/d25/d33/d55/d80/da6/cc7 28394 1 2024-02-07T12:25:59.814 INFO:tasks.workunit.client.0.smithi047.stdout:6/532: rmdir d3/da/d3b 39 2024-02-07T12:25:59.817 INFO:tasks.workunit.client.0.smithi047.stdout:8/660: creat d3/d36/d50/d30/d9e/da6/fdb x:0 0 0 2024-02-07T12:25:59.817 INFO:tasks.workunit.client.0.smithi047.stdout:8/661: stat d3/d36/d50/fbc 0 2024-02-07T12:25:59.820 INFO:tasks.workunit.client.0.smithi047.stdout:0/452: rename d19/d1c/d24/f59 to d19/d40/d66/f8e 0 2024-02-07T12:25:59.820 INFO:tasks.workunit.client.0.smithi047.stdout:5/658: rename da/df/d16/d41/d57/d6c to da/df/d16/d41/d57/d6c/ddc 22 2024-02-07T12:25:59.822 INFO:tasks.workunit.client.0.smithi047.stdout:1/493: mknod d1/d15/d2f/d3d/d84/c98 0 2024-02-07T12:25:59.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:25:59 smithi047 ceph-mon[28972]: pgmap v16: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 36 MiB/s rd, 49 MiB/s wr, 207 op/s 2024-02-07T12:25:59.825 INFO:tasks.workunit.client.0.smithi047.stdout:7/659: symlink d0/d6f/ld5 0 2024-02-07T12:25:59.833 INFO:tasks.workunit.client.0.smithi047.stdout:8/662: dread d3/d36/d50/d30/d34/f43 [0,4194304] 0 2024-02-07T12:25:59.833 INFO:tasks.workunit.client.0.smithi047.stdout:8/663: creat d3/dbd/fdc x:0 0 0 2024-02-07T12:25:59.833 INFO:tasks.workunit.client.0.smithi047.stdout:8/664: stat d3/d4/l5 0 2024-02-07T12:25:59.833 INFO:tasks.workunit.client.0.smithi047.stdout:8/665: chown d3/d36/d50/fbc 32 1 2024-02-07T12:25:59.833 INFO:tasks.workunit.client.0.smithi047.stdout:8/666: readlink d3/d36/d50/d30/d34/la0 0 2024-02-07T12:25:59.833 INFO:tasks.workunit.client.0.smithi047.stdout:7/660: dread d0/d6f/f9b [0,4194304] 0 2024-02-07T12:25:59.833 INFO:tasks.workunit.client.0.smithi047.stdout:7/661: dread d0/db0/fbd [0,4194304] 0 2024-02-07T12:25:59.834 INFO:tasks.workunit.client.0.smithi047.stdout:5/659: read da/df/d16/d41/f51 [251575,962] 0 2024-02-07T12:25:59.834 INFO:tasks.workunit.client.0.smithi047.stdout:5/660: stat da/df/d16/d25/l4c 0 2024-02-07T12:25:59.834 INFO:tasks.workunit.client.0.smithi047.stdout:9/449: mkdir d3/d10/d18/d3a/da7 0 2024-02-07T12:25:59.834 INFO:tasks.workunit.client.0.smithi047.stdout:9/450: dread - d3/d10/d18/d3d/f83 zero size 2024-02-07T12:25:59.836 INFO:tasks.workunit.client.0.smithi047.stdout:4/714: link d3/l3f d3/d27/dbc/lf3 0 2024-02-07T12:25:59.842 INFO:tasks.workunit.client.0.smithi047.stdout:8/667: dread d3/d4/d4d/fb1 [0,4194304] 0 2024-02-07T12:25:59.843 INFO:tasks.workunit.client.0.smithi047.stdout:0/453: dwrite d19/d1c/d3c/d60/d6f/d70/f76 [0,4194304] 0 2024-02-07T12:25:59.844 INFO:tasks.workunit.client.0.smithi047.stdout:1/494: dwrite d1/d15/d18/d40/f56 [4194304,4194304] 0 2024-02-07T12:25:59.848 INFO:tasks.workunit.client.0.smithi047.stdout:6/533: link d3/da/f49 d3/da/d34/d6d/d9f/fb6 0 2024-02-07T12:25:59.848 INFO:tasks.workunit.client.0.smithi047.stdout:9/451: write d3/d10/d18/f27 [3542968,77315] 0 2024-02-07T12:25:59.848 INFO:tasks.workunit.client.0.smithi047.stdout:9/452: write d3/d10/f24 [3282451,123793] 0 2024-02-07T12:25:59.850 INFO:tasks.workunit.client.0.smithi047.stdout:7/662: symlink d0/d6f/ld6 0 2024-02-07T12:25:59.850 INFO:tasks.workunit.client.0.smithi047.stdout:7/663: chown d0/la5 1253223 1 2024-02-07T12:25:59.850 INFO:tasks.workunit.client.0.smithi047.stdout:6/534: dread d3/da/d3b/d55/f69 [0,4194304] 0 2024-02-07T12:25:59.850 INFO:tasks.workunit.client.0.smithi047.stdout:6/535: chown d3/da/f74 10472 1 2024-02-07T12:25:59.850 INFO:tasks.workunit.client.0.smithi047.stdout:6/536: dread - d3/d5/faf zero size 2024-02-07T12:25:59.850 INFO:tasks.workunit.client.0.smithi047.stdout:5/661: dread da/df/f98 [0,4194304] 0 2024-02-07T12:25:59.851 INFO:tasks.workunit.client.0.smithi047.stdout:4/715: rename d3/d61/d70/d8b/ddb/d66/fca to d3/db1/de5/ff4 0 2024-02-07T12:25:59.855 INFO:tasks.workunit.client.0.smithi047.stdout:8/668: creat d3/d36/d50/d30/d9e/dcb/fdd x:0 0 0 2024-02-07T12:25:59.858 INFO:tasks.workunit.client.0.smithi047.stdout:6/537: dread d3/f18 [0,4194304] 0 2024-02-07T12:25:59.859 INFO:tasks.workunit.client.0.smithi047.stdout:0/454: creat d19/d1c/d24/f8f x:0 0 0 2024-02-07T12:25:59.861 INFO:tasks.workunit.client.0.smithi047.stdout:1/495: symlink d1/d15/d2f/l99 0 2024-02-07T12:25:59.861 INFO:tasks.workunit.client.0.smithi047.stdout:1/496: truncate d1/d15/f79 1247595 0 2024-02-07T12:25:59.861 INFO:tasks.workunit.client.0.smithi047.stdout:1/497: write d1/d15/d30/f6a [1039003,62836] 0 2024-02-07T12:25:59.861 INFO:tasks.workunit.client.0.smithi047.stdout:7/664: dwrite d0/df/d29/d3e/f59 [0,4194304] 0 2024-02-07T12:25:59.865 INFO:tasks.workunit.client.0.smithi047.stdout:5/662: mkdir da/df/d16/d41/d57/ddd 0 2024-02-07T12:25:59.865 INFO:tasks.workunit.client.0.smithi047.stdout:5/663: getdents da/df/d16/dab 0 2024-02-07T12:25:59.865 INFO:tasks.workunit.client.0.smithi047.stdout:5/664: dread - da/df/d16/d25/d71/d68/fa0 zero size 2024-02-07T12:25:59.865 INFO:tasks.workunit.client.0.smithi047.stdout:5/665: stat da/df/fc6 0 2024-02-07T12:25:59.865 INFO:tasks.workunit.client.0.smithi047.stdout:4/716: mknod d3/d61/d70/d83/cf5 0 2024-02-07T12:25:59.865 INFO:tasks.workunit.client.0.smithi047.stdout:4/717: truncate d3/f75 716797 0 2024-02-07T12:25:59.866 INFO:tasks.workunit.client.0.smithi047.stdout:4/718: write d3/d27/d3b/d7d/da2/fd5 [54023,52565] 0 2024-02-07T12:25:59.869 INFO:tasks.workunit.client.0.smithi047.stdout:5/666: write da/df/d16/d25/f50 [2497657,114761] 0 2024-02-07T12:25:59.870 INFO:tasks.workunit.client.0.smithi047.stdout:8/669: unlink d3/d36/d50/d30/f61 0 2024-02-07T12:25:59.870 INFO:tasks.workunit.client.0.smithi047.stdout:8/670: dread - d3/faf zero size 2024-02-07T12:25:59.870 INFO:tasks.workunit.client.0.smithi047.stdout:8/671: fdatasync d3/d66/d67/d6a/f23 0 2024-02-07T12:25:59.871 INFO:tasks.workunit.client.0.smithi047.stdout:6/538: symlink d3/da/d14/d28/d9a/lb7 0 2024-02-07T12:25:59.871 INFO:tasks.workunit.client.0.smithi047.stdout:6/539: write d3/da/d2c/f7c [567307,72842] 0 2024-02-07T12:25:59.873 INFO:tasks.workunit.client.0.smithi047.stdout:1/498: rename d1/d15/f50 to d1/d2a/f9a 0 2024-02-07T12:25:59.873 INFO:tasks.workunit.client.0.smithi047.stdout:1/499: fdatasync d1/d15/d18/f4f 0 2024-02-07T12:25:59.873 INFO:tasks.workunit.client.0.smithi047.stdout:1/500: fdatasync d1/d15/d2f/f6c 0 2024-02-07T12:25:59.876 INFO:tasks.workunit.client.0.smithi047.stdout:7/665: truncate d0/d2f/fc4 2681439 0 2024-02-07T12:25:59.876 INFO:tasks.workunit.client.0.smithi047.stdout:7/666: truncate d0/da8/fca 628736 0 2024-02-07T12:25:59.877 INFO:tasks.workunit.client.0.smithi047.stdout:4/719: dread d3/d61/d43/f53 [0,4194304] 0 2024-02-07T12:25:59.877 INFO:tasks.workunit.client.0.smithi047.stdout:4/720: fdatasync d3/db1/f86 0 2024-02-07T12:25:59.878 INFO:tasks.workunit.client.0.smithi047.stdout:9/453: getdents d3/d10/d18/d3b/d3c/d5d 0 2024-02-07T12:25:59.878 INFO:tasks.workunit.client.0.smithi047.stdout:9/454: creat d3/d10/d18/d3a/fa8 x:0 0 0 2024-02-07T12:25:59.878 INFO:tasks.workunit.client.0.smithi047.stdout:9/455: read - d3/f85 zero size 2024-02-07T12:25:59.878 INFO:tasks.workunit.client.0.smithi047.stdout:9/456: write d3/d10/d4c/f8e [1838533,32696] 0 2024-02-07T12:25:59.879 INFO:tasks.workunit.client.0.smithi047.stdout:0/455: dwrite d19/d1c/d3c/d60/f87 [0,4194304] 0 2024-02-07T12:25:59.882 INFO:tasks.workunit.client.0.smithi047.stdout:5/667: link da/df/d16/d25/d71/d68/lac da/df/d16/d25/d71/dd2/lde 0 2024-02-07T12:25:59.883 INFO:tasks.workunit.client.0.smithi047.stdout:8/672: dread d3/d66/f79 [0,4194304] 0 2024-02-07T12:25:59.883 INFO:tasks.workunit.client.0.smithi047.stdout:6/540: creat d3/d5/d35/d3c/d72/d8c/d91/fb8 x:0 0 0 2024-02-07T12:25:59.888 INFO:tasks.workunit.client.0.smithi047.stdout:0/456: write f1 [3609104,93759] 0 2024-02-07T12:25:59.888 INFO:tasks.workunit.client.0.smithi047.stdout:1/501: rmdir d1/d15/d30/d46/d66 39 2024-02-07T12:25:59.888 INFO:tasks.workunit.client.0.smithi047.stdout:7/667: mkdir d0/df/d29/d31/d40/dd7 0 2024-02-07T12:25:59.888 INFO:tasks.workunit.client.0.smithi047.stdout:7/668: fdatasync d0/df/d29/d31/d40/f8c 0 2024-02-07T12:25:59.896 INFO:tasks.workunit.client.0.smithi047.stdout:5/668: unlink da/df/d16/d25/d33/d55/d80/db2/fd7 0 2024-02-07T12:25:59.898 INFO:tasks.workunit.client.0.smithi047.stdout:6/541: symlink d3/da/d34/lb9 0 2024-02-07T12:25:59.899 INFO:tasks.workunit.client.0.smithi047.stdout:0/457: unlink d19/d40/d66/f63 0 2024-02-07T12:25:59.901 INFO:tasks.workunit.client.0.smithi047.stdout:7/669: mkdir d0/d42/d4d/d67/dd8 0 2024-02-07T12:25:59.901 INFO:tasks.workunit.client.0.smithi047.stdout:1/502: dread d1/d15/d18/d40/f61 [0,4194304] 0 2024-02-07T12:25:59.903 INFO:tasks.workunit.client.0.smithi047.stdout:4/721: mkdir d3/df6 0 2024-02-07T12:25:59.906 INFO:tasks.workunit.client.0.smithi047.stdout:6/542: mkdir d3/da/d34/d6d/d8f/db3/dba 0 2024-02-07T12:25:59.910 INFO:tasks.workunit.client.0.smithi047.stdout:7/670: creat d0/df/d29/d31/fd9 x:0 0 0 2024-02-07T12:25:59.911 INFO:tasks.workunit.client.0.smithi047.stdout:9/457: dwrite d3/d10/d18/d3b/f69 [4194304,4194304] 0 2024-02-07T12:25:59.912 INFO:tasks.workunit.client.0.smithi047.stdout:8/673: dwrite d3/d4/fbb [0,4194304] 0 2024-02-07T12:25:59.912 INFO:tasks.workunit.client.0.smithi047.stdout:1/503: mknod d1/d15/c9b 0 2024-02-07T12:25:59.916 INFO:tasks.workunit.client.0.smithi047.stdout:6/543: symlink d3/da/d3b/d55/lbb 0 2024-02-07T12:25:59.917 INFO:tasks.workunit.client.0.smithi047.stdout:6/544: read d3/d5/d35/d3c/d72/d8c/d95/f4a [1766394,122180] 0 2024-02-07T12:25:59.918 INFO:tasks.workunit.client.0.smithi047.stdout:6/545: write d3/d5/d35/d3c/d72/d8c/d91/fb8 [407413,100714] 0 2024-02-07T12:25:59.918 INFO:tasks.workunit.client.0.smithi047.stdout:6/546: getdents d3/da/d34/d6d/d8f/db3/dba 0 2024-02-07T12:25:59.918 INFO:tasks.workunit.client.0.smithi047.stdout:4/722: truncate d3/d61/d70/d8b/ddb/d66/f7e 2060044 0 2024-02-07T12:25:59.918 INFO:tasks.workunit.client.0.smithi047.stdout:7/671: mknod d0/da8/cda 0 2024-02-07T12:25:59.918 INFO:tasks.workunit.client.0.smithi047.stdout:7/672: chown d0/df/d29/d3e/d4c/d97/laa 0 1 2024-02-07T12:25:59.918 INFO:tasks.workunit.client.0.smithi047.stdout:7/673: chown d0/d42/fa7 104361 1 2024-02-07T12:25:59.918 INFO:tasks.workunit.client.0.smithi047.stdout:7/674: write d0/df/d29/d3e/d4c/f8e [889782,4068] 0 2024-02-07T12:25:59.918 INFO:tasks.workunit.client.0.smithi047.stdout:7/675: chown d0/d42/d4d 1864 1 2024-02-07T12:25:59.919 INFO:tasks.workunit.client.0.smithi047.stdout:7/676: fdatasync d0/d4/f5 0 2024-02-07T12:25:59.919 INFO:tasks.workunit.client.0.smithi047.stdout:9/458: truncate d3/d10/f67 1999708 0 2024-02-07T12:25:59.924 INFO:tasks.workunit.client.0.smithi047.stdout:0/458: dwrite d19/d1c/d3c/d60/d6f/d70/f86 [0,4194304] 0 2024-02-07T12:25:59.924 INFO:tasks.workunit.client.0.smithi047.stdout:8/674: rmdir d3/d36/d50/d30/d9e/dcb/dcd/dd0 0 2024-02-07T12:25:59.924 INFO:tasks.workunit.client.0.smithi047.stdout:8/675: chown d3/d36/d50/d30/d9e/da6/fc8 13389966 1 2024-02-07T12:25:59.926 INFO:tasks.workunit.client.0.smithi047.stdout:6/547: mkdir d3/da/d34/d6d/d8f/db3/dbc 0 2024-02-07T12:25:59.926 INFO:tasks.workunit.client.0.smithi047.stdout:6/548: fdatasync d3/d1e/f66 0 2024-02-07T12:25:59.926 INFO:tasks.workunit.client.0.smithi047.stdout:6/549: truncate d3/da/d14/d28/f3e 1093234 0 2024-02-07T12:25:59.927 INFO:tasks.workunit.client.0.smithi047.stdout:5/669: dwrite da/df/d16/d25/fad [0,4194304] 0 2024-02-07T12:25:59.927 INFO:tasks.workunit.client.0.smithi047.stdout:6/550: read d3/da/d14/d28/f3e [301242,102845] 0 2024-02-07T12:25:59.928 INFO:tasks.workunit.client.0.smithi047.stdout:4/723: symlink d3/d27/dc5/de2/lf7 0 2024-02-07T12:25:59.928 INFO:tasks.workunit.client.0.smithi047.stdout:4/724: dread - d3/db1/de5/fed zero size 2024-02-07T12:25:59.931 INFO:tasks.workunit.client.0.smithi047.stdout:7/677: truncate d0/d42/d4d/f69 302302 0 2024-02-07T12:25:59.931 INFO:tasks.workunit.client.0.smithi047.stdout:7/678: write d0/d4/fe [3264481,98875] 0 2024-02-07T12:25:59.931 INFO:tasks.workunit.client.0.smithi047.stdout:7/679: stat d0/df/d29/d31/l6b 0 2024-02-07T12:25:59.935 INFO:tasks.workunit.client.0.smithi047.stdout:8/676: symlink d3/d66/d67/d6a/lde 0 2024-02-07T12:25:59.936 INFO:tasks.workunit.client.0.smithi047.stdout:1/504: dwrite d1/d15/d2f/f3c [0,4194304] 0 2024-02-07T12:25:59.943 INFO:tasks.workunit.client.0.smithi047.stdout:6/551: symlink d3/da/d14/lbd 0 2024-02-07T12:25:59.943 INFO:tasks.workunit.client.0.smithi047.stdout:6/552: dread - d3/da/d3b/f9d zero size 2024-02-07T12:25:59.943 INFO:tasks.workunit.client.0.smithi047.stdout:6/553: creat d3/d5/d35/d3c/d90/fbe x:0 0 0 2024-02-07T12:25:59.944 INFO:tasks.workunit.client.0.smithi047.stdout:0/459: dwrite d19/d1c/d2b/f88 [0,4194304] 0 2024-02-07T12:25:59.944 INFO:tasks.workunit.client.0.smithi047.stdout:0/460: chown f1 105176688 1 2024-02-07T12:25:59.945 INFO:tasks.workunit.client.0.smithi047.stdout:5/670: dwrite da/f1a [0,4194304] 0 2024-02-07T12:25:59.946 INFO:tasks.workunit.client.0.smithi047.stdout:4/725: unlink d3/d27/l3d 0 2024-02-07T12:25:59.947 INFO:tasks.workunit.client.0.smithi047.stdout:4/726: chown d3 478 1 2024-02-07T12:25:59.951 INFO:tasks.workunit.client.0.smithi047.stdout:0/461: dread d19/d1c/d2c/d49/f68 [0,4194304] 0 2024-02-07T12:25:59.953 INFO:tasks.workunit.client.0.smithi047.stdout:7/680: truncate d0/df/d29/d3e/f56 3543919 0 2024-02-07T12:25:59.953 INFO:tasks.workunit.client.0.smithi047.stdout:7/681: write d0/d42/fb5 [875179,89017] 0 2024-02-07T12:25:59.959 INFO:tasks.workunit.client.0.smithi047.stdout:8/677: rename d3/d4/f98 to d3/d36/d50/d30/d9e/da6/fdf 0 2024-02-07T12:25:59.960 INFO:tasks.workunit.client.0.smithi047.stdout:8/678: chown d3/d4/lf 1799 1 2024-02-07T12:25:59.963 INFO:tasks.workunit.client.0.smithi047.stdout:6/554: symlink d3/da/lbf 0 2024-02-07T12:25:59.963 INFO:tasks.workunit.client.0.smithi047.stdout:6/555: read d3/da/f19 [826390,116759] 0 2024-02-07T12:25:59.968 INFO:tasks.workunit.client.0.smithi047.stdout:5/671: creat da/df/fdf x:0 0 0 2024-02-07T12:25:59.968 INFO:tasks.workunit.client.0.smithi047.stdout:5/672: fdatasync da/df/d16/fc0 0 2024-02-07T12:25:59.970 INFO:tasks.workunit.client.0.smithi047.stdout:7/682: dwrite d0/df/d29/d3e/f60 [0,4194304] 0 2024-02-07T12:25:59.973 INFO:tasks.workunit.client.0.smithi047.stdout:8/679: symlink d3/d4/d59/le0 0 2024-02-07T12:25:59.975 INFO:tasks.workunit.client.0.smithi047.stdout:1/505: link d1/d15/d18/d40/f52 d1/d15/d18/f9c 0 2024-02-07T12:25:59.975 INFO:tasks.workunit.client.0.smithi047.stdout:1/506: chown d1/d15/d2f/d3d/d84/c8e 117100494 1 2024-02-07T12:25:59.978 INFO:tasks.workunit.client.0.smithi047.stdout:6/556: unlink d3/d5/faf 0 2024-02-07T12:25:59.978 INFO:tasks.workunit.client.0.smithi047.stdout:6/557: stat d3/da/d34/f71 0 2024-02-07T12:25:59.979 INFO:tasks.workunit.client.0.smithi047.stdout:4/727: getdents d3/d27/d5e 0 2024-02-07T12:25:59.980 INFO:tasks.workunit.client.0.smithi047.stdout:6/558: dread d3/d5/d35/d3c/d72/d8c/d91/fb8 [0,4194304] 0 2024-02-07T12:25:59.980 INFO:tasks.workunit.client.0.smithi047.stdout:6/559: truncate d3/da/f86 906244 0 2024-02-07T12:25:59.982 INFO:tasks.workunit.client.0.smithi047.stdout:4/728: dread d3/d61/d70/d8b/ddb/d66/f8f [0,4194304] 0 2024-02-07T12:25:59.982 INFO:tasks.workunit.client.0.smithi047.stdout:5/673: dwrite da/df/d16/d25/d71/d68/fa0 [0,4194304] 0 2024-02-07T12:25:59.982 INFO:tasks.workunit.client.0.smithi047.stdout:5/674: chown da/fd 89859564 1 2024-02-07T12:25:59.984 INFO:tasks.workunit.client.0.smithi047.stdout:4/729: dread d3/d61/d70/d83/fc4 [0,4194304] 0 2024-02-07T12:25:59.984 INFO:tasks.workunit.client.0.smithi047.stdout:4/730: dread - d3/d61/d70/d83/fd7 zero size 2024-02-07T12:25:59.984 INFO:tasks.workunit.client.0.smithi047.stdout:4/731: write d3/d27/dc5/fae [1039255,85037] 0 2024-02-07T12:25:59.986 INFO:tasks.workunit.client.0.smithi047.stdout:4/732: dread d3/d61/d70/d8b/ddb/d66/f8f [0,4194304] 0 2024-02-07T12:25:59.989 INFO:tasks.workunit.client.0.smithi047.stdout:6/560: dread d3/d5/d35/d3c/d72/d8c/d95/f4a [0,4194304] 0 2024-02-07T12:25:59.995 INFO:tasks.workunit.client.0.smithi047.stdout:7/683: unlink d0/d4/f7e 0 2024-02-07T12:25:59.995 INFO:tasks.workunit.client.0.smithi047.stdout:7/684: read d0/d42/f4f [3693805,8748] 0 2024-02-07T12:25:59.995 INFO:tasks.workunit.client.0.smithi047.stdout:7/685: chown d0/d42/d4d/d67 31 1 2024-02-07T12:25:59.996 INFO:tasks.workunit.client.0.smithi047.stdout:0/462: rmdir d19/d1c 39 2024-02-07T12:25:59.996 INFO:tasks.workunit.client.0.smithi047.stdout:0/463: write d19/f2d [8608574,75527] 0 2024-02-07T12:25:59.996 INFO:tasks.workunit.client.0.smithi047.stdout:0/464: fdatasync d19/d1c/d2b/d5f/f89 0 2024-02-07T12:25:59.997 INFO:tasks.workunit.client.0.smithi047.stdout:8/680: truncate d3/d36/d50/f5b 468483 0 2024-02-07T12:26:00.000 INFO:tasks.workunit.client.0.smithi047.stdout:1/507: mknod d1/d15/c9d 0 2024-02-07T12:26:00.004 INFO:tasks.workunit.client.0.smithi047.stdout:4/733: dwrite d3/f23 [0,4194304] 0 2024-02-07T12:26:00.004 INFO:tasks.workunit.client.0.smithi047.stdout:8/681: dread d3/d36/d50/d30/d34/f43 [0,4194304] 0 2024-02-07T12:26:00.004 INFO:tasks.workunit.client.0.smithi047.stdout:8/682: fdatasync d3/d66/d67/d71/d93/f95 0 2024-02-07T12:26:00.005 INFO:tasks.workunit.client.0.smithi047.stdout:5/675: mknod da/d24/ce0 0 2024-02-07T12:26:00.005 INFO:tasks.workunit.client.0.smithi047.stdout:5/676: creat da/df/d16/d25/d33/d55/d80/db2/fe1 x:0 0 0 2024-02-07T12:26:00.005 INFO:tasks.workunit.client.0.smithi047.stdout:5/677: chown da/df/d16/d41/d57/ddd 633130 1 2024-02-07T12:26:00.006 INFO:tasks.workunit.client.0.smithi047.stdout:6/561: rmdir d3/da 39 2024-02-07T12:26:00.010 INFO:tasks.workunit.client.0.smithi047.stdout:7/686: mkdir d0/d4/da2/ddb 0 2024-02-07T12:26:00.010 INFO:tasks.workunit.client.0.smithi047.stdout:7/687: fdatasync d0/f47 0 2024-02-07T12:26:00.012 INFO:tasks.workunit.client.0.smithi047.stdout:0/465: mknod d19/d1c/d3c/d60/c90 0 2024-02-07T12:26:00.014 INFO:tasks.workunit.client.0.smithi047.stdout:8/683: symlink d3/d66/d67/d6a/le1 0 2024-02-07T12:26:00.016 INFO:tasks.workunit.client.0.smithi047.stdout:5/678: symlink da/df/d16/d25/d33/d6e/da8/db6/le2 0 2024-02-07T12:26:00.018 INFO:tasks.workunit.client.0.smithi047.stdout:6/562: creat d3/da/d3b/d55/fc0 x:0 0 0 2024-02-07T12:26:00.019 INFO:tasks.workunit.client.0.smithi047.stdout:7/688: creat d0/df/d74/fdc x:0 0 0 2024-02-07T12:26:00.019 INFO:tasks.workunit.client.0.smithi047.stdout:7/689: fsync d0/df/d29/fa6 0 2024-02-07T12:26:00.020 INFO:tasks.workunit.client.0.smithi047.stdout:0/466: creat d19/d1c/d2c/d8c/f91 x:0 0 0 2024-02-07T12:26:00.022 INFO:tasks.workunit.client.0.smithi047.stdout:8/684: mkdir d3/d36/de2 0 2024-02-07T12:26:00.022 INFO:tasks.workunit.client.0.smithi047.stdout:1/508: dwrite d1/d15/d18/f9c [0,4194304] 0 2024-02-07T12:26:00.023 INFO:tasks.workunit.client.0.smithi047.stdout:5/679: mkdir da/d24/de3 0 2024-02-07T12:26:00.023 INFO:tasks.workunit.client.0.smithi047.stdout:4/734: dwrite d3/db1/f5b [0,4194304] 0 2024-02-07T12:26:00.024 INFO:tasks.workunit.client.0.smithi047.stdout:8/685: dread d3/d36/f4b [0,4194304] 0 2024-02-07T12:26:00.024 INFO:tasks.workunit.client.0.smithi047.stdout:8/686: creat d3/dbd/fe3 x:0 0 0 2024-02-07T12:26:00.024 INFO:tasks.workunit.client.0.smithi047.stdout:6/563: mkdir d3/da/d3b/d87/dc1 0 2024-02-07T12:26:00.026 INFO:tasks.workunit.client.0.smithi047.stdout:7/690: symlink d0/df/d29/d3e/d4c/d97/ldd 0 2024-02-07T12:26:00.027 INFO:tasks.workunit.client.0.smithi047.stdout:0/467: creat d19/d1c/f92 x:0 0 0 2024-02-07T12:26:00.028 INFO:tasks.workunit.client.0.smithi047.stdout:1/509: rmdir d1/d15/d18 39 2024-02-07T12:26:00.030 INFO:tasks.workunit.client.0.smithi047.stdout:5/680: truncate da/df/d16/d25/d33/d55/d7c/fcd 1579665 0 2024-02-07T12:26:00.032 INFO:tasks.workunit.client.0.smithi047.stdout:4/735: write d3/d27/dc5/d73/fdc [7950072,57955] 0 2024-02-07T12:26:00.033 INFO:tasks.workunit.client.0.smithi047.stdout:1/510: dread d1/d15/d30/d46/f59 [0,4194304] 0 2024-02-07T12:26:00.034 INFO:tasks.workunit.client.0.smithi047.stdout:6/564: symlink d3/d5/d35/d3c/d72/d8c/d95/lc2 0 2024-02-07T12:26:00.040 INFO:tasks.workunit.client.0.smithi047.stdout:7/691: link d0/dd0/f7f d0/df/d29/d3e/d4c/fde 0 2024-02-07T12:26:00.042 INFO:tasks.workunit.client.0.smithi047.stdout:4/736: link d3/d27/dc5/cc0 d3/df6/cf8 0 2024-02-07T12:26:00.042 INFO:tasks.workunit.client.0.smithi047.stdout:4/737: write d3/d27/dc5/fae [278394,113410] 0 2024-02-07T12:26:00.044 INFO:tasks.workunit.client.0.smithi047.stdout:1/511: mknod d1/d15/d18/d80/c9e 0 2024-02-07T12:26:00.046 INFO:tasks.workunit.client.0.smithi047.stdout:7/692: dread d0/d42/f57 [0,4194304] 0 2024-02-07T12:26:00.046 INFO:tasks.workunit.client.0.smithi047.stdout:7/693: readlink d0/df/d29/d31/l6b 0 2024-02-07T12:26:00.047 INFO:tasks.workunit.client.0.smithi047.stdout:6/565: rename d3/da/d34/f71 to d3/da/d3b/d87/dc1/fc3 0 2024-02-07T12:26:00.048 INFO:tasks.workunit.client.0.smithi047.stdout:6/566: dread d3/da/d14/d28/f3e [0,4194304] 0 2024-02-07T12:26:00.049 INFO:tasks.workunit.client.0.smithi047.stdout:6/567: read d3/da/d34/d6d/d9f/fb6 [81118,12338] 0 2024-02-07T12:26:00.049 INFO:tasks.workunit.client.0.smithi047.stdout:8/687: rmdir d3/d4/d87/da1 0 2024-02-07T12:26:00.050 INFO:tasks.workunit.client.0.smithi047.stdout:4/738: mknod d3/d61/d70/d8b/ddb/d63/dda/cf9 0 2024-02-07T12:26:00.051 INFO:tasks.workunit.client.0.smithi047.stdout:0/468: dwrite d19/d1c/d2b/d5f/f6b [0,4194304] 0 2024-02-07T12:26:00.052 INFO:tasks.workunit.client.0.smithi047.stdout:1/512: rmdir d1/d8a 0 2024-02-07T12:26:00.052 INFO:tasks.workunit.client.0.smithi047.stdout:5/681: dwrite da/d24/fd3 [0,4194304] 0 2024-02-07T12:26:00.055 INFO:tasks.workunit.client.0.smithi047.stdout:7/694: link d0/df/c72 d0/db0/cdf 0 2024-02-07T12:26:00.058 INFO:tasks.workunit.client.0.smithi047.stdout:4/739: mknod d3/d61/d70/d83/d85/cfa 0 2024-02-07T12:26:00.062 INFO:tasks.workunit.client.0.smithi047.stdout:0/469: getdents d19/d1c/d2b/d5f 0 2024-02-07T12:26:00.064 INFO:tasks.workunit.client.0.smithi047.stdout:1/513: symlink d1/d48/d81/l9f 0 2024-02-07T12:26:00.066 INFO:tasks.workunit.client.0.smithi047.stdout:5/682: link da/d24/c27 da/df/d16/ce4 0 2024-02-07T12:26:00.067 INFO:tasks.workunit.client.0.smithi047.stdout:8/688: symlink d3/d36/d50/d30/le4 0 2024-02-07T12:26:00.068 INFO:tasks.workunit.client.0.smithi047.stdout:8/689: dread - d3/faf zero size 2024-02-07T12:26:00.068 INFO:tasks.workunit.client.0.smithi047.stdout:8/690: chown d3/d36/d50/d30/d9e/da6/f64 1304356 1 2024-02-07T12:26:00.068 INFO:tasks.workunit.client.0.smithi047.stdout:4/740: stat d3/ca 0 2024-02-07T12:26:00.068 INFO:tasks.workunit.client.0.smithi047.stdout:0/470: getdents d19/d1c/d24 0 2024-02-07T12:26:00.070 INFO:tasks.workunit.client.0.smithi047.stdout:5/683: rmdir da/df/d16/d41/dd8 0 2024-02-07T12:26:00.072 INFO:tasks.workunit.client.0.smithi047.stdout:8/691: mkdir d3/d36/de2/de5 0 2024-02-07T12:26:00.073 INFO:tasks.workunit.client.0.smithi047.stdout:4/741: rename d3/f23 to d3/d61/d70/d8b/ddb/d63/ffb 0 2024-02-07T12:26:00.075 INFO:tasks.workunit.client.0.smithi047.stdout:6/568: dwrite d3/da/d34/f5a [0,4194304] 0 2024-02-07T12:26:00.078 INFO:tasks.workunit.client.0.smithi047.stdout:6/569: creat d3/da/d14/d28/d46/d94/fc4 x:0 0 0 2024-02-07T12:26:00.078 INFO:tasks.workunit.client.0.smithi047.stdout:1/514: write d1/d15/d30/d46/f7e [3275451,115677] 0 2024-02-07T12:26:00.078 INFO:tasks.workunit.client.0.smithi047.stdout:7/695: dwrite d0/da8/fca [0,4194304] 0 2024-02-07T12:26:00.078 INFO:tasks.workunit.client.0.smithi047.stdout:6/570: write d3/d5/d35/f54 [1773590,43049] 0 2024-02-07T12:26:00.081 INFO:tasks.workunit.client.0.smithi047.stdout:4/742: link d3/d61/d43/f4c d3/ffc 0 2024-02-07T12:26:00.082 INFO:tasks.workunit.client.0.smithi047.stdout:4/743: fdatasync d3/f17 0 2024-02-07T12:26:00.087 INFO:tasks.workunit.client.0.smithi047.stdout:7/696: creat d0/fe0 x:0 0 0 2024-02-07T12:26:00.088 INFO:tasks.workunit.client.0.smithi047.stdout:1/515: mkdir d1/d48/d74/da0 0 2024-02-07T12:26:00.090 INFO:tasks.workunit.client.0.smithi047.stdout:0/471: dwrite d19/f45 [0,4194304] 0 2024-02-07T12:26:00.092 INFO:tasks.workunit.client.0.smithi047.stdout:8/692: dwrite d3/d36/d50/d30/d34/d3e/f86 [0,4194304] 0 2024-02-07T12:26:00.092 INFO:tasks.workunit.client.0.smithi047.stdout:4/744: rename d3/d61/d70/d83/c9c to d3/d61/d70/d8b/ddb/d63/dda/cfd 0 2024-02-07T12:26:00.094 INFO:tasks.workunit.client.0.smithi047.stdout:4/745: dread d3/d61/d70/d8b/ddb/d63/fc3 [0,4194304] 0 2024-02-07T12:26:00.101 INFO:tasks.workunit.client.0.smithi047.stdout:7/697: creat d0/d42/d4d/d67/dd8/fe1 x:0 0 0 2024-02-07T12:26:00.102 INFO:tasks.workunit.client.0.smithi047.stdout:6/571: getdents d3/da/d14/d9e 0 2024-02-07T12:26:00.102 INFO:tasks.workunit.client.0.smithi047.stdout:6/572: fsync d3/da/d14/f2d 0 2024-02-07T12:26:00.102 INFO:tasks.workunit.client.0.smithi047.stdout:6/573: chown d3/da/d3b/d87/dc1 3 1 2024-02-07T12:26:00.102 INFO:tasks.workunit.client.0.smithi047.stdout:6/574: creat d3/d5/d35/d3c/d72/d8c/d91/fc5 x:0 0 0 2024-02-07T12:26:00.103 INFO:tasks.workunit.client.0.smithi047.stdout:6/575: chown d3/da/d34/f41 2985127 1 2024-02-07T12:26:00.104 INFO:tasks.workunit.client.0.smithi047.stdout:7/698: dread d0/db0/fbd [0,4194304] 0 2024-02-07T12:26:00.104 INFO:tasks.workunit.client.0.smithi047.stdout:7/699: readlink d0/d6f/ld6 0 2024-02-07T12:26:00.104 INFO:tasks.workunit.client.0.smithi047.stdout:7/700: write d0/d42/f4f [5324985,82018] 0 2024-02-07T12:26:00.104 INFO:tasks.workunit.client.0.smithi047.stdout:7/701: creat d0/d4/da2/fe2 x:0 0 0 2024-02-07T12:26:00.104 INFO:tasks.workunit.client.0.smithi047.stdout:7/702: chown d0/df/d29/d3e/d4c/fde 7560 1 2024-02-07T12:26:00.104 INFO:tasks.workunit.client.0.smithi047.stdout:7/703: chown d0/d42/fa3 1527426 1 2024-02-07T12:26:00.104 INFO:tasks.workunit.client.0.smithi047.stdout:8/693: dread d3/d66/f7d [0,4194304] 0 2024-02-07T12:26:00.104 INFO:tasks.workunit.client.0.smithi047.stdout:0/472: rename d19/d1c/d3c/d48/f74 to d19/d1c/d3c/d48/f93 0 2024-02-07T12:26:00.107 INFO:tasks.workunit.client.0.smithi047.stdout:1/516: rename d1/d2a/f9a to d1/d15/d2f/d3d/d84/fa1 0 2024-02-07T12:26:00.107 INFO:tasks.workunit.client.0.smithi047.stdout:7/704: fsync d0/d42/f4f 0 2024-02-07T12:26:00.107 INFO:tasks.workunit.client.0.smithi047.stdout:7/705: chown d0/df/d29/d31/l6b 0 1 2024-02-07T12:26:00.107 INFO:tasks.workunit.client.0.smithi047.stdout:7/706: read - d0/df/fce zero size 2024-02-07T12:26:00.108 INFO:tasks.workunit.client.0.smithi047.stdout:4/746: mkdir d3/d61/d70/d8b/ddb/d66/dfe 0 2024-02-07T12:26:00.114 INFO:tasks.workunit.client.0.smithi047.stdout:6/576: symlink d3/da/d14/lc6 0 2024-02-07T12:26:00.114 INFO:tasks.workunit.client.0.smithi047.stdout:6/577: write d3/da/d3b/d55/fc0 [19325,108872] 0 2024-02-07T12:26:00.114 INFO:tasks.workunit.client.0.smithi047.stdout:6/578: write d3/da/d14/f1c [68667,122656] 0 2024-02-07T12:26:00.114 INFO:tasks.workunit.client.0.smithi047.stdout:6/579: fdatasync d3/da/d14/d28/d46/f6c 0 2024-02-07T12:26:00.114 INFO:tasks.workunit.client.0.smithi047.stdout:6/580: readlink d3/da/l38 0 2024-02-07T12:26:00.114 INFO:tasks.workunit.client.0.smithi047.stdout:6/581: read - d3/da/d2c/f8b zero size 2024-02-07T12:26:00.119 INFO:tasks.workunit.client.0.smithi047.stdout:1/517: write d1/d15/d18/f41 [3022615,99899] 0 2024-02-07T12:26:00.122 INFO:tasks.workunit.client.0.smithi047.stdout:8/694: mknod d3/d36/d50/d2a/ce6 0 2024-02-07T12:26:00.123 INFO:tasks.workunit.client.0.smithi047.stdout:8/695: dread - d3/d66/d67/d6a/fd2 zero size 2024-02-07T12:26:00.135 INFO:tasks.workunit.client.0.smithi047.stdout:0/473: dwrite d19/f45 [4194304,4194304] 0 2024-02-07T12:26:00.152 INFO:tasks.workunit.client.0.smithi047.stdout:7/707: dwrite d0/df/d29/f68 [0,4194304] 0 2024-02-07T12:26:00.152 INFO:tasks.workunit.client.0.smithi047.stdout:7/708: readlink d0/df/d29/d31/l93 0 2024-02-07T12:26:00.152 INFO:tasks.workunit.client.0.smithi047.stdout:0/474: dread d19/d1c/d3c/d60/f87 [0,4194304] 0 2024-02-07T12:26:00.153 INFO:tasks.workunit.client.0.smithi047.stdout:7/709: mkdir d0/df/d29/d3e/d4c/d97/de3 0 2024-02-07T12:26:00.156 INFO:tasks.workunit.client.0.smithi047.stdout:6/582: dwrite d3/f18 [0,4194304] 0 2024-02-07T12:26:00.156 INFO:tasks.workunit.client.0.smithi047.stdout:1/518: dwrite d1/d15/d18/f9c [0,4194304] 0 2024-02-07T12:26:00.156 INFO:tasks.workunit.client.0.smithi047.stdout:4/747: dwrite d3/d61/d70/d8b/ddb/d63/f93 [0,4194304] 0 2024-02-07T12:26:00.164 INFO:tasks.workunit.client.0.smithi047.stdout:1/519: rmdir d1/d15/d18 39 2024-02-07T12:26:00.164 INFO:tasks.workunit.client.0.smithi047.stdout:1/520: fsync d1/d15/d18/f2b 0 2024-02-07T12:26:00.166 INFO:tasks.workunit.client.0.smithi047.stdout:6/583: mknod d3/da/d14/d9e/cc7 0 2024-02-07T12:26:00.167 INFO:tasks.workunit.client.0.smithi047.stdout:0/475: write d19/f2e [1444118,75724] 0 2024-02-07T12:26:00.167 INFO:tasks.workunit.client.0.smithi047.stdout:0/476: dread - d19/d1c/d24/f8f zero size 2024-02-07T12:26:00.167 INFO:tasks.workunit.client.0.smithi047.stdout:0/477: chown d19/d1c/d2b 94623 1 2024-02-07T12:26:00.171 INFO:tasks.workunit.client.0.smithi047.stdout:7/710: rename d0/da8 to d0/df/d74/dcd/de4 0 2024-02-07T12:26:00.171 INFO:tasks.workunit.client.0.smithi047.stdout:7/711: chown d0/df/d29/d3e/d4c/d97 1516398 1 2024-02-07T12:26:00.171 INFO:tasks.workunit.client.0.smithi047.stdout:7/712: write d0/df/d29/d31/d40/f49 [3077217,118253] 0 2024-02-07T12:26:00.172 INFO:tasks.workunit.client.0.smithi047.stdout:1/521: symlink d1/d48/d81/la2 0 2024-02-07T12:26:00.173 INFO:tasks.workunit.client.0.smithi047.stdout:0/478: truncate d19/d1c/d24/f35 954465 0 2024-02-07T12:26:00.174 INFO:tasks.workunit.client.0.smithi047.stdout:4/748: getdents d3/db1/de5 0 2024-02-07T12:26:00.174 INFO:tasks.workunit.client.0.smithi047.stdout:4/749: fdatasync d3/d27/f87 0 2024-02-07T12:26:00.175 INFO:tasks.workunit.client.0.smithi047.stdout:1/522: rename d1/d15/d30/f5a to d1/d48/d74/fa3 0 2024-02-07T12:26:00.175 INFO:tasks.workunit.client.0.smithi047.stdout:1/523: read d1/d15/d18/f41 [2901850,97529] 0 2024-02-07T12:26:00.176 INFO:tasks.workunit.client.0.smithi047.stdout:0/479: mknod d19/d40/d66/c94 0 2024-02-07T12:26:00.178 INFO:tasks.workunit.client.0.smithi047.stdout:4/750: unlink d3/d61/fa6 0 2024-02-07T12:26:00.180 INFO:tasks.workunit.client.0.smithi047.stdout:1/524: rmdir d1/d48/d74/da0 0 2024-02-07T12:26:00.180 INFO:tasks.workunit.client.0.smithi047.stdout:1/525: write d1/d15/d18/d65/f92 [360572,52313] 0 2024-02-07T12:26:00.185 INFO:tasks.workunit.client.0.smithi047.stdout:1/526: symlink d1/d15/d2f/d3d/d84/la4 0 2024-02-07T12:26:00.186 INFO:tasks.workunit.client.0.smithi047.stdout:0/480: dread f1 [0,4194304] 0 2024-02-07T12:26:00.194 INFO:tasks.workunit.client.0.smithi047.stdout:4/751: rmdir d3/d61/d70 39 2024-02-07T12:26:00.199 INFO:tasks.workunit.client.0.smithi047.stdout:1/527: rename d1/f21 to d1/d15/d30/fa5 0 2024-02-07T12:26:00.199 INFO:tasks.workunit.client.0.smithi047.stdout:1/528: chown d1/d2a/c31 29452 1 2024-02-07T12:26:00.199 INFO:tasks.workunit.client.0.smithi047.stdout:0/481: write d19/d1c/d2b/d5f/f6b [1116261,54524] 0 2024-02-07T12:26:00.202 INFO:tasks.workunit.client.0.smithi047.stdout:4/752: symlink d3/d27/dc5/de2/lff 0 2024-02-07T12:26:00.203 INFO:tasks.workunit.client.0.smithi047.stdout:4/753: write d3/db1/de5/fed [187196,67962] 0 2024-02-07T12:26:00.203 INFO:tasks.workunit.client.0.smithi047.stdout:4/754: write d3/d61/d70/d8b/ddb/d63/f9e [4398,126325] 0 2024-02-07T12:26:00.205 INFO:tasks.workunit.client.0.smithi047.stdout:1/529: mkdir d1/d37/da6 0 2024-02-07T12:26:00.209 INFO:tasks.workunit.client.0.smithi047.stdout:0/482: mkdir d19/d1c/d3c/d60/d6f/d95 0 2024-02-07T12:26:00.212 INFO:tasks.workunit.client.0.smithi047.stdout:4/755: mkdir d3/d61/d70/d8b/ddb/d63/db3/d100 0 2024-02-07T12:26:00.213 INFO:tasks.workunit.client.0.smithi047.stdout:4/756: fdatasync d3/d61/d70/d83/d85/fd6 0 2024-02-07T12:26:00.215 INFO:tasks.workunit.client.0.smithi047.stdout:4/757: creat d3/d27/dc5/de2/f101 x:0 0 0 2024-02-07T12:26:00.215 INFO:tasks.workunit.client.0.smithi047.stdout:4/758: chown d3/d61/d70/d8b/ddb/db7/ce6 30665 1 2024-02-07T12:26:00.215 INFO:tasks.workunit.client.0.smithi047.stdout:4/759: chown d3/d27/d5e/f9f 15420 1 2024-02-07T12:26:00.215 INFO:tasks.workunit.client.0.smithi047.stdout:4/760: fdatasync d3/d61/d70/d8b/ddb/d66/f80 0 2024-02-07T12:26:00.226 INFO:tasks.workunit.client.0.smithi047.stdout:4/761: rename d3/d27/dc5/de2 to d3/d61/d70/d8b/ddb/d63/db3/d102 0 2024-02-07T12:26:00.226 INFO:tasks.workunit.client.0.smithi047.stdout:4/762: write d3/d27/dbc/fbe [737285,120178] 0 2024-02-07T12:26:00.226 INFO:tasks.workunit.client.0.smithi047.stdout:4/763: unlink d3/d61/d70/d8b/ddb/db7/lbf 0 2024-02-07T12:26:00.227 INFO:tasks.workunit.client.0.smithi047.stdout:4/764: creat d3/d27/dc5/f103 x:0 0 0 2024-02-07T12:26:00.232 INFO:tasks.workunit.client.0.smithi047.stdout:1/530: dwrite d1/d15/d18/d40/f56 [4194304,4194304] 0 2024-02-07T12:26:00.232 INFO:tasks.workunit.client.0.smithi047.stdout:0/483: dwrite d19/d1c/d2c/d49/f79 [0,4194304] 0 2024-02-07T12:26:00.232 INFO:tasks.workunit.client.0.smithi047.stdout:0/484: stat d19/f2d 0 2024-02-07T12:26:00.240 INFO:tasks.workunit.client.0.smithi047.stdout:4/765: write d3/d61/d70/d8b/ddb/d66/f80 [3395207,85681] 0 2024-02-07T12:26:00.240 INFO:tasks.workunit.client.0.smithi047.stdout:4/766: stat d3/f17 0 2024-02-07T12:26:00.242 INFO:tasks.workunit.client.0.smithi047.stdout:4/767: getdents d3/d61/d70/d8b/ddb/d63/db3 0 2024-02-07T12:26:00.242 INFO:tasks.workunit.client.0.smithi047.stdout:4/768: chown d3/c32 17 1 2024-02-07T12:26:00.244 INFO:tasks.workunit.client.0.smithi047.stdout:4/769: symlink d3/d61/d70/d8b/ddb/d66/l104 0 2024-02-07T12:26:00.245 INFO:tasks.workunit.client.0.smithi047.stdout:4/770: stat d3/c16 0 2024-02-07T12:26:00.250 INFO:tasks.workunit.client.0.smithi047.stdout:0/485: dwrite d19/d1c/d2c/d49/f79 [0,4194304] 0 2024-02-07T12:26:00.252 INFO:tasks.workunit.client.0.smithi047.stdout:0/486: mknod d19/d1c/d2b/d5f/c96 0 2024-02-07T12:26:00.253 INFO:tasks.workunit.client.0.smithi047.stdout:0/487: creat d19/d1c/d3c/d60/f97 x:0 0 0 2024-02-07T12:26:00.254 INFO:tasks.workunit.client.0.smithi047.stdout:0/488: write d19/d1c/d24/f2a [5196757,26342] 0 2024-02-07T12:26:00.254 INFO:tasks.workunit.client.0.smithi047.stdout:4/771: write d3/f12 [2722736,50729] 0 2024-02-07T12:26:00.255 INFO:tasks.workunit.client.0.smithi047.stdout:0/489: symlink d19/d1c/d24/l98 0 2024-02-07T12:26:00.255 INFO:tasks.workunit.client.0.smithi047.stdout:0/490: stat d19/d1c/d24/f56 0 2024-02-07T12:26:00.256 INFO:tasks.workunit.client.0.smithi047.stdout:4/772: mknod d3/d27/d3b/d7d/c105 0 2024-02-07T12:26:00.262 INFO:tasks.workunit.client.0.smithi047.stdout:0/491: write f18 [2729736,57049] 0 2024-02-07T12:26:00.283 INFO:tasks.workunit.client.0.smithi047.stdout:4/773: dwrite d3/f6 [0,4194304] 0 2024-02-07T12:26:00.283 INFO:tasks.workunit.client.0.smithi047.stdout:0/492: dwrite d19/d1c/d24/f56 [0,4194304] 0 2024-02-07T12:26:00.284 INFO:tasks.workunit.client.0.smithi047.stdout:4/774: creat d3/f106 x:0 0 0 2024-02-07T12:26:00.284 INFO:tasks.workunit.client.0.smithi047.stdout:4/775: write d3/d61/d70/d8b/ddb/d66/fe0 [1950826,63425] 0 2024-02-07T12:26:00.284 INFO:tasks.workunit.client.0.smithi047.stdout:0/493: creat d19/d40/f99 x:0 0 0 2024-02-07T12:26:00.285 INFO:tasks.workunit.client.0.smithi047.stdout:4/776: getdents d3/d61/d70/d83/d85 0 2024-02-07T12:26:00.285 INFO:tasks.workunit.client.0.smithi047.stdout:4/777: chown d3/db1/de5/fed 25519756 1 2024-02-07T12:26:00.286 INFO:tasks.workunit.client.0.smithi047.stdout:4/778: link d3/d61/d70/d8b/ddb/d63/fc3 d3/d61/d70/d83/f107 0 2024-02-07T12:26:00.287 INFO:tasks.workunit.client.0.smithi047.stdout:4/779: chown d3 94 1 2024-02-07T12:26:00.293 INFO:tasks.workunit.client.0.smithi047.stdout:4/780: dread d3/d61/f60 [0,4194304] 0 2024-02-07T12:26:00.294 INFO:tasks.workunit.client.0.smithi047.stdout:4/781: creat d3/d61/d70/d8b/ddb/d63/f108 x:0 0 0 2024-02-07T12:26:00.294 INFO:tasks.workunit.client.0.smithi047.stdout:4/782: dread - d3/db1/de5/fe8 zero size 2024-02-07T12:26:00.294 INFO:tasks.workunit.client.0.smithi047.stdout:4/783: fsync d3/f5 0 2024-02-07T12:26:00.295 INFO:tasks.workunit.client.0.smithi047.stdout:4/784: readlink d3/d61/d70/d8b/ddb/d66/l49 0 2024-02-07T12:26:00.296 INFO:tasks.workunit.client.0.smithi047.stdout:4/785: symlink d3/d61/d70/d8b/ddb/d63/db3/dd4/l109 0 2024-02-07T12:26:00.298 INFO:tasks.workunit.client.0.smithi047.stdout:4/786: symlink d3/d61/d70/d8b/ddb/d63/db3/l10a 0 2024-02-07T12:26:00.300 INFO:tasks.workunit.client.0.smithi047.stdout:4/787: rename d3/f6 to d3/d27/d5e/f10b 0 2024-02-07T12:26:00.300 INFO:tasks.workunit.client.0.smithi047.stdout:4/788: readlink d3/d27/d5e/l5f 0 2024-02-07T12:26:00.300 INFO:tasks.workunit.client.0.smithi047.stdout:4/789: fsync d3/d61/d70/d8b/ddb/d63/db3/fef 0 2024-02-07T12:26:00.306 INFO:tasks.workunit.client.0.smithi047.stdout:0/494: dwrite d19/d40/d66/f51 [0,4194304] 0 2024-02-07T12:26:00.313 INFO:tasks.workunit.client.0.smithi047.stdout:4/790: dwrite d3/d27/fba [0,4194304] 0 2024-02-07T12:26:00.314 INFO:tasks.workunit.client.0.smithi047.stdout:4/791: fsync d3/d27/d3b/d7d/f82 0 2024-02-07T12:26:00.315 INFO:tasks.workunit.client.0.smithi047.stdout:0/495: dread d19/d1c/d2c/f42 [0,4194304] 0 2024-02-07T12:26:00.315 INFO:tasks.workunit.client.0.smithi047.stdout:4/792: mknod d3/db1/d37/c10c 0 2024-02-07T12:26:00.316 INFO:tasks.workunit.client.0.smithi047.stdout:4/793: creat d3/d61/d70/d83/d85/f10d x:0 0 0 2024-02-07T12:26:00.321 INFO:tasks.workunit.client.0.smithi047.stdout:0/496: write d19/d1c/d2c/d49/f68 [3174982,87968] 0 2024-02-07T12:26:00.325 INFO:tasks.workunit.client.0.smithi047.stdout:4/794: write d3/f4 [3973846,99773] 0 2024-02-07T12:26:00.325 INFO:tasks.workunit.client.0.smithi047.stdout:4/795: read d3/db1/f6e [1203907,117051] 0 2024-02-07T12:26:00.326 INFO:tasks.workunit.client.0.smithi047.stdout:4/796: rename d3/d61/d70/d8b/ddb/d66/f8f to d3/d27/d5e/f10e 0 2024-02-07T12:26:00.342 INFO:tasks.workunit.client.0.smithi047.stdout:4/797: dwrite d3/d61/d70/d8b/ddb/d63/f9e [4194304,4194304] 0 2024-02-07T12:26:00.358 INFO:tasks.workunit.client.0.smithi047.stdout:4/798: dwrite d3/d27/dbc/fe7 [0,4194304] 0 2024-02-07T12:26:00.358 INFO:tasks.workunit.client.0.smithi047.stdout:4/799: write d3/d27/dbc/fd9 [1249200,676] 0 2024-02-07T12:26:00.358 INFO:tasks.workunit.client.0.smithi047.stdout:4/800: dread - d3/db1/de5/fe8 zero size 2024-02-07T12:26:00.360 INFO:tasks.workunit.client.0.smithi047.stdout:4/801: mkdir d3/d27/d5e/d10f 0 2024-02-07T12:26:00.362 INFO:tasks.workunit.client.0.smithi047.stdout:4/802: creat d3/d61/d70/d8b/ddb/db7/f110 x:0 0 0 2024-02-07T12:26:00.362 INFO:tasks.workunit.client.0.smithi047.stdout:4/803: chown d3/d27/d3b/d7d/da2/la5 1107 1 2024-02-07T12:26:00.362 INFO:tasks.workunit.client.0.smithi047.stdout:4/804: creat d3/d27/d5e/dd0/f111 x:0 0 0 2024-02-07T12:26:00.371 INFO:tasks.workunit.client.0.smithi047.stdout:4/805: dread d3/db1/de5/ff4 [0,4194304] 0 2024-02-07T12:26:00.371 INFO:tasks.workunit.client.0.smithi047.stdout:4/806: readlink d3/l1f 0 2024-02-07T12:26:00.385 INFO:tasks.workunit.client.0.smithi047.stdout:4/807: creat d3/d61/d70/d8b/ddb/d63/db3/dd4/f112 x:0 0 0 2024-02-07T12:26:00.386 INFO:tasks.workunit.client.0.smithi047.stdout:4/808: mknod d3/d61/d70/d8b/ddb/c113 0 2024-02-07T12:26:00.387 INFO:tasks.workunit.client.0.smithi047.stdout:4/809: rename d3/d61/l50 to d3/d27/d3b/d7d/l114 0 2024-02-07T12:26:00.387 INFO:tasks.workunit.client.0.smithi047.stdout:4/810: readlink d3/d27/d3b/d7d/da2/la5 0 2024-02-07T12:26:00.390 INFO:tasks.workunit.client.0.smithi047.stdout:4/811: dread d3/d27/dc5/fae [0,4194304] 0 2024-02-07T12:26:00.390 INFO:tasks.workunit.client.0.smithi047.stdout:4/812: chown d3/d27/dc5/c92 0 1 2024-02-07T12:26:00.391 INFO:tasks.workunit.client.0.smithi047.stdout:4/813: stat d3/c32 0 2024-02-07T12:26:00.391 INFO:tasks.workunit.client.0.smithi047.stdout:4/814: read d3/d27/d3b/d7d/da2/fb8 [1228245,31536] 0 2024-02-07T12:26:00.392 INFO:tasks.workunit.client.0.smithi047.stdout:4/815: chown d3/db1/c98 0 1 2024-02-07T12:26:00.393 INFO:tasks.workunit.client.0.smithi047.stdout:4/816: dread d3/d27/d5e/fab [0,4194304] 0 2024-02-07T12:26:00.394 INFO:tasks.workunit.client.0.smithi047.stdout:4/817: creat d3/d61/d70/d8b/ddb/d63/db3/d100/f115 x:0 0 0 2024-02-07T12:26:00.394 INFO:tasks.workunit.client.0.smithi047.stdout:4/818: stat d3/d61/d70/d8b/ddb/db7/fbd 0 2024-02-07T12:26:00.394 INFO:tasks.workunit.client.0.smithi047.stdout:4/819: getdents d3/d61/d70/d8b/ddb/d63/db3/d102 0 2024-02-07T12:26:00.395 INFO:tasks.workunit.client.0.smithi047.stdout:4/820: chown d3/d61/d70/d8b/ddb/l62 1 1 2024-02-07T12:26:00.395 INFO:tasks.workunit.client.0.smithi047.stdout:4/821: creat d3/d61/d70/f116 x:0 0 0 2024-02-07T12:26:00.396 INFO:tasks.workunit.client.0.smithi047.stdout:4/822: unlink d3/db1/d37/da9/dcb/cd1 0 2024-02-07T12:26:00.397 INFO:tasks.workunit.client.0.smithi047.stdout:4/823: symlink d3/d61/d70/d8b/ddb/l117 0 2024-02-07T12:26:00.397 INFO:tasks.workunit.client.0.smithi047.stdout:4/824: fdatasync d3/d61/d70/d8b/ddb/d66/f7e 0 2024-02-07T12:26:00.406 INFO:tasks.workunit.client.0.smithi047.stdout:4/825: dread d3/d61/d70/d8b/ddb/d63/ffb [0,4194304] 0 2024-02-07T12:26:00.407 INFO:tasks.workunit.client.0.smithi047.stdout:4/826: symlink d3/d27/d5e/d10f/l118 0 2024-02-07T12:26:00.407 INFO:tasks.workunit.client.0.smithi047.stdout:4/827: creat d3/d61/d70/d8b/ddb/f119 x:0 0 0 2024-02-07T12:26:00.408 INFO:tasks.workunit.client.0.smithi047.stdout:4/828: mknod d3/d61/c11a 0 2024-02-07T12:26:00.415 INFO:tasks.workunit.client.0.smithi047.stdout:4/829: write d3/d61/d70/d8b/ddb/d63/db3/fef [664338,9703] 0 2024-02-07T12:26:00.415 INFO:tasks.workunit.client.0.smithi047.stdout:4/830: dread - d3/d61/fa1 zero size 2024-02-07T12:26:00.421 INFO:tasks.workunit.client.0.smithi047.stdout:4/831: dread d3/d27/d3b/f88 [0,4194304] 0 2024-02-07T12:26:00.434 INFO:tasks.workunit.client.0.smithi047.stdout:4/832: dwrite d3/d61/d70/d8b/ddb/d63/ffb [4194304,4194304] 0 2024-02-07T12:26:00.436 INFO:tasks.workunit.client.0.smithi047.stdout:4/833: dread d3/d27/d3b/d7d/da2/fd5 [0,4194304] 0 2024-02-07T12:26:00.436 INFO:tasks.workunit.client.0.smithi047.stdout:4/834: creat d3/d61/d70/f11b x:0 0 0 2024-02-07T12:26:00.436 INFO:tasks.workunit.client.0.smithi047.stdout:4/835: fdatasync d3/d61/faa 0 2024-02-07T12:26:00.438 INFO:tasks.workunit.client.0.smithi047.stdout:4/836: symlink d3/d61/d70/d8b/ddb/d63/db3/dd4/l11c 0 2024-02-07T12:26:00.451 INFO:tasks.workunit.client.0.smithi047.stdout:4/837: dwrite d3/d61/d70/d83/f107 [0,4194304] 0 2024-02-07T12:26:00.456 INFO:tasks.workunit.client.0.smithi047.stdout:4/838: dread d3/db1/de5/ff4 [0,4194304] 0 2024-02-07T12:26:00.456 INFO:tasks.workunit.client.0.smithi047.stdout:4/839: write d3/d27/dc5/f103 [493628,17066] 0 2024-02-07T12:26:00.456 INFO:tasks.workunit.client.0.smithi047.stdout:4/840: readlink d3/d27/l6b 0 2024-02-07T12:26:00.456 INFO:tasks.workunit.client.0.smithi047.stdout:4/841: fdatasync d3/d61/faa 0 2024-02-07T12:26:00.456 INFO:tasks.workunit.client.0.smithi047.stdout:4/842: write d3/d27/d5e/dd0/f111 [308596,79696] 0 2024-02-07T12:26:00.457 INFO:tasks.workunit.client.0.smithi047.stdout:4/843: unlink d3/d27/dbc/fbe 0 2024-02-07T12:26:00.457 INFO:tasks.workunit.client.0.smithi047.stdout:4/844: creat d3/d27/dbc/f11d x:0 0 0 2024-02-07T12:26:00.457 INFO:tasks.workunit.client.0.smithi047.stdout:4/845: dread - d3/d61/d70/d8b/ddb/d63/db3/dd4/fdf zero size 2024-02-07T12:26:00.457 INFO:tasks.workunit.client.0.smithi047.stdout:4/846: chown d3/d61/d70/d8b/ddb/d66/l49 3045468 1 2024-02-07T12:26:00.458 INFO:tasks.workunit.client.0.smithi047.stdout:4/847: symlink d3/d27/dd8/l11e 0 2024-02-07T12:26:00.458 INFO:tasks.workunit.client.0.smithi047.stdout:4/848: chown d3/d61/d70/feb 0 1 2024-02-07T12:26:00.459 INFO:tasks.workunit.client.0.smithi047.stdout:4/849: mknod d3/d27/c11f 0 2024-02-07T12:26:00.459 INFO:tasks.workunit.client.0.smithi047.stdout:4/850: mknod d3/d27/d3b/d7d/da2/c120 0 2024-02-07T12:26:00.460 INFO:tasks.workunit.client.0.smithi047.stdout:4/851: getdents d3/d27/d5e 0 2024-02-07T12:26:00.460 INFO:tasks.workunit.client.0.smithi047.stdout:4/852: write d3/d27/d3b/d7d/fb5 [4125579,31141] 0 2024-02-07T12:26:00.460 INFO:tasks.workunit.client.0.smithi047.stdout:4/853: write d3/d61/d70/d83/fc4 [407271,2928] 0 2024-02-07T12:26:00.461 INFO:tasks.workunit.client.0.smithi047.stdout:4/854: creat d3/d61/d70/d8b/ddb/d63/db3/f121 x:0 0 0 2024-02-07T12:26:00.461 INFO:tasks.workunit.client.0.smithi047.stdout:4/855: creat d3/db1/d37/da9/f122 x:0 0 0 2024-02-07T12:26:00.462 INFO:tasks.workunit.client.0.smithi047.stdout:4/856: symlink d3/d61/d70/d8b/ddb/d63/dda/l123 0 2024-02-07T12:26:00.468 INFO:tasks.workunit.client.0.smithi047.stdout:4/857: dread d3/d27/d3b/f72 [0,4194304] 0 2024-02-07T12:26:00.468 INFO:tasks.workunit.client.0.smithi047.stdout:4/858: chown d3/d61/d70/d83/d85/dee/ff0 294265381 1 2024-02-07T12:26:00.469 INFO:tasks.workunit.client.0.smithi047.stdout:4/859: chown d3/d27/d5e 241018 1 2024-02-07T12:26:00.484 INFO:tasks.workunit.client.0.smithi047.stdout:4/860: dwrite d3/db1/f9d [0,4194304] 0 2024-02-07T12:26:00.493 INFO:tasks.workunit.client.0.smithi047.stdout:4/861: dread d3/d61/d70/d8b/ddb/d66/f6f [0,4194304] 0 2024-02-07T12:26:00.500 INFO:tasks.workunit.client.0.smithi047.stdout:4/862: dread d3/d27/d3b/f88 [0,4194304] 0 2024-02-07T12:26:00.501 INFO:tasks.workunit.client.0.smithi047.stdout:4/863: rename d3/db1/d37/da9/dcb/cde to d3/d61/d43/c124 0 2024-02-07T12:26:00.501 INFO:tasks.workunit.client.0.smithi047.stdout:4/864: readlink d3/d61/d70/d83/d85/lc7 0 2024-02-07T12:26:00.502 INFO:tasks.workunit.client.0.smithi047.stdout:4/865: link d3/d27/dc5/d73/f91 d3/db1/f125 0 2024-02-07T12:26:00.503 INFO:tasks.workunit.client.0.smithi047.stdout:4/866: mkdir d3/d27/dd8/d126 0 2024-02-07T12:26:00.503 INFO:tasks.workunit.client.0.smithi047.stdout:4/867: fsync d3/d61/d70/d8b/ddb/d63/f9e 0 2024-02-07T12:26:00.504 INFO:tasks.workunit.client.0.smithi047.stdout:4/868: creat d3/db1/de5/f127 x:0 0 0 2024-02-07T12:26:00.505 INFO:tasks.workunit.client.0.smithi047.stdout:4/869: getdents d3/d27 0 2024-02-07T12:26:00.506 INFO:tasks.workunit.client.0.smithi047.stdout:4/870: mkdir d3/d27/dd8/d128 0 2024-02-07T12:26:00.507 INFO:tasks.workunit.client.0.smithi047.stdout:4/871: fdatasync d3/db1/f9d 0 2024-02-07T12:26:00.662 INFO:tasks.workunit.client.0.smithi047.stdout:2/708: sync 2024-02-07T12:26:00.662 INFO:tasks.workunit.client.0.smithi047.stdout:3/636: sync 2024-02-07T12:26:00.662 INFO:tasks.workunit.client.0.smithi047.stdout:3/637: truncate d12/dc7/d29/d44/f69 4813 0 2024-02-07T12:26:00.662 INFO:tasks.workunit.client.0.smithi047.stdout:2/709: truncate d7/d2d/d5c/d77/d92/f96 1268680 0 2024-02-07T12:26:00.664 INFO:tasks.workunit.client.0.smithi047.stdout:3/638: mknod d12/dc7/d29/d31/d38/d59/d87/dc5/cdc 0 2024-02-07T12:26:00.666 INFO:tasks.workunit.client.0.smithi047.stdout:3/639: unlink d12/c15 0 2024-02-07T12:26:00.668 INFO:tasks.workunit.client.0.smithi047.stdout:3/640: link d12/dc7/d29/l58 d12/d19/d2d/d82/ldd 0 2024-02-07T12:26:00.671 INFO:tasks.workunit.client.0.smithi047.stdout:3/641: creat d12/d19/fde x:0 0 0 2024-02-07T12:26:00.671 INFO:tasks.workunit.client.0.smithi047.stdout:3/642: write d12/dc7/d29/d6f/d93/dba/dbf/fc4 [949179,39964] 0 2024-02-07T12:26:00.679 INFO:tasks.workunit.client.0.smithi047.stdout:2/710: dwrite d7/d48/f7e [4194304,4194304] 0 2024-02-07T12:26:00.680 INFO:tasks.workunit.client.0.smithi047.stdout:2/711: creat d7/dc/d8a/fe1 x:0 0 0 2024-02-07T12:26:00.682 INFO:tasks.workunit.client.0.smithi047.stdout:2/712: creat d7/d2d/d5c/d77/fe2 x:0 0 0 2024-02-07T12:26:00.684 INFO:tasks.workunit.client.0.smithi047.stdout:2/713: mknod d7/d2d/d5c/d77/ce3 0 2024-02-07T12:26:00.687 INFO:tasks.workunit.client.0.smithi047.stdout:2/714: rename d7/d2d/ddc to d7/dc/d4c/de4 0 2024-02-07T12:26:00.690 INFO:tasks.workunit.client.0.smithi047.stdout:3/643: dwrite d12/dc7/d29/d31/f3e [0,4194304] 0 2024-02-07T12:26:00.699 INFO:tasks.workunit.client.0.smithi047.stdout:2/715: dread d7/d48/d72/dbf/fd4 [0,4194304] 0 2024-02-07T12:26:00.701 INFO:tasks.workunit.client.0.smithi047.stdout:2/716: mknod d7/dc/d71/ce5 0 2024-02-07T12:26:00.703 INFO:tasks.workunit.client.0.smithi047.stdout:2/717: rename d7/cad to d7/d2d/d5c/d77/d9b/dc4/ce6 0 2024-02-07T12:26:00.712 INFO:tasks.workunit.client.0.smithi047.stdout:3/644: read d12/dc7/d29/d44/fa1 [3304701,77610] 0 2024-02-07T12:26:00.719 INFO:tasks.workunit.client.0.smithi047.stdout:2/718: dwrite d7/fb [0,4194304] 0 2024-02-07T12:26:00.731 INFO:tasks.workunit.client.0.smithi047.stdout:2/719: dread d7/dc/f84 [0,4194304] 0 2024-02-07T12:26:00.731 INFO:tasks.workunit.client.0.smithi047.stdout:3/645: dwrite d12/d19/d2d/f4e [0,4194304] 0 2024-02-07T12:26:00.732 INFO:tasks.workunit.client.0.smithi047.stdout:3/646: truncate d12/f18 1020786 0 2024-02-07T12:26:00.733 INFO:tasks.workunit.client.0.smithi047.stdout:2/720: link d7/f39 d7/dc/dd6/fe7 0 2024-02-07T12:26:00.733 INFO:tasks.workunit.client.0.smithi047.stdout:2/721: creat d7/d2d/d5c/d77/d9b/dc4/fe8 x:0 0 0 2024-02-07T12:26:00.745 INFO:tasks.workunit.client.0.smithi047.stdout:2/722: write d7/dc/f84 [2581641,106199] 0 2024-02-07T12:26:00.746 INFO:tasks.workunit.client.0.smithi047.stdout:2/723: dread d7/dc/f59 [0,4194304] 0 2024-02-07T12:26:00.746 INFO:tasks.workunit.client.0.smithi047.stdout:2/724: write d7/d2d/f53 [171790,113588] 0 2024-02-07T12:26:00.747 INFO:tasks.workunit.client.0.smithi047.stdout:2/725: truncate d7/d2d/f63 2720511 0 2024-02-07T12:26:00.747 INFO:tasks.workunit.client.0.smithi047.stdout:2/726: readlink d7/d2d/d5c/d77/d9b/la8 0 2024-02-07T12:26:00.748 INFO:tasks.workunit.client.0.smithi047.stdout:2/727: symlink d7/d2d/d5c/le9 0 2024-02-07T12:26:00.750 INFO:tasks.workunit.client.0.smithi047.stdout:2/728: rename d7/dc/d51/le0 to d7/dc/d4c/d65/lea 0 2024-02-07T12:26:00.750 INFO:tasks.workunit.client.0.smithi047.stdout:2/729: truncate d7/dc/d4c/fbe 915877 0 2024-02-07T12:26:00.750 INFO:tasks.workunit.client.0.smithi047.stdout:2/730: write d7/d48/d72/db7/fd1 [243831,66777] 0 2024-02-07T12:26:00.751 INFO:tasks.workunit.client.0.smithi047.stdout:3/647: dwrite d12/dc7/d29/fa4 [0,4194304] 0 2024-02-07T12:26:00.751 INFO:tasks.workunit.client.0.smithi047.stdout:3/648: fdatasync d12/dc7/d29/d31/d38/fbb 0 2024-02-07T12:26:00.751 INFO:tasks.workunit.client.0.smithi047.stdout:3/649: chown d12/d19/f1d 176868351 1 2024-02-07T12:26:00.751 INFO:tasks.workunit.client.0.smithi047.stdout:3/650: readlink d12/dc7/l54 0 2024-02-07T12:26:00.752 INFO:tasks.workunit.client.0.smithi047.stdout:3/651: write d12/dc7/d29/d31/d38/fbb [264314,109191] 0 2024-02-07T12:26:00.756 INFO:tasks.workunit.client.0.smithi047.stdout:3/652: unlink fc 0 2024-02-07T12:26:00.757 INFO:tasks.workunit.client.0.smithi047.stdout:3/653: rmdir d12/d19/d2d/d82 39 2024-02-07T12:26:00.768 INFO:tasks.workunit.client.0.smithi047.stdout:3/654: write d12/dc7/f2c [2772713,119121] 0 2024-02-07T12:26:00.769 INFO:tasks.workunit.client.0.smithi047.stdout:2/731: dwrite d7/f3b [0,4194304] 0 2024-02-07T12:26:00.769 INFO:tasks.workunit.client.0.smithi047.stdout:2/732: fsync d7/dc/f76 0 2024-02-07T12:26:00.769 INFO:tasks.workunit.client.0.smithi047.stdout:2/733: readlink d7/d48/d72/ld2 0 2024-02-07T12:26:00.779 INFO:tasks.workunit.client.0.smithi047.stdout:3/655: dread d12/dc7/d29/f2f [0,4194304] 0 2024-02-07T12:26:00.779 INFO:tasks.workunit.client.0.smithi047.stdout:2/734: dread d7/dc/f2b [0,4194304] 0 2024-02-07T12:26:00.782 INFO:tasks.workunit.client.0.smithi047.stdout:2/735: creat d7/feb x:0 0 0 2024-02-07T12:26:00.790 INFO:tasks.workunit.client.0.smithi047.stdout:2/736: dread d7/d2d/f53 [0,4194304] 0 2024-02-07T12:26:00.792 INFO:tasks.workunit.client.0.smithi047.stdout:2/737: creat d7/d2d/d5c/d77/d9b/fec x:0 0 0 2024-02-07T12:26:00.792 INFO:tasks.workunit.client.0.smithi047.stdout:2/738: truncate d7/dc/f59 171050 0 2024-02-07T12:26:00.801 INFO:tasks.workunit.client.0.smithi047.stdout:3/656: dwrite d12/f76 [0,4194304] 0 2024-02-07T12:26:00.801 INFO:tasks.workunit.client.0.smithi047.stdout:3/657: dread - d12/dc7/d29/fb4 zero size 2024-02-07T12:26:00.802 INFO:tasks.workunit.client.0.smithi047.stdout:3/658: rmdir d12/d19/d2d/d82/dbc 0 2024-02-07T12:26:00.809 INFO:tasks.workunit.client.0.smithi047.stdout:2/739: dwrite d7/d2d/fc0 [0,4194304] 0 2024-02-07T12:26:00.810 INFO:tasks.workunit.client.0.smithi047.stdout:3/659: write d12/d19/d46/f72 [2054215,36390] 0 2024-02-07T12:26:00.810 INFO:tasks.workunit.client.0.smithi047.stdout:3/660: creat d12/d19/fdf x:0 0 0 2024-02-07T12:26:00.810 INFO:tasks.workunit.client.0.smithi047.stdout:3/661: readlink d12/dc7/l54 0 2024-02-07T12:26:00.829 INFO:tasks.workunit.client.0.smithi047.stdout:3/662: dwrite d12/d19/d2d/d52/fa7 [0,4194304] 0 2024-02-07T12:26:00.829 INFO:tasks.workunit.client.0.smithi047.stdout:2/740: dwrite d7/d2d/d7c/fbc [0,4194304] 0 2024-02-07T12:26:00.836 INFO:tasks.workunit.client.0.smithi047.stdout:2/741: rename d7/d2d/d5c/d77/d9b/dc4 to d7/dc/d51/ded 0 2024-02-07T12:26:00.836 INFO:tasks.workunit.client.0.smithi047.stdout:2/742: truncate d7/dc/d51/ded/fd9 248933 0 2024-02-07T12:26:00.837 INFO:tasks.workunit.client.0.smithi047.stdout:2/743: creat d7/dc/dd6/fee x:0 0 0 2024-02-07T12:26:00.837 INFO:tasks.workunit.client.0.smithi047.stdout:2/744: creat d7/dc/d8a/fef x:0 0 0 2024-02-07T12:26:00.837 INFO:tasks.workunit.client.0.smithi047.stdout:2/745: write d7/dc/d51/ded/fe8 [226859,69381] 0 2024-02-07T12:26:00.840 INFO:tasks.workunit.client.0.smithi047.stdout:2/746: mkdir d7/d48/df0 0 2024-02-07T12:26:00.840 INFO:tasks.workunit.client.0.smithi047.stdout:2/747: write d7/d2d/fc0 [5038316,67668] 0 2024-02-07T12:26:00.843 INFO:tasks.workunit.client.0.smithi047.stdout:5/684: sync 2024-02-07T12:26:00.845 INFO:tasks.workunit.client.0.smithi047.stdout:5/685: rmdir da/df/d16/d25/d33/d55/d80/db2 39 2024-02-07T12:26:00.847 INFO:tasks.workunit.client.0.smithi047.stdout:5/686: mknod da/d24/d63/d85/db3/ce5 0 2024-02-07T12:26:00.849 INFO:tasks.workunit.client.0.smithi047.stdout:5/687: rename da/df/d16/d25/d71/f31 to da/df/d16/d25/d71/dd2/fe6 0 2024-02-07T12:26:00.849 INFO:tasks.workunit.client.0.smithi047.stdout:5/688: chown da/df/d16/d41/c6d 55 1 2024-02-07T12:26:00.849 INFO:tasks.workunit.client.0.smithi047.stdout:5/689: dread - da/d24/daa/faf zero size 2024-02-07T12:26:00.850 INFO:tasks.workunit.client.0.smithi047.stdout:5/690: write da/df/d16/d25/d71/d68/f7e [148563,70267] 0 2024-02-07T12:26:00.852 INFO:tasks.workunit.client.0.smithi047.stdout:5/691: rename da/df/f38 to da/df/d16/d25/d33/d6e/fe7 0 2024-02-07T12:26:00.860 INFO:tasks.workunit.client.0.smithi047.stdout:3/663: dwrite d12/d19/d2d/d42/d6b/fd9 [0,4194304] 0 2024-02-07T12:26:00.860 INFO:tasks.workunit.client.0.smithi047.stdout:2/748: dwrite d7/d2d/d5c/d77/d9b/fec [0,4194304] 0 2024-02-07T12:26:00.862 INFO:tasks.workunit.client.0.smithi047.stdout:3/664: mknod d12/dc7/d29/d31/d61/ce0 0 2024-02-07T12:26:00.870 INFO:tasks.workunit.client.0.smithi047.stdout:3/665: rename d12/dc7/d29/d31/c3c to d12/d19/d2d/d42/ce1 0 2024-02-07T12:26:00.870 INFO:tasks.workunit.client.0.smithi047.stdout:2/749: getdents d7/dc/d4c/da0 0 2024-02-07T12:26:00.874 INFO:tasks.workunit.client.0.smithi047.stdout:3/666: dread d12/f3d [0,4194304] 0 2024-02-07T12:26:00.874 INFO:tasks.workunit.client.0.smithi047.stdout:3/667: fdatasync d12/d19/d2d/f63 0 2024-02-07T12:26:00.874 INFO:tasks.workunit.client.0.smithi047.stdout:3/668: fdatasync d12/dc7/d29/f66 0 2024-02-07T12:26:00.874 INFO:tasks.workunit.client.0.smithi047.stdout:2/750: dread d7/d48/d72/dbf/fd4 [0,4194304] 0 2024-02-07T12:26:00.874 INFO:tasks.workunit.client.0.smithi047.stdout:2/751: write d7/dc/d51/ded/fd9 [329906,58191] 0 2024-02-07T12:26:00.875 INFO:tasks.workunit.client.0.smithi047.stdout:3/669: symlink d12/dc7/d29/da9/le2 0 2024-02-07T12:26:00.875 INFO:tasks.workunit.client.0.smithi047.stdout:3/670: write d12/dc7/d29/d31/d7c/fab [3113825,54640] 0 2024-02-07T12:26:00.875 INFO:tasks.workunit.client.0.smithi047.stdout:3/671: write d12/dc7/d29/d31/d7c/fc6 [197080,106095] 0 2024-02-07T12:26:00.875 INFO:tasks.workunit.client.0.smithi047.stdout:2/752: creat d7/dc/d71/dde/ff1 x:0 0 0 2024-02-07T12:26:00.876 INFO:tasks.workunit.client.0.smithi047.stdout:3/672: creat d12/dc7/d29/d6f/d93/dba/dbf/fe3 x:0 0 0 2024-02-07T12:26:00.877 INFO:tasks.workunit.client.0.smithi047.stdout:3/673: symlink d12/dc7/d90/dad/le4 0 2024-02-07T12:26:00.877 INFO:tasks.workunit.client.0.smithi047.stdout:2/753: dread d7/d48/f56 [0,4194304] 0 2024-02-07T12:26:00.878 INFO:tasks.workunit.client.0.smithi047.stdout:3/674: rename d12/dc7/d29/d31/d61/f86 to d12/dc7/d29/d31/d38/d59/fe5 0 2024-02-07T12:26:00.879 INFO:tasks.workunit.client.0.smithi047.stdout:3/675: chown d12/dc7/d29/d44/f88 6 1 2024-02-07T12:26:00.891 INFO:tasks.workunit.client.0.smithi047.stdout:2/754: rmdir d7 39 2024-02-07T12:26:00.892 INFO:tasks.workunit.client.0.smithi047.stdout:2/755: chown d7/dc/d71/lac 29 1 2024-02-07T12:26:00.892 INFO:tasks.workunit.client.0.smithi047.stdout:2/756: readlink d7/dc/l8c 0 2024-02-07T12:26:00.893 INFO:tasks.workunit.client.0.smithi047.stdout:3/676: rename d12/d19/d46 to d12/dc7/d29/d31/d38/d59/de6 0 2024-02-07T12:26:00.895 INFO:tasks.workunit.client.0.smithi047.stdout:2/757: mkdir d7/dc/df2 0 2024-02-07T12:26:00.916 INFO:tasks.workunit.client.0.smithi047.stdout:3/677: dwrite f11 [0,4194304] 0 2024-02-07T12:26:00.916 INFO:tasks.workunit.client.0.smithi047.stdout:3/678: truncate d12/dc7/d29/d44/f88 3398563 0 2024-02-07T12:26:00.917 INFO:tasks.workunit.client.0.smithi047.stdout:3/679: fdatasync d12/d19/d2d/d52/f9e 0 2024-02-07T12:26:00.917 INFO:tasks.workunit.client.0.smithi047.stdout:2/758: dwrite d7/f8 [0,4194304] 0 2024-02-07T12:26:00.918 INFO:tasks.workunit.client.0.smithi047.stdout:3/680: getdents d12 0 2024-02-07T12:26:00.928 INFO:tasks.workunit.client.0.smithi047.stdout:3/681: dread d12/dc7/d29/d31/d38/d59/fe5 [0,4194304] 0 2024-02-07T12:26:00.936 INFO:tasks.workunit.client.0.smithi047.stdout:3/682: write d12/dc7/d90/f91 [237219,8466] 0 2024-02-07T12:26:00.936 INFO:tasks.workunit.client.0.smithi047.stdout:3/683: dread - d12/d19/d37/f98 zero size 2024-02-07T12:26:00.942 INFO:tasks.workunit.client.0.smithi047.stdout:3/684: dread d12/dc7/d29/f66 [0,4194304] 0 2024-02-07T12:26:00.943 INFO:tasks.workunit.client.0.smithi047.stdout:3/685: creat d12/dc7/fe7 x:0 0 0 2024-02-07T12:26:00.943 INFO:tasks.workunit.client.0.smithi047.stdout:3/686: chown d12/d19/d2d/d33/d8d/fb5 362 1 2024-02-07T12:26:00.952 INFO:tasks.workunit.client.0.smithi047.stdout:3/687: write d12/d19/d2d/d52/f9e [3235521,60990] 0 2024-02-07T12:26:00.961 INFO:tasks.workunit.client.0.smithi047.stdout:3/688: dread d12/dc7/d29/d31/f45 [0,4194304] 0 2024-02-07T12:26:00.984 INFO:tasks.workunit.client.0.smithi047.stdout:9/459: sync 2024-02-07T12:26:00.986 INFO:tasks.workunit.client.0.smithi047.stdout:9/460: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/fa9 x:0 0 0 2024-02-07T12:26:00.988 INFO:tasks.workunit.client.0.smithi047.stdout:9/461: creat d3/d10/d18/d3b/d3c/d5d/d68/faa x:0 0 0 2024-02-07T12:26:00.989 INFO:tasks.workunit.client.0.smithi047.stdout:3/689: dwrite d12/dc7/d29/d6f/fb6 [4194304,4194304] 0 2024-02-07T12:26:00.989 INFO:tasks.workunit.client.0.smithi047.stdout:3/690: stat d12/f13 0 2024-02-07T12:26:00.989 INFO:tasks.workunit.client.0.smithi047.stdout:9/462: truncate d3/f19 3585787 0 2024-02-07T12:26:00.991 INFO:tasks.workunit.client.0.smithi047.stdout:9/463: link d3/d10/l56 d3/d10/d11/lab 0 2024-02-07T12:26:00.994 INFO:tasks.workunit.client.0.smithi047.stdout:3/691: write d12/dc7/d29/d44/f69 [1020525,71081] 0 2024-02-07T12:26:01.000 INFO:tasks.workunit.client.0.smithi047.stdout:9/464: read d3/d10/d18/d3d/f37 [1561464,118583] 0 2024-02-07T12:26:01.001 INFO:tasks.workunit.client.0.smithi047.stdout:9/465: link d3/d10/d18/d3b/f57 d3/d10/d18/d3a/da7/fac 0 2024-02-07T12:26:01.001 INFO:tasks.workunit.client.0.smithi047.stdout:9/466: readlink d3/d10/d18/d3b/d3c/d5d/l71 0 2024-02-07T12:26:01.006 INFO:tasks.workunit.client.0.smithi047.stdout:9/467: getdents d3/d10/d18/d3d 0 2024-02-07T12:26:01.006 INFO:tasks.workunit.client.0.smithi047.stdout:3/692: dread d12/d19/d2d/d42/f55 [0,4194304] 0 2024-02-07T12:26:01.006 INFO:tasks.workunit.client.0.smithi047.stdout:3/693: chown d12/dc7/d29/d31/d7c/d8c 13593972 1 2024-02-07T12:26:01.006 INFO:tasks.workunit.client.0.smithi047.stdout:3/694: chown d12/dc7/d29/d6f/d93/dba/dbf 1092 1 2024-02-07T12:26:01.006 INFO:tasks.workunit.client.0.smithi047.stdout:3/695: write d12/dc7/d29/fc1 [915906,19079] 0 2024-02-07T12:26:01.006 INFO:tasks.workunit.client.0.smithi047.stdout:9/468: mkdir d3/d10/d18/d3b/d3c/d5d/d70/dad 0 2024-02-07T12:26:01.010 INFO:tasks.workunit.client.0.smithi047.stdout:3/696: rename d12/dc7/d29/d44/fa1 to d12/dc7/d29/d31/d7c/fe8 0 2024-02-07T12:26:01.010 INFO:tasks.workunit.client.0.smithi047.stdout:3/697: stat d12/d19/d2d/d52 0 2024-02-07T12:26:01.010 INFO:tasks.workunit.client.0.smithi047.stdout:9/469: stat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/l7e 0 2024-02-07T12:26:01.012 INFO:tasks.workunit.client.0.smithi047.stdout:3/698: mkdir d12/dc7/d90/de9 0 2024-02-07T12:26:01.013 INFO:tasks.workunit.client.0.smithi047.stdout:3/699: rmdir d12/dc7/d29/d31/d38/d59/de6 39 2024-02-07T12:26:01.013 INFO:tasks.workunit.client.0.smithi047.stdout:3/700: fsync d12/dc7/d29/d31/d7c/fb3 0 2024-02-07T12:26:01.013 INFO:tasks.workunit.client.0.smithi047.stdout:3/701: fsync d12/d19/fdf 0 2024-02-07T12:26:01.019 INFO:tasks.workunit.client.0.smithi047.stdout:9/470: write d3/d10/d18/f2e [2909020,96273] 0 2024-02-07T12:26:01.029 INFO:tasks.workunit.client.0.smithi047.stdout:3/702: dwrite d12/dc7/d29/d31/d7c/fc6 [0,4194304] 0 2024-02-07T12:26:01.032 INFO:tasks.workunit.client.0.smithi047.stdout:3/703: rmdir d12/dc7/d29/d31/d61 39 2024-02-07T12:26:01.032 INFO:tasks.workunit.client.0.smithi047.stdout:3/704: write d12/dc7/d29/d31/d38/d59/f67 [2456192,33840] 0 2024-02-07T12:26:01.032 INFO:tasks.workunit.client.0.smithi047.stdout:3/705: rmdir d12/dc7/d29/d6f 39 2024-02-07T12:26:01.032 INFO:tasks.workunit.client.0.smithi047.stdout:3/706: stat d12/d19/d37/dd5 0 2024-02-07T12:26:01.037 INFO:tasks.workunit.client.0.smithi047.stdout:9/471: dwrite d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/fa9 [0,4194304] 0 2024-02-07T12:26:01.040 INFO:tasks.workunit.client.0.smithi047.stdout:9/472: mknod d3/d10/d18/d3b/d3c/d47/cae 0 2024-02-07T12:26:01.051 INFO:tasks.workunit.client.0.smithi047.stdout:9/473: write d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/fa9 [2586419,107100] 0 2024-02-07T12:26:01.051 INFO:tasks.workunit.client.0.smithi047.stdout:9/474: mkdir d3/d10/d18/d6e/d9a/daf 0 2024-02-07T12:26:01.051 INFO:tasks.workunit.client.0.smithi047.stdout:9/475: stat d3/f19 0 2024-02-07T12:26:01.053 INFO:tasks.workunit.client.0.smithi047.stdout:3/707: dwrite d12/dc7/f2c [0,4194304] 0 2024-02-07T12:26:01.062 INFO:tasks.workunit.client.0.smithi047.stdout:3/708: dread d12/dc7/d29/d31/d38/f7e [0,4194304] 0 2024-02-07T12:26:01.062 INFO:tasks.workunit.client.0.smithi047.stdout:3/709: chown d12/d19/f5a 250708 1 2024-02-07T12:26:01.062 INFO:tasks.workunit.client.0.smithi047.stdout:3/710: stat d12/dc7/d29 0 2024-02-07T12:26:01.063 INFO:tasks.workunit.client.0.smithi047.stdout:3/711: truncate d12/dc7/fe7 114835 0 2024-02-07T12:26:01.066 INFO:tasks.workunit.client.0.smithi047.stdout:9/476: dwrite d3/d10/d18/d3a/f4a [0,4194304] 0 2024-02-07T12:26:01.073 INFO:tasks.workunit.client.0.smithi047.stdout:9/477: dread d3/d10/d18/f2e [0,4194304] 0 2024-02-07T12:26:01.075 INFO:tasks.workunit.client.0.smithi047.stdout:9/478: unlink d3/d10/d18/d3a/fa8 0 2024-02-07T12:26:01.075 INFO:tasks.workunit.client.0.smithi047.stdout:9/479: fsync d3/d10/d11/f42 0 2024-02-07T12:26:01.076 INFO:tasks.workunit.client.0.smithi047.stdout:9/480: mknod d3/cb0 0 2024-02-07T12:26:01.078 INFO:tasks.workunit.client.0.smithi047.stdout:9/481: link d3/d10/d18/d3b/l41 d3/d10/d18/lb1 0 2024-02-07T12:26:01.078 INFO:tasks.workunit.client.0.smithi047.stdout:9/482: write d3/d10/d4c/f8d [1072249,57445] 0 2024-02-07T12:26:01.078 INFO:tasks.workunit.client.0.smithi047.stdout:9/483: chown d3/d10/d18/d3a/da7 0 1 2024-02-07T12:26:01.078 INFO:tasks.workunit.client.0.smithi047.stdout:9/484: chown d3/d10/d18/d3b/d3c/d5d/d68/faa 32482 1 2024-02-07T12:26:01.078 INFO:tasks.workunit.client.0.smithi047.stdout:9/485: truncate d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/f54 814678 0 2024-02-07T12:26:01.078 INFO:tasks.workunit.client.0.smithi047.stdout:9/486: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/fb2 x:0 0 0 2024-02-07T12:26:01.081 INFO:tasks.workunit.client.0.smithi047.stdout:9/487: rmdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90 39 2024-02-07T12:26:01.082 INFO:tasks.workunit.client.0.smithi047.stdout:9/488: mknod d3/d10/d18/d3d/d79/cb3 0 2024-02-07T12:26:01.085 INFO:tasks.workunit.client.0.smithi047.stdout:9/489: rename d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/fa9 to d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/fb4 0 2024-02-07T12:26:01.085 INFO:tasks.workunit.client.0.smithi047.stdout:9/490: write d3/d10/f60 [805917,15377] 0 2024-02-07T12:26:01.183 INFO:tasks.workunit.client.0.smithi047.stdout:7/713: sync 2024-02-07T12:26:01.183 INFO:tasks.workunit.client.0.smithi047.stdout:6/584: sync 2024-02-07T12:26:01.183 INFO:tasks.workunit.client.0.smithi047.stdout:6/585: write d3/d5/f27 [7390854,3125] 0 2024-02-07T12:26:01.184 INFO:tasks.workunit.client.0.smithi047.stdout:0/497: sync 2024-02-07T12:26:01.184 INFO:tasks.workunit.client.0.smithi047.stdout:4/872: sync 2024-02-07T12:26:01.185 INFO:tasks.workunit.client.0.smithi047.stdout:0/498: chown d19/d1c/d3c/d60/d6f/d70 1048 1 2024-02-07T12:26:01.185 INFO:tasks.workunit.client.0.smithi047.stdout:1/531: sync 2024-02-07T12:26:01.185 INFO:tasks.workunit.client.0.smithi047.stdout:4/873: fsync d3/d61/d43/f53 0 2024-02-07T12:26:01.185 INFO:tasks.workunit.client.0.smithi047.stdout:4/874: read - d3/d61/d70/d83/d85/dee/ff0 zero size 2024-02-07T12:26:01.185 INFO:tasks.workunit.client.0.smithi047.stdout:4/875: dread - d3/d61/d70/d8b/ddb/d63/db3/d100/f115 zero size 2024-02-07T12:26:01.185 INFO:tasks.workunit.client.0.smithi047.stdout:8/696: sync 2024-02-07T12:26:01.185 INFO:tasks.workunit.client.0.smithi047.stdout:7/714: dread d0/df/d29/d3e/d4c/fde [0,4194304] 0 2024-02-07T12:26:01.185 INFO:tasks.workunit.client.0.smithi047.stdout:7/715: chown d0/df/d29/d31/f99 62104 1 2024-02-07T12:26:01.185 INFO:tasks.workunit.client.0.smithi047.stdout:7/716: creat d0/df/fe5 x:0 0 0 2024-02-07T12:26:01.185 INFO:tasks.workunit.client.0.smithi047.stdout:7/717: truncate d0/df/d74/fdc 192095 0 2024-02-07T12:26:01.187 INFO:tasks.workunit.client.0.smithi047.stdout:0/499: getdents d19/d1c/d3c/d37 0 2024-02-07T12:26:01.188 INFO:tasks.workunit.client.0.smithi047.stdout:8/697: creat d3/d36/d50/d2a/fe7 x:0 0 0 2024-02-07T12:26:01.191 INFO:tasks.workunit.client.0.smithi047.stdout:8/698: mknod d3/d36/d9d/dbe/ce8 0 2024-02-07T12:26:01.191 INFO:tasks.workunit.client.0.smithi047.stdout:8/699: dread - d3/d36/d50/d30/d9e/da6/fb6 zero size 2024-02-07T12:26:01.195 INFO:tasks.workunit.client.0.smithi047.stdout:8/700: unlink d3/d4/d4d/dc0/fd6 0 2024-02-07T12:26:01.195 INFO:tasks.workunit.client.0.smithi047.stdout:8/701: dread - d3/d4/d4d/fc5 zero size 2024-02-07T12:26:01.198 INFO:tasks.workunit.client.0.smithi047.stdout:6/586: dread d3/f18 [0,4194304] 0 2024-02-07T12:26:01.199 INFO:tasks.workunit.client.0.smithi047.stdout:1/532: dread d1/d15/d18/f4f [0,4194304] 0 2024-02-07T12:26:01.199 INFO:tasks.workunit.client.0.smithi047.stdout:1/533: fsync d1/d15/d30/f6a 0 2024-02-07T12:26:01.201 INFO:tasks.workunit.client.0.smithi047.stdout:1/534: truncate d1/d15/d2f/f3c 1064496 0 2024-02-07T12:26:01.201 INFO:tasks.workunit.client.0.smithi047.stdout:1/535: truncate d1/f5e 270768 0 2024-02-07T12:26:01.216 INFO:tasks.workunit.client.0.smithi047.stdout:1/536: dread d1/f22 [0,4194304] 0 2024-02-07T12:26:01.224 INFO:tasks.workunit.client.0.smithi047.stdout:7/718: dwrite d0/d42/d4d/d67/f79 [0,4194304] 0 2024-02-07T12:26:01.224 INFO:tasks.workunit.client.0.smithi047.stdout:7/719: write d0/df/d29/d31/f99 [562160,5878] 0 2024-02-07T12:26:01.228 INFO:tasks.workunit.client.0.smithi047.stdout:7/720: mknod d0/dd0/ce6 0 2024-02-07T12:26:01.228 INFO:tasks.workunit.client.0.smithi047.stdout:8/702: dwrite d3/d36/d50/d28/fa3 [0,4194304] 0 2024-02-07T12:26:01.229 INFO:tasks.workunit.client.0.smithi047.stdout:6/587: dwrite d3/da/d14/f88 [0,4194304] 0 2024-02-07T12:26:01.229 INFO:tasks.workunit.client.0.smithi047.stdout:6/588: chown d3/da/d34/f5a 16 1 2024-02-07T12:26:01.235 INFO:tasks.workunit.client.0.smithi047.stdout:1/537: dwrite d1/d15/d18/f9c [0,4194304] 0 2024-02-07T12:26:01.235 INFO:tasks.workunit.client.0.smithi047.stdout:1/538: fsync d1/fe 0 2024-02-07T12:26:01.235 INFO:tasks.workunit.client.0.smithi047.stdout:1/539: fdatasync d1/d15/d18/f9c 0 2024-02-07T12:26:01.236 INFO:tasks.workunit.client.0.smithi047.stdout:1/540: rmdir d1/d37 39 2024-02-07T12:26:01.248 INFO:tasks.workunit.client.0.smithi047.stdout:1/541: dread d1/d15/d30/d46/d4c/f6d [0,4194304] 0 2024-02-07T12:26:01.254 INFO:tasks.workunit.client.0.smithi047.stdout:1/542: rename d1/d15/d18 to d1/d6e/d75/da7 0 2024-02-07T12:26:01.254 INFO:tasks.workunit.client.0.smithi047.stdout:1/543: dread - d1/d15/d2f/d3d/f8b zero size 2024-02-07T12:26:01.254 INFO:tasks.workunit.client.0.smithi047.stdout:1/544: chown d1/c2c 715 1 2024-02-07T12:26:01.258 INFO:tasks.workunit.client.0.smithi047.stdout:6/589: dwrite d3/da/d2c/d42/f57 [4194304,4194304] 0 2024-02-07T12:26:01.259 INFO:tasks.workunit.client.0.smithi047.stdout:7/721: dwrite d0/d42/d4d/d67/f79 [0,4194304] 0 2024-02-07T12:26:01.261 INFO:tasks.workunit.client.0.smithi047.stdout:6/590: rename d3/d5/d35/f4f to d3/da/d3b/d52/fc8 0 2024-02-07T12:26:01.261 INFO:tasks.workunit.client.0.smithi047.stdout:6/591: write d3/da/d2c/d42/f7b [1752231,20073] 0 2024-02-07T12:26:01.261 INFO:tasks.workunit.client.0.smithi047.stdout:6/592: chown d3/d5/f26 20982988 1 2024-02-07T12:26:01.263 INFO:tasks.workunit.client.0.smithi047.stdout:7/722: symlink d0/d4/da2/le7 0 2024-02-07T12:26:01.264 INFO:tasks.workunit.client.0.smithi047.stdout:7/723: symlink d0/d42/le8 0 2024-02-07T12:26:01.265 INFO:tasks.workunit.client.0.smithi047.stdout:1/545: read d1/d15/d2f/f6c [1183998,10465] 0 2024-02-07T12:26:01.266 INFO:tasks.workunit.client.0.smithi047.stdout:6/593: getdents d3/da/d3b/d55 0 2024-02-07T12:26:01.272 INFO:tasks.workunit.client.0.smithi047.stdout:1/546: dread d1/d6e/d75/da7/f27 [0,4194304] 0 2024-02-07T12:26:01.272 INFO:tasks.workunit.client.0.smithi047.stdout:1/547: creat d1/d15/d2f/d3d/d84/fa8 x:0 0 0 2024-02-07T12:26:01.274 INFO:tasks.workunit.client.0.smithi047.stdout:7/724: mkdir d0/d42/d4d/de9 0 2024-02-07T12:26:01.274 INFO:tasks.workunit.client.0.smithi047.stdout:7/725: fdatasync d0/df/f11 0 2024-02-07T12:26:01.278 INFO:tasks.workunit.client.0.smithi047.stdout:7/726: link d0/d42/fcc d0/d4/da2/ddb/fea 0 2024-02-07T12:26:01.278 INFO:tasks.workunit.client.0.smithi047.stdout:7/727: chown d0/c6c 2952504 1 2024-02-07T12:26:01.282 INFO:tasks.workunit.client.0.smithi047.stdout:7/728: symlink d0/leb 0 2024-02-07T12:26:01.284 INFO:tasks.workunit.client.0.smithi047.stdout:7/729: link d0/dd0/cae d0/df/d29/d3e/d4c/d97/de3/cec 0 2024-02-07T12:26:01.286 INFO:tasks.workunit.client.0.smithi047.stdout:7/730: creat d0/d42/fed x:0 0 0 2024-02-07T12:26:01.286 INFO:tasks.workunit.client.0.smithi047.stdout:7/731: write d0/d4/f17 [2679889,43221] 0 2024-02-07T12:26:01.287 INFO:tasks.workunit.client.0.smithi047.stdout:7/732: mkdir d0/df/dd1/dee 0 2024-02-07T12:26:01.287 INFO:tasks.workunit.client.0.smithi047.stdout:7/733: read d0/d4/da2/fba [42499,124325] 0 2024-02-07T12:26:01.289 INFO:tasks.workunit.client.0.smithi047.stdout:7/734: link d0/df/d74/c8d d0/df/d29/d3e/d4c/d97/cef 0 2024-02-07T12:26:01.290 INFO:tasks.workunit.client.0.smithi047.stdout:6/594: dwrite d3/d5/d35/d3c/d72/d8c/d91/fb8 [0,4194304] 0 2024-02-07T12:26:01.290 INFO:tasks.workunit.client.0.smithi047.stdout:6/595: fdatasync d3/da/d2c/f2e 0 2024-02-07T12:26:01.290 INFO:tasks.workunit.client.0.smithi047.stdout:6/596: fsync d3/da/d2c/f2e 0 2024-02-07T12:26:01.294 INFO:tasks.workunit.client.0.smithi047.stdout:6/597: getdents d3/da/d14/d28/d46 0 2024-02-07T12:26:01.296 INFO:tasks.workunit.client.0.smithi047.stdout:6/598: truncate d3/da/d34/f5a 839684 0 2024-02-07T12:26:01.296 INFO:tasks.workunit.client.0.smithi047.stdout:6/599: creat d3/da/d14/d28/d46/fc9 x:0 0 0 2024-02-07T12:26:01.303 INFO:tasks.workunit.client.0.smithi047.stdout:7/735: dread d0/df/d29/d3e/f60 [0,4194304] 0 2024-02-07T12:26:01.304 INFO:tasks.workunit.client.0.smithi047.stdout:7/736: mkdir d0/d2f/df0 0 2024-02-07T12:26:01.304 INFO:tasks.workunit.client.0.smithi047.stdout:7/737: write d0/d4/da2/fe2 [448959,19681] 0 2024-02-07T12:26:01.325 INFO:tasks.workunit.client.0.smithi047.stdout:6/600: dwrite d3/da/f49 [0,4194304] 0 2024-02-07T12:26:01.326 INFO:tasks.workunit.client.0.smithi047.stdout:6/601: chown d3/da/f74 27363705 1 2024-02-07T12:26:01.326 INFO:tasks.workunit.client.0.smithi047.stdout:7/738: dwrite d0/df/d29/d3e/d4c/f8e [0,4194304] 0 2024-02-07T12:26:01.330 INFO:tasks.workunit.client.0.smithi047.stdout:7/739: rename d0/df/d29/d3e/d4c/d97/fc3 to d0/df/d74/ff1 0 2024-02-07T12:26:01.335 INFO:tasks.workunit.client.0.smithi047.stdout:6/602: write d3/d5/f27 [3725963,74137] 0 2024-02-07T12:26:01.335 INFO:tasks.workunit.client.0.smithi047.stdout:6/603: write d3/d5/d35/d3c/d72/d8c/d91/fc5 [666461,61472] 0 2024-02-07T12:26:01.339 INFO:tasks.workunit.client.0.smithi047.stdout:7/740: read d0/d4/da2/ddb/fea [6085664,126526] 0 2024-02-07T12:26:01.339 INFO:tasks.workunit.client.0.smithi047.stdout:7/741: chown d0/d6f/f71 307614690 1 2024-02-07T12:26:01.352 INFO:tasks.workunit.client.0.smithi047.stdout:6/604: dwrite d3/da/f83 [0,4194304] 0 2024-02-07T12:26:01.363 INFO:tasks.workunit.client.0.smithi047.stdout:7/742: dwrite d0/df/d29/d31/f34 [0,4194304] 0 2024-02-07T12:26:01.366 INFO:tasks.workunit.client.0.smithi047.stdout:7/743: rmdir d0/df/dd1 39 2024-02-07T12:26:01.366 INFO:tasks.workunit.client.0.smithi047.stdout:7/744: fsync d0/df/d29/d3e/f43 0 2024-02-07T12:26:01.366 INFO:tasks.workunit.client.0.smithi047.stdout:6/605: dwrite d3/da/d2c/d47/f98 [0,4194304] 0 2024-02-07T12:26:01.369 INFO:tasks.workunit.client.0.smithi047.stdout:7/745: link d0/df/d29/d31/c84 d0/db0/cf2 0 2024-02-07T12:26:01.370 INFO:tasks.workunit.client.0.smithi047.stdout:6/606: symlink d3/da/d2c/lca 0 2024-02-07T12:26:01.370 INFO:tasks.workunit.client.0.smithi047.stdout:6/607: fdatasync d3/da/d2c/f8b 0 2024-02-07T12:26:01.371 INFO:tasks.workunit.client.0.smithi047.stdout:6/608: read - d3/d5/d35/d3c/d90/f97 zero size 2024-02-07T12:26:01.371 INFO:tasks.workunit.client.0.smithi047.stdout:6/609: dread - d3/d5/fb0 zero size 2024-02-07T12:26:01.371 INFO:tasks.workunit.client.0.smithi047.stdout:7/746: getdents d0/dd0 0 2024-02-07T12:26:01.385 INFO:tasks.workunit.client.0.smithi047.stdout:6/610: mknod d3/da/d3b/d87/dc1/ccb 0 2024-02-07T12:26:01.385 INFO:tasks.workunit.client.0.smithi047.stdout:7/747: truncate d0/df/d29/d31/d40/f8c 2083766 0 2024-02-07T12:26:01.386 INFO:tasks.workunit.client.0.smithi047.stdout:7/748: chown d0/df/d29/d31/d40/c5c 1 1 2024-02-07T12:26:01.386 INFO:tasks.workunit.client.0.smithi047.stdout:7/749: write d0/fa4 [252429,129206] 0 2024-02-07T12:26:01.386 INFO:tasks.workunit.client.0.smithi047.stdout:7/750: chown d0/db0/fbd 23 1 2024-02-07T12:26:01.386 INFO:tasks.workunit.client.0.smithi047.stdout:7/751: dread - d0/d2f/fc8 zero size 2024-02-07T12:26:01.386 INFO:tasks.workunit.client.0.smithi047.stdout:6/611: symlink d3/da/d14/d28/lcc 0 2024-02-07T12:26:01.386 INFO:tasks.workunit.client.0.smithi047.stdout:7/752: creat d0/d42/d4d/ff3 x:0 0 0 2024-02-07T12:26:01.387 INFO:tasks.workunit.client.0.smithi047.stdout:6/612: unlink d3/d1e/f66 0 2024-02-07T12:26:01.391 INFO:tasks.workunit.client.0.smithi047.stdout:7/753: mknod d0/d6f/cf4 0 2024-02-07T12:26:01.401 INFO:tasks.workunit.client.0.smithi047.stdout:7/754: rename d0/d6f to d0/df/d74/df5 0 2024-02-07T12:26:01.402 INFO:tasks.workunit.client.0.smithi047.stdout:7/755: truncate d0/df/d29/d31/d40/f49 1426989 0 2024-02-07T12:26:01.404 INFO:tasks.workunit.client.0.smithi047.stdout:6/613: dwrite d3/d5/f13 [0,4194304] 0 2024-02-07T12:26:01.404 INFO:tasks.workunit.client.0.smithi047.stdout:7/756: symlink d0/df/d29/lf6 0 2024-02-07T12:26:01.404 INFO:tasks.workunit.client.0.smithi047.stdout:7/757: creat d0/df/d29/d31/ff7 x:0 0 0 2024-02-07T12:26:01.404 INFO:tasks.workunit.client.0.smithi047.stdout:7/758: write d0/df/d29/d3e/f43 [1231258,66572] 0 2024-02-07T12:26:01.404 INFO:tasks.workunit.client.0.smithi047.stdout:7/759: truncate d0/f47 4520167 0 2024-02-07T12:26:01.406 INFO:tasks.workunit.client.0.smithi047.stdout:7/760: dread d0/d4/da2/fba [0,4194304] 0 2024-02-07T12:26:01.407 INFO:tasks.workunit.client.0.smithi047.stdout:7/761: symlink d0/d2f/df0/lf8 0 2024-02-07T12:26:01.426 INFO:tasks.workunit.client.0.smithi047.stdout:6/614: dwrite d3/da/f83 [4194304,4194304] 0 2024-02-07T12:26:01.426 INFO:tasks.workunit.client.0.smithi047.stdout:7/762: dwrite d0/d4/da2/ddb/fea [8388608,4194304] 0 2024-02-07T12:26:01.428 INFO:tasks.workunit.client.0.smithi047.stdout:6/615: rmdir d3/da/d34/d6d/d9f 39 2024-02-07T12:26:01.428 INFO:tasks.workunit.client.0.smithi047.stdout:6/616: chown d3/d5/l50 2 1 2024-02-07T12:26:01.428 INFO:tasks.workunit.client.0.smithi047.stdout:6/617: stat d3/da/d34/f41 0 2024-02-07T12:26:01.428 INFO:tasks.workunit.client.0.smithi047.stdout:6/618: write d3/da/d3b/d52/f81 [306794,106437] 0 2024-02-07T12:26:01.428 INFO:tasks.workunit.client.0.smithi047.stdout:7/763: truncate d0/df/d29/d3e/d4c/f8e 3271169 0 2024-02-07T12:26:01.430 INFO:tasks.workunit.client.0.smithi047.stdout:6/619: mknod d3/da/d14/d9e/ccd 0 2024-02-07T12:26:01.431 INFO:tasks.workunit.client.0.smithi047.stdout:6/620: creat d3/d5/d35/d3c/d72/fce x:0 0 0 2024-02-07T12:26:01.433 INFO:tasks.workunit.client.0.smithi047.stdout:6/621: symlink d3/da/d14/d28/lcf 0 2024-02-07T12:26:01.435 INFO:tasks.workunit.client.0.smithi047.stdout:6/622: unlink d3/da/d3b/c5f 0 2024-02-07T12:26:01.435 INFO:tasks.workunit.client.0.smithi047.stdout:6/623: write d3/d5/f26 [357502,17161] 0 2024-02-07T12:26:01.435 INFO:tasks.workunit.client.0.smithi047.stdout:7/764: dread d0/df/d29/d3e/f59 [0,4194304] 0 2024-02-07T12:26:01.435 INFO:tasks.workunit.client.0.smithi047.stdout:7/765: fsync d0/df/d29/d3e/f46 0 2024-02-07T12:26:01.435 INFO:tasks.workunit.client.0.smithi047.stdout:7/766: dread - d0/df/d29/d31/ff7 zero size 2024-02-07T12:26:01.436 INFO:tasks.workunit.client.0.smithi047.stdout:7/767: read d0/d42/d4d/f69 [219603,83434] 0 2024-02-07T12:26:01.440 INFO:tasks.workunit.client.0.smithi047.stdout:6/624: rmdir d3/da/d34/d6d/d8f/db3/dba 0 2024-02-07T12:26:01.441 INFO:tasks.workunit.client.0.smithi047.stdout:6/625: mknod d3/d5/d35/d3c/d72/d8c/d91/cd0 0 2024-02-07T12:26:01.444 INFO:tasks.workunit.client.0.smithi047.stdout:6/626: rename d3/da/d14/d28/d46/d94/fc4 to d3/da/da9/fd1 0 2024-02-07T12:26:01.445 INFO:tasks.workunit.client.0.smithi047.stdout:6/627: truncate d3/d5/d35/d3c/d72/fce 542218 0 2024-02-07T12:26:01.446 INFO:tasks.workunit.client.0.smithi047.stdout:6/628: link d3/da/d2c/d42/f57 d3/da/da9/fd2 0 2024-02-07T12:26:01.446 INFO:tasks.workunit.client.0.smithi047.stdout:6/629: dread - d3/da/da9/fd1 zero size 2024-02-07T12:26:01.468 INFO:tasks.workunit.client.0.smithi047.stdout:6/630: dwrite d3/da/d14/d28/d46/f6c [0,4194304] 0 2024-02-07T12:26:01.468 INFO:tasks.workunit.client.0.smithi047.stdout:6/631: stat d3/da/d2c/d42/ca4 0 2024-02-07T12:26:01.468 INFO:tasks.workunit.client.0.smithi047.stdout:6/632: readlink d3/d5/d35/laa 0 2024-02-07T12:26:01.470 INFO:tasks.workunit.client.0.smithi047.stdout:6/633: mkdir d3/da/d34/d6d/d9f/dd3 0 2024-02-07T12:26:01.473 INFO:tasks.workunit.client.0.smithi047.stdout:6/634: rename d3/da/d3b/d52 to d3/d5/d35/d3c/dd4 0 2024-02-07T12:26:01.492 INFO:tasks.workunit.client.0.smithi047.stdout:6/635: dwrite d3/d5/d35/d3c/dd4/f67 [0,4194304] 0 2024-02-07T12:26:01.494 INFO:tasks.workunit.client.0.smithi047.stdout:6/636: rmdir d3/da/da9 39 2024-02-07T12:26:01.496 INFO:tasks.workunit.client.0.smithi047.stdout:6/637: rmdir d3/d5/d35/d3c/d72/d8c/d95 39 2024-02-07T12:26:01.496 INFO:tasks.workunit.client.0.smithi047.stdout:6/638: chown d3/d5/f13 6962054 1 2024-02-07T12:26:01.496 INFO:tasks.workunit.client.0.smithi047.stdout:6/639: fsync d3/da/d14/d28/f3e 0 2024-02-07T12:26:01.497 INFO:tasks.workunit.client.0.smithi047.stdout:6/640: getdents d3/da/d34 0 2024-02-07T12:26:01.500 INFO:tasks.workunit.client.0.smithi047.stdout:6/641: truncate d3/d5/d35/d3c/dd4/fc8 2827890 0 2024-02-07T12:26:01.500 INFO:tasks.workunit.client.0.smithi047.stdout:6/642: write d3/d5/d35/d3c/d90/f97 [129811,93544] 0 2024-02-07T12:26:01.504 INFO:tasks.workunit.client.0.smithi047.stdout:5/692: sync 2024-02-07T12:26:01.504 INFO:tasks.workunit.client.0.smithi047.stdout:5/693: truncate da/df/d16/d25/d71/d68/f9b 4226541 0 2024-02-07T12:26:01.505 INFO:tasks.workunit.client.0.smithi047.stdout:5/694: rename da/d24/c37 to da/df/d16/d41/d57/d6c/ce8 0 2024-02-07T12:26:01.506 INFO:tasks.workunit.client.0.smithi047.stdout:5/695: rmdir da/d24 39 2024-02-07T12:26:01.507 INFO:tasks.workunit.client.0.smithi047.stdout:5/696: truncate da/fd 2449413 0 2024-02-07T12:26:01.507 INFO:tasks.workunit.client.0.smithi047.stdout:5/697: read - da/df/d16/d25/d33/d91/fcb zero size 2024-02-07T12:26:01.510 INFO:tasks.workunit.client.0.smithi047.stdout:5/698: dread da/df/d16/d25/d33/f77 [0,4194304] 0 2024-02-07T12:26:01.510 INFO:tasks.workunit.client.0.smithi047.stdout:6/643: dread d3/da/da9/fd2 [4194304,4194304] 0 2024-02-07T12:26:01.510 INFO:tasks.workunit.client.0.smithi047.stdout:6/644: write d3/da/f6f [1434078,52242] 0 2024-02-07T12:26:01.511 INFO:tasks.workunit.client.0.smithi047.stdout:6/645: symlink d3/d5/d35/d3c/d90/ld5 0 2024-02-07T12:26:01.511 INFO:tasks.workunit.client.0.smithi047.stdout:6/646: chown d3/da/f6f 1157 1 2024-02-07T12:26:01.515 INFO:tasks.workunit.client.0.smithi047.stdout:6/647: dread d3/d5/d35/d3c/d90/f97 [0,4194304] 0 2024-02-07T12:26:01.515 INFO:tasks.workunit.client.0.smithi047.stdout:6/648: creat d3/d5/d35/d3c/d72/d8c/d91/fd6 x:0 0 0 2024-02-07T12:26:01.525 INFO:tasks.workunit.client.0.smithi047.stdout:5/699: dwrite da/df/d16/d25/d33/f77 [0,4194304] 0 2024-02-07T12:26:01.531 INFO:tasks.workunit.client.0.smithi047.stdout:5/700: creat da/df/d16/d25/d33/d55/fe9 x:0 0 0 2024-02-07T12:26:01.541 INFO:tasks.workunit.client.0.smithi047.stdout:5/701: getdents da/df/d16/d25/d33/d55 0 2024-02-07T12:26:01.541 INFO:tasks.workunit.client.0.smithi047.stdout:5/702: chown da/df/d16/d25/d33/d6e/dbb/lc8 2025914 1 2024-02-07T12:26:01.541 INFO:tasks.workunit.client.0.smithi047.stdout:5/703: fsync da/df/d16/d25/d71/f43 0 2024-02-07T12:26:01.542 INFO:tasks.workunit.client.0.smithi047.stdout:5/704: getdents da/d24/d63/d9a 0 2024-02-07T12:26:01.542 INFO:tasks.workunit.client.0.smithi047.stdout:6/649: dwrite d3/d5/d35/d3c/dd4/fc8 [0,4194304] 0 2024-02-07T12:26:01.545 INFO:tasks.workunit.client.0.smithi047.stdout:5/705: rename da/d24/d63/d9a/f3a to da/d24/d63/d9c/da3/fea 0 2024-02-07T12:26:01.547 INFO:tasks.workunit.client.0.smithi047.stdout:5/706: mkdir da/df/d16/d25/d33/d55/d7c/deb 0 2024-02-07T12:26:01.550 INFO:tasks.workunit.client.0.smithi047.stdout:5/707: unlink da/df/d16/d25/d71/f9f 0 2024-02-07T12:26:01.550 INFO:tasks.workunit.client.0.smithi047.stdout:5/708: chown da/d24/d63/d85/db3 45748062 1 2024-02-07T12:26:01.550 INFO:tasks.workunit.client.0.smithi047.stdout:5/709: readlink da/df/d16/d81/l8a 0 2024-02-07T12:26:01.550 INFO:tasks.workunit.client.0.smithi047.stdout:5/710: write da/df/d16/d25/d33/d55/d7c/fcd [1591970,19168] 0 2024-02-07T12:26:01.550 INFO:tasks.workunit.client.0.smithi047.stdout:5/711: write da/df/d16/d25/d33/d55/d80/fae [85451,52529] 0 2024-02-07T12:26:01.551 INFO:tasks.workunit.client.0.smithi047.stdout:5/712: unlink da/df/d16/d41/d57/d6c/l7a 0 2024-02-07T12:26:01.555 INFO:tasks.workunit.client.0.smithi047.stdout:5/713: rename da/df/d16/d81 to da/d24/d63/d9a/dec 0 2024-02-07T12:26:01.555 INFO:tasks.workunit.client.0.smithi047.stdout:5/714: write da/df/d16/d25/d33/d55/d80/fae [1341721,39073] 0 2024-02-07T12:26:01.555 INFO:tasks.workunit.client.0.smithi047.stdout:5/715: stat da/d24/ce0 0 2024-02-07T12:26:01.556 INFO:tasks.workunit.client.0.smithi047.stdout:6/650: dwrite d3/da/d14/d9e/fb2 [0,4194304] 0 2024-02-07T12:26:01.556 INFO:tasks.workunit.client.0.smithi047.stdout:6/651: fdatasync d3/da/d34/f5a 0 2024-02-07T12:26:01.556 INFO:tasks.workunit.client.0.smithi047.stdout:6/652: readlink d3/d1e/l76 0 2024-02-07T12:26:01.562 INFO:tasks.workunit.client.0.smithi047.stdout:6/653: mkdir d3/da/d34/d6d/d8f/db3/dbc/dd7 0 2024-02-07T12:26:01.571 INFO:tasks.workunit.client.0.smithi047.stdout:6/654: read d3/d5/d35/f63 [2900315,1596] 0 2024-02-07T12:26:01.571 INFO:tasks.workunit.client.0.smithi047.stdout:6/655: getdents d3/da/d2c/d42 0 2024-02-07T12:26:01.572 INFO:tasks.workunit.client.0.smithi047.stdout:6/656: readlink d3/da/d2c/l48 0 2024-02-07T12:26:01.572 INFO:tasks.workunit.client.0.smithi047.stdout:6/657: read d3/da/d34/f41 [1006154,47752] 0 2024-02-07T12:26:01.573 INFO:tasks.workunit.client.0.smithi047.stdout:6/658: creat d3/da/d3b/d55/fd8 x:0 0 0 2024-02-07T12:26:01.573 INFO:tasks.workunit.client.0.smithi047.stdout:6/659: write d3/da/d3b/d55/fc0 [236378,15325] 0 2024-02-07T12:26:01.573 INFO:tasks.workunit.client.0.smithi047.stdout:6/660: symlink d3/da/d2c/ld9 0 2024-02-07T12:26:01.574 INFO:tasks.workunit.client.0.smithi047.stdout:5/716: dwrite da/df/d16/d25/d33/d55/d80/fae [0,4194304] 0 2024-02-07T12:26:01.574 INFO:tasks.workunit.client.0.smithi047.stdout:5/717: fdatasync da/df/d16/dab/fb0 0 2024-02-07T12:26:01.574 INFO:tasks.workunit.client.0.smithi047.stdout:6/661: creat d3/da/d3b/d87/fda x:0 0 0 2024-02-07T12:26:01.576 INFO:tasks.workunit.client.0.smithi047.stdout:5/718: unlink da/df/d16/d25/d71/d68/f87 0 2024-02-07T12:26:01.578 INFO:tasks.workunit.client.0.smithi047.stdout:5/719: rename da/lcc to da/df/d16/d25/d33/d6e/da8/db6/dd5/led 0 2024-02-07T12:26:01.579 INFO:tasks.workunit.client.0.smithi047.stdout:5/720: mknod da/df/d16/d25/d71/cee 0 2024-02-07T12:26:01.600 INFO:tasks.workunit.client.0.smithi047.stdout:6/662: dwrite d3/d5/d35/f63 [0,4194304] 0 2024-02-07T12:26:01.600 INFO:tasks.workunit.client.0.smithi047.stdout:5/721: dwrite da/d24/d63/d9a/dec/f99 [0,4194304] 0 2024-02-07T12:26:01.600 INFO:tasks.workunit.client.0.smithi047.stdout:5/722: read - da/df/d16/dab/fb0 zero size 2024-02-07T12:26:01.601 INFO:tasks.workunit.client.0.smithi047.stdout:5/723: creat da/df/d16/d25/d33/d6e/dbb/fef x:0 0 0 2024-02-07T12:26:01.616 INFO:tasks.workunit.client.0.smithi047.stdout:6/663: dwrite d3/da/d3b/d55/fc0 [0,4194304] 0 2024-02-07T12:26:01.617 INFO:tasks.workunit.client.0.smithi047.stdout:6/664: write d3/f18 [4655083,88754] 0 2024-02-07T12:26:01.617 INFO:tasks.workunit.client.0.smithi047.stdout:6/665: truncate d3/da/d34/d6d/fa7 816680 0 2024-02-07T12:26:01.617 INFO:tasks.workunit.client.0.smithi047.stdout:6/666: fdatasync d3/da/d34/f5a 0 2024-02-07T12:26:01.631 INFO:tasks.workunit.client.0.smithi047.stdout:6/667: dwrite d3/da/d3b/f85 [4194304,4194304] 0 2024-02-07T12:26:01.635 INFO:tasks.workunit.client.0.smithi047.stdout:6/668: dread d3/d5/f26 [0,4194304] 0 2024-02-07T12:26:01.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:01 smithi138 ceph-mon[35528]: pgmap v17: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 92 MiB/s rd, 109 MiB/s wr, 380 op/s 2024-02-07T12:26:01.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:01 smithi047 ceph-mon[28972]: pgmap v17: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 92 MiB/s rd, 109 MiB/s wr, 380 op/s 2024-02-07T12:26:01.982 INFO:tasks.workunit.client.0.smithi047.stdout:2/759: sync 2024-02-07T12:26:01.984 INFO:tasks.workunit.client.0.smithi047.stdout:2/760: link d7/d2d/d5c/fa6 d7/d2d/d5c/ff3 0 2024-02-07T12:26:01.986 INFO:tasks.workunit.client.0.smithi047.stdout:2/761: mknod d7/dc/d4c/d65/cf4 0 2024-02-07T12:26:01.986 INFO:tasks.workunit.client.0.smithi047.stdout:2/762: write d7/dc/d51/ded/fd9 [710045,35987] 0 2024-02-07T12:26:01.999 INFO:tasks.workunit.client.0.smithi047.stdout:2/763: dwrite d7/dc/d8a/fef [0,4194304] 0 2024-02-07T12:26:01.999 INFO:tasks.workunit.client.0.smithi047.stdout:2/764: dread - d7/d2d/f2f zero size 2024-02-07T12:26:02.003 INFO:tasks.workunit.client.0.smithi047.stdout:2/765: getdents d7/d2d 0 2024-02-07T12:26:02.003 INFO:tasks.workunit.client.0.smithi047.stdout:2/766: chown d7/f23 490555 1 2024-02-07T12:26:02.004 INFO:tasks.workunit.client.0.smithi047.stdout:2/767: unlink d7/d2d/d5c/f80 0 2024-02-07T12:26:02.006 INFO:tasks.workunit.client.0.smithi047.stdout:2/768: rename d7/dc/f5b to d7/d48/d72/ff5 0 2024-02-07T12:26:02.007 INFO:tasks.workunit.client.0.smithi047.stdout:2/769: chown d7/dc/d71/fcd 3252 1 2024-02-07T12:26:02.020 INFO:tasks.workunit.client.0.smithi047.stdout:2/770: dwrite d7/dc/d4c/da0/fdd [0,4194304] 0 2024-02-07T12:26:02.021 INFO:tasks.workunit.client.0.smithi047.stdout:2/771: read d7/d2d/d5c/d77/d92/f96 [128803,12811] 0 2024-02-07T12:26:02.021 INFO:tasks.workunit.client.0.smithi047.stdout:2/772: chown d7/dc/f2b 100800 1 2024-02-07T12:26:02.023 INFO:tasks.workunit.client.0.smithi047.stdout:2/773: mknod d7/dc/d8a/cf6 0 2024-02-07T12:26:02.023 INFO:tasks.workunit.client.0.smithi047.stdout:2/774: stat d7/d2d/d5c/d77/c83 0 2024-02-07T12:26:02.023 INFO:tasks.workunit.client.0.smithi047.stdout:2/775: read - d7/dc/d71/f87 zero size 2024-02-07T12:26:02.025 INFO:tasks.workunit.client.0.smithi047.stdout:2/776: unlink d7/ca 0 2024-02-07T12:26:02.025 INFO:tasks.workunit.client.0.smithi047.stdout:2/777: fdatasync d7/f28 0 2024-02-07T12:26:02.027 INFO:tasks.workunit.client.0.smithi047.stdout:2/778: mkdir d7/d48/d72/df7 0 2024-02-07T12:26:02.029 INFO:tasks.workunit.client.0.smithi047.stdout:2/779: creat d7/d48/df0/ff8 x:0 0 0 2024-02-07T12:26:02.029 INFO:tasks.workunit.client.0.smithi047.stdout:2/780: chown d7/d2d/d7c 286396057 1 2024-02-07T12:26:02.029 INFO:tasks.workunit.client.0.smithi047.stdout:2/781: truncate d7/dc/d71/fcd 920419 0 2024-02-07T12:26:02.030 INFO:tasks.workunit.client.0.smithi047.stdout:2/782: mknod d7/d48/d72/db7/cf9 0 2024-02-07T12:26:02.031 INFO:tasks.workunit.client.0.smithi047.stdout:2/783: unlink d7/f38 0 2024-02-07T12:26:02.032 INFO:tasks.workunit.client.0.smithi047.stdout:2/784: dread - d7/dc/d4c/da0/fae zero size 2024-02-07T12:26:02.032 INFO:tasks.workunit.client.0.smithi047.stdout:2/785: write d7/d48/fa3 [1042067,15818] 0 2024-02-07T12:26:02.038 INFO:tasks.workunit.client.0.smithi047.stdout:2/786: write d7/d2d/d7c/fbc [2988749,102638] 0 2024-02-07T12:26:02.039 INFO:tasks.workunit.client.0.smithi047.stdout:2/787: mkdir d7/dc/dd6/dfa 0 2024-02-07T12:26:02.046 INFO:tasks.workunit.client.0.smithi047.stdout:2/788: dread d7/d2d/f63 [0,4194304] 0 2024-02-07T12:26:02.047 INFO:tasks.workunit.client.0.smithi047.stdout:2/789: dread d7/d2d/f43 [0,4194304] 0 2024-02-07T12:26:02.048 INFO:tasks.workunit.client.0.smithi047.stdout:2/790: getdents d7/dc/d51/ded 0 2024-02-07T12:26:02.049 INFO:tasks.workunit.client.0.smithi047.stdout:2/791: link d7/d2d/f4a d7/d2d/d5c/d77/d92/ffb 0 2024-02-07T12:26:02.066 INFO:tasks.workunit.client.0.smithi047.stdout:2/792: dwrite d7/dc/f2b [0,4194304] 0 2024-02-07T12:26:02.067 INFO:tasks.workunit.client.0.smithi047.stdout:2/793: creat d7/d2d/d5c/ffc x:0 0 0 2024-02-07T12:26:02.068 INFO:tasks.workunit.client.0.smithi047.stdout:2/794: link d7/dc/f76 d7/dc/d71/ffd 0 2024-02-07T12:26:02.080 INFO:tasks.workunit.client.0.smithi047.stdout:2/795: dwrite d7/d2d/f53 [0,4194304] 0 2024-02-07T12:26:02.080 INFO:tasks.workunit.client.0.smithi047.stdout:2/796: readlink d7/dc/d4c/d65/lb8 0 2024-02-07T12:26:02.084 INFO:tasks.workunit.client.0.smithi047.stdout:2/797: creat d7/dc/d4c/da0/ffe x:0 0 0 2024-02-07T12:26:02.085 INFO:tasks.workunit.client.0.smithi047.stdout:2/798: chown d7/dc/d8a/ccb 250728 1 2024-02-07T12:26:02.085 INFO:tasks.workunit.client.0.smithi047.stdout:2/799: chown d7/dc/f1a 3 1 2024-02-07T12:26:02.085 INFO:tasks.workunit.client.0.smithi047.stdout:2/800: stat d7/d48/f56 0 2024-02-07T12:26:02.085 INFO:tasks.workunit.client.0.smithi047.stdout:2/801: write d7/dc/d4c/fa2 [321568,122387] 0 2024-02-07T12:26:02.086 INFO:tasks.workunit.client.0.smithi047.stdout:2/802: mkdir d7/dc/d4c/de4/dff 0 2024-02-07T12:26:02.088 INFO:tasks.workunit.client.0.smithi047.stdout:2/803: mknod d7/dc/d4c/da0/c100 0 2024-02-07T12:26:02.088 INFO:tasks.workunit.client.0.smithi047.stdout:2/804: stat d7/dc/dd6 0 2024-02-07T12:26:02.093 INFO:tasks.workunit.client.0.smithi047.stdout:2/805: symlink d7/l101 0 2024-02-07T12:26:02.093 INFO:tasks.workunit.client.0.smithi047.stdout:2/806: mkdir d7/d48/d72/db7/d102 0 2024-02-07T12:26:02.096 INFO:tasks.workunit.client.0.smithi047.stdout:2/807: write d7/dc/f31 [5017965,71040] 0 2024-02-07T12:26:02.098 INFO:tasks.workunit.client.0.smithi047.stdout:2/808: mknod d7/d2d/d5c/c103 0 2024-02-07T12:26:02.098 INFO:tasks.workunit.client.0.smithi047.stdout:2/809: fsync d7/dc/d4c/f50 0 2024-02-07T12:26:02.098 INFO:tasks.workunit.client.0.smithi047.stdout:2/810: symlink d7/d48/d72/l104 0 2024-02-07T12:26:02.099 INFO:tasks.workunit.client.0.smithi047.stdout:2/811: stat d7/d48/d72/df7 0 2024-02-07T12:26:02.099 INFO:tasks.workunit.client.0.smithi047.stdout:2/812: fdatasync d7/d2d/f2f 0 2024-02-07T12:26:02.099 INFO:tasks.workunit.client.0.smithi047.stdout:2/813: creat d7/d48/d72/dbf/f105 x:0 0 0 2024-02-07T12:26:02.102 INFO:tasks.workunit.client.0.smithi047.stdout:2/814: rename d7/dc/f31 to d7/dc/d4c/de4/f106 0 2024-02-07T12:26:02.104 INFO:tasks.workunit.client.0.smithi047.stdout:2/815: rename d7/l32 to d7/dc/d71/l107 0 2024-02-07T12:26:02.105 INFO:tasks.workunit.client.0.smithi047.stdout:2/816: creat d7/d2d/f108 x:0 0 0 2024-02-07T12:26:02.107 INFO:tasks.workunit.client.0.smithi047.stdout:2/817: rename d7/dc/d4c/f94 to d7/dc/d71/dde/f109 0 2024-02-07T12:26:02.112 INFO:tasks.workunit.client.0.smithi047.stdout:2/818: dread d7/dc/d4c/fa2 [0,4194304] 0 2024-02-07T12:26:02.113 INFO:tasks.workunit.client.0.smithi047.stdout:2/819: rmdir d7/dc/d51/ded 39 2024-02-07T12:26:02.113 INFO:tasks.workunit.client.0.smithi047.stdout:2/820: symlink d7/d48/d72/dbf/l10a 0 2024-02-07T12:26:02.115 INFO:tasks.workunit.client.0.smithi047.stdout:2/821: symlink d7/d2d/d5c/d77/l10b 0 2024-02-07T12:26:02.115 INFO:tasks.workunit.client.0.smithi047.stdout:2/822: stat d7/dc/c1c 0 2024-02-07T12:26:02.124 INFO:tasks.workunit.client.0.smithi047.stdout:2/823: write d7/dc/f8f [3613302,65758] 0 2024-02-07T12:26:02.144 INFO:tasks.workunit.client.0.smithi047.stdout:2/824: dwrite d7/d2d/d5c/f70 [0,4194304] 0 2024-02-07T12:26:02.146 INFO:tasks.workunit.client.0.smithi047.stdout:2/825: getdents d7/dc/d4c 0 2024-02-07T12:26:02.148 INFO:tasks.workunit.client.0.smithi047.stdout:2/826: rename d7/d2d/d5c/f8b to d7/dc/d4c/d65/f10c 0 2024-02-07T12:26:02.148 INFO:tasks.workunit.client.0.smithi047.stdout:4/876: sync 2024-02-07T12:26:02.150 INFO:tasks.workunit.client.0.smithi047.stdout:3/712: sync 2024-02-07T12:26:02.150 INFO:tasks.workunit.client.0.smithi047.stdout:9/491: sync 2024-02-07T12:26:02.150 INFO:tasks.workunit.client.0.smithi047.stdout:9/492: read d3/d10/d18/d3d/f37 [3231085,9196] 0 2024-02-07T12:26:02.151 INFO:tasks.workunit.client.0.smithi047.stdout:4/877: creat d3/d27/dc5/d73/f129 x:0 0 0 2024-02-07T12:26:02.154 INFO:tasks.workunit.client.0.smithi047.stdout:9/493: rename d3/d10/c13 to d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/cb5 0 2024-02-07T12:26:02.155 INFO:tasks.workunit.client.0.smithi047.stdout:4/878: link d3/db1/d37/c10c d3/db1/d37/da9/c12a 0 2024-02-07T12:26:02.157 INFO:tasks.workunit.client.0.smithi047.stdout:9/494: symlink d3/d10/d18/d3d/lb6 0 2024-02-07T12:26:02.158 INFO:tasks.workunit.client.0.smithi047.stdout:1/548: sync 2024-02-07T12:26:02.158 INFO:tasks.workunit.client.0.smithi047.stdout:6/669: sync 2024-02-07T12:26:02.158 INFO:tasks.workunit.client.0.smithi047.stdout:5/724: sync 2024-02-07T12:26:02.158 INFO:tasks.workunit.client.0.smithi047.stdout:7/768: sync 2024-02-07T12:26:02.158 INFO:tasks.workunit.client.0.smithi047.stdout:7/769: truncate d0/d42/fed 412256 0 2024-02-07T12:26:02.158 INFO:tasks.workunit.client.0.smithi047.stdout:6/670: write d3/d5/d35/d3c/d72/d8c/f8a [524640,42687] 0 2024-02-07T12:26:02.158 INFO:tasks.workunit.client.0.smithi047.stdout:7/770: creat d0/ff9 x:0 0 0 2024-02-07T12:26:02.158 INFO:tasks.workunit.client.0.smithi047.stdout:7/771: fsync d0/df/d74/df5/f71 0 2024-02-07T12:26:02.158 INFO:tasks.workunit.client.0.smithi047.stdout:0/500: sync 2024-02-07T12:26:02.159 INFO:tasks.workunit.client.0.smithi047.stdout:8/703: sync 2024-02-07T12:26:02.159 INFO:tasks.workunit.client.0.smithi047.stdout:8/704: dread - d3/d36/f9b zero size 2024-02-07T12:26:02.160 INFO:tasks.workunit.client.0.smithi047.stdout:3/713: write d12/dc7/d29/d31/d7c/fc6 [2682364,46399] 0 2024-02-07T12:26:02.160 INFO:tasks.workunit.client.0.smithi047.stdout:3/714: dread - d12/d19/d2d/d42/f4d zero size 2024-02-07T12:26:02.161 INFO:tasks.workunit.client.0.smithi047.stdout:7/772: dread d0/d4/da2/fe2 [0,4194304] 0 2024-02-07T12:26:02.164 INFO:tasks.workunit.client.0.smithi047.stdout:4/879: link d3/d27/d5e/fab d3/d27/d5e/f12b 0 2024-02-07T12:26:02.164 INFO:tasks.workunit.client.0.smithi047.stdout:4/880: chown d3/d27/d3b/d7d/da2/la7 1416 1 2024-02-07T12:26:02.164 INFO:tasks.workunit.client.0.smithi047.stdout:4/881: creat d3/d61/d70/f12c x:0 0 0 2024-02-07T12:26:02.165 INFO:tasks.workunit.client.0.smithi047.stdout:1/549: symlink d1/d2a/la9 0 2024-02-07T12:26:02.165 INFO:tasks.workunit.client.0.smithi047.stdout:1/550: chown d1/d6e/d75 300287 1 2024-02-07T12:26:02.166 INFO:tasks.workunit.client.0.smithi047.stdout:9/495: read d3/d10/d18/d3b/d3c/d5d/f78 [2474538,69009] 0 2024-02-07T12:26:02.166 INFO:tasks.workunit.client.0.smithi047.stdout:9/496: fsync d3/f9 0 2024-02-07T12:26:02.166 INFO:tasks.workunit.client.0.smithi047.stdout:9/497: readlink d3/d10/d18/d3d/l9c 0 2024-02-07T12:26:02.166 INFO:tasks.workunit.client.0.smithi047.stdout:5/725: symlink da/d24/d63/d9a/dec/lf0 0 2024-02-07T12:26:02.166 INFO:tasks.workunit.client.0.smithi047.stdout:5/726: fdatasync da/df/d16/dab/fb0 0 2024-02-07T12:26:02.166 INFO:tasks.workunit.client.0.smithi047.stdout:5/727: chown da/d24/d63/d9c/fc9 4614 1 2024-02-07T12:26:02.168 INFO:tasks.workunit.client.0.smithi047.stdout:7/773: dread d0/d42/fb5 [0,4194304] 0 2024-02-07T12:26:02.169 INFO:tasks.workunit.client.0.smithi047.stdout:3/715: dread d12/d19/f28 [0,4194304] 0 2024-02-07T12:26:02.171 INFO:tasks.workunit.client.0.smithi047.stdout:8/705: dread d3/d66/f7d [0,4194304] 0 2024-02-07T12:26:02.172 INFO:tasks.workunit.client.0.smithi047.stdout:0/501: creat d19/d1c/d3c/d60/d6f/f9a x:0 0 0 2024-02-07T12:26:02.178 INFO:tasks.workunit.client.0.smithi047.stdout:6/671: dwrite d3/d5/d35/d3c/d72/d8c/d91/fc5 [0,4194304] 0 2024-02-07T12:26:02.184 INFO:tasks.workunit.client.0.smithi047.stdout:0/502: creat d19/d1c/d3c/f9b x:0 0 0 2024-02-07T12:26:02.186 INFO:tasks.workunit.client.0.smithi047.stdout:4/882: rmdir d3/d27/d5e/dd0 39 2024-02-07T12:26:02.186 INFO:tasks.workunit.client.0.smithi047.stdout:7/774: write d0/df/d74/dcd/de4/fca [515811,31510] 0 2024-02-07T12:26:02.186 INFO:tasks.workunit.client.0.smithi047.stdout:4/883: stat d3/db1/de5/f127 0 2024-02-07T12:26:02.187 INFO:tasks.workunit.client.0.smithi047.stdout:4/884: chown d3/d61/d70/d8b/ddb/cd3 6200779 1 2024-02-07T12:26:02.187 INFO:tasks.workunit.client.0.smithi047.stdout:7/775: truncate d0/df/d29/d3e/fac 469337 0 2024-02-07T12:26:02.187 INFO:tasks.workunit.client.0.smithi047.stdout:4/885: dread - d3/d61/d70/d8b/ddb/db7/f110 zero size 2024-02-07T12:26:02.190 INFO:tasks.workunit.client.0.smithi047.stdout:5/728: link da/d24/d63/d9a/c7b da/cf1 0 2024-02-07T12:26:02.194 INFO:tasks.workunit.client.0.smithi047.stdout:5/729: dread da/d24/f2f [0,4194304] 0 2024-02-07T12:26:02.196 INFO:tasks.workunit.client.0.smithi047.stdout:6/672: creat d3/da/d2c/fdb x:0 0 0 2024-02-07T12:26:02.198 INFO:tasks.workunit.client.0.smithi047.stdout:8/706: rmdir d3/d4/d4d 39 2024-02-07T12:26:02.198 INFO:tasks.workunit.client.0.smithi047.stdout:8/707: write d3/d66/d67/d6a/fd2 [601792,71347] 0 2024-02-07T12:26:02.198 INFO:tasks.workunit.client.0.smithi047.stdout:9/498: dwrite d3/d10/d18/f1a [0,4194304] 0 2024-02-07T12:26:02.199 INFO:tasks.workunit.client.0.smithi047.stdout:9/499: readlink d3/d10/l56 0 2024-02-07T12:26:02.199 INFO:tasks.workunit.client.0.smithi047.stdout:9/500: fsync d3/d10/d18/d3d/f37 0 2024-02-07T12:26:02.199 INFO:tasks.workunit.client.0.smithi047.stdout:9/501: chown d3/c95 925604828 1 2024-02-07T12:26:02.199 INFO:tasks.workunit.client.0.smithi047.stdout:0/503: symlink d19/d1c/d3c/d37/l9c 0 2024-02-07T12:26:02.199 INFO:tasks.workunit.client.0.smithi047.stdout:0/504: truncate d19/d1c/f30 5134032 0 2024-02-07T12:26:02.200 INFO:tasks.workunit.client.0.smithi047.stdout:4/886: symlink d3/db1/d37/da9/dcb/l12d 0 2024-02-07T12:26:02.200 INFO:tasks.workunit.client.0.smithi047.stdout:4/887: write d3/db1/de5/f127 [398401,20847] 0 2024-02-07T12:26:02.201 INFO:tasks.workunit.client.0.smithi047.stdout:3/716: dwrite d12/f13 [0,4194304] 0 2024-02-07T12:26:02.201 INFO:tasks.workunit.client.0.smithi047.stdout:3/717: stat d12/f3d 0 2024-02-07T12:26:02.202 INFO:tasks.workunit.client.0.smithi047.stdout:8/708: symlink d3/d66/le9 0 2024-02-07T12:26:02.203 INFO:tasks.workunit.client.0.smithi047.stdout:6/673: dread d3/d5/d35/f54 [0,4194304] 0 2024-02-07T12:26:02.204 INFO:tasks.workunit.client.0.smithi047.stdout:6/674: truncate d3/da/da9/fd1 112036 0 2024-02-07T12:26:02.205 INFO:tasks.workunit.client.0.smithi047.stdout:9/502: symlink d3/d10/d18/d3d/lb7 0 2024-02-07T12:26:02.205 INFO:tasks.workunit.client.0.smithi047.stdout:9/503: fdatasync d3/d10/d18/fa3 0 2024-02-07T12:26:02.206 INFO:tasks.workunit.client.0.smithi047.stdout:4/888: creat d3/d27/d5e/dd0/f12e x:0 0 0 2024-02-07T12:26:02.206 INFO:tasks.workunit.client.0.smithi047.stdout:4/889: dread - d3/d61/d70/d8b/ddb/d63/db3/dd4/f112 zero size 2024-02-07T12:26:02.209 INFO:tasks.workunit.client.0.smithi047.stdout:0/505: symlink d19/d1c/l9d 0 2024-02-07T12:26:02.210 INFO:tasks.workunit.client.0.smithi047.stdout:9/504: write d3/d10/d18/d3b/d3c/f4e [333710,41476] 0 2024-02-07T12:26:02.210 INFO:tasks.workunit.client.0.smithi047.stdout:9/505: dread - d3/d10/d18/fa3 zero size 2024-02-07T12:26:02.210 INFO:tasks.workunit.client.0.smithi047.stdout:9/506: truncate d3/d10/d4c/f4d 75712 0 2024-02-07T12:26:02.210 INFO:tasks.workunit.client.0.smithi047.stdout:9/507: stat d3/d10/d18/d3b/d3c/d5d/d70/f80 0 2024-02-07T12:26:02.210 INFO:tasks.workunit.client.0.smithi047.stdout:9/508: readlink d3/d10/l3e 0 2024-02-07T12:26:02.213 INFO:tasks.workunit.client.0.smithi047.stdout:7/776: dwrite d0/d42/fb9 [0,4194304] 0 2024-02-07T12:26:02.214 INFO:tasks.workunit.client.0.smithi047.stdout:0/506: unlink d19/d1c/d3c/d48/f93 0 2024-02-07T12:26:02.214 INFO:tasks.workunit.client.0.smithi047.stdout:0/507: readlink d19/d1c/d2b/l7a 0 2024-02-07T12:26:02.215 INFO:tasks.workunit.client.0.smithi047.stdout:0/508: write d19/d1c/f43 [1633547,93428] 0 2024-02-07T12:26:02.217 INFO:tasks.workunit.client.0.smithi047.stdout:9/509: unlink d3/d10/d4c/f66 0 2024-02-07T12:26:02.217 INFO:tasks.workunit.client.0.smithi047.stdout:9/510: readlink d3/d10/d18/d3d/lb6 0 2024-02-07T12:26:02.220 INFO:tasks.workunit.client.0.smithi047.stdout:5/730: rename da/df/d16/d25/d33/d55/d80 to da/d24/d63/d9a/df2 0 2024-02-07T12:26:02.220 INFO:tasks.workunit.client.0.smithi047.stdout:5/731: stat da/df/d16/fc0 0 2024-02-07T12:26:02.220 INFO:tasks.workunit.client.0.smithi047.stdout:5/732: write da/df/d16/d25/d71/dd2/fe6 [4860825,114714] 0 2024-02-07T12:26:02.227 INFO:tasks.workunit.client.0.smithi047.stdout:0/509: mkdir d19/d40/d66/d81/d82/d9e 0 2024-02-07T12:26:02.231 INFO:tasks.workunit.client.0.smithi047.stdout:9/511: mknod d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/cb8 0 2024-02-07T12:26:02.231 INFO:tasks.workunit.client.0.smithi047.stdout:9/512: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/fb9 x:0 0 0 2024-02-07T12:26:02.231 INFO:tasks.workunit.client.0.smithi047.stdout:9/513: truncate d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/f54 1811762 0 2024-02-07T12:26:02.231 INFO:tasks.workunit.client.0.smithi047.stdout:9/514: chown d3/d10/d18/d3b 23 1 2024-02-07T12:26:02.232 INFO:tasks.workunit.client.0.smithi047.stdout:4/890: dwrite d3/d27/dc5/d73/f91 [0,4194304] 0 2024-02-07T12:26:02.233 INFO:tasks.workunit.client.0.smithi047.stdout:4/891: stat d3/d61/d70/d8b/ddb/d63/db3/dd4/l11c 0 2024-02-07T12:26:02.233 INFO:tasks.workunit.client.0.smithi047.stdout:4/892: chown d3/db1/d37/da9/c12a 1800 1 2024-02-07T12:26:02.233 INFO:tasks.workunit.client.0.smithi047.stdout:6/675: dwrite d3/da/f6f [0,4194304] 0 2024-02-07T12:26:02.234 INFO:tasks.workunit.client.0.smithi047.stdout:3/718: rename d12/d19/d37/l6d to d12/dc7/d29/da9/lea 0 2024-02-07T12:26:02.235 INFO:tasks.workunit.client.0.smithi047.stdout:5/733: symlink da/d24/daa/lf3 0 2024-02-07T12:26:02.235 INFO:tasks.workunit.client.0.smithi047.stdout:5/734: readlink da/df/d16/ld9 0 2024-02-07T12:26:02.236 INFO:tasks.workunit.client.0.smithi047.stdout:5/735: dread da/d24/d63/d9a/df2/da6/fc4 [0,4194304] 0 2024-02-07T12:26:02.236 INFO:tasks.workunit.client.0.smithi047.stdout:0/510: mkdir d19/d1c/d2b/d5f/d9f 0 2024-02-07T12:26:02.241 INFO:tasks.workunit.client.0.smithi047.stdout:4/893: mknod d3/d27/dd8/d128/c12f 0 2024-02-07T12:26:02.247 INFO:tasks.workunit.client.0.smithi047.stdout:6/676: creat d3/d5/d35/d3c/d72/d8c/d95/fdc x:0 0 0 2024-02-07T12:26:02.247 INFO:tasks.workunit.client.0.smithi047.stdout:6/677: dread - d3/da/d3b/d87/fda zero size 2024-02-07T12:26:02.249 INFO:tasks.workunit.client.0.smithi047.stdout:3/719: symlink d12/dc7/d29/da9/leb 0 2024-02-07T12:26:02.252 INFO:tasks.workunit.client.0.smithi047.stdout:7/777: rename d0/df/d29/fa6 to d0/df/d29/d31/d40/dd7/ffa 0 2024-02-07T12:26:02.255 INFO:tasks.workunit.client.0.smithi047.stdout:5/736: mknod da/df/d16/d25/d33/d55/d7c/deb/cf4 0 2024-02-07T12:26:02.258 INFO:tasks.workunit.client.0.smithi047.stdout:0/511: symlink d19/d1c/d2c/d8c/la0 0 2024-02-07T12:26:02.261 INFO:tasks.workunit.client.0.smithi047.stdout:6/678: unlink d3/d5/d35/d3c/d72/d8c/d91/cb1 0 2024-02-07T12:26:02.263 INFO:tasks.workunit.client.0.smithi047.stdout:4/894: dwrite d3/f54 [4194304,4194304] 0 2024-02-07T12:26:02.264 INFO:tasks.workunit.client.0.smithi047.stdout:4/895: chown d3/db1/d37/da9/dcb 55 1 2024-02-07T12:26:02.266 INFO:tasks.workunit.client.0.smithi047.stdout:5/737: dread da/df/d16/d25/d33/d6e/da8/db6/dd5/f95 [0,4194304] 0 2024-02-07T12:26:02.266 INFO:tasks.workunit.client.0.smithi047.stdout:5/738: truncate da/d24/d63/d9c/da3/fbf 1198850 0 2024-02-07T12:26:02.266 INFO:tasks.workunit.client.0.smithi047.stdout:9/515: rename d3/d10/d18/c28 to d3/d10/d18/d6e/cba 0 2024-02-07T12:26:02.266 INFO:tasks.workunit.client.0.smithi047.stdout:3/720: rename d12/d19/d2d/d33 to d12/d19/d2d/d33/da5/dec 22 2024-02-07T12:26:02.266 INFO:tasks.workunit.client.0.smithi047.stdout:3/721: stat d12/dc7/fe7 0 2024-02-07T12:26:02.269 INFO:tasks.workunit.client.0.smithi047.stdout:0/512: dread d19/f34 [0,4194304] 0 2024-02-07T12:26:02.270 INFO:tasks.workunit.client.0.smithi047.stdout:7/778: link d0/fe0 d0/df/d29/ffb 0 2024-02-07T12:26:02.272 INFO:tasks.workunit.client.0.smithi047.stdout:6/679: symlink d3/da/d14/d28/d46/ldd 0 2024-02-07T12:26:02.273 INFO:tasks.workunit.client.0.smithi047.stdout:4/896: mknod d3/d27/dd8/d128/c130 0 2024-02-07T12:26:02.275 INFO:tasks.workunit.client.0.smithi047.stdout:9/516: link d3/d10/d18/d3a/l8f d3/d10/d18/d6e/d9a/daf/lbb 0 2024-02-07T12:26:02.277 INFO:tasks.workunit.client.0.smithi047.stdout:3/722: creat d12/dc7/d90/fed x:0 0 0 2024-02-07T12:26:02.278 INFO:tasks.workunit.client.0.smithi047.stdout:0/513: mknod d19/d1c/d3c/ca1 0 2024-02-07T12:26:02.281 INFO:tasks.workunit.client.0.smithi047.stdout:6/680: rename d3/da/d2c/c89 to d3/d5/d35/d3c/dd4/cde 0 2024-02-07T12:26:02.281 INFO:tasks.workunit.client.0.smithi047.stdout:6/681: truncate d3/da/d2c/fdb 100039 0 2024-02-07T12:26:02.281 INFO:tasks.workunit.client.0.smithi047.stdout:4/897: symlink d3/d61/l131 0 2024-02-07T12:26:02.282 INFO:tasks.workunit.client.0.smithi047.stdout:9/517: creat d3/d10/d18/d6e/fbc x:0 0 0 2024-02-07T12:26:02.282 INFO:tasks.workunit.client.0.smithi047.stdout:9/518: fsync d3/d10/d4c/f5b 0 2024-02-07T12:26:02.284 INFO:tasks.workunit.client.0.smithi047.stdout:7/779: link d0/d42/fb9 d0/d4/ffc 0 2024-02-07T12:26:02.284 INFO:tasks.workunit.client.0.smithi047.stdout:7/780: fsync d0/fa4 0 2024-02-07T12:26:02.285 INFO:tasks.workunit.client.0.smithi047.stdout:6/682: creat d3/da/d14/d28/d9a/fdf x:0 0 0 2024-02-07T12:26:02.288 INFO:tasks.workunit.client.0.smithi047.stdout:4/898: rename d3/d61/d70/d8b/ddb/d63/dda/cfd to d3/df6/c132 0 2024-02-07T12:26:02.289 INFO:tasks.workunit.client.0.smithi047.stdout:9/519: getdents d3/d10/d18/d3d/d79 0 2024-02-07T12:26:02.292 INFO:tasks.workunit.client.0.smithi047.stdout:7/781: rmdir d0/df/d29/d3e/d4c 39 2024-02-07T12:26:02.298 INFO:tasks.workunit.client.0.smithi047.stdout:7/782: rename d0/d4/da2/ddb to d0/d42/d4d/d67/dfd 0 2024-02-07T12:26:02.298 INFO:tasks.workunit.client.0.smithi047.stdout:7/783: creat d0/d42/d4d/d67/ffe x:0 0 0 2024-02-07T12:26:02.298 INFO:tasks.workunit.client.0.smithi047.stdout:7/784: stat d0/df/fe5 0 2024-02-07T12:26:02.298 INFO:tasks.workunit.client.0.smithi047.stdout:0/514: write d19/d1c/d24/f56 [1704434,46133] 0 2024-02-07T12:26:02.300 INFO:tasks.workunit.client.0.smithi047.stdout:0/515: truncate d19/f27 2457987 0 2024-02-07T12:26:02.303 INFO:tasks.workunit.client.0.smithi047.stdout:0/516: rename d19/d1c/d24/f2a to d19/d40/d66/fa2 0 2024-02-07T12:26:02.304 INFO:tasks.workunit.client.0.smithi047.stdout:0/517: read - d19/d1c/d2b/d5f/f80 zero size 2024-02-07T12:26:02.305 INFO:tasks.workunit.client.0.smithi047.stdout:5/739: dwrite da/df/d16/d41/f5a [0,4194304] 0 2024-02-07T12:26:02.305 INFO:tasks.workunit.client.0.smithi047.stdout:3/723: dwrite d12/dc7/d90/fed [0,4194304] 0 2024-02-07T12:26:02.305 INFO:tasks.workunit.client.0.smithi047.stdout:3/724: fsync d12/dc7/d29/d6f/d93/dba/dbf/fe3 0 2024-02-07T12:26:02.308 INFO:tasks.workunit.client.0.smithi047.stdout:6/683: dwrite d3/da/d14/fa0 [0,4194304] 0 2024-02-07T12:26:02.308 INFO:tasks.workunit.client.0.smithi047.stdout:6/684: dread - d3/d5/d35/d3c/d90/fbe zero size 2024-02-07T12:26:02.310 INFO:tasks.workunit.client.0.smithi047.stdout:6/685: write d3/d5/d35/f54 [739820,10727] 0 2024-02-07T12:26:02.311 INFO:tasks.workunit.client.0.smithi047.stdout:6/686: fsync d3/d5/f15 0 2024-02-07T12:26:02.311 INFO:tasks.workunit.client.0.smithi047.stdout:6/687: stat d3/da/d3b/d55/lbb 0 2024-02-07T12:26:02.311 INFO:tasks.workunit.client.0.smithi047.stdout:5/740: creat da/d24/d63/d85/ff5 x:0 0 0 2024-02-07T12:26:02.311 INFO:tasks.workunit.client.0.smithi047.stdout:3/725: mknod d12/dc7/d29/d31/d7c/d8c/cee 0 2024-02-07T12:26:02.311 INFO:tasks.workunit.client.0.smithi047.stdout:3/726: read d12/dc7/d29/da9/fc2 [236188,124961] 0 2024-02-07T12:26:02.313 INFO:tasks.workunit.client.0.smithi047.stdout:5/741: read da/d24/d63/d9a/df2/fc5 [597376,56445] 0 2024-02-07T12:26:02.318 INFO:tasks.workunit.client.0.smithi047.stdout:5/742: creat da/df/d16/d25/d33/d55/d7c/deb/ff6 x:0 0 0 2024-02-07T12:26:02.319 INFO:tasks.workunit.client.0.smithi047.stdout:6/688: write d3/da/f74 [2249550,121610] 0 2024-02-07T12:26:02.321 INFO:tasks.workunit.client.0.smithi047.stdout:5/743: unlink da/d24/d63/d9a/df2/fc5 0 2024-02-07T12:26:02.324 INFO:tasks.workunit.client.0.smithi047.stdout:6/689: creat d3/da/d34/d6d/d8f/db3/dbc/fe0 x:0 0 0 2024-02-07T12:26:02.325 INFO:tasks.workunit.client.0.smithi047.stdout:5/744: mkdir da/df/df7 0 2024-02-07T12:26:02.325 INFO:tasks.workunit.client.0.smithi047.stdout:5/745: chown da/df/d16/d25/d71/dd2/lde 581252579 1 2024-02-07T12:26:02.325 INFO:tasks.workunit.client.0.smithi047.stdout:5/746: readlink da/df/d16/d25/d33/d6e/da8/db6/le2 0 2024-02-07T12:26:02.325 INFO:tasks.workunit.client.0.smithi047.stdout:5/747: read - da/df/d16/d25/d33/d55/fe9 zero size 2024-02-07T12:26:02.325 INFO:tasks.workunit.client.0.smithi047.stdout:5/748: chown da/df/d16/d25/d71/d68/fa0 101 1 2024-02-07T12:26:02.326 INFO:tasks.workunit.client.0.smithi047.stdout:6/690: symlink d3/da/d34/le1 0 2024-02-07T12:26:02.327 INFO:tasks.workunit.client.0.smithi047.stdout:5/749: symlink da/d24/lf8 0 2024-02-07T12:26:02.327 INFO:tasks.workunit.client.0.smithi047.stdout:5/750: write da/df/d16/d41/d57/f5d [3169663,63765] 0 2024-02-07T12:26:02.330 INFO:tasks.workunit.client.0.smithi047.stdout:5/751: link da/d24/lbc da/df/lf9 0 2024-02-07T12:26:02.332 INFO:tasks.workunit.client.0.smithi047.stdout:7/785: dwrite d0/df/d29/f23 [0,4194304] 0 2024-02-07T12:26:02.332 INFO:tasks.workunit.client.0.smithi047.stdout:5/752: mknod da/d24/d63/d85/cfa 0 2024-02-07T12:26:02.332 INFO:tasks.workunit.client.0.smithi047.stdout:9/520: dwrite d3/d10/d18/d3b/fa5 [0,4194304] 0 2024-02-07T12:26:02.334 INFO:tasks.workunit.client.0.smithi047.stdout:4/899: dwrite d3/d61/d70/d83/d85/fd6 [0,4194304] 0 2024-02-07T12:26:02.335 INFO:tasks.workunit.client.0.smithi047.stdout:0/518: dwrite d19/f45 [0,4194304] 0 2024-02-07T12:26:02.335 INFO:tasks.workunit.client.0.smithi047.stdout:0/519: dread - d19/d1c/d3c/d48/f4e zero size 2024-02-07T12:26:02.339 INFO:tasks.workunit.client.0.smithi047.stdout:9/521: mkdir d3/d10/d18/d3d/dbd 0 2024-02-07T12:26:02.339 INFO:tasks.workunit.client.0.smithi047.stdout:9/522: readlink d3/d10/l17 0 2024-02-07T12:26:02.340 INFO:tasks.workunit.client.0.smithi047.stdout:9/523: dread - d3/fa0 zero size 2024-02-07T12:26:02.340 INFO:tasks.workunit.client.0.smithi047.stdout:9/524: chown d3/d10/l73 1766945 1 2024-02-07T12:26:02.352 INFO:tasks.workunit.client.0.smithi047.stdout:6/691: dwrite d3/d5/fb0 [0,4194304] 0 2024-02-07T12:26:02.353 INFO:tasks.workunit.client.0.smithi047.stdout:7/786: dwrite d0/df/d29/d3e/d4c/fb7 [0,4194304] 0 2024-02-07T12:26:02.353 INFO:tasks.workunit.client.0.smithi047.stdout:7/787: chown d0/df/d29/lf6 42 1 2024-02-07T12:26:02.372 INFO:tasks.workunit.client.0.smithi047.stdout:0/520: mknod d19/d40/d66/d46/ca3 0 2024-02-07T12:26:02.372 INFO:tasks.workunit.client.0.smithi047.stdout:0/521: chown d19/d1c/d2c/f38 118288 1 2024-02-07T12:26:02.374 INFO:tasks.workunit.client.0.smithi047.stdout:5/753: mknod da/d24/d63/d9a/cfb 0 2024-02-07T12:26:02.375 INFO:tasks.workunit.client.0.smithi047.stdout:9/525: rename d3/c25 to d3/cbe 0 2024-02-07T12:26:02.375 INFO:tasks.workunit.client.0.smithi047.stdout:9/526: truncate d3/d10/d18/d3d/f89 595676 0 2024-02-07T12:26:02.375 INFO:tasks.workunit.client.0.smithi047.stdout:9/527: write d3/d10/d18/f2e [5034365,1110] 0 2024-02-07T12:26:02.375 INFO:tasks.workunit.client.0.smithi047.stdout:9/528: chown d3/l5 23949 1 2024-02-07T12:26:02.379 INFO:tasks.workunit.client.0.smithi047.stdout:6/692: symlink d3/d5/d35/d3c/d72/d8c/le2 0 2024-02-07T12:26:02.379 INFO:tasks.workunit.client.0.smithi047.stdout:6/693: chown d3/da/d14/l5c 3433176 1 2024-02-07T12:26:02.383 INFO:tasks.workunit.client.0.smithi047.stdout:0/522: truncate d19/d1c/d24/f35 660091 0 2024-02-07T12:26:02.384 INFO:tasks.workunit.client.0.smithi047.stdout:5/754: stat da/df/c9e 0 2024-02-07T12:26:02.386 INFO:tasks.workunit.client.0.smithi047.stdout:6/694: mknod d3/d5/d35/d3c/d72/d8c/d95/ce3 0 2024-02-07T12:26:02.387 INFO:tasks.workunit.client.0.smithi047.stdout:9/529: read d3/d10/f4b [2443020,48994] 0 2024-02-07T12:26:02.387 INFO:tasks.workunit.client.0.smithi047.stdout:5/755: mkdir da/d24/d63/d9c/da3/dfc 0 2024-02-07T12:26:02.389 INFO:tasks.workunit.client.0.smithi047.stdout:6/695: mkdir d3/da/d3b/d87/de4 0 2024-02-07T12:26:02.389 INFO:tasks.workunit.client.0.smithi047.stdout:6/696: dread - d3/d5/d35/d3c/d90/fbe zero size 2024-02-07T12:26:02.390 INFO:tasks.workunit.client.0.smithi047.stdout:6/697: creat d3/da/d14/d28/d46/d94/fe5 x:0 0 0 2024-02-07T12:26:02.390 INFO:tasks.workunit.client.0.smithi047.stdout:6/698: write d3/d5/d35/f54 [285170,110951] 0 2024-02-07T12:26:02.391 INFO:tasks.workunit.client.0.smithi047.stdout:5/756: rmdir da/d24/d63/d9a 39 2024-02-07T12:26:02.391 INFO:tasks.workunit.client.0.smithi047.stdout:5/757: stat da/df/d16/d25/d33/d55/d7c/ca2 0 2024-02-07T12:26:02.394 INFO:tasks.workunit.client.0.smithi047.stdout:0/523: write d19/d1c/d3c/d60/d6f/d70/f76 [2123600,71457] 0 2024-02-07T12:26:02.394 INFO:tasks.workunit.client.0.smithi047.stdout:0/524: fdatasync d19/d1c/d2b/d5f/f89 0 2024-02-07T12:26:02.398 INFO:tasks.workunit.client.0.smithi047.stdout:9/530: write d3/f34 [2424769,130583] 0 2024-02-07T12:26:02.399 INFO:tasks.workunit.client.0.smithi047.stdout:9/531: dread d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/f54 [0,4194304] 0 2024-02-07T12:26:02.400 INFO:tasks.workunit.client.0.smithi047.stdout:9/532: unlink d3/f51 0 2024-02-07T12:26:02.400 INFO:tasks.workunit.client.0.smithi047.stdout:9/533: fdatasync d3/d10/d18/d3a/da7/fac 0 2024-02-07T12:26:02.400 INFO:tasks.workunit.client.0.smithi047.stdout:9/534: truncate d3/d10/d18/d3b/d3c/d5d/fa6 563230 0 2024-02-07T12:26:02.401 INFO:tasks.workunit.client.0.smithi047.stdout:9/535: mkdir d3/d10/d18/d3b/d3c/d5d/d70/dad/dbf 0 2024-02-07T12:26:02.402 INFO:tasks.workunit.client.0.smithi047.stdout:9/536: mkdir d3/d10/d18/d3d/dc0 0 2024-02-07T12:26:02.404 INFO:tasks.workunit.client.0.smithi047.stdout:9/537: rename d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/fb9 to d3/d10/d18/d3b/fc1 0 2024-02-07T12:26:02.404 INFO:tasks.workunit.client.0.smithi047.stdout:0/525: rmdir d19/d40 39 2024-02-07T12:26:02.405 INFO:tasks.workunit.client.0.smithi047.stdout:9/538: mknod d3/d10/d18/d3a/cc2 0 2024-02-07T12:26:02.406 INFO:tasks.workunit.client.0.smithi047.stdout:0/526: unlink d19/d1c/f92 0 2024-02-07T12:26:02.408 INFO:tasks.workunit.client.0.smithi047.stdout:9/539: rename d3/d10/d18/f2e to d3/d10/d18/d3b/d3c/d5d/d9b/fc3 0 2024-02-07T12:26:02.408 INFO:tasks.workunit.client.0.smithi047.stdout:0/527: getdents d19/d1c/d2b 0 2024-02-07T12:26:02.426 INFO:tasks.workunit.client.0.smithi047.stdout:5/758: dread da/f34 [0,4194304] 0 2024-02-07T12:26:02.427 INFO:tasks.workunit.client.0.smithi047.stdout:5/759: rmdir da/df/d16/d25/d33 39 2024-02-07T12:26:02.428 INFO:tasks.workunit.client.0.smithi047.stdout:5/760: creat da/d24/d63/d85/db3/ffd x:0 0 0 2024-02-07T12:26:02.429 INFO:tasks.workunit.client.0.smithi047.stdout:9/540: dwrite d3/d10/d18/d3d/f46 [0,4194304] 0 2024-02-07T12:26:02.432 INFO:tasks.workunit.client.0.smithi047.stdout:0/528: dwrite d19/d40/d66/f8e [0,4194304] 0 2024-02-07T12:26:02.432 INFO:tasks.workunit.client.0.smithi047.stdout:0/529: write d19/d1c/d24/f56 [53904,56824] 0 2024-02-07T12:26:02.432 INFO:tasks.workunit.client.0.smithi047.stdout:0/530: fdatasync d19/f34 0 2024-02-07T12:26:02.440 INFO:tasks.workunit.client.0.smithi047.stdout:0/531: mknod d19/d1c/d3c/d37/ca4 0 2024-02-07T12:26:02.440 INFO:tasks.workunit.client.0.smithi047.stdout:5/761: write da/df/d16/d25/d33/f77 [1170539,121923] 0 2024-02-07T12:26:02.441 INFO:tasks.workunit.client.0.smithi047.stdout:0/532: mknod d19/d1c/d2b/ca5 0 2024-02-07T12:26:02.441 INFO:tasks.workunit.client.0.smithi047.stdout:6/699: dwrite d3/da/f6f [0,4194304] 0 2024-02-07T12:26:02.441 INFO:tasks.workunit.client.0.smithi047.stdout:6/700: readlink d3/d5/d35/d3c/la2 0 2024-02-07T12:26:02.444 INFO:tasks.workunit.client.0.smithi047.stdout:6/701: symlink d3/da/d14/d28/d46/d94/le6 0 2024-02-07T12:26:02.444 INFO:tasks.workunit.client.0.smithi047.stdout:6/702: creat d3/da/d3b/d87/fe7 x:0 0 0 2024-02-07T12:26:02.445 INFO:tasks.workunit.client.0.smithi047.stdout:5/762: rmdir da/df/d16/d25/d33/d55/d7c/deb 39 2024-02-07T12:26:02.447 INFO:tasks.workunit.client.0.smithi047.stdout:6/703: mkdir d3/da/d34/de8 0 2024-02-07T12:26:02.449 INFO:tasks.workunit.client.0.smithi047.stdout:6/704: rename d3/d5/d35/d3c/d90/f97 to d3/da/d3b/d87/de4/fe9 0 2024-02-07T12:26:02.450 INFO:tasks.workunit.client.0.smithi047.stdout:6/705: creat d3/da/d34/d6d/d8f/db3/dbc/dd7/fea x:0 0 0 2024-02-07T12:26:02.450 INFO:tasks.workunit.client.0.smithi047.stdout:6/706: creat d3/d5/d35/d3c/d72/d8c/d91/feb x:0 0 0 2024-02-07T12:26:02.450 INFO:tasks.workunit.client.0.smithi047.stdout:6/707: chown d3/d5/d35 0 1 2024-02-07T12:26:02.452 INFO:tasks.workunit.client.0.smithi047.stdout:6/708: symlink d3/lec 0 2024-02-07T12:26:02.452 INFO:tasks.workunit.client.0.smithi047.stdout:6/709: chown d3/da/d34/d6d/d8f/db3/dbc/fe0 30 1 2024-02-07T12:26:02.453 INFO:tasks.workunit.client.0.smithi047.stdout:6/710: dread - d3/da/d14/d28/d46/d94/fe5 zero size 2024-02-07T12:26:02.454 INFO:tasks.workunit.client.0.smithi047.stdout:6/711: creat d3/da/fed x:0 0 0 2024-02-07T12:26:02.454 INFO:tasks.workunit.client.0.smithi047.stdout:0/533: write d19/d1c/d2b/f88 [2565387,47932] 0 2024-02-07T12:26:02.454 INFO:tasks.workunit.client.0.smithi047.stdout:0/534: dread - d19/d1c/d2c/d8c/f91 zero size 2024-02-07T12:26:02.455 INFO:tasks.workunit.client.0.smithi047.stdout:6/712: symlink d3/da/d34/d6d/d8f/lee 0 2024-02-07T12:26:02.455 INFO:tasks.workunit.client.0.smithi047.stdout:9/541: dwrite d3/f85 [0,4194304] 0 2024-02-07T12:26:02.457 INFO:tasks.workunit.client.0.smithi047.stdout:0/535: mknod d19/d1c/d3c/d60/ca6 0 2024-02-07T12:26:02.463 INFO:tasks.workunit.client.0.smithi047.stdout:6/713: truncate d3/da/d34/d6d/fa7 1543346 0 2024-02-07T12:26:02.465 INFO:tasks.workunit.client.0.smithi047.stdout:6/714: read d3/d5/d35/d3c/d72/d8c/d95/f78 [531810,16695] 0 2024-02-07T12:26:02.466 INFO:tasks.workunit.client.0.smithi047.stdout:0/536: mkdir d19/d1c/d3c/d60/d6f/d95/da7 0 2024-02-07T12:26:02.466 INFO:tasks.workunit.client.0.smithi047.stdout:9/542: dread d3/f85 [0,4194304] 0 2024-02-07T12:26:02.467 INFO:tasks.workunit.client.0.smithi047.stdout:0/537: mknod d19/d1c/d3c/d60/d6f/d95/da7/ca8 0 2024-02-07T12:26:02.470 INFO:tasks.workunit.client.0.smithi047.stdout:0/538: mkdir d19/d40/d66/da9 0 2024-02-07T12:26:02.470 INFO:tasks.workunit.client.0.smithi047.stdout:9/543: mkdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4 0 2024-02-07T12:26:02.470 INFO:tasks.workunit.client.0.smithi047.stdout:9/544: readlink d3/d10/d18/d3d/lb6 0 2024-02-07T12:26:02.470 INFO:tasks.workunit.client.0.smithi047.stdout:9/545: creat d3/d10/d18/d3b/d3c/d5d/d68/fc5 x:0 0 0 2024-02-07T12:26:02.470 INFO:tasks.workunit.client.0.smithi047.stdout:9/546: dread d3/d10/d18/d3a/da7/fac [0,4194304] 0 2024-02-07T12:26:02.474 INFO:tasks.workunit.client.0.smithi047.stdout:6/715: dread d3/da/d34/d6d/d9f/fb6 [0,4194304] 0 2024-02-07T12:26:02.474 INFO:tasks.workunit.client.0.smithi047.stdout:6/716: chown d3/da/d14/lbd 9569765 1 2024-02-07T12:26:02.476 INFO:tasks.workunit.client.0.smithi047.stdout:9/547: mkdir d3/d10/d18/d3b/dc6 0 2024-02-07T12:26:02.476 INFO:tasks.workunit.client.0.smithi047.stdout:9/548: creat d3/d10/d18/fc7 x:0 0 0 2024-02-07T12:26:02.477 INFO:tasks.workunit.client.0.smithi047.stdout:9/549: dread d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/f54 [0,4194304] 0 2024-02-07T12:26:02.478 INFO:tasks.workunit.client.0.smithi047.stdout:9/550: fsync d3/d10/d18/d3b/fc1 0 2024-02-07T12:26:02.479 INFO:tasks.workunit.client.0.smithi047.stdout:0/539: rename d19/d1c/d2c to d19/d1c/d3c/d60/d6f/d95/daa 0 2024-02-07T12:26:02.484 INFO:tasks.workunit.client.0.smithi047.stdout:9/551: dread d3/d10/d18/d3d/f37 [0,4194304] 0 2024-02-07T12:26:02.484 INFO:tasks.workunit.client.0.smithi047.stdout:0/540: rename d19/d40/c6a to d19/d1c/d3c/d60/d6f/d95/daa/d8c/cab 0 2024-02-07T12:26:02.487 INFO:tasks.workunit.client.0.smithi047.stdout:6/717: getdents d3/d5 0 2024-02-07T12:26:02.489 INFO:tasks.workunit.client.0.smithi047.stdout:9/552: getdents d3/d10/d18/d3d 0 2024-02-07T12:26:02.492 INFO:tasks.workunit.client.0.smithi047.stdout:6/718: mknod d3/da/d14/d28/d46/d94/cef 0 2024-02-07T12:26:02.492 INFO:tasks.workunit.client.0.smithi047.stdout:6/719: readlink d3/da/d14/lbd 0 2024-02-07T12:26:02.494 INFO:tasks.workunit.client.0.smithi047.stdout:9/553: symlink d3/d10/d18/d3b/d3c/d5d/d70/dad/lc8 0 2024-02-07T12:26:02.500 INFO:tasks.workunit.client.0.smithi047.stdout:0/541: unlink d19/d1c/c1e 0 2024-02-07T12:26:02.500 INFO:tasks.workunit.client.0.smithi047.stdout:6/720: mkdir d3/da/d14/d28/df0 0 2024-02-07T12:26:02.502 INFO:tasks.workunit.client.0.smithi047.stdout:0/542: read d19/d1c/d3c/d37/f39 [380672,84270] 0 2024-02-07T12:26:02.506 INFO:tasks.workunit.client.0.smithi047.stdout:6/721: symlink d3/d5/d35/d3c/dd4/lf1 0 2024-02-07T12:26:02.507 INFO:tasks.workunit.client.0.smithi047.stdout:0/543: truncate d19/d1c/d3c/d60/f72 1810743 0 2024-02-07T12:26:02.507 INFO:tasks.workunit.client.0.smithi047.stdout:0/544: creat d19/d1c/d3c/d60/d6f/fac x:0 0 0 2024-02-07T12:26:02.507 INFO:tasks.workunit.client.0.smithi047.stdout:0/545: fsync d19/d1c/d3c/d60/d6f/d95/daa/d49/f65 0 2024-02-07T12:26:02.513 INFO:tasks.workunit.client.0.smithi047.stdout:9/554: dwrite d3/d10/f60 [0,4194304] 0 2024-02-07T12:26:02.514 INFO:tasks.workunit.client.0.smithi047.stdout:0/546: rename d19/d1c/c29 to d19/d1c/d2b/d5f/d9f/cad 0 2024-02-07T12:26:02.514 INFO:tasks.workunit.client.0.smithi047.stdout:0/547: chown cf 1250501 1 2024-02-07T12:26:02.517 INFO:tasks.workunit.client.0.smithi047.stdout:0/548: link d19/d1c/d24/f8f d19/d1c/d3c/d60/d6f/d95/daa/fae 0 2024-02-07T12:26:02.519 INFO:tasks.workunit.client.0.smithi047.stdout:0/549: creat d19/d40/d66/da9/faf x:0 0 0 2024-02-07T12:26:02.526 INFO:tasks.workunit.client.0.smithi047.stdout:0/550: dread d19/d1c/d2b/f88 [0,4194304] 0 2024-02-07T12:26:02.527 INFO:tasks.workunit.client.0.smithi047.stdout:0/551: write d19/f26 [2736278,37773] 0 2024-02-07T12:26:02.529 INFO:tasks.workunit.client.0.smithi047.stdout:0/552: creat d19/d25/fb0 x:0 0 0 2024-02-07T12:26:02.530 INFO:tasks.workunit.client.0.smithi047.stdout:0/553: mkdir d19/d1c/d24/db1 0 2024-02-07T12:26:02.541 INFO:tasks.workunit.client.0.smithi047.stdout:0/554: dread d19/f26 [0,4194304] 0 2024-02-07T12:26:02.543 INFO:tasks.workunit.client.0.smithi047.stdout:0/555: rename d19/d25/fb0 to d19/d1c/d3c/d60/d6f/d95/daa/d49/fb2 0 2024-02-07T12:26:02.543 INFO:tasks.workunit.client.0.smithi047.stdout:0/556: stat cf 0 2024-02-07T12:26:02.559 INFO:tasks.workunit.client.0.smithi047.stdout:0/557: dwrite d19/d1c/d24/f8f [0,4194304] 0 2024-02-07T12:26:02.560 INFO:tasks.workunit.client.0.smithi047.stdout:0/558: truncate d19/d40/d66/f8e 2945233 0 2024-02-07T12:26:02.578 INFO:tasks.workunit.client.0.smithi047.stdout:0/559: symlink d19/d40/d66/d81/d82/d9e/lb3 0 2024-02-07T12:26:02.583 INFO:tasks.workunit.client.0.smithi047.stdout:0/560: symlink d19/d1c/d3c/d37/lb4 0 2024-02-07T12:26:02.583 INFO:tasks.workunit.client.0.smithi047.stdout:0/561: readlink d19/d25/l6e 0 2024-02-07T12:26:02.668 INFO:tasks.workunit.client.0.smithi047.stdout:2/827: sync 2024-02-07T12:26:02.668 INFO:tasks.workunit.client.0.smithi047.stdout:2/828: read - d7/dc/f9e zero size 2024-02-07T12:26:02.668 INFO:tasks.workunit.client.0.smithi047.stdout:2/829: creat d7/d48/df0/f10d x:0 0 0 2024-02-07T12:26:02.688 INFO:tasks.workunit.client.0.smithi047.stdout:2/830: dwrite d7/dc/d71/fdf [0,4194304] 0 2024-02-07T12:26:02.711 INFO:tasks.workunit.client.0.smithi047.stdout:2/831: dwrite d7/f13 [0,4194304] 0 2024-02-07T12:26:02.712 INFO:tasks.workunit.client.0.smithi047.stdout:2/832: rename d7/dc/d71/fdf to d7/d48/d72/db7/f10e 0 2024-02-07T12:26:02.712 INFO:tasks.workunit.client.0.smithi047.stdout:2/833: getdents d7/d48/d72/db7/d102 0 2024-02-07T12:26:02.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:02 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:26:02.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:02 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:26:03.006 INFO:tasks.workunit.client.0.smithi047.stdout:1/551: sync 2024-02-07T12:26:03.007 INFO:tasks.workunit.client.0.smithi047.stdout:1/552: mknod d1/d15/d30/caa 0 2024-02-07T12:26:03.023 INFO:tasks.workunit.client.0.smithi047.stdout:1/553: dwrite d1/d6e/d75/da7/f4f [0,4194304] 0 2024-02-07T12:26:03.220 INFO:tasks.workunit.client.0.smithi047.stdout:4/900: sync 2024-02-07T12:26:03.220 INFO:tasks.workunit.client.0.smithi047.stdout:8/709: sync 2024-02-07T12:26:03.220 INFO:tasks.workunit.client.0.smithi047.stdout:3/727: sync 2024-02-07T12:26:03.220 INFO:tasks.workunit.client.0.smithi047.stdout:3/728: readlink d12/d19/l7b 0 2024-02-07T12:26:03.220 INFO:tasks.workunit.client.0.smithi047.stdout:8/710: read - d3/dbd/fe3 zero size 2024-02-07T12:26:03.220 INFO:tasks.workunit.client.0.smithi047.stdout:3/729: stat d12/dc7/d29/d6f/d93/dba/dbf/f80 0 2024-02-07T12:26:03.230 INFO:tasks.workunit.client.0.smithi047.stdout:3/730: dread d12/dc7/d29/d31/d38/f71 [0,4194304] 0 2024-02-07T12:26:03.252 INFO:tasks.workunit.client.0.smithi047.stdout:8/711: dwrite d3/d66/f7d [0,4194304] 0 2024-02-07T12:26:03.252 INFO:tasks.workunit.client.0.smithi047.stdout:4/901: dwrite d3/d27/dc5/d73/fe3 [0,4194304] 0 2024-02-07T12:26:03.255 INFO:tasks.workunit.client.0.smithi047.stdout:3/731: dwrite d12/dc7/d29/d31/d38/d59/fe5 [0,4194304] 0 2024-02-07T12:26:03.255 INFO:tasks.workunit.client.0.smithi047.stdout:3/732: chown d12/dc7/d29/d6f/d93/dba/dbf 361128 1 2024-02-07T12:26:03.255 INFO:tasks.workunit.client.0.smithi047.stdout:8/712: mkdir d3/d66/d67/d6a/dea 0 2024-02-07T12:26:03.259 INFO:tasks.workunit.client.0.smithi047.stdout:3/733: rmdir d12/dc7/d90/de9 0 2024-02-07T12:26:03.259 INFO:tasks.workunit.client.0.smithi047.stdout:8/713: mknod d3/d4/d4d/ceb 0 2024-02-07T12:26:03.261 INFO:tasks.workunit.client.0.smithi047.stdout:8/714: creat d3/d36/fec x:0 0 0 2024-02-07T12:26:03.261 INFO:tasks.workunit.client.0.smithi047.stdout:8/715: write d3/d66/f7a [1350503,62404] 0 2024-02-07T12:26:03.264 INFO:tasks.workunit.client.0.smithi047.stdout:8/716: rename d3/d4/d4d/dc0/fc9 to d3/d4/d59/fed 0 2024-02-07T12:26:03.264 INFO:tasks.workunit.client.0.smithi047.stdout:8/717: readlink d3/d4/lf 0 2024-02-07T12:26:03.266 INFO:tasks.workunit.client.0.smithi047.stdout:3/734: dread d12/f99 [0,4194304] 0 2024-02-07T12:26:03.268 INFO:tasks.workunit.client.0.smithi047.stdout:3/735: creat d12/dc7/d29/d6f/d93/dac/fef x:0 0 0 2024-02-07T12:26:03.269 INFO:tasks.workunit.client.0.smithi047.stdout:3/736: mkdir d12/dc7/d29/d6f/df0 0 2024-02-07T12:26:03.270 INFO:tasks.workunit.client.0.smithi047.stdout:4/902: dwrite d3/db1/d37/ff2 [0,4194304] 0 2024-02-07T12:26:03.270 INFO:tasks.workunit.client.0.smithi047.stdout:4/903: getdents d3/d27 0 2024-02-07T12:26:03.270 INFO:tasks.workunit.client.0.smithi047.stdout:4/904: chown d3/d27/fba 54156191 1 2024-02-07T12:26:03.270 INFO:tasks.workunit.client.0.smithi047.stdout:4/905: readlink d3/d27/d5e/lb2 0 2024-02-07T12:26:03.271 INFO:tasks.workunit.client.0.smithi047.stdout:4/906: chown d3/d61/d70/d8b/ddb/db7 81088 1 2024-02-07T12:26:03.271 INFO:tasks.workunit.client.0.smithi047.stdout:4/907: creat d3/db1/de5/f133 x:0 0 0 2024-02-07T12:26:03.271 INFO:tasks.workunit.client.0.smithi047.stdout:4/908: stat d3/d61/d70/d8b/ddb/d66/fec 0 2024-02-07T12:26:03.271 INFO:tasks.workunit.client.0.smithi047.stdout:4/909: creat d3/d61/d70/d8b/ddb/d63/db3/d100/f134 x:0 0 0 2024-02-07T12:26:03.271 INFO:tasks.workunit.client.0.smithi047.stdout:3/737: mknod d12/dc7/d29/d6f/d93/cf1 0 2024-02-07T12:26:03.271 INFO:tasks.workunit.client.0.smithi047.stdout:3/738: fsync d12/d19/d2d/d82/fcc 0 2024-02-07T12:26:03.271 INFO:tasks.workunit.client.0.smithi047.stdout:8/718: dread d3/d66/d67/d6a/f46 [4194304,4194304] 0 2024-02-07T12:26:03.283 INFO:tasks.workunit.client.0.smithi047.stdout:4/910: rename d3/db1/de5 to d3/d61/d70/d8b/d135 0 2024-02-07T12:26:03.283 INFO:tasks.workunit.client.0.smithi047.stdout:4/911: stat d3/f106 0 2024-02-07T12:26:03.283 INFO:tasks.workunit.client.0.smithi047.stdout:4/912: chown d3/d61/d70/d8b/fa4 1315679370 1 2024-02-07T12:26:03.283 INFO:tasks.workunit.client.0.smithi047.stdout:4/913: fdatasync d3/d61/f60 0 2024-02-07T12:26:03.287 INFO:tasks.workunit.client.0.smithi047.stdout:8/719: rename d3/d36/d50/d30/d34/d3e/l60 to d3/d36/d9d/dbe/lee 0 2024-02-07T12:26:03.287 INFO:tasks.workunit.client.0.smithi047.stdout:3/739: dwrite d12/dc7/d29/d31/f45 [0,4194304] 0 2024-02-07T12:26:03.289 INFO:tasks.workunit.client.0.smithi047.stdout:4/914: symlink d3/d61/d70/d8b/ddb/d63/dda/l136 0 2024-02-07T12:26:03.289 INFO:tasks.workunit.client.0.smithi047.stdout:4/915: getdents d3/d61/d70/d8b/ddb/d66/dfe 0 2024-02-07T12:26:03.291 INFO:tasks.workunit.client.0.smithi047.stdout:3/740: link d12/dc7/d29/d31/d38/d59/d87/dc5/ccb d12/dc7/d29/d31/d7c/d8c/cf2 0 2024-02-07T12:26:03.291 INFO:tasks.workunit.client.0.smithi047.stdout:3/741: write d12/fcd [50223,19615] 0 2024-02-07T12:26:03.291 INFO:tasks.workunit.client.0.smithi047.stdout:8/720: write d3/d36/f68 [218803,93940] 0 2024-02-07T12:26:03.292 INFO:tasks.workunit.client.0.smithi047.stdout:3/742: getdents d12/dc7/d29/d6f/d93/dba 0 2024-02-07T12:26:03.292 INFO:tasks.workunit.client.0.smithi047.stdout:3/743: read - d12/d19/fde zero size 2024-02-07T12:26:03.294 INFO:tasks.workunit.client.0.smithi047.stdout:8/721: getdents d3/d36/de2 0 2024-02-07T12:26:03.294 INFO:tasks.workunit.client.0.smithi047.stdout:3/744: mkdir d12/dc7/d29/d31/d7c/df3 0 2024-02-07T12:26:03.295 INFO:tasks.workunit.client.0.smithi047.stdout:8/722: symlink d3/d36/d50/d28/lef 0 2024-02-07T12:26:03.297 INFO:tasks.workunit.client.0.smithi047.stdout:3/745: rename d12/dc7/d29/d31/d7c/fc6 to d12/dc7/d29/d6f/d93/dac/ff4 0 2024-02-07T12:26:03.299 INFO:tasks.workunit.client.0.smithi047.stdout:3/746: link d12/dc7/d29/d31/d38/d59/f67 d12/d19/d2d/d42/ff5 0 2024-02-07T12:26:03.300 INFO:tasks.workunit.client.0.smithi047.stdout:3/747: write d12/d19/d2d/d52/f9e [2398813,122158] 0 2024-02-07T12:26:03.306 INFO:tasks.workunit.client.0.smithi047.stdout:4/916: dwrite d3/d61/d70/d8b/ddb/d66/f80 [0,4194304] 0 2024-02-07T12:26:03.307 INFO:tasks.workunit.client.0.smithi047.stdout:3/748: dread d12/f14 [0,4194304] 0 2024-02-07T12:26:03.307 INFO:tasks.workunit.client.0.smithi047.stdout:3/749: read d12/dc7/d29/d6f/d93/dac/ff4 [3703565,875] 0 2024-02-07T12:26:03.307 INFO:tasks.workunit.client.0.smithi047.stdout:3/750: chown d12/dc7/d29/d31/d61/c7a 450021273 1 2024-02-07T12:26:03.308 INFO:tasks.workunit.client.0.smithi047.stdout:4/917: link d3/d27/d3b/d7d/faf d3/d61/d70/d83/d85/f137 0 2024-02-07T12:26:03.309 INFO:tasks.workunit.client.0.smithi047.stdout:3/751: creat d12/dc7/d29/d6f/d93/dba/ff6 x:0 0 0 2024-02-07T12:26:03.310 INFO:tasks.workunit.client.0.smithi047.stdout:3/752: creat d12/d19/d2d/ff7 x:0 0 0 2024-02-07T12:26:03.311 INFO:tasks.workunit.client.0.smithi047.stdout:3/753: rename d12/dc7/d29/d31/d38/d59/de6/d95/ca8 to d12/dc7/d29/d31/d38/d59/de6/d95/cf8 0 2024-02-07T12:26:03.313 INFO:tasks.workunit.client.0.smithi047.stdout:3/754: unlink d12/dc7/d29/d6f/fb6 0 2024-02-07T12:26:03.313 INFO:tasks.workunit.client.0.smithi047.stdout:3/755: truncate d12/f13 4716717 0 2024-02-07T12:26:03.313 INFO:tasks.workunit.client.0.smithi047.stdout:4/918: dread d3/d61/d70/d8b/ddb/d66/f7e [0,4194304] 0 2024-02-07T12:26:03.324 INFO:tasks.workunit.client.0.smithi047.stdout:3/756: write d12/dc7/d29/d31/d38/d59/fe5 [208796,81590] 0 2024-02-07T12:26:03.324 INFO:tasks.workunit.client.0.smithi047.stdout:3/757: fsync d12/fc0 0 2024-02-07T12:26:03.324 INFO:tasks.workunit.client.0.smithi047.stdout:3/758: chown d12/dc7/d29/d6f/d93/dba/ff6 4831424 1 2024-02-07T12:26:03.324 INFO:tasks.workunit.client.0.smithi047.stdout:3/759: read d12/d19/f26 [1902805,59584] 0 2024-02-07T12:26:03.324 INFO:tasks.workunit.client.0.smithi047.stdout:3/760: fsync d12/d19/f26 0 2024-02-07T12:26:03.324 INFO:tasks.workunit.client.0.smithi047.stdout:3/761: readlink d12/dc7/d29/d31/d61/lda 0 2024-02-07T12:26:03.324 INFO:tasks.workunit.client.0.smithi047.stdout:3/762: chown d12/dc7/l54 0 1 2024-02-07T12:26:03.325 INFO:tasks.workunit.client.0.smithi047.stdout:3/763: stat d12/dc7/d29/d6f/d93/cf1 0 2024-02-07T12:26:03.325 INFO:tasks.workunit.client.0.smithi047.stdout:3/764: creat d12/dc7/d29/d6f/d93/dac/ff9 x:0 0 0 2024-02-07T12:26:03.325 INFO:tasks.workunit.client.0.smithi047.stdout:4/919: dread d3/d61/d70/d8b/ddb/d63/f93 [0,4194304] 0 2024-02-07T12:26:03.326 INFO:tasks.workunit.client.0.smithi047.stdout:3/765: mknod d12/dc7/d29/d6f/d93/dba/cfa 0 2024-02-07T12:26:03.327 INFO:tasks.workunit.client.0.smithi047.stdout:4/920: truncate d3/d61/d43/f4c 3297822 0 2024-02-07T12:26:03.328 INFO:tasks.workunit.client.0.smithi047.stdout:4/921: write d3/d27/dc5/f103 [319503,71287] 0 2024-02-07T12:26:03.328 INFO:tasks.workunit.client.0.smithi047.stdout:3/766: fdatasync d12/dc7/d29/d31/d38/d59/fe5 0 2024-02-07T12:26:03.330 INFO:tasks.workunit.client.0.smithi047.stdout:4/922: rename d3/d27/dd8/d126 to d3/d61/d70/d83/d138 0 2024-02-07T12:26:03.332 INFO:tasks.workunit.client.0.smithi047.stdout:3/767: mknod d12/dc7/cfb 0 2024-02-07T12:26:03.332 INFO:tasks.workunit.client.0.smithi047.stdout:3/768: dread - d12/dc7/d29/d31/d38/d59/de6/d95/fce zero size 2024-02-07T12:26:03.333 INFO:tasks.workunit.client.0.smithi047.stdout:4/923: mkdir d3/db1/d139 0 2024-02-07T12:26:03.349 INFO:tasks.workunit.client.0.smithi047.stdout:4/924: dwrite d3/d27/d3b/d7d/f82 [0,4194304] 0 2024-02-07T12:26:03.351 INFO:tasks.workunit.client.0.smithi047.stdout:3/769: dwrite d12/dc7/d29/d31/d7c/fab [4194304,4194304] 0 2024-02-07T12:26:03.351 INFO:tasks.workunit.client.0.smithi047.stdout:4/925: creat d3/d61/d70/d8b/f13a x:0 0 0 2024-02-07T12:26:03.351 INFO:tasks.workunit.client.0.smithi047.stdout:4/926: read d3/d27/d5e/dd0/f111 [314510,7885] 0 2024-02-07T12:26:03.351 INFO:tasks.workunit.client.0.smithi047.stdout:4/927: write d3/d61/d70/d8b/ddb/d66/f7e [2327314,14454] 0 2024-02-07T12:26:03.352 INFO:tasks.workunit.client.0.smithi047.stdout:3/770: mknod d12/dc7/d29/d31/d38/d59/d87/cfc 0 2024-02-07T12:26:03.353 INFO:tasks.workunit.client.0.smithi047.stdout:4/928: rmdir d3/db1 39 2024-02-07T12:26:03.357 INFO:tasks.workunit.client.0.smithi047.stdout:4/929: dread d3/d61/d70/d8b/ddb/d63/db3/fcc [0,4194304] 0 2024-02-07T12:26:03.357 INFO:tasks.workunit.client.0.smithi047.stdout:4/930: readlink d3/d27/d3b/d7d/l114 0 2024-02-07T12:26:03.359 INFO:tasks.workunit.client.0.smithi047.stdout:4/931: dread d3/d61/d70/d8b/fa4 [0,4194304] 0 2024-02-07T12:26:03.364 INFO:tasks.workunit.client.0.smithi047.stdout:3/771: dread d12/d19/d2d/d52/f9e [0,4194304] 0 2024-02-07T12:26:03.369 INFO:tasks.workunit.client.0.smithi047.stdout:4/932: dread d3/db1/f125 [0,4194304] 0 2024-02-07T12:26:03.370 INFO:tasks.workunit.client.0.smithi047.stdout:4/933: creat d3/d27/d3b/d7d/f13b x:0 0 0 2024-02-07T12:26:03.371 INFO:tasks.workunit.client.0.smithi047.stdout:4/934: fdatasync d3/d61/d70/d8b/ddb/d63/ffb 0 2024-02-07T12:26:03.371 INFO:tasks.workunit.client.0.smithi047.stdout:4/935: write d3/d61/faa [294462,7385] 0 2024-02-07T12:26:03.371 INFO:tasks.workunit.client.0.smithi047.stdout:4/936: readlink d3/d61/d70/d8b/ddb/d63/db3/dd4/l109 0 2024-02-07T12:26:03.373 INFO:tasks.workunit.client.0.smithi047.stdout:3/772: dread d12/d19/f8f [0,4194304] 0 2024-02-07T12:26:03.382 INFO:tasks.workunit.client.0.smithi047.stdout:3/773: dread d12/dc7/d29/d31/f45 [0,4194304] 0 2024-02-07T12:26:03.384 INFO:tasks.workunit.client.0.smithi047.stdout:3/774: getdents d12/d19/d2d/d33/da5 0 2024-02-07T12:26:03.385 INFO:tasks.workunit.client.0.smithi047.stdout:4/937: dwrite d3/d61/faa [0,4194304] 0 2024-02-07T12:26:03.386 INFO:tasks.workunit.client.0.smithi047.stdout:3/775: rename d12/dc7/d29/da9/lea to d12/dc7/d29/d44/lfd 0 2024-02-07T12:26:03.386 INFO:tasks.workunit.client.0.smithi047.stdout:3/776: dread - d12/dc7/d29/d31/d38/d59/de6/fae zero size 2024-02-07T12:26:03.387 INFO:tasks.workunit.client.0.smithi047.stdout:4/938: write d3/d27/d3b/f42 [4277026,108714] 0 2024-02-07T12:26:03.388 INFO:tasks.workunit.client.0.smithi047.stdout:3/777: rmdir d12/d19/d37 39 2024-02-07T12:26:03.390 INFO:tasks.workunit.client.0.smithi047.stdout:4/939: mknod d3/d27/d5e/d10f/c13c 0 2024-02-07T12:26:03.391 INFO:tasks.workunit.client.0.smithi047.stdout:3/778: creat d12/dc7/d29/d31/ffe x:0 0 0 2024-02-07T12:26:03.392 INFO:tasks.workunit.client.0.smithi047.stdout:3/779: mkdir d12/d19/d2d/d33/d8d/dff 0 2024-02-07T12:26:03.393 INFO:tasks.workunit.client.0.smithi047.stdout:3/780: rmdir d12/dc7/d29/da9 39 2024-02-07T12:26:03.395 INFO:tasks.workunit.client.0.smithi047.stdout:3/781: link d12/dc7/d90/dad/caf d12/dc7/d29/d31/d7c/c100 0 2024-02-07T12:26:03.396 INFO:tasks.workunit.client.0.smithi047.stdout:3/782: symlink d12/dc7/d90/dad/l101 0 2024-02-07T12:26:03.406 INFO:tasks.workunit.client.0.smithi047.stdout:3/783: write d12/f64 [3570812,14975] 0 2024-02-07T12:26:03.407 INFO:tasks.workunit.client.0.smithi047.stdout:4/940: dwrite d3/d27/dc5/d73/fdc [8388608,4194304] 0 2024-02-07T12:26:03.408 INFO:tasks.workunit.client.0.smithi047.stdout:4/941: write d3/d27/d5e/f12b [90976,98955] 0 2024-02-07T12:26:03.408 INFO:tasks.workunit.client.0.smithi047.stdout:4/942: creat d3/d27/d3b/d7d/da2/f13d x:0 0 0 2024-02-07T12:26:03.409 INFO:tasks.workunit.client.0.smithi047.stdout:4/943: dread - d3/d61/d70/d8b/ddb/f119 zero size 2024-02-07T12:26:03.409 INFO:tasks.workunit.client.0.smithi047.stdout:4/944: read - d3/d61/d70/d8b/ddb/db7/fbd zero size 2024-02-07T12:26:03.409 INFO:tasks.workunit.client.0.smithi047.stdout:3/784: unlink d12/dc7/d90/dad/l101 0 2024-02-07T12:26:03.410 INFO:tasks.workunit.client.0.smithi047.stdout:3/785: dread d12/d19/d2d/f8b [0,4194304] 0 2024-02-07T12:26:03.411 INFO:tasks.workunit.client.0.smithi047.stdout:4/945: rename d3/l1f to d3/db1/d139/l13e 0 2024-02-07T12:26:03.411 INFO:tasks.workunit.client.0.smithi047.stdout:4/946: write d3/db1/f6e [3746234,47886] 0 2024-02-07T12:26:03.411 INFO:tasks.workunit.client.0.smithi047.stdout:4/947: chown d3/db1/f125 125 1 2024-02-07T12:26:03.412 INFO:tasks.workunit.client.0.smithi047.stdout:3/786: unlink d12/dc7/c65 0 2024-02-07T12:26:03.412 INFO:tasks.workunit.client.0.smithi047.stdout:3/787: stat d12/dc7/d29/d31 0 2024-02-07T12:26:03.412 INFO:tasks.workunit.client.0.smithi047.stdout:3/788: write d12/d19/f26 [552768,14349] 0 2024-02-07T12:26:03.413 INFO:tasks.workunit.client.0.smithi047.stdout:4/948: mkdir d3/d61/d70/d8b/ddb/db7/d13f 0 2024-02-07T12:26:03.414 INFO:tasks.workunit.client.0.smithi047.stdout:4/949: rename d3/d61/d70/f11b to d3/d27/d3b/d7d/da2/f140 0 2024-02-07T12:26:03.423 INFO:tasks.workunit.client.0.smithi047.stdout:3/789: dread d12/d19/d2d/d42/ff5 [0,4194304] 0 2024-02-07T12:26:03.423 INFO:tasks.workunit.client.0.smithi047.stdout:3/790: symlink d12/dc7/d29/d31/d38/d59/d87/dc5/l102 0 2024-02-07T12:26:03.425 INFO:tasks.workunit.client.0.smithi047.stdout:3/791: unlink d12/dc7/d29/ccf 0 2024-02-07T12:26:03.426 INFO:tasks.workunit.client.0.smithi047.stdout:3/792: dread d12/d19/d2d/f8b [0,4194304] 0 2024-02-07T12:26:03.444 INFO:tasks.workunit.client.0.smithi047.stdout:4/950: dwrite d3/d27/d3b/d7d/da2/fc9 [0,4194304] 0 2024-02-07T12:26:03.448 INFO:tasks.workunit.client.0.smithi047.stdout:3/793: dwrite d12/dc7/d29/f81 [0,4194304] 0 2024-02-07T12:26:03.448 INFO:tasks.workunit.client.0.smithi047.stdout:3/794: readlink d12/d19/d2d/d42/l78 0 2024-02-07T12:26:03.449 INFO:tasks.workunit.client.0.smithi047.stdout:3/795: readlink d12/d19/d2d/d33/da5/ld2 0 2024-02-07T12:26:03.456 INFO:tasks.workunit.client.0.smithi047.stdout:4/951: truncate d3/d61/fa1 2688938 0 2024-02-07T12:26:03.458 INFO:tasks.workunit.client.0.smithi047.stdout:3/796: rename d12/d19/d2d/ff7 to d12/dc7/d29/d31/d38/d59/d87/dc5/f103 0 2024-02-07T12:26:03.461 INFO:tasks.workunit.client.0.smithi047.stdout:4/952: mkdir d3/db1/d141 0 2024-02-07T12:26:03.461 INFO:tasks.workunit.client.0.smithi047.stdout:4/953: fdatasync d3/d27/d3b/d7d/f13b 0 2024-02-07T12:26:03.461 INFO:tasks.workunit.client.0.smithi047.stdout:4/954: read d3/d27/d5e/fab [9192,79863] 0 2024-02-07T12:26:03.461 INFO:tasks.workunit.client.0.smithi047.stdout:4/955: write d3/d61/d70/d8b/ddb/db7/f110 [264514,53875] 0 2024-02-07T12:26:03.476 INFO:tasks.workunit.client.0.smithi047.stdout:4/956: dwrite d3/d61/d70/d8b/fa4 [0,4194304] 0 2024-02-07T12:26:03.490 INFO:tasks.workunit.client.0.smithi047.stdout:4/957: dwrite d3/d27/dc5/d73/fd2 [0,4194304] 0 2024-02-07T12:26:03.510 INFO:tasks.workunit.client.0.smithi047.stdout:4/958: dwrite d3/d27/d5e/f12b [0,4194304] 0 2024-02-07T12:26:03.528 INFO:tasks.workunit.client.0.smithi047.stdout:4/959: dwrite d3/d61/d70/d8b/ddb/d66/f7e [0,4194304] 0 2024-02-07T12:26:03.529 INFO:tasks.workunit.client.0.smithi047.stdout:4/960: mknod d3/c142 0 2024-02-07T12:26:03.549 INFO:tasks.workunit.client.0.smithi047.stdout:4/961: dwrite d3/d61/d70/d8b/d135/fed [0,4194304] 0 2024-02-07T12:26:03.550 INFO:tasks.workunit.client.0.smithi047.stdout:4/962: chown d3/d61/d70/d8b/ddb/d66/l5a 1980499 1 2024-02-07T12:26:03.551 INFO:tasks.workunit.client.0.smithi047.stdout:4/963: symlink d3/db1/l143 0 2024-02-07T12:26:03.551 INFO:tasks.workunit.client.0.smithi047.stdout:4/964: chown d3/d27/dc5 1008614 1 2024-02-07T12:26:03.553 INFO:tasks.workunit.client.0.smithi047.stdout:4/965: creat d3/d27/d5e/f144 x:0 0 0 2024-02-07T12:26:03.553 INFO:tasks.workunit.client.0.smithi047.stdout:4/966: creat d3/d61/d70/d8b/ddb/d63/db3/f145 x:0 0 0 2024-02-07T12:26:03.555 INFO:tasks.workunit.client.0.smithi047.stdout:4/967: rename d3/d61/d70/d8b/ddb/d63/db3/dd4/fdf to d3/d27/d3b/f146 0 2024-02-07T12:26:03.558 INFO:tasks.workunit.client.0.smithi047.stdout:4/968: rename d3/d61/d70/d8b/ddb/d63/db3/d102 to d3/d147 0 2024-02-07T12:26:03.558 INFO:tasks.workunit.client.0.smithi047.stdout:4/969: creat d3/d61/d70/f148 x:0 0 0 2024-02-07T12:26:03.560 INFO:tasks.workunit.client.0.smithi047.stdout:4/970: creat d3/d27/dd8/f149 x:0 0 0 2024-02-07T12:26:03.560 INFO:tasks.workunit.client.0.smithi047.stdout:4/971: readlink d3/d61/d70/d8b/ddb/d63/db3/lc6 0 2024-02-07T12:26:03.563 INFO:tasks.workunit.client.0.smithi047.stdout:4/972: rename d3/c1e to d3/db1/d37/da9/dcb/c14a 0 2024-02-07T12:26:03.571 INFO:tasks.workunit.client.0.smithi047.stdout:4/973: read d3/d61/d70/d8b/ddb/d63/fc3 [3528089,82257] 0 2024-02-07T12:26:03.571 INFO:tasks.workunit.client.0.smithi047.stdout:4/974: readlink d3/d27/l6b 0 2024-02-07T12:26:03.573 INFO:tasks.workunit.client.0.smithi047.stdout:4/975: creat d3/d61/d70/d83/d85/dee/f14b x:0 0 0 2024-02-07T12:26:03.573 INFO:tasks.workunit.client.0.smithi047.stdout:4/976: creat d3/d27/d3b/d7d/f14c x:0 0 0 2024-02-07T12:26:03.578 INFO:tasks.workunit.client.0.smithi047.stdout:4/977: getdents d3 0 2024-02-07T12:26:03.580 INFO:tasks.workunit.client.0.smithi047.stdout:4/978: getdents d3/d61/d70/d83/d85/dee 0 2024-02-07T12:26:03.583 INFO:tasks.workunit.client.0.smithi047.stdout:4/979: creat d3/d61/d70/d8b/ddb/db7/d13f/f14d x:0 0 0 2024-02-07T12:26:03.584 INFO:tasks.workunit.client.0.smithi047.stdout:4/980: unlink d3/d27/c11f 0 2024-02-07T12:26:03.585 INFO:tasks.workunit.client.0.smithi047.stdout:4/981: symlink d3/d27/d5e/l14e 0 2024-02-07T12:26:03.585 INFO:tasks.workunit.client.0.smithi047.stdout:4/982: write d3/d27/d5e/dd0/f12e [508513,58340] 0 2024-02-07T12:26:03.586 INFO:tasks.workunit.client.0.smithi047.stdout:4/983: chown d3/d61/d70/f148 3834 1 2024-02-07T12:26:03.600 INFO:tasks.workunit.client.0.smithi047.stdout:4/984: dwrite d3/db1/d37/da9/f122 [0,4194304] 0 2024-02-07T12:26:03.602 INFO:tasks.workunit.client.0.smithi047.stdout:4/985: mknod d3/d61/d70/d8b/ddb/d63/db3/c14f 0 2024-02-07T12:26:03.626 INFO:tasks.workunit.client.0.smithi047.stdout:4/986: dwrite d3/d61/d70/d8b/d135/fed [0,4194304] 0 2024-02-07T12:26:03.626 INFO:tasks.workunit.client.0.smithi047.stdout:4/987: creat d3/db1/d37/f150 x:0 0 0 2024-02-07T12:26:03.642 INFO:tasks.workunit.client.0.smithi047.stdout:4/988: dwrite d3/db1/f86 [0,4194304] 0 2024-02-07T12:26:03.644 INFO:tasks.workunit.client.0.smithi047.stdout:4/989: mkdir d3/d27/d3b/d7d/d151 0 2024-02-07T12:26:03.645 INFO:tasks.workunit.client.0.smithi047.stdout:4/990: truncate d3/f54 1273300 0 2024-02-07T12:26:03.645 INFO:tasks.workunit.client.0.smithi047.stdout:4/991: creat d3/d61/d70/f152 x:0 0 0 2024-02-07T12:26:03.645 INFO:tasks.workunit.client.0.smithi047.stdout:4/992: stat d3/db1/ff1 0 2024-02-07T12:26:03.645 INFO:tasks.workunit.client.0.smithi047.stdout:7/788: sync 2024-02-07T12:26:03.646 INFO:tasks.workunit.client.0.smithi047.stdout:5/763: sync 2024-02-07T12:26:03.646 INFO:tasks.workunit.client.0.smithi047.stdout:6/722: sync 2024-02-07T12:26:03.646 INFO:tasks.workunit.client.0.smithi047.stdout:7/789: creat d0/df/fff x:0 0 0 2024-02-07T12:26:03.646 INFO:tasks.workunit.client.0.smithi047.stdout:7/790: chown d0/df/d29/d31/l6b 58 1 2024-02-07T12:26:03.648 INFO:tasks.workunit.client.0.smithi047.stdout:7/791: read d0/df/d29/d3e/fac [314096,59285] 0 2024-02-07T12:26:03.648 INFO:tasks.workunit.client.0.smithi047.stdout:7/792: write d0/d42/f4b [446508,49869] 0 2024-02-07T12:26:03.649 INFO:tasks.workunit.client.0.smithi047.stdout:7/793: read d0/d42/d4d/d67/dfd/fea [6966959,52674] 0 2024-02-07T12:26:03.649 INFO:tasks.workunit.client.0.smithi047.stdout:7/794: readlink d0/d2f/l70 0 2024-02-07T12:26:03.649 INFO:tasks.workunit.client.0.smithi047.stdout:7/795: readlink d0/d42/d4d/l5d 0 2024-02-07T12:26:03.653 INFO:tasks.workunit.client.0.smithi047.stdout:4/993: dread d3/db1/f6e [0,4194304] 0 2024-02-07T12:26:03.653 INFO:tasks.workunit.client.0.smithi047.stdout:4/994: creat d3/d27/d3b/d7d/f153 x:0 0 0 2024-02-07T12:26:03.654 INFO:tasks.workunit.client.0.smithi047.stdout:5/764: dread da/df/d16/fbd [0,4194304] 0 2024-02-07T12:26:03.654 INFO:tasks.workunit.client.0.smithi047.stdout:5/765: chown da/d24/d63/d9c/da3/fbf 473 1 2024-02-07T12:26:03.657 INFO:tasks.workunit.client.0.smithi047.stdout:7/796: read d0/df/d29/f68 [1474987,80518] 0 2024-02-07T12:26:03.663 INFO:tasks.workunit.client.0.smithi047.stdout:4/995: mknod d3/d27/dd8/d128/c154 0 2024-02-07T12:26:03.663 INFO:tasks.workunit.client.0.smithi047.stdout:5/766: dread da/d24/d63/d9a/df2/fae [0,4194304] 0 2024-02-07T12:26:03.670 INFO:tasks.workunit.client.0.smithi047.stdout:5/767: write da/df/d16/d25/d33/d55/d7c/fcd [919720,8490] 0 2024-02-07T12:26:03.679 INFO:tasks.workunit.client.0.smithi047.stdout:7/797: dwrite d0/d42/d4d/d67/fb3 [0,4194304] 0 2024-02-07T12:26:03.679 INFO:tasks.workunit.client.0.smithi047.stdout:6/723: dwrite d3/da/f6f [0,4194304] 0 2024-02-07T12:26:03.680 INFO:tasks.workunit.client.0.smithi047.stdout:6/724: dread d3/da/da9/fd1 [0,4194304] 0 2024-02-07T12:26:03.683 INFO:tasks.workunit.client.0.smithi047.stdout:7/798: truncate d0/df/d74/df5/f71 3707718 0 2024-02-07T12:26:03.685 INFO:tasks.workunit.client.0.smithi047.stdout:6/725: creat d3/da/d34/d6d/ff2 x:0 0 0 2024-02-07T12:26:03.686 INFO:tasks.workunit.client.0.smithi047.stdout:7/799: rmdir d0/df/d29/d3e/d4c/d97/de3 39 2024-02-07T12:26:03.687 INFO:tasks.workunit.client.0.smithi047.stdout:5/768: dwrite da/d24/d63/d9c/da3/fea [0,4194304] 0 2024-02-07T12:26:03.687 INFO:tasks.workunit.client.0.smithi047.stdout:6/726: truncate d3/da/d14/f2d 2656959 0 2024-02-07T12:26:03.689 INFO:tasks.workunit.client.0.smithi047.stdout:7/800: creat d0/d42/d4d/f100 x:0 0 0 2024-02-07T12:26:03.689 INFO:tasks.workunit.client.0.smithi047.stdout:7/801: read d0/d42/d4d/d67/dfd/fea [4983939,93681] 0 2024-02-07T12:26:03.694 INFO:tasks.workunit.client.0.smithi047.stdout:5/769: symlink da/df/d16/d25/d33/d6e/dbb/lfe 0 2024-02-07T12:26:03.695 INFO:tasks.workunit.client.0.smithi047.stdout:5/770: dread da/df/d16/d25/d33/d91/fbe [0,4194304] 0 2024-02-07T12:26:03.695 INFO:tasks.workunit.client.0.smithi047.stdout:6/727: symlink d3/da/d34/lf3 0 2024-02-07T12:26:03.696 INFO:tasks.workunit.client.0.smithi047.stdout:5/771: mknod da/df/d16/d25/dc1/cff 0 2024-02-07T12:26:03.696 INFO:tasks.workunit.client.0.smithi047.stdout:5/772: chown da/df/d16/d25/d33/d55/d7c/deb/cf4 4 1 2024-02-07T12:26:03.697 INFO:tasks.workunit.client.0.smithi047.stdout:7/802: dread d0/d4/f17 [0,4194304] 0 2024-02-07T12:26:03.698 INFO:tasks.workunit.client.0.smithi047.stdout:6/728: symlink d3/d5/d35/d3c/d72/lf4 0 2024-02-07T12:26:03.699 INFO:tasks.workunit.client.0.smithi047.stdout:7/803: write d0/d4/f16 [639089,98600] 0 2024-02-07T12:26:03.699 INFO:tasks.workunit.client.0.smithi047.stdout:7/804: fsync d0/fa4 0 2024-02-07T12:26:03.699 INFO:tasks.workunit.client.0.smithi047.stdout:7/805: truncate d0/df/d29/d3e/f56 3692076 0 2024-02-07T12:26:03.699 INFO:tasks.workunit.client.0.smithi047.stdout:7/806: readlink d0/d42/d4d/lcf 0 2024-02-07T12:26:03.700 INFO:tasks.workunit.client.0.smithi047.stdout:7/807: getdents d0/dd0 0 2024-02-07T12:26:03.700 INFO:tasks.workunit.client.0.smithi047.stdout:5/773: rename da/df/f28 to da/df/d16/d25/dc1/f100 0 2024-02-07T12:26:03.700 INFO:tasks.workunit.client.0.smithi047.stdout:5/774: chown da/df/l21 246535027 1 2024-02-07T12:26:03.702 INFO:tasks.workunit.client.0.smithi047.stdout:7/808: truncate d0/d4/da2/fe2 394783 0 2024-02-07T12:26:03.706 INFO:tasks.workunit.client.0.smithi047.stdout:5/775: rename da/df/d16/d25/d33/d6e/da8/cb5 to da/df/d16/d41/d57/d6c/db1/c101 0 2024-02-07T12:26:03.709 INFO:tasks.workunit.client.0.smithi047.stdout:5/776: unlink da/df/d16/d25/d71/d68/f9b 0 2024-02-07T12:26:03.709 INFO:tasks.workunit.client.0.smithi047.stdout:5/777: chown da/df/d16/d41/d57/d6c/ce8 3521 1 2024-02-07T12:26:03.723 INFO:tasks.workunit.client.0.smithi047.stdout:6/729: dwrite d3/d5/f27 [0,4194304] 0 2024-02-07T12:26:03.734 INFO:tasks.workunit.client.0.smithi047.stdout:7/809: dwrite d0/df/d29/ffb [0,4194304] 0 2024-02-07T12:26:03.734 INFO:tasks.workunit.client.0.smithi047.stdout:7/810: truncate d0/df/d74/df5/f71 4383725 0 2024-02-07T12:26:03.734 INFO:tasks.workunit.client.0.smithi047.stdout:5/778: dwrite da/d24/d63/d9a/dec/f99 [0,4194304] 0 2024-02-07T12:26:03.734 INFO:tasks.workunit.client.0.smithi047.stdout:5/779: chown da/df/d16/d25 74638952 1 2024-02-07T12:26:03.734 INFO:tasks.workunit.client.0.smithi047.stdout:5/780: fsync da/df/d16/f3d 0 2024-02-07T12:26:03.734 INFO:tasks.workunit.client.0.smithi047.stdout:5/781: chown da/d24/d63/d9c/da3/dfc 1 1 2024-02-07T12:26:03.734 INFO:tasks.workunit.client.0.smithi047.stdout:6/730: write d3/da/d3b/d55/fc0 [3199918,4085] 0 2024-02-07T12:26:03.734 INFO:tasks.workunit.client.0.smithi047.stdout:7/811: mknod d0/df/d74/dcd/de4/c101 0 2024-02-07T12:26:03.734 INFO:tasks.workunit.client.0.smithi047.stdout:7/812: rmdir d0/d2f/df0 39 2024-02-07T12:26:03.735 INFO:tasks.workunit.client.0.smithi047.stdout:7/813: symlink d0/df/d29/d3e/d4c/d97/l102 0 2024-02-07T12:26:03.737 INFO:tasks.workunit.client.0.smithi047.stdout:7/814: unlink d0/d4/da2/ld2 0 2024-02-07T12:26:03.739 INFO:tasks.workunit.client.0.smithi047.stdout:7/815: rename d0/ff9 to d0/d42/d4d/d67/f103 0 2024-02-07T12:26:03.745 INFO:tasks.workunit.client.0.smithi047.stdout:7/816: getdents d0 0 2024-02-07T12:26:03.755 INFO:tasks.workunit.client.0.smithi047.stdout:7/817: dread d0/d4/f5 [0,4194304] 0 2024-02-07T12:26:03.755 INFO:tasks.workunit.client.0.smithi047.stdout:7/818: write d0/df/d29/d3e/d4c/d97/fbe [842548,85113] 0 2024-02-07T12:26:03.755 INFO:tasks.workunit.client.0.smithi047.stdout:7/819: fdatasync d0/d4/fe 0 2024-02-07T12:26:03.755 INFO:tasks.workunit.client.0.smithi047.stdout:7/820: fdatasync d0/df/d29/f22 0 2024-02-07T12:26:03.756 INFO:tasks.workunit.client.0.smithi047.stdout:5/782: dwrite da/df/d16/d25/d33/d91/fbe [0,4194304] 0 2024-02-07T12:26:03.756 INFO:tasks.workunit.client.0.smithi047.stdout:5/783: chown da/d24/d63/d9a/dec/lf0 96 1 2024-02-07T12:26:03.756 INFO:tasks.workunit.client.0.smithi047.stdout:5/784: chown da/df/d16/d41/f51 831197137 1 2024-02-07T12:26:03.756 INFO:tasks.workunit.client.0.smithi047.stdout:5/785: chown da/df/fdf 7407402 1 2024-02-07T12:26:03.757 INFO:tasks.workunit.client.0.smithi047.stdout:6/731: dwrite d3/d5/d35/d3c/d72/d8c/d91/fd6 [0,4194304] 0 2024-02-07T12:26:03.762 INFO:tasks.workunit.client.0.smithi047.stdout:6/732: mkdir d3/da/d34/d6d/d8f/db3/dbc/df5 0 2024-02-07T12:26:03.766 INFO:tasks.workunit.client.0.smithi047.stdout:5/786: write da/df/d16/d25/d71/dd2/fe6 [1787322,57493] 0 2024-02-07T12:26:03.767 INFO:tasks.workunit.client.0.smithi047.stdout:7/821: dwrite d0/d42/fed [0,4194304] 0 2024-02-07T12:26:03.767 INFO:tasks.workunit.client.0.smithi047.stdout:5/787: unlink da/df/d16/d25/d33/l8e 0 2024-02-07T12:26:03.767 INFO:tasks.workunit.client.0.smithi047.stdout:6/733: dread d3/f18 [0,4194304] 0 2024-02-07T12:26:03.771 INFO:tasks.workunit.client.0.smithi047.stdout:7/822: creat d0/df/d29/d31/d40/f104 x:0 0 0 2024-02-07T12:26:03.774 INFO:tasks.workunit.client.0.smithi047.stdout:7/823: rename d0/df/d29/d3e/d4c/d97/fbe to d0/f105 0 2024-02-07T12:26:03.778 INFO:tasks.workunit.client.0.smithi047.stdout:7/824: mkdir d0/dd0/d106 0 2024-02-07T12:26:03.779 INFO:tasks.workunit.client.0.smithi047.stdout:7/825: chown d0/d2f 69899 1 2024-02-07T12:26:03.781 INFO:tasks.workunit.client.0.smithi047.stdout:6/734: rename d3/da/d3b/d55 to d3/da/d3b/df6 0 2024-02-07T12:26:03.781 INFO:tasks.workunit.client.0.smithi047.stdout:6/735: fsync d3/d1e/f96 0 2024-02-07T12:26:03.784 INFO:tasks.workunit.client.0.smithi047.stdout:6/736: unlink d3/d5/d35/d3c/dd4/c82 0 2024-02-07T12:26:03.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:03 smithi138 ceph-mon[35528]: pgmap v18: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 79 MiB/s rd, 92 MiB/s wr, 279 op/s 2024-02-07T12:26:03.786 INFO:tasks.workunit.client.0.smithi047.stdout:5/788: dwrite da/df/d16/d25/d71/dd2/fe6 [0,4194304] 0 2024-02-07T12:26:03.788 INFO:tasks.workunit.client.0.smithi047.stdout:5/789: truncate da/df/d16/f53 1848505 0 2024-02-07T12:26:03.789 INFO:tasks.workunit.client.0.smithi047.stdout:5/790: rmdir da/d24/d63/d9a 39 2024-02-07T12:26:03.791 INFO:tasks.workunit.client.0.smithi047.stdout:5/791: creat da/d24/d63/f102 x:0 0 0 2024-02-07T12:26:03.791 INFO:tasks.workunit.client.0.smithi047.stdout:5/792: chown da/df/d16/f3d 1 1 2024-02-07T12:26:03.792 INFO:tasks.workunit.client.0.smithi047.stdout:7/826: dwrite d0/d4/da2/fe2 [0,4194304] 0 2024-02-07T12:26:03.793 INFO:tasks.workunit.client.0.smithi047.stdout:5/793: creat da/df/d16/d25/d33/d55/f103 x:0 0 0 2024-02-07T12:26:03.795 INFO:tasks.workunit.client.0.smithi047.stdout:7/827: creat d0/dd0/d106/f107 x:0 0 0 2024-02-07T12:26:03.798 INFO:tasks.workunit.client.0.smithi047.stdout:7/828: mknod d0/c108 0 2024-02-07T12:26:03.798 INFO:tasks.workunit.client.0.smithi047.stdout:7/829: fdatasync d0/df/d29/f68 0 2024-02-07T12:26:03.799 INFO:tasks.workunit.client.0.smithi047.stdout:7/830: dread d0/d4/da2/fba [0,4194304] 0 2024-02-07T12:26:03.799 INFO:tasks.workunit.client.0.smithi047.stdout:7/831: fdatasync d0/d4/da2/fe2 0 2024-02-07T12:26:03.802 INFO:tasks.workunit.client.0.smithi047.stdout:7/832: symlink d0/d4/l109 0 2024-02-07T12:26:03.802 INFO:tasks.workunit.client.0.smithi047.stdout:7/833: readlink d0/d42/l5e 0 2024-02-07T12:26:03.818 INFO:tasks.workunit.client.0.smithi047.stdout:7/834: dwrite d0/df/d74/df5/f71 [4194304,4194304] 0 2024-02-07T12:26:03.819 INFO:tasks.workunit.client.0.smithi047.stdout:7/835: getdents d0/df/dd1 0 2024-02-07T12:26:03.819 INFO:tasks.workunit.client.0.smithi047.stdout:7/836: readlink d0/d42/l5e 0 2024-02-07T12:26:03.819 INFO:tasks.workunit.client.0.smithi047.stdout:7/837: write d0/d42/d4d/ff3 [898189,82327] 0 2024-02-07T12:26:03.821 INFO:tasks.workunit.client.0.smithi047.stdout:7/838: rename d0/df/d29/d3e/f59 to d0/df/f10a 0 2024-02-07T12:26:03.822 INFO:tasks.workunit.client.0.smithi047.stdout:7/839: symlink d0/df/dd1/dee/l10b 0 2024-02-07T12:26:03.824 INFO:tasks.workunit.client.0.smithi047.stdout:7/840: mkdir d0/d2f/df0/d10c 0 2024-02-07T12:26:03.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:03 smithi047 ceph-mon[28972]: pgmap v18: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 79 MiB/s rd, 92 MiB/s wr, 279 op/s 2024-02-07T12:26:03.839 INFO:tasks.workunit.client.0.smithi047.stdout:7/841: dwrite d0/df/d29/d31/d40/dd7/ffa [0,4194304] 0 2024-02-07T12:26:03.840 INFO:tasks.workunit.client.0.smithi047.stdout:7/842: unlink d0/df/d29/d3e/d4c/d97/de3/cec 0 2024-02-07T12:26:03.840 INFO:tasks.workunit.client.0.smithi047.stdout:7/843: creat d0/d42/f10d x:0 0 0 2024-02-07T12:26:03.840 INFO:tasks.workunit.client.0.smithi047.stdout:7/844: truncate d0/df/d29/d31/f96 481411 0 2024-02-07T12:26:03.863 INFO:tasks.workunit.client.0.smithi047.stdout:7/845: dwrite d0/d4/fe [0,4194304] 0 2024-02-07T12:26:03.863 INFO:tasks.workunit.client.0.smithi047.stdout:7/846: readlink d0/df/d29/l63 0 2024-02-07T12:26:03.863 INFO:tasks.workunit.client.0.smithi047.stdout:7/847: creat d0/d42/f10e x:0 0 0 2024-02-07T12:26:03.869 INFO:tasks.workunit.client.0.smithi047.stdout:7/848: dread d0/d4/ffc [0,4194304] 0 2024-02-07T12:26:03.870 INFO:tasks.workunit.client.0.smithi047.stdout:7/849: truncate d0/d4/f20 5968342 0 2024-02-07T12:26:03.885 INFO:tasks.workunit.client.0.smithi047.stdout:7/850: dwrite d0/d42/d4d/d67/f103 [0,4194304] 0 2024-02-07T12:26:03.889 INFO:tasks.workunit.client.0.smithi047.stdout:7/851: dread d0/f2c [0,4194304] 0 2024-02-07T12:26:03.891 INFO:tasks.workunit.client.0.smithi047.stdout:7/852: rename d0/d42/fcc to d0/df/d29/d31/d40/dd7/f10f 0 2024-02-07T12:26:03.901 INFO:tasks.workunit.client.0.smithi047.stdout:7/853: write d0/df/d29/d3e/fac [1246674,56042] 0 2024-02-07T12:26:03.901 INFO:tasks.workunit.client.0.smithi047.stdout:7/854: dread - d0/df/d74/df5/fc1 zero size 2024-02-07T12:26:03.902 INFO:tasks.workunit.client.0.smithi047.stdout:7/855: rename d0/df/d29/d3e/d4c/d97/cef to d0/df/d29/d3e/d4c/d97/c110 0 2024-02-07T12:26:03.902 INFO:tasks.workunit.client.0.smithi047.stdout:7/856: fdatasync d0/db0/fbd 0 2024-02-07T12:26:03.903 INFO:tasks.workunit.client.0.smithi047.stdout:7/857: symlink d0/df/d74/df5/l111 0 2024-02-07T12:26:03.903 INFO:tasks.workunit.client.0.smithi047.stdout:7/858: chown d0/df/d29/cb6 0 1 2024-02-07T12:26:03.903 INFO:tasks.workunit.client.0.smithi047.stdout:7/859: creat d0/d42/f112 x:0 0 0 2024-02-07T12:26:03.903 INFO:tasks.workunit.client.0.smithi047.stdout:7/860: stat d0/df/d74/df5/f9b 0 2024-02-07T12:26:03.903 INFO:tasks.workunit.client.0.smithi047.stdout:7/861: creat d0/df/d29/d31/f113 x:0 0 0 2024-02-07T12:26:03.905 INFO:tasks.workunit.client.0.smithi047.stdout:7/862: mkdir d0/d4/d114 0 2024-02-07T12:26:03.906 INFO:tasks.workunit.client.0.smithi047.stdout:7/863: symlink d0/d42/d4d/d67/l115 0 2024-02-07T12:26:03.909 INFO:tasks.workunit.client.0.smithi047.stdout:7/864: rename d0/df/d29/d3e/d4c/fde to d0/df/d74/dcd/de4/f116 0 2024-02-07T12:26:03.916 INFO:tasks.workunit.client.0.smithi047.stdout:7/865: dread d0/df/d29/d3e/d4c/f8e [0,4194304] 0 2024-02-07T12:26:03.919 INFO:tasks.workunit.client.0.smithi047.stdout:9/555: sync 2024-02-07T12:26:03.922 INFO:tasks.workunit.client.0.smithi047.stdout:7/866: dread d0/d4/f5 [0,4194304] 0 2024-02-07T12:26:03.922 INFO:tasks.workunit.client.0.smithi047.stdout:7/867: chown d0/df/d29/d3e/d4c/d97/l102 4039343 1 2024-02-07T12:26:03.924 INFO:tasks.workunit.client.0.smithi047.stdout:7/868: rmdir d0/df/d29/d3e/d4c/d97/de3 0 2024-02-07T12:26:03.926 INFO:tasks.workunit.client.0.smithi047.stdout:7/869: unlink d0/df/d74/df5/fc1 0 2024-02-07T12:26:03.926 INFO:tasks.workunit.client.0.smithi047.stdout:7/870: chown d0/d2f/df0/d10c 2112386 1 2024-02-07T12:26:03.926 INFO:tasks.workunit.client.0.smithi047.stdout:7/871: write d0/df/d29/d3e/f80 [564252,53701] 0 2024-02-07T12:26:03.926 INFO:tasks.workunit.client.0.smithi047.stdout:7/872: write d0/d42/d4d/d67/ffe [142715,129835] 0 2024-02-07T12:26:03.940 INFO:tasks.workunit.client.0.smithi047.stdout:9/556: dwrite d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/fb4 [0,4194304] 0 2024-02-07T12:26:03.942 INFO:tasks.workunit.client.0.smithi047.stdout:9/557: creat d3/d10/d18/d3b/fc9 x:0 0 0 2024-02-07T12:26:03.942 INFO:tasks.workunit.client.0.smithi047.stdout:9/558: fsync d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/f86 0 2024-02-07T12:26:03.944 INFO:tasks.workunit.client.0.smithi047.stdout:9/559: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/fca x:0 0 0 2024-02-07T12:26:03.945 INFO:tasks.workunit.client.0.smithi047.stdout:7/873: dwrite d0/d42/d4d/f69 [0,4194304] 0 2024-02-07T12:26:03.948 INFO:tasks.workunit.client.0.smithi047.stdout:7/874: mknod d0/dd0/c117 0 2024-02-07T12:26:03.950 INFO:tasks.workunit.client.0.smithi047.stdout:7/875: rename d0/df/c10 to d0/df/d29/d3e/c118 0 2024-02-07T12:26:03.952 INFO:tasks.workunit.client.0.smithi047.stdout:9/560: write d3/d10/d18/f59 [103583,93960] 0 2024-02-07T12:26:03.953 INFO:tasks.workunit.client.0.smithi047.stdout:9/561: fdatasync d3/fa0 0 2024-02-07T12:26:03.953 INFO:tasks.workunit.client.0.smithi047.stdout:9/562: fdatasync d3/d10/d18/d6e/f9f 0 2024-02-07T12:26:03.954 INFO:tasks.workunit.client.0.smithi047.stdout:9/563: creat d3/d10/d18/d3d/dc0/fcb x:0 0 0 2024-02-07T12:26:03.975 INFO:tasks.workunit.client.0.smithi047.stdout:7/876: dwrite d0/df/d29/d31/d40/f6e [0,4194304] 0 2024-02-07T12:26:03.976 INFO:tasks.workunit.client.0.smithi047.stdout:9/564: dwrite d3/d10/d18/d3d/f89 [0,4194304] 0 2024-02-07T12:26:03.978 INFO:tasks.workunit.client.0.smithi047.stdout:7/877: dread d0/f105 [0,4194304] 0 2024-02-07T12:26:03.980 INFO:tasks.workunit.client.0.smithi047.stdout:7/878: symlink d0/dd0/l119 0 2024-02-07T12:26:03.981 INFO:tasks.workunit.client.0.smithi047.stdout:7/879: chown d0/d42/f57 1064 1 2024-02-07T12:26:03.993 INFO:tasks.workunit.client.0.smithi047.stdout:7/880: read d0/df/f10a [2810606,126952] 0 2024-02-07T12:26:03.993 INFO:tasks.workunit.client.0.smithi047.stdout:9/565: dwrite d3/d10/d18/d3b/d3c/d5d/f78 [0,4194304] 0 2024-02-07T12:26:03.993 INFO:tasks.workunit.client.0.smithi047.stdout:9/566: creat d3/fcc x:0 0 0 2024-02-07T12:26:03.994 INFO:tasks.workunit.client.0.smithi047.stdout:7/881: link d0/df/d29/d3e/f46 d0/f11a 0 2024-02-07T12:26:03.997 INFO:tasks.workunit.client.0.smithi047.stdout:7/882: symlink d0/df/d29/d3e/d4c/d97/l11b 0 2024-02-07T12:26:04.000 INFO:tasks.workunit.client.0.smithi047.stdout:7/883: link d0/d42/fa7 d0/db0/f11c 0 2024-02-07T12:26:04.001 INFO:tasks.workunit.client.0.smithi047.stdout:7/884: mkdir d0/df/d29/d11d 0 2024-02-07T12:26:04.001 INFO:tasks.workunit.client.0.smithi047.stdout:7/885: read d0/d42/f4f [7930558,119445] 0 2024-02-07T12:26:04.002 INFO:tasks.workunit.client.0.smithi047.stdout:7/886: symlink d0/d2f/df0/l11e 0 2024-02-07T12:26:04.015 INFO:tasks.workunit.client.0.smithi047.stdout:7/887: dread d0/df/d29/d31/f34 [0,4194304] 0 2024-02-07T12:26:04.015 INFO:tasks.workunit.client.0.smithi047.stdout:9/567: dwrite d3/f29 [4194304,4194304] 0 2024-02-07T12:26:04.016 INFO:tasks.workunit.client.0.smithi047.stdout:7/888: symlink d0/dd0/l11f 0 2024-02-07T12:26:04.016 INFO:tasks.workunit.client.0.smithi047.stdout:7/889: write d0/df/dd1/fd3 [680712,8970] 0 2024-02-07T12:26:04.016 INFO:tasks.workunit.client.0.smithi047.stdout:7/890: chown d0/d42/l5f 20 1 2024-02-07T12:26:04.016 INFO:tasks.workunit.client.0.smithi047.stdout:7/891: stat d0/d42/d4d/d67/fb3 0 2024-02-07T12:26:04.017 INFO:tasks.workunit.client.0.smithi047.stdout:9/568: mkdir d3/d10/d18/d3d/d79/dcd 0 2024-02-07T12:26:04.017 INFO:tasks.workunit.client.0.smithi047.stdout:7/892: mknod d0/df/d29/c120 0 2024-02-07T12:26:04.018 INFO:tasks.workunit.client.0.smithi047.stdout:7/893: chown d0/d42/f45 2 1 2024-02-07T12:26:04.021 INFO:tasks.workunit.client.0.smithi047.stdout:7/894: rename d0/d4/da2/fe2 to d0/df/d74/df5/f121 0 2024-02-07T12:26:04.021 INFO:tasks.workunit.client.0.smithi047.stdout:7/895: fdatasync d0/df/d29/fb1 0 2024-02-07T12:26:04.035 INFO:tasks.workunit.client.0.smithi047.stdout:7/896: dwrite d0/df/d29/d31/fd9 [0,4194304] 0 2024-02-07T12:26:04.043 INFO:tasks.workunit.client.0.smithi047.stdout:7/897: read d0/df/d29/d3e/f46 [4766352,41340] 0 2024-02-07T12:26:04.058 INFO:tasks.workunit.client.0.smithi047.stdout:7/898: dwrite d0/d4/da2/fba [0,4194304] 0 2024-02-07T12:26:04.058 INFO:tasks.workunit.client.0.smithi047.stdout:7/899: write d0/d42/f45 [3856963,108607] 0 2024-02-07T12:26:04.061 INFO:tasks.workunit.client.0.smithi047.stdout:7/900: rename d0/df/d74/df5/c81 to d0/df/d29/d3e/d4c/c122 0 2024-02-07T12:26:04.062 INFO:tasks.workunit.client.0.smithi047.stdout:7/901: link d0/dd0/ccb d0/df/d29/d11d/c123 0 2024-02-07T12:26:04.064 INFO:tasks.workunit.client.0.smithi047.stdout:7/902: creat d0/df/d29/d3e/f124 x:0 0 0 2024-02-07T12:26:04.065 INFO:tasks.workunit.client.0.smithi047.stdout:7/903: readlink d0/d42/d4d/l5d 0 2024-02-07T12:26:04.065 INFO:tasks.workunit.client.0.smithi047.stdout:7/904: truncate d0/df/d29/ffb 300798 0 2024-02-07T12:26:04.067 INFO:tasks.workunit.client.0.smithi047.stdout:7/905: symlink d0/d4/d114/l125 0 2024-02-07T12:26:04.079 INFO:tasks.workunit.client.0.smithi047.stdout:7/906: dwrite d0/d2f/fc8 [0,4194304] 0 2024-02-07T12:26:04.083 INFO:tasks.workunit.client.0.smithi047.stdout:7/907: rename d0/df/cc0 to d0/df/dd1/c126 0 2024-02-07T12:26:04.083 INFO:tasks.workunit.client.0.smithi047.stdout:7/908: write d0/dd0/f7f [467082,23107] 0 2024-02-07T12:26:04.087 INFO:tasks.workunit.client.0.smithi047.stdout:7/909: rename d0/df/d29/l37 to d0/d4/l127 0 2024-02-07T12:26:04.087 INFO:tasks.workunit.client.0.smithi047.stdout:7/910: chown d0/df/dd1/fd3 67151291 1 2024-02-07T12:26:04.089 INFO:tasks.workunit.client.0.smithi047.stdout:7/911: rename d0/df/fe5 to d0/df/d29/d3e/d4c/f128 0 2024-02-07T12:26:04.089 INFO:tasks.workunit.client.0.smithi047.stdout:7/912: write d0/d4/f16 [718533,96647] 0 2024-02-07T12:26:04.090 INFO:tasks.workunit.client.0.smithi047.stdout:7/913: mknod d0/d42/d4d/de9/c129 0 2024-02-07T12:26:04.090 INFO:tasks.workunit.client.0.smithi047.stdout:7/914: fsync d0/df/d74/dcd/de4/fad 0 2024-02-07T12:26:04.092 INFO:tasks.workunit.client.0.smithi047.stdout:7/915: rename d0/d4/d114/l125 to d0/df/d74/df5/l12a 0 2024-02-07T12:26:04.094 INFO:tasks.workunit.client.0.smithi047.stdout:0/562: sync 2024-02-07T12:26:04.101 INFO:tasks.workunit.client.0.smithi047.stdout:7/916: dread d0/d4/f17 [0,4194304] 0 2024-02-07T12:26:04.101 INFO:tasks.workunit.client.0.smithi047.stdout:7/917: write d0/d42/f45 [2627737,41721] 0 2024-02-07T12:26:04.101 INFO:tasks.workunit.client.0.smithi047.stdout:0/563: rename d19/d1c/d3c/d48/f4e to d19/d1c/d3c/d60/d6f/d95/daa/d49/fb5 0 2024-02-07T12:26:04.101 INFO:tasks.workunit.client.0.smithi047.stdout:0/564: chown d19/d40/f99 15 1 2024-02-07T12:26:04.101 INFO:tasks.workunit.client.0.smithi047.stdout:0/565: write d19/d1c/d2b/d5f/f80 [498887,52944] 0 2024-02-07T12:26:04.101 INFO:tasks.workunit.client.0.smithi047.stdout:0/566: dread - d19/d1c/d3c/d60/f97 zero size 2024-02-07T12:26:04.102 INFO:tasks.workunit.client.0.smithi047.stdout:7/918: dread d0/df/d29/d31/d40/f49 [0,4194304] 0 2024-02-07T12:26:04.112 INFO:tasks.workunit.client.0.smithi047.stdout:0/567: rmdir d19/d1c/d3c/d48 39 2024-02-07T12:26:04.112 INFO:tasks.workunit.client.0.smithi047.stdout:7/919: dread d0/f47 [0,4194304] 0 2024-02-07T12:26:04.112 INFO:tasks.workunit.client.0.smithi047.stdout:7/920: fsync d0/df/dd1/fd3 0 2024-02-07T12:26:04.112 INFO:tasks.workunit.client.0.smithi047.stdout:7/921: chown d0/dd0/d106 111375 1 2024-02-07T12:26:04.112 INFO:tasks.workunit.client.0.smithi047.stdout:7/922: read d0/df/d29/d31/d40/f49 [1363438,87926] 0 2024-02-07T12:26:04.113 INFO:tasks.workunit.client.0.smithi047.stdout:0/568: mknod d19/d40/cb6 0 2024-02-07T12:26:04.113 INFO:tasks.workunit.client.0.smithi047.stdout:0/569: read - d19/d40/d66/da9/faf zero size 2024-02-07T12:26:04.114 INFO:tasks.workunit.client.0.smithi047.stdout:7/923: creat d0/d4/d114/f12b x:0 0 0 2024-02-07T12:26:04.115 INFO:tasks.workunit.client.0.smithi047.stdout:7/924: stat d0/df/dd1/c126 0 2024-02-07T12:26:04.116 INFO:tasks.workunit.client.0.smithi047.stdout:0/570: mknod d19/d1c/cb7 0 2024-02-07T12:26:04.116 INFO:tasks.workunit.client.0.smithi047.stdout:0/571: chown d19/d1c/d3c/d60/d6f/d95/daa/f42 766088 1 2024-02-07T12:26:04.117 INFO:tasks.workunit.client.0.smithi047.stdout:0/572: rmdir d19/d40/d66/d81/d82 39 2024-02-07T12:26:04.118 INFO:tasks.workunit.client.0.smithi047.stdout:7/925: mkdir d0/d4/d12c 0 2024-02-07T12:26:04.118 INFO:tasks.workunit.client.0.smithi047.stdout:7/926: truncate d0/d42/fa3 1158348 0 2024-02-07T12:26:04.120 INFO:tasks.workunit.client.0.smithi047.stdout:7/927: write d0/df/d29/d3e/fac [1056781,87246] 0 2024-02-07T12:26:04.120 INFO:tasks.workunit.client.0.smithi047.stdout:7/928: write d0/df/d29/d3e/f80 [1989694,91997] 0 2024-02-07T12:26:04.135 INFO:tasks.workunit.client.0.smithi047.stdout:0/573: dwrite d19/d40/d66/fa2 [0,4194304] 0 2024-02-07T12:26:04.135 INFO:tasks.workunit.client.0.smithi047.stdout:7/929: dwrite d0/d4/d114/f12b [0,4194304] 0 2024-02-07T12:26:04.135 INFO:tasks.workunit.client.0.smithi047.stdout:7/930: read d0/df/d29/d3e/f46 [1529239,114826] 0 2024-02-07T12:26:04.136 INFO:tasks.workunit.client.0.smithi047.stdout:7/931: dread - d0/d42/d4d/d67/fc5 zero size 2024-02-07T12:26:04.136 INFO:tasks.workunit.client.0.smithi047.stdout:0/574: truncate d19/d1c/d24/f8f 1439129 0 2024-02-07T12:26:04.140 INFO:tasks.workunit.client.0.smithi047.stdout:7/932: creat d0/df/d29/d31/d40/dd7/f12d x:0 0 0 2024-02-07T12:26:04.140 INFO:tasks.workunit.client.0.smithi047.stdout:7/933: chown d0/df/d74/df5 36046106 1 2024-02-07T12:26:04.145 INFO:tasks.workunit.client.0.smithi047.stdout:0/575: write d19/d40/d66/f8e [1482734,119209] 0 2024-02-07T12:26:04.145 INFO:tasks.workunit.client.0.smithi047.stdout:0/576: stat d19/d1c/d3c/d60/d6f/fac 0 2024-02-07T12:26:04.147 INFO:tasks.workunit.client.0.smithi047.stdout:0/577: mknod d19/d40/d66/da9/cb8 0 2024-02-07T12:26:04.155 INFO:tasks.workunit.client.0.smithi047.stdout:7/934: dwrite d0/d42/f57 [0,4194304] 0 2024-02-07T12:26:04.155 INFO:tasks.workunit.client.0.smithi047.stdout:7/935: write d0/d42/d4d/ff3 [1406754,79073] 0 2024-02-07T12:26:04.172 INFO:tasks.workunit.client.0.smithi047.stdout:7/936: dwrite d0/db0/fbd [0,4194304] 0 2024-02-07T12:26:04.172 INFO:tasks.workunit.client.0.smithi047.stdout:7/937: chown d0/d4/f20 507549 1 2024-02-07T12:26:04.172 INFO:tasks.workunit.client.0.smithi047.stdout:7/938: fsync d0/df/d29/d3e/f88 0 2024-02-07T12:26:04.177 INFO:tasks.workunit.client.0.smithi047.stdout:7/939: link d0/df/d29/d3e/d4c/c4e d0/df/d74/dcd/de4/c12e 0 2024-02-07T12:26:04.177 INFO:tasks.workunit.client.0.smithi047.stdout:7/940: write d0/d4/f17 [4358108,97691] 0 2024-02-07T12:26:04.199 INFO:tasks.workunit.client.0.smithi047.stdout:7/941: dwrite d0/df/d29/d31/d40/f104 [0,4194304] 0 2024-02-07T12:26:04.203 INFO:tasks.workunit.client.0.smithi047.stdout:7/942: unlink d0/df/d29/d31/d40/f49 0 2024-02-07T12:26:04.203 INFO:tasks.workunit.client.0.smithi047.stdout:7/943: dread - d0/df/d74/ff1 zero size 2024-02-07T12:26:04.203 INFO:tasks.workunit.client.0.smithi047.stdout:7/944: creat d0/df/d74/f12f x:0 0 0 2024-02-07T12:26:04.205 INFO:tasks.workunit.client.0.smithi047.stdout:7/945: mkdir d0/d42/d4d/d67/dfd/d130 0 2024-02-07T12:26:04.208 INFO:tasks.workunit.client.0.smithi047.stdout:7/946: link d0/df/d29/d3e/d4c/fb7 d0/df/d29/d3e/d4c/d97/f131 0 2024-02-07T12:26:04.208 INFO:tasks.workunit.client.0.smithi047.stdout:7/947: truncate d0/dd0/d106/f107 503556 0 2024-02-07T12:26:04.211 INFO:tasks.workunit.client.0.smithi047.stdout:7/948: unlink d0/df/d29/d31/d40/l6d 0 2024-02-07T12:26:04.211 INFO:tasks.workunit.client.0.smithi047.stdout:7/949: readlink d0/d42/le8 0 2024-02-07T12:26:04.219 INFO:tasks.workunit.client.0.smithi047.stdout:7/950: write d0/d2f/fc8 [1712104,73019] 0 2024-02-07T12:26:04.500 INFO:tasks.workunit.client.0.smithi047.stdout:2/834: sync 2024-02-07T12:26:04.500 INFO:tasks.workunit.client.0.smithi047.stdout:8/723: sync 2024-02-07T12:26:04.500 INFO:tasks.workunit.client.0.smithi047.stdout:1/554: sync 2024-02-07T12:26:04.501 INFO:tasks.workunit.client.0.smithi047.stdout:8/724: fsync d3/d36/d50/d30/d9e/da6/fce 0 2024-02-07T12:26:04.501 INFO:tasks.workunit.client.0.smithi047.stdout:8/725: write d3/d36/d50/d28/fa3 [4309518,56471] 0 2024-02-07T12:26:04.501 INFO:tasks.workunit.client.0.smithi047.stdout:8/726: readlink d3/d36/l58 0 2024-02-07T12:26:04.502 INFO:tasks.workunit.client.0.smithi047.stdout:1/555: rmdir d1/d15/d30/d46/d66 39 2024-02-07T12:26:04.505 INFO:tasks.workunit.client.0.smithi047.stdout:2/835: mkdir d7/dc/d10f 0 2024-02-07T12:26:04.509 INFO:tasks.workunit.client.0.smithi047.stdout:1/556: mknod d1/d6e/d75/da7/d65/cab 0 2024-02-07T12:26:04.510 INFO:tasks.workunit.client.0.smithi047.stdout:1/557: write d1/d6e/d75/da7/f24 [2133519,33326] 0 2024-02-07T12:26:04.510 INFO:tasks.workunit.client.0.smithi047.stdout:1/558: chown d1/d2a/c31 0 1 2024-02-07T12:26:04.517 INFO:tasks.workunit.client.0.smithi047.stdout:2/836: read d7/f12 [375025,50870] 0 2024-02-07T12:26:04.518 INFO:tasks.workunit.client.0.smithi047.stdout:2/837: symlink d7/dc/d4c/l110 0 2024-02-07T12:26:04.518 INFO:tasks.workunit.client.0.smithi047.stdout:2/838: creat d7/dc/d51/dda/f111 x:0 0 0 2024-02-07T12:26:04.518 INFO:tasks.workunit.client.0.smithi047.stdout:2/839: fdatasync d7/d48/d72/dbf/f105 0 2024-02-07T12:26:04.519 INFO:tasks.workunit.client.0.smithi047.stdout:8/727: dwrite d3/d36/f75 [4194304,4194304] 0 2024-02-07T12:26:04.521 INFO:tasks.workunit.client.0.smithi047.stdout:8/728: truncate d3/d4/f1e 4865064 0 2024-02-07T12:26:04.521 INFO:tasks.workunit.client.0.smithi047.stdout:8/729: write d3/d4/f7f [1004436,36988] 0 2024-02-07T12:26:04.523 INFO:tasks.workunit.client.0.smithi047.stdout:8/730: unlink d3/d66/d67/d6a/fd2 0 2024-02-07T12:26:04.524 INFO:tasks.workunit.client.0.smithi047.stdout:1/559: dread d1/f87 [0,4194304] 0 2024-02-07T12:26:04.524 INFO:tasks.workunit.client.0.smithi047.stdout:1/560: truncate d1/d6e/d75/da7/f9c 5382165 0 2024-02-07T12:26:04.525 INFO:tasks.workunit.client.0.smithi047.stdout:8/731: symlink d3/d36/d50/d30/d9e/da6/lf0 0 2024-02-07T12:26:04.525 INFO:tasks.workunit.client.0.smithi047.stdout:8/732: fsync d3/d66/d67/d6a/d91/f97 0 2024-02-07T12:26:04.525 INFO:tasks.workunit.client.0.smithi047.stdout:8/733: readlink d3/d4/lf 0 2024-02-07T12:26:04.526 INFO:tasks.workunit.client.0.smithi047.stdout:8/734: write d3/d36/d50/d30/d9e/da6/f84 [4571274,40062] 0 2024-02-07T12:26:04.526 INFO:tasks.workunit.client.0.smithi047.stdout:2/840: getdents d7/dc/d4c 0 2024-02-07T12:26:04.528 INFO:tasks.workunit.client.0.smithi047.stdout:1/561: mkdir d1/d15/d30/d46/d66/dac 0 2024-02-07T12:26:04.531 INFO:tasks.workunit.client.0.smithi047.stdout:2/841: rmdir d7/d48/df0 39 2024-02-07T12:26:04.532 INFO:tasks.workunit.client.0.smithi047.stdout:2/842: creat d7/dc/d8a/f112 x:0 0 0 2024-02-07T12:26:04.532 INFO:tasks.workunit.client.0.smithi047.stdout:2/843: chown d7/dc/d51/dda/f111 510901 1 2024-02-07T12:26:04.532 INFO:tasks.workunit.client.0.smithi047.stdout:2/844: dread - d7/d2d/d5c/fa6 zero size 2024-02-07T12:26:04.534 INFO:tasks.workunit.client.0.smithi047.stdout:2/845: unlink d7/dc/d8a/fef 0 2024-02-07T12:26:04.535 INFO:tasks.workunit.client.0.smithi047.stdout:2/846: fsync d7/f13 0 2024-02-07T12:26:04.559 INFO:tasks.workunit.client.0.smithi047.stdout:1/562: dwrite d1/f87 [0,4194304] 0 2024-02-07T12:26:04.559 INFO:tasks.workunit.client.0.smithi047.stdout:8/735: dwrite d3/d36/d50/fbc [0,4194304] 0 2024-02-07T12:26:04.563 INFO:tasks.workunit.client.0.smithi047.stdout:1/563: symlink d1/d15/lad 0 2024-02-07T12:26:04.565 INFO:tasks.workunit.client.0.smithi047.stdout:8/736: rename d3/d4/d4d/l7b to d3/d4/lf1 0 2024-02-07T12:26:04.565 INFO:tasks.workunit.client.0.smithi047.stdout:8/737: dread - d3/dbd/fe3 zero size 2024-02-07T12:26:04.566 INFO:tasks.workunit.client.0.smithi047.stdout:1/564: mkdir d1/d15/d30/d46/dae 0 2024-02-07T12:26:04.570 INFO:tasks.workunit.client.0.smithi047.stdout:3/797: sync 2024-02-07T12:26:04.572 INFO:tasks.workunit.client.0.smithi047.stdout:3/798: write d12/dc7/d29/d44/f69 [133976,31136] 0 2024-02-07T12:26:04.576 INFO:tasks.workunit.client.0.smithi047.stdout:1/565: write d1/d6e/d75/da7/d40/f56 [4432663,10206] 0 2024-02-07T12:26:04.579 INFO:tasks.workunit.client.0.smithi047.stdout:1/566: dread d1/d6e/d75/da7/d65/f92 [0,4194304] 0 2024-02-07T12:26:04.580 INFO:tasks.workunit.client.0.smithi047.stdout:8/738: dwrite d3/d36/d50/d2a/fcf [0,4194304] 0 2024-02-07T12:26:04.580 INFO:tasks.workunit.client.0.smithi047.stdout:1/567: creat d1/d37/faf x:0 0 0 2024-02-07T12:26:04.580 INFO:tasks.workunit.client.0.smithi047.stdout:1/568: write d1/d37/f60 [398443,67955] 0 2024-02-07T12:26:04.583 INFO:tasks.workunit.client.0.smithi047.stdout:8/739: creat d3/ff2 x:0 0 0 2024-02-07T12:26:04.584 INFO:tasks.workunit.client.0.smithi047.stdout:1/569: truncate d1/f22 7004540 0 2024-02-07T12:26:04.586 INFO:tasks.workunit.client.0.smithi047.stdout:1/570: symlink d1/d15/d30/d46/dae/lb0 0 2024-02-07T12:26:04.586 INFO:tasks.workunit.client.0.smithi047.stdout:1/571: write d1/d15/f79 [1101596,24273] 0 2024-02-07T12:26:04.588 INFO:tasks.workunit.client.0.smithi047.stdout:3/799: dwrite d12/dc7/d29/d6f/d93/dba/fc3 [0,4194304] 0 2024-02-07T12:26:04.588 INFO:tasks.workunit.client.0.smithi047.stdout:3/800: readlink d12/d19/d37/l5e 0 2024-02-07T12:26:04.588 INFO:tasks.workunit.client.0.smithi047.stdout:3/801: creat d12/d19/d2d/d42/d6b/f104 x:0 0 0 2024-02-07T12:26:04.588 INFO:tasks.workunit.client.0.smithi047.stdout:1/572: dread d1/f5e [0,4194304] 0 2024-02-07T12:26:04.593 INFO:tasks.workunit.client.0.smithi047.stdout:3/802: symlink d12/dc7/d29/da9/l105 0 2024-02-07T12:26:04.595 INFO:tasks.workunit.client.0.smithi047.stdout:1/573: link d1/d15/d30/l36 d1/d48/d81/lb1 0 2024-02-07T12:26:04.597 INFO:tasks.workunit.client.0.smithi047.stdout:3/803: truncate d12/d19/d2d/f8b 444988 0 2024-02-07T12:26:04.597 INFO:tasks.workunit.client.0.smithi047.stdout:3/804: stat d12/dc7/d29/d31/d38/d59/d87/dc5/ldb 0 2024-02-07T12:26:04.598 INFO:tasks.workunit.client.0.smithi047.stdout:1/574: creat d1/d15/d30/d46/d66/fb2 x:0 0 0 2024-02-07T12:26:04.598 INFO:tasks.workunit.client.0.smithi047.stdout:1/575: chown d1/d6e 386 1 2024-02-07T12:26:04.600 INFO:tasks.workunit.client.0.smithi047.stdout:3/805: symlink d12/d19/l106 0 2024-02-07T12:26:04.602 INFO:tasks.workunit.client.0.smithi047.stdout:1/576: unlink d1/d6e/d75/da7/d65/l6f 0 2024-02-07T12:26:04.603 INFO:tasks.workunit.client.0.smithi047.stdout:1/577: creat d1/d2a/fb3 x:0 0 0 2024-02-07T12:26:04.604 INFO:tasks.workunit.client.0.smithi047.stdout:3/806: creat d12/dc7/d29/d6f/d93/f107 x:0 0 0 2024-02-07T12:26:04.607 INFO:tasks.workunit.client.0.smithi047.stdout:1/578: rename d1/d15/d2f/f3c to d1/d15/d30/d46/dae/fb4 0 2024-02-07T12:26:04.609 INFO:tasks.workunit.client.0.smithi047.stdout:3/807: mknod d12/dc7/d29/d6f/d93/dba/dbf/c108 0 2024-02-07T12:26:04.611 INFO:tasks.workunit.client.0.smithi047.stdout:1/579: mknod d1/d48/d81/cb5 0 2024-02-07T12:26:04.611 INFO:tasks.workunit.client.0.smithi047.stdout:1/580: truncate d1/d48/d81/f91 226234 0 2024-02-07T12:26:04.611 INFO:tasks.workunit.client.0.smithi047.stdout:1/581: creat d1/d15/d30/d46/d66/fb6 x:0 0 0 2024-02-07T12:26:04.611 INFO:tasks.workunit.client.0.smithi047.stdout:1/582: fdatasync d1/d6e/d75/da7/f4f 0 2024-02-07T12:26:04.613 INFO:tasks.workunit.client.0.smithi047.stdout:3/808: write d12/d19/d2d/f8b [905987,80755] 0 2024-02-07T12:26:04.614 INFO:tasks.workunit.client.0.smithi047.stdout:1/583: mkdir d1/d15/d30/d46/d66/dac/db7 0 2024-02-07T12:26:04.616 INFO:tasks.workunit.client.0.smithi047.stdout:3/809: creat d12/dc7/d29/d31/d7c/d8c/f109 x:0 0 0 2024-02-07T12:26:04.618 INFO:tasks.workunit.client.0.smithi047.stdout:1/584: symlink d1/d15/d2f/lb8 0 2024-02-07T12:26:04.620 INFO:tasks.workunit.client.0.smithi047.stdout:3/810: creat d12/dc7/d29/d31/d38/d59/de6/d95/f10a x:0 0 0 2024-02-07T12:26:04.627 INFO:tasks.workunit.client.0.smithi047.stdout:1/585: dread d1/f58 [0,4194304] 0 2024-02-07T12:26:04.628 INFO:tasks.workunit.client.0.smithi047.stdout:1/586: mkdir d1/d15/db9 0 2024-02-07T12:26:04.629 INFO:tasks.workunit.client.0.smithi047.stdout:1/587: creat d1/d6e/d75/da7/d65/fba x:0 0 0 2024-02-07T12:26:04.629 INFO:tasks.workunit.client.0.smithi047.stdout:1/588: truncate d1/d6e/d75/da7/f1d 2395821 0 2024-02-07T12:26:04.639 INFO:tasks.workunit.client.0.smithi047.stdout:3/811: dwrite d12/d19/d2d/d42/ff5 [0,4194304] 0 2024-02-07T12:26:04.640 INFO:tasks.workunit.client.0.smithi047.stdout:3/812: chown d12/d19/d2d/d33/da5/ld2 120 1 2024-02-07T12:26:04.651 INFO:tasks.workunit.client.0.smithi047.stdout:3/813: write d12/d19/d2d/f4e [2042342,78242] 0 2024-02-07T12:26:04.671 INFO:tasks.workunit.client.0.smithi047.stdout:3/814: dwrite d12/dc7/d29/f81 [0,4194304] 0 2024-02-07T12:26:04.671 INFO:tasks.workunit.client.0.smithi047.stdout:3/815: creat d12/dc7/d29/d31/d7c/d8c/f10b x:0 0 0 2024-02-07T12:26:04.674 INFO:tasks.workunit.client.0.smithi047.stdout:3/816: creat d12/d19/d2d/d33/d8d/f10c x:0 0 0 2024-02-07T12:26:04.679 INFO:tasks.workunit.client.0.smithi047.stdout:3/817: dread d12/f64 [0,4194304] 0 2024-02-07T12:26:04.679 INFO:tasks.workunit.client.0.smithi047.stdout:3/818: readlink d12/dc7/d29/d31/d38/d59/de6/l9a 0 2024-02-07T12:26:04.685 INFO:tasks.workunit.client.0.smithi047.stdout:3/819: write d12/d19/d37/f68 [2403504,60059] 0 2024-02-07T12:26:04.685 INFO:tasks.workunit.client.0.smithi047.stdout:3/820: write d12/d19/d2d/f8b [1230494,56134] 0 2024-02-07T12:26:04.745 INFO:tasks.workunit.client.0.smithi047.stdout:3/821: creat d12/dc7/d29/d31/d38/f10d x:0 0 0 2024-02-07T12:26:04.748 INFO:tasks.workunit.client.0.smithi047.stdout:3/822: mknod d12/dc7/d29/d6f/df0/c10e 0 2024-02-07T12:26:04.752 INFO:tasks.workunit.client.0.smithi047.stdout:7/951: sync 2024-02-07T12:26:04.752 INFO:tasks.workunit.client.0.smithi047.stdout:6/737: sync 2024-02-07T12:26:04.753 INFO:tasks.workunit.client.0.smithi047.stdout:0/578: sync 2024-02-07T12:26:04.753 INFO:tasks.workunit.client.0.smithi047.stdout:9/569: sync 2024-02-07T12:26:04.753 INFO:tasks.workunit.client.0.smithi047.stdout:9/570: dread - d3/fcc zero size 2024-02-07T12:26:04.753 INFO:tasks.workunit.client.0.smithi047.stdout:4/996: sync 2024-02-07T12:26:04.753 INFO:tasks.workunit.client.0.smithi047.stdout:6/738: write d3/da/d2c/fdb [320622,54934] 0 2024-02-07T12:26:04.753 INFO:tasks.workunit.client.0.smithi047.stdout:5/794: sync 2024-02-07T12:26:04.753 INFO:tasks.workunit.client.0.smithi047.stdout:9/571: write f1 [1717175,122155] 0 2024-02-07T12:26:04.754 INFO:tasks.workunit.client.0.smithi047.stdout:7/952: dread d0/dd0/d106/f107 [0,4194304] 0 2024-02-07T12:26:04.754 INFO:tasks.workunit.client.0.smithi047.stdout:7/953: write d0/d42/f112 [884100,103659] 0 2024-02-07T12:26:04.756 INFO:tasks.workunit.client.0.smithi047.stdout:4/997: creat d3/d27/f155 x:0 0 0 2024-02-07T12:26:04.756 INFO:tasks.workunit.client.0.smithi047.stdout:6/739: getdents d3/d5/d35/d3c/d72/d8c 0 2024-02-07T12:26:04.758 INFO:tasks.workunit.client.0.smithi047.stdout:5/795: creat da/dd0/f104 x:0 0 0 2024-02-07T12:26:04.758 INFO:tasks.workunit.client.0.smithi047.stdout:5/796: creat da/df/d16/d25/d33/d91/f105 x:0 0 0 2024-02-07T12:26:04.761 INFO:tasks.workunit.client.0.smithi047.stdout:9/572: mknod d3/d10/d18/d3a/cce 0 2024-02-07T12:26:04.761 INFO:tasks.workunit.client.0.smithi047.stdout:9/573: fsync d3/d10/d18/f1a 0 2024-02-07T12:26:04.761 INFO:tasks.workunit.client.0.smithi047.stdout:9/574: creat d3/d10/d4c/fcf x:0 0 0 2024-02-07T12:26:04.763 INFO:tasks.workunit.client.0.smithi047.stdout:7/954: rename d0/df/d29/d31/f113 to d0/df/d74/dcd/f132 0 2024-02-07T12:26:04.763 INFO:tasks.workunit.client.0.smithi047.stdout:7/955: truncate d0/fa4 1104604 0 2024-02-07T12:26:04.764 INFO:tasks.workunit.client.0.smithi047.stdout:3/823: dwrite d12/dc7/d29/d31/f8a [0,4194304] 0 2024-02-07T12:26:04.764 INFO:tasks.workunit.client.0.smithi047.stdout:9/575: dread d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/f6f [0,4194304] 0 2024-02-07T12:26:04.767 INFO:tasks.workunit.client.0.smithi047.stdout:4/998: mkdir d3/d61/d70/d8b/ddb/d66/dfe/d156 0 2024-02-07T12:26:04.767 INFO:tasks.workunit.client.0.smithi047.stdout:4/999: write d3/d27/dc5/f103 [999354,15696] 0 2024-02-07T12:26:04.769 INFO:tasks.workunit.client.0.smithi047.stdout:6/740: symlink d3/da/d34/d6d/d8f/db3/dbc/dd7/lf7 0 2024-02-07T12:26:04.769 INFO:tasks.workunit.client.0.smithi047.stdout:6/741: creat d3/da/d34/d6d/d8f/db3/dbc/ff8 x:0 0 0 2024-02-07T12:26:04.772 INFO:tasks.workunit.client.0.smithi047.stdout:5/797: creat da/df/d16/d25/d71/d68/dda/f106 x:0 0 0 2024-02-07T12:26:04.774 INFO:tasks.workunit.client.0.smithi047.stdout:9/576: dread d3/d10/d18/d3a/f44 [0,4194304] 0 2024-02-07T12:26:04.774 INFO:tasks.workunit.client.0.smithi047.stdout:9/577: truncate d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/fb2 834248 0 2024-02-07T12:26:04.774 INFO:tasks.workunit.client.0.smithi047.stdout:0/579: dwrite f1 [0,4194304] 0 2024-02-07T12:26:04.774 INFO:tasks.workunit.client.0.smithi047.stdout:0/580: stat d19/d1c/f43 0 2024-02-07T12:26:04.774 INFO:tasks.workunit.client.0.smithi047.stdout:0/581: read - d19/d1c/d3c/d60/d6f/fac zero size 2024-02-07T12:26:04.774 INFO:tasks.workunit.client.0.smithi047.stdout:0/582: chown d19/d40/f53 5122 1 2024-02-07T12:26:04.775 INFO:tasks.workunit.client.0.smithi047.stdout:7/956: rename d0/dd0/l11f to d0/d4/d12c/l133 0 2024-02-07T12:26:04.780 INFO:tasks.workunit.client.0.smithi047.stdout:9/578: link d3/d10/d18/d3b/d3c/d47/c63 d3/d10/d18/d3b/d3c/d47/cd0 0 2024-02-07T12:26:04.782 INFO:tasks.workunit.client.0.smithi047.stdout:7/957: mkdir d0/d134 0 2024-02-07T12:26:04.792 INFO:tasks.workunit.client.0.smithi047.stdout:9/579: read d3/d10/d18/d3a/f44 [3895812,10691] 0 2024-02-07T12:26:04.793 INFO:tasks.workunit.client.0.smithi047.stdout:9/580: rename d3/d10/d18/d3d/lb7 to d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/ld1 0 2024-02-07T12:26:04.795 INFO:tasks.workunit.client.0.smithi047.stdout:5/798: dwrite da/d24/d63/d9a/dec/f99 [0,4194304] 0 2024-02-07T12:26:04.796 INFO:tasks.workunit.client.0.smithi047.stdout:0/583: dwrite f1 [0,4194304] 0 2024-02-07T12:26:04.796 INFO:tasks.workunit.client.0.smithi047.stdout:0/584: stat d19/d1c/d24/l4c 0 2024-02-07T12:26:04.796 INFO:tasks.workunit.client.0.smithi047.stdout:0/585: chown d19/d1c/d3c/c7b 1190 1 2024-02-07T12:26:04.796 INFO:tasks.workunit.client.0.smithi047.stdout:0/586: write d19/d1c/d2b/f88 [814857,130475] 0 2024-02-07T12:26:04.796 INFO:tasks.workunit.client.0.smithi047.stdout:0/587: mknod d19/d1c/d24/db1/cb9 0 2024-02-07T12:26:04.798 INFO:tasks.workunit.client.0.smithi047.stdout:0/588: mknod d19/cba 0 2024-02-07T12:26:04.798 INFO:tasks.workunit.client.0.smithi047.stdout:0/589: chown d19/d1c/d3c/d60/d6f/d95/daa/f42 2585738 1 2024-02-07T12:26:04.799 INFO:tasks.workunit.client.0.smithi047.stdout:0/590: mknod d19/d1c/d3c/d60/d6f/d95/daa/d8c/cbb 0 2024-02-07T12:26:04.800 INFO:tasks.workunit.client.0.smithi047.stdout:0/591: creat d19/d1c/d3c/d48/fbc x:0 0 0 2024-02-07T12:26:04.800 INFO:tasks.workunit.client.0.smithi047.stdout:9/581: dread d3/d10/d18/d3b/d3c/d5d/f78 [0,4194304] 0 2024-02-07T12:26:04.802 INFO:tasks.workunit.client.0.smithi047.stdout:9/582: link d3/fcc d3/d10/d18/d3d/fd2 0 2024-02-07T12:26:04.803 INFO:tasks.workunit.client.0.smithi047.stdout:9/583: truncate d3/d10/d18/d3b/d3c/d5d/fa6 525529 0 2024-02-07T12:26:04.805 INFO:tasks.workunit.client.0.smithi047.stdout:9/584: link d3/d10/l73 d3/d10/d18/d3b/d3c/d5d/d9b/ld3 0 2024-02-07T12:26:04.805 INFO:tasks.workunit.client.0.smithi047.stdout:9/585: stat d3/f19 0 2024-02-07T12:26:04.805 INFO:tasks.workunit.client.0.smithi047.stdout:9/586: fdatasync d3/d10/d18/f27 0 2024-02-07T12:26:04.808 INFO:tasks.workunit.client.0.smithi047.stdout:9/587: link d3/d10/d18/d3b/d3c/d5d/d70/f80 d3/d10/d18/d3b/d3c/d5d/fd4 0 2024-02-07T12:26:04.808 INFO:tasks.workunit.client.0.smithi047.stdout:9/588: dread - d3/d10/d18/d3d/dc0/fcb zero size 2024-02-07T12:26:04.809 INFO:tasks.workunit.client.0.smithi047.stdout:0/592: dread d19/d1c/d3c/d60/d6f/d95/daa/d49/f68 [0,4194304] 0 2024-02-07T12:26:04.809 INFO:tasks.workunit.client.0.smithi047.stdout:7/958: dwrite d0/df/d74/df5/f9b [0,4194304] 0 2024-02-07T12:26:04.809 INFO:tasks.workunit.client.0.smithi047.stdout:5/799: write da/d24/d63/f65 [2961451,48484] 0 2024-02-07T12:26:04.816 INFO:tasks.workunit.client.0.smithi047.stdout:9/589: unlink d3/d10/d18/f59 0 2024-02-07T12:26:04.818 INFO:tasks.workunit.client.0.smithi047.stdout:0/593: mkdir d19/d40/d66/d81/dbd 0 2024-02-07T12:26:04.819 INFO:tasks.workunit.client.0.smithi047.stdout:7/959: dread d0/df/d74/df5/f9b [0,4194304] 0 2024-02-07T12:26:04.819 INFO:tasks.workunit.client.0.smithi047.stdout:7/960: creat d0/d2f/f135 x:0 0 0 2024-02-07T12:26:04.822 INFO:tasks.workunit.client.0.smithi047.stdout:9/590: creat d3/d10/d18/d3b/d3c/d5d/d70/dad/dbf/fd5 x:0 0 0 2024-02-07T12:26:04.822 INFO:tasks.workunit.client.0.smithi047.stdout:9/591: dread - d3/d10/d18/d3b/d3c/d5d/d70/d7a/fca zero size 2024-02-07T12:26:04.822 INFO:tasks.workunit.client.0.smithi047.stdout:9/592: dread - d3/d10/d18/d3b/fc9 zero size 2024-02-07T12:26:04.824 INFO:tasks.workunit.client.0.smithi047.stdout:5/800: dwrite da/df/d16/d41/f46 [0,4194304] 0 2024-02-07T12:26:04.824 INFO:tasks.workunit.client.0.smithi047.stdout:5/801: creat da/d24/d63/f107 x:0 0 0 2024-02-07T12:26:04.826 INFO:tasks.workunit.client.0.smithi047.stdout:7/961: symlink d0/df/dd1/dee/l136 0 2024-02-07T12:26:04.826 INFO:tasks.workunit.client.0.smithi047.stdout:7/962: truncate d0/d42/d4d/d67/fc5 373409 0 2024-02-07T12:26:04.827 INFO:tasks.workunit.client.0.smithi047.stdout:7/963: creat d0/df/f137 x:0 0 0 2024-02-07T12:26:04.827 INFO:tasks.workunit.client.0.smithi047.stdout:9/593: mkdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/dd6 0 2024-02-07T12:26:04.827 INFO:tasks.workunit.client.0.smithi047.stdout:9/594: readlink d3/d10/d18/d3b/d3c/d5d/d9b/ld3 0 2024-02-07T12:26:04.827 INFO:tasks.workunit.client.0.smithi047.stdout:9/595: read d3/d10/d18/d3b/d3c/f4e [136858,13534] 0 2024-02-07T12:26:04.829 INFO:tasks.workunit.client.0.smithi047.stdout:0/594: link f18 d19/d40/d66/d81/fbe 0 2024-02-07T12:26:04.834 INFO:tasks.workunit.client.0.smithi047.stdout:9/596: mknod d3/d10/d18/d3b/d3c/d5d/d68/cd7 0 2024-02-07T12:26:04.835 INFO:tasks.workunit.client.0.smithi047.stdout:0/595: link d19/d1c/d3c/d60/d6f/d95/daa/d49/f68 d19/d40/d66/da9/fbf 0 2024-02-07T12:26:04.835 INFO:tasks.workunit.client.0.smithi047.stdout:7/964: dread d0/df/d74/df5/f71 [0,4194304] 0 2024-02-07T12:26:04.836 INFO:tasks.workunit.client.0.smithi047.stdout:5/802: truncate da/df/d16/d25/d33/d6e/fe7 835859 0 2024-02-07T12:26:04.837 INFO:tasks.workunit.client.0.smithi047.stdout:5/803: write da/df/d16/d25/f2d [132095,38377] 0 2024-02-07T12:26:04.837 INFO:tasks.workunit.client.0.smithi047.stdout:5/804: write da/dd0/f104 [878420,67504] 0 2024-02-07T12:26:04.840 INFO:tasks.workunit.client.0.smithi047.stdout:0/596: creat d19/d1c/d3c/d60/d6f/d70/fc0 x:0 0 0 2024-02-07T12:26:04.844 INFO:tasks.workunit.client.0.smithi047.stdout:9/597: getdents d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b 0 2024-02-07T12:26:04.850 INFO:tasks.workunit.client.0.smithi047.stdout:7/965: getdents d0/d4 0 2024-02-07T12:26:04.850 INFO:tasks.workunit.client.0.smithi047.stdout:7/966: chown d0/df/l14 9 1 2024-02-07T12:26:04.850 INFO:tasks.workunit.client.0.smithi047.stdout:7/967: dread - d0/df/d29/fb1 zero size 2024-02-07T12:26:04.853 INFO:tasks.workunit.client.0.smithi047.stdout:7/968: symlink d0/d4/d12c/l138 0 2024-02-07T12:26:04.856 INFO:tasks.workunit.client.0.smithi047.stdout:0/597: write fc [7847385,21247] 0 2024-02-07T12:26:04.856 INFO:tasks.workunit.client.0.smithi047.stdout:5/805: dwrite da/df/d16/d25/f2d [0,4194304] 0 2024-02-07T12:26:04.857 INFO:tasks.workunit.client.0.smithi047.stdout:0/598: symlink d19/d1c/d2b/d5f/lc1 0 2024-02-07T12:26:04.866 INFO:tasks.workunit.client.0.smithi047.stdout:0/599: mkdir d19/d1c/d2b/dc2 0 2024-02-07T12:26:04.867 INFO:tasks.workunit.client.0.smithi047.stdout:0/600: write d19/d1c/d3c/f9b [811302,7663] 0 2024-02-07T12:26:04.875 INFO:tasks.workunit.client.0.smithi047.stdout:9/598: dwrite d3/d10/d4c/f8d [0,4194304] 0 2024-02-07T12:26:04.876 INFO:tasks.workunit.client.0.smithi047.stdout:7/969: dwrite d0/df/d74/dcd/de4/fc9 [0,4194304] 0 2024-02-07T12:26:04.878 INFO:tasks.workunit.client.0.smithi047.stdout:9/599: creat d3/d10/d11/fd8 x:0 0 0 2024-02-07T12:26:04.878 INFO:tasks.workunit.client.0.smithi047.stdout:9/600: dread - d3/d10/d18/d3d/dc0/fcb zero size 2024-02-07T12:26:04.881 INFO:tasks.workunit.client.0.smithi047.stdout:0/601: dread d19/d1c/d3c/d60/d6f/d95/daa/f42 [0,4194304] 0 2024-02-07T12:26:04.881 INFO:tasks.workunit.client.0.smithi047.stdout:0/602: readlink d19/d1c/d24/l4c 0 2024-02-07T12:26:04.884 INFO:tasks.workunit.client.0.smithi047.stdout:7/970: creat d0/df/d74/df5/f139 x:0 0 0 2024-02-07T12:26:04.884 INFO:tasks.workunit.client.0.smithi047.stdout:9/601: mknod d3/d10/d18/d3b/d3c/d5d/d70/d7a/cd9 0 2024-02-07T12:26:04.884 INFO:tasks.workunit.client.0.smithi047.stdout:0/603: symlink d19/d1c/d3c/d60/d6f/d95/lc3 0 2024-02-07T12:26:04.884 INFO:tasks.workunit.client.0.smithi047.stdout:0/604: chown d19/d1c/cb7 90932 1 2024-02-07T12:26:04.886 INFO:tasks.workunit.client.0.smithi047.stdout:7/971: getdents d0/df/d74/dcd/de4 0 2024-02-07T12:26:04.886 INFO:tasks.workunit.client.0.smithi047.stdout:7/972: chown d0/df/d29/d31/l93 896544946 1 2024-02-07T12:26:04.901 INFO:tasks.workunit.client.0.smithi047.stdout:7/973: rmdir d0/d42/d4d 39 2024-02-07T12:26:04.901 INFO:tasks.workunit.client.0.smithi047.stdout:7/974: truncate d0/df/d74/dcd/de4/fbb 854684 0 2024-02-07T12:26:04.903 INFO:tasks.workunit.client.0.smithi047.stdout:5/806: rename da/df/d16/d25 to da/d24/d63/d9a/df2/db2/d108 0 2024-02-07T12:26:04.907 INFO:tasks.workunit.client.0.smithi047.stdout:5/807: rename da/d24/d63/d9a/df2/da6/fc4 to da/d24/f109 0 2024-02-07T12:26:04.907 INFO:tasks.workunit.client.0.smithi047.stdout:5/808: chown da/df/d16/d41/f46 73 1 2024-02-07T12:26:04.910 INFO:tasks.workunit.client.0.smithi047.stdout:9/602: rename d3/d10/d18/d3a/la2 to d3/lda 0 2024-02-07T12:26:04.910 INFO:tasks.workunit.client.0.smithi047.stdout:9/603: write d3/d10/d18/d3b/d3c/d5d/d70/f80 [773157,75895] 0 2024-02-07T12:26:04.913 INFO:tasks.workunit.client.0.smithi047.stdout:5/809: link da/c26 da/d24/d63/d9a/df2/db2/d108/d33/d55/c10a 0 2024-02-07T12:26:04.919 INFO:tasks.workunit.client.0.smithi047.stdout:9/604: dread d3/d10/d18/d3b/d3c/d5d/d70/f80 [0,4194304] 0 2024-02-07T12:26:04.922 INFO:tasks.workunit.client.0.smithi047.stdout:9/605: link d3/d10/d18/d3d/l74 d3/d10/d18/d3b/d3c/d5d/d70/dad/ldb 0 2024-02-07T12:26:04.922 INFO:tasks.workunit.client.0.smithi047.stdout:9/606: chown d3/fa0 8 1 2024-02-07T12:26:04.923 INFO:tasks.workunit.client.0.smithi047.stdout:7/975: dwrite d0/d42/d4d/d67/fb3 [0,4194304] 0 2024-02-07T12:26:04.923 INFO:tasks.workunit.client.0.smithi047.stdout:7/976: stat d0/d4/l127 0 2024-02-07T12:26:04.923 INFO:tasks.workunit.client.0.smithi047.stdout:7/977: truncate d0/d42/d4d/d67/fb3 4247048 0 2024-02-07T12:26:04.923 INFO:tasks.workunit.client.0.smithi047.stdout:7/978: truncate d0/df/d29/d31/d40/dd7/f12d 588559 0 2024-02-07T12:26:04.924 INFO:tasks.workunit.client.0.smithi047.stdout:9/607: mknod d3/d10/d18/d3b/cdc 0 2024-02-07T12:26:04.924 INFO:tasks.workunit.client.0.smithi047.stdout:9/608: creat d3/fdd x:0 0 0 2024-02-07T12:26:04.928 INFO:tasks.workunit.client.0.smithi047.stdout:7/979: getdents d0/df/d29/d31 0 2024-02-07T12:26:04.931 INFO:tasks.workunit.client.0.smithi047.stdout:7/980: unlink d0/df/fff 0 2024-02-07T12:26:04.932 INFO:tasks.workunit.client.0.smithi047.stdout:5/810: dwrite da/df/d16/dab/fb0 [0,4194304] 0 2024-02-07T12:26:04.941 INFO:tasks.workunit.client.0.smithi047.stdout:7/981: dread d0/df/f11 [0,4194304] 0 2024-02-07T12:26:04.942 INFO:tasks.workunit.client.0.smithi047.stdout:5/811: dread da/fd [0,4194304] 0 2024-02-07T12:26:04.942 INFO:tasks.workunit.client.0.smithi047.stdout:5/812: write da/d24/d63/d9a/df2/db2/d108/d33/d6e/da8/fce [8061314,55237] 0 2024-02-07T12:26:04.944 INFO:tasks.workunit.client.0.smithi047.stdout:5/813: creat da/d24/d63/d9a/df2/db2/d108/d71/dd2/f10b x:0 0 0 2024-02-07T12:26:04.944 INFO:tasks.workunit.client.0.smithi047.stdout:5/814: dread - da/d24/d63/d9a/df2/db2/d108/d33/d55/fe9 zero size 2024-02-07T12:26:04.944 INFO:tasks.workunit.client.0.smithi047.stdout:5/815: readlink da/d24/d63/d85/db3/ld4 0 2024-02-07T12:26:04.946 INFO:tasks.workunit.client.0.smithi047.stdout:5/816: creat da/d24/d63/d9a/dec/f10c x:0 0 0 2024-02-07T12:26:04.955 INFO:tasks.workunit.client.0.smithi047.stdout:5/817: dread da/d24/d63/d9a/df2/db2/d108/f3b [0,4194304] 0 2024-02-07T12:26:04.955 INFO:tasks.workunit.client.0.smithi047.stdout:5/818: fdatasync da/d24/d63/d9a/df2/db2/d108/f50 0 2024-02-07T12:26:04.956 INFO:tasks.workunit.client.0.smithi047.stdout:5/819: symlink da/d24/d63/d9a/df2/db2/d108/d33/d55/l10d 0 2024-02-07T12:26:04.961 INFO:tasks.workunit.client.0.smithi047.stdout:5/820: mkdir da/d24/d63/d9a/df2/db2/d108/d33/d91/d10e 0 2024-02-07T12:26:04.961 INFO:tasks.workunit.client.0.smithi047.stdout:7/982: dwrite d0/df/d29/d31/d40/f8c [0,4194304] 0 2024-02-07T12:26:04.961 INFO:tasks.workunit.client.0.smithi047.stdout:5/821: mkdir da/d24/d63/d9a/df2/db2/d108/d33/d91/d10f 0 2024-02-07T12:26:04.962 INFO:tasks.workunit.client.0.smithi047.stdout:7/983: creat d0/d42/d4d/f13a x:0 0 0 2024-02-07T12:26:04.962 INFO:tasks.workunit.client.0.smithi047.stdout:5/822: symlink da/d24/d63/d9a/df2/db2/d108/d33/d55/d7c/deb/l110 0 2024-02-07T12:26:04.962 INFO:tasks.workunit.client.0.smithi047.stdout:7/984: unlink d0/ca0 0 2024-02-07T12:26:04.963 INFO:tasks.workunit.client.0.smithi047.stdout:7/985: symlink d0/df/d29/l13b 0 2024-02-07T12:26:04.963 INFO:tasks.workunit.client.0.smithi047.stdout:7/986: dread - d0/d2f/f135 zero size 2024-02-07T12:26:04.963 INFO:tasks.workunit.client.0.smithi047.stdout:7/987: dread - d0/d42/f10e zero size 2024-02-07T12:26:04.963 INFO:tasks.workunit.client.0.smithi047.stdout:7/988: write d0/df/d29/d31/d40/f104 [4527837,74682] 0 2024-02-07T12:26:04.963 INFO:tasks.workunit.client.0.smithi047.stdout:5/823: getdents da/d24/d63/d85/db3 0 2024-02-07T12:26:04.963 INFO:tasks.workunit.client.0.smithi047.stdout:5/824: stat da/d24/d63/d9a/df2/da6 0 2024-02-07T12:26:04.964 INFO:tasks.workunit.client.0.smithi047.stdout:7/989: creat d0/d42/d4d/d67/dd8/f13c x:0 0 0 2024-02-07T12:26:04.965 INFO:tasks.workunit.client.0.smithi047.stdout:5/825: symlink da/d24/d63/d9a/df2/db2/d108/d33/d6e/da8/db6/l111 0 2024-02-07T12:26:04.967 INFO:tasks.workunit.client.0.smithi047.stdout:5/826: symlink da/d24/d63/d9a/df2/db2/d108/d33/l112 0 2024-02-07T12:26:04.968 INFO:tasks.workunit.client.0.smithi047.stdout:5/827: creat da/d24/de3/f113 x:0 0 0 2024-02-07T12:26:04.968 INFO:tasks.workunit.client.0.smithi047.stdout:5/828: chown da/d24/d63/d9a/df2/db2/d108/f96 244062 1 2024-02-07T12:26:04.987 INFO:tasks.workunit.client.0.smithi047.stdout:5/829: read da/d24/d63/d9a/df2/db2/d108/f2a [3417330,4792] 0 2024-02-07T12:26:04.987 INFO:tasks.workunit.client.0.smithi047.stdout:7/990: dwrite d0/f105 [0,4194304] 0 2024-02-07T12:26:04.989 INFO:tasks.workunit.client.0.smithi047.stdout:5/830: symlink da/d24/d63/d9a/dec/l114 0 2024-02-07T12:26:04.989 INFO:tasks.workunit.client.0.smithi047.stdout:5/831: chown da/d24/d63/d9a/df2/db2/fe1 709 1 2024-02-07T12:26:04.989 INFO:tasks.workunit.client.0.smithi047.stdout:5/832: creat da/dd0/f115 x:0 0 0 2024-02-07T12:26:04.990 INFO:tasks.workunit.client.0.smithi047.stdout:7/991: dread d0/d42/f112 [0,4194304] 0 2024-02-07T12:26:04.992 INFO:tasks.workunit.client.0.smithi047.stdout:5/833: mkdir da/d24/d63/d9a/df2/db2/d108/d33/d6e/d116 0 2024-02-07T12:26:04.994 INFO:tasks.workunit.client.0.smithi047.stdout:5/834: write da/d24/d63/d9a/f5b [6320291,38738] 0 2024-02-07T12:26:04.996 INFO:tasks.workunit.client.0.smithi047.stdout:5/835: mknod da/d24/d63/d9a/df2/db2/d108/d33/d91/d10e/c117 0 2024-02-07T12:26:04.996 INFO:tasks.workunit.client.0.smithi047.stdout:5/836: write da/d24/f4a [977512,577] 0 2024-02-07T12:26:04.996 INFO:tasks.workunit.client.0.smithi047.stdout:5/837: stat da/d24/f45 0 2024-02-07T12:26:04.996 INFO:tasks.workunit.client.0.smithi047.stdout:5/838: chown da/d24/fd3 7650413 1 2024-02-07T12:26:04.996 INFO:tasks.workunit.client.0.smithi047.stdout:5/839: chown da/dd0/f104 13335 1 2024-02-07T12:26:04.998 INFO:tasks.workunit.client.0.smithi047.stdout:5/840: write da/df/f94 [313336,69038] 0 2024-02-07T12:26:04.998 INFO:tasks.workunit.client.0.smithi047.stdout:5/841: stat da/d24/d63/d9a/df2/db2/d108/d33/d6e/dbb/lc8 0 2024-02-07T12:26:04.999 INFO:tasks.workunit.client.0.smithi047.stdout:5/842: mkdir da/d24/d63/d118 0 2024-02-07T12:26:05.000 INFO:tasks.workunit.client.0.smithi047.stdout:5/843: mkdir da/d24/d63/d9a/df2/da6/d119 0 2024-02-07T12:26:05.001 INFO:tasks.workunit.client.0.smithi047.stdout:5/844: write da/d24/d63/d9a/df2/da6/fc2 [645812,64614] 0 2024-02-07T12:26:05.001 INFO:tasks.workunit.client.0.smithi047.stdout:5/845: write da/d24/d63/d85/db3/ffd [657822,126637] 0 2024-02-07T12:26:05.001 INFO:tasks.workunit.client.0.smithi047.stdout:5/846: chown da/df/d16/dab/fb0 87135 1 2024-02-07T12:26:05.001 INFO:tasks.workunit.client.0.smithi047.stdout:5/847: write da/d24/d63/d9a/df2/db2/d108/d71/dd2/f10b [785988,86958] 0 2024-02-07T12:26:05.001 INFO:tasks.workunit.client.0.smithi047.stdout:5/848: dread - da/d24/d63/d9a/df2/da6/fcf zero size 2024-02-07T12:26:05.003 INFO:tasks.workunit.client.0.smithi047.stdout:7/992: dwrite d0/d42/f10e [0,4194304] 0 2024-02-07T12:26:05.003 INFO:tasks.workunit.client.0.smithi047.stdout:7/993: dread - d0/df/d74/dcd/f132 zero size 2024-02-07T12:26:05.003 INFO:tasks.workunit.client.0.smithi047.stdout:7/994: readlink d0/d42/l5e 0 2024-02-07T12:26:05.006 INFO:tasks.workunit.client.0.smithi047.stdout:7/995: creat d0/d2f/df0/d10c/f13d x:0 0 0 2024-02-07T12:26:05.008 INFO:tasks.workunit.client.0.smithi047.stdout:5/849: dread da/d24/d63/d9a/df2/db2/d108/f3b [0,4194304] 0 2024-02-07T12:26:05.009 INFO:tasks.workunit.client.0.smithi047.stdout:7/996: unlink d0/df/d74/df5/ld5 0 2024-02-07T12:26:05.011 INFO:tasks.workunit.client.0.smithi047.stdout:5/850: dread da/dd0/f104 [0,4194304] 0 2024-02-07T12:26:05.021 INFO:tasks.workunit.client.0.smithi047.stdout:5/851: dread da/d24/d63/d9a/df2/db2/d108/d33/f3c [0,4194304] 0 2024-02-07T12:26:05.023 INFO:tasks.workunit.client.0.smithi047.stdout:5/852: creat da/d24/d63/d9a/df2/db2/d108/d33/d91/d10e/f11a x:0 0 0 2024-02-07T12:26:05.023 INFO:tasks.workunit.client.0.smithi047.stdout:5/853: write da/df/d16/fc0 [656962,94624] 0 2024-02-07T12:26:05.024 INFO:tasks.workunit.client.0.smithi047.stdout:5/854: symlink da/dd0/l11b 0 2024-02-07T12:26:05.026 INFO:tasks.workunit.client.0.smithi047.stdout:5/855: unlink da/d24/d63/d9a/df2/db2/d108/d33/d6e/da8/db6/dd5/fb9 0 2024-02-07T12:26:05.026 INFO:tasks.workunit.client.0.smithi047.stdout:5/856: fsync da/d24/d63/d9a/df2/db2/d108/d33/d91/f105 0 2024-02-07T12:26:05.042 INFO:tasks.workunit.client.0.smithi047.stdout:5/857: dwrite da/d24/daa/faf [0,4194304] 0 2024-02-07T12:26:05.056 INFO:tasks.workunit.client.0.smithi047.stdout:5/858: dwrite da/df/d16/f74 [0,4194304] 0 2024-02-07T12:26:05.059 INFO:tasks.workunit.client.0.smithi047.stdout:5/859: creat da/d24/d63/d9c/da3/dfc/f11c x:0 0 0 2024-02-07T12:26:05.059 INFO:tasks.workunit.client.0.smithi047.stdout:5/860: read - da/d24/d63/d9a/df2/db2/d108/d33/d55/d7c/fca zero size 2024-02-07T12:26:05.067 INFO:tasks.workunit.client.0.smithi047.stdout:5/861: dread da/f11 [0,4194304] 0 2024-02-07T12:26:05.069 INFO:tasks.workunit.client.0.smithi047.stdout:5/862: mkdir da/df/d16/d41/d11d 0 2024-02-07T12:26:05.069 INFO:tasks.workunit.client.0.smithi047.stdout:5/863: truncate da/d24/d63/d9a/df2/db2/d108/d33/d55/f92 1820990 0 2024-02-07T12:26:05.069 INFO:tasks.workunit.client.0.smithi047.stdout:5/864: fsync da/df/d16/d41/f5a 0 2024-02-07T12:26:05.070 INFO:tasks.workunit.client.0.smithi047.stdout:5/865: mkdir da/d24/d63/d9a/df2/da6/d119/d11e 0 2024-02-07T12:26:05.070 INFO:tasks.workunit.client.0.smithi047.stdout:5/866: chown da/d24/d63/d9a/df2/db2/d108/d33/f35 2457 1 2024-02-07T12:26:05.071 INFO:tasks.workunit.client.0.smithi047.stdout:5/867: creat da/d24/d63/d9a/df2/db2/d108/d33/d91/f11f x:0 0 0 2024-02-07T12:26:05.074 INFO:tasks.workunit.client.0.smithi047.stdout:5/868: rename da/df/d16/f3d to da/d24/d63/d9a/df2/db2/d108/d33/d55/f120 0 2024-02-07T12:26:05.074 INFO:tasks.workunit.client.0.smithi047.stdout:5/869: fdatasync da/df/d16/d41/f46 0 2024-02-07T12:26:05.080 INFO:tasks.workunit.client.0.smithi047.stdout:5/870: dread da/f1a [0,4194304] 0 2024-02-07T12:26:05.080 INFO:tasks.workunit.client.0.smithi047.stdout:5/871: read - da/d24/d63/d9a/df2/db2/d108/fd1 zero size 2024-02-07T12:26:05.082 INFO:tasks.workunit.client.0.smithi047.stdout:5/872: rename da/d24/d63/d9a/df2/db2/d108/d33/d6e/dbb/lfe to da/d24/d63/d9a/df2/l121 0 2024-02-07T12:26:05.083 INFO:tasks.workunit.client.0.smithi047.stdout:5/873: unlink da/df/f98 0 2024-02-07T12:26:05.084 INFO:tasks.workunit.client.0.smithi047.stdout:5/874: fdatasync da/d24/d63/d9a/df2/db2/d108/d33/d55/d7c/deb/ff6 0 2024-02-07T12:26:05.085 INFO:tasks.workunit.client.0.smithi047.stdout:5/875: dread da/dd0/f104 [0,4194304] 0 2024-02-07T12:26:05.087 INFO:tasks.workunit.client.0.smithi047.stdout:5/876: rename da/df/l1d to da/d24/d63/d9a/df2/db2/d108/d33/d55/d7c/l122 0 2024-02-07T12:26:05.087 INFO:tasks.workunit.client.0.smithi047.stdout:5/877: fdatasync da/d24/d63/d9a/df2/db2/d108/f96 0 2024-02-07T12:26:05.093 INFO:tasks.workunit.client.0.smithi047.stdout:5/878: write da/d24/d63/d9c/da3/fbf [1947945,107232] 0 2024-02-07T12:26:05.094 INFO:tasks.workunit.client.0.smithi047.stdout:5/879: truncate da/df/fc6 2756594 0 2024-02-07T12:26:05.095 INFO:tasks.workunit.client.0.smithi047.stdout:5/880: unlink da/d24/d63/d9a/df2/db2/d108/d33/d55/d7c/fca 0 2024-02-07T12:26:05.095 INFO:tasks.workunit.client.0.smithi047.stdout:5/881: write da/d24/d63/d9a/dec/f10c [666455,91071] 0 2024-02-07T12:26:05.101 INFO:tasks.workunit.client.0.smithi047.stdout:5/882: write da/d24/d63/d9a/df2/db2/d108/d33/f3c [1103281,42484] 0 2024-02-07T12:26:05.164 INFO:tasks.workunit.client.0.smithi047.stdout:5/883: dwrite da/d24/d63/d9a/df2/db2/d108/dc1/f100 [0,4194304] 0 2024-02-07T12:26:05.172 INFO:tasks.workunit.client.0.smithi047.stdout:5/884: symlink da/df/d16/d41/d57/ddd/l123 0 2024-02-07T12:26:05.174 INFO:tasks.workunit.client.0.smithi047.stdout:5/885: creat da/df/df7/f124 x:0 0 0 2024-02-07T12:26:05.176 INFO:tasks.workunit.client.0.smithi047.stdout:5/886: fdatasync da/df/d16/fc0 0 2024-02-07T12:26:05.176 INFO:tasks.workunit.client.0.smithi047.stdout:5/887: readlink da/d24/d63/d9a/df2/db2/d108/d33/d55/l10d 0 2024-02-07T12:26:05.177 INFO:tasks.workunit.client.0.smithi047.stdout:5/888: rmdir da/df/d16/d41/d57/ddd 39 2024-02-07T12:26:05.178 INFO:tasks.workunit.client.0.smithi047.stdout:5/889: stat da/d24/d63/d9a/df2/db2/d108/c49 0 2024-02-07T12:26:05.178 INFO:tasks.workunit.client.0.smithi047.stdout:5/890: write da/d24/d63/d9a/f5b [6621667,91255] 0 2024-02-07T12:26:05.179 INFO:tasks.workunit.client.0.smithi047.stdout:5/891: creat da/d24/d63/d9a/df2/db2/d108/d33/d6e/dbb/f125 x:0 0 0 2024-02-07T12:26:05.180 INFO:tasks.workunit.client.0.smithi047.stdout:5/892: mknod da/df/d16/d41/d57/c126 0 2024-02-07T12:26:05.180 INFO:tasks.workunit.client.0.smithi047.stdout:5/893: write da/d24/d63/d9a/df2/db2/fe1 [901689,13992] 0 2024-02-07T12:26:05.181 INFO:tasks.workunit.client.0.smithi047.stdout:5/894: mkdir da/d24/d63/d85/db3/d127 0 2024-02-07T12:26:05.182 INFO:tasks.workunit.client.0.smithi047.stdout:5/895: chown da/df/ldb 2 1 2024-02-07T12:26:05.182 INFO:tasks.workunit.client.0.smithi047.stdout:5/896: stat da/df/d16/d41/d57/l5f 0 2024-02-07T12:26:05.189 INFO:tasks.workunit.client.0.smithi047.stdout:5/897: dread da/d24/d63/d9a/df2/db2/d108/fad [0,4194304] 0 2024-02-07T12:26:05.189 INFO:tasks.workunit.client.0.smithi047.stdout:5/898: dread - da/d24/d63/d9a/df2/db2/d108/f96 zero size 2024-02-07T12:26:05.190 INFO:tasks.workunit.client.0.smithi047.stdout:5/899: mkdir da/d24/d63/d9a/df2/db2/d108/d33/d55/d7c/d128 0 2024-02-07T12:26:05.191 INFO:tasks.workunit.client.0.smithi047.stdout:5/900: symlink da/d24/d63/d9a/df2/db2/d108/d71/d68/dda/l129 0 2024-02-07T12:26:05.210 INFO:tasks.workunit.client.0.smithi047.stdout:5/901: dwrite da/df/d16/fbd [0,4194304] 0 2024-02-07T12:26:05.225 INFO:tasks.workunit.client.0.smithi047.stdout:2/847: sync 2024-02-07T12:26:05.226 INFO:tasks.workunit.client.0.smithi047.stdout:2/848: write d7/dc/d4c/f7b [787087,52611] 0 2024-02-07T12:26:05.242 INFO:tasks.workunit.client.0.smithi047.stdout:2/849: dwrite d7/dc/f84 [0,4194304] 0 2024-02-07T12:26:05.500 INFO:tasks.workunit.client.0.smithi047.stdout:8/740: sync 2024-02-07T12:26:05.501 INFO:tasks.workunit.client.0.smithi047.stdout:8/741: write d3/d36/d50/d2a/f32 [1085672,53866] 0 2024-02-07T12:26:05.501 INFO:tasks.workunit.client.0.smithi047.stdout:8/742: fdatasync d3/d66/dac/fc1 0 2024-02-07T12:26:05.523 INFO:tasks.workunit.client.0.smithi047.stdout:8/743: dwrite d3/d66/d67/d6a/d91/fcc [0,4194304] 0 2024-02-07T12:26:05.530 INFO:tasks.workunit.client.0.smithi047.stdout:8/744: dread d3/d36/d50/d30/f90 [0,4194304] 0 2024-02-07T12:26:05.532 INFO:tasks.workunit.client.0.smithi047.stdout:8/745: rename d3/d4/d4d/db7 to d3/d66/d67/d6a/df3 0 2024-02-07T12:26:05.532 INFO:tasks.workunit.client.0.smithi047.stdout:8/746: write d3/d66/d67/d6a/f51 [8754498,27367] 0 2024-02-07T12:26:05.546 INFO:tasks.workunit.client.0.smithi047.stdout:8/747: dwrite d3/f6f [0,4194304] 0 2024-02-07T12:26:05.549 INFO:tasks.workunit.client.0.smithi047.stdout:8/748: creat d3/d36/d50/ff4 x:0 0 0 2024-02-07T12:26:05.549 INFO:tasks.workunit.client.0.smithi047.stdout:8/749: fsync d3/d66/d67/d6a/f4c 0 2024-02-07T12:26:05.550 INFO:tasks.workunit.client.0.smithi047.stdout:8/750: mkdir d3/d36/d9d/dbe/df5 0 2024-02-07T12:26:05.550 INFO:tasks.workunit.client.0.smithi047.stdout:8/751: write d3/d36/d50/d30/d9e/dcb/fdd [328769,21220] 0 2024-02-07T12:26:05.550 INFO:tasks.workunit.client.0.smithi047.stdout:8/752: chown d3/d4/d4d 31 1 2024-02-07T12:26:05.558 INFO:tasks.workunit.client.0.smithi047.stdout:8/753: write d3/d66/f7d [3925288,27326] 0 2024-02-07T12:26:05.559 INFO:tasks.workunit.client.0.smithi047.stdout:8/754: mknod d3/d36/de2/de5/cf6 0 2024-02-07T12:26:05.560 INFO:tasks.workunit.client.0.smithi047.stdout:8/755: fsync d3/d36/d50/fb5 0 2024-02-07T12:26:05.560 INFO:tasks.workunit.client.0.smithi047.stdout:8/756: fsync d3/d36/d50/d30/d9e/da6/fdb 0 2024-02-07T12:26:05.560 INFO:tasks.workunit.client.0.smithi047.stdout:8/757: creat d3/d36/de2/de5/ff7 x:0 0 0 2024-02-07T12:26:05.573 INFO:tasks.workunit.client.0.smithi047.stdout:8/758: dwrite d3/d36/d50/d30/d9e/da6/f84 [0,4194304] 0 2024-02-07T12:26:05.588 INFO:tasks.workunit.client.0.smithi047.stdout:8/759: write d3/d4/f1e [356160,108360] 0 2024-02-07T12:26:05.589 INFO:tasks.workunit.client.0.smithi047.stdout:8/760: rename d3/d36/d50/d30/d34/f35 to d3/d4/d4d/dc0/ff8 0 2024-02-07T12:26:05.592 INFO:tasks.workunit.client.0.smithi047.stdout:8/761: rename d3/d36/d50/d30/d9e/dcb to d3/d36/d9d/dbe/df5/df9 0 2024-02-07T12:26:05.594 INFO:tasks.workunit.client.0.smithi047.stdout:8/762: write d3/d36/f4b [441351,71727] 0 2024-02-07T12:26:05.594 INFO:tasks.workunit.client.0.smithi047.stdout:8/763: readlink d3/d36/d50/d2a/l62 0 2024-02-07T12:26:05.609 INFO:tasks.workunit.client.0.smithi047.stdout:8/764: dwrite d3/d36/d50/d30/f5e [0,4194304] 0 2024-02-07T12:26:05.610 INFO:tasks.workunit.client.0.smithi047.stdout:8/765: mknod d3/d66/dac/cfa 0 2024-02-07T12:26:05.611 INFO:tasks.workunit.client.0.smithi047.stdout:8/766: mknod d3/d66/dac/cfb 0 2024-02-07T12:26:05.613 INFO:tasks.workunit.client.0.smithi047.stdout:8/767: rename d3/d36/d50/d30/l3a to d3/d36/de2/de5/lfc 0 2024-02-07T12:26:05.613 INFO:tasks.workunit.client.0.smithi047.stdout:8/768: stat d3/d66/d67/c73 0 2024-02-07T12:26:05.614 INFO:tasks.workunit.client.0.smithi047.stdout:8/769: write d3/d36/f9b [1041093,31964] 0 2024-02-07T12:26:05.622 INFO:tasks.workunit.client.0.smithi047.stdout:8/770: dread d3/d66/d67/d71/d93/f95 [0,4194304] 0 2024-02-07T12:26:05.623 INFO:tasks.workunit.client.0.smithi047.stdout:8/771: link d3/d36/f9b d3/d36/d50/ffd 0 2024-02-07T12:26:05.625 INFO:tasks.workunit.client.0.smithi047.stdout:8/772: creat d3/d66/d67/d6a/d91/ffe x:0 0 0 2024-02-07T12:26:05.626 INFO:tasks.workunit.client.0.smithi047.stdout:8/773: mknod d3/d4/cff 0 2024-02-07T12:26:05.628 INFO:tasks.workunit.client.0.smithi047.stdout:8/774: mkdir d3/d36/d50/d28/d100 0 2024-02-07T12:26:05.628 INFO:tasks.workunit.client.0.smithi047.stdout:8/775: creat d3/d66/d67/d6a/dca/f101 x:0 0 0 2024-02-07T12:26:05.629 INFO:tasks.workunit.client.0.smithi047.stdout:8/776: truncate d3/d4/d4d/fc5 341320 0 2024-02-07T12:26:05.629 INFO:tasks.workunit.client.0.smithi047.stdout:8/777: chown d3/d66/d67 3630092 1 2024-02-07T12:26:05.635 INFO:tasks.workunit.client.0.smithi047.stdout:8/778: getdents d3/d36/d50/d30 0 2024-02-07T12:26:05.636 INFO:tasks.workunit.client.0.smithi047.stdout:8/779: symlink d3/d66/l102 0 2024-02-07T12:26:05.636 INFO:tasks.workunit.client.0.smithi047.stdout:8/780: getdents d3/d66/d67/d71/d93/dd8 0 2024-02-07T12:26:05.637 INFO:tasks.workunit.client.0.smithi047.stdout:8/781: creat d3/d4/d87/f103 x:0 0 0 2024-02-07T12:26:05.654 INFO:tasks.workunit.client.0.smithi047.stdout:8/782: dwrite d3/d66/d67/d6a/d91/ffe [0,4194304] 0 2024-02-07T12:26:05.763 INFO:tasks.workunit.client.0.smithi047.stdout:1/589: sync 2024-02-07T12:26:05.765 INFO:tasks.workunit.client.0.smithi047.stdout:1/590: dread d1/d15/d2f/d3d/d3e/f7a [0,4194304] 0 2024-02-07T12:26:05.766 INFO:tasks.workunit.client.0.smithi047.stdout:1/591: rmdir d1/d15/d30/d46/d4c 39 2024-02-07T12:26:05.766 INFO:tasks.workunit.client.0.smithi047.stdout:1/592: readlink d1/d15/d30/l8c 0 2024-02-07T12:26:05.768 INFO:tasks.workunit.client.0.smithi047.stdout:1/593: rmdir d1/d48/d81 39 2024-02-07T12:26:05.770 INFO:tasks.workunit.client.0.smithi047.stdout:1/594: mkdir d1/d15/d2f/d3d/d3e/dbb 0 2024-02-07T12:26:05.771 INFO:tasks.workunit.client.0.smithi047.stdout:1/595: write d1/d15/d30/d46/d66/fb6 [217718,61053] 0 2024-02-07T12:26:05.773 INFO:tasks.workunit.client.0.smithi047.stdout:1/596: mkdir d1/d15/d30/d46/d66/dac/dbc 0 2024-02-07T12:26:05.775 INFO:tasks.workunit.client.0.smithi047.stdout:1/597: link d1/fe d1/d15/d30/d46/d66/dac/dbc/fbd 0 2024-02-07T12:26:05.778 INFO:tasks.workunit.client.0.smithi047.stdout:1/598: read d1/d6e/d75/da7/f24 [1215178,22396] 0 2024-02-07T12:26:05.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:05 smithi138 ceph-mon[35528]: pgmap v19: 65 pgs: 65 active+clean; 1.7 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 125 MiB/s rd, 153 MiB/s wr, 456 op/s 2024-02-07T12:26:05.793 INFO:tasks.workunit.client.0.smithi047.stdout:1/599: dwrite d1/d15/d2f/d3d/d3e/f4a [0,4194304] 0 2024-02-07T12:26:05.794 INFO:tasks.workunit.client.0.smithi047.stdout:1/600: mknod d1/d15/d2f/d3d/d84/cbe 0 2024-02-07T12:26:05.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:05 smithi047 ceph-mon[28972]: pgmap v19: 65 pgs: 65 active+clean; 1.7 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 125 MiB/s rd, 153 MiB/s wr, 456 op/s 2024-02-07T12:26:05.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.907+0000 7fa2fde8e700 1 -- 172.21.15.47:0/841233258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f8102430 msgr2=0x7fa2f8104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:05.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.907+0000 7fa2fde8e700 1 --2- 172.21.15.47:0/841233258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f8102430 0x7fa2f8104810 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec004940 tx=0x7fa2ec009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:05.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.907+0000 7fa2fde8e700 1 -- 172.21.15.47:0/841233258 shutdown_connections 2024-02-07T12:26:05.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.907+0000 7fa2fde8e700 1 --2- 172.21.15.47:0/841233258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f8102430 0x7fa2f8104810 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:05.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.907+0000 7fa2fde8e700 1 --2- 172.21.15.47:0/841233258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2f8066c70 0x7fa2f8101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:05.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.907+0000 7fa2fde8e700 1 -- 172.21.15.47:0/841233258 >> 172.21.15.47:0/841233258 conn(0x7fa2f80f7500 msgr2=0x7fa2f80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:05.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.908+0000 7fa2fde8e700 1 -- 172.21.15.47:0/841233258 shutdown_connections 2024-02-07T12:26:05.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.908+0000 7fa2fde8e700 1 -- 172.21.15.47:0/841233258 wait complete. 2024-02-07T12:26:05.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.908+0000 7fa2fde8e700 1 Processor -- start 2024-02-07T12:26:05.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.908+0000 7fa2fde8e700 1 -- start start 2024-02-07T12:26:05.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.908+0000 7fa2fde8e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f8066c70 0x7fa2f810fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:05.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.909+0000 7fa2fde8e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2f8102430 0x7fa2f8110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:05.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.909+0000 7fa2fde8e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f8110650 con 0x7fa2f8066c70 2024-02-07T12:26:05.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.909+0000 7fa2fde8e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f8110ef0 con 0x7fa2f8102430 2024-02-07T12:26:05.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.909+0000 7fa2f77fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f8066c70 0x7fa2f810fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:05.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.909+0000 7fa2f77fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f8066c70 0x7fa2f810fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42068/0 (socket says 172.21.15.47:42068) 2024-02-07T12:26:05.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.909+0000 7fa2f77fe700 1 -- 172.21.15.47:0/3475031588 learned_addr learned my addr 172.21.15.47:0/3475031588 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:05.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.909+0000 7fa2f6ffd700 1 --2- 172.21.15.47:0/3475031588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2f8102430 0x7fa2f8110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:05.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.909+0000 7fa2f77fe700 1 -- 172.21.15.47:0/3475031588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2f8102430 msgr2=0x7fa2f8110050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:05.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.909+0000 7fa2f77fe700 1 --2- 172.21.15.47:0/3475031588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2f8102430 0x7fa2f8110050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:05.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.909+0000 7fa2f77fe700 1 -- 172.21.15.47:0/3475031588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec005040 con 0x7fa2f8066c70 2024-02-07T12:26:05.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.909+0000 7fa2f77fe700 1 --2- 172.21.15.47:0/3475031588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f8066c70 0x7fa2f810fb10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800eb40 tx=0x7fa2e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:05.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.909+0000 7fa2dffff700 1 -- 172.21.15.47:0/3475031588 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e8007cc0 con 0x7fa2f8066c70 2024-02-07T12:26:05.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.910+0000 7fa2fde8e700 1 -- 172.21.15.47:0/3475031588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f8111170 con 0x7fa2f8066c70 2024-02-07T12:26:05.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.910+0000 7fa2fde8e700 1 -- 172.21.15.47:0/3475031588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f81116b0 con 0x7fa2f8066c70 2024-02-07T12:26:05.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.910+0000 7fa2dffff700 1 -- 172.21.15.47:0/3475031588 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2e800f040 con 0x7fa2f8066c70 2024-02-07T12:26:05.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.910+0000 7fa2dffff700 1 -- 172.21.15.47:0/3475031588 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e8009550 con 0x7fa2f8066c70 2024-02-07T12:26:05.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.911+0000 7fa2fde8e700 1 -- 172.21.15.47:0/3475031588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f8109c50 con 0x7fa2f8066c70 2024-02-07T12:26:05.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.911+0000 7fa2dffff700 1 -- 172.21.15.47:0/3475031588 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7fa2e80096b0 con 0x7fa2f8066c70 2024-02-07T12:26:05.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.912+0000 7fa2dffff700 1 --2- 172.21.15.47:0/3475031588 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fa2e006b140 0x7fa2e006d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:05.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.912+0000 7fa2dffff700 1 -- 172.21.15.47:0/3475031588 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa2e80898a0 con 0x7fa2f8066c70 2024-02-07T12:26:05.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.912+0000 7fa2f6ffd700 1 --2- 172.21.15.47:0/3475031588 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fa2e006b140 0x7fa2e006d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:05.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.913+0000 7fa2f6ffd700 1 --2- 172.21.15.47:0/3475031588 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fa2e006b140 0x7fa2e006d5f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec000c00 tx=0x7fa2ec009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:05.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:05.917+0000 7fa2dffff700 1 -- 172.21.15.47:0/3475031588 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa2e804f620 con 0x7fa2f8066c70 2024-02-07T12:26:05.968 INFO:tasks.workunit.client.0.smithi047.stdout:3/824: sync 2024-02-07T12:26:05.968 INFO:tasks.workunit.client.0.smithi047.stdout:3/825: write d12/d19/d37/f68 [3889961,128201] 0 2024-02-07T12:26:05.969 INFO:tasks.workunit.client.0.smithi047.stdout:3/826: unlink d12/d19/f2e 0 2024-02-07T12:26:05.970 INFO:tasks.workunit.client.0.smithi047.stdout:3/827: symlink d12/dc7/d29/d31/d7c/df3/l10f 0 2024-02-07T12:26:05.971 INFO:tasks.workunit.client.0.smithi047.stdout:3/828: rmdir d12/dc7/d29/d31/d7c/df3 39 2024-02-07T12:26:05.972 INFO:tasks.workunit.client.0.smithi047.stdout:3/829: symlink d12/dc7/d29/d6f/d93/dac/l110 0 2024-02-07T12:26:05.972 INFO:tasks.workunit.client.0.smithi047.stdout:3/830: rmdir d12/dc7/d29/d31/d38/d59/d87/dc5 39 2024-02-07T12:26:05.973 INFO:tasks.workunit.client.0.smithi047.stdout:3/831: mknod d12/dc7/d29/d6f/d93/dba/dbf/c111 0 2024-02-07T12:26:05.978 INFO:tasks.workunit.client.0.smithi047.stdout:3/832: rmdir d12/d19 39 2024-02-07T12:26:05.978 INFO:tasks.workunit.client.0.smithi047.stdout:3/833: write d12/d19/d37/f68 [1784656,71039] 0 2024-02-07T12:26:05.995 INFO:tasks.workunit.client.0.smithi047.stdout:3/834: dwrite d12/d19/f8f [0,4194304] 0 2024-02-07T12:26:05.996 INFO:tasks.workunit.client.0.smithi047.stdout:3/835: readlink d12/dc7/d29/l73 0 2024-02-07T12:26:05.997 INFO:tasks.workunit.client.0.smithi047.stdout:3/836: rename d12/dc7/d29/d31/d38/l6e to d12/dc7/d29/da9/l112 0 2024-02-07T12:26:06.005 INFO:tasks.workunit.client.0.smithi047.stdout:3/837: dread d12/dc7/d29/f2f [0,4194304] 0 2024-02-07T12:26:06.005 INFO:tasks.workunit.client.0.smithi047.stdout:3/838: readlink d12/dc7/d29/da9/l112 0 2024-02-07T12:26:06.012 INFO:tasks.workunit.client.0.smithi047.stdout:3/839: dread d12/dc7/d29/f66 [0,4194304] 0 2024-02-07T12:26:06.014 INFO:tasks.workunit.client.0.smithi047.stdout:3/840: mknod d12/dc7/c113 0 2024-02-07T12:26:06.015 INFO:tasks.workunit.client.0.smithi047.stdout:3/841: creat d12/dc7/d90/f114 x:0 0 0 2024-02-07T12:26:06.016 INFO:tasks.workunit.client.0.smithi047.stdout:3/842: mkdir d12/dc7/d29/d6f/d93/dac/d115 0 2024-02-07T12:26:06.019 INFO:tasks.workunit.client.0.smithi047.stdout:3/843: rename d12/l20 to d12/dc7/d29/d31/d38/l116 0 2024-02-07T12:26:06.019 INFO:tasks.workunit.client.0.smithi047.stdout:3/844: chown d12/dc7/d29/d6f/d93/dba 45 1 2024-02-07T12:26:06.020 INFO:tasks.workunit.client.0.smithi047.stdout:3/845: unlink d12/dc7/d29/d31/d38/d59/de6/l9a 0 2024-02-07T12:26:06.020 INFO:tasks.workunit.client.0.smithi047.stdout:3/846: fsync d12/d19/f1d 0 2024-02-07T12:26:06.020 INFO:tasks.workunit.client.0.smithi047.stdout:3/847: creat d12/dc7/d29/d31/f117 x:0 0 0 2024-02-07T12:26:06.021 INFO:tasks.workunit.client.0.smithi047.stdout:3/848: dread d12/dc7/d29/d31/f32 [0,4194304] 0 2024-02-07T12:26:06.022 INFO:tasks.workunit.client.0.smithi047.stdout:3/849: creat d12/dc7/d29/d6f/d93/dac/d115/f118 x:0 0 0 2024-02-07T12:26:06.023 INFO:tasks.workunit.client.0.smithi047.stdout:3/850: symlink d12/dc7/d29/d6f/d93/dac/d115/l119 0 2024-02-07T12:26:06.023 INFO:tasks.workunit.client.0.smithi047.stdout:3/851: fdatasync d12/dc7/d29/d31/d38/d59/d87/dc5/f103 0 2024-02-07T12:26:06.032 INFO:tasks.workunit.client.0.smithi047.stdout:3/852: dread d12/dc7/f2c [0,4194304] 0 2024-02-07T12:26:06.034 INFO:tasks.workunit.client.0.smithi047.stdout:3/853: rmdir d12/dc7/d29/d31/d38/d59/de6/d95 39 2024-02-07T12:26:06.034 INFO:tasks.workunit.client.0.smithi047.stdout:3/854: readlink d12/d19/d2d/d42/l78 0 2024-02-07T12:26:06.034 INFO:tasks.workunit.client.0.smithi047.stdout:3/855: write d12/d19/d2d/d82/f85 [4023334,89473] 0 2024-02-07T12:26:06.036 INFO:tasks.workunit.client.0.smithi047.stdout:3/856: mknod d12/dc7/d29/d31/d7c/d8c/c11a 0 2024-02-07T12:26:06.055 INFO:tasks.workunit.client.0.smithi047.stdout:3/857: dwrite d12/dc7/d29/d31/f45 [0,4194304] 0 2024-02-07T12:26:06.055 INFO:tasks.workunit.client.0.smithi047.stdout:3/858: chown d12/dc7/cd1 18181131 1 2024-02-07T12:26:06.056 INFO:tasks.workunit.client.0.smithi047.stdout:3/859: mkdir d12/d19/d2d/d33/d8d/d11b 0 2024-02-07T12:26:06.059 INFO:tasks.workunit.client.0.smithi047.stdout:6/742: sync 2024-02-07T12:26:06.059 INFO:tasks.workunit.client.0.smithi047.stdout:6/743: chown d3/d5/d35/d3c/d90/ld5 60 1 2024-02-07T12:26:06.059 INFO:tasks.workunit.client.0.smithi047.stdout:6/744: chown d3/da/d2c/d47/f98 2465074 1 2024-02-07T12:26:06.062 INFO:tasks.workunit.client.0.smithi047.stdout:3/860: write d12/f3d [410524,24899] 0 2024-02-07T12:26:06.068 INFO:tasks.workunit.client.0.smithi047.stdout:6/745: write d3/d5/f27 [2052952,22157] 0 2024-02-07T12:26:06.072 INFO:tasks.workunit.client.0.smithi047.stdout:6/746: rename d3/d5/f15 to d3/da/d3b/d87/de4/ff9 0 2024-02-07T12:26:06.073 INFO:tasks.workunit.client.0.smithi047.stdout:6/747: creat d3/da/d14/d28/ffa x:0 0 0 2024-02-07T12:26:06.075 INFO:tasks.workunit.client.0.smithi047.stdout:6/748: creat d3/da/d3b/ffb x:0 0 0 2024-02-07T12:26:06.075 INFO:tasks.workunit.client.0.smithi047.stdout:6/749: stat d3/d5/d35/d3c/d72/d8c/d95/l6a 0 2024-02-07T12:26:06.075 INFO:tasks.workunit.client.0.smithi047.stdout:6/750: chown d3/da/lbf 9408548 1 2024-02-07T12:26:06.076 INFO:tasks.workunit.client.0.smithi047.stdout:6/751: getdents d3/da/d3b/df6 0 2024-02-07T12:26:06.077 INFO:tasks.workunit.client.0.smithi047.stdout:6/752: readlink d3/da/d34/d6d/l73 0 2024-02-07T12:26:06.077 INFO:tasks.workunit.client.0.smithi047.stdout:3/861: dwrite d12/dc7/d29/d6f/d93/dac/d115/f118 [0,4194304] 0 2024-02-07T12:26:06.077 INFO:tasks.workunit.client.0.smithi047.stdout:3/862: chown d12/dc7/d29/d6f/d93/dac/ff4 7 1 2024-02-07T12:26:06.077 INFO:tasks.workunit.client.0.smithi047.stdout:3/863: chown d12/dc7/d29/d31/d7c/fe8 1 1 2024-02-07T12:26:06.091 INFO:tasks.workunit.client.0.smithi047.stdout:3/864: dread d12/d19/d2d/d42/f55 [0,4194304] 0 2024-02-07T12:26:06.094 INFO:tasks.workunit.client.0.smithi047.stdout:6/753: dwrite d3/d5/f26 [0,4194304] 0 2024-02-07T12:26:06.094 INFO:tasks.workunit.client.0.smithi047.stdout:6/754: chown d3/d5/d35/c56 18 1 2024-02-07T12:26:06.094 INFO:tasks.workunit.client.0.smithi047.stdout:6/755: chown d3/da/d14/d28/df0 534965518 1 2024-02-07T12:26:06.094 INFO:tasks.workunit.client.0.smithi047.stdout:6/756: write d3/d5/d35/d3c/d72/d8c/d95/f4a [3234648,129518] 0 2024-02-07T12:26:06.094 INFO:tasks.workunit.client.0.smithi047.stdout:6/757: write d3/da/d2c/d42/f7b [2041837,45062] 0 2024-02-07T12:26:06.095 INFO:tasks.workunit.client.0.smithi047.stdout:6/758: rename d3/da/d14/d9e/ccd to d3/da/d14/d28/df0/cfc 0 2024-02-07T12:26:06.095 INFO:tasks.workunit.client.0.smithi047.stdout:6/759: fdatasync d3/da/d3b/f5e 0 2024-02-07T12:26:06.096 INFO:tasks.workunit.client.0.smithi047.stdout:3/865: dread d12/f64 [0,4194304] 0 2024-02-07T12:26:06.103 INFO:tasks.workunit.client.0.smithi047.stdout:6/760: rename d3/d5/d35/d3c/d72/d8c/d95/f78 to d3/da/d14/d28/d46/d94/ffd 0 2024-02-07T12:26:06.105 INFO:tasks.workunit.client.0.smithi047.stdout:3/866: dread d12/dc7/d29/fa4 [0,4194304] 0 2024-02-07T12:26:06.107 INFO:tasks.workunit.client.0.smithi047.stdout:3/867: link d12/d19/f1e d12/d19/d2d/d33/d8d/dff/f11c 0 2024-02-07T12:26:06.110 INFO:tasks.workunit.client.0.smithi047.stdout:3/868: link d12/dc7/d29/d31/d7c/d8c/cb2 d12/d19/d2d/c11d 0 2024-02-07T12:26:06.111 INFO:tasks.workunit.client.0.smithi047.stdout:3/869: readlink d12/dc7/d29/d31/d7c/la6 0 2024-02-07T12:26:06.111 INFO:tasks.workunit.client.0.smithi047.stdout:3/870: chown d12/dc7/d29/d31/d38/d59/d87/dc5/f103 4091 1 2024-02-07T12:26:06.112 INFO:tasks.workunit.client.0.smithi047.stdout:0/605: sync 2024-02-07T12:26:06.113 INFO:tasks.workunit.client.0.smithi047.stdout:7/997: sync 2024-02-07T12:26:06.113 INFO:tasks.workunit.client.0.smithi047.stdout:6/761: write d3/d5/d35/f3d [513197,80526] 0 2024-02-07T12:26:06.113 INFO:tasks.workunit.client.0.smithi047.stdout:5/902: sync 2024-02-07T12:26:06.113 INFO:tasks.workunit.client.0.smithi047.stdout:2/850: sync 2024-02-07T12:26:06.113 INFO:tasks.workunit.client.0.smithi047.stdout:8/783: sync 2024-02-07T12:26:06.113 INFO:tasks.workunit.client.0.smithi047.stdout:8/784: truncate d3/d4/d4d/fb8 526497 0 2024-02-07T12:26:06.113 INFO:tasks.workunit.client.0.smithi047.stdout:8/785: write d3/d4/d4d/fc5 [378590,127144] 0 2024-02-07T12:26:06.113 INFO:tasks.workunit.client.0.smithi047.stdout:9/609: sync 2024-02-07T12:26:06.114 INFO:tasks.workunit.client.0.smithi047.stdout:3/871: creat d12/d19/d2d/d33/f11e x:0 0 0 2024-02-07T12:26:06.116 INFO:tasks.workunit.client.0.smithi047.stdout:0/606: rename d19/d1c/d2b/c47 to d19/d40/d66/d81/dbd/cc4 0 2024-02-07T12:26:06.124 INFO:tasks.workunit.client.0.smithi047.stdout:6/762: unlink d3/da/d34/d6d/d8f/db3/dbc/dd7/fea 0 2024-02-07T12:26:06.127 INFO:tasks.workunit.client.0.smithi047.stdout:5/903: mknod da/d24/d63/d85/db3/d127/c12a 0 2024-02-07T12:26:06.127 INFO:tasks.workunit.client.0.smithi047.stdout:5/904: stat da/d24/d63/d9a/df2/db2/d108/d33/d55/d7c/deb/ff6 0 2024-02-07T12:26:06.128 INFO:tasks.workunit.client.0.smithi047.stdout:1/601: sync 2024-02-07T12:26:06.130 INFO:tasks.workunit.client.0.smithi047.stdout:8/786: mkdir d3/d66/d67/d6a/dca/d104 0 2024-02-07T12:26:06.132 INFO:tasks.workunit.client.0.smithi047.stdout:3/872: truncate d12/dc7/d29/d31/d38/fbb 358995 0 2024-02-07T12:26:06.133 INFO:tasks.workunit.client.0.smithi047.stdout:9/610: dwrite d3/d10/d18/f27 [0,4194304] 0 2024-02-07T12:26:06.133 INFO:tasks.workunit.client.0.smithi047.stdout:9/611: stat d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4 0 2024-02-07T12:26:06.138 INFO:tasks.workunit.client.0.smithi047.stdout:7/998: rename d0/d42/d4d/d67/ffe to d0/d42/d4d/d67/dfd/d130/f13e 0 2024-02-07T12:26:06.140 INFO:tasks.workunit.client.0.smithi047.stdout:5/905: symlink da/d24/d63/d9a/df2/db2/d108/d33/l12b 0 2024-02-07T12:26:06.141 INFO:tasks.workunit.client.0.smithi047.stdout:5/906: stat da/d24/d63/d9a/df2/db2/d108/d33/d55/d7c/deb 0 2024-02-07T12:26:06.142 INFO:tasks.workunit.client.0.smithi047.stdout:7/999: dread d0/f2c [0,4194304] 0 2024-02-07T12:26:06.142 INFO:tasks.workunit.client.0.smithi047.stdout:2/851: getdents d7/dc/d51/dda 0 2024-02-07T12:26:06.143 INFO:tasks.workunit.client.0.smithi047.stdout:8/787: truncate d3/f4a 939302 0 2024-02-07T12:26:06.147 INFO:tasks.workunit.client.0.smithi047.stdout:6/763: dwrite d3/da/d34/f5a [0,4194304] 0 2024-02-07T12:26:06.147 INFO:tasks.workunit.client.0.smithi047.stdout:6/764: readlink d3/da/d14/d28/d46/ldd 0 2024-02-07T12:26:06.148 INFO:tasks.workunit.client.0.smithi047.stdout:1/602: rename d1/d6e/d75/da7/d40/f61 to d1/d15/d30/d46/d66/dac/fbf 0 2024-02-07T12:26:06.149 INFO:tasks.workunit.client.0.smithi047.stdout:5/907: mkdir da/d12c 0 2024-02-07T12:26:06.150 INFO:tasks.workunit.client.0.smithi047.stdout:2/852: mkdir d7/dc/d51/dda/d113 0 2024-02-07T12:26:06.153 INFO:tasks.workunit.client.0.smithi047.stdout:6/765: mknod d3/d5/d35/d3c/d72/cfe 0 2024-02-07T12:26:06.155 INFO:tasks.workunit.client.0.smithi047.stdout:3/873: rename d12/d19/d2d/d42/d6b/fb9 to d12/d19/d37/dd5/f11f 0 2024-02-07T12:26:06.157 INFO:tasks.workunit.client.0.smithi047.stdout:1/603: creat d1/d48/d74/fc0 x:0 0 0 2024-02-07T12:26:06.158 INFO:tasks.workunit.client.0.smithi047.stdout:5/908: mknod da/d24/d63/d85/c12d 0 2024-02-07T12:26:06.164 INFO:tasks.workunit.client.0.smithi047.stdout:2/853: unlink d7/cd 0 2024-02-07T12:26:06.165 INFO:tasks.workunit.client.0.smithi047.stdout:6/766: dread d3/d1e/f21 [0,4194304] 0 2024-02-07T12:26:06.168 INFO:tasks.workunit.client.0.smithi047.stdout:1/604: dread d1/d15/d30/fa5 [0,4194304] 0 2024-02-07T12:26:06.168 INFO:tasks.workunit.client.0.smithi047.stdout:9/612: rename d3/d10/d18/d3b/d3c/d5d/d70/f87 to d3/d10/d18/d3d/d79/dcd/fde 0 2024-02-07T12:26:06.171 INFO:tasks.workunit.client.0.smithi047.stdout:3/874: unlink d12/d19/f1d 0 2024-02-07T12:26:06.171 INFO:tasks.workunit.client.0.smithi047.stdout:2/854: mknod d7/dc/d10f/c114 0 2024-02-07T12:26:06.175 INFO:tasks.workunit.client.0.smithi047.stdout:9/613: mkdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/ddf 0 2024-02-07T12:26:06.180 INFO:tasks.workunit.client.0.smithi047.stdout:8/788: rename d3/d36/d50/d30/d34/c54 to d3/d36/d50/d2a/c105 0 2024-02-07T12:26:06.180 INFO:tasks.workunit.client.0.smithi047.stdout:1/605: dread d1/d15/f1c [0,4194304] 0 2024-02-07T12:26:06.181 INFO:tasks.workunit.client.0.smithi047.stdout:8/789: truncate d3/d36/d50/d30/d9e/da6/f57 2921817 0 2024-02-07T12:26:06.182 INFO:tasks.workunit.client.0.smithi047.stdout:1/606: symlink d1/d15/d30/d46/dae/lc1 0 2024-02-07T12:26:06.184 INFO:tasks.workunit.client.0.smithi047.stdout:5/909: dwrite da/d24/d63/d9c/da3/dfc/f11c [0,4194304] 0 2024-02-07T12:26:06.187 INFO:tasks.workunit.client.0.smithi047.stdout:5/910: mknod da/d24/d63/d9a/df2/db2/d108/d33/d55/d7c/d128/c12e 0 2024-02-07T12:26:06.192 INFO:tasks.workunit.client.0.smithi047.stdout:1/607: write d1/d15/d2f/d3d/d3e/f7a [454784,19501] 0 2024-02-07T12:26:06.193 INFO:tasks.workunit.client.0.smithi047.stdout:5/911: rename da/df/c78 to da/d24/d63/d9c/da3/dfc/c12f 0 2024-02-07T12:26:06.193 INFO:tasks.workunit.client.0.smithi047.stdout:3/875: write d12/d19/d2d/d42/ff5 [2370193,35501] 0 2024-02-07T12:26:06.193 INFO:tasks.workunit.client.0.smithi047.stdout:3/876: chown d12/d19/l5c 65452 1 2024-02-07T12:26:06.193 INFO:tasks.workunit.client.0.smithi047.stdout:1/608: symlink d1/d15/d30/d46/d66/lc2 0 2024-02-07T12:26:06.193 INFO:tasks.workunit.client.0.smithi047.stdout:2/855: dread d7/dc/f4b [0,4194304] 0 2024-02-07T12:26:06.193 INFO:tasks.workunit.client.0.smithi047.stdout:2/856: write d7/d48/d72/dbf/f105 [114603,38925] 0 2024-02-07T12:26:06.194 INFO:tasks.workunit.client.0.smithi047.stdout:1/609: truncate d1/d6e/d75/da7/d40/f62 2551282 0 2024-02-07T12:26:06.197 INFO:tasks.workunit.client.0.smithi047.stdout:6/767: dwrite d3/da/d14/f1c [0,4194304] 0 2024-02-07T12:26:06.197 INFO:tasks.workunit.client.0.smithi047.stdout:6/768: creat d3/da/d34/d6d/fff x:0 0 0 2024-02-07T12:26:06.197 INFO:tasks.workunit.client.0.smithi047.stdout:6/769: readlink d3/d5/d35/d3c/d72/d8c/d95/lc2 0 2024-02-07T12:26:06.197 INFO:tasks.workunit.client.0.smithi047.stdout:6/770: dread - d3/d5/d35/d3c/d90/fbe zero size 2024-02-07T12:26:06.197 INFO:tasks.workunit.client.0.smithi047.stdout:6/771: dread - d3/da/d14/d28/d46/d94/fe5 zero size 2024-02-07T12:26:06.197 INFO:tasks.workunit.client.0.smithi047.stdout:6/772: write d3/d1e/f96 [903215,6873] 0 2024-02-07T12:26:06.197 INFO:tasks.workunit.client.0.smithi047.stdout:6/773: fsync d3/da/d14/d28/d9a/fdf 0 2024-02-07T12:26:06.197 INFO:tasks.workunit.client.0.smithi047.stdout:6/774: write d3/d5/d35/d3c/d72/d8c/d91/fb8 [4269633,75929] 0 2024-02-07T12:26:06.207 INFO:tasks.workunit.client.0.smithi047.stdout:2/857: write d7/dc/d71/ffd [3297526,39680] 0 2024-02-07T12:26:06.207 INFO:tasks.workunit.client.0.smithi047.stdout:2/858: chown d7/dc/c1c 33608582 1 2024-02-07T12:26:06.208 INFO:tasks.workunit.client.0.smithi047.stdout:3/877: getdents d12/d19/d37/dd5 0 2024-02-07T12:26:06.208 INFO:tasks.workunit.client.0.smithi047.stdout:3/878: chown d12/d19/d2d/d82/f85 0 1 2024-02-07T12:26:06.208 INFO:tasks.workunit.client.0.smithi047.stdout:3/879: chown d12/dc7/d29/d31/f8a 1174780 1 2024-02-07T12:26:06.208 INFO:tasks.workunit.client.0.smithi047.stdout:3/880: stat d12/dc7/fe7 0 2024-02-07T12:26:06.208 INFO:tasks.workunit.client.0.smithi047.stdout:9/614: dwrite d3/d10/d18/d3b/d3c/d5d/d9b/fc3 [0,4194304] 0 2024-02-07T12:26:06.208 INFO:tasks.workunit.client.0.smithi047.stdout:5/912: write da/d24/d63/d9a/dec/f99 [3603181,29597] 0 2024-02-07T12:26:06.209 INFO:tasks.workunit.client.0.smithi047.stdout:8/790: dwrite d3/d36/d9d/dbe/fd1 [0,4194304] 0 2024-02-07T12:26:06.210 INFO:tasks.workunit.client.0.smithi047.stdout:3/881: rename d12/d19/d37/cc9 to d12/d19/d2d/d33/da5/c120 0 2024-02-07T12:26:06.211 INFO:tasks.workunit.client.0.smithi047.stdout:3/882: write d12/d19/d2d/d42/f55 [1669849,121106] 0 2024-02-07T12:26:06.216 INFO:tasks.workunit.client.0.smithi047.stdout:6/775: write d3/da/d3b/f85 [3058956,3115] 0 2024-02-07T12:26:06.217 INFO:tasks.workunit.client.0.smithi047.stdout:9/615: symlink d3/le0 0 2024-02-07T12:26:06.218 INFO:tasks.workunit.client.0.smithi047.stdout:5/913: unlink da/d24/d63/d9a/df2/db2/d108/d33/d55/d7c/l122 0 2024-02-07T12:26:06.218 INFO:tasks.workunit.client.0.smithi047.stdout:5/914: creat da/d24/d63/d9a/df2/db2/d108/d33/d91/f130 x:0 0 0 2024-02-07T12:26:06.218 INFO:tasks.workunit.client.0.smithi047.stdout:5/915: chown da/d24/d63/d9a/df2/da6/fcf 15734285 1 2024-02-07T12:26:06.219 INFO:tasks.workunit.client.0.smithi047.stdout:8/791: link d3/d4/d87/f9c d3/d4/d59/f106 0 2024-02-07T12:26:06.219 INFO:tasks.workunit.client.0.smithi047.stdout:8/792: chown d3/d36/d9d/dbe 0 1 2024-02-07T12:26:06.219 INFO:tasks.workunit.client.0.smithi047.stdout:8/793: creat d3/d66/d67/d6a/dca/f107 x:0 0 0 2024-02-07T12:26:06.220 INFO:tasks.workunit.client.0.smithi047.stdout:1/610: dread d1/d15/d2f/d3d/d3e/f7a [0,4194304] 0 2024-02-07T12:26:06.221 INFO:tasks.workunit.client.0.smithi047.stdout:1/611: read d1/d15/d30/d46/d66/fb6 [118451,54428] 0 2024-02-07T12:26:06.221 INFO:tasks.workunit.client.0.smithi047.stdout:3/883: mknod d12/d19/d2d/c121 0 2024-02-07T12:26:06.225 INFO:tasks.workunit.client.0.smithi047.stdout:6/776: unlink d3/da/d14/d28/d9a/fdf 0 2024-02-07T12:26:06.225 INFO:tasks.workunit.client.0.smithi047.stdout:2/859: dwrite d7/d2d/f4a [0,4194304] 0 2024-02-07T12:26:06.229 INFO:tasks.workunit.client.0.smithi047.stdout:9/616: creat d3/d10/d18/d3d/d79/dcd/fe1 x:0 0 0 2024-02-07T12:26:06.231 INFO:tasks.workunit.client.0.smithi047.stdout:5/916: getdents da/d24/d63/d9a/df2/db2/d108/d71/d68/dda 0 2024-02-07T12:26:06.231 INFO:tasks.workunit.client.0.smithi047.stdout:5/917: dread - da/d24/d63/f107 zero size 2024-02-07T12:26:06.236 INFO:tasks.workunit.client.0.smithi047.stdout:8/794: symlink d3/d36/d50/d30/d34/d3e/l108 0 2024-02-07T12:26:06.239 INFO:tasks.workunit.client.0.smithi047.stdout:1/612: creat d1/d48/fc3 x:0 0 0 2024-02-07T12:26:06.241 INFO:tasks.workunit.client.0.smithi047.stdout:5/918: dread da/d24/d63/d9a/df2/db2/d108/d33/f3c [0,4194304] 0 2024-02-07T12:26:06.254 INFO:tasks.workunit.client.0.smithi047.stdout:3/884: link d12/dc7/d29/d31/ffe d12/d19/d2d/d42/d6b/f122 0 2024-02-07T12:26:06.261 INFO:tasks.workunit.client.0.smithi047.stdout:6/777: mkdir d3/da/d34/d6d/d8f/d100 0 2024-02-07T12:26:06.261 INFO:tasks.workunit.client.0.smithi047.stdout:6/778: truncate d3/f59 370524 0 2024-02-07T12:26:06.262 INFO:tasks.workunit.client.0.smithi047.stdout:8/795: dwrite d3/d36/d50/d28/f96 [0,4194304] 0 2024-02-07T12:26:06.268 INFO:tasks.workunit.client.0.smithi047.stdout:5/919: dwrite da/d24/d63/d9a/df2/db2/d108/d33/d91/f130 [0,4194304] 0 2024-02-07T12:26:06.268 INFO:tasks.workunit.client.0.smithi047.stdout:9/617: unlink d3/d10/d18/d3b/d3c/d47/f77 0 2024-02-07T12:26:06.268 INFO:tasks.workunit.client.0.smithi047.stdout:9/618: dread - d3/d10/d18/d3d/f83 zero size 2024-02-07T12:26:06.268 INFO:tasks.workunit.client.0.smithi047.stdout:9/619: stat d3/d10/d18/d3d/lb6 0 2024-02-07T12:26:06.268 INFO:tasks.workunit.client.0.smithi047.stdout:9/620: chown d3/d10/d18/d3b/l41 2846 1 2024-02-07T12:26:06.270 INFO:tasks.workunit.client.0.smithi047.stdout:3/885: stat d12/d19/d2d/c11d 0 2024-02-07T12:26:06.272 INFO:tasks.workunit.client.0.smithi047.stdout:1/613: dwrite d1/d15/d2f/f6b [0,4194304] 0 2024-02-07T12:26:06.276 INFO:tasks.workunit.client.0.smithi047.stdout:6/779: truncate d3/da/d34/f5a 494459 0 2024-02-07T12:26:06.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.273+0000 7fa2fde8e700 1 -- 172.21.15.47:0/3475031588 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2f802b310 con 0x7fa2e006b140 2024-02-07T12:26:06.277 INFO:tasks.workunit.client.0.smithi047.stdout:8/796: symlink d3/d36/d9d/l109 0 2024-02-07T12:26:06.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.276+0000 7fa2dffff700 1 -- 172.21.15.47:0/3475031588 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa2f802b310 con 0x7fa2e006b140 2024-02-07T12:26:06.279 INFO:tasks.workunit.client.0.smithi047.stdout:6/780: dread d3/da/d2c/f7c [0,4194304] 0 2024-02-07T12:26:06.281 INFO:tasks.workunit.client.0.smithi047.stdout:2/860: creat d7/dc/d4c/d65/f115 x:0 0 0 2024-02-07T12:26:06.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.280+0000 7fa2fde8e700 1 -- 172.21.15.47:0/3475031588 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fa2e006b140 msgr2=0x7fa2e006d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:06.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.280+0000 7fa2fde8e700 1 --2- 172.21.15.47:0/3475031588 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fa2e006b140 0x7fa2e006d5f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec000c00 tx=0x7fa2ec009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:06.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.280+0000 7fa2fde8e700 1 -- 172.21.15.47:0/3475031588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f8066c70 msgr2=0x7fa2f810fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:06.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.280+0000 7fa2fde8e700 1 --2- 172.21.15.47:0/3475031588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f8066c70 0x7fa2f810fb10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800eb40 tx=0x7fa2e800b040 comp rx=0 tx=0).stop 2024-02-07T12:26:06.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.280+0000 7fa2fde8e700 1 -- 172.21.15.47:0/3475031588 shutdown_connections 2024-02-07T12:26:06.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.280+0000 7fa2fde8e700 1 --2- 172.21.15.47:0/3475031588 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fa2e006b140 0x7fa2e006d5f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:06.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.280+0000 7fa2fde8e700 1 --2- 172.21.15.47:0/3475031588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f8066c70 0x7fa2f810fb10 secure :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800eb40 tx=0x7fa2e800b040 comp rx=0 tx=0).stop 2024-02-07T12:26:06.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.280+0000 7fa2fde8e700 1 --2- 172.21.15.47:0/3475031588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2f8102430 0x7fa2f8110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:06.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.280+0000 7fa2fde8e700 1 -- 172.21.15.47:0/3475031588 >> 172.21.15.47:0/3475031588 conn(0x7fa2f80f7500 msgr2=0x7fa2f80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:06.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.281+0000 7fa2fde8e700 1 -- 172.21.15.47:0/3475031588 shutdown_connections 2024-02-07T12:26:06.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.281+0000 7fa2fde8e700 1 -- 172.21.15.47:0/3475031588 wait complete. 2024-02-07T12:26:06.285 INFO:tasks.workunit.client.0.smithi047.stdout:1/614: write d1/d6e/d75/da7/d40/f56 [2767775,82176] 0 2024-02-07T12:26:06.285 INFO:tasks.workunit.client.0.smithi047.stdout:1/615: write d1/d15/d2f/d3d/d84/fa8 [1020461,94897] 0 2024-02-07T12:26:06.291 INFO:tasks.workunit.client.0.smithi047.stdout:5/920: link da/d24/d63/d9a/df2/db2/d108/d71/d68/lac da/df/d16/d41/d57/d6c/db1/l131 0 2024-02-07T12:26:06.292 INFO:tasks.workunit.client.0.smithi047.stdout:5/921: write da/d24/d63/d9a/df2/db2/d108/f2a [1366307,60004] 0 2024-02-07T12:26:06.293 INFO:tasks.workunit.client.0.smithi047.stdout:9/621: mknod d3/d10/d18/d3d/ce2 0 2024-02-07T12:26:06.293 INFO:tasks.workunit.client.0.smithi047.stdout:9/622: write d3/d10/f4b [1774651,13840] 0 2024-02-07T12:26:06.298 INFO:tasks.workunit.client.0.smithi047.stdout:3/886: dwrite d12/dc7/d29/d6f/d93/dba/dbf/fe3 [0,4194304] 0 2024-02-07T12:26:06.299 INFO:tasks.workunit.client.0.smithi047.stdout:8/797: truncate d3/d36/d50/d30/d34/f43 651027 0 2024-02-07T12:26:06.299 INFO:tasks.workunit.client.0.smithi047.stdout:8/798: write d3/f56 [4312684,118781] 0 2024-02-07T12:26:06.304 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:26:06.306 INFO:tasks.workunit.client.0.smithi047.stdout:1/616: dwrite d1/d6e/d75/da7/f27 [4194304,4194304] 0 2024-02-07T12:26:06.306 INFO:tasks.workunit.client.0.smithi047.stdout:1/617: stat d1/c44 0 2024-02-07T12:26:06.309 INFO:tasks.workunit.client.0.smithi047.stdout:6/781: link d3/da/da9/fab d3/d5/d35/f101 0 2024-02-07T12:26:06.319 INFO:tasks.workunit.client.0.smithi047.stdout:6/782: write d3/da/d14/f88 [571031,96875] 0 2024-02-07T12:26:06.319 INFO:tasks.workunit.client.0.smithi047.stdout:6/783: write d3/d5/f27 [3122079,26198] 0 2024-02-07T12:26:06.319 INFO:tasks.workunit.client.0.smithi047.stdout:5/922: mknod da/df/d16/d41/c132 0 2024-02-07T12:26:06.320 INFO:tasks.workunit.client.0.smithi047.stdout:9/623: getdents d3/d10/d18/d6e/d9a 0 2024-02-07T12:26:06.320 INFO:tasks.workunit.client.0.smithi047.stdout:9/624: dread - d3/d10/d18/fa1 zero size 2024-02-07T12:26:06.321 INFO:tasks.workunit.client.0.smithi047.stdout:6/784: write d3/d1e/f96 [77303,44894] 0 2024-02-07T12:26:06.322 INFO:tasks.workunit.client.0.smithi047.stdout:2/861: read d7/f2e [6043332,80187] 0 2024-02-07T12:26:06.324 INFO:tasks.workunit.client.0.smithi047.stdout:3/887: rmdir d12/dc7/d29/d31/d7c/df3 39 2024-02-07T12:26:06.328 INFO:tasks.workunit.client.0.smithi047.stdout:1/618: rename d1/d15/d2f/d3d/d3e/c7b to d1/d15/d30/cc4 0 2024-02-07T12:26:06.328 INFO:tasks.workunit.client.0.smithi047.stdout:1/619: fdatasync d1/d15/d2f/d3d/f8b 0 2024-02-07T12:26:06.328 INFO:tasks.workunit.client.0.smithi047.stdout:1/620: dread - d1/d15/d2f/d3d/d3e/f94 zero size 2024-02-07T12:26:06.331 INFO:tasks.workunit.client.0.smithi047.stdout:5/923: creat da/d24/d63/d9a/df2/db2/d108/d71/f133 x:0 0 0 2024-02-07T12:26:06.331 INFO:tasks.workunit.client.0.smithi047.stdout:5/924: stat da/d24/d63/d9a/df2/db2/d108/d33/d55/f120 0 2024-02-07T12:26:06.331 INFO:tasks.workunit.client.0.smithi047.stdout:6/785: creat d3/da/d14/d9e/f102 x:0 0 0 2024-02-07T12:26:06.334 INFO:tasks.workunit.client.0.smithi047.stdout:9/625: write d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/f96 [1952446,57934] 0 2024-02-07T12:26:06.334 INFO:tasks.workunit.client.0.smithi047.stdout:8/799: dwrite d3/d36/d50/ffd [0,4194304] 0 2024-02-07T12:26:06.334 INFO:tasks.workunit.client.0.smithi047.stdout:6/786: unlink d3/d5/d35/d3c/d90/fb5 0 2024-02-07T12:26:06.335 INFO:tasks.workunit.client.0.smithi047.stdout:6/787: dread - d3/da/d14/d9e/f102 zero size 2024-02-07T12:26:06.337 INFO:tasks.workunit.client.0.smithi047.stdout:2/862: mkdir d7/dc/d51/dda/d116 0 2024-02-07T12:26:06.338 INFO:tasks.workunit.client.0.smithi047.stdout:6/788: write d3/da/d34/f8e [315600,28419] 0 2024-02-07T12:26:06.339 INFO:tasks.workunit.client.0.smithi047.stdout:1/621: truncate d1/d15/d2f/f6b 372685 0 2024-02-07T12:26:06.342 INFO:tasks.workunit.client.0.smithi047.stdout:3/888: write d12/d19/d2d/d33/f3a [2064760,54760] 0 2024-02-07T12:26:06.342 INFO:tasks.workunit.client.0.smithi047.stdout:3/889: readlink d12/d19/d2d/d52/la3 0 2024-02-07T12:26:06.357 INFO:tasks.workunit.client.0.smithi047.stdout:8/800: dwrite d3/d36/d50/d30/f5e [4194304,4194304] 0 2024-02-07T12:26:06.358 INFO:tasks.workunit.client.0.smithi047.stdout:5/925: write da/d24/d63/d9a/df2/db2/d108/fad [2802884,121680] 0 2024-02-07T12:26:06.366 INFO:tasks.workunit.client.0.smithi047.stdout:9/626: creat d3/d10/d18/d6e/d9a/daf/fe3 x:0 0 0 2024-02-07T12:26:06.366 INFO:tasks.workunit.client.0.smithi047.stdout:9/627: dread - d3/d10/d18/d3d/d79/dcd/fe1 zero size 2024-02-07T12:26:06.366 INFO:tasks.workunit.client.0.smithi047.stdout:9/628: chown d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/cb5 430331 1 2024-02-07T12:26:06.366 INFO:tasks.workunit.client.0.smithi047.stdout:9/629: dread - d3/d10/d4c/fcf zero size 2024-02-07T12:26:06.367 INFO:tasks.workunit.client.0.smithi047.stdout:9/630: chown d3/d10/d18/d3d 36450 1 2024-02-07T12:26:06.373 INFO:tasks.workunit.client.0.smithi047.stdout:6/789: rmdir d3/da/d3b/df6 39 2024-02-07T12:26:06.373 INFO:tasks.workunit.client.0.smithi047.stdout:6/790: chown d3/da/d14/d28/d46/d94/fe5 619507197 1 2024-02-07T12:26:06.376 INFO:tasks.workunit.client.0.smithi047.stdout:1/622: mknod d1/d6e/d75/da7/d80/cc5 0 2024-02-07T12:26:06.386 INFO:tasks.workunit.client.0.smithi047.stdout:9/631: dwrite d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/fb4 [0,4194304] 0 2024-02-07T12:26:06.389 INFO:tasks.workunit.client.0.smithi047.stdout:0/607: sync 2024-02-07T12:26:06.391 INFO:tasks.workunit.client.0.smithi047.stdout:2/863: rename d7/d48/d72/dbf/f105 to d7/dc/df2/f117 0 2024-02-07T12:26:06.397 INFO:tasks.workunit.client.0.smithi047.stdout:2/864: dread d7/dc/d71/f90 [0,4194304] 0 2024-02-07T12:26:06.397 INFO:tasks.workunit.client.0.smithi047.stdout:6/791: mknod d3/da/d3b/c103 0 2024-02-07T12:26:06.397 INFO:tasks.workunit.client.0.smithi047.stdout:6/792: rename d3/da/d3b to d3/da/d3b/d104 22 2024-02-07T12:26:06.397 INFO:tasks.workunit.client.0.smithi047.stdout:6/793: chown d3/da/d2c/lca 115553 1 2024-02-07T12:26:06.401 INFO:tasks.workunit.client.0.smithi047.stdout:0/608: dread f1 [0,4194304] 0 2024-02-07T12:26:06.401 INFO:tasks.workunit.client.0.smithi047.stdout:0/609: chown d19/d1c/d3c/d60/d6f/d95/daa/d49/c64 62481632 1 2024-02-07T12:26:06.401 INFO:tasks.workunit.client.0.smithi047.stdout:0/610: write d19/d40/d66/d46/f5e [4963454,101362] 0 2024-02-07T12:26:06.401 INFO:tasks.workunit.client.0.smithi047.stdout:0/611: write d19/f6d [428512,57245] 0 2024-02-07T12:26:06.403 INFO:tasks.workunit.client.0.smithi047.stdout:1/623: mknod d1/d48/cc6 0 2024-02-07T12:26:06.404 INFO:tasks.workunit.client.0.smithi047.stdout:3/890: getdents d12/dc7/d29/d44 0 2024-02-07T12:26:06.404 INFO:tasks.workunit.client.0.smithi047.stdout:3/891: write d12/d19/d2d/d42/f4d [708356,70630] 0 2024-02-07T12:26:06.408 INFO:tasks.workunit.client.0.smithi047.stdout:5/926: getdents da/d24/d63 0 2024-02-07T12:26:06.416 INFO:tasks.workunit.client.0.smithi047.stdout:1/624: dread d1/d15/d30/d46/d66/dac/dbc/fbd [4194304,4194304] 0 2024-02-07T12:26:06.418 INFO:tasks.workunit.client.0.smithi047.stdout:2/865: rmdir d7/dc/d51/dda/d116 0 2024-02-07T12:26:06.418 INFO:tasks.workunit.client.0.smithi047.stdout:2/866: fsync d7/dc/d8a/fe1 0 2024-02-07T12:26:06.421 INFO:tasks.workunit.client.0.smithi047.stdout:6/794: dwrite d3/d5/d35/f101 [0,4194304] 0 2024-02-07T12:26:06.422 INFO:tasks.workunit.client.0.smithi047.stdout:8/801: dwrite d3/d36/d50/d30/d9e/da6/f57 [0,4194304] 0 2024-02-07T12:26:06.422 INFO:tasks.workunit.client.0.smithi047.stdout:8/802: chown d3/d36/d50/d30/d9e/da6/f64 493 1 2024-02-07T12:26:06.424 INFO:tasks.workunit.client.0.smithi047.stdout:0/612: unlink d19/f34 0 2024-02-07T12:26:06.425 INFO:tasks.workunit.client.0.smithi047.stdout:0/613: chown d19/d1c/d3c/d60/d6f/d95/da7 329331322 1 2024-02-07T12:26:06.425 INFO:tasks.workunit.client.0.smithi047.stdout:3/892: creat d12/dc7/d29/da9/f123 x:0 0 0 2024-02-07T12:26:06.426 INFO:tasks.workunit.client.0.smithi047.stdout:9/632: getdents d3/d10/d18/d3b/d3c/d5d/d68 0 2024-02-07T12:26:06.426 INFO:tasks.workunit.client.0.smithi047.stdout:9/633: fdatasync d3/fcc 0 2024-02-07T12:26:06.427 INFO:tasks.workunit.client.0.smithi047.stdout:5/927: creat da/df/d16/d41/d11d/f134 x:0 0 0 2024-02-07T12:26:06.428 INFO:tasks.workunit.client.0.smithi047.stdout:2/867: dread d7/d2d/d7c/fbc [0,4194304] 0 2024-02-07T12:26:06.428 INFO:tasks.workunit.client.0.smithi047.stdout:2/868: stat d7/dc/cb2 0 2024-02-07T12:26:06.428 INFO:tasks.workunit.client.0.smithi047.stdout:9/634: dread d3/d10/d18/d3b/d3c/d5d/fd4 [0,4194304] 0 2024-02-07T12:26:06.429 INFO:tasks.workunit.client.0.smithi047.stdout:1/625: mkdir d1/d48/dc7 0 2024-02-07T12:26:06.432 INFO:tasks.workunit.client.0.smithi047.stdout:6/795: creat d3/da/d14/d28/df0/f105 x:0 0 0 2024-02-07T12:26:06.432 INFO:tasks.workunit.client.0.smithi047.stdout:1/626: fdatasync d1/d6e/d75/da7/d40/f56 0 2024-02-07T12:26:06.434 INFO:tasks.workunit.client.0.smithi047.stdout:6/796: write d3/d5/d35/d3c/d72/d8c/f8a [250657,110926] 0 2024-02-07T12:26:06.434 INFO:tasks.workunit.client.0.smithi047.stdout:8/803: mknod d3/d36/d9d/c10a 0 2024-02-07T12:26:06.434 INFO:tasks.workunit.client.0.smithi047.stdout:8/804: dread - d3/d36/d50/d30/d34/d3e/fba zero size 2024-02-07T12:26:06.434 INFO:tasks.workunit.client.0.smithi047.stdout:8/805: dread - d3/d66/d67/d6a/dca/f101 zero size 2024-02-07T12:26:06.435 INFO:tasks.workunit.client.0.smithi047.stdout:1/627: dread d1/d37/f60 [0,4194304] 0 2024-02-07T12:26:06.435 INFO:tasks.workunit.client.0.smithi047.stdout:1/628: chown d1/d6e/d75/da7/d65/l63 267331697 1 2024-02-07T12:26:06.437 INFO:tasks.workunit.client.0.smithi047.stdout:0/614: mknod d19/d1c/d3c/d60/cc5 0 2024-02-07T12:26:06.439 INFO:tasks.workunit.client.0.smithi047.stdout:3/893: mkdir d12/dc7/d29/d31/d38/d124 0 2024-02-07T12:26:06.442 INFO:tasks.workunit.client.0.smithi047.stdout:5/928: link da/d24/d63/d9a/cfb da/d24/d63/d9a/df2/db2/d108/d71/d68/c135 0 2024-02-07T12:26:06.443 INFO:tasks.workunit.client.0.smithi047.stdout:6/797: dread d3/da/f74 [0,4194304] 0 2024-02-07T12:26:06.445 INFO:tasks.workunit.client.0.smithi047.stdout:2/869: mkdir d7/d48/d72/db7/d102/d118 0 2024-02-07T12:26:06.447 INFO:tasks.workunit.client.0.smithi047.stdout:9/635: rename d3/d10/d18/d3b/d3c/d5d/d68/fc5 to d3/d10/d18/d3b/d3c/d5d/d70/fe4 0 2024-02-07T12:26:06.448 INFO:tasks.workunit.client.0.smithi047.stdout:0/615: dread d19/d1c/f30 [0,4194304] 0 2024-02-07T12:26:06.448 INFO:tasks.workunit.client.0.smithi047.stdout:0/616: read d19/d40/d66/f8e [2241487,4498] 0 2024-02-07T12:26:06.450 INFO:tasks.workunit.client.0.smithi047.stdout:8/806: creat d3/d66/d67/d71/d93/dd8/f10b x:0 0 0 2024-02-07T12:26:06.451 INFO:tasks.workunit.client.0.smithi047.stdout:1/629: mknod d1/d15/d30/cc8 0 2024-02-07T12:26:06.456 INFO:tasks.workunit.client.0.smithi047.stdout:3/894: mknod d12/d19/d2d/d33/da5/c125 0 2024-02-07T12:26:06.457 INFO:tasks.workunit.client.0.smithi047.stdout:5/929: symlink da/d24/d63/d9a/df2/l136 0 2024-02-07T12:26:06.463 INFO:tasks.workunit.client.0.smithi047.stdout:2/870: stat d7/d48/cb1 0 2024-02-07T12:26:06.464 INFO:tasks.workunit.client.0.smithi047.stdout:5/930: dread da/d24/d63/d9a/f5b [4194304,4194304] 0 2024-02-07T12:26:06.464 INFO:tasks.workunit.client.0.smithi047.stdout:5/931: chown da/df/d16/d41/d57/l5f 34151 1 2024-02-07T12:26:06.468 INFO:tasks.workunit.client.0.smithi047.stdout:0/617: mkdir d19/d40/d66/d46/dc6 0 2024-02-07T12:26:06.473 INFO:tasks.workunit.client.0.smithi047.stdout:8/807: mkdir d3/d36/de2/de5/d10c 0 2024-02-07T12:26:06.475 INFO:tasks.workunit.client.0.smithi047.stdout:3/895: dwrite d12/dc7/d29/d31/d38/d59/f67 [0,4194304] 0 2024-02-07T12:26:06.475 INFO:tasks.workunit.client.0.smithi047.stdout:3/896: chown d12/dc7/d29/d31/d38/fbb 241 1 2024-02-07T12:26:06.476 INFO:tasks.workunit.client.0.smithi047.stdout:1/630: mkdir d1/d48/dc9 0 2024-02-07T12:26:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.477+0000 7f066977a700 1 -- 172.21.15.47:0/2006171266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06640fe0e0 msgr2=0x7f06640fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:06.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.477+0000 7f066977a700 1 --2- 172.21.15.47:0/2006171266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06640fe0e0 0x7f06640fe550 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0658004940 tx=0x7f0658009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:06.480 INFO:tasks.workunit.client.0.smithi047.stdout:6/798: truncate d3/d5/d35/f101 2866982 0 2024-02-07T12:26:06.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.478+0000 7f066977a700 1 -- 172.21.15.47:0/2006171266 shutdown_connections 2024-02-07T12:26:06.480 INFO:tasks.workunit.client.0.smithi047.stdout:6/799: fdatasync d3/da/d3b/d87/de4/ff9 0 2024-02-07T12:26:06.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.478+0000 7f066977a700 1 --2- 172.21.15.47:0/2006171266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06640fe0e0 0x7f06640fe550 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:06.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.478+0000 7f066977a700 1 --2- 172.21.15.47:0/2006171266 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06640fcef0 0x7f06640fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:06.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.478+0000 7f066977a700 1 -- 172.21.15.47:0/2006171266 >> 172.21.15.47:0/2006171266 conn(0x7f06640f8620 msgr2=0x7f06640faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:06.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.478+0000 7f066977a700 1 -- 172.21.15.47:0/2006171266 shutdown_connections 2024-02-07T12:26:06.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.478+0000 7f066977a700 1 -- 172.21.15.47:0/2006171266 wait complete. 2024-02-07T12:26:06.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.479+0000 7f066977a700 1 Processor -- start 2024-02-07T12:26:06.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.479+0000 7f066977a700 1 -- start start 2024-02-07T12:26:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.480+0000 7f066977a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06640fcef0 0x7f066410d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.480+0000 7f066977a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06640fe0e0 0x7f066410dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.480+0000 7f066977a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066410e210 con 0x7f06640fe0e0 2024-02-07T12:26:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.480+0000 7f066977a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066410eab0 con 0x7f06640fcef0 2024-02-07T12:26:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.480+0000 7f0662ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06640fcef0 0x7f066410d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.480+0000 7f0662ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06640fcef0 0x7f066410d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.47:48556/0 (socket says 172.21.15.47:48556) 2024-02-07T12:26:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.480+0000 7f0662ffd700 1 -- 172.21.15.47:0/624307375 learned_addr learned my addr 172.21.15.47:0/624307375 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.480+0000 7f06627fc700 1 --2- 172.21.15.47:0/624307375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06640fe0e0 0x7f066410dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.481+0000 7f0662ffd700 1 -- 172.21.15.47:0/624307375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06640fe0e0 msgr2=0x7f066410dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.481+0000 7f0662ffd700 1 --2- 172.21.15.47:0/624307375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06640fe0e0 0x7f066410dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.481+0000 7f0662ffd700 1 -- 172.21.15.47:0/624307375 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0658005040 con 0x7f06640fcef0 2024-02-07T12:26:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.481+0000 7f0662ffd700 1 --2- 172.21.15.47:0/624307375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06640fcef0 0x7f066410d6d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f065400eb70 tx=0x7f065400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.481+0000 7f064b7fe700 1 -- 172.21.15.47:0/624307375 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0654007cc0 con 0x7f06640fcef0 2024-02-07T12:26:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.481+0000 7f066977a700 1 -- 172.21.15.47:0/624307375 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066410ed30 con 0x7f06640fcef0 2024-02-07T12:26:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.481+0000 7f066977a700 1 -- 172.21.15.47:0/624307375 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066410f270 con 0x7f06640fcef0 2024-02-07T12:26:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.481+0000 7f064b7fe700 1 -- 172.21.15.47:0/624307375 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f065400f040 con 0x7f06640fcef0 2024-02-07T12:26:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.482+0000 7f064b7fe700 1 -- 172.21.15.47:0/624307375 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f065400cb20 con 0x7f06640fcef0 2024-02-07T12:26:06.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.483+0000 7f066977a700 1 -- 172.21.15.47:0/624307375 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06500052e0 con 0x7f06640fcef0 2024-02-07T12:26:06.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.483+0000 7f064b7fe700 1 -- 172.21.15.47:0/624307375 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7f065400cc80 con 0x7f06640fcef0 2024-02-07T12:26:06.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.484+0000 7f064b7fe700 1 --2- 172.21.15.47:0/624307375 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f064c06b140 0x7f064c06d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:06.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.484+0000 7f06627fc700 1 --2- 172.21.15.47:0/624307375 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f064c06b140 0x7f064c06d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:06.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.484+0000 7f064b7fe700 1 -- 172.21.15.47:0/624307375 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f0654089650 con 0x7f06640fcef0 2024-02-07T12:26:06.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.484+0000 7f06627fc700 1 --2- 172.21.15.47:0/624307375 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f064c06b140 0x7f064c06d5f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0658000c00 tx=0x7f0658009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:06.490 INFO:tasks.workunit.client.0.smithi047.stdout:5/932: rmdir da/d24/d63/d118 0 2024-02-07T12:26:06.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.489+0000 7f064b7fe700 1 -- 172.21.15.47:0/624307375 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f065404f620 con 0x7f06640fcef0 2024-02-07T12:26:06.495 INFO:tasks.workunit.client.0.smithi047.stdout:0/618: dread - d19/d1c/d3c/d60/d6f/d95/daa/d49/fb2 zero size 2024-02-07T12:26:06.498 INFO:tasks.workunit.client.0.smithi047.stdout:5/933: write da/f1a [1962950,116567] 0 2024-02-07T12:26:06.499 INFO:tasks.workunit.client.0.smithi047.stdout:8/808: link d3/d36/fa5 d3/d66/d67/d71/d93/f10d 0 2024-02-07T12:26:06.500 INFO:tasks.workunit.client.0.smithi047.stdout:3/897: symlink d12/d19/d2d/d33/d8d/l126 0 2024-02-07T12:26:06.502 INFO:tasks.workunit.client.0.smithi047.stdout:1/631: symlink d1/d6e/d75/da7/d80/lca 0 2024-02-07T12:26:06.502 INFO:tasks.workunit.client.0.smithi047.stdout:1/632: chown d1/d15/d2f/d3d/d84/c8d 4 1 2024-02-07T12:26:06.504 INFO:tasks.workunit.client.0.smithi047.stdout:2/871: truncate d7/f13 2766139 0 2024-02-07T12:26:06.504 INFO:tasks.workunit.client.0.smithi047.stdout:2/872: write d7/d48/d72/ff5 [4914151,38279] 0 2024-02-07T12:26:06.504 INFO:tasks.workunit.client.0.smithi047.stdout:2/873: chown d7/d2d/d5c/d77/d9b/la8 3164183 1 2024-02-07T12:26:06.504 INFO:tasks.workunit.client.0.smithi047.stdout:2/874: fdatasync d7/dc/d51/ded/fe8 0 2024-02-07T12:26:06.505 INFO:tasks.workunit.client.0.smithi047.stdout:0/619: fdatasync fa 0 2024-02-07T12:26:06.506 INFO:tasks.workunit.client.0.smithi047.stdout:8/809: unlink d3/d36/d50/d30/d9e/da6/fdf 0 2024-02-07T12:26:06.506 INFO:tasks.workunit.client.0.smithi047.stdout:8/810: chown d3/d36/d50/d28/c8f 13336 1 2024-02-07T12:26:06.506 INFO:tasks.workunit.client.0.smithi047.stdout:8/811: truncate d3/d66/d67/d71/d93/f10d 640184 0 2024-02-07T12:26:06.508 INFO:tasks.workunit.client.0.smithi047.stdout:3/898: getdents d12/dc7/d29/d31/d7c 0 2024-02-07T12:26:06.510 INFO:tasks.workunit.client.0.smithi047.stdout:1/633: unlink d1/d15/d30/d46/d4c/c93 0 2024-02-07T12:26:06.513 INFO:tasks.workunit.client.0.smithi047.stdout:2/875: mknod d7/dc/d4c/da0/c119 0 2024-02-07T12:26:06.513 INFO:tasks.workunit.client.0.smithi047.stdout:2/876: chown d7/dc/d4c/fbe 212517 1 2024-02-07T12:26:06.513 INFO:tasks.workunit.client.0.smithi047.stdout:2/877: creat d7/dc/d4c/d65/f11a x:0 0 0 2024-02-07T12:26:06.513 INFO:tasks.workunit.client.0.smithi047.stdout:2/878: readlink d7/d2d/l4e 0 2024-02-07T12:26:06.513 INFO:tasks.workunit.client.0.smithi047.stdout:2/879: fsync d7/d48/d72/dbf/fd4 0 2024-02-07T12:26:06.513 INFO:tasks.workunit.client.0.smithi047.stdout:2/880: write d7/dc/d4c/fa2 [1398948,13572] 0 2024-02-07T12:26:06.514 INFO:tasks.workunit.client.0.smithi047.stdout:0/620: rename d19/d1c/d3c/d60/d6f/d95/daa/d8c/la0 to d19/d40/d66/d81/lc7 0 2024-02-07T12:26:06.515 INFO:tasks.workunit.client.0.smithi047.stdout:5/934: getdents da/df/df7 0 2024-02-07T12:26:06.515 INFO:tasks.workunit.client.0.smithi047.stdout:5/935: write da/d24/d63/d9a/df2/db2/d108/d33/d55/f103 [35116,129015] 0 2024-02-07T12:26:06.520 INFO:tasks.workunit.client.0.smithi047.stdout:0/621: creat d19/d1c/d2b/fc8 x:0 0 0 2024-02-07T12:26:06.522 INFO:tasks.workunit.client.0.smithi047.stdout:8/812: rename d3/d66/d67/d6a/l44 to d3/d36/de2/l10e 0 2024-02-07T12:26:06.522 INFO:tasks.workunit.client.0.smithi047.stdout:8/813: truncate d3/d66/d67/d71/d93/dd8/f10b 326642 0 2024-02-07T12:26:06.527 INFO:tasks.workunit.client.0.smithi047.stdout:5/936: symlink da/df/d16/dab/l137 0 2024-02-07T12:26:06.527 INFO:tasks.workunit.client.0.smithi047.stdout:5/937: chown da/d24/d63/d9a/df2/db2/d108/d33/d55/d7c/fcd 420 1 2024-02-07T12:26:06.527 INFO:tasks.workunit.client.0.smithi047.stdout:5/938: truncate da/d24/d63/d9a/df2/db2/d108/fd1 714922 0 2024-02-07T12:26:06.527 INFO:tasks.workunit.client.0.smithi047.stdout:5/939: readlink da/d24/d63/d9a/df2/db2/d108/d33/d55/l10d 0 2024-02-07T12:26:06.527 INFO:tasks.workunit.client.0.smithi047.stdout:5/940: write da/d24/d63/f102 [266110,54238] 0 2024-02-07T12:26:06.529 INFO:tasks.workunit.client.0.smithi047.stdout:2/881: truncate d7/f1e 2017915 0 2024-02-07T12:26:06.529 INFO:tasks.workunit.client.0.smithi047.stdout:1/634: dwrite d1/d15/d2f/d3d/d84/fa1 [0,4194304] 0 2024-02-07T12:26:06.532 INFO:tasks.workunit.client.0.smithi047.stdout:0/622: link d19/d1c/d3c/d37/ca4 d19/d1c/d3c/d60/d6f/d95/cc9 0 2024-02-07T12:26:06.532 INFO:tasks.workunit.client.0.smithi047.stdout:8/814: symlink d3/d36/d9d/l10f 0 2024-02-07T12:26:06.534 INFO:tasks.workunit.client.0.smithi047.stdout:3/899: rename d12/fcd to d12/dc7/d29/d6f/df0/f127 0 2024-02-07T12:26:06.534 INFO:tasks.workunit.client.0.smithi047.stdout:3/900: stat d12/dc7/d29/d31/d7c/c97 0 2024-02-07T12:26:06.536 INFO:tasks.workunit.client.0.smithi047.stdout:2/882: creat d7/dc/d51/dda/d113/f11b x:0 0 0 2024-02-07T12:26:06.536 INFO:tasks.workunit.client.0.smithi047.stdout:2/883: write d7/d2d/f108 [663425,82133] 0 2024-02-07T12:26:06.538 INFO:tasks.workunit.client.0.smithi047.stdout:1/635: rename d1/d15/d30/d46/l68 to d1/d6e/d75/da7/d65/lcb 0 2024-02-07T12:26:06.539 INFO:tasks.workunit.client.0.smithi047.stdout:3/901: symlink d12/dc7/d29/d31/d61/l128 0 2024-02-07T12:26:06.540 INFO:tasks.workunit.client.0.smithi047.stdout:0/623: rename d19/d1c/d2b/d5f/lc1 to d19/d40/d66/lca 0 2024-02-07T12:26:06.541 INFO:tasks.workunit.client.0.smithi047.stdout:1/636: link d1/d15/d2f/lb8 d1/d15/d2f/d3d/d3e/lcc 0 2024-02-07T12:26:06.543 INFO:tasks.workunit.client.0.smithi047.stdout:8/815: rename d3/d36/d50/d30/d34/f85 to d3/d66/d67/d6a/dea/f110 0 2024-02-07T12:26:06.546 INFO:tasks.workunit.client.0.smithi047.stdout:0/624: mknod d19/d40/d66/d46/ccb 0 2024-02-07T12:26:06.546 INFO:tasks.workunit.client.0.smithi047.stdout:1/637: symlink d1/d48/lcd 0 2024-02-07T12:26:06.546 INFO:tasks.workunit.client.0.smithi047.stdout:5/941: dwrite da/d24/d63/d9a/df2/db2/d108/d33/d91/f105 [0,4194304] 0 2024-02-07T12:26:06.550 INFO:tasks.workunit.client.0.smithi047.stdout:5/942: getdents da/d24/d63/d9a/df2/db2/d108 0 2024-02-07T12:26:06.550 INFO:tasks.workunit.client.0.smithi047.stdout:5/943: write da/df/f94 [279393,113223] 0 2024-02-07T12:26:06.551 INFO:tasks.workunit.client.0.smithi047.stdout:3/902: write d12/dc7/d29/d31/d7c/fab [2222538,106775] 0 2024-02-07T12:26:06.551 INFO:tasks.workunit.client.0.smithi047.stdout:3/903: dread - d12/d19/d2d/d33/d8d/f10c zero size 2024-02-07T12:26:06.551 INFO:tasks.workunit.client.0.smithi047.stdout:3/904: write d12/d19/d37/f68 [192585,10207] 0 2024-02-07T12:26:06.553 INFO:tasks.workunit.client.0.smithi047.stdout:2/884: rename d7/f28 to d7/dc/d71/f11c 0 2024-02-07T12:26:06.553 INFO:tasks.workunit.client.0.smithi047.stdout:2/885: write d7/dc/d4c/d65/f10c [996104,48315] 0 2024-02-07T12:26:06.553 INFO:tasks.workunit.client.0.smithi047.stdout:2/886: stat d7/d2d/d5c/lab 0 2024-02-07T12:26:06.556 INFO:tasks.workunit.client.0.smithi047.stdout:0/625: dread d19/d40/f53 [0,4194304] 0 2024-02-07T12:26:06.556 INFO:tasks.workunit.client.0.smithi047.stdout:0/626: chown d19/d1c/d3c/d60/cc5 9768937 1 2024-02-07T12:26:06.556 INFO:tasks.workunit.client.0.smithi047.stdout:0/627: fdatasync d19/d1c/d3c/d48/fbc 0 2024-02-07T12:26:06.566 INFO:tasks.workunit.client.0.smithi047.stdout:5/944: symlink da/d24/d63/d85/db3/l138 0 2024-02-07T12:26:06.566 INFO:tasks.workunit.client.0.smithi047.stdout:5/945: stat da/l97 0 2024-02-07T12:26:06.566 INFO:tasks.workunit.client.0.smithi047.stdout:5/946: stat da/d24/d63/d9a/df2/db2/d108/d33/d55/c5c 0 2024-02-07T12:26:06.570 INFO:tasks.workunit.client.0.smithi047.stdout:3/905: creat d12/d19/d2d/d33/d8d/f129 x:0 0 0 2024-02-07T12:26:06.575 INFO:tasks.workunit.client.0.smithi047.stdout:2/887: link d7/dc/d4c/d65/ld5 d7/d2d/d5c/d77/d92/l11d 0 2024-02-07T12:26:06.576 INFO:tasks.workunit.client.0.smithi047.stdout:0/628: symlink d19/d40/d66/d46/lcc 0 2024-02-07T12:26:06.579 INFO:tasks.workunit.client.0.smithi047.stdout:5/947: link da/d24/d63/d9a/cfb da/d24/d63/d9a/df2/da6/c139 0 2024-02-07T12:26:06.579 INFO:tasks.workunit.client.0.smithi047.stdout:5/948: write da/df/d16/d41/f47 [4330413,42923] 0 2024-02-07T12:26:06.580 INFO:tasks.workunit.client.0.smithi047.stdout:5/949: dread da/df/d16/d41/f42 [4194304,4194304] 0 2024-02-07T12:26:06.580 INFO:tasks.workunit.client.0.smithi047.stdout:5/950: dread - da/d24/de3/f113 zero size 2024-02-07T12:26:06.582 INFO:tasks.workunit.client.0.smithi047.stdout:0/629: rmdir d19/d40/d66/d81/d82 39 2024-02-07T12:26:06.584 INFO:tasks.workunit.client.0.smithi047.stdout:5/951: creat da/d24/d63/d9a/df2/db2/d108/dc1/f13a x:0 0 0 2024-02-07T12:26:06.586 INFO:tasks.workunit.client.0.smithi047.stdout:2/888: unlink d7/c54 0 2024-02-07T12:26:06.586 INFO:tasks.workunit.client.0.smithi047.stdout:2/889: truncate d7/d48/d72/ff5 5403151 0 2024-02-07T12:26:06.586 INFO:tasks.workunit.client.0.smithi047.stdout:0/630: getdents d19/d1c/d24 0 2024-02-07T12:26:06.588 INFO:tasks.workunit.client.0.smithi047.stdout:5/952: creat da/d24/d63/d9c/f13b x:0 0 0 2024-02-07T12:26:06.590 INFO:tasks.workunit.client.0.smithi047.stdout:0/631: creat d19/d1c/d3c/d60/d6f/d95/da7/fcd x:0 0 0 2024-02-07T12:26:06.596 INFO:tasks.workunit.client.0.smithi047.stdout:5/953: dread da/df/d16/d41/f51 [0,4194304] 0 2024-02-07T12:26:06.597 INFO:tasks.workunit.client.0.smithi047.stdout:5/954: mknod da/df/d16/d41/d57/d6c/db1/c13c 0 2024-02-07T12:26:06.598 INFO:tasks.workunit.client.0.smithi047.stdout:5/955: mkdir da/df/d16/d41/d57/d13d 0 2024-02-07T12:26:06.599 INFO:tasks.workunit.client.0.smithi047.stdout:0/632: read d19/d1c/d24/f8f [1007209,23810] 0 2024-02-07T12:26:06.604 INFO:tasks.workunit.client.0.smithi047.stdout:5/956: rename da/d24/d63/d9a/df2/db2/d108/dc1/f13a to da/d24/d63/d9a/df2/da6/d119/f13e 0 2024-02-07T12:26:06.604 INFO:tasks.workunit.client.0.smithi047.stdout:5/957: creat da/d24/d63/d9a/df2/db2/d108/dc1/f13f x:0 0 0 2024-02-07T12:26:06.604 INFO:tasks.workunit.client.0.smithi047.stdout:5/958: fdatasync da/d24/d63/d9a/df2/db2/d108/d33/d55/d7c/fcd 0 2024-02-07T12:26:06.604 INFO:tasks.workunit.client.0.smithi047.stdout:5/959: fdatasync da/d24/d63/d9a/df2/db2/d108/d71/f133 0 2024-02-07T12:26:06.605 INFO:tasks.workunit.client.0.smithi047.stdout:0/633: rmdir d19/d40/d66 39 2024-02-07T12:26:06.606 INFO:tasks.workunit.client.0.smithi047.stdout:0/634: link d19/d1c/d3c/d37/ca4 d19/d40/d66/d81/d82/d9e/cce 0 2024-02-07T12:26:06.607 INFO:tasks.workunit.client.0.smithi047.stdout:2/890: dwrite d7/feb [0,4194304] 0 2024-02-07T12:26:06.609 INFO:tasks.workunit.client.0.smithi047.stdout:5/960: dread da/df/d16/f53 [0,4194304] 0 2024-02-07T12:26:06.609 INFO:tasks.workunit.client.0.smithi047.stdout:5/961: creat da/dd0/f140 x:0 0 0 2024-02-07T12:26:06.610 INFO:tasks.workunit.client.0.smithi047.stdout:2/891: getdents d7/dc/d71/dde 0 2024-02-07T12:26:06.610 INFO:tasks.workunit.client.0.smithi047.stdout:2/892: stat d7/d2d/lb5 0 2024-02-07T12:26:06.610 INFO:tasks.workunit.client.0.smithi047.stdout:2/893: readlink d7/d48/l4d 0 2024-02-07T12:26:06.610 INFO:tasks.workunit.client.0.smithi047.stdout:2/894: chown d7/dc/d51 8 1 2024-02-07T12:26:06.610 INFO:tasks.workunit.client.0.smithi047.stdout:2/895: write d7/dc/d71/fcd [1469353,129175] 0 2024-02-07T12:26:06.612 INFO:tasks.workunit.client.0.smithi047.stdout:5/962: creat da/d24/d63/d9a/df2/db2/d108/d33/d6e/da8/db6/f141 x:0 0 0 2024-02-07T12:26:06.613 INFO:tasks.workunit.client.0.smithi047.stdout:5/963: write da/d24/f2f [13010,23285] 0 2024-02-07T12:26:06.615 INFO:tasks.workunit.client.0.smithi047.stdout:0/635: dread fa [0,4194304] 0 2024-02-07T12:26:06.615 INFO:tasks.workunit.client.0.smithi047.stdout:2/896: unlink d7/d2d/lc7 0 2024-02-07T12:26:06.615 INFO:tasks.workunit.client.0.smithi047.stdout:0/636: chown d19/d1c/d2b/f77 42504 1 2024-02-07T12:26:06.615 INFO:tasks.workunit.client.0.smithi047.stdout:0/637: chown d19/d1c/f30 4238631 1 2024-02-07T12:26:06.615 INFO:tasks.workunit.client.0.smithi047.stdout:0/638: write d19/d1c/d3c/f9b [1575803,12948] 0 2024-02-07T12:26:06.617 INFO:tasks.workunit.client.0.smithi047.stdout:5/964: unlink da/d24/d63/d9a/df2/db2/d108/d33/d55/fe9 0 2024-02-07T12:26:06.619 INFO:tasks.workunit.client.0.smithi047.stdout:2/897: rename d7/d2d/f53 to d7/dc/dd6/dfa/f11e 0 2024-02-07T12:26:06.621 INFO:tasks.workunit.client.0.smithi047.stdout:0/639: symlink d19/d1c/d3c/d48/lcf 0 2024-02-07T12:26:06.622 INFO:tasks.workunit.client.0.smithi047.stdout:5/965: symlink da/df/d16/d41/d57/d13d/l142 0 2024-02-07T12:26:06.627 INFO:tasks.workunit.client.0.smithi047.stdout:2/898: mknod d7/c11f 0 2024-02-07T12:26:06.647 INFO:tasks.workunit.client.0.smithi047.stdout:0/640: dwrite d19/f83 [0,4194304] 0 2024-02-07T12:26:06.647 INFO:tasks.workunit.client.0.smithi047.stdout:5/966: dwrite da/d24/d63/d9a/df2/db2/d108/d33/d6e/da8/db6/f141 [0,4194304] 0 2024-02-07T12:26:06.651 INFO:tasks.workunit.client.0.smithi047.stdout:0/641: creat d19/d1c/d3c/d37/fd0 x:0 0 0 2024-02-07T12:26:06.651 INFO:tasks.workunit.client.0.smithi047.stdout:2/899: rmdir d7 39 2024-02-07T12:26:06.654 INFO:tasks.workunit.client.0.smithi047.stdout:0/642: creat d19/d1c/d3c/d60/fd1 x:0 0 0 2024-02-07T12:26:06.655 INFO:tasks.workunit.client.0.smithi047.stdout:5/967: dread da/d24/d63/d9a/df2/db2/d108/d33/d55/f92 [0,4194304] 0 2024-02-07T12:26:06.655 INFO:tasks.workunit.client.0.smithi047.stdout:5/968: fdatasync da/d24/d63/d9a/df2/db2/d108/d33/d55/f92 0 2024-02-07T12:26:06.655 INFO:tasks.workunit.client.0.smithi047.stdout:2/900: symlink d7/dc/d4c/da0/l120 0 2024-02-07T12:26:06.655 INFO:tasks.workunit.client.0.smithi047.stdout:2/901: chown d7/d48/d72/ld2 0 1 2024-02-07T12:26:06.657 INFO:tasks.workunit.client.0.smithi047.stdout:0/643: rename d19/d1c/d3c/d60/d6f/d95/da7/ca8 to d19/d40/d66/d46/cd2 0 2024-02-07T12:26:06.660 INFO:tasks.workunit.client.0.smithi047.stdout:5/969: mknod da/df/d16/d41/d57/d6c/c143 0 2024-02-07T12:26:06.660 INFO:tasks.workunit.client.0.smithi047.stdout:5/970: write da/d24/d63/d9a/df2/db2/d108/d33/d55/d7c/fcd [606653,84067] 0 2024-02-07T12:26:06.660 INFO:tasks.workunit.client.0.smithi047.stdout:2/902: mknod d7/d48/df0/c121 0 2024-02-07T12:26:06.662 INFO:tasks.workunit.client.0.smithi047.stdout:2/903: dread d7/dc/d8a/fd8 [0,4194304] 0 2024-02-07T12:26:06.662 INFO:tasks.workunit.client.0.smithi047.stdout:0/644: unlink d19/d1c/d3c/d60/d6f/d95/daa/fae 0 2024-02-07T12:26:06.664 INFO:tasks.workunit.client.0.smithi047.stdout:5/971: rename da/d24/d63/d9a/df2/db2/d108/d33/d6e/dbb/fef to da/df/d16/d41/d57/f144 0 2024-02-07T12:26:06.665 INFO:tasks.workunit.client.0.smithi047.stdout:5/972: chown da/d24/d63/d85/ff5 1251104 1 2024-02-07T12:26:06.666 INFO:tasks.workunit.client.0.smithi047.stdout:5/973: read da/d24/d63/d9c/da3/fbf [558451,33437] 0 2024-02-07T12:26:06.667 INFO:tasks.workunit.client.0.smithi047.stdout:5/974: symlink da/d24/d63/d9a/df2/db2/d108/d33/d91/l145 0 2024-02-07T12:26:06.671 INFO:tasks.workunit.client.0.smithi047.stdout:0/645: rename d19/d1c/d3c/d37 to d19/d1c/d2b/d5f/d9f/dd3 0 2024-02-07T12:26:06.672 INFO:tasks.workunit.client.0.smithi047.stdout:5/975: getdents da/d24/d63/d9a/df2/db2/d108/d33/d55 0 2024-02-07T12:26:06.675 INFO:tasks.workunit.client.0.smithi047.stdout:0/646: write d19/d1c/d3c/d60/d6f/d95/daa/d49/f5c [294239,53242] 0 2024-02-07T12:26:06.675 INFO:tasks.workunit.client.0.smithi047.stdout:0/647: dread - d19/d1c/d2b/f71 zero size 2024-02-07T12:26:06.677 INFO:tasks.workunit.client.0.smithi047.stdout:5/976: rename da/d24/d63/d9a/df2/db2/d108/f82 to da/d24/d63/d85/d9d/f146 0 2024-02-07T12:26:06.677 INFO:tasks.workunit.client.0.smithi047.stdout:5/977: write da/d24/d63/d9a/df2/db2/d108/d71/f43 [1831539,13173] 0 2024-02-07T12:26:06.677 INFO:tasks.workunit.client.0.smithi047.stdout:5/978: chown da/df/d16/d41/d57/c5e 106661979 1 2024-02-07T12:26:06.679 INFO:tasks.workunit.client.0.smithi047.stdout:2/904: dwrite d7/d2d/d5c/d77/f85 [0,4194304] 0 2024-02-07T12:26:06.679 INFO:tasks.workunit.client.0.smithi047.stdout:5/979: creat da/d12c/f147 x:0 0 0 2024-02-07T12:26:06.681 INFO:tasks.workunit.client.0.smithi047.stdout:2/905: chown d7/c42 1616000121 1 2024-02-07T12:26:06.686 INFO:tasks.workunit.client.0.smithi047.stdout:2/906: mknod d7/dc/d71/dde/c122 0 2024-02-07T12:26:06.686 INFO:tasks.workunit.client.0.smithi047.stdout:2/907: truncate d7/dc/d8a/fd8 1059010 0 2024-02-07T12:26:06.688 INFO:tasks.workunit.client.0.smithi047.stdout:2/908: creat d7/dc/f123 x:0 0 0 2024-02-07T12:26:06.688 INFO:tasks.workunit.client.0.smithi047.stdout:2/909: write d7/d2d/f6d [897547,54816] 0 2024-02-07T12:26:06.690 INFO:tasks.workunit.client.0.smithi047.stdout:2/910: creat d7/dc/d51/dda/d113/f124 x:0 0 0 2024-02-07T12:26:06.695 INFO:tasks.workunit.client.0.smithi047.stdout:0/648: dwrite d19/d1c/d24/f56 [0,4194304] 0 2024-02-07T12:26:06.698 INFO:tasks.workunit.client.0.smithi047.stdout:0/649: getdents d19/d1c/d3c/d60/d6f/d70 0 2024-02-07T12:26:06.700 INFO:tasks.workunit.client.0.smithi047.stdout:5/980: dwrite da/f1a [0,4194304] 0 2024-02-07T12:26:06.711 INFO:tasks.workunit.client.0.smithi047.stdout:5/981: dread da/d24/d63/d9a/df2/db2/d108/d33/d91/f130 [0,4194304] 0 2024-02-07T12:26:06.713 INFO:tasks.workunit.client.0.smithi047.stdout:5/982: dread da/d24/d63/d9a/df2/db2/d108/d33/d6e/fe7 [0,4194304] 0 2024-02-07T12:26:06.713 INFO:tasks.workunit.client.0.smithi047.stdout:5/983: truncate da/d24/d63/d9a/df2/db2/d108/d71/d68/dda/f106 812838 0 2024-02-07T12:26:06.718 INFO:tasks.workunit.client.0.smithi047.stdout:2/911: dwrite d7/d48/d72/ff5 [0,4194304] 0 2024-02-07T12:26:06.718 INFO:tasks.workunit.client.0.smithi047.stdout:2/912: write d7/dc/d8a/f112 [247490,62300] 0 2024-02-07T12:26:06.719 INFO:tasks.workunit.client.0.smithi047.stdout:2/913: symlink d7/dc/d51/l125 0 2024-02-07T12:26:06.719 INFO:tasks.workunit.client.0.smithi047.stdout:0/650: dwrite d19/d1c/d3c/d60/d6f/d95/daa/d8c/f91 [0,4194304] 0 2024-02-07T12:26:06.719 INFO:tasks.workunit.client.0.smithi047.stdout:2/914: getdents d7/d48/d72/db7/d102/d118 0 2024-02-07T12:26:06.721 INFO:tasks.workunit.client.0.smithi047.stdout:2/915: rmdir d7/dc/d51 39 2024-02-07T12:26:06.721 INFO:tasks.workunit.client.0.smithi047.stdout:2/916: fsync d7/d2d/f45 0 2024-02-07T12:26:06.722 INFO:tasks.workunit.client.0.smithi047.stdout:2/917: creat d7/dc/d71/dde/f126 x:0 0 0 2024-02-07T12:26:06.722 INFO:tasks.workunit.client.0.smithi047.stdout:0/651: dread d19/d1c/f43 [0,4194304] 0 2024-02-07T12:26:06.722 INFO:tasks.workunit.client.0.smithi047.stdout:0/652: chown d19/d1c/d3c/d60/ca6 164 1 2024-02-07T12:26:06.730 INFO:tasks.workunit.client.0.smithi047.stdout:5/984: dwrite da/d24/d63/d9a/df2/db2/d108/dc1/f100 [0,4194304] 0 2024-02-07T12:26:06.731 INFO:tasks.workunit.client.0.smithi047.stdout:5/985: chown da/df/l4f 4724954 1 2024-02-07T12:26:06.746 INFO:tasks.workunit.client.0.smithi047.stdout:5/986: dwrite da/d24/daa/faf [4194304,4194304] 0 2024-02-07T12:26:06.746 INFO:tasks.workunit.client.0.smithi047.stdout:5/987: write da/d24/d63/d9a/dec/f10c [675849,72828] 0 2024-02-07T12:26:06.764 INFO:tasks.workunit.client.0.smithi047.stdout:5/988: dread da/d24/d63/d9a/df2/fa9 [0,4194304] 0 2024-02-07T12:26:06.770 INFO:tasks.workunit.client.0.smithi047.stdout:5/989: dread da/df/d16/d41/f46 [0,4194304] 0 2024-02-07T12:26:06.770 INFO:tasks.workunit.client.0.smithi047.stdout:5/990: read - da/d12c/f147 zero size 2024-02-07T12:26:06.785 INFO:tasks.workunit.client.0.smithi047.stdout:5/991: dwrite da/d24/d63/d9a/df2/db2/d108/d33/d91/f11f [0,4194304] 0 2024-02-07T12:26:06.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.836+0000 7f066977a700 1 -- 172.21.15.47:0/624307375 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0650000bf0 con 0x7f064c06b140 2024-02-07T12:26:06.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.837+0000 7f064b7fe700 1 -- 172.21.15.47:0/624307375 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f0650000bf0 con 0x7f064c06b140 2024-02-07T12:26:06.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.839+0000 7f066977a700 1 -- 172.21.15.47:0/624307375 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f064c06b140 msgr2=0x7f064c06d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:06.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.839+0000 7f066977a700 1 --2- 172.21.15.47:0/624307375 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f064c06b140 0x7f064c06d5f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0658000c00 tx=0x7f0658009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:06.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.839+0000 7f066977a700 1 -- 172.21.15.47:0/624307375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06640fcef0 msgr2=0x7f066410d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:06.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.839+0000 7f066977a700 1 --2- 172.21.15.47:0/624307375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06640fcef0 0x7f066410d6d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f065400eb70 tx=0x7f065400b040 comp rx=0 tx=0).stop 2024-02-07T12:26:06.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.840+0000 7f066977a700 1 -- 172.21.15.47:0/624307375 shutdown_connections 2024-02-07T12:26:06.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.840+0000 7f066977a700 1 --2- 172.21.15.47:0/624307375 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f064c06b140 0x7f064c06d5f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:06.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.840+0000 7f066977a700 1 --2- 172.21.15.47:0/624307375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06640fcef0 0x7f066410d6d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:06.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.840+0000 7f066977a700 1 --2- 172.21.15.47:0/624307375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06640fe0e0 0x7f066410dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:06.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.840+0000 7f066977a700 1 -- 172.21.15.47:0/624307375 >> 172.21.15.47:0/624307375 conn(0x7f06640f8620 msgr2=0x7f06640fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:06.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.840+0000 7f066977a700 1 -- 172.21.15.47:0/624307375 shutdown_connections 2024-02-07T12:26:06.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.840+0000 7f066977a700 1 -- 172.21.15.47:0/624307375 wait complete. 2024-02-07T12:26:06.851 INFO:tasks.workunit.client.0.smithi047.stdout:0/653: dread - d19/d1c/d3c/d60/d6f/d95/daa/d49/fb5 zero size 2024-02-07T12:26:06.854 INFO:tasks.workunit.client.0.smithi047.stdout:5/992: mknod da/d24/d63/d9a/df2/db2/d108/d33/d6e/d116/c148 0 2024-02-07T12:26:06.865 INFO:tasks.workunit.client.0.smithi047.stdout:2/918: dwrite d7/d2d/f43 [0,4194304] 0 2024-02-07T12:26:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.948+0000 7fb7606dc700 1 -- 172.21.15.47:0/624508737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7580fbe40 msgr2=0x7fb7580fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.948+0000 7fb7606dc700 1 --2- 172.21.15.47:0/624508737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7580fbe40 0x7fb7580fc250 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb754004940 tx=0x7fb754009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.948+0000 7fb7606dc700 1 -- 172.21.15.47:0/624508737 shutdown_connections 2024-02-07T12:26:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.948+0000 7fb7606dc700 1 --2- 172.21.15.47:0/624508737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7580fcfb0 0x7fb7580fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.948+0000 7fb7606dc700 1 --2- 172.21.15.47:0/624508737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7580fbe40 0x7fb7580fc250 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:06.952 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:06 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:26:06.952 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:06 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:26:06.952 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:06 smithi047 ceph-mon[28972]: Reconfiguring alertmanager.smithi047 (dependencies changed)... 2024-02-07T12:26:06.952 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:06 smithi047 ceph-mon[28972]: Reconfiguring daemon alertmanager.smithi047 on smithi047 2024-02-07T12:26:06.953 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:06 smithi047 ceph-mon[28972]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:06.953 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:06 smithi047 ceph-mon[28972]: pgmap v20: 65 pgs: 65 active+clean; 1.7 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 101 MiB/s rd, 121 MiB/s wr, 350 op/s 2024-02-07T12:26:06.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.948+0000 7fb7606dc700 1 -- 172.21.15.47:0/624508737 >> 172.21.15.47:0/624508737 conn(0x7fb7580f74e0 msgr2=0x7fb7580f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:06.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.948+0000 7fb7606dc700 1 -- 172.21.15.47:0/624508737 shutdown_connections 2024-02-07T12:26:06.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.948+0000 7fb7606dc700 1 -- 172.21.15.47:0/624508737 wait complete. 2024-02-07T12:26:06.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.949+0000 7fb7606dc700 1 Processor -- start 2024-02-07T12:26:06.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.949+0000 7fb7606dc700 1 -- start start 2024-02-07T12:26:06.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.949+0000 7fb7606dc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7580fbe40 0x7fb75810d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:06.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.949+0000 7fb7606dc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7580fcfb0 0x7fb75810ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:06.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.949+0000 7fb7606dc700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75810e3f0 con 0x7fb7580fbe40 2024-02-07T12:26:06.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.949+0000 7fb7606dc700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75810ec90 con 0x7fb7580fcfb0 2024-02-07T12:26:06.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.949+0000 7fb75e478700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7580fbe40 0x7fb75810d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:06.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.949+0000 7fb75e478700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7580fbe40 0x7fb75810d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42104/0 (socket says 172.21.15.47:42104) 2024-02-07T12:26:06.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.949+0000 7fb75e478700 1 -- 172.21.15.47:0/3460947109 learned_addr learned my addr 172.21.15.47:0/3460947109 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:06.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.949+0000 7fb75dc77700 1 --2- 172.21.15.47:0/3460947109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7580fcfb0 0x7fb75810ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:06.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.950+0000 7fb75e478700 1 -- 172.21.15.47:0/3460947109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7580fcfb0 msgr2=0x7fb75810ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:06.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.950+0000 7fb75e478700 1 --2- 172.21.15.47:0/3460947109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7580fcfb0 0x7fb75810ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:06.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.950+0000 7fb75e478700 1 -- 172.21.15.47:0/3460947109 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb754005040 con 0x7fb7580fbe40 2024-02-07T12:26:06.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.950+0000 7fb75e478700 1 --2- 172.21.15.47:0/3460947109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7580fbe40 0x7fb75810d8b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb754000c00 tx=0x7fb754009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:06.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.950+0000 7fb74effd700 1 -- 172.21.15.47:0/3460947109 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb754021070 con 0x7fb7580fbe40 2024-02-07T12:26:06.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.950+0000 7fb7606dc700 1 -- 172.21.15.47:0/3460947109 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75810ef10 con 0x7fb7580fbe40 2024-02-07T12:26:06.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.950+0000 7fb74effd700 1 -- 172.21.15.47:0/3460947109 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb75401c400 con 0x7fb7580fbe40 2024-02-07T12:26:06.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.950+0000 7fb74effd700 1 -- 172.21.15.47:0/3460947109 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb75400e070 con 0x7fb7580fbe40 2024-02-07T12:26:06.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.950+0000 7fb7606dc700 1 -- 172.21.15.47:0/3460947109 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75810f3f0 con 0x7fb7580fbe40 2024-02-07T12:26:06.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.951+0000 7fb7606dc700 1 -- 172.21.15.47:0/3460947109 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75804bed0 con 0x7fb7580fbe40 2024-02-07T12:26:06.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.952+0000 7fb74effd700 1 -- 172.21.15.47:0/3460947109 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7fb75401ca50 con 0x7fb7580fbe40 2024-02-07T12:26:06.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.953+0000 7fb74effd700 1 --2- 172.21.15.47:0/3460947109 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fb74406b140 0x7fb74406d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:06.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.953+0000 7fb74effd700 1 -- 172.21.15.47:0/3460947109 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb75408acc0 con 0x7fb7580fbe40 2024-02-07T12:26:06.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.953+0000 7fb75dc77700 1 --2- 172.21.15.47:0/3460947109 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fb74406b140 0x7fb74406d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:06.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.954+0000 7fb75dc77700 1 --2- 172.21.15.47:0/3460947109 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fb74406b140 0x7fb74406d5f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb748009b80 tx=0x7fb74800b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:06.958 INFO:tasks.workunit.client.0.smithi047.stdout:0/654: rename d19/d1c/d2b/d5f/d9f/cad to d19/d40/d66/d81/cd4 0 2024-02-07T12:26:06.960 INFO:tasks.workunit.client.0.smithi047.stdout:5/993: link da/d24/d63/d9a/df2/db2/d108/d71/f4b da/df/d16/d41/d11d/f149 0 2024-02-07T12:26:06.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:06.959+0000 7fb74effd700 1 -- 172.21.15.47:0/3460947109 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb7540588c0 con 0x7fb7580fbe40 2024-02-07T12:26:06.971 INFO:tasks.workunit.client.0.smithi047.stdout:5/994: dread da/d24/d63/d9a/df2/db2/d108/dc1/f100 [0,4194304] 0 2024-02-07T12:26:06.972 INFO:tasks.workunit.client.0.smithi047.stdout:5/995: symlink da/d24/d63/d9c/da3/l14a 0 2024-02-07T12:26:06.973 INFO:tasks.workunit.client.0.smithi047.stdout:5/996: truncate da/d24/d63/d9a/df2/db2/d108/d71/f4e 1165829 0 2024-02-07T12:26:06.973 INFO:tasks.workunit.client.0.smithi047.stdout:5/997: creat da/d24/d63/d9a/df2/db2/d108/d33/d6e/da8/db6/f14b x:0 0 0 2024-02-07T12:26:06.976 INFO:tasks.workunit.client.0.smithi047.stdout:0/655: dwrite d19/d40/f53 [4194304,4194304] 0 2024-02-07T12:26:06.978 INFO:tasks.workunit.client.0.smithi047.stdout:5/998: link da/d24/d63/d9a/df2/db2/d108/fd1 da/d24/d63/d9a/df2/da6/f14c 0 2024-02-07T12:26:06.978 INFO:tasks.workunit.client.0.smithi047.stdout:5/999: dread - da/d24/d63/d9a/df2/db2/d108/d33/d6e/dbb/f125 zero size 2024-02-07T12:26:06.981 INFO:tasks.workunit.client.0.smithi047.stdout:0/656: unlink d19/d40/d66/d46/cd2 0 2024-02-07T12:26:06.982 INFO:tasks.workunit.client.0.smithi047.stdout:0/657: fdatasync d19/d1c/d2b/d5f/d9f/dd3/f39 0 2024-02-07T12:26:06.982 INFO:tasks.workunit.client.0.smithi047.stdout:0/658: link d19/d1c/d3c/d60/d6f/d95/cc9 d19/d1c/d3c/d48/cd5 0 2024-02-07T12:26:06.984 INFO:tasks.workunit.client.0.smithi047.stdout:0/659: mkdir d19/d40/d66/d81/d82/d9e/dd6 0 2024-02-07T12:26:06.984 INFO:tasks.workunit.client.0.smithi047.stdout:0/660: fsync d19/d1c/f30 0 2024-02-07T12:26:07.001 INFO:tasks.workunit.client.0.smithi047.stdout:0/661: dwrite d19/d40/f99 [0,4194304] 0 2024-02-07T12:26:07.001 INFO:tasks.workunit.client.0.smithi047.stdout:0/662: fdatasync d19/d1c/d2b/d5f/f80 0 2024-02-07T12:26:07.003 INFO:tasks.workunit.client.0.smithi047.stdout:0/663: rename d19/d1c/d3c/d60/d6f/d70 to d19/d25/dd7 0 2024-02-07T12:26:07.008 INFO:tasks.workunit.client.0.smithi047.stdout:0/664: truncate d19/d40/d66/d81/fbe 3045841 0 2024-02-07T12:26:07.016 INFO:tasks.workunit.client.0.smithi047.stdout:0/665: dread f15 [0,4194304] 0 2024-02-07T12:26:07.016 INFO:tasks.workunit.client.0.smithi047.stdout:0/666: fdatasync d19/d40/d66/fa2 0 2024-02-07T12:26:07.016 INFO:tasks.workunit.client.0.smithi047.stdout:0/667: fdatasync d19/d1c/d24/f56 0 2024-02-07T12:26:07.016 INFO:tasks.workunit.client.0.smithi047.stdout:0/668: creat d19/d40/d66/d46/fd8 x:0 0 0 2024-02-07T12:26:07.031 INFO:tasks.workunit.client.0.smithi047.stdout:0/669: dwrite d19/d40/d66/fa2 [0,4194304] 0 2024-02-07T12:26:07.031 INFO:tasks.workunit.client.0.smithi047.stdout:0/670: truncate d19/d1c/d2b/d5f/f80 963972 0 2024-02-07T12:26:07.031 INFO:tasks.workunit.client.0.smithi047.stdout:0/671: symlink d19/d1c/d24/ld9 0 2024-02-07T12:26:07.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:06 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:26:07.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:06 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:26:07.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:06 smithi138 ceph-mon[35528]: Reconfiguring alertmanager.smithi047 (dependencies changed)... 2024-02-07T12:26:07.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:06 smithi138 ceph-mon[35528]: Reconfiguring daemon alertmanager.smithi047 on smithi047 2024-02-07T12:26:07.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:06 smithi138 ceph-mon[35528]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:07.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:06 smithi138 ceph-mon[35528]: pgmap v20: 65 pgs: 65 active+clean; 1.7 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 101 MiB/s rd, 121 MiB/s wr, 350 op/s 2024-02-07T12:26:07.043 INFO:tasks.workunit.client.0.smithi047.stdout:0/672: dread d19/d1c/d2b/d5f/f6b [0,4194304] 0 2024-02-07T12:26:07.052 INFO:tasks.workunit.client.0.smithi047.stdout:0/673: write d19/d1c/d3c/d60/d6f/d95/daa/d8c/f91 [286336,85171] 0 2024-02-07T12:26:07.052 INFO:tasks.workunit.client.0.smithi047.stdout:0/674: write d19/d1c/d3c/d60/d6f/d95/daa/d49/fb2 [273753,105097] 0 2024-02-07T12:26:07.054 INFO:tasks.workunit.client.0.smithi047.stdout:0/675: unlink d19/cba 0 2024-02-07T12:26:07.055 INFO:tasks.workunit.client.0.smithi047.stdout:0/676: chown d19/d1c/d3c/d60/d6f/d95/daa/f7d 8019532 1 2024-02-07T12:26:07.065 INFO:tasks.workunit.client.0.smithi047.stdout:0/677: dread d19/d25/dd7/f76 [0,4194304] 0 2024-02-07T12:26:07.075 INFO:tasks.workunit.client.0.smithi047.stdout:0/678: write d19/d40/f99 [24198,126718] 0 2024-02-07T12:26:07.076 INFO:tasks.workunit.client.0.smithi047.stdout:0/679: creat d19/d1c/d2b/dc2/fda x:0 0 0 2024-02-07T12:26:07.078 INFO:tasks.workunit.client.0.smithi047.stdout:0/680: unlink d19/d25/dd7/f76 0 2024-02-07T12:26:07.078 INFO:tasks.workunit.client.0.smithi047.stdout:0/681: fsync d19/d1c/d3c/d60/f87 0 2024-02-07T12:26:07.080 INFO:tasks.workunit.client.0.smithi047.stdout:0/682: mkdir d19/d25/ddb 0 2024-02-07T12:26:07.081 INFO:tasks.workunit.client.0.smithi047.stdout:0/683: getdents d19/d1c/d2b/d5f/d9f 0 2024-02-07T12:26:07.092 INFO:tasks.workunit.client.0.smithi047.stdout:0/684: write d19/d1c/d24/f56 [865010,10941] 0 2024-02-07T12:26:07.093 INFO:tasks.workunit.client.0.smithi047.stdout:0/685: creat d19/d40/d66/d81/d82/fdc x:0 0 0 2024-02-07T12:26:07.095 INFO:tasks.workunit.client.0.smithi047.stdout:0/686: mknod d19/d1c/d2b/cdd 0 2024-02-07T12:26:07.095 INFO:tasks.workunit.client.0.smithi047.stdout:0/687: creat d19/d1c/d3c/d48/fde x:0 0 0 2024-02-07T12:26:07.097 INFO:tasks.workunit.client.0.smithi047.stdout:0/688: mknod d19/d1c/d24/db1/cdf 0 2024-02-07T12:26:07.097 INFO:tasks.workunit.client.0.smithi047.stdout:0/689: dread - d19/d1c/d2b/f71 zero size 2024-02-07T12:26:07.106 INFO:tasks.workunit.client.0.smithi047.stdout:0/690: write d19/d1c/d3c/d60/d6f/d95/daa/d49/f79 [2058985,63838] 0 2024-02-07T12:26:07.108 INFO:tasks.workunit.client.0.smithi047.stdout:0/691: mknod d19/d1c/d3c/d60/d6f/d95/ce0 0 2024-02-07T12:26:07.108 INFO:tasks.workunit.client.0.smithi047.stdout:0/692: creat d19/d1c/d3c/d48/fe1 x:0 0 0 2024-02-07T12:26:07.108 INFO:tasks.workunit.client.0.smithi047.stdout:0/693: chown f15 1 1 2024-02-07T12:26:07.109 INFO:tasks.workunit.client.0.smithi047.stdout:0/694: mknod d19/ce2 0 2024-02-07T12:26:07.124 INFO:tasks.workunit.client.0.smithi047.stdout:0/695: dwrite d19/d40/d66/fa2 [0,4194304] 0 2024-02-07T12:26:07.125 INFO:tasks.workunit.client.0.smithi047.stdout:0/696: symlink d19/d1c/d24/le3 0 2024-02-07T12:26:07.141 INFO:tasks.workunit.client.0.smithi047.stdout:0/697: dwrite d19/d1c/d2b/dc2/fda [0,4194304] 0 2024-02-07T12:26:07.141 INFO:tasks.workunit.client.0.smithi047.stdout:0/698: write d19/d1c/d3c/d60/d6f/d95/daa/d8c/f91 [2338346,80992] 0 2024-02-07T12:26:07.141 INFO:tasks.workunit.client.0.smithi047.stdout:0/699: write d19/d25/dd7/f86 [4550707,90367] 0 2024-02-07T12:26:07.141 INFO:tasks.workunit.client.0.smithi047.stdout:0/700: creat d19/d1c/d2b/dc2/fe4 x:0 0 0 2024-02-07T12:26:07.141 INFO:tasks.workunit.client.0.smithi047.stdout:0/701: fdatasync d19/d1c/d3c/d48/fbc 0 2024-02-07T12:26:07.158 INFO:tasks.workunit.client.0.smithi047.stdout:0/702: dwrite d19/d1c/d3c/d60/f97 [0,4194304] 0 2024-02-07T12:26:07.158 INFO:tasks.workunit.client.0.smithi047.stdout:0/703: chown d19/d1c/d3c/d60/d6f/d95/daa/f7d 2653 1 2024-02-07T12:26:07.160 INFO:tasks.workunit.client.0.smithi047.stdout:0/704: mknod d19/d1c/d24/ce5 0 2024-02-07T12:26:07.161 INFO:tasks.workunit.client.0.smithi047.stdout:0/705: rename fa to d19/d1c/d3c/fe6 0 2024-02-07T12:26:07.162 INFO:tasks.workunit.client.0.smithi047.stdout:0/706: creat d19/d1c/d3c/d60/d6f/fe7 x:0 0 0 2024-02-07T12:26:07.164 INFO:tasks.workunit.client.0.smithi047.stdout:0/707: mknod d19/d40/d66/d46/ce8 0 2024-02-07T12:26:07.164 INFO:tasks.workunit.client.0.smithi047.stdout:0/708: write d19/d40/d66/d46/fd8 [741942,93933] 0 2024-02-07T12:26:07.177 INFO:tasks.workunit.client.0.smithi047.stdout:0/709: dwrite d19/d1c/d24/f35 [0,4194304] 0 2024-02-07T12:26:07.193 INFO:tasks.workunit.client.0.smithi047.stdout:0/710: dwrite d19/d40/d66/f8e [0,4194304] 0 2024-02-07T12:26:07.196 INFO:tasks.workunit.client.0.smithi047.stdout:0/711: link d19/d40/l4f d19/d1c/d3c/le9 0 2024-02-07T12:26:07.196 INFO:tasks.workunit.client.0.smithi047.stdout:0/712: dread - d19/d1c/d2b/dc2/fe4 zero size 2024-02-07T12:26:07.198 INFO:tasks.workunit.client.0.smithi047.stdout:9/636: sync 2024-02-07T12:26:07.198 INFO:tasks.workunit.client.0.smithi047.stdout:0/713: link d19/d1c/d24/f35 d19/d1c/d3c/fea 0 2024-02-07T12:26:07.198 INFO:tasks.workunit.client.0.smithi047.stdout:0/714: chown d19/d40/d66/da9 2 1 2024-02-07T12:26:07.199 INFO:tasks.workunit.client.0.smithi047.stdout:6/800: sync 2024-02-07T12:26:07.199 INFO:tasks.workunit.client.0.smithi047.stdout:6/801: chown d3/da/d14 4633 1 2024-02-07T12:26:07.201 INFO:tasks.workunit.client.0.smithi047.stdout:9/637: mknod d3/d10/d18/d3b/ce5 0 2024-02-07T12:26:07.201 INFO:tasks.workunit.client.0.smithi047.stdout:9/638: read - d3/d10/d18/d3d/fd2 zero size 2024-02-07T12:26:07.201 INFO:tasks.workunit.client.0.smithi047.stdout:0/715: rmdir d19/d1c 39 2024-02-07T12:26:07.202 INFO:tasks.workunit.client.0.smithi047.stdout:6/802: creat d3/da/d34/f106 x:0 0 0 2024-02-07T12:26:07.205 INFO:tasks.workunit.client.0.smithi047.stdout:9/639: unlink d3/d10/d18/d3d/fd2 0 2024-02-07T12:26:07.206 INFO:tasks.workunit.client.0.smithi047.stdout:0/716: read d19/f27 [266996,75539] 0 2024-02-07T12:26:07.213 INFO:tasks.workunit.client.0.smithi047.stdout:6/803: getdents d3/da/d2c/d47 0 2024-02-07T12:26:07.213 INFO:tasks.workunit.client.0.smithi047.stdout:6/804: dread - d3/da/d14/d28/d46/fc9 zero size 2024-02-07T12:26:07.213 INFO:tasks.workunit.client.0.smithi047.stdout:6/805: mknod d3/da/d14/d28/d46/d94/c107 0 2024-02-07T12:26:07.213 INFO:tasks.workunit.client.0.smithi047.stdout:6/806: unlink d3/d5/d35/d3c/dd4/l7d 0 2024-02-07T12:26:07.214 INFO:tasks.workunit.client.0.smithi047.stdout:6/807: mknod d3/da/d34/d6d/d8f/db3/c108 0 2024-02-07T12:26:07.217 INFO:tasks.workunit.client.0.smithi047.stdout:8/816: sync 2024-02-07T12:26:07.217 INFO:tasks.workunit.client.0.smithi047.stdout:1/638: sync 2024-02-07T12:26:07.217 INFO:tasks.workunit.client.0.smithi047.stdout:1/639: creat d1/d6e/d75/da7/d65/fce x:0 0 0 2024-02-07T12:26:07.219 INFO:tasks.workunit.client.0.smithi047.stdout:8/817: creat d3/d36/d50/d30/d34/dab/f111 x:0 0 0 2024-02-07T12:26:07.220 INFO:tasks.workunit.client.0.smithi047.stdout:8/818: write d3/d4/d59/fed [743940,32343] 0 2024-02-07T12:26:07.220 INFO:tasks.workunit.client.0.smithi047.stdout:0/717: dread d19/d1c/d3c/d60/d6f/d95/daa/d8c/f91 [0,4194304] 0 2024-02-07T12:26:07.220 INFO:tasks.workunit.client.0.smithi047.stdout:0/718: chown d19/d1c/d2b/d5f 206431577 1 2024-02-07T12:26:07.221 INFO:tasks.workunit.client.0.smithi047.stdout:0/719: truncate d19/d1c/d3c/d60/d6f/fac 1030200 0 2024-02-07T12:26:07.223 INFO:tasks.workunit.client.0.smithi047.stdout:1/640: truncate d1/d15/d2f/d3d/d3e/f4a 1642699 0 2024-02-07T12:26:07.223 INFO:tasks.workunit.client.0.smithi047.stdout:6/808: write d3/da/da9/fab [1809300,113241] 0 2024-02-07T12:26:07.224 INFO:tasks.workunit.client.0.smithi047.stdout:8/819: unlink d3/d66/d67/d6a/d91/ffe 0 2024-02-07T12:26:07.225 INFO:tasks.workunit.client.0.smithi047.stdout:1/641: getdents d1/d15/d2f/d3d 0 2024-02-07T12:26:07.230 INFO:tasks.workunit.client.0.smithi047.stdout:9/640: dwrite d3/d10/d18/d3a/da7/fac [0,4194304] 0 2024-02-07T12:26:07.232 INFO:tasks.workunit.client.0.smithi047.stdout:8/820: mkdir d3/d36/d50/d2a/d112 0 2024-02-07T12:26:07.237 INFO:tasks.workunit.client.0.smithi047.stdout:8/821: creat d3/d66/dac/f113 x:0 0 0 2024-02-07T12:26:07.241 INFO:tasks.workunit.client.0.smithi047.stdout:1/642: rename d1/d15/d2f/d3d to d1/d6e/dcf 0 2024-02-07T12:26:07.242 INFO:tasks.workunit.client.0.smithi047.stdout:8/822: read d3/d4/d4d/fb8 [155994,129154] 0 2024-02-07T12:26:07.243 INFO:tasks.workunit.client.0.smithi047.stdout:1/643: dread d1/d48/d81/f91 [0,4194304] 0 2024-02-07T12:26:07.244 INFO:tasks.workunit.client.0.smithi047.stdout:0/720: dwrite d19/d1c/d3c/d48/fbc [0,4194304] 0 2024-02-07T12:26:07.245 INFO:tasks.workunit.client.0.smithi047.stdout:1/644: symlink d1/d15/d2f/ld0 0 2024-02-07T12:26:07.245 INFO:tasks.workunit.client.0.smithi047.stdout:1/645: creat d1/d6e/d75/da7/d65/fd1 x:0 0 0 2024-02-07T12:26:07.245 INFO:tasks.workunit.client.0.smithi047.stdout:6/809: dwrite d3/d5/d35/d3c/dd4/f81 [0,4194304] 0 2024-02-07T12:26:07.249 INFO:tasks.workunit.client.0.smithi047.stdout:0/721: symlink d19/d1c/d24/leb 0 2024-02-07T12:26:07.254 INFO:tasks.workunit.client.0.smithi047.stdout:6/810: rename d3/da/d34/f5a to d3/da/d3b/d87/f109 0 2024-02-07T12:26:07.254 INFO:tasks.workunit.client.0.smithi047.stdout:9/641: dwrite d3/d10/d18/d3a/f44 [0,4194304] 0 2024-02-07T12:26:07.255 INFO:tasks.workunit.client.0.smithi047.stdout:1/646: dread d1/d15/d30/fa5 [0,4194304] 0 2024-02-07T12:26:07.260 INFO:tasks.workunit.client.0.smithi047.stdout:1/647: symlink d1/d15/ld2 0 2024-02-07T12:26:07.262 INFO:tasks.workunit.client.0.smithi047.stdout:8/823: write d3/d66/d67/d6a/f92 [111934,26842] 0 2024-02-07T12:26:07.263 INFO:tasks.workunit.client.0.smithi047.stdout:1/648: mknod d1/d6e/cd3 0 2024-02-07T12:26:07.265 INFO:tasks.workunit.client.0.smithi047.stdout:8/824: link d3/d36/d50/d30/d9e/da6/cbf d3/d66/d67/d6a/dca/d104/c114 0 2024-02-07T12:26:07.270 INFO:tasks.workunit.client.0.smithi047.stdout:8/825: creat d3/d36/d50/d28/d100/f115 x:0 0 0 2024-02-07T12:26:07.274 INFO:tasks.workunit.client.0.smithi047.stdout:6/811: link d3/da/d3b/d87/f109 d3/d5/d35/d3c/d72/f10a 0 2024-02-07T12:26:07.274 INFO:tasks.workunit.client.0.smithi047.stdout:6/812: dread - d3/d5/d35/d3c/d72/d8c/d91/feb zero size 2024-02-07T12:26:07.274 INFO:tasks.workunit.client.0.smithi047.stdout:6/813: readlink d3/da/lbf 0 2024-02-07T12:26:07.277 INFO:tasks.workunit.client.0.smithi047.stdout:9/642: dwrite d3/d10/d4c/f5b [0,4194304] 0 2024-02-07T12:26:07.277 INFO:tasks.workunit.client.0.smithi047.stdout:9/643: write d3/d10/d18/d3b/fc1 [506458,130604] 0 2024-02-07T12:26:07.277 INFO:tasks.workunit.client.0.smithi047.stdout:1/649: write d1/d6e/d75/da7/f27 [6235066,31668] 0 2024-02-07T12:26:07.278 INFO:tasks.workunit.client.0.smithi047.stdout:6/814: creat d3/da/d3b/d87/dc1/f10b x:0 0 0 2024-02-07T12:26:07.280 INFO:tasks.workunit.client.0.smithi047.stdout:0/722: dwrite d19/d40/d66/f51 [0,4194304] 0 2024-02-07T12:26:07.286 INFO:tasks.workunit.client.0.smithi047.stdout:1/650: symlink d1/d6e/d75/da7/d65/ld4 0 2024-02-07T12:26:07.287 INFO:tasks.workunit.client.0.smithi047.stdout:9/644: mkdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/de6 0 2024-02-07T12:26:07.287 INFO:tasks.workunit.client.0.smithi047.stdout:9/645: truncate d3/d10/d18/f1a 4952934 0 2024-02-07T12:26:07.287 INFO:tasks.workunit.client.0.smithi047.stdout:6/815: mknod d3/da/d34/d6d/d8f/db3/dbc/df5/c10c 0 2024-02-07T12:26:07.287 INFO:tasks.workunit.client.0.smithi047.stdout:0/723: link d19/d40/d66/da9/faf d19/d1c/d2b/d5f/fec 0 2024-02-07T12:26:07.289 INFO:tasks.workunit.client.0.smithi047.stdout:1/651: creat d1/d6e/d75/da7/d40/fd5 x:0 0 0 2024-02-07T12:26:07.289 INFO:tasks.workunit.client.0.smithi047.stdout:8/826: dwrite d3/d4/d4d/fc5 [0,4194304] 0 2024-02-07T12:26:07.290 INFO:tasks.workunit.client.0.smithi047.stdout:9/646: mknod d3/d10/d18/d6e/d9a/daf/ce7 0 2024-02-07T12:26:07.295 INFO:tasks.workunit.client.0.smithi047.stdout:0/724: rename d19/f83 to d19/d40/fed 0 2024-02-07T12:26:07.300 INFO:tasks.workunit.client.0.smithi047.stdout:1/652: creat d1/d6e/dcf/d84/fd6 x:0 0 0 2024-02-07T12:26:07.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.300+0000 7fb7606dc700 1 -- 172.21.15.47:0/3460947109 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb758065dd0 con 0x7fb74406b140 2024-02-07T12:26:07.305 INFO:tasks.workunit.client.0.smithi047.stdout:8/827: link d3/d66/c70 d3/d36/d50/d2a/d112/c116 0 2024-02-07T12:26:07.317 INFO:tasks.workunit.client.0.smithi047.stdout:1/653: dwrite d1/d48/d74/fa3 [0,4194304] 0 2024-02-07T12:26:07.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.316+0000 7fb74effd700 1 -- 172.21.15.47:0/3460947109 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb758065dd0 con 0x7fb74406b140 2024-02-07T12:26:07.318 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:26:07.318 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (7m) 19s ago 8m 26.7M - 0.25.0 c8568f914cd2 edd19ce884c8 2024-02-07T12:26:07.319 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (8m) 19s ago 8m 6660k - 17.2.7-491-gf2462625 4ad3622d1b31 bca7317ed169 2024-02-07T12:26:07.319 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (7m) 23s ago 7m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 110c84c6624b 2024-02-07T12:26:07.319 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (7m) 19s ago 8m 84.0M - 9.4.7 954c08fa6188 5b93631efbfc 2024-02-07T12:26:07.319 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (3m) 19s ago 3m 148M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:26:07.319 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (3m) 19s ago 3m 136M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:26:07.319 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (3m) 23s ago 3m 76.3M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:26:07.319 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (3m) 23s ago 3m 95.1M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:26:07.319 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:9283 running (9m) 19s ago 9m 348M - 17.2.7-491-gf2462625 4ad3622d1b31 f3b25479d84e 2024-02-07T12:26:07.319 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283 running (62s) 23s ago 7m 488M - 19.0.0-1252-g44458cce 79957b372307 fd928ea0fb8a 2024-02-07T12:26:07.319 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (9m) 19s ago 10m 46.9M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 105826d9ef9a 2024-02-07T12:26:07.320 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (7m) 23s ago 7m 40.3M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 02dfa0b8d573 2024-02-07T12:26:07.320 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 starting - - - - 2024-02-07T12:26:07.320 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (7m) 23s ago 7m 16.0M - 1.5.0 0da6a335fe13 8823dad6f717 2024-02-07T12:26:07.320 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (6m) 19s ago 6m 226M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 4f37918f583a 2024-02-07T12:26:07.320 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (6m) 19s ago 6m 243M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 1c6e3c603ed3 2024-02-07T12:26:07.320 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (5m) 19s ago 5m 190M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:26:07.320 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (5m) 23s ago 5m 283M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:26:07.320 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (5m) 23s ago 5m 226M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:26:07.320 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (4m) 23s ago 4m 280M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:26:07.320 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (6m) 19s ago 8m 57.3M - 2.43.0 a07b618ecd1d e41b94b0d167 2024-02-07T12:26:07.322 INFO:tasks.workunit.client.0.smithi047.stdout:9/647: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d82/fe8 x:0 0 0 2024-02-07T12:26:07.322 INFO:tasks.workunit.client.0.smithi047.stdout:9/648: dread - d3/d10/d18/d3b/fc9 zero size 2024-02-07T12:26:07.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.320+0000 7fb7606dc700 1 -- 172.21.15.47:0/3460947109 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fb74406b140 msgr2=0x7fb74406d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:07.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.320+0000 7fb7606dc700 1 --2- 172.21.15.47:0/3460947109 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fb74406b140 0x7fb74406d5f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb748009b80 tx=0x7fb74800b040 comp rx=0 tx=0).stop 2024-02-07T12:26:07.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.320+0000 7fb7606dc700 1 -- 172.21.15.47:0/3460947109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7580fbe40 msgr2=0x7fb75810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:07.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.320+0000 7fb7606dc700 1 --2- 172.21.15.47:0/3460947109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7580fbe40 0x7fb75810d8b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb754000c00 tx=0x7fb754009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:07.323 INFO:tasks.workunit.client.0.smithi047.stdout:6/816: getdents d3/d5/d35/d3c/dd4 0 2024-02-07T12:26:07.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.321+0000 7fb7606dc700 1 -- 172.21.15.47:0/3460947109 shutdown_connections 2024-02-07T12:26:07.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.321+0000 7fb7606dc700 1 --2- 172.21.15.47:0/3460947109 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fb74406b140 0x7fb74406d5f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:07.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.321+0000 7fb7606dc700 1 --2- 172.21.15.47:0/3460947109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7580fbe40 0x7fb75810d8b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:07.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.321+0000 7fb7606dc700 1 --2- 172.21.15.47:0/3460947109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7580fcfb0 0x7fb75810ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:07.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.321+0000 7fb7606dc700 1 -- 172.21.15.47:0/3460947109 >> 172.21.15.47:0/3460947109 conn(0x7fb7580f74e0 msgr2=0x7fb7580656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:07.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.321+0000 7fb7606dc700 1 -- 172.21.15.47:0/3460947109 shutdown_connections 2024-02-07T12:26:07.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.321+0000 7fb7606dc700 1 -- 172.21.15.47:0/3460947109 wait complete. 2024-02-07T12:26:07.329 INFO:tasks.workunit.client.0.smithi047.stdout:0/725: rename d19/d1c/d3c/d60/d6f/d95/daa/f38 to d19/d1c/d2b/dc2/fee 0 2024-02-07T12:26:07.333 INFO:tasks.workunit.client.0.smithi047.stdout:6/817: dread d3/da/d14/f88 [0,4194304] 0 2024-02-07T12:26:07.333 INFO:tasks.workunit.client.0.smithi047.stdout:6/818: write d3/d5/d35/d3c/d72/d8c/f93 [520179,45436] 0 2024-02-07T12:26:07.333 INFO:tasks.workunit.client.0.smithi047.stdout:6/819: creat d3/da/f10d x:0 0 0 2024-02-07T12:26:07.334 INFO:tasks.workunit.client.0.smithi047.stdout:8/828: symlink d3/d4/d4d/dc0/l117 0 2024-02-07T12:26:07.335 INFO:tasks.workunit.client.0.smithi047.stdout:8/829: chown d3/d66/dac/fc1 226731 1 2024-02-07T12:26:07.339 INFO:tasks.workunit.client.0.smithi047.stdout:1/654: creat d1/d37/da6/fd7 x:0 0 0 2024-02-07T12:26:07.339 INFO:tasks.workunit.client.0.smithi047.stdout:9/649: mknod d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/ce9 0 2024-02-07T12:26:07.339 INFO:tasks.workunit.client.0.smithi047.stdout:9/650: stat d3/f19 0 2024-02-07T12:26:07.342 INFO:tasks.workunit.client.0.smithi047.stdout:8/830: mkdir d3/d4/d59/d118 0 2024-02-07T12:26:07.349 INFO:tasks.workunit.client.0.smithi047.stdout:2/919: sync 2024-02-07T12:26:07.349 INFO:tasks.workunit.client.0.smithi047.stdout:3/906: sync 2024-02-07T12:26:07.351 INFO:tasks.workunit.client.0.smithi047.stdout:1/655: mknod d1/d48/d81/cd8 0 2024-02-07T12:26:07.351 INFO:tasks.workunit.client.0.smithi047.stdout:1/656: fdatasync d1/d6e/d75/da7/f23 0 2024-02-07T12:26:07.351 INFO:tasks.workunit.client.0.smithi047.stdout:1/657: write d1/d15/d30/d46/d66/fb2 [69088,3336] 0 2024-02-07T12:26:07.355 INFO:tasks.workunit.client.0.smithi047.stdout:1/658: rmdir d1/d6e/d75/da7 39 2024-02-07T12:26:07.355 INFO:tasks.workunit.client.0.smithi047.stdout:1/659: truncate d1/d48/d74/fc0 142271 0 2024-02-07T12:26:07.355 INFO:tasks.workunit.client.0.smithi047.stdout:1/660: stat d1/d2a 0 2024-02-07T12:26:07.355 INFO:tasks.workunit.client.0.smithi047.stdout:1/661: chown d1/d6e/d75/da7/l1f 0 1 2024-02-07T12:26:07.357 INFO:tasks.workunit.client.0.smithi047.stdout:1/662: mknod d1/d15/d30/d46/d66/dac/dbc/cd9 0 2024-02-07T12:26:07.360 INFO:tasks.workunit.client.0.smithi047.stdout:1/663: mkdir d1/d15/d30/d46/dda 0 2024-02-07T12:26:07.363 INFO:tasks.workunit.client.0.smithi047.stdout:3/907: read d12/d19/f8f [1003836,76079] 0 2024-02-07T12:26:07.366 INFO:tasks.workunit.client.0.smithi047.stdout:0/726: dwrite d19/d1c/d3c/d60/d6f/d95/daa/f7d [0,4194304] 0 2024-02-07T12:26:07.366 INFO:tasks.workunit.client.0.smithi047.stdout:0/727: chown d19/d1c/d2b/d5f/f80 330158907 1 2024-02-07T12:26:07.367 INFO:tasks.workunit.client.0.smithi047.stdout:3/908: unlink d12/dc7/d29/d6f/d93/dac/d115/f118 0 2024-02-07T12:26:07.369 INFO:tasks.workunit.client.0.smithi047.stdout:0/728: truncate d19/d40/fed 2569481 0 2024-02-07T12:26:07.370 INFO:tasks.workunit.client.0.smithi047.stdout:8/831: dwrite d3/d66/d67/d71/d93/f95 [0,4194304] 0 2024-02-07T12:26:07.370 INFO:tasks.workunit.client.0.smithi047.stdout:8/832: fsync d3/d36/d50/d30/f90 0 2024-02-07T12:26:07.370 INFO:tasks.workunit.client.0.smithi047.stdout:3/909: stat d12/dc7/d90/dad/caf 0 2024-02-07T12:26:07.371 INFO:tasks.workunit.client.0.smithi047.stdout:6/820: dwrite d3/da/d2c/d47/f98 [0,4194304] 0 2024-02-07T12:26:07.371 INFO:tasks.workunit.client.0.smithi047.stdout:6/821: creat d3/da/d14/d28/d46/f10e x:0 0 0 2024-02-07T12:26:07.374 INFO:tasks.workunit.client.0.smithi047.stdout:0/729: rename d19/d40/d66/d81/dbd/cc4 to d19/d25/cef 0 2024-02-07T12:26:07.375 INFO:tasks.workunit.client.0.smithi047.stdout:1/664: write d1/d48/d74/fa3 [2704140,128142] 0 2024-02-07T12:26:07.375 INFO:tasks.workunit.client.0.smithi047.stdout:0/730: dread d19/d1c/d3c/d60/d6f/fac [0,4194304] 0 2024-02-07T12:26:07.376 INFO:tasks.workunit.client.0.smithi047.stdout:8/833: mknod d3/d36/d50/d28/d100/c119 0 2024-02-07T12:26:07.377 INFO:tasks.workunit.client.0.smithi047.stdout:6/822: getdents d3/da/d34/d6d/d8f/db3/dbc/df5 0 2024-02-07T12:26:07.380 INFO:tasks.workunit.client.0.smithi047.stdout:0/731: mkdir d19/d40/d66/d46/df0 0 2024-02-07T12:26:07.380 INFO:tasks.workunit.client.0.smithi047.stdout:0/732: chown d19/d1c/d3c/c7b 0 1 2024-02-07T12:26:07.382 INFO:tasks.workunit.client.0.smithi047.stdout:8/834: link d3/dbd/fdc d3/d66/f11a 0 2024-02-07T12:26:07.383 INFO:tasks.workunit.client.0.smithi047.stdout:6/823: rename d3/d5/d35/d3c/dd4/cde to d3/da/d34/d6d/d9f/c10f 0 2024-02-07T12:26:07.383 INFO:tasks.workunit.client.0.smithi047.stdout:6/824: stat d3/da/d34/d6d/d9f/la5 0 2024-02-07T12:26:07.383 INFO:tasks.workunit.client.0.smithi047.stdout:0/733: dread d19/d1c/d2b/d5f/f80 [0,4194304] 0 2024-02-07T12:26:07.384 INFO:tasks.workunit.client.0.smithi047.stdout:6/825: link d3/d5/d35/d3c/d72/d8c/d95/lc2 d3/d5/d35/d3c/d72/l110 0 2024-02-07T12:26:07.385 INFO:tasks.workunit.client.0.smithi047.stdout:6/826: write d3/d5/d35/d3c/d72/fce [418792,13382] 0 2024-02-07T12:26:07.388 INFO:tasks.workunit.client.0.smithi047.stdout:3/910: write d12/f76 [2640790,20497] 0 2024-02-07T12:26:07.389 INFO:tasks.workunit.client.0.smithi047.stdout:3/911: getdents d12/d19/d2d/d33/da5 0 2024-02-07T12:26:07.391 INFO:tasks.workunit.client.0.smithi047.stdout:8/835: read d3/d36/d50/d30/d9e/da6/f57 [2802967,7788] 0 2024-02-07T12:26:07.392 INFO:tasks.workunit.client.0.smithi047.stdout:2/920: dwrite d7/dc/d4c/da0/ffe [0,4194304] 0 2024-02-07T12:26:07.392 INFO:tasks.workunit.client.0.smithi047.stdout:2/921: stat d7/d48/cb1 0 2024-02-07T12:26:07.392 INFO:tasks.workunit.client.0.smithi047.stdout:2/922: write d7/dc/f59 [236617,71295] 0 2024-02-07T12:26:07.393 INFO:tasks.workunit.client.0.smithi047.stdout:9/651: dwrite d3/f1d [8388608,4194304] 0 2024-02-07T12:26:07.393 INFO:tasks.workunit.client.0.smithi047.stdout:9/652: write d3/d10/d18/d6e/fbc [182301,29561] 0 2024-02-07T12:26:07.393 INFO:tasks.workunit.client.0.smithi047.stdout:9/653: readlink d3/d10/l73 0 2024-02-07T12:26:07.393 INFO:tasks.workunit.client.0.smithi047.stdout:9/654: chown d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/l6d 45180079 1 2024-02-07T12:26:07.395 INFO:tasks.workunit.client.0.smithi047.stdout:8/836: link d3/d36/d50/d2a/l2c d3/d36/d9d/dbe/df5/df9/l11b 0 2024-02-07T12:26:07.395 INFO:tasks.workunit.client.0.smithi047.stdout:8/837: write d3/d36/f4b [214810,39933] 0 2024-02-07T12:26:07.398 INFO:tasks.workunit.client.0.smithi047.stdout:6/827: dread d3/da/f83 [4194304,4194304] 0 2024-02-07T12:26:07.398 INFO:tasks.workunit.client.0.smithi047.stdout:6/828: creat d3/da/d34/d6d/f111 x:0 0 0 2024-02-07T12:26:07.398 INFO:tasks.workunit.client.0.smithi047.stdout:6/829: chown d3/d5/d35/d3c/dd4/cad 464507086 1 2024-02-07T12:26:07.399 INFO:tasks.workunit.client.0.smithi047.stdout:6/830: read - d3/da/d3b/d87/dc1/f10b zero size 2024-02-07T12:26:07.399 INFO:tasks.workunit.client.0.smithi047.stdout:8/838: dread d3/d4/d59/f106 [0,4194304] 0 2024-02-07T12:26:07.402 INFO:tasks.workunit.client.0.smithi047.stdout:9/655: mkdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/dea 0 2024-02-07T12:26:07.407 INFO:tasks.workunit.client.0.smithi047.stdout:9/656: dread d3/d10/f67 [0,4194304] 0 2024-02-07T12:26:07.408 INFO:tasks.workunit.client.0.smithi047.stdout:9/657: chown d3/d10/d18/d3b/d3c/d47/cae 8157 1 2024-02-07T12:26:07.412 INFO:tasks.workunit.client.0.smithi047.stdout:0/734: rename d19/d40/d66/d81 to d19/d1c/df1 0 2024-02-07T12:26:07.416 INFO:tasks.workunit.client.0.smithi047.stdout:9/658: mknod d3/d10/d18/d6e/ceb 0 2024-02-07T12:26:07.416 INFO:tasks.workunit.client.0.smithi047.stdout:9/659: write d3/d10/d18/d3b/d3c/d5d/fd4 [1210202,100944] 0 2024-02-07T12:26:07.417 INFO:tasks.workunit.client.0.smithi047.stdout:8/839: write d3/d36/d50/d30/f5e [3499098,110438] 0 2024-02-07T12:26:07.422 INFO:tasks.workunit.client.0.smithi047.stdout:2/923: rename d7/dc/f76 to d7/d48/f127 0 2024-02-07T12:26:07.425 INFO:tasks.workunit.client.0.smithi047.stdout:8/840: link d3/d36/d50/d28/d100/c119 d3/d36/d50/d30/d9e/da6/c11c 0 2024-02-07T12:26:07.425 INFO:tasks.workunit.client.0.smithi047.stdout:3/912: write d12/d19/d2d/d33/d8d/fb5 [921464,77409] 0 2024-02-07T12:26:07.427 INFO:tasks.workunit.client.0.smithi047.stdout:6/831: rename d3/da/d34/d6d/d8f/db3/dbc/dd7 to d3/da/d34/d6d/d8f/db3/dbc/d112 0 2024-02-07T12:26:07.427 INFO:tasks.workunit.client.0.smithi047.stdout:6/832: truncate d3/d5/d35/d3c/d72/d8c/d95/fdc 585663 0 2024-02-07T12:26:07.429 INFO:tasks.workunit.client.0.smithi047.stdout:2/924: creat d7/dc/d4c/d65/f128 x:0 0 0 2024-02-07T12:26:07.431 INFO:tasks.workunit.client.0.smithi047.stdout:6/833: dread d3/da/d2c/fdb [0,4194304] 0 2024-02-07T12:26:07.431 INFO:tasks.workunit.client.0.smithi047.stdout:6/834: creat d3/da/d14/d28/d46/f113 x:0 0 0 2024-02-07T12:26:07.434 INFO:tasks.workunit.client.0.smithi047.stdout:0/735: rename d19/d1c/d3c/d60/ca6 to d19/d1c/d3c/d48/cf2 0 2024-02-07T12:26:07.434 INFO:tasks.workunit.client.0.smithi047.stdout:9/660: dwrite d3/d10/d18/d3d/f83 [0,4194304] 0 2024-02-07T12:26:07.434 INFO:tasks.workunit.client.0.smithi047.stdout:9/661: stat d3/d10/d18/d3b/d3c/d47 0 2024-02-07T12:26:07.438 INFO:tasks.workunit.client.0.smithi047.stdout:8/841: symlink d3/d36/d9d/dbe/df5/df9/dcd/l11d 0 2024-02-07T12:26:07.447 INFO:tasks.workunit.client.0.smithi047.stdout:6/835: symlink d3/da/d34/d6d/d8f/db3/dbc/l114 0 2024-02-07T12:26:07.447 INFO:tasks.workunit.client.0.smithi047.stdout:6/836: read - d3/da/d34/d6d/fff zero size 2024-02-07T12:26:07.447 INFO:tasks.workunit.client.0.smithi047.stdout:6/837: truncate d3/da/d2c/fdb 684634 0 2024-02-07T12:26:07.449 INFO:tasks.workunit.client.0.smithi047.stdout:2/925: dwrite d7/dc/d4c/f50 [0,4194304] 0 2024-02-07T12:26:07.450 INFO:tasks.workunit.client.0.smithi047.stdout:0/736: rename d19/d1c/d3c/d48/fe1 to d19/d1c/df1/dbd/ff3 0 2024-02-07T12:26:07.457 INFO:tasks.workunit.client.0.smithi047.stdout:9/662: creat d3/d10/d18/d3d/d79/fec x:0 0 0 2024-02-07T12:26:07.457 INFO:tasks.workunit.client.0.smithi047.stdout:9/663: readlink d3/l5 0 2024-02-07T12:26:07.457 INFO:tasks.workunit.client.0.smithi047.stdout:0/737: write d19/d40/f53 [4066364,8860] 0 2024-02-07T12:26:07.457 INFO:tasks.workunit.client.0.smithi047.stdout:0/738: chown d19/d1c/d3c/d60 6342579 1 2024-02-07T12:26:07.459 INFO:tasks.workunit.client.0.smithi047.stdout:3/913: rmdir d12/dc7/d29/d6f/d93/dac/d115 39 2024-02-07T12:26:07.459 INFO:tasks.workunit.client.0.smithi047.stdout:3/914: truncate d12/dc7/d29/d31/d38/d59/de6/f72 5010316 0 2024-02-07T12:26:07.460 INFO:tasks.workunit.client.0.smithi047.stdout:2/926: dread d7/dc/f59 [0,4194304] 0 2024-02-07T12:26:07.460 INFO:tasks.workunit.client.0.smithi047.stdout:2/927: read - d7/d48/df0/ff8 zero size 2024-02-07T12:26:07.460 INFO:tasks.workunit.client.0.smithi047.stdout:8/842: dwrite d3/d66/dac/f113 [0,4194304] 0 2024-02-07T12:26:07.461 INFO:tasks.workunit.client.0.smithi047.stdout:6/838: creat d3/d5/d35/d3c/d72/d8c/f115 x:0 0 0 2024-02-07T12:26:07.465 INFO:tasks.workunit.client.0.smithi047.stdout:3/915: truncate d12/dc7/f2c 3874550 0 2024-02-07T12:26:07.469 INFO:tasks.workunit.client.0.smithi047.stdout:2/928: write d7/d2d/f63 [1422209,73675] 0 2024-02-07T12:26:07.469 INFO:tasks.workunit.client.0.smithi047.stdout:2/929: dread - d7/dc/d71/dde/ff1 zero size 2024-02-07T12:26:07.469 INFO:tasks.workunit.client.0.smithi047.stdout:2/930: truncate d7/d48/df0/ff8 850053 0 2024-02-07T12:26:07.470 INFO:tasks.workunit.client.0.smithi047.stdout:3/916: dread d12/dc7/d29/d6f/d93/dba/dbf/f80 [0,4194304] 0 2024-02-07T12:26:07.475 INFO:tasks.workunit.client.0.smithi047.stdout:8/843: mkdir d3/d36/d50/d30/d11e 0 2024-02-07T12:26:07.478 INFO:tasks.workunit.client.0.smithi047.stdout:0/739: dwrite d19/d1c/d3c/d60/f72 [0,4194304] 0 2024-02-07T12:26:07.478 INFO:tasks.workunit.client.0.smithi047.stdout:0/740: chown d19/d40/d66/d46/l5d 244736 1 2024-02-07T12:26:07.479 INFO:tasks.workunit.client.0.smithi047.stdout:6/839: symlink d3/d5/l116 0 2024-02-07T12:26:07.481 INFO:tasks.workunit.client.0.smithi047.stdout:2/931: rename d7/d48/fa3 to d7/d48/f129 0 2024-02-07T12:26:07.481 INFO:tasks.workunit.client.0.smithi047.stdout:3/917: symlink d12/d19/l12a 0 2024-02-07T12:26:07.484 INFO:tasks.workunit.client.0.smithi047.stdout:0/741: mkdir d19/d1c/df1/d82/d9e/df4 0 2024-02-07T12:26:07.487 INFO:tasks.workunit.client.0.smithi047.stdout:3/918: mknod d12/c12b 0 2024-02-07T12:26:07.490 INFO:tasks.workunit.client.0.smithi047.stdout:9/664: dwrite d3/d10/d18/d3b/f69 [8388608,4194304] 0 2024-02-07T12:26:07.490 INFO:tasks.workunit.client.0.smithi047.stdout:0/742: truncate d19/f27 1783366 0 2024-02-07T12:26:07.490 INFO:tasks.workunit.client.0.smithi047.stdout:8/844: fdatasync d3/d36/d50/d30/f5e 0 2024-02-07T12:26:07.490 INFO:tasks.workunit.client.0.smithi047.stdout:8/845: write d3/d36/d50/d30/d9e/da6/fc8 [344175,127494] 0 2024-02-07T12:26:07.494 INFO:tasks.workunit.client.0.smithi047.stdout:3/919: mknod d12/d19/d2d/d42/c12c 0 2024-02-07T12:26:07.500 INFO:tasks.workunit.client.0.smithi047.stdout:0/743: dread d19/d1c/d3c/d60/d6f/d95/daa/d8c/f91 [0,4194304] 0 2024-02-07T12:26:07.500 INFO:tasks.workunit.client.0.smithi047.stdout:3/920: getdents d12/d19/d2d/d42/d6b 0 2024-02-07T12:26:07.500 INFO:tasks.workunit.client.0.smithi047.stdout:3/921: fdatasync d12/dc7/d29/fa4 0 2024-02-07T12:26:07.500 INFO:tasks.workunit.client.0.smithi047.stdout:3/922: creat d12/dc7/d90/f12d x:0 0 0 2024-02-07T12:26:07.503 INFO:tasks.workunit.client.0.smithi047.stdout:8/846: dread d3/d4/fbb [0,4194304] 0 2024-02-07T12:26:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.515+0000 7f9534f06700 1 -- 172.21.15.47:0/3353507971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9530064ec0 msgr2=0x7f95300fb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.515+0000 7f9534f06700 1 --2- 172.21.15.47:0/3353507971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9530064ec0 0x7f95300fb550 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9520004940 tx=0x7f9520009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.515+0000 7f9534f06700 1 -- 172.21.15.47:0/3353507971 shutdown_connections 2024-02-07T12:26:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.515+0000 7f9534f06700 1 --2- 172.21.15.47:0/3353507971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95300fba90 0x7f95300fc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.515+0000 7f9534f06700 1 --2- 172.21.15.47:0/3353507971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9530064ec0 0x7f95300fb550 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.515+0000 7f9534f06700 1 -- 172.21.15.47:0/3353507971 >> 172.21.15.47:0/3353507971 conn(0x7f95300f6ca0 msgr2=0x7f95300f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.515+0000 7f9534f06700 1 -- 172.21.15.47:0/3353507971 shutdown_connections 2024-02-07T12:26:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.516+0000 7f9534f06700 1 -- 172.21.15.47:0/3353507971 wait complete. 2024-02-07T12:26:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.516+0000 7f9534f06700 1 Processor -- start 2024-02-07T12:26:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.517+0000 7f9534f06700 1 -- start start 2024-02-07T12:26:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.517+0000 7f9534f06700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9530064ec0 0x7f95301107a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.517+0000 7f9534f06700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95300fba90 0x7f9530112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.517+0000 7f9534f06700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95300fe8a0 con 0x7f95300fba90 2024-02-07T12:26:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.517+0000 7f9534f06700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95300fe9e0 con 0x7f9530064ec0 2024-02-07T12:26:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.517+0000 7f952dd9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95300fba90 0x7f9530112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.517+0000 7f952dd9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95300fba90 0x7f9530112cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42126/0 (socket says 172.21.15.47:42126) 2024-02-07T12:26:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.517+0000 7f952dd9b700 1 -- 172.21.15.47:0/3434703816 learned_addr learned my addr 172.21.15.47:0/3434703816 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.518+0000 7f952dd9b700 1 -- 172.21.15.47:0/3434703816 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9530064ec0 msgr2=0x7f95301107a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-07T12:26:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.518+0000 7f952dd9b700 1 --2- 172.21.15.47:0/3434703816 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9530064ec0 0x7f95301107a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.518+0000 7f952dd9b700 1 -- 172.21.15.47:0/3434703816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9520005040 con 0x7f95300fba90 2024-02-07T12:26:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.518+0000 7f952dd9b700 1 --2- 172.21.15.47:0/3434703816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95300fba90 0x7f9530112cf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f952400b580 tx=0x7f95240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.518+0000 7f951effd700 1 -- 172.21.15.47:0/3434703816 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f952400f6f0 con 0x7f95300fba90 2024-02-07T12:26:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.518+0000 7f951effd700 1 -- 172.21.15.47:0/3434703816 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f952400fd20 con 0x7f95300fba90 2024-02-07T12:26:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.518+0000 7f951effd700 1 -- 172.21.15.47:0/3434703816 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9524011ea0 con 0x7f95300fba90 2024-02-07T12:26:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.518+0000 7f9534f06700 1 -- 172.21.15.47:0/3434703816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95301133d0 con 0x7f95300fba90 2024-02-07T12:26:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.518+0000 7f9534f06700 1 -- 172.21.15.47:0/3434703816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95301138c0 con 0x7f95300fba90 2024-02-07T12:26:07.522 INFO:tasks.workunit.client.0.smithi047.stdout:6/840: dwrite d3/da/d3b/df6/fc0 [0,4194304] 0 2024-02-07T12:26:07.523 INFO:tasks.workunit.client.0.smithi047.stdout:6/841: write d3/d5/d35/d3c/dd4/fc8 [5109188,52646] 0 2024-02-07T12:26:07.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.520+0000 7f9534f06700 1 -- 172.21.15.47:0/3434703816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953004bed0 con 0x7f95300fba90 2024-02-07T12:26:07.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.521+0000 7f951effd700 1 -- 172.21.15.47:0/3434703816 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7f952400f850 con 0x7f95300fba90 2024-02-07T12:26:07.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.522+0000 7f951effd700 1 --2- 172.21.15.47:0/3434703816 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f951806b140 0x7f951806d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:07.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.522+0000 7f951effd700 1 -- 172.21.15.47:0/3434703816 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f95240897e0 con 0x7f95300fba90 2024-02-07T12:26:07.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.522+0000 7f952e59c700 1 --2- 172.21.15.47:0/3434703816 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f951806b140 0x7f951806d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:07.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.523+0000 7f952e59c700 1 --2- 172.21.15.47:0/3434703816 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f951806b140 0x7f951806d5f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9520009fd0 tx=0x7f9520009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:07.529 INFO:tasks.workunit.client.0.smithi047.stdout:2/932: dwrite d7/d2d/d7c/f7f [0,4194304] 0 2024-02-07T12:26:07.530 INFO:tasks.workunit.client.0.smithi047.stdout:2/933: mkdir d7/d48/d72/db7/d12a 0 2024-02-07T12:26:07.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:07.529+0000 7f951effd700 1 -- 172.21.15.47:0/3434703816 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f9524053900 con 0x7f95300fba90 2024-02-07T12:26:07.532 INFO:tasks.workunit.client.0.smithi047.stdout:2/934: creat d7/dc/d51/ded/f12b x:0 0 0 2024-02-07T12:26:07.535 INFO:tasks.workunit.client.0.smithi047.stdout:2/935: read d7/dc/d71/fcd [806362,93295] 0 2024-02-07T12:26:07.536 INFO:tasks.workunit.client.0.smithi047.stdout:2/936: symlink d7/dc/d8a/l12c 0 2024-02-07T12:26:07.536 INFO:tasks.workunit.client.0.smithi047.stdout:2/937: rmdir d7/d2d 39 2024-02-07T12:26:07.552 INFO:tasks.workunit.client.0.smithi047.stdout:9/665: dwrite d3/d10/d18/d3d/f37 [0,4194304] 0 2024-02-07T12:26:07.573 INFO:tasks.workunit.client.0.smithi047.stdout:0/744: dwrite d19/d40/d66/da9/faf [0,4194304] 0 2024-02-07T12:26:07.573 INFO:tasks.workunit.client.0.smithi047.stdout:3/923: dwrite d12/d19/d2d/d42/ff5 [0,4194304] 0 2024-02-07T12:26:07.574 INFO:tasks.workunit.client.0.smithi047.stdout:8/847: dwrite d3/d4/d4d/dc0/ff8 [0,4194304] 0 2024-02-07T12:26:07.578 INFO:tasks.workunit.client.0.smithi047.stdout:8/848: rmdir d3/d4/d59 39 2024-02-07T12:26:07.578 INFO:tasks.workunit.client.0.smithi047.stdout:0/745: dread d19/d40/d66/fa2 [4194304,4194304] 0 2024-02-07T12:26:07.579 INFO:tasks.workunit.client.0.smithi047.stdout:6/842: dwrite d3/d5/d35/d3c/dd4/f67 [0,4194304] 0 2024-02-07T12:26:07.581 INFO:tasks.workunit.client.0.smithi047.stdout:0/746: creat d19/d40/d66/d46/dc6/ff5 x:0 0 0 2024-02-07T12:26:07.581 INFO:tasks.workunit.client.0.smithi047.stdout:0/747: creat d19/d40/d66/d46/ff6 x:0 0 0 2024-02-07T12:26:07.581 INFO:tasks.workunit.client.0.smithi047.stdout:0/748: creat d19/d40/d66/d46/ff7 x:0 0 0 2024-02-07T12:26:07.582 INFO:tasks.workunit.client.0.smithi047.stdout:9/666: dwrite d3/d10/d18/d3d/d79/dcd/fde [0,4194304] 0 2024-02-07T12:26:07.583 INFO:tasks.workunit.client.0.smithi047.stdout:6/843: link d3/da/d3b/ffb d3/da/d34/d6d/f117 0 2024-02-07T12:26:07.589 INFO:tasks.workunit.client.0.smithi047.stdout:9/667: rename d3/d10/d18/d3b/d3c/d5d/d70/f80 to d3/d10/d18/d3a/da7/fed 0 2024-02-07T12:26:07.593 INFO:tasks.workunit.client.0.smithi047.stdout:8/849: dread d3/d36/d9d/dbe/fd1 [0,4194304] 0 2024-02-07T12:26:07.593 INFO:tasks.workunit.client.0.smithi047.stdout:2/938: dwrite d7/dc/f84 [0,4194304] 0 2024-02-07T12:26:07.594 INFO:tasks.workunit.client.0.smithi047.stdout:2/939: write d7/d48/f56 [1462525,29255] 0 2024-02-07T12:26:07.594 INFO:tasks.workunit.client.0.smithi047.stdout:2/940: fdatasync d7/dc/d51/ded/fd9 0 2024-02-07T12:26:07.596 INFO:tasks.workunit.client.0.smithi047.stdout:8/850: symlink d3/d99/l11f 0 2024-02-07T12:26:07.596 INFO:tasks.workunit.client.0.smithi047.stdout:2/941: symlink d7/dc/df2/l12d 0 2024-02-07T12:26:07.597 INFO:tasks.workunit.client.0.smithi047.stdout:0/749: dread d19/d1c/d2b/d5f/f6b [0,4194304] 0 2024-02-07T12:26:07.597 INFO:tasks.workunit.client.0.smithi047.stdout:6/844: dread d3/d5/fb0 [0,4194304] 0 2024-02-07T12:26:07.599 INFO:tasks.workunit.client.0.smithi047.stdout:3/924: dwrite d12/f25 [0,4194304] 0 2024-02-07T12:26:07.601 INFO:tasks.workunit.client.0.smithi047.stdout:0/750: getdents d19/d1c/df1/d82 0 2024-02-07T12:26:07.601 INFO:tasks.workunit.client.0.smithi047.stdout:0/751: stat d19/d1c/d2b/d5f/d9f/dd3 0 2024-02-07T12:26:07.604 INFO:tasks.workunit.client.0.smithi047.stdout:6/845: creat d3/f118 x:0 0 0 2024-02-07T12:26:07.604 INFO:tasks.workunit.client.0.smithi047.stdout:3/925: mkdir d12/d19/d2d/d42/d6b/d12e 0 2024-02-07T12:26:07.604 INFO:tasks.workunit.client.0.smithi047.stdout:2/942: write d7/f30 [603714,42700] 0 2024-02-07T12:26:07.614 INFO:tasks.workunit.client.0.smithi047.stdout:3/926: rmdir d12/dc7/d29/d6f/d93/dba 39 2024-02-07T12:26:07.615 INFO:tasks.workunit.client.0.smithi047.stdout:3/927: mkdir d12/dc7/d29/d31/d7c/d12f 0 2024-02-07T12:26:07.619 INFO:tasks.workunit.client.0.smithi047.stdout:3/928: rmdir d12/d19/d2d/d33/d8d/d11b 0 2024-02-07T12:26:07.620 INFO:tasks.workunit.client.0.smithi047.stdout:3/929: creat d12/dc7/d29/d31/d38/d59/de6/f130 x:0 0 0 2024-02-07T12:26:07.622 INFO:tasks.workunit.client.0.smithi047.stdout:3/930: rmdir d12/dc7/d29/d44 39 2024-02-07T12:26:07.626 INFO:tasks.workunit.client.0.smithi047.stdout:3/931: creat d12/dc7/d29/f131 x:0 0 0 2024-02-07T12:26:07.627 INFO:tasks.workunit.client.0.smithi047.stdout:3/932: readlink d12/dc7/d29/d31/d38/d59/d87/dc5/ldb 0 2024-02-07T12:26:07.627 INFO:tasks.workunit.client.0.smithi047.stdout:3/933: fsync d12/dc7/d90/f12d 0 2024-02-07T12:26:07.628 INFO:tasks.workunit.client.0.smithi047.stdout:9/668: dwrite d3/fdd [0,4194304] 0 2024-02-07T12:26:07.629 INFO:tasks.workunit.client.0.smithi047.stdout:3/934: getdents d12/dc7 0 2024-02-07T12:26:07.630 INFO:tasks.workunit.client.0.smithi047.stdout:0/752: dwrite d19/d1c/d2b/fc8 [0,4194304] 0 2024-02-07T12:26:07.639 INFO:tasks.workunit.client.0.smithi047.stdout:9/669: dread d3/d10/d11/f42 [0,4194304] 0 2024-02-07T12:26:07.639 INFO:tasks.workunit.client.0.smithi047.stdout:9/670: stat d3/d10/d11/c2a 0 2024-02-07T12:26:07.639 INFO:tasks.workunit.client.0.smithi047.stdout:9/671: write d3/d10/d18/d3b/f69 [13608576,118753] 0 2024-02-07T12:26:07.639 INFO:tasks.workunit.client.0.smithi047.stdout:9/672: creat d3/d10/d18/fee x:0 0 0 2024-02-07T12:26:07.647 INFO:tasks.workunit.client.0.smithi047.stdout:9/673: write d3/d10/d18/d3d/f37 [1443592,11384] 0 2024-02-07T12:26:07.648 INFO:tasks.workunit.client.0.smithi047.stdout:2/943: dwrite d7/dc/d4c/d65/f10c [0,4194304] 0 2024-02-07T12:26:07.648 INFO:tasks.workunit.client.0.smithi047.stdout:2/944: creat d7/dc/d51/ded/f12e x:0 0 0 2024-02-07T12:26:07.654 INFO:tasks.workunit.client.0.smithi047.stdout:2/945: creat d7/d2d/f12f x:0 0 0 2024-02-07T12:26:07.655 INFO:tasks.workunit.client.0.smithi047.stdout:2/946: symlink d7/d2d/d5c/d77/d92/l130 0 2024-02-07T12:26:07.656 INFO:tasks.workunit.client.0.smithi047.stdout:2/947: symlink d7/d48/l131 0 2024-02-07T12:26:07.658 INFO:tasks.workunit.client.0.smithi047.stdout:2/948: read d7/d2d/f6d [412780,25700] 0 2024-02-07T12:26:07.658 INFO:tasks.workunit.client.0.smithi047.stdout:2/949: fdatasync d7/dc/d4c/da0/fdd 0 2024-02-07T12:26:07.671 INFO:tasks.workunit.client.0.smithi047.stdout:6/846: dwrite d3/da/f49 [0,4194304] 0 2024-02-07T12:26:07.671 INFO:tasks.workunit.client.0.smithi047.stdout:6/847: dread - d3/da/d34/d6d/f117 zero size 2024-02-07T12:26:07.673 INFO:tasks.workunit.client.0.smithi047.stdout:6/848: symlink d3/da/d2c/d42/l119 0 2024-02-07T12:26:07.674 INFO:tasks.workunit.client.0.smithi047.stdout:3/935: dwrite d12/dc7/fe7 [0,4194304] 0 2024-02-07T12:26:07.674 INFO:tasks.workunit.client.0.smithi047.stdout:9/674: dwrite d3/d10/d18/d3b/f50 [0,4194304] 0 2024-02-07T12:26:07.674 INFO:tasks.workunit.client.0.smithi047.stdout:3/936: write d12/dc7/d29/d31/d38/d59/de6/d95/fce [145071,76556] 0 2024-02-07T12:26:07.674 INFO:tasks.workunit.client.0.smithi047.stdout:0/753: dwrite d19/f6d [4194304,4194304] 0 2024-02-07T12:26:07.676 INFO:tasks.workunit.client.0.smithi047.stdout:8/851: dwrite d3/d4/d4d/fb8 [0,4194304] 0 2024-02-07T12:26:07.676 INFO:tasks.workunit.client.0.smithi047.stdout:8/852: fdatasync d3/d66/f11a 0 2024-02-07T12:26:07.682 INFO:tasks.workunit.client.0.smithi047.stdout:3/937: truncate d12/d19/f8f 1129740 0 2024-02-07T12:26:07.687 INFO:tasks.workunit.client.0.smithi047.stdout:3/938: mkdir d12/d19/d2d/d132 0 2024-02-07T12:26:07.687 INFO:tasks.workunit.client.0.smithi047.stdout:3/939: write d12/d19/d37/f68 [2965814,19319] 0 2024-02-07T12:26:07.688 INFO:tasks.workunit.client.0.smithi047.stdout:3/940: readlink d12/dc7/d29/d31/d38/d59/d87/dc5/ldb 0 2024-02-07T12:26:07.691 INFO:tasks.workunit.client.0.smithi047.stdout:2/950: dwrite d7/fb [0,4194304] 0 2024-02-07T12:26:07.691 INFO:tasks.workunit.client.0.smithi047.stdout:9/675: dread d3/d10/d18/d3b/d3c/d5d/fd4 [0,4194304] 0 2024-02-07T12:26:07.691 INFO:tasks.workunit.client.0.smithi047.stdout:9/676: stat d3/d10/d18/d3b/d3c/d5d/d70/dad 0 2024-02-07T12:26:07.691 INFO:tasks.workunit.client.0.smithi047.stdout:2/951: dread - d7/d2d/d5c/fa6 zero size 2024-02-07T12:26:07.691 INFO:tasks.workunit.client.0.smithi047.stdout:9/677: creat d3/d10/d18/d3d/d79/fef x:0 0 0 2024-02-07T12:26:07.701 INFO:tasks.workunit.client.0.smithi047.stdout:3/941: mkdir d12/dc7/d29/d31/d7c/d133 0 2024-02-07T12:26:07.702 INFO:tasks.workunit.client.0.smithi047.stdout:2/952: write d7/f2e [3822760,8861] 0 2024-02-07T12:26:07.708 INFO:tasks.workunit.client.0.smithi047.stdout:6/849: dwrite d3/da/d3b/f85 [0,4194304] 0 2024-02-07T12:26:07.708 INFO:tasks.workunit.client.0.smithi047.stdout:8/853: dwrite d3/d36/d50/f2d [0,4194304] 0 2024-02-07T12:26:07.715 INFO:tasks.workunit.client.0.smithi047.stdout:2/953: symlink d7/d2d/d5c/l132 0 2024-02-07T12:26:07.717 INFO:tasks.workunit.client.0.smithi047.stdout:8/854: dread d3/d36/d50/d30/f90 [0,4194304] 0 2024-02-07T12:26:07.717 INFO:tasks.workunit.client.0.smithi047.stdout:8/855: truncate d3/d36/d50/d30/d34/f3d 4931707 0 2024-02-07T12:26:07.717 INFO:tasks.workunit.client.0.smithi047.stdout:9/678: getdents d3/d10/d18/d6e/d9a/daf 0 2024-02-07T12:26:07.718 INFO:tasks.workunit.client.0.smithi047.stdout:9/679: stat d3/d10/d18/d3a/f94 0 2024-02-07T12:26:07.725 INFO:tasks.workunit.client.0.smithi047.stdout:6/850: dwrite d3/d5/d35/f3d [0,4194304] 0 2024-02-07T12:26:07.725 INFO:tasks.workunit.client.0.smithi047.stdout:6/851: truncate d3/da/d14/d28/ffa 1014141 0 2024-02-07T12:26:07.726 INFO:tasks.workunit.client.0.smithi047.stdout:2/954: creat d7/d48/d72/dbf/f133 x:0 0 0 2024-02-07T12:26:07.728 INFO:tasks.workunit.client.0.smithi047.stdout:2/955: creat d7/dc/dd6/f134 x:0 0 0 2024-02-07T12:26:07.728 INFO:tasks.workunit.client.0.smithi047.stdout:8/856: write d3/d36/f3b [3293273,107850] 0 2024-02-07T12:26:07.731 INFO:tasks.workunit.client.0.smithi047.stdout:2/956: creat d7/d48/d72/db7/d12a/f135 x:0 0 0 2024-02-07T12:26:07.731 INFO:tasks.workunit.client.0.smithi047.stdout:2/957: fdatasync d7/dc/d8a/fd8 0 2024-02-07T12:26:07.731 INFO:tasks.workunit.client.0.smithi047.stdout:2/958: stat d7/dc/d4c/da0/ffe 0 2024-02-07T12:26:07.731 INFO:tasks.workunit.client.0.smithi047.stdout:2/959: creat d7/dc/d51/dda/d113/f136 x:0 0 0 2024-02-07T12:26:07.743 INFO:tasks.workunit.client.0.smithi047.stdout:6/852: dread d3/da/d14/f36 [0,4194304] 0 2024-02-07T12:26:07.745 INFO:tasks.workunit.client.0.smithi047.stdout:6/853: creat d3/da/d34/d6d/d8f/d100/f11a x:0 0 0 2024-02-07T12:26:07.745 INFO:tasks.workunit.client.0.smithi047.stdout:6/854: dread - d3/f118 zero size 2024-02-07T12:26:07.746 INFO:tasks.workunit.client.0.smithi047.stdout:6/855: creat d3/d5/f11b x:0 0 0 2024-02-07T12:26:07.747 INFO:tasks.workunit.client.0.smithi047.stdout:6/856: mkdir d3/d5/d11c 0 2024-02-07T12:26:07.747 INFO:tasks.workunit.client.0.smithi047.stdout:6/857: dread - d3/da/f10d zero size 2024-02-07T12:26:07.749 INFO:tasks.workunit.client.0.smithi047.stdout:6/858: creat d3/d5/d35/f11d x:0 0 0 2024-02-07T12:26:07.750 INFO:tasks.workunit.client.0.smithi047.stdout:6/859: mknod d3/da/d34/d6d/c11e 0 2024-02-07T12:26:07.750 INFO:tasks.workunit.client.0.smithi047.stdout:6/860: creat d3/d5/d35/d3c/d90/f11f x:0 0 0 2024-02-07T12:26:07.750 INFO:tasks.workunit.client.0.smithi047.stdout:6/861: fsync d3/f118 0 2024-02-07T12:26:07.751 INFO:tasks.workunit.client.0.smithi047.stdout:6/862: creat d3/da/d14/d28/d9a/f120 x:0 0 0 2024-02-07T12:26:07.751 INFO:tasks.workunit.client.0.smithi047.stdout:6/863: dread - d3/da/d34/d6d/f111 zero size 2024-02-07T12:26:07.751 INFO:tasks.workunit.client.0.smithi047.stdout:6/864: creat d3/da/d14/d28/d46/d94/f121 x:0 0 0 2024-02-07T12:26:07.754 INFO:tasks.workunit.client.0.smithi047.stdout:6/865: getdents d3/da/d34/d6d/d8f/db3/dbc 0 2024-02-07T12:26:07.754 INFO:tasks.workunit.client.0.smithi047.stdout:6/866: chown d3/d5/d35/d3c/d72/d8c/d95/c64 43338125 1 2024-02-07T12:26:07.755 INFO:tasks.workunit.client.0.smithi047.stdout:6/867: chown d3/d5/c16 2 1 2024-02-07T12:26:07.755 INFO:tasks.workunit.client.0.smithi047.stdout:9/680: dwrite d3/f40 [0,4194304] 0 2024-02-07T12:26:07.755 INFO:tasks.workunit.client.0.smithi047.stdout:9/681: write d3/d10/d18/d3a/da7/fac [4244405,104980] 0 2024-02-07T12:26:07.755 INFO:tasks.workunit.client.0.smithi047.stdout:3/942: dwrite d12/dc7/d29/d31/d38/fbb [0,4194304] 0 2024-02-07T12:26:07.757 INFO:tasks.workunit.client.0.smithi047.stdout:8/857: dwrite d3/d36/f7e [0,4194304] 0 2024-02-07T12:26:07.757 INFO:tasks.workunit.client.0.smithi047.stdout:8/858: fdatasync d3/d4/f7f 0 2024-02-07T12:26:07.757 INFO:tasks.workunit.client.0.smithi047.stdout:6/868: creat d3/da/d34/d6d/d9f/f122 x:0 0 0 2024-02-07T12:26:07.757 INFO:tasks.workunit.client.0.smithi047.stdout:6/869: write d3/d5/d35/f54 [187066,8346] 0 2024-02-07T12:26:07.758 INFO:tasks.workunit.client.0.smithi047.stdout:8/859: write d3/d4/d59/fed [468712,99580] 0 2024-02-07T12:26:07.760 INFO:tasks.workunit.client.0.smithi047.stdout:9/682: getdents d3/d10/d18/d3b/d3c 0 2024-02-07T12:26:07.769 INFO:tasks.workunit.client.0.smithi047.stdout:3/943: dwrite d12/d19/fde [0,4194304] 0 2024-02-07T12:26:07.770 INFO:tasks.workunit.client.0.smithi047.stdout:6/870: rename d3/da/d3b/f7e to d3/da/d34/d6d/d9f/f123 0 2024-02-07T12:26:07.778 INFO:tasks.workunit.client.0.smithi047.stdout:8/860: mknod d3/d36/d50/d2a/c120 0 2024-02-07T12:26:07.778 INFO:tasks.workunit.client.0.smithi047.stdout:8/861: chown d3/d4/f18 403125 1 2024-02-07T12:26:07.780 INFO:tasks.workunit.client.0.smithi047.stdout:6/871: rmdir d3/da/d3b/d87/dc1 39 2024-02-07T12:26:07.784 INFO:tasks.workunit.client.0.smithi047.stdout:9/683: rename d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d82 to d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0 0 2024-02-07T12:26:07.784 INFO:tasks.workunit.client.0.smithi047.stdout:3/944: dwrite d12/dc7/d29/d31/d38/d59/de6/d95/f10a [0,4194304] 0 2024-02-07T12:26:07.786 INFO:tasks.workunit.client.0.smithi047.stdout:6/872: mkdir d3/d5/d35/d3c/d72/d8c/d124 0 2024-02-07T12:26:07.786 INFO:tasks.workunit.client.0.smithi047.stdout:6/873: readlink d3/d5/d35/d3c/d72/d8c/d95/l6a 0 2024-02-07T12:26:07.786 INFO:tasks.workunit.client.0.smithi047.stdout:6/874: fdatasync d3/da/d3b/d87/de4/ff9 0 2024-02-07T12:26:07.786 INFO:tasks.workunit.client.0.smithi047.stdout:8/862: rmdir d3/d66/d67/d71/d93/dd8 39 2024-02-07T12:26:07.788 INFO:tasks.workunit.client.0.smithi047.stdout:9/684: creat d3/d10/d18/d3a/da7/ff1 x:0 0 0 2024-02-07T12:26:07.788 INFO:tasks.workunit.client.0.smithi047.stdout:9/685: fdatasync d3/f1d 0 2024-02-07T12:26:07.790 INFO:tasks.workunit.client.0.smithi047.stdout:6/875: truncate d3/d5/d35/f63 1507001 0 2024-02-07T12:26:07.790 INFO:tasks.workunit.client.0.smithi047.stdout:6/876: truncate d3/da/f10d 969541 0 2024-02-07T12:26:07.790 INFO:tasks.workunit.client.0.smithi047.stdout:6/877: dread - d3/f118 zero size 2024-02-07T12:26:07.791 INFO:tasks.workunit.client.0.smithi047.stdout:9/686: link d3/d10/d18/l7b d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/lf2 0 2024-02-07T12:26:07.793 INFO:tasks.workunit.client.0.smithi047.stdout:9/687: creat d3/d10/d18/d3b/d3c/d5d/d9b/ff3 x:0 0 0 2024-02-07T12:26:07.795 INFO:tasks.workunit.client.0.smithi047.stdout:3/945: read d12/d19/d2d/d33/f7f [223589,31711] 0 2024-02-07T12:26:07.797 INFO:tasks.workunit.client.0.smithi047.stdout:3/946: getdents d12/d19/d37 0 2024-02-07T12:26:07.801 INFO:tasks.workunit.client.0.smithi047.stdout:6/878: dread d3/da/d14/f1c [0,4194304] 0 2024-02-07T12:26:07.805 INFO:tasks.workunit.client.0.smithi047.stdout:3/947: rmdir d12/dc7/d29/d31 39 2024-02-07T12:26:07.805 INFO:tasks.workunit.client.0.smithi047.stdout:3/948: write d12/dc7/d29/d31/d38/d59/de6/f130 [621543,36141] 0 2024-02-07T12:26:07.807 INFO:tasks.workunit.client.0.smithi047.stdout:3/949: rename d12/d19/d2d/d33/d8d/f10c to d12/d19/d2d/d52/f134 0 2024-02-07T12:26:07.808 INFO:tasks.workunit.client.0.smithi047.stdout:3/950: mkdir d12/dc7/d29/d31/d38/d59/de6/d135 0 2024-02-07T12:26:07.809 INFO:tasks.workunit.client.0.smithi047.stdout:3/951: creat d12/d19/d2d/d42/d6b/d12e/f136 x:0 0 0 2024-02-07T12:26:07.823 INFO:tasks.workunit.client.0.smithi047.stdout:3/952: dread d12/dc7/d90/f91 [0,4194304] 0 2024-02-07T12:26:07.823 INFO:tasks.workunit.client.0.smithi047.stdout:3/953: read - d12/dc7/d29/da9/f123 zero size 2024-02-07T12:26:07.823 INFO:tasks.workunit.client.0.smithi047.stdout:3/954: truncate d12/dc7/d29/d31/f32 824842 0 2024-02-07T12:26:07.824 INFO:tasks.workunit.client.0.smithi047.stdout:3/955: mkdir d12/dc7/d29/d137 0 2024-02-07T12:26:07.824 INFO:tasks.workunit.client.0.smithi047.stdout:3/956: read d12/dc7/d29/da9/fc2 [161408,10927] 0 2024-02-07T12:26:07.825 INFO:tasks.workunit.client.0.smithi047.stdout:3/957: write d12/d19/d2d/f8b [1056713,96270] 0 2024-02-07T12:26:07.826 INFO:tasks.workunit.client.0.smithi047.stdout:3/958: mknod d12/dc7/d90/c138 0 2024-02-07T12:26:07.827 INFO:tasks.workunit.client.0.smithi047.stdout:8/863: dwrite d3/d66/f7d [0,4194304] 0 2024-02-07T12:26:07.827 INFO:tasks.workunit.client.0.smithi047.stdout:8/864: chown d3/d36/d50/d30/d9e/da6/fc8 63415 1 2024-02-07T12:26:07.827 INFO:tasks.workunit.client.0.smithi047.stdout:8/865: fsync d3/d4/f55 0 2024-02-07T12:26:07.827 INFO:tasks.workunit.client.0.smithi047.stdout:9/688: dwrite d3/f40 [4194304,4194304] 0 2024-02-07T12:26:07.827 INFO:tasks.workunit.client.0.smithi047.stdout:6/879: dwrite d3/da/d14/d28/df0/f105 [0,4194304] 0 2024-02-07T12:26:07.827 INFO:tasks.workunit.client.0.smithi047.stdout:3/959: symlink d12/dc7/d29/d6f/d93/dba/dbf/l139 0 2024-02-07T12:26:07.828 INFO:tasks.workunit.client.0.smithi047.stdout:8/866: mkdir d3/d99/d121 0 2024-02-07T12:26:07.837 INFO:tasks.workunit.client.0.smithi047.stdout:9/689: mkdir d3/d10/d18/d3b/d3c/d5d/d70/dad/dbf/df4 0 2024-02-07T12:26:07.841 INFO:tasks.workunit.client.0.smithi047.stdout:8/867: dwrite d3/d4/f1e [4194304,4194304] 0 2024-02-07T12:26:07.843 INFO:tasks.workunit.client.0.smithi047.stdout:3/960: rename d12/d19/d2d/d42/f55 to d12/dc7/d29/d137/f13a 0 2024-02-07T12:26:07.845 INFO:tasks.workunit.client.0.smithi047.stdout:9/690: creat d3/d10/d18/d3d/ff5 x:0 0 0 2024-02-07T12:26:07.845 INFO:tasks.workunit.client.0.smithi047.stdout:9/691: fsync d3/d10/d18/d3b/d3c/d5d/d70/d7a/fca 0 2024-02-07T12:26:07.845 INFO:tasks.workunit.client.0.smithi047.stdout:8/868: symlink d3/d4/d87/l122 0 2024-02-07T12:26:07.847 INFO:tasks.workunit.client.0.smithi047.stdout:6/880: getdents d3/da/d14/d28/d46 0 2024-02-07T12:26:07.847 INFO:tasks.workunit.client.0.smithi047.stdout:6/881: chown d3/da/d14/f36 9523 1 2024-02-07T12:26:07.848 INFO:tasks.workunit.client.0.smithi047.stdout:6/882: write d3/da/d3b/d87/f8d [525669,78645] 0 2024-02-07T12:26:07.848 INFO:tasks.workunit.client.0.smithi047.stdout:9/692: write d3/d10/f67 [289149,80960] 0 2024-02-07T12:26:07.848 INFO:tasks.workunit.client.0.smithi047.stdout:9/693: fdatasync d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/f6f 0 2024-02-07T12:26:07.848 INFO:tasks.workunit.client.0.smithi047.stdout:9/694: chown d3/d10/d18/d3b/d3c/c99 622908 1 2024-02-07T12:26:07.848 INFO:tasks.workunit.client.0.smithi047.stdout:3/961: mknod d12/d19/d2d/c13b 0 2024-02-07T12:26:07.849 INFO:tasks.workunit.client.0.smithi047.stdout:8/869: mknod d3/d36/de2/de5/d10c/c123 0 2024-02-07T12:26:07.849 INFO:tasks.workunit.client.0.smithi047.stdout:8/870: chown d3/d4/lf1 89601 1 2024-02-07T12:26:07.850 INFO:tasks.workunit.client.0.smithi047.stdout:6/883: symlink d3/d5/d35/d3c/d72/d8c/l125 0 2024-02-07T12:26:07.853 INFO:tasks.workunit.client.0.smithi047.stdout:3/962: mkdir d12/dc7/d29/d31/d13c 0 2024-02-07T12:26:07.853 INFO:tasks.workunit.client.0.smithi047.stdout:3/963: stat d12/dc7/d29/d31/d7c/df3 0 2024-02-07T12:26:07.853 INFO:tasks.workunit.client.0.smithi047.stdout:9/695: truncate d3/d10/d4c/f8e 1373067 0 2024-02-07T12:26:07.855 INFO:tasks.workunit.client.0.smithi047.stdout:9/696: mknod d3/d10/cf6 0 2024-02-07T12:26:07.858 INFO:tasks.workunit.client.0.smithi047.stdout:8/871: dread d3/d36/d50/d30/d34/d3e/f86 [0,4194304] 0 2024-02-07T12:26:07.858 INFO:tasks.workunit.client.0.smithi047.stdout:8/872: creat d3/d36/d50/d30/d34/d3e/f124 x:0 0 0 2024-02-07T12:26:07.859 INFO:tasks.workunit.client.0.smithi047.stdout:9/697: creat d3/d10/d18/d3b/d3c/d5d/d68/ff7 x:0 0 0 2024-02-07T12:26:07.859 INFO:tasks.workunit.client.0.smithi047.stdout:9/698: fsync d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/f86 0 2024-02-07T12:26:07.862 INFO:tasks.workunit.client.0.smithi047.stdout:3/964: write d12/dc7/d29/d31/d38/fbb [150555,99621] 0 2024-02-07T12:26:07.863 INFO:tasks.workunit.client.0.smithi047.stdout:8/873: link d3/d36/d50/d28/d100/c119 d3/d4/d4d/dc0/c125 0 2024-02-07T12:26:07.866 INFO:tasks.workunit.client.0.smithi047.stdout:9/699: mkdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8 0 2024-02-07T12:26:07.866 INFO:tasks.workunit.client.0.smithi047.stdout:9/700: chown d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0 38764 1 2024-02-07T12:26:07.866 INFO:tasks.workunit.client.0.smithi047.stdout:3/965: mknod d12/d19/d2d/c13d 0 2024-02-07T12:26:07.869 INFO:tasks.workunit.client.0.smithi047.stdout:9/701: creat d3/d10/d18/d3d/dbd/ff9 x:0 0 0 2024-02-07T12:26:07.869 INFO:tasks.workunit.client.0.smithi047.stdout:9/702: truncate d3/d10/d18/fa3 716020 0 2024-02-07T12:26:07.869 INFO:tasks.workunit.client.0.smithi047.stdout:9/703: creat d3/d10/d18/ffa x:0 0 0 2024-02-07T12:26:07.870 INFO:tasks.workunit.client.0.smithi047.stdout:3/966: symlink d12/dc7/l13e 0 2024-02-07T12:26:07.870 INFO:tasks.workunit.client.0.smithi047.stdout:3/967: fsync d12/d19/d2d/d42/f4d 0 2024-02-07T12:26:07.870 INFO:tasks.workunit.client.0.smithi047.stdout:3/968: readlink d12/dc7/d29/d31/d38/l116 0 2024-02-07T12:26:07.872 INFO:tasks.workunit.client.0.smithi047.stdout:3/969: symlink d12/dc7/d29/d44/l13f 0 2024-02-07T12:26:07.872 INFO:tasks.workunit.client.0.smithi047.stdout:3/970: chown d12/dc7/d29/d31/d7c 32254014 1 2024-02-07T12:26:07.873 INFO:tasks.workunit.client.0.smithi047.stdout:3/971: rename d12/dc7/d29/fa4 to d12/dc7/d29/d31/d7c/d12f/f140 0 2024-02-07T12:26:07.875 INFO:tasks.workunit.client.0.smithi047.stdout:3/972: unlink d12/dc7/f2c 0 2024-02-07T12:26:07.876 INFO:tasks.workunit.client.0.smithi047.stdout:3/973: mknod d12/dc7/d29/d6f/c141 0 2024-02-07T12:26:07.879 INFO:tasks.workunit.client.0.smithi047.stdout:9/704: dread d3/d10/d18/d3a/f44 [0,4194304] 0 2024-02-07T12:26:07.879 INFO:tasks.workunit.client.0.smithi047.stdout:9/705: creat d3/d10/d18/d3b/ffb x:0 0 0 2024-02-07T12:26:07.881 INFO:tasks.workunit.client.0.smithi047.stdout:8/874: dwrite d3/d66/faa [0,4194304] 0 2024-02-07T12:26:07.883 INFO:tasks.workunit.client.0.smithi047.stdout:8/875: mkdir d3/d36/d50/d30/d34/d126 0 2024-02-07T12:26:07.886 INFO:tasks.workunit.client.0.smithi047.stdout:8/876: rename d3/d36/d50/c19 to d3/d66/dac/c127 0 2024-02-07T12:26:07.886 INFO:tasks.workunit.client.0.smithi047.stdout:8/877: chown d3/d36/d50/c22 2464 1 2024-02-07T12:26:07.886 INFO:tasks.workunit.client.0.smithi047.stdout:8/878: stat d3/d4/d87/cd4 0 2024-02-07T12:26:07.887 INFO:tasks.workunit.client.0.smithi047.stdout:8/879: mknod d3/d36/d50/c128 0 2024-02-07T12:26:07.888 INFO:tasks.workunit.client.0.smithi047.stdout:8/880: fdatasync d3/d4/f18 0 2024-02-07T12:26:07.888 INFO:tasks.workunit.client.0.smithi047.stdout:8/881: creat d3/d36/d50/d28/d100/f129 x:0 0 0 2024-02-07T12:26:07.890 INFO:tasks.workunit.client.0.smithi047.stdout:8/882: link d3/d66/d67/d6a/dca/f107 d3/d4/d87/f12a 0 2024-02-07T12:26:07.890 INFO:tasks.workunit.client.0.smithi047.stdout:8/883: fsync d3/d36/d50/fbc 0 2024-02-07T12:26:07.902 INFO:tasks.workunit.client.0.smithi047.stdout:9/706: read d3/d10/d4c/f8e [495028,61488] 0 2024-02-07T12:26:07.902 INFO:tasks.workunit.client.0.smithi047.stdout:9/707: fdatasync d3/d10/d18/d3d/d79/fec 0 2024-02-07T12:26:07.905 INFO:tasks.workunit.client.0.smithi047.stdout:9/708: symlink d3/d10/d18/d3d/d79/lfc 0 2024-02-07T12:26:07.905 INFO:tasks.workunit.client.0.smithi047.stdout:8/884: dwrite d3/d66/d67/d6a/d91/f97 [0,4194304] 0 2024-02-07T12:26:07.905 INFO:tasks.workunit.client.0.smithi047.stdout:9/709: chown d3/d10/d18/d3b/l7f 1153 1 2024-02-07T12:26:07.907 INFO:tasks.workunit.client.0.smithi047.stdout:9/710: creat d3/d10/d18/d3b/d3c/ffd x:0 0 0 2024-02-07T12:26:07.911 INFO:tasks.workunit.client.0.smithi047.stdout:9/711: truncate d3/d10/d18/d3b/f69 10016610 0 2024-02-07T12:26:07.912 INFO:tasks.workunit.client.0.smithi047.stdout:9/712: rmdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90 39 2024-02-07T12:26:07.916 INFO:tasks.workunit.client.0.smithi047.stdout:9/713: dread d3/d10/d18/d3a/da7/fed [0,4194304] 0 2024-02-07T12:26:07.916 INFO:tasks.workunit.client.0.smithi047.stdout:8/885: dread d3/d66/d67/d71/d93/f95 [0,4194304] 0 2024-02-07T12:26:07.917 INFO:tasks.workunit.client.0.smithi047.stdout:8/886: fdatasync d3/d4/f55 0 2024-02-07T12:26:07.919 INFO:tasks.workunit.client.0.smithi047.stdout:9/714: link d3/d10/d4c/f5b d3/d10/d18/d3d/ffe 0 2024-02-07T12:26:07.928 INFO:tasks.workunit.client.0.smithi047.stdout:9/715: dread d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/f96 [0,4194304] 0 2024-02-07T12:26:07.928 INFO:tasks.workunit.client.0.smithi047.stdout:9/716: chown d3/d10/d18/d3b/d3c/d5d/d68/ff7 5 1 2024-02-07T12:26:07.928 INFO:tasks.workunit.client.0.smithi047.stdout:9/717: truncate d3/d10/d18/d3b/d3c/d5d/d70/dad/dbf/fd5 270488 0 2024-02-07T12:26:07.955 INFO:tasks.workunit.client.0.smithi047.stdout:8/887: creat d3/d36/d9d/f12b x:0 0 0 2024-02-07T12:26:07.975 INFO:tasks.workunit.client.0.smithi047.stdout:8/888: dwrite d3/d66/d67/d6a/f23 [0,4194304] 0 2024-02-07T12:26:07.981 INFO:tasks.workunit.client.0.smithi047.stdout:9/718: symlink d3/d10/d18/d6e/d9a/daf/lff 0 2024-02-07T12:26:07.981 INFO:tasks.workunit.client.0.smithi047.stdout:9/719: fsync d3/d10/d18/d3b/d3c/d5d/d70/fe4 0 2024-02-07T12:26:08.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.012+0000 7f9534f06700 1 -- 172.21.15.47:0/3434703816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9530113b90 con 0x7f95300fba90 2024-02-07T12:26:08.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.013+0000 7f951effd700 1 -- 172.21.15.47:0/3434703816 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f9530113b90 con 0x7f95300fba90 2024-02-07T12:26:08.015 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:26:08.015 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:26:08.015 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2 2024-02-07T12:26:08.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:26:08.015 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:26:08.015 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 1, 2024-02-07T12:26:08.015 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 1 2024-02-07T12:26:08.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:26:08.016 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:26:08.016 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 6 2024-02-07T12:26:08.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:26:08.016 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:26:08.016 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:26:08.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:26:08.016 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:26:08.016 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 13, 2024-02-07T12:26:08.016 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 1 2024-02-07T12:26:08.016 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:26:08.016 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:26:08.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.016+0000 7f9534f06700 1 -- 172.21.15.47:0/3434703816 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f951806b140 msgr2=0x7f951806d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:08.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.016+0000 7f9534f06700 1 --2- 172.21.15.47:0/3434703816 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f951806b140 0x7f951806d5f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9520009fd0 tx=0x7f9520009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:08.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.016+0000 7f9534f06700 1 -- 172.21.15.47:0/3434703816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95300fba90 msgr2=0x7f9530112cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:08.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.016+0000 7f9534f06700 1 --2- 172.21.15.47:0/3434703816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95300fba90 0x7f9530112cf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f952400b580 tx=0x7f95240091a0 comp rx=0 tx=0).stop 2024-02-07T12:26:08.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.016+0000 7f9534f06700 1 -- 172.21.15.47:0/3434703816 shutdown_connections 2024-02-07T12:26:08.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:07 smithi047 ceph-mon[28972]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:08.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:07 smithi047 ceph-mon[28972]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:08.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.016+0000 7f9534f06700 1 --2- 172.21.15.47:0/3434703816 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f951806b140 0x7f951806d5f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:08.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.016+0000 7f9534f06700 1 --2- 172.21.15.47:0/3434703816 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9530064ec0 0x7f95301107a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:08.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.016+0000 7f9534f06700 1 --2- 172.21.15.47:0/3434703816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95300fba90 0x7f9530112cf0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:08.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.016+0000 7f9534f06700 1 -- 172.21.15.47:0/3434703816 >> 172.21.15.47:0/3434703816 conn(0x7f95300f6ca0 msgr2=0x7f9530100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:08.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.016+0000 7f9534f06700 1 -- 172.21.15.47:0/3434703816 shutdown_connections 2024-02-07T12:26:08.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.016+0000 7f9534f06700 1 -- 172.21.15.47:0/3434703816 wait complete. 2024-02-07T12:26:08.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:07 smithi138 ceph-mon[35528]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:08.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:07 smithi138 ceph-mon[35528]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:08.110 INFO:tasks.workunit.client.0.smithi047.stdout:8/889: link d3/d36/d50/d28/lc6 d3/d4/d87/l12c 0 2024-02-07T12:26:08.123 INFO:tasks.workunit.client.0.smithi047.stdout:9/720: getdents d3/d10/d18/d3d/dbd 0 2024-02-07T12:26:08.123 INFO:tasks.workunit.client.0.smithi047.stdout:9/721: dread - d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/fe8 zero size 2024-02-07T12:26:08.123 INFO:tasks.workunit.client.0.smithi047.stdout:9/722: chown d3/d10/d18/d3a/f44 46 1 2024-02-07T12:26:08.137 INFO:tasks.workunit.client.0.smithi047.stdout:9/723: dwrite d3/fdd [0,4194304] 0 2024-02-07T12:26:08.148 INFO:tasks.workunit.client.0.smithi047.stdout:9/724: rmdir d3/d10/d18/d3a/da7 39 2024-02-07T12:26:08.149 INFO:tasks.workunit.client.0.smithi047.stdout:8/890: unlink d3/f6f 0 2024-02-07T12:26:08.150 INFO:tasks.workunit.client.0.smithi047.stdout:8/891: symlink d3/dbd/l12d 0 2024-02-07T12:26:08.155 INFO:tasks.workunit.client.0.smithi047.stdout:8/892: rmdir d3/d36/d50/d30/d34/d126 0 2024-02-07T12:26:08.156 INFO:tasks.workunit.client.0.smithi047.stdout:8/893: symlink d3/d66/d67/l12e 0 2024-02-07T12:26:08.163 INFO:tasks.workunit.client.0.smithi047.stdout:9/725: dwrite d3/d10/d18/d3d/dbd/ff9 [0,4194304] 0 2024-02-07T12:26:08.169 INFO:tasks.workunit.client.0.smithi047.stdout:9/726: rmdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/dea 0 2024-02-07T12:26:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.173+0000 7f49bc239700 1 -- 172.21.15.47:0/2252839847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49b40fe5a0 msgr2=0x7f49b40fe9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.173+0000 7f49bc239700 1 --2- 172.21.15.47:0/2252839847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49b40fe5a0 0x7f49b40fe9b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f49b0004940 tx=0x7f49b0009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.173+0000 7f49bc239700 1 -- 172.21.15.47:0/2252839847 shutdown_connections 2024-02-07T12:26:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.173+0000 7f49bc239700 1 --2- 172.21.15.47:0/2252839847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49b40fef80 0x7f49b40fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.173+0000 7f49bc239700 1 --2- 172.21.15.47:0/2252839847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49b40fe5a0 0x7f49b40fe9b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.173+0000 7f49bc239700 1 -- 172.21.15.47:0/2252839847 >> 172.21.15.47:0/2252839847 conn(0x7f49b40f6ca0 msgr2=0x7f49b40f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.173+0000 7f49bc239700 1 -- 172.21.15.47:0/2252839847 shutdown_connections 2024-02-07T12:26:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.173+0000 7f49bc239700 1 -- 172.21.15.47:0/2252839847 wait complete. 2024-02-07T12:26:08.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.174+0000 7f49bc239700 1 Processor -- start 2024-02-07T12:26:08.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.174+0000 7f49bc239700 1 -- start start 2024-02-07T12:26:08.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.174+0000 7f49bc239700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49b40fe5a0 0x7f49b410d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:08.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.174+0000 7f49bc239700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49b410dee0 0x7f49b410ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:08.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.174+0000 7f49bc239700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b410e3a0 con 0x7f49b40fe5a0 2024-02-07T12:26:08.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.174+0000 7f49bc239700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b410e4e0 con 0x7f49b410dee0 2024-02-07T12:26:08.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.174+0000 7f49b9fd5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49b40fe5a0 0x7f49b410d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:08.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.174+0000 7f49b9fd5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49b40fe5a0 0x7f49b410d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42154/0 (socket says 172.21.15.47:42154) 2024-02-07T12:26:08.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.174+0000 7f49b97d4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49b410dee0 0x7f49b410ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:08.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.174+0000 7f49b9fd5700 1 -- 172.21.15.47:0/2007969616 learned_addr learned my addr 172.21.15.47:0/2007969616 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:08.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.175+0000 7f49b97d4700 1 -- 172.21.15.47:0/2007969616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49b40fe5a0 msgr2=0x7f49b410d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:08.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.175+0000 7f49b97d4700 1 --2- 172.21.15.47:0/2007969616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49b40fe5a0 0x7f49b410d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:08.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.175+0000 7f49b97d4700 1 -- 172.21.15.47:0/2007969616 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a4005040 con 0x7f49b410dee0 2024-02-07T12:26:08.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.175+0000 7f49b9fd5700 1 --2- 172.21.15.47:0/2007969616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49b40fe5a0 0x7f49b410d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-07T12:26:08.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.175+0000 7f49b97d4700 1 --2- 172.21.15.47:0/2007969616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49b410dee0 0x7f49b410ed80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f49a4009fd0 tx=0x7f49a4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:08.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.175+0000 7f49aa7fc700 1 -- 172.21.15.47:0/2007969616 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a4012570 con 0x7f49b410dee0 2024-02-07T12:26:08.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.175+0000 7f49bc239700 1 -- 172.21.15.47:0/2007969616 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b0005040 con 0x7f49b410dee0 2024-02-07T12:26:08.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.175+0000 7f49aa7fc700 1 -- 172.21.15.47:0/2007969616 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49a400f040 con 0x7f49b410dee0 2024-02-07T12:26:08.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.175+0000 7f49aa7fc700 1 -- 172.21.15.47:0/2007969616 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a4013c40 con 0x7f49b410dee0 2024-02-07T12:26:08.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.175+0000 7f49bc239700 1 -- 172.21.15.47:0/2007969616 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b410f760 con 0x7f49b410dee0 2024-02-07T12:26:08.180 INFO:tasks.workunit.client.0.smithi047.stdout:8/894: dwrite d3/d66/faa [0,4194304] 0 2024-02-07T12:26:08.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.177+0000 7f49bc239700 1 -- 172.21.15.47:0/2007969616 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b404bed0 con 0x7f49b410dee0 2024-02-07T12:26:08.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.177+0000 7f49aa7fc700 1 -- 172.21.15.47:0/2007969616 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7f49a40126d0 con 0x7f49b410dee0 2024-02-07T12:26:08.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.178+0000 7f49aa7fc700 1 --2- 172.21.15.47:0/2007969616 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f49a006b140 0x7f49a006d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:08.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.178+0000 7f49aa7fc700 1 -- 172.21.15.47:0/2007969616 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f49a40899b0 con 0x7f49b410dee0 2024-02-07T12:26:08.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.178+0000 7f49b9fd5700 1 --2- 172.21.15.47:0/2007969616 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f49a006b140 0x7f49a006d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:08.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.180+0000 7f49b9fd5700 1 --2- 172.21.15.47:0/2007969616 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f49a006b140 0x7f49a006d5f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f49b0007f50 tx=0x7f49b0009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:08.183 INFO:tasks.workunit.client.0.smithi047.stdout:9/727: dread d3/f40 [4194304,4194304] 0 2024-02-07T12:26:08.185 INFO:tasks.workunit.client.0.smithi047.stdout:8/895: write d3/f56 [3356486,111603] 0 2024-02-07T12:26:08.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.183+0000 7f49aa7fc700 1 -- 172.21.15.47:0/2007969616 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f49a4057470 con 0x7f49b410dee0 2024-02-07T12:26:08.187 INFO:tasks.workunit.client.0.smithi047.stdout:9/728: rename d3/lda to d3/d10/d18/d3d/dbd/l100 0 2024-02-07T12:26:08.188 INFO:tasks.workunit.client.0.smithi047.stdout:8/896: mknod d3/d36/d9d/dbe/df5/df9/c12f 0 2024-02-07T12:26:08.191 INFO:tasks.workunit.client.0.smithi047.stdout:9/729: rmdir d3/d10/d18/d3b/d3c/d5d/d70/dad/dbf 39 2024-02-07T12:26:08.192 INFO:tasks.workunit.client.0.smithi047.stdout:8/897: symlink d3/d4/d4d/dc0/l130 0 2024-02-07T12:26:08.195 INFO:tasks.workunit.client.0.smithi047.stdout:9/730: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/f101 x:0 0 0 2024-02-07T12:26:08.197 INFO:tasks.workunit.client.0.smithi047.stdout:9/731: dread d3/d10/d18/d6e/fbc [0,4194304] 0 2024-02-07T12:26:08.197 INFO:tasks.workunit.client.0.smithi047.stdout:8/898: link d3/d66/d67/d6a/dca/d104/c114 d3/d36/d9d/c131 0 2024-02-07T12:26:08.199 INFO:tasks.workunit.client.0.smithi047.stdout:9/732: creat d3/d10/d18/d3a/da7/f102 x:0 0 0 2024-02-07T12:26:08.199 INFO:tasks.workunit.client.0.smithi047.stdout:9/733: fdatasync d3/f19 0 2024-02-07T12:26:08.199 INFO:tasks.workunit.client.0.smithi047.stdout:9/734: fdatasync d3/f85 0 2024-02-07T12:26:08.199 INFO:tasks.workunit.client.0.smithi047.stdout:9/735: symlink d3/d10/d18/d3b/dc6/l103 0 2024-02-07T12:26:08.200 INFO:tasks.workunit.client.0.smithi047.stdout:8/899: rename d3/d4/c38 to d3/d99/d121/c132 0 2024-02-07T12:26:08.201 INFO:tasks.workunit.client.0.smithi047.stdout:9/736: symlink d3/d10/d18/d3b/d3c/d5d/d70/l104 0 2024-02-07T12:26:08.201 INFO:tasks.workunit.client.0.smithi047.stdout:9/737: getdents d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8 0 2024-02-07T12:26:08.202 INFO:tasks.workunit.client.0.smithi047.stdout:8/900: mkdir d3/d66/d67/d6a/dca/d133 0 2024-02-07T12:26:08.202 INFO:tasks.workunit.client.0.smithi047.stdout:8/901: read d3/d36/d50/d2a/f32 [902229,46005] 0 2024-02-07T12:26:08.202 INFO:tasks.workunit.client.0.smithi047.stdout:9/738: truncate d3/d10/d18/d3d/dbd/ff9 1055833 0 2024-02-07T12:26:08.204 INFO:tasks.workunit.client.0.smithi047.stdout:9/739: mkdir d3/d10/d4c/d105 0 2024-02-07T12:26:08.204 INFO:tasks.workunit.client.0.smithi047.stdout:9/740: write d3/d10/d11/fd8 [643528,112711] 0 2024-02-07T12:26:08.205 INFO:tasks.workunit.client.0.smithi047.stdout:9/741: mknod d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/de6/c106 0 2024-02-07T12:26:08.205 INFO:tasks.workunit.client.0.smithi047.stdout:9/742: fsync d3/d10/d18/d3d/f37 0 2024-02-07T12:26:08.205 INFO:tasks.workunit.client.0.smithi047.stdout:9/743: fdatasync d3/d10/f67 0 2024-02-07T12:26:08.206 INFO:tasks.workunit.client.0.smithi047.stdout:9/744: unlink d3/d10/d18/d3b/l41 0 2024-02-07T12:26:08.206 INFO:tasks.workunit.client.0.smithi047.stdout:9/745: fsync d3/f9 0 2024-02-07T12:26:08.206 INFO:tasks.workunit.client.0.smithi047.stdout:9/746: chown d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/l88 58 1 2024-02-07T12:26:08.208 INFO:tasks.workunit.client.0.smithi047.stdout:9/747: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/dd6/f107 x:0 0 0 2024-02-07T12:26:08.208 INFO:tasks.workunit.client.0.smithi047.stdout:9/748: creat d3/d10/d18/d3d/dc0/f108 x:0 0 0 2024-02-07T12:26:08.208 INFO:tasks.workunit.client.0.smithi047.stdout:9/749: fdatasync d3/d10/d18/d3a/da7/fed 0 2024-02-07T12:26:08.210 INFO:tasks.workunit.client.0.smithi047.stdout:8/902: dread d3/d66/d67/d6a/f4c [0,4194304] 0 2024-02-07T12:26:08.214 INFO:tasks.workunit.client.0.smithi047.stdout:8/903: mknod d3/d4/d87/c134 0 2024-02-07T12:26:08.214 INFO:tasks.workunit.client.0.smithi047.stdout:8/904: chown d3/d36/d50/d28/lc6 12432 1 2024-02-07T12:26:08.220 INFO:tasks.workunit.client.0.smithi047.stdout:9/750: dread d3/d10/d18/d3d/f46 [0,4194304] 0 2024-02-07T12:26:08.221 INFO:tasks.workunit.client.0.smithi047.stdout:9/751: getdents d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0 0 2024-02-07T12:26:08.221 INFO:tasks.workunit.client.0.smithi047.stdout:9/752: chown d3/ca 51628 1 2024-02-07T12:26:08.227 INFO:tasks.workunit.client.0.smithi047.stdout:8/905: dread d3/d4/f1e [0,4194304] 0 2024-02-07T12:26:08.227 INFO:tasks.workunit.client.0.smithi047.stdout:8/906: write d3/d4/d87/f103 [34969,55868] 0 2024-02-07T12:26:08.236 INFO:tasks.workunit.client.0.smithi047.stdout:8/907: write d3/d4/f55 [1426856,112751] 0 2024-02-07T12:26:08.236 INFO:tasks.workunit.client.0.smithi047.stdout:9/753: dwrite d3/d10/d18/d3b/fc9 [0,4194304] 0 2024-02-07T12:26:08.239 INFO:tasks.workunit.client.0.smithi047.stdout:9/754: chown d3/d10/d18/d3b/cdc 681858 1 2024-02-07T12:26:08.242 INFO:tasks.workunit.client.0.smithi047.stdout:8/908: link d3/d4/d4d/fb1 d3/d36/d50/d30/d9e/f135 0 2024-02-07T12:26:08.242 INFO:tasks.workunit.client.0.smithi047.stdout:9/755: chown d3/d10/d18/d3a/da7/ff1 13461 1 2024-02-07T12:26:08.244 INFO:tasks.workunit.client.0.smithi047.stdout:9/756: dread - d3/d10/d18/d3d/dc0/fcb zero size 2024-02-07T12:26:08.246 INFO:tasks.workunit.client.0.smithi047.stdout:8/909: link d3/d4/f7 d3/d36/f136 0 2024-02-07T12:26:08.248 INFO:tasks.workunit.client.0.smithi047.stdout:9/757: symlink d3/d10/d18/d6e/l109 0 2024-02-07T12:26:08.249 INFO:tasks.workunit.client.0.smithi047.stdout:9/758: creat d3/d10/d18/d3b/d3c/d5d/d68/f10a x:0 0 0 2024-02-07T12:26:08.251 INFO:tasks.workunit.client.0.smithi047.stdout:9/759: dread d3/d10/d18/fa3 [0,4194304] 0 2024-02-07T12:26:08.251 INFO:tasks.workunit.client.0.smithi047.stdout:9/760: dread - d3/d10/d18/d3b/d3c/d5d/d68/f10a zero size 2024-02-07T12:26:08.251 INFO:tasks.workunit.client.0.smithi047.stdout:9/761: creat d3/d10/d18/d3d/d79/f10b x:0 0 0 2024-02-07T12:26:08.251 INFO:tasks.workunit.client.0.smithi047.stdout:9/762: creat d3/d10/d18/d3b/f10c x:0 0 0 2024-02-07T12:26:08.254 INFO:tasks.workunit.client.0.smithi047.stdout:9/763: rmdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c 39 2024-02-07T12:26:08.254 INFO:tasks.workunit.client.0.smithi047.stdout:9/764: creat d3/d10/d4c/f10d x:0 0 0 2024-02-07T12:26:08.256 INFO:tasks.workunit.client.0.smithi047.stdout:9/765: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/f10e x:0 0 0 2024-02-07T12:26:08.258 INFO:tasks.workunit.client.0.smithi047.stdout:9/766: creat d3/d10/d18/d3b/d3c/d5d/d70/f10f x:0 0 0 2024-02-07T12:26:08.258 INFO:tasks.workunit.client.0.smithi047.stdout:9/767: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/f110 x:0 0 0 2024-02-07T12:26:08.258 INFO:tasks.workunit.client.0.smithi047.stdout:9/768: read - d3/d10/d18/d3b/d3c/d5d/d68/ff7 zero size 2024-02-07T12:26:08.267 INFO:tasks.workunit.client.0.smithi047.stdout:8/910: write d3/d36/d50/d2a/f2b [834258,115272] 0 2024-02-07T12:26:08.273 INFO:tasks.workunit.client.0.smithi047.stdout:9/769: dwrite d3/d10/d18/d3d/f46 [0,4194304] 0 2024-02-07T12:26:08.274 INFO:tasks.workunit.client.0.smithi047.stdout:9/770: getdents d3/d10/d18/d6e/d9a/daf 0 2024-02-07T12:26:08.274 INFO:tasks.workunit.client.0.smithi047.stdout:9/771: fdatasync d3/f34 0 2024-02-07T12:26:08.276 INFO:tasks.workunit.client.0.smithi047.stdout:9/772: stat d3/d10/d18/c2b 0 2024-02-07T12:26:08.276 INFO:tasks.workunit.client.0.smithi047.stdout:9/773: write d3/d10/f67 [1436920,83888] 0 2024-02-07T12:26:08.277 INFO:tasks.workunit.client.0.smithi047.stdout:9/774: link d3/d10/ca4 d3/d10/d18/d3b/d3c/d5d/c111 0 2024-02-07T12:26:08.279 INFO:tasks.workunit.client.0.smithi047.stdout:9/775: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/f112 x:0 0 0 2024-02-07T12:26:08.279 INFO:tasks.workunit.client.0.smithi047.stdout:9/776: truncate d3/d10/d18/d3b/ffb 352903 0 2024-02-07T12:26:08.284 INFO:tasks.workunit.client.0.smithi047.stdout:8/911: dwrite d3/d36/d50/d30/d34/d3e/fc7 [0,4194304] 0 2024-02-07T12:26:08.284 INFO:tasks.workunit.client.0.smithi047.stdout:8/912: fdatasync d3/d4/d87/f12a 0 2024-02-07T12:26:08.295 INFO:tasks.workunit.client.0.smithi047.stdout:8/913: dread d3/d66/d67/d6a/f51 [0,4194304] 0 2024-02-07T12:26:08.295 INFO:tasks.workunit.client.0.smithi047.stdout:8/914: creat d3/d36/d50/d30/d9e/da6/f137 x:0 0 0 2024-02-07T12:26:08.298 INFO:tasks.workunit.client.0.smithi047.stdout:8/915: chown d3/d4/d59/f106 198 1 2024-02-07T12:26:08.298 INFO:tasks.workunit.client.0.smithi047.stdout:8/916: write d3/d4/d59/f106 [1516418,35440] 0 2024-02-07T12:26:08.309 INFO:tasks.workunit.client.0.smithi047.stdout:8/917: dread d3/d4/f7f [0,4194304] 0 2024-02-07T12:26:08.326 INFO:tasks.workunit.client.0.smithi047.stdout:8/918: dwrite d3/d36/d50/d30/d9e/da6/fce [0,4194304] 0 2024-02-07T12:26:08.340 INFO:tasks.workunit.client.0.smithi047.stdout:8/919: dwrite d3/d36/f4b [0,4194304] 0 2024-02-07T12:26:08.340 INFO:tasks.workunit.client.0.smithi047.stdout:8/920: fdatasync d3/d66/d67/d6a/dca/fd5 0 2024-02-07T12:26:08.347 INFO:tasks.workunit.client.0.smithi047.stdout:8/921: mknod d3/d36/d50/d2a/d112/c138 0 2024-02-07T12:26:08.347 INFO:tasks.workunit.client.0.smithi047.stdout:8/922: fsync d3/d36/fa5 0 2024-02-07T12:26:08.351 INFO:tasks.workunit.client.0.smithi047.stdout:8/923: rename d3/d36/d50/d2a/d112/c116 to d3/c139 0 2024-02-07T12:26:08.351 INFO:tasks.workunit.client.0.smithi047.stdout:8/924: fsync d3/d66/d67/d71/d93/f10d 0 2024-02-07T12:26:08.351 INFO:tasks.workunit.client.0.smithi047.stdout:8/925: creat d3/d36/d50/d30/d9e/da6/f13a x:0 0 0 2024-02-07T12:26:08.364 INFO:tasks.workunit.client.0.smithi047.stdout:1/665: sync 2024-02-07T12:26:08.367 INFO:tasks.workunit.client.0.smithi047.stdout:8/926: unlink d3/d4/f1e 0 2024-02-07T12:26:08.370 INFO:tasks.workunit.client.0.smithi047.stdout:8/927: mknod d3/d4/d4d/dc0/c13b 0 2024-02-07T12:26:08.387 INFO:tasks.workunit.client.0.smithi047.stdout:1/666: dwrite d1/d6e/d75/da7/f9c [4194304,4194304] 0 2024-02-07T12:26:08.423 INFO:tasks.workunit.client.0.smithi047.stdout:8/928: creat d3/d4/d4d/dc0/f13c x:0 0 0 2024-02-07T12:26:08.425 INFO:tasks.workunit.client.0.smithi047.stdout:1/667: symlink d1/d6e/d75/da7/d65/ldb 0 2024-02-07T12:26:08.428 INFO:tasks.workunit.client.0.smithi047.stdout:1/668: dread d1/d15/d2f/f6b [0,4194304] 0 2024-02-07T12:26:08.429 INFO:tasks.workunit.client.0.smithi047.stdout:8/929: creat d3/d36/d50/f13d x:0 0 0 2024-02-07T12:26:08.429 INFO:tasks.workunit.client.0.smithi047.stdout:8/930: write d3/d66/d67/d6a/f46 [2126886,124277] 0 2024-02-07T12:26:08.429 INFO:tasks.workunit.client.0.smithi047.stdout:8/931: read - d3/d66/f11a zero size 2024-02-07T12:26:08.430 INFO:tasks.workunit.client.0.smithi047.stdout:8/932: chown d3/d36/f75 1911 1 2024-02-07T12:26:08.446 INFO:tasks.workunit.client.0.smithi047.stdout:1/669: rename d1/c2c to d1/d37/cdc 0 2024-02-07T12:26:08.446 INFO:tasks.workunit.client.0.smithi047.stdout:1/670: rename d1 to d1/d6e/dcf/d3e/dbb/ddd 22 2024-02-07T12:26:08.449 INFO:tasks.workunit.client.0.smithi047.stdout:8/933: mkdir d3/d66/d67/d71/d93/dd8/d13e 0 2024-02-07T12:26:08.472 INFO:tasks.workunit.client.0.smithi047.stdout:8/934: dwrite d3/d66/d67/d6a/d91/fcc [4194304,4194304] 0 2024-02-07T12:26:08.472 INFO:tasks.workunit.client.0.smithi047.stdout:8/935: chown d3/d36/d50/ff4 242639 1 2024-02-07T12:26:08.483 INFO:tasks.workunit.client.0.smithi047.stdout:8/936: dread d3/d36/f75 [0,4194304] 0 2024-02-07T12:26:08.499 INFO:tasks.workunit.client.0.smithi047.stdout:8/937: dwrite d3/f56 [0,4194304] 0 2024-02-07T12:26:08.499 INFO:tasks.workunit.client.0.smithi047.stdout:8/938: dread - d3/d36/fec zero size 2024-02-07T12:26:08.502 INFO:tasks.workunit.client.0.smithi047.stdout:8/939: unlink d3/d66/dac/cfb 0 2024-02-07T12:26:08.502 INFO:tasks.workunit.client.0.smithi047.stdout:8/940: write d3/faf [104045,130437] 0 2024-02-07T12:26:08.502 INFO:tasks.workunit.client.0.smithi047.stdout:8/941: chown d3/d4/d4d/dc0/l117 0 1 2024-02-07T12:26:08.508 INFO:tasks.workunit.client.0.smithi047.stdout:8/942: dread d3/d4/f55 [0,4194304] 0 2024-02-07T12:26:08.510 INFO:tasks.workunit.client.0.smithi047.stdout:8/943: rmdir d3/d66/d67/d71/d93/d9f 39 2024-02-07T12:26:08.512 INFO:tasks.workunit.client.0.smithi047.stdout:8/944: creat d3/d66/d67/d71/d93/d9f/f13f x:0 0 0 2024-02-07T12:26:08.515 INFO:tasks.workunit.client.0.smithi047.stdout:8/945: rename d3/d66/d67/d71/d93/f10d to d3/d36/de2/f140 0 2024-02-07T12:26:08.539 INFO:tasks.workunit.client.0.smithi047.stdout:8/946: dwrite d3/d66/f7d [0,4194304] 0 2024-02-07T12:26:08.556 INFO:tasks.workunit.client.0.smithi047.stdout:8/947: creat d3/d66/d67/d6a/dca/d104/f141 x:0 0 0 2024-02-07T12:26:08.584 INFO:tasks.workunit.client.0.smithi047.stdout:8/948: mknod d3/d36/de2/c142 0 2024-02-07T12:26:08.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.652+0000 7f49bc239700 1 -- 172.21.15.47:0/2007969616 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f49b410f2c0 con 0x7f49b410dee0 2024-02-07T12:26:08.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.652+0000 7f49aa7fc700 1 -- 172.21.15.47:0/2007969616 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f49a4057000 con 0x7f49b410dee0 2024-02-07T12:26:08.655 INFO:teuthology.orchestra.run.smithi047.stdout:e19 2024-02-07T12:26:08.655 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:26:08.655 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:26:08.655 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:26:08.655 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:26:08.655 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:26:08.655 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:26:08.655 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 19 2024-02-07T12:26:08.655 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:24:57.983373+0000 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:26:08.656 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:26:08.657 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:26:08.657 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:26:08.657 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:26:08.657 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:26:08.657 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:26:08.657 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:26:08.657 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:26:08.657 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 export targets 1 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:26:08.657 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:26:08.657 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:26:08.657 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:26:08.657 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:26:08.657 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:26:08.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.655+0000 7f49bc239700 1 -- 172.21.15.47:0/2007969616 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f49a006b140 msgr2=0x7f49a006d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:08.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.655+0000 7f49bc239700 1 --2- 172.21.15.47:0/2007969616 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f49a006b140 0x7f49a006d5f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f49b0007f50 tx=0x7f49b0009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:08.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.655+0000 7f49bc239700 1 -- 172.21.15.47:0/2007969616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49b410dee0 msgr2=0x7f49b410ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:08.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.655+0000 7f49bc239700 1 --2- 172.21.15.47:0/2007969616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49b410dee0 0x7f49b410ed80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f49a4009fd0 tx=0x7f49a4009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:08.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.655+0000 7f49bc239700 1 -- 172.21.15.47:0/2007969616 shutdown_connections 2024-02-07T12:26:08.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.655+0000 7f49bc239700 1 --2- 172.21.15.47:0/2007969616 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f49a006b140 0x7f49a006d5f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:08.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.655+0000 7f49bc239700 1 --2- 172.21.15.47:0/2007969616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49b40fe5a0 0x7f49b410d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:08.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.655+0000 7f49bc239700 1 --2- 172.21.15.47:0/2007969616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49b410dee0 0x7f49b410ed80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:08.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.655+0000 7f49bc239700 1 -- 172.21.15.47:0/2007969616 >> 172.21.15.47:0/2007969616 conn(0x7f49b40f6ca0 msgr2=0x7f49b4101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:08.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.655+0000 7f49bc239700 1 -- 172.21.15.47:0/2007969616 shutdown_connections 2024-02-07T12:26:08.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.655+0000 7f49bc239700 1 -- 172.21.15.47:0/2007969616 wait complete. 2024-02-07T12:26:08.659 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-02-07T12:26:08.696 INFO:tasks.workunit.client.0.smithi047.stdout:0/754: sync 2024-02-07T12:26:08.696 INFO:tasks.workunit.client.0.smithi047.stdout:2/960: sync 2024-02-07T12:26:08.697 INFO:tasks.workunit.client.0.smithi047.stdout:2/961: mkdir d7/d2d/d137 0 2024-02-07T12:26:08.717 INFO:tasks.workunit.client.0.smithi047.stdout:0/755: dwrite d19/d1c/d3c/d60/d6f/d95/da7/fcd [0,4194304] 0 2024-02-07T12:26:08.718 INFO:tasks.workunit.client.0.smithi047.stdout:2/962: dwrite d7/d2d/f4a [0,4194304] 0 2024-02-07T12:26:08.719 INFO:tasks.workunit.client.0.smithi047.stdout:2/963: rmdir d7/dc/d8a 39 2024-02-07T12:26:08.719 INFO:tasks.workunit.client.0.smithi047.stdout:2/964: creat d7/dc/f138 x:0 0 0 2024-02-07T12:26:08.721 INFO:tasks.workunit.client.0.smithi047.stdout:0/756: truncate d19/d40/f53 7755912 0 2024-02-07T12:26:08.733 INFO:tasks.workunit.client.0.smithi047.stdout:2/965: dread d7/dc/d71/dde/f109 [0,4194304] 0 2024-02-07T12:26:08.734 INFO:tasks.workunit.client.0.smithi047.stdout:2/966: creat d7/dc/df2/f139 x:0 0 0 2024-02-07T12:26:08.748 INFO:tasks.workunit.client.0.smithi047.stdout:2/967: dwrite d7/dc/d71/f87 [0,4194304] 0 2024-02-07T12:26:08.751 INFO:tasks.workunit.client.0.smithi047.stdout:2/968: mknod d7/dc/d71/dde/c13a 0 2024-02-07T12:26:08.753 INFO:tasks.workunit.client.0.smithi047.stdout:2/969: mkdir d7/d48/d72/db7/d13b 0 2024-02-07T12:26:08.764 INFO:tasks.workunit.client.0.smithi047.stdout:0/757: creat d19/d1c/ff8 x:0 0 0 2024-02-07T12:26:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.788+0000 7f300c1d8700 1 -- 172.21.15.47:0/1944604542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30040fcef0 msgr2=0x7f30040fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.788+0000 7f300c1d8700 1 --2- 172.21.15.47:0/1944604542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30040fcef0 0x7f30040fd320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3000004940 tx=0x7f3000009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.788+0000 7f300c1d8700 1 -- 172.21.15.47:0/1944604542 shutdown_connections 2024-02-07T12:26:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.788+0000 7f300c1d8700 1 --2- 172.21.15.47:0/1944604542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30040fe0e0 0x7f30040fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.788+0000 7f300c1d8700 1 --2- 172.21.15.47:0/1944604542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30040fcef0 0x7f30040fd320 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.788+0000 7f300c1d8700 1 -- 172.21.15.47:0/1944604542 >> 172.21.15.47:0/1944604542 conn(0x7f30040f8620 msgr2=0x7f30040faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.788+0000 7f300c1d8700 1 -- 172.21.15.47:0/1944604542 shutdown_connections 2024-02-07T12:26:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.788+0000 7f300c1d8700 1 -- 172.21.15.47:0/1944604542 wait complete. 2024-02-07T12:26:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.789+0000 7f300c1d8700 1 Processor -- start 2024-02-07T12:26:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.789+0000 7f300c1d8700 1 -- start start 2024-02-07T12:26:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.789+0000 7f300c1d8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30040fcef0 0x7f300410d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:08.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.789+0000 7f300c1d8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30040fe0e0 0x7f300410de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:08.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.789+0000 7f300c1d8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300410e430 con 0x7f30040fcef0 2024-02-07T12:26:08.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.789+0000 7f300c1d8700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300410ecd0 con 0x7f30040fe0e0 2024-02-07T12:26:08.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.789+0000 7f3009773700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30040fe0e0 0x7f300410de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:08.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.789+0000 7f3009f74700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30040fcef0 0x7f300410d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:08.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.789+0000 7f3009773700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30040fe0e0 0x7f300410de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.47:48636/0 (socket says 172.21.15.47:48636) 2024-02-07T12:26:08.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.789+0000 7f3009f74700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30040fcef0 0x7f300410d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42168/0 (socket says 172.21.15.47:42168) 2024-02-07T12:26:08.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.789+0000 7f3009773700 1 -- 172.21.15.47:0/2026755996 learned_addr learned my addr 172.21.15.47:0/2026755996 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.790+0000 7f3009773700 1 -- 172.21.15.47:0/2026755996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30040fcef0 msgr2=0x7f300410d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.790+0000 7f3009773700 1 --2- 172.21.15.47:0/2026755996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30040fcef0 0x7f300410d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.790+0000 7f3009773700 1 -- 172.21.15.47:0/2026755996 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3000005040 con 0x7f30040fe0e0 2024-02-07T12:26:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.790+0000 7f3009773700 1 --2- 172.21.15.47:0/2026755996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30040fe0e0 0x7f300410de30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400eb40 tx=0x7f2ff400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.790+0000 7f2ffa7fc700 1 -- 172.21.15.47:0/2026755996 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff4007cc0 con 0x7f30040fe0e0 2024-02-07T12:26:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.790+0000 7f2ffa7fc700 1 -- 172.21.15.47:0/2026755996 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ff400f040 con 0x7f30040fe0e0 2024-02-07T12:26:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.790+0000 7f300c1d8700 1 -- 172.21.15.47:0/2026755996 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300410ef50 con 0x7f30040fe0e0 2024-02-07T12:26:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.790+0000 7f2ffa7fc700 1 -- 172.21.15.47:0/2026755996 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff400ca00 con 0x7f30040fe0e0 2024-02-07T12:26:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.791+0000 7f300c1d8700 1 -- 172.21.15.47:0/2026755996 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300410f3d0 con 0x7f30040fe0e0 2024-02-07T12:26:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.792+0000 7f2ffa7fc700 1 -- 172.21.15.47:0/2026755996 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7f2ff400cb60 con 0x7f30040fe0e0 2024-02-07T12:26:08.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.793+0000 7f2ffa7fc700 1 --2- 172.21.15.47:0/2026755996 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f2ff006b140 0x7f2ff006d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:08.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.793+0000 7f2ffa7fc700 1 -- 172.21.15.47:0/2026755996 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2ff4089650 con 0x7f30040fe0e0 2024-02-07T12:26:08.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.793+0000 7f3009f74700 1 --2- 172.21.15.47:0/2026755996 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f2ff006b140 0x7f2ff006d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:08.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.793+0000 7f300c1d8700 1 -- 172.21.15.47:0/2026755996 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300404bed0 con 0x7f30040fe0e0 2024-02-07T12:26:08.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.793+0000 7f3009f74700 1 --2- 172.21.15.47:0/2026755996 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f2ff006b140 0x7f2ff006d5f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3000000c00 tx=0x7f3000009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:08.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:08.798+0000 7f2ffa7fc700 1 -- 172.21.15.47:0/2026755996 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f2ff4057100 con 0x7f30040fe0e0 2024-02-07T12:26:09.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:08 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3434703816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:26:09.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:08 smithi138 ceph-mon[35528]: pgmap v21: 65 pgs: 65 active+clean; 1.8 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 107 MiB/s rd, 129 MiB/s wr, 367 op/s 2024-02-07T12:26:09.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:08 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2007969616' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:26:09.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.069+0000 7f300c1d8700 1 -- 172.21.15.47:0/2026755996 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3004102ac0 con 0x7f2ff006b140 2024-02-07T12:26:09.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:08 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3434703816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:26:09.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:08 smithi047 ceph-mon[28972]: pgmap v21: 65 pgs: 65 active+clean; 1.8 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 107 MiB/s rd, 129 MiB/s wr, 367 op/s 2024-02-07T12:26:09.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:08 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2007969616' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:26:09.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.071+0000 7f2ffa7fc700 1 -- 172.21.15.47:0/2026755996 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f3004102ac0 con 0x7f2ff006b140 2024-02-07T12:26:09.073 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:26:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:26:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:26:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:26:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [], 2024-02-07T12:26:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "1/21 daemons upgraded", 2024-02-07T12:26:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "", 2024-02-07T12:26:09.073 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:26:09.073 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:26:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.072+0000 7f300c1d8700 1 -- 172.21.15.47:0/2026755996 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f2ff006b140 msgr2=0x7f2ff006d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.072+0000 7f300c1d8700 1 --2- 172.21.15.47:0/2026755996 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f2ff006b140 0x7f2ff006d5f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3000000c00 tx=0x7f3000009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.072+0000 7f300c1d8700 1 -- 172.21.15.47:0/2026755996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30040fe0e0 msgr2=0x7f300410de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.072+0000 7f300c1d8700 1 --2- 172.21.15.47:0/2026755996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30040fe0e0 0x7f300410de30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400eb40 tx=0x7f2ff400b040 comp rx=0 tx=0).stop 2024-02-07T12:26:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.073+0000 7f300c1d8700 1 -- 172.21.15.47:0/2026755996 shutdown_connections 2024-02-07T12:26:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.073+0000 7f300c1d8700 1 --2- 172.21.15.47:0/2026755996 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f2ff006b140 0x7f2ff006d5f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.073+0000 7f300c1d8700 1 --2- 172.21.15.47:0/2026755996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30040fcef0 0x7f300410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.073+0000 7f300c1d8700 1 --2- 172.21.15.47:0/2026755996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30040fe0e0 0x7f300410de30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.073+0000 7f300c1d8700 1 -- 172.21.15.47:0/2026755996 >> 172.21.15.47:0/2026755996 conn(0x7f30040f8620 msgr2=0x7f30041013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.073+0000 7f300c1d8700 1 -- 172.21.15.47:0/2026755996 shutdown_connections 2024-02-07T12:26:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.073+0000 7f300c1d8700 1 -- 172.21.15.47:0/2026755996 wait complete. 2024-02-07T12:26:09.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.175+0000 7ff22d3ac700 1 -- 172.21.15.47:0/2889747308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2281000f0 msgr2=0x7ff2281024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:09.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.175+0000 7ff22d3ac700 1 --2- 172.21.15.47:0/2889747308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2281000f0 0x7ff2281024d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff210004940 tx=0x7ff210009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:09.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.175+0000 7ff22d3ac700 1 -- 172.21.15.47:0/2889747308 shutdown_connections 2024-02-07T12:26:09.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.175+0000 7ff22d3ac700 1 --2- 172.21.15.47:0/2889747308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2281000f0 0x7ff2281024d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:09.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.175+0000 7ff22d3ac700 1 --2- 172.21.15.47:0/2889747308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff228066bf0 0x7ff2280ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:09.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.175+0000 7ff22d3ac700 1 -- 172.21.15.47:0/2889747308 >> 172.21.15.47:0/2889747308 conn(0x7ff2280f75c0 msgr2=0x7ff2280f99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:09.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.175+0000 7ff22d3ac700 1 -- 172.21.15.47:0/2889747308 shutdown_connections 2024-02-07T12:26:09.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.175+0000 7ff22d3ac700 1 -- 172.21.15.47:0/2889747308 wait complete. 2024-02-07T12:26:09.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.176+0000 7ff22d3ac700 1 Processor -- start 2024-02-07T12:26:09.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.176+0000 7ff22d3ac700 1 -- start start 2024-02-07T12:26:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.176+0000 7ff22d3ac700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff228066bf0 0x7ff22810d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.176+0000 7ff22d3ac700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2281000f0 0x7ff22810de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.176+0000 7ff22d3ac700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22810e430 con 0x7ff228066bf0 2024-02-07T12:26:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.176+0000 7ff22d3ac700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22810ecd0 con 0x7ff2281000f0 2024-02-07T12:26:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.176+0000 7ff226ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff228066bf0 0x7ff22810d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.176+0000 7ff226ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff228066bf0 0x7ff22810d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42178/0 (socket says 172.21.15.47:42178) 2024-02-07T12:26:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.176+0000 7ff226ffd700 1 -- 172.21.15.47:0/3605039529 learned_addr learned my addr 172.21.15.47:0/3605039529 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.177+0000 7ff226ffd700 1 -- 172.21.15.47:0/3605039529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2281000f0 msgr2=0x7ff22810de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.177+0000 7ff226ffd700 1 --2- 172.21.15.47:0/3605039529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2281000f0 0x7ff22810de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:09.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.177+0000 7ff226ffd700 1 -- 172.21.15.47:0/3605039529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff210005040 con 0x7ff228066bf0 2024-02-07T12:26:09.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.177+0000 7ff226ffd700 1 --2- 172.21.15.47:0/3605039529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff228066bf0 0x7ff22810d8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff218001db0 tx=0x7ff218009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:09.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.177+0000 7ff21f7fe700 1 -- 172.21.15.47:0/3605039529 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff21800ed50 con 0x7ff228066bf0 2024-02-07T12:26:09.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.177+0000 7ff21f7fe700 1 -- 172.21.15.47:0/3605039529 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff218007df0 con 0x7ff228066bf0 2024-02-07T12:26:09.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.177+0000 7ff22d3ac700 1 -- 172.21.15.47:0/3605039529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22810efb0 con 0x7ff228066bf0 2024-02-07T12:26:09.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.177+0000 7ff21f7fe700 1 -- 172.21.15.47:0/3605039529 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff218014640 con 0x7ff228066bf0 2024-02-07T12:26:09.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.177+0000 7ff22d3ac700 1 -- 172.21.15.47:0/3605039529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22810f4f0 con 0x7ff228066bf0 2024-02-07T12:26:09.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.178+0000 7ff22d3ac700 1 -- 172.21.15.47:0/3605039529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22804bed0 con 0x7ff228066bf0 2024-02-07T12:26:09.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.178+0000 7ff21f7fe700 1 -- 172.21.15.47:0/3605039529 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7ff218009360 con 0x7ff228066bf0 2024-02-07T12:26:09.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.179+0000 7ff21f7fe700 1 --2- 172.21.15.47:0/3605039529 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7ff21406b140 0x7ff21406d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:09.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.179+0000 7ff21f7fe700 1 -- 172.21.15.47:0/3605039529 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff218089a10 con 0x7ff228066bf0 2024-02-07T12:26:09.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.179+0000 7ff2267fc700 1 --2- 172.21.15.47:0/3605039529 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7ff21406b140 0x7ff21406d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:09.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.180+0000 7ff2267fc700 1 --2- 172.21.15.47:0/3605039529 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7ff21406b140 0x7ff21406d5f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff210004f90 tx=0x7ff210009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:09.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.184+0000 7ff21f7fe700 1 -- 172.21.15.47:0/3605039529 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7ff21804f620 con 0x7ff228066bf0 2024-02-07T12:26:09.294 INFO:tasks.workunit.client.0.smithi047.stdout:6/884: sync 2024-02-07T12:26:09.294 INFO:tasks.workunit.client.0.smithi047.stdout:6/885: chown d3/da/d14/c68 403 1 2024-02-07T12:26:09.294 INFO:tasks.workunit.client.0.smithi047.stdout:6/886: rmdir d3/da/d14 39 2024-02-07T12:26:09.295 INFO:tasks.workunit.client.0.smithi047.stdout:6/887: write d3/da/fed [69124,86471] 0 2024-02-07T12:26:09.295 INFO:tasks.workunit.client.0.smithi047.stdout:6/888: creat d3/da/d34/de8/f126 x:0 0 0 2024-02-07T12:26:09.295 INFO:tasks.workunit.client.0.smithi047.stdout:6/889: write d3/da/d2c/f7c [316695,64983] 0 2024-02-07T12:26:09.295 INFO:tasks.workunit.client.0.smithi047.stdout:6/890: write d3/da/d14/f36 [872623,107554] 0 2024-02-07T12:26:09.296 INFO:tasks.workunit.client.0.smithi047.stdout:6/891: chown d3/da/d14/d28/d46/d94/le6 841557 1 2024-02-07T12:26:09.296 INFO:tasks.workunit.client.0.smithi047.stdout:6/892: truncate d3/d5/d35/f63 1685781 0 2024-02-07T12:26:09.296 INFO:tasks.workunit.client.0.smithi047.stdout:6/893: write d3/da/d14/f62 [511348,122811] 0 2024-02-07T12:26:09.306 INFO:tasks.workunit.client.0.smithi047.stdout:6/894: rename d3/d5/d35/d3c/d72/d8c to d3/d5/d35/d127 0 2024-02-07T12:26:09.306 INFO:tasks.workunit.client.0.smithi047.stdout:6/895: fdatasync d3/da/d3b/df6/f69 0 2024-02-07T12:26:09.306 INFO:tasks.workunit.client.0.smithi047.stdout:6/896: dread - d3/da/d14/d28/d46/fc9 zero size 2024-02-07T12:26:09.307 INFO:tasks.workunit.client.0.smithi047.stdout:6/897: mknod d3/da/d14/d28/d46/d94/c128 0 2024-02-07T12:26:09.309 INFO:tasks.workunit.client.0.smithi047.stdout:6/898: mknod d3/da/d3b/d87/dc1/c129 0 2024-02-07T12:26:09.318 INFO:tasks.workunit.client.0.smithi047.stdout:6/899: dread d3/d5/d35/d3c/dd4/f67 [0,4194304] 0 2024-02-07T12:26:09.318 INFO:tasks.workunit.client.0.smithi047.stdout:6/900: chown d3/da/d14/d28/ffa 312606 1 2024-02-07T12:26:09.319 INFO:tasks.workunit.client.0.smithi047.stdout:6/901: mknod d3/da/d2c/d42/c12a 0 2024-02-07T12:26:09.319 INFO:tasks.workunit.client.0.smithi047.stdout:6/902: readlink d3/d5/l116 0 2024-02-07T12:26:09.320 INFO:tasks.workunit.client.0.smithi047.stdout:6/903: getdents d3/da/d3b/d87/de4 0 2024-02-07T12:26:09.321 INFO:tasks.workunit.client.0.smithi047.stdout:6/904: mkdir d3/da/d2c/d47/d12b 0 2024-02-07T12:26:09.323 INFO:tasks.workunit.client.0.smithi047.stdout:6/905: truncate d3/d5/d35/f63 748418 0 2024-02-07T12:26:09.325 INFO:tasks.workunit.client.0.smithi047.stdout:6/906: creat d3/da/d2c/d47/d12b/f12c x:0 0 0 2024-02-07T12:26:09.325 INFO:tasks.workunit.client.0.smithi047.stdout:6/907: readlink d3/l65 0 2024-02-07T12:26:09.329 INFO:tasks.workunit.client.0.smithi047.stdout:6/908: rename d3/d5/d35/d3c/d72/c9b to d3/da/d14/d9e/c12d 0 2024-02-07T12:26:09.329 INFO:tasks.workunit.client.0.smithi047.stdout:6/909: read - d3/d5/d35/f11d zero size 2024-02-07T12:26:09.329 INFO:tasks.workunit.client.0.smithi047.stdout:6/910: chown d3/da/d34/d6d/d8f/db3/dbc/df5/c10c 28778941 1 2024-02-07T12:26:09.351 INFO:tasks.workunit.client.0.smithi047.stdout:6/911: dwrite d3/d5/d35/d3c/dd4/f67 [0,4194304] 0 2024-02-07T12:26:09.351 INFO:tasks.workunit.client.0.smithi047.stdout:6/912: rename d3/da/d14/d28 to d3/da/d14/d28/d12e 22 2024-02-07T12:26:09.371 INFO:tasks.workunit.client.0.smithi047.stdout:6/913: dwrite d3/da/d2c/f8b [0,4194304] 0 2024-02-07T12:26:09.373 INFO:tasks.workunit.client.0.smithi047.stdout:6/914: link d3/da/d34/lf3 d3/da/d34/d6d/l12f 0 2024-02-07T12:26:09.376 INFO:tasks.workunit.client.0.smithi047.stdout:6/915: rename d3/da/da9/fab to d3/d5/d35/f130 0 2024-02-07T12:26:09.376 INFO:tasks.workunit.client.0.smithi047.stdout:6/916: chown d3/da/d14/d28/d46/f113 13625668 1 2024-02-07T12:26:09.376 INFO:tasks.workunit.client.0.smithi047.stdout:6/917: fsync d3/da/d2c/fdb 0 2024-02-07T12:26:09.376 INFO:tasks.workunit.client.0.smithi047.stdout:6/918: chown d3/d5/d35/f3d 0 1 2024-02-07T12:26:09.387 INFO:tasks.workunit.client.0.smithi047.stdout:6/919: dread d3/da/d3b/d87/dc1/fc3 [0,4194304] 0 2024-02-07T12:26:09.399 INFO:tasks.workunit.client.0.smithi047.stdout:6/920: dread d3/d5/d35/d127/d91/fd6 [0,4194304] 0 2024-02-07T12:26:09.399 INFO:tasks.workunit.client.0.smithi047.stdout:6/921: rmdir d3/da/d34/d6d/d8f/db3 39 2024-02-07T12:26:09.401 INFO:tasks.workunit.client.0.smithi047.stdout:6/922: truncate d3/da/d2c/d42/f57 431632 0 2024-02-07T12:26:09.407 INFO:tasks.workunit.client.0.smithi047.stdout:6/923: rename d3/d5/f5d to d3/da/d3b/d87/de4/f131 0 2024-02-07T12:26:09.415 INFO:tasks.workunit.client.0.smithi047.stdout:3/974: sync 2024-02-07T12:26:09.415 INFO:tasks.workunit.client.0.smithi047.stdout:9/777: sync 2024-02-07T12:26:09.416 INFO:tasks.workunit.client.0.smithi047.stdout:3/975: write d12/d19/d2d/d33/f7f [3435421,122697] 0 2024-02-07T12:26:09.418 INFO:tasks.workunit.client.0.smithi047.stdout:9/778: mknod d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/dd6/c113 0 2024-02-07T12:26:09.419 INFO:tasks.workunit.client.0.smithi047.stdout:3/976: link d12/d19/d2d/c11d d12/d19/d2d/c142 0 2024-02-07T12:26:09.425 INFO:tasks.workunit.client.0.smithi047.stdout:6/924: dwrite d3/d5/d35/f101 [0,4194304] 0 2024-02-07T12:26:09.426 INFO:tasks.workunit.client.0.smithi047.stdout:3/977: dread d12/d19/d2d/f8b [0,4194304] 0 2024-02-07T12:26:09.427 INFO:tasks.workunit.client.0.smithi047.stdout:3/978: dread d12/dc7/d29/f81 [4194304,4194304] 0 2024-02-07T12:26:09.427 INFO:tasks.workunit.client.0.smithi047.stdout:3/979: fsync d12/dc7/d29/d6f/d93/dba/dbf/f80 0 2024-02-07T12:26:09.428 INFO:tasks.workunit.client.0.smithi047.stdout:6/925: creat d3/da/d34/d6d/d8f/db3/dbc/d112/f132 x:0 0 0 2024-02-07T12:26:09.429 INFO:tasks.workunit.client.0.smithi047.stdout:6/926: link d3/d5/d35/d3c/d90/ld5 d3/da/d34/l133 0 2024-02-07T12:26:09.430 INFO:tasks.workunit.client.0.smithi047.stdout:3/980: creat d12/dc7/d29/d31/d7c/d12f/f143 x:0 0 0 2024-02-07T12:26:09.433 INFO:tasks.workunit.client.0.smithi047.stdout:9/779: dwrite d3/d10/d18/d3b/fc9 [0,4194304] 0 2024-02-07T12:26:09.438 INFO:tasks.workunit.client.0.smithi047.stdout:3/981: dread d12/d19/f1e [0,4194304] 0 2024-02-07T12:26:09.438 INFO:tasks.workunit.client.0.smithi047.stdout:3/982: dread - d12/fc0 zero size 2024-02-07T12:26:09.439 INFO:tasks.workunit.client.0.smithi047.stdout:3/983: getdents d12/dc7/d29/d6f/d93/dba/dbf 0 2024-02-07T12:26:09.441 INFO:tasks.workunit.client.0.smithi047.stdout:6/927: getdents d3/da/d34/d6d/d8f/db3/dbc/d112 0 2024-02-07T12:26:09.441 INFO:tasks.workunit.client.0.smithi047.stdout:9/780: dread d3/f85 [0,4194304] 0 2024-02-07T12:26:09.443 INFO:tasks.workunit.client.0.smithi047.stdout:3/984: unlink d12/dc7/d29/d31/d38/d59/f5f 0 2024-02-07T12:26:09.443 INFO:tasks.workunit.client.0.smithi047.stdout:9/781: symlink d3/d10/d18/d3a/l114 0 2024-02-07T12:26:09.444 INFO:tasks.workunit.client.0.smithi047.stdout:9/782: rmdir d3 39 2024-02-07T12:26:09.445 INFO:tasks.workunit.client.0.smithi047.stdout:3/985: link d12/d19/c23 d12/d19/d2d/d42/d6b/c144 0 2024-02-07T12:26:09.452 INFO:tasks.workunit.client.0.smithi047.stdout:9/783: dread d3/d10/d18/d3b/fc9 [0,4194304] 0 2024-02-07T12:26:09.455 INFO:tasks.workunit.client.0.smithi047.stdout:3/986: write d12/dc7/d29/d31/d38/d59/de6/f72 [3659269,10861] 0 2024-02-07T12:26:09.457 INFO:tasks.workunit.client.0.smithi047.stdout:3/987: unlink d12/d19/d37/f74 0 2024-02-07T12:26:09.458 INFO:tasks.workunit.client.0.smithi047.stdout:3/988: chown d12/dc7/d29/f2f 1534 1 2024-02-07T12:26:09.459 INFO:tasks.workunit.client.0.smithi047.stdout:3/989: creat d12/dc7/d29/d31/d38/d59/de6/d135/f145 x:0 0 0 2024-02-07T12:26:09.460 INFO:tasks.workunit.client.0.smithi047.stdout:3/990: mkdir d12/dc7/d90/d146 0 2024-02-07T12:26:09.461 INFO:tasks.workunit.client.0.smithi047.stdout:3/991: read - d12/dc7/d29/d6f/d93/dac/ff9 zero size 2024-02-07T12:26:09.461 INFO:tasks.workunit.client.0.smithi047.stdout:9/784: write d3/d10/d4c/f5b [626569,125887] 0 2024-02-07T12:26:09.462 INFO:tasks.workunit.client.0.smithi047.stdout:3/992: symlink d12/d19/d2d/d42/l147 0 2024-02-07T12:26:09.463 INFO:tasks.workunit.client.0.smithi047.stdout:9/785: creat d3/f115 x:0 0 0 2024-02-07T12:26:09.463 INFO:tasks.workunit.client.0.smithi047.stdout:9/786: truncate d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/fe8 965301 0 2024-02-07T12:26:09.465 INFO:tasks.workunit.client.0.smithi047.stdout:9/787: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/f116 x:0 0 0 2024-02-07T12:26:09.465 INFO:tasks.workunit.client.0.smithi047.stdout:9/788: read d3/d10/f4b [3736861,119372] 0 2024-02-07T12:26:09.466 INFO:tasks.workunit.client.0.smithi047.stdout:9/789: rename d3/d10/d18/d3b/d3c/d5d/d70/dad/lc8 to d3/d10/d18/d6e/l117 0 2024-02-07T12:26:09.467 INFO:tasks.workunit.client.0.smithi047.stdout:9/790: fsync d3/d10/d18/d3b/d3c/d5d/d68/f10a 0 2024-02-07T12:26:09.474 INFO:tasks.workunit.client.0.smithi047.stdout:9/791: dread d3/d10/d18/d3d/f37 [0,4194304] 0 2024-02-07T12:26:09.478 INFO:tasks.workunit.client.0.smithi047.stdout:9/792: dread d3/f85 [0,4194304] 0 2024-02-07T12:26:09.479 INFO:tasks.workunit.client.0.smithi047.stdout:9/793: creat d3/d10/d18/d3a/f118 x:0 0 0 2024-02-07T12:26:09.481 INFO:tasks.workunit.client.0.smithi047.stdout:9/794: mknod d3/d10/d18/d3b/d3c/d5d/d70/c119 0 2024-02-07T12:26:09.488 INFO:tasks.workunit.client.0.smithi047.stdout:3/993: dwrite d12/dc7/d29/f81 [0,4194304] 0 2024-02-07T12:26:09.489 INFO:tasks.workunit.client.0.smithi047.stdout:3/994: mknod d12/dc7/d29/d31/d38/d59/de6/d135/c148 0 2024-02-07T12:26:09.490 INFO:tasks.workunit.client.0.smithi047.stdout:3/995: getdents d12/d19/d37 0 2024-02-07T12:26:09.491 INFO:tasks.workunit.client.0.smithi047.stdout:3/996: mkdir d12/dc7/d29/d31/d7c/d12f/d149 0 2024-02-07T12:26:09.492 INFO:tasks.workunit.client.0.smithi047.stdout:3/997: fdatasync d12/dc7/fe7 0 2024-02-07T12:26:09.492 INFO:tasks.workunit.client.0.smithi047.stdout:3/998: readlink d12/dc7/l13e 0 2024-02-07T12:26:09.495 INFO:tasks.workunit.client.0.smithi047.stdout:9/795: write d3/d10/f60 [3041226,90683] 0 2024-02-07T12:26:09.500 INFO:tasks.workunit.client.0.smithi047.stdout:3/999: read d12/d19/fde [486004,73916] 0 2024-02-07T12:26:09.501 INFO:tasks.workunit.client.0.smithi047.stdout:9/796: dread d3/d10/d18/d3a/f44 [0,4194304] 0 2024-02-07T12:26:09.502 INFO:tasks.workunit.client.0.smithi047.stdout:9/797: mkdir d3/d10/d4c/d105/d11a 0 2024-02-07T12:26:09.502 INFO:tasks.workunit.client.0.smithi047.stdout:9/798: readlink d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/l7e 0 2024-02-07T12:26:09.502 INFO:tasks.workunit.client.0.smithi047.stdout:9/799: creat d3/d10/d18/d3b/f11b x:0 0 0 2024-02-07T12:26:09.503 INFO:tasks.workunit.client.0.smithi047.stdout:9/800: creat d3/d10/d18/f11c x:0 0 0 2024-02-07T12:26:09.520 INFO:tasks.workunit.client.0.smithi047.stdout:9/801: dwrite d3/d10/d18/f1a [4194304,4194304] 0 2024-02-07T12:26:09.521 INFO:tasks.workunit.client.0.smithi047.stdout:9/802: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/de6/f11d x:0 0 0 2024-02-07T12:26:09.522 INFO:tasks.workunit.client.0.smithi047.stdout:9/803: chown d3/f9 24465 1 2024-02-07T12:26:09.522 INFO:tasks.workunit.client.0.smithi047.stdout:9/804: chown d3/d10/d18/d3b/d3c/d5d/d70/l104 821709462 1 2024-02-07T12:26:09.522 INFO:tasks.workunit.client.0.smithi047.stdout:9/805: dread - d3/d10/d18/d3d/d79/fef zero size 2024-02-07T12:26:09.522 INFO:tasks.workunit.client.0.smithi047.stdout:9/806: creat d3/f11e x:0 0 0 2024-02-07T12:26:09.536 INFO:tasks.workunit.client.0.smithi047.stdout:9/807: dwrite d3/fdd [4194304,4194304] 0 2024-02-07T12:26:09.537 INFO:tasks.workunit.client.0.smithi047.stdout:9/808: creat d3/d10/d18/d3b/d3c/d47/f11f x:0 0 0 2024-02-07T12:26:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.589+0000 7ff22d3ac700 1 -- 172.21.15.47:0/3605039529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff2280008d0 con 0x7ff228066bf0 2024-02-07T12:26:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.589+0000 7ff21f7fe700 1 -- 172.21.15.47:0/3605039529 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff218057650 con 0x7ff228066bf0 2024-02-07T12:26:09.592 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:26:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.591+0000 7ff22d3ac700 1 -- 172.21.15.47:0/3605039529 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7ff21406b140 msgr2=0x7ff21406d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.591+0000 7ff22d3ac700 1 --2- 172.21.15.47:0/3605039529 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7ff21406b140 0x7ff21406d5f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff210004f90 tx=0x7ff210009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.591+0000 7ff22d3ac700 1 -- 172.21.15.47:0/3605039529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff228066bf0 msgr2=0x7ff22810d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.591+0000 7ff22d3ac700 1 --2- 172.21.15.47:0/3605039529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff228066bf0 0x7ff22810d8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff218001db0 tx=0x7ff218009ee0 comp rx=0 tx=0).stop 2024-02-07T12:26:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.591+0000 7ff22d3ac700 1 -- 172.21.15.47:0/3605039529 shutdown_connections 2024-02-07T12:26:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.591+0000 7ff22d3ac700 1 --2- 172.21.15.47:0/3605039529 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7ff21406b140 0x7ff21406d5f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.591+0000 7ff22d3ac700 1 --2- 172.21.15.47:0/3605039529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff228066bf0 0x7ff22810d8f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.591+0000 7ff22d3ac700 1 --2- 172.21.15.47:0/3605039529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2281000f0 0x7ff22810de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.591+0000 7ff22d3ac700 1 -- 172.21.15.47:0/3605039529 >> 172.21.15.47:0/3605039529 conn(0x7ff2280f75c0 msgr2=0x7ff2280f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.591+0000 7ff22d3ac700 1 -- 172.21.15.47:0/3605039529 shutdown_connections 2024-02-07T12:26:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:09.591+0000 7ff22d3ac700 1 -- 172.21.15.47:0/3605039529 wait complete. 2024-02-07T12:26:09.641 INFO:tasks.workunit.client.0.smithi047.stdout:8/949: sync 2024-02-07T12:26:09.641 INFO:tasks.workunit.client.0.smithi047.stdout:1/671: sync 2024-02-07T12:26:09.641 INFO:tasks.workunit.client.0.smithi047.stdout:2/970: sync 2024-02-07T12:26:09.642 INFO:tasks.workunit.client.0.smithi047.stdout:0/758: sync 2024-02-07T12:26:09.642 INFO:tasks.workunit.client.0.smithi047.stdout:2/971: chown d7/dc/d4c/de4/f106 2 1 2024-02-07T12:26:09.642 INFO:tasks.workunit.client.0.smithi047.stdout:0/759: getdents d19/d25 0 2024-02-07T12:26:09.643 INFO:tasks.workunit.client.0.smithi047.stdout:1/672: link d1/d48/lcd d1/d15/db9/lde 0 2024-02-07T12:26:09.645 INFO:tasks.workunit.client.0.smithi047.stdout:2/972: write d7/f62 [47888,91554] 0 2024-02-07T12:26:09.645 INFO:tasks.workunit.client.0.smithi047.stdout:2/973: stat d7/d2d/f6d 0 2024-02-07T12:26:09.646 INFO:tasks.workunit.client.0.smithi047.stdout:2/974: write d7/dc/d51/dda/d113/f124 [556198,22055] 0 2024-02-07T12:26:09.661 INFO:tasks.workunit.client.0.smithi047.stdout:8/950: dwrite d3/d4/d4d/fc5 [0,4194304] 0 2024-02-07T12:26:09.663 INFO:tasks.workunit.client.0.smithi047.stdout:8/951: creat d3/d36/d9d/dbe/df5/df9/f143 x:0 0 0 2024-02-07T12:26:09.664 INFO:tasks.workunit.client.0.smithi047.stdout:8/952: mknod d3/d66/d67/d71/c144 0 2024-02-07T12:26:09.665 INFO:tasks.workunit.client.0.smithi047.stdout:8/953: truncate d3/d4/d59/f106 634689 0 2024-02-07T12:26:09.667 INFO:tasks.workunit.client.0.smithi047.stdout:8/954: truncate d3/d36/d50/d30/d9e/da6/f64 96606 0 2024-02-07T12:26:09.675 INFO:tasks.workunit.client.0.smithi047.stdout:1/673: dwrite d1/d6e/dcf/d3e/f4a [0,4194304] 0 2024-02-07T12:26:09.675 INFO:tasks.workunit.client.0.smithi047.stdout:1/674: creat d1/d37/fdf x:0 0 0 2024-02-07T12:26:09.675 INFO:tasks.workunit.client.0.smithi047.stdout:1/675: truncate d1/d6e/dcf/d3e/f4a 4271543 0 2024-02-07T12:26:09.675 INFO:tasks.workunit.client.0.smithi047.stdout:1/676: fdatasync d1/d6e/dcf/d84/fa1 0 2024-02-07T12:26:09.675 INFO:tasks.workunit.client.0.smithi047.stdout:1/677: chown d1/d6e/dcf/d3e/f4a 5959 1 2024-02-07T12:26:09.675 INFO:tasks.workunit.client.0.smithi047.stdout:0/760: dwrite d19/d40/d66/d46/dc6/ff5 [0,4194304] 0 2024-02-07T12:26:09.675 INFO:tasks.workunit.client.0.smithi047.stdout:2/975: dwrite d7/d2d/d5c/d77/fe2 [0,4194304] 0 2024-02-07T12:26:09.679 INFO:tasks.workunit.client.0.smithi047.stdout:0/761: link d19/d1c/d24/db1/cdf d19/d1c/d3c/d48/cf9 0 2024-02-07T12:26:09.680 INFO:tasks.workunit.client.0.smithi047.stdout:8/955: dwrite d3/d4/d4d/fb1 [0,4194304] 0 2024-02-07T12:26:09.693 INFO:tasks.workunit.client.0.smithi047.stdout:0/762: dread d19/d1c/d3c/d60/d6f/d95/daa/d49/f79 [0,4194304] 0 2024-02-07T12:26:09.693 INFO:tasks.workunit.client.0.smithi047.stdout:0/763: chown d19/d40/d66/da9/faf 67615 1 2024-02-07T12:26:09.694 INFO:tasks.workunit.client.0.smithi047.stdout:1/678: dwrite d1/d6e/dcf/d84/fa1 [0,4194304] 0 2024-02-07T12:26:09.696 INFO:tasks.workunit.client.0.smithi047.stdout:1/679: mkdir d1/d6e/dcf/d3e/dbb/de0 0 2024-02-07T12:26:09.697 INFO:tasks.workunit.client.0.smithi047.stdout:1/680: creat d1/d6e/d75/da7/fe1 x:0 0 0 2024-02-07T12:26:09.697 INFO:tasks.workunit.client.0.smithi047.stdout:1/681: write d1/d48/d74/fa3 [3204016,68327] 0 2024-02-07T12:26:09.715 INFO:tasks.workunit.client.0.smithi047.stdout:1/682: dwrite d1/d2a/f97 [0,4194304] 0 2024-02-07T12:26:09.716 INFO:tasks.workunit.client.0.smithi047.stdout:1/683: unlink d1/d6e/d75/da7/d40/f56 0 2024-02-07T12:26:09.718 INFO:tasks.workunit.client.0.smithi047.stdout:1/684: dread d1/d15/d30/d46/f59 [0,4194304] 0 2024-02-07T12:26:09.718 INFO:tasks.workunit.client.0.smithi047.stdout:1/685: write d1/d6e/dcf/f5c [5662868,30799] 0 2024-02-07T12:26:09.719 INFO:tasks.workunit.client.0.smithi047.stdout:1/686: creat d1/d15/db9/fe2 x:0 0 0 2024-02-07T12:26:09.728 INFO:tasks.workunit.client.0.smithi047.stdout:1/687: dread d1/d6e/d75/da7/f23 [0,4194304] 0 2024-02-07T12:26:09.728 INFO:tasks.workunit.client.0.smithi047.stdout:1/688: fsync d1/d6e/dcf/d84/fa1 0 2024-02-07T12:26:09.729 INFO:tasks.workunit.client.0.smithi047.stdout:1/689: unlink d1/d15/d30/c32 0 2024-02-07T12:26:09.731 INFO:tasks.workunit.client.0.smithi047.stdout:1/690: rename d1/d15/d30/d46/d66/dac/db7 to d1/d15/d2f/de3 0 2024-02-07T12:26:09.732 INFO:tasks.workunit.client.0.smithi047.stdout:1/691: rmdir d1/d15/d30/d46/dda 0 2024-02-07T12:26:09.734 INFO:tasks.workunit.client.0.smithi047.stdout:1/692: getdents d1/d2a 0 2024-02-07T12:26:09.736 INFO:tasks.workunit.client.0.smithi047.stdout:1/693: rename d1/d6e/dcf/f5c to d1/d15/d2f/de3/fe4 0 2024-02-07T12:26:09.736 INFO:tasks.workunit.client.0.smithi047.stdout:1/694: write d1/d37/fdf [113198,77388] 0 2024-02-07T12:26:09.750 INFO:tasks.workunit.client.0.smithi047.stdout:1/695: dwrite d1/d15/d30/d46/f59 [0,4194304] 0 2024-02-07T12:26:09.750 INFO:tasks.workunit.client.0.smithi047.stdout:1/696: chown d1/d6e/dcf/d3e/f4a 3135 1 2024-02-07T12:26:09.751 INFO:tasks.workunit.client.0.smithi047.stdout:1/697: dread - d1/d6e/d75/da7/d65/fba zero size 2024-02-07T12:26:09.751 INFO:tasks.workunit.client.0.smithi047.stdout:1/698: truncate d1/d15/db9/fe2 371013 0 2024-02-07T12:26:09.751 INFO:tasks.workunit.client.0.smithi047.stdout:1/699: symlink d1/d15/d30/d46/d66/le5 0 2024-02-07T12:26:09.761 INFO:tasks.workunit.client.0.smithi047.stdout:1/700: dread d1/f87 [0,4194304] 0 2024-02-07T12:26:09.767 INFO:tasks.workunit.client.0.smithi047.stdout:1/701: write d1/d6e/dcf/d3e/f4a [404264,75628] 0 2024-02-07T12:26:09.767 INFO:tasks.workunit.client.0.smithi047.stdout:1/702: fsync d1/d48/d74/fc0 0 2024-02-07T12:26:09.768 INFO:tasks.workunit.client.0.smithi047.stdout:1/703: truncate d1/d15/db9/fe2 761288 0 2024-02-07T12:26:09.769 INFO:tasks.workunit.client.0.smithi047.stdout:1/704: link d1/d15/d30/d46/d66/lc2 d1/d48/le6 0 2024-02-07T12:26:09.772 INFO:tasks.workunit.client.0.smithi047.stdout:1/705: getdents d1/d15/d30/d46/d66 0 2024-02-07T12:26:09.781 INFO:tasks.workunit.client.0.smithi047.stdout:1/706: dread d1/d6e/d75/da7/f2b [4194304,4194304] 0 2024-02-07T12:26:09.782 INFO:tasks.workunit.client.0.smithi047.stdout:1/707: rename d1/d6e/dcf/d84/fa8 to d1/d37/fe7 0 2024-02-07T12:26:09.782 INFO:tasks.workunit.client.0.smithi047.stdout:1/708: readlink d1/d2a/l95 0 2024-02-07T12:26:09.921 INFO:tasks.workunit.client.0.smithi047.stdout:6/928: sync 2024-02-07T12:26:09.921 INFO:tasks.workunit.client.0.smithi047.stdout:6/929: write d3/da/d14/f62 [966207,17921] 0 2024-02-07T12:26:09.922 INFO:tasks.workunit.client.0.smithi047.stdout:6/930: creat d3/d5/d35/d3c/d72/f134 x:0 0 0 2024-02-07T12:26:09.923 INFO:tasks.workunit.client.0.smithi047.stdout:6/931: chown d3/da/d14/d28/d46/d94/c128 13344 1 2024-02-07T12:26:09.924 INFO:tasks.workunit.client.0.smithi047.stdout:6/932: symlink d3/d5/d35/d127/l135 0 2024-02-07T12:26:09.924 INFO:tasks.workunit.client.0.smithi047.stdout:6/933: creat d3/da/d34/f136 x:0 0 0 2024-02-07T12:26:09.926 INFO:tasks.workunit.client.0.smithi047.stdout:6/934: unlink d3/da/d14/f1c 0 2024-02-07T12:26:09.928 INFO:tasks.workunit.client.0.smithi047.stdout:6/935: creat d3/d5/d11c/f137 x:0 0 0 2024-02-07T12:26:09.928 INFO:tasks.workunit.client.0.smithi047.stdout:6/936: truncate d3/d5/d35/d3c/d72/f134 902466 0 2024-02-07T12:26:09.928 INFO:tasks.workunit.client.0.smithi047.stdout:6/937: creat d3/da/d34/de8/f138 x:0 0 0 2024-02-07T12:26:09.936 INFO:tasks.workunit.client.0.smithi047.stdout:6/938: dread d3/da/d3b/d87/de4/ff9 [0,4194304] 0 2024-02-07T12:26:09.936 INFO:tasks.workunit.client.0.smithi047.stdout:6/939: chown d3/da/d14/d28/d46/d94 19530552 1 2024-02-07T12:26:09.937 INFO:tasks.workunit.client.0.smithi047.stdout:6/940: write d3/d5/d35/d127/f93 [895933,70920] 0 2024-02-07T12:26:10.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:09 smithi138 ceph-mon[35528]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:10.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:09 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3605039529' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:26:10.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:09 smithi047 ceph-mon[28972]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:10.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:09 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3605039529' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:26:10.218 INFO:tasks.workunit.client.0.smithi047.stdout:9/809: sync 2024-02-07T12:26:10.218 INFO:tasks.workunit.client.0.smithi047.stdout:9/810: creat d3/d10/d4c/d105/d11a/f120 x:0 0 0 2024-02-07T12:26:10.236 INFO:tasks.workunit.client.0.smithi047.stdout:9/811: dwrite d3/d10/d18/d3b/f50 [0,4194304] 0 2024-02-07T12:26:10.251 INFO:tasks.workunit.client.0.smithi047.stdout:9/812: dwrite d3/d10/d18/d3b/d3c/d5d/d68/ff7 [0,4194304] 0 2024-02-07T12:26:10.253 INFO:tasks.workunit.client.0.smithi047.stdout:8/956: sync 2024-02-07T12:26:10.253 INFO:tasks.workunit.client.0.smithi047.stdout:1/709: sync 2024-02-07T12:26:10.253 INFO:tasks.workunit.client.0.smithi047.stdout:0/764: sync 2024-02-07T12:26:10.253 INFO:tasks.workunit.client.0.smithi047.stdout:2/976: sync 2024-02-07T12:26:10.257 INFO:tasks.workunit.client.0.smithi047.stdout:2/977: creat d7/d48/d72/db7/d13b/f13c x:0 0 0 2024-02-07T12:26:10.258 INFO:tasks.workunit.client.0.smithi047.stdout:1/710: mkdir d1/d6e/d75/da7/d65/de8 0 2024-02-07T12:26:10.260 INFO:tasks.workunit.client.0.smithi047.stdout:0/765: creat d19/d1c/d2b/d5f/ffa x:0 0 0 2024-02-07T12:26:10.260 INFO:tasks.workunit.client.0.smithi047.stdout:0/766: chown d19/d40/l4f 6504943 1 2024-02-07T12:26:10.260 INFO:tasks.workunit.client.0.smithi047.stdout:0/767: chown d19/d1c/cb7 2132044223 1 2024-02-07T12:26:10.263 INFO:tasks.workunit.client.0.smithi047.stdout:2/978: rename d7/d2d/d5c/c68 to d7/dc/d4c/c13d 0 2024-02-07T12:26:10.263 INFO:tasks.workunit.client.0.smithi047.stdout:2/979: write d7/d48/df0/f10d [47469,70010] 0 2024-02-07T12:26:10.263 INFO:tasks.workunit.client.0.smithi047.stdout:0/768: symlink d19/d1c/d3c/d60/d6f/d95/daa/lfb 0 2024-02-07T12:26:10.267 INFO:tasks.workunit.client.0.smithi047.stdout:0/769: rename f18 to d19/d1c/df1/d82/d9e/df4/ffc 0 2024-02-07T12:26:10.269 INFO:tasks.workunit.client.0.smithi047.stdout:0/770: mkdir d19/d1c/d2b/d5f/d9f/dd3/dfd 0 2024-02-07T12:26:10.271 INFO:tasks.workunit.client.0.smithi047.stdout:9/813: dwrite d3/d10/d18/d3a/f118 [0,4194304] 0 2024-02-07T12:26:10.271 INFO:tasks.workunit.client.0.smithi047.stdout:9/814: write d3/d10/d18/d3b/f10c [787909,44648] 0 2024-02-07T12:26:10.272 INFO:tasks.workunit.client.0.smithi047.stdout:9/815: stat d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4 0 2024-02-07T12:26:10.274 INFO:tasks.workunit.client.0.smithi047.stdout:9/816: creat d3/d10/d18/d3b/dc6/f121 x:0 0 0 2024-02-07T12:26:10.275 INFO:tasks.workunit.client.0.smithi047.stdout:6/941: sync 2024-02-07T12:26:10.276 INFO:tasks.workunit.client.0.smithi047.stdout:9/817: creat d3/d10/d18/d3b/d3c/d5d/d9b/f122 x:0 0 0 2024-02-07T12:26:10.276 INFO:tasks.workunit.client.0.smithi047.stdout:9/818: chown d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90 0 1 2024-02-07T12:26:10.278 INFO:tasks.workunit.client.0.smithi047.stdout:0/771: mknod d19/d1c/d3c/d60/d6f/cfe 0 2024-02-07T12:26:10.278 INFO:tasks.workunit.client.0.smithi047.stdout:0/772: write d19/d1c/df1/dbd/ff3 [889475,65719] 0 2024-02-07T12:26:10.278 INFO:tasks.workunit.client.0.smithi047.stdout:6/942: mknod d3/da/d14/d9e/c139 0 2024-02-07T12:26:10.280 INFO:tasks.workunit.client.0.smithi047.stdout:9/819: dread - d3/d10/d18/fa1 zero size 2024-02-07T12:26:10.281 INFO:tasks.workunit.client.0.smithi047.stdout:0/773: mknod d19/d40/d66/d46/df0/cff 0 2024-02-07T12:26:10.282 INFO:tasks.workunit.client.0.smithi047.stdout:6/943: symlink d3/da/d14/d28/l13a 0 2024-02-07T12:26:10.286 INFO:tasks.workunit.client.0.smithi047.stdout:0/774: creat d19/d40/d66/d46/dc6/f100 x:0 0 0 2024-02-07T12:26:10.287 INFO:tasks.workunit.client.0.smithi047.stdout:8/957: dwrite d3/d36/f6c [0,4194304] 0 2024-02-07T12:26:10.297 INFO:tasks.workunit.client.0.smithi047.stdout:2/980: dwrite d7/dc/f1a [0,4194304] 0 2024-02-07T12:26:10.297 INFO:tasks.workunit.client.0.smithi047.stdout:9/820: dwrite d3/d10/d18/d3b/ffb [0,4194304] 0 2024-02-07T12:26:10.297 INFO:tasks.workunit.client.0.smithi047.stdout:9/821: dread - d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/f112 zero size 2024-02-07T12:26:10.298 INFO:tasks.workunit.client.0.smithi047.stdout:0/775: symlink d19/d40/d66/da9/l101 0 2024-02-07T12:26:10.299 INFO:tasks.workunit.client.0.smithi047.stdout:2/981: link d7/d48/d72/dbf/l10a d7/d48/d72/l13e 0 2024-02-07T12:26:10.300 INFO:tasks.workunit.client.0.smithi047.stdout:0/776: rmdir d19/d1c/d24/db1 39 2024-02-07T12:26:10.302 INFO:tasks.workunit.client.0.smithi047.stdout:8/958: read d3/d66/d67/d6a/d91/f97 [3291649,118235] 0 2024-02-07T12:26:10.302 INFO:tasks.workunit.client.0.smithi047.stdout:8/959: chown d3/d66/d67/d71/d93/dd8/d13e 170550660 1 2024-02-07T12:26:10.304 INFO:tasks.workunit.client.0.smithi047.stdout:8/960: symlink d3/d66/d67/d6a/dea/l145 0 2024-02-07T12:26:10.305 INFO:tasks.workunit.client.0.smithi047.stdout:9/822: link d3/d10/d18/d3b/f10c d3/d10/d18/f123 0 2024-02-07T12:26:10.305 INFO:tasks.workunit.client.0.smithi047.stdout:9/823: write d3/d10/d4c/f5b [2358218,125376] 0 2024-02-07T12:26:10.305 INFO:tasks.workunit.client.0.smithi047.stdout:9/824: chown d3/d10/d18/d3d/dbd 782212 1 2024-02-07T12:26:10.306 INFO:tasks.workunit.client.0.smithi047.stdout:9/825: truncate d3/d10/d18/d3a/f44 5062544 0 2024-02-07T12:26:10.306 INFO:tasks.workunit.client.0.smithi047.stdout:9/826: readlink d3/d10/d18/d3d/l9c 0 2024-02-07T12:26:10.307 INFO:tasks.workunit.client.0.smithi047.stdout:2/982: truncate d7/f23 4120728 0 2024-02-07T12:26:10.307 INFO:tasks.workunit.client.0.smithi047.stdout:2/983: write d7/dc/d4c/f7a [994696,18177] 0 2024-02-07T12:26:10.307 INFO:tasks.workunit.client.0.smithi047.stdout:2/984: stat d7/d48/f7e 0 2024-02-07T12:26:10.310 INFO:tasks.workunit.client.0.smithi047.stdout:8/961: unlink d3/d66/d67/d71/lb0 0 2024-02-07T12:26:10.310 INFO:tasks.workunit.client.0.smithi047.stdout:8/962: dread - d3/dbd/fe3 zero size 2024-02-07T12:26:10.310 INFO:tasks.workunit.client.0.smithi047.stdout:8/963: fsync d3/d36/d50/d30/d9e/da6/f64 0 2024-02-07T12:26:10.311 INFO:tasks.workunit.client.0.smithi047.stdout:2/985: symlink d7/dc/d10f/l13f 0 2024-02-07T12:26:10.314 INFO:tasks.workunit.client.0.smithi047.stdout:8/964: creat d3/d4/f146 x:0 0 0 2024-02-07T12:26:10.314 INFO:tasks.workunit.client.0.smithi047.stdout:8/965: truncate d3/d4/d4d/dc0/f13c 614843 0 2024-02-07T12:26:10.318 INFO:tasks.workunit.client.0.smithi047.stdout:8/966: dread d3/d36/d50/f81 [0,4194304] 0 2024-02-07T12:26:10.320 INFO:tasks.workunit.client.0.smithi047.stdout:8/967: unlink d3/d4/d87/c8d 0 2024-02-07T12:26:10.322 INFO:tasks.workunit.client.0.smithi047.stdout:8/968: rmdir d3/d36/d50/d30/d34/d3e 39 2024-02-07T12:26:10.322 INFO:tasks.workunit.client.0.smithi047.stdout:8/969: write d3/d4/d4d/fb1 [5004070,41464] 0 2024-02-07T12:26:10.324 INFO:tasks.workunit.client.0.smithi047.stdout:8/970: symlink d3/d66/d67/d71/d93/dd8/l147 0 2024-02-07T12:26:10.325 INFO:tasks.workunit.client.0.smithi047.stdout:8/971: creat d3/d4/d87/f148 x:0 0 0 2024-02-07T12:26:10.325 INFO:tasks.workunit.client.0.smithi047.stdout:8/972: write d3/d66/d67/d6a/f92 [877571,92221] 0 2024-02-07T12:26:10.327 INFO:tasks.workunit.client.0.smithi047.stdout:8/973: dread d3/d4/d87/f103 [0,4194304] 0 2024-02-07T12:26:10.330 INFO:tasks.workunit.client.0.smithi047.stdout:8/974: truncate d3/d4/f25 4143831 0 2024-02-07T12:26:10.330 INFO:tasks.workunit.client.0.smithi047.stdout:0/777: dwrite d19/d1c/d3c/f9b [0,4194304] 0 2024-02-07T12:26:10.331 INFO:tasks.workunit.client.0.smithi047.stdout:0/778: dread - d19/d1c/d2b/dc2/fe4 zero size 2024-02-07T12:26:10.331 INFO:tasks.workunit.client.0.smithi047.stdout:6/944: dwrite d3/da/da9/fd2 [0,4194304] 0 2024-02-07T12:26:10.331 INFO:tasks.workunit.client.0.smithi047.stdout:9/827: dwrite d3/d10/d18/d3b/d3c/d5d/d70/fe4 [0,4194304] 0 2024-02-07T12:26:10.331 INFO:tasks.workunit.client.0.smithi047.stdout:9/828: chown d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/f10e 4269559 1 2024-02-07T12:26:10.332 INFO:tasks.workunit.client.0.smithi047.stdout:8/975: mkdir d3/d36/d9d/d149 0 2024-02-07T12:26:10.334 INFO:tasks.workunit.client.0.smithi047.stdout:2/986: dwrite d7/dc/d4c/fbe [0,4194304] 0 2024-02-07T12:26:10.335 INFO:tasks.workunit.client.0.smithi047.stdout:2/987: read d7/dc/d4c/fa2 [19026,71981] 0 2024-02-07T12:26:10.338 INFO:tasks.workunit.client.0.smithi047.stdout:0/779: mknod d19/d1c/d3c/c102 0 2024-02-07T12:26:10.341 INFO:tasks.workunit.client.0.smithi047.stdout:0/780: mkdir d19/d1c/d2b/d5f/d9f/dd3/d103 0 2024-02-07T12:26:10.341 INFO:tasks.workunit.client.0.smithi047.stdout:0/781: dread - d19/d1c/d2b/f71 zero size 2024-02-07T12:26:10.342 INFO:tasks.workunit.client.0.smithi047.stdout:6/945: rename d3/da/f49 to d3/da/f13b 0 2024-02-07T12:26:10.345 INFO:tasks.workunit.client.0.smithi047.stdout:8/976: write d3/d36/d50/d30/d34/d3e/fc7 [106269,29984] 0 2024-02-07T12:26:10.345 INFO:tasks.workunit.client.0.smithi047.stdout:8/977: write d3/d36/d9d/f12b [877116,108839] 0 2024-02-07T12:26:10.347 INFO:tasks.workunit.client.0.smithi047.stdout:0/782: link c6 d19/d40/d66/d46/df0/c104 0 2024-02-07T12:26:10.347 INFO:tasks.workunit.client.0.smithi047.stdout:0/783: readlink d19/d1c/d2b/d5f/d9f/dd3/l9c 0 2024-02-07T12:26:10.347 INFO:tasks.workunit.client.0.smithi047.stdout:0/784: write d19/f8b [193007,34718] 0 2024-02-07T12:26:10.349 INFO:tasks.workunit.client.0.smithi047.stdout:0/785: rmdir d19/d25/dd7 39 2024-02-07T12:26:10.349 INFO:tasks.workunit.client.0.smithi047.stdout:0/786: chown d19/d40/d66/d46/df0/c104 245 1 2024-02-07T12:26:10.350 INFO:tasks.workunit.client.0.smithi047.stdout:9/829: rename d3/f29 to d3/d10/d4c/d105/d11a/f124 0 2024-02-07T12:26:10.352 INFO:tasks.workunit.client.0.smithi047.stdout:0/787: truncate d19/f26 3720574 0 2024-02-07T12:26:10.357 INFO:tasks.workunit.client.0.smithi047.stdout:0/788: symlink d19/d1c/df1/d82/l105 0 2024-02-07T12:26:10.365 INFO:tasks.workunit.client.0.smithi047.stdout:0/789: rmdir d19/d40/d66/d46/dc6 39 2024-02-07T12:26:10.365 INFO:tasks.workunit.client.0.smithi047.stdout:0/790: fsync d19/d1c/d3c/d48/fde 0 2024-02-07T12:26:10.365 INFO:tasks.workunit.client.0.smithi047.stdout:0/791: stat d19/d1c/d2b/d5f/d9f 0 2024-02-07T12:26:10.367 INFO:tasks.workunit.client.0.smithi047.stdout:2/988: creat d7/dc/dd6/dfa/f140 x:0 0 0 2024-02-07T12:26:10.371 INFO:tasks.workunit.client.0.smithi047.stdout:6/946: symlink d3/da/d2c/d47/l13c 0 2024-02-07T12:26:10.371 INFO:tasks.workunit.client.0.smithi047.stdout:6/947: chown d3/d5/d35/d127/d91/fd6 64038 1 2024-02-07T12:26:10.371 INFO:tasks.workunit.client.0.smithi047.stdout:6/948: write d3/da/d14/d28/d9a/f120 [540434,125106] 0 2024-02-07T12:26:10.376 INFO:tasks.workunit.client.0.smithi047.stdout:8/978: symlink d3/d66/d67/d6a/df3/l14a 0 2024-02-07T12:26:10.376 INFO:tasks.workunit.client.0.smithi047.stdout:8/979: readlink d3/d4/d87/l12c 0 2024-02-07T12:26:10.376 INFO:tasks.workunit.client.0.smithi047.stdout:0/792: dread d19/d40/f99 [0,4194304] 0 2024-02-07T12:26:10.376 INFO:tasks.workunit.client.0.smithi047.stdout:9/830: creat d3/d10/d18/d3b/d3c/d5d/d70/dad/f125 x:0 0 0 2024-02-07T12:26:10.380 INFO:tasks.workunit.client.0.smithi047.stdout:2/989: symlink d7/d2d/d5c/d77/d92/l141 0 2024-02-07T12:26:10.381 INFO:tasks.workunit.client.0.smithi047.stdout:0/793: creat d19/d1c/d3c/d60/d6f/d95/f106 x:0 0 0 2024-02-07T12:26:10.382 INFO:tasks.workunit.client.0.smithi047.stdout:2/990: write d7/d2d/f108 [124884,123651] 0 2024-02-07T12:26:10.382 INFO:tasks.workunit.client.0.smithi047.stdout:2/991: read - d7/dc/d4c/d65/fa1 zero size 2024-02-07T12:26:10.382 INFO:tasks.workunit.client.0.smithi047.stdout:2/992: truncate d7/d2d/d5c/ff3 135431 0 2024-02-07T12:26:10.382 INFO:tasks.workunit.client.0.smithi047.stdout:2/993: truncate d7/dc/d4c/d65/fa1 164482 0 2024-02-07T12:26:10.384 INFO:tasks.workunit.client.0.smithi047.stdout:8/980: link d3/d66/d67/d71/d93/d9f/la7 d3/d66/d67/d6a/dca/d104/l14b 0 2024-02-07T12:26:10.385 INFO:tasks.workunit.client.0.smithi047.stdout:0/794: rename d19/d40/l44 to d19/d1c/d2b/d5f/d9f/dd3/dfd/l107 0 2024-02-07T12:26:10.386 INFO:tasks.workunit.client.0.smithi047.stdout:0/795: write d19/d1c/d2b/d5f/f89 [16865,93145] 0 2024-02-07T12:26:10.386 INFO:tasks.workunit.client.0.smithi047.stdout:9/831: symlink d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/l126 0 2024-02-07T12:26:10.389 INFO:tasks.workunit.client.0.smithi047.stdout:2/994: mknod d7/dc/dd6/c142 0 2024-02-07T12:26:10.390 INFO:tasks.workunit.client.0.smithi047.stdout:8/981: truncate d3/d36/f4b 2946775 0 2024-02-07T12:26:10.391 INFO:tasks.workunit.client.0.smithi047.stdout:8/982: truncate d3/d36/d50/fb5 639740 0 2024-02-07T12:26:10.391 INFO:tasks.workunit.client.0.smithi047.stdout:0/796: mkdir d19/d1c/df1/d82/d108 0 2024-02-07T12:26:10.393 INFO:tasks.workunit.client.0.smithi047.stdout:6/949: dwrite d3/da/d14/f88 [0,4194304] 0 2024-02-07T12:26:10.394 INFO:tasks.workunit.client.0.smithi047.stdout:9/832: rename d3/d10/d18/d3b/d3c/d5d/d9b to d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/d127 0 2024-02-07T12:26:10.396 INFO:tasks.workunit.client.0.smithi047.stdout:0/797: symlink d19/d1c/d2b/d5f/d9f/dd3/dfd/l109 0 2024-02-07T12:26:10.396 INFO:tasks.workunit.client.0.smithi047.stdout:0/798: chown d19/l7c 568074407 1 2024-02-07T12:26:10.396 INFO:tasks.workunit.client.0.smithi047.stdout:0/799: dread d19/d1c/d3c/d60/d6f/fac [0,4194304] 0 2024-02-07T12:26:10.397 INFO:tasks.workunit.client.0.smithi047.stdout:0/800: readlink d19/d1c/d3c/d48/l8a 0 2024-02-07T12:26:10.400 INFO:tasks.workunit.client.0.smithi047.stdout:8/983: truncate d3/d4/d4d/fb1 809080 0 2024-02-07T12:26:10.401 INFO:tasks.workunit.client.0.smithi047.stdout:0/801: creat d19/d1c/d3c/d48/f10a x:0 0 0 2024-02-07T12:26:10.403 INFO:tasks.workunit.client.0.smithi047.stdout:0/802: mkdir d19/d1c/d24/db1/d10b 0 2024-02-07T12:26:10.404 INFO:tasks.workunit.client.0.smithi047.stdout:6/950: mknod d3/da/d2c/d42/c13d 0 2024-02-07T12:26:10.405 INFO:tasks.workunit.client.0.smithi047.stdout:8/984: creat d3/d36/d9d/d149/f14c x:0 0 0 2024-02-07T12:26:10.405 INFO:tasks.workunit.client.0.smithi047.stdout:8/985: fsync d3/d66/d67/d6a/f46 0 2024-02-07T12:26:10.405 INFO:tasks.workunit.client.0.smithi047.stdout:0/803: creat d19/d1c/d24/db1/d10b/f10c x:0 0 0 2024-02-07T12:26:10.405 INFO:tasks.workunit.client.0.smithi047.stdout:0/804: dread - d19/d1c/d3c/d60/d6f/d95/f106 zero size 2024-02-07T12:26:10.405 INFO:tasks.workunit.client.0.smithi047.stdout:0/805: fdatasync d19/d1c/d2b/f71 0 2024-02-07T12:26:10.405 INFO:tasks.workunit.client.0.smithi047.stdout:0/806: fsync d19/d1c/d2b/d5f/ffa 0 2024-02-07T12:26:10.405 INFO:tasks.workunit.client.0.smithi047.stdout:0/807: dread - d19/d25/dd7/fc0 zero size 2024-02-07T12:26:10.406 INFO:tasks.workunit.client.0.smithi047.stdout:0/808: symlink d19/d40/d66/d46/df0/l10d 0 2024-02-07T12:26:10.407 INFO:tasks.workunit.client.0.smithi047.stdout:6/951: creat d3/da/d34/d6d/d9f/dd3/f13e x:0 0 0 2024-02-07T12:26:10.407 INFO:tasks.workunit.client.0.smithi047.stdout:6/952: chown d3/da/d14/d28/d9a 201210 1 2024-02-07T12:26:10.407 INFO:tasks.workunit.client.0.smithi047.stdout:6/953: chown d3/da/d2c/f2e 35518 1 2024-02-07T12:26:10.409 INFO:tasks.workunit.client.0.smithi047.stdout:8/986: mknod d3/d36/d50/c14d 0 2024-02-07T12:26:10.409 INFO:tasks.workunit.client.0.smithi047.stdout:8/987: fsync d3/d36/d50/d28/d100/f129 0 2024-02-07T12:26:10.412 INFO:tasks.workunit.client.0.smithi047.stdout:0/809: dread d19/f27 [0,4194304] 0 2024-02-07T12:26:10.414 INFO:tasks.workunit.client.0.smithi047.stdout:6/954: mknod d3/d5/d35/d3c/dd4/c13f 0 2024-02-07T12:26:10.414 INFO:tasks.workunit.client.0.smithi047.stdout:6/955: truncate d3/d5/d35/f130 4829373 0 2024-02-07T12:26:10.414 INFO:tasks.workunit.client.0.smithi047.stdout:0/810: creat d19/d25/ddb/f10e x:0 0 0 2024-02-07T12:26:10.418 INFO:tasks.workunit.client.0.smithi047.stdout:8/988: link d3/d36/d50/d30/d34/dab/cb4 d3/d36/d9d/dbe/c14e 0 2024-02-07T12:26:10.419 INFO:tasks.workunit.client.0.smithi047.stdout:0/811: rename d19/d1c/ff8 to d19/d1c/d2b/d5f/d9f/f10f 0 2024-02-07T12:26:10.419 INFO:tasks.workunit.client.0.smithi047.stdout:0/812: chown d19/d40/d66/d46/l5d 4 1 2024-02-07T12:26:10.421 INFO:tasks.workunit.client.0.smithi047.stdout:9/833: dwrite d3/d10/d4c/f8e [0,4194304] 0 2024-02-07T12:26:10.421 INFO:tasks.workunit.client.0.smithi047.stdout:9/834: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/f128 x:0 0 0 2024-02-07T12:26:10.424 INFO:tasks.workunit.client.0.smithi047.stdout:2/995: dwrite d7/f20 [4194304,4194304] 0 2024-02-07T12:26:10.425 INFO:tasks.workunit.client.0.smithi047.stdout:2/996: fsync d7/dc/d71/f87 0 2024-02-07T12:26:10.425 INFO:tasks.workunit.client.0.smithi047.stdout:9/835: symlink d3/d10/l129 0 2024-02-07T12:26:10.425 INFO:tasks.workunit.client.0.smithi047.stdout:9/836: stat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/f86 0 2024-02-07T12:26:10.433 INFO:tasks.workunit.client.0.smithi047.stdout:8/989: write d3/d4/fbb [2068458,13191] 0 2024-02-07T12:26:10.433 INFO:tasks.workunit.client.0.smithi047.stdout:8/990: creat d3/d66/d67/d6a/d91/f14f x:0 0 0 2024-02-07T12:26:10.437 INFO:tasks.workunit.client.0.smithi047.stdout:8/991: mknod d3/d36/d50/d2a/d112/c150 0 2024-02-07T12:26:10.437 INFO:tasks.workunit.client.0.smithi047.stdout:8/992: creat d3/d36/d50/d30/d9e/da6/f151 x:0 0 0 2024-02-07T12:26:10.439 INFO:tasks.workunit.client.0.smithi047.stdout:8/993: stat d3/d66/c70 0 2024-02-07T12:26:10.439 INFO:tasks.workunit.client.0.smithi047.stdout:8/994: creat d3/d36/de2/de5/f152 x:0 0 0 2024-02-07T12:26:10.446 INFO:tasks.workunit.client.0.smithi047.stdout:6/956: dwrite d3/da/d14/d28/df0/f105 [0,4194304] 0 2024-02-07T12:26:10.448 INFO:tasks.workunit.client.0.smithi047.stdout:2/997: dwrite d7/dc/f9e [0,4194304] 0 2024-02-07T12:26:10.448 INFO:tasks.workunit.client.0.smithi047.stdout:0/813: dwrite d19/d40/d66/da9/faf [0,4194304] 0 2024-02-07T12:26:10.448 INFO:tasks.workunit.client.0.smithi047.stdout:0/814: fdatasync d19/f2d 0 2024-02-07T12:26:10.448 INFO:tasks.workunit.client.0.smithi047.stdout:9/837: dwrite d3/d10/f67 [0,4194304] 0 2024-02-07T12:26:10.449 INFO:tasks.workunit.client.0.smithi047.stdout:6/957: creat d3/da/d3b/d87/f140 x:0 0 0 2024-02-07T12:26:10.452 INFO:tasks.workunit.client.0.smithi047.stdout:8/995: read d3/d4/f7f [2102499,48] 0 2024-02-07T12:26:10.453 INFO:tasks.workunit.client.0.smithi047.stdout:8/996: read - d3/d36/fec zero size 2024-02-07T12:26:10.453 INFO:tasks.workunit.client.0.smithi047.stdout:8/997: truncate d3/d36/d50/d2a/f32 2162322 0 2024-02-07T12:26:10.455 INFO:tasks.workunit.client.0.smithi047.stdout:8/998: mkdir d3/d66/d67/d6a/dca/d104/d153 0 2024-02-07T12:26:10.456 INFO:tasks.workunit.client.0.smithi047.stdout:2/998: dread d7/dc/dd6/dfa/f11e [0,4194304] 0 2024-02-07T12:26:10.458 INFO:tasks.workunit.client.0.smithi047.stdout:8/999: mkdir d3/d66/d67/d6a/d154 0 2024-02-07T12:26:10.459 INFO:tasks.workunit.client.0.smithi047.stdout:2/999: link d7/d48/f97 d7/dc/d8a/f143 0 2024-02-07T12:26:10.460 INFO:tasks.workunit.client.0.smithi047.stdout:0/815: dread d19/d1c/d3c/d60/f72 [0,4194304] 0 2024-02-07T12:26:10.463 INFO:tasks.workunit.client.0.smithi047.stdout:6/958: dread d3/f18 [0,4194304] 0 2024-02-07T12:26:10.468 INFO:tasks.workunit.client.0.smithi047.stdout:9/838: dwrite d3/d10/d18/d3d/dc0/fcb [0,4194304] 0 2024-02-07T12:26:10.468 INFO:tasks.workunit.client.0.smithi047.stdout:9/839: truncate d3/d10/d18/d3d/dc0/f108 226491 0 2024-02-07T12:26:10.468 INFO:tasks.workunit.client.0.smithi047.stdout:9/840: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/f12a x:0 0 0 2024-02-07T12:26:10.472 INFO:tasks.workunit.client.0.smithi047.stdout:9/841: symlink d3/d10/d4c/d105/d11a/l12b 0 2024-02-07T12:26:10.472 INFO:tasks.workunit.client.0.smithi047.stdout:9/842: chown d3/d10/d18/d3b/d3c/d5d/d70/dad/dbf/fd5 1 1 2024-02-07T12:26:10.472 INFO:tasks.workunit.client.0.smithi047.stdout:9/843: fdatasync d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/f116 0 2024-02-07T12:26:10.475 INFO:tasks.workunit.client.0.smithi047.stdout:0/816: dread d19/d1c/d2b/f88 [0,4194304] 0 2024-02-07T12:26:10.475 INFO:tasks.workunit.client.0.smithi047.stdout:6/959: dread d3/d5/d35/d3c/d72/f10a [0,4194304] 0 2024-02-07T12:26:10.476 INFO:tasks.workunit.client.0.smithi047.stdout:0/817: creat d19/d1c/d2b/d5f/f110 x:0 0 0 2024-02-07T12:26:10.480 INFO:tasks.workunit.client.0.smithi047.stdout:0/818: creat d19/d1c/d3c/d60/d6f/d95/daa/d49/f111 x:0 0 0 2024-02-07T12:26:10.482 INFO:tasks.workunit.client.0.smithi047.stdout:0/819: rename d19/d40/f99 to d19/d1c/d3c/d60/d6f/d95/f112 0 2024-02-07T12:26:10.489 INFO:tasks.workunit.client.0.smithi047.stdout:9/844: dwrite d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/fb4 [0,4194304] 0 2024-02-07T12:26:10.513 INFO:tasks.workunit.client.0.smithi047.stdout:6/960: dwrite d3/d5/d11c/f137 [0,4194304] 0 2024-02-07T12:26:10.513 INFO:tasks.workunit.client.0.smithi047.stdout:6/961: chown d3/da/d34/d6d/d8f/db3/dbc/fe0 20914 1 2024-02-07T12:26:10.513 INFO:tasks.workunit.client.0.smithi047.stdout:6/962: stat d3/d5/d35/d3c 0 2024-02-07T12:26:10.514 INFO:tasks.workunit.client.0.smithi047.stdout:0/820: dwrite d19/d1c/d2b/f77 [0,4194304] 0 2024-02-07T12:26:10.514 INFO:tasks.workunit.client.0.smithi047.stdout:9/845: dwrite d3/f115 [0,4194304] 0 2024-02-07T12:26:10.514 INFO:tasks.workunit.client.0.smithi047.stdout:6/963: rmdir d3/da/da9 39 2024-02-07T12:26:10.514 INFO:tasks.workunit.client.0.smithi047.stdout:6/964: write d3/d1e/f96 [256338,93499] 0 2024-02-07T12:26:10.521 INFO:tasks.workunit.client.0.smithi047.stdout:0/821: link d19/d1c/d24/c69 d19/d25/dd7/c113 0 2024-02-07T12:26:10.524 INFO:tasks.workunit.client.0.smithi047.stdout:0/822: chown d19/d1c/d3c/d60/d6f/d95/daa/d49/f68 44945 1 2024-02-07T12:26:10.527 INFO:tasks.workunit.client.0.smithi047.stdout:6/965: mkdir d3/da/d3b/d87/d141 0 2024-02-07T12:26:10.530 INFO:tasks.workunit.client.0.smithi047.stdout:9/846: dwrite d3/d10/d18/d3d/f37 [4194304,4194304] 0 2024-02-07T12:26:10.531 INFO:tasks.workunit.client.0.smithi047.stdout:9/847: write d3/d10/d18/d3d/d79/fef [53729,57567] 0 2024-02-07T12:26:10.534 INFO:tasks.workunit.client.0.smithi047.stdout:0/823: dread fc [4194304,4194304] 0 2024-02-07T12:26:10.535 INFO:tasks.workunit.client.0.smithi047.stdout:0/824: getdents d19/d1c/d3c/d60/d6f 0 2024-02-07T12:26:10.539 INFO:tasks.workunit.client.0.smithi047.stdout:9/848: write d3/d10/d18/d3d/f65 [6889943,58744] 0 2024-02-07T12:26:10.539 INFO:tasks.workunit.client.0.smithi047.stdout:9/849: write d3/d10/d18/d3d/f65 [2828183,126981] 0 2024-02-07T12:26:10.540 INFO:tasks.workunit.client.0.smithi047.stdout:9/850: creat d3/d10/d18/d3d/f12c x:0 0 0 2024-02-07T12:26:10.540 INFO:tasks.workunit.client.0.smithi047.stdout:9/851: write d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/f12a [279948,89241] 0 2024-02-07T12:26:10.541 INFO:tasks.workunit.client.0.smithi047.stdout:9/852: mkdir d3/d10/d18/d3b/dc6/d12d 0 2024-02-07T12:26:10.544 INFO:tasks.workunit.client.0.smithi047.stdout:0/825: dread d19/d40/d66/d46/dc6/ff5 [0,4194304] 0 2024-02-07T12:26:10.545 INFO:tasks.workunit.client.0.smithi047.stdout:6/966: dwrite d3/da/d3b/df6/f69 [0,4194304] 0 2024-02-07T12:26:10.547 INFO:tasks.workunit.client.0.smithi047.stdout:0/826: link d19/d1c/df1/d82/d9e/cce d19/d1c/df1/d82/c114 0 2024-02-07T12:26:10.547 INFO:tasks.workunit.client.0.smithi047.stdout:6/967: mkdir d3/da/d3b/d87/d142 0 2024-02-07T12:26:10.548 INFO:tasks.workunit.client.0.smithi047.stdout:6/968: mknod d3/d5/d35/d3c/dd4/c143 0 2024-02-07T12:26:10.549 INFO:tasks.workunit.client.0.smithi047.stdout:9/853: dread d3/d10/d18/d3b/ffb [0,4194304] 0 2024-02-07T12:26:10.550 INFO:tasks.workunit.client.0.smithi047.stdout:6/969: rename d3/da/d14/d28/c80 to d3/da/d34/d6d/d8f/db3/dbc/df5/c144 0 2024-02-07T12:26:10.551 INFO:tasks.workunit.client.0.smithi047.stdout:9/854: mkdir d3/d10/d18/d3a/da7/d12e 0 2024-02-07T12:26:10.553 INFO:tasks.workunit.client.0.smithi047.stdout:6/970: mkdir d3/da/d3b/d87/dc1/d145 0 2024-02-07T12:26:10.554 INFO:tasks.workunit.client.0.smithi047.stdout:6/971: mknod d3/da/d2c/d47/c146 0 2024-02-07T12:26:10.556 INFO:tasks.workunit.client.0.smithi047.stdout:0/827: read d19/d1c/d2b/dc2/fee [1282889,36870] 0 2024-02-07T12:26:10.561 INFO:tasks.workunit.client.0.smithi047.stdout:9/855: dread d3/d10/d4c/f8d [0,4194304] 0 2024-02-07T12:26:10.561 INFO:tasks.workunit.client.0.smithi047.stdout:9/856: chown d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/dd6/c113 1423795584 1 2024-02-07T12:26:10.561 INFO:tasks.workunit.client.0.smithi047.stdout:9/857: chown d3/d10/d18/d3a/da7/fed 95300 1 2024-02-07T12:26:10.562 INFO:tasks.workunit.client.0.smithi047.stdout:9/858: truncate d3/d10/d18/f27 4629095 0 2024-02-07T12:26:10.566 INFO:tasks.workunit.client.0.smithi047.stdout:6/972: truncate d3/d1e/f96 614982 0 2024-02-07T12:26:10.568 INFO:tasks.workunit.client.0.smithi047.stdout:9/859: rename d3/d10/d18/d3d/d79 to d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/d12f 0 2024-02-07T12:26:10.569 INFO:tasks.workunit.client.0.smithi047.stdout:6/973: rename d3/da/d34/d6d/c11e to d3/da/d14/d28/df0/c147 0 2024-02-07T12:26:10.571 INFO:tasks.workunit.client.0.smithi047.stdout:6/974: link d3/da/d14/d28/d46/fc9 d3/da/d3b/f148 0 2024-02-07T12:26:10.571 INFO:tasks.workunit.client.0.smithi047.stdout:6/975: symlink d3/da/d3b/d87/dc1/d145/l149 0 2024-02-07T12:26:10.577 INFO:tasks.workunit.client.0.smithi047.stdout:0/828: dwrite d19/f26 [0,4194304] 0 2024-02-07T12:26:10.580 INFO:tasks.workunit.client.0.smithi047.stdout:0/829: symlink d19/d1c/df1/d82/l115 0 2024-02-07T12:26:10.580 INFO:tasks.workunit.client.0.smithi047.stdout:0/830: readlink d19/d1c/d3c/l8d 0 2024-02-07T12:26:10.582 INFO:tasks.workunit.client.0.smithi047.stdout:9/860: write d3/d10/d18/d3b/f50 [1425714,44564] 0 2024-02-07T12:26:10.582 INFO:tasks.workunit.client.0.smithi047.stdout:9/861: write d3/d10/d18/d3b/d3c/d5d/d70/dad/dbf/fd5 [1229626,14084] 0 2024-02-07T12:26:10.582 INFO:tasks.workunit.client.0.smithi047.stdout:0/831: truncate d19/d1c/df1/d82/d9e/df4/ffc 1174909 0 2024-02-07T12:26:10.585 INFO:tasks.workunit.client.0.smithi047.stdout:9/862: mknod d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/dd6/c130 0 2024-02-07T12:26:10.586 INFO:tasks.workunit.client.0.smithi047.stdout:6/976: write d3/d5/d35/f130 [1462255,11722] 0 2024-02-07T12:26:10.598 INFO:tasks.workunit.client.0.smithi047.stdout:9/863: dread d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/f96 [0,4194304] 0 2024-02-07T12:26:10.599 INFO:tasks.workunit.client.0.smithi047.stdout:9/864: dread - d3/d10/d18/d3a/da7/f102 zero size 2024-02-07T12:26:10.599 INFO:tasks.workunit.client.0.smithi047.stdout:0/832: dwrite d19/f2d [4194304,4194304] 0 2024-02-07T12:26:10.599 INFO:tasks.workunit.client.0.smithi047.stdout:9/865: getdents d3/d10 0 2024-02-07T12:26:10.600 INFO:tasks.workunit.client.0.smithi047.stdout:9/866: rmdir d3/d10/d18/d6e/d9a 39 2024-02-07T12:26:10.602 INFO:tasks.workunit.client.0.smithi047.stdout:9/867: link d3/d10/d18/d6e/l109 d3/d10/d18/d3b/d3c/l131 0 2024-02-07T12:26:10.602 INFO:tasks.workunit.client.0.smithi047.stdout:9/868: chown d3/f19 15001 1 2024-02-07T12:26:10.603 INFO:tasks.workunit.client.0.smithi047.stdout:9/869: mkdir d3/d10/d18/d3b/d3c/d5d/d132 0 2024-02-07T12:26:10.610 INFO:tasks.workunit.client.0.smithi047.stdout:6/977: dwrite d3/da/d3b/f9d [0,4194304] 0 2024-02-07T12:26:10.632 INFO:tasks.workunit.client.0.smithi047.stdout:0/833: dwrite d19/d1c/df1/fbe [0,4194304] 0 2024-02-07T12:26:10.636 INFO:tasks.workunit.client.0.smithi047.stdout:0/834: creat d19/d1c/df1/d82/d9e/dd6/f116 x:0 0 0 2024-02-07T12:26:10.638 INFO:tasks.workunit.client.0.smithi047.stdout:0/835: mkdir d19/d40/d66/da9/d117 0 2024-02-07T12:26:10.640 INFO:tasks.workunit.client.0.smithi047.stdout:0/836: mknod d19/d1c/d3c/d48/c118 0 2024-02-07T12:26:10.640 INFO:tasks.workunit.client.0.smithi047.stdout:0/837: write d19/d1c/d3c/d60/d6f/d95/daa/d49/f111 [833888,21931] 0 2024-02-07T12:26:10.643 INFO:tasks.workunit.client.0.smithi047.stdout:0/838: creat d19/d40/d66/da9/f119 x:0 0 0 2024-02-07T12:26:10.643 INFO:tasks.workunit.client.0.smithi047.stdout:0/839: stat d19/d1c/d3c/d60/d6f/d95/daa/d49/fb2 0 2024-02-07T12:26:10.645 INFO:tasks.workunit.client.0.smithi047.stdout:1/711: sync 2024-02-07T12:26:10.645 INFO:tasks.workunit.client.0.smithi047.stdout:1/712: dread - d1/d37/faf zero size 2024-02-07T12:26:10.645 INFO:tasks.workunit.client.0.smithi047.stdout:0/840: rmdir d19/d40/d66/d46/df0 39 2024-02-07T12:26:10.646 INFO:tasks.workunit.client.0.smithi047.stdout:1/713: rmdir d1/d48 39 2024-02-07T12:26:10.647 INFO:tasks.workunit.client.0.smithi047.stdout:1/714: dread d1/d48/d74/fc0 [0,4194304] 0 2024-02-07T12:26:10.647 INFO:tasks.workunit.client.0.smithi047.stdout:0/841: creat d19/d1c/d2b/d5f/d9f/f11a x:0 0 0 2024-02-07T12:26:10.649 INFO:tasks.workunit.client.0.smithi047.stdout:1/715: creat d1/d48/dc9/fe9 x:0 0 0 2024-02-07T12:26:10.651 INFO:tasks.workunit.client.0.smithi047.stdout:0/842: rmdir d19/d40 39 2024-02-07T12:26:10.653 INFO:tasks.workunit.client.0.smithi047.stdout:1/716: dread d1/d15/d30/d46/d66/fb6 [0,4194304] 0 2024-02-07T12:26:10.654 INFO:tasks.workunit.client.0.smithi047.stdout:1/717: symlink d1/d6e/dcf/lea 0 2024-02-07T12:26:10.657 INFO:tasks.workunit.client.0.smithi047.stdout:1/718: truncate d1/d6e/d75/da7/d40/f62 1604127 0 2024-02-07T12:26:10.659 INFO:tasks.workunit.client.0.smithi047.stdout:6/978: dwrite d3/d5/d35/d3c/dd4/f81 [0,4194304] 0 2024-02-07T12:26:10.660 INFO:tasks.workunit.client.0.smithi047.stdout:1/719: mkdir d1/d6e/d75/deb 0 2024-02-07T12:26:10.665 INFO:tasks.workunit.client.0.smithi047.stdout:1/720: dread d1/d6e/dcf/d84/f88 [0,4194304] 0 2024-02-07T12:26:10.667 INFO:tasks.workunit.client.0.smithi047.stdout:1/721: unlink d1/lf 0 2024-02-07T12:26:10.667 INFO:tasks.workunit.client.0.smithi047.stdout:1/722: creat d1/d15/db9/fec x:0 0 0 2024-02-07T12:26:10.668 INFO:tasks.workunit.client.0.smithi047.stdout:0/843: dwrite d19/d40/d66/da9/fbf [0,4194304] 0 2024-02-07T12:26:10.670 INFO:tasks.workunit.client.0.smithi047.stdout:1/723: mkdir d1/d15/db9/ded 0 2024-02-07T12:26:10.670 INFO:tasks.workunit.client.0.smithi047.stdout:0/844: symlink d19/d1c/d2b/d5f/d9f/dd3/dfd/l11b 0 2024-02-07T12:26:10.670 INFO:tasks.workunit.client.0.smithi047.stdout:0/845: read d19/d1c/d2b/d5f/d9f/dd3/f39 [195617,32846] 0 2024-02-07T12:26:10.671 INFO:tasks.workunit.client.0.smithi047.stdout:1/724: mkdir d1/d6e/d75/da7/d40/dee 0 2024-02-07T12:26:10.671 INFO:tasks.workunit.client.0.smithi047.stdout:0/846: mknod d19/d1c/d2b/dc2/c11c 0 2024-02-07T12:26:10.672 INFO:tasks.workunit.client.0.smithi047.stdout:6/979: dwrite d3/da/d3b/d87/de4/fe9 [0,4194304] 0 2024-02-07T12:26:10.672 INFO:tasks.workunit.client.0.smithi047.stdout:1/725: mknod d1/d48/dc7/cef 0 2024-02-07T12:26:10.673 INFO:tasks.workunit.client.0.smithi047.stdout:1/726: chown d1/d6e/dcf/d3e/dbb 25 1 2024-02-07T12:26:10.692 INFO:tasks.workunit.client.0.smithi047.stdout:0/847: dwrite fc [0,4194304] 0 2024-02-07T12:26:10.694 INFO:tasks.workunit.client.0.smithi047.stdout:0/848: link d19/d1c/d3c/d60/d6f/d95/daa/d49/fb5 d19/d40/d66/d46/dc6/f11d 0 2024-02-07T12:26:10.694 INFO:tasks.workunit.client.0.smithi047.stdout:0/849: write d19/d1c/d2b/f88 [1466433,78416] 0 2024-02-07T12:26:10.695 INFO:tasks.workunit.client.0.smithi047.stdout:0/850: mkdir d19/d40/d66/d11e 0 2024-02-07T12:26:10.702 INFO:tasks.workunit.client.0.smithi047.stdout:0/851: write d19/d40/d66/fa2 [1196867,31283] 0 2024-02-07T12:26:10.702 INFO:tasks.workunit.client.0.smithi047.stdout:0/852: chown d19/d1c/d2b/d5f/d9f/dd3/dfd/l109 62395 1 2024-02-07T12:26:10.702 INFO:tasks.workunit.client.0.smithi047.stdout:0/853: symlink d19/d1c/df1/d82/d9e/dd6/l11f 0 2024-02-07T12:26:10.703 INFO:tasks.workunit.client.0.smithi047.stdout:0/854: creat d19/d40/d66/da9/f120 x:0 0 0 2024-02-07T12:26:10.719 INFO:tasks.workunit.client.0.smithi047.stdout:0/855: dwrite f15 [4194304,4194304] 0 2024-02-07T12:26:10.719 INFO:tasks.workunit.client.0.smithi047.stdout:0/856: write d19/d1c/d3c/d60/d6f/d95/daa/d49/fb2 [546750,99486] 0 2024-02-07T12:26:10.722 INFO:tasks.workunit.client.0.smithi047.stdout:0/857: mknod d19/d1c/d3c/d48/c121 0 2024-02-07T12:26:10.722 INFO:tasks.workunit.client.0.smithi047.stdout:0/858: write d19/d1c/d3c/d60/d6f/fac [976917,71626] 0 2024-02-07T12:26:10.724 INFO:tasks.workunit.client.0.smithi047.stdout:0/859: creat d19/d1c/df1/dbd/f122 x:0 0 0 2024-02-07T12:26:10.724 INFO:tasks.workunit.client.0.smithi047.stdout:0/860: stat d19/d1c/d3c/d48 0 2024-02-07T12:26:10.739 INFO:tasks.workunit.client.0.smithi047.stdout:0/861: dwrite d19/d1c/d3c/d60/d6f/d95/daa/d49/f65 [0,4194304] 0 2024-02-07T12:26:10.739 INFO:tasks.workunit.client.0.smithi047.stdout:0/862: getdents d19/d1c/df1/d82/d108 0 2024-02-07T12:26:10.756 INFO:tasks.workunit.client.0.smithi047.stdout:0/863: dwrite d19/f26 [0,4194304] 0 2024-02-07T12:26:10.756 INFO:tasks.workunit.client.0.smithi047.stdout:0/864: write d19/d1c/f31 [986743,14505] 0 2024-02-07T12:26:10.759 INFO:tasks.workunit.client.0.smithi047.stdout:0/865: symlink d19/d40/d66/l123 0 2024-02-07T12:26:10.776 INFO:tasks.workunit.client.0.smithi047.stdout:0/866: dwrite d19/d1c/d2b/d5f/ffa [0,4194304] 0 2024-02-07T12:26:10.776 INFO:tasks.workunit.client.0.smithi047.stdout:0/867: fsync d19/d1c/d3c/d60/f72 0 2024-02-07T12:26:10.776 INFO:tasks.workunit.client.0.smithi047.stdout:0/868: fdatasync d19/d1c/f30 0 2024-02-07T12:26:10.778 INFO:tasks.workunit.client.0.smithi047.stdout:0/869: getdents d19/d1c/d24/db1 0 2024-02-07T12:26:10.780 INFO:tasks.workunit.client.0.smithi047.stdout:0/870: creat d19/d1c/df1/d82/d108/f124 x:0 0 0 2024-02-07T12:26:10.796 INFO:tasks.workunit.client.0.smithi047.stdout:0/871: dwrite d19/d1c/f31 [0,4194304] 0 2024-02-07T12:26:10.797 INFO:tasks.workunit.client.0.smithi047.stdout:0/872: mknod d19/d1c/df1/d82/c125 0 2024-02-07T12:26:10.800 INFO:tasks.workunit.client.0.smithi047.stdout:0/873: rmdir d19/d1c/df1/d82/d108 39 2024-02-07T12:26:10.800 INFO:tasks.workunit.client.0.smithi047.stdout:0/874: fdatasync d19/d1c/d3c/d60/d6f/d95/da7/fcd 0 2024-02-07T12:26:10.802 INFO:tasks.workunit.client.0.smithi047.stdout:0/875: symlink d19/d1c/d3c/d60/d6f/d95/daa/d8c/l126 0 2024-02-07T12:26:10.811 INFO:tasks.workunit.client.0.smithi047.stdout:0/876: dread d19/d1c/d3c/f9b [0,4194304] 0 2024-02-07T12:26:10.813 INFO:tasks.workunit.client.0.smithi047.stdout:0/877: symlink d19/d1c/d24/l127 0 2024-02-07T12:26:10.813 INFO:tasks.workunit.client.0.smithi047.stdout:0/878: chown d19/d40/d66/d46/dc6/f100 326358881 1 2024-02-07T12:26:10.813 INFO:tasks.workunit.client.0.smithi047.stdout:0/879: chown d19/d25 122 1 2024-02-07T12:26:10.827 INFO:tasks.workunit.client.0.smithi047.stdout:0/880: dwrite d19/d25/dd7/f86 [0,4194304] 0 2024-02-07T12:26:10.828 INFO:tasks.workunit.client.0.smithi047.stdout:0/881: creat d19/d1c/df1/f128 x:0 0 0 2024-02-07T12:26:10.829 INFO:tasks.workunit.client.0.smithi047.stdout:0/882: mkdir d19/d1c/df1/d129 0 2024-02-07T12:26:10.830 INFO:tasks.workunit.client.0.smithi047.stdout:0/883: fsync d19/d1c/d2b/f77 0 2024-02-07T12:26:10.833 INFO:tasks.workunit.client.0.smithi047.stdout:0/884: dread d19/d1c/d3c/d60/d6f/fac [0,4194304] 0 2024-02-07T12:26:10.834 INFO:tasks.workunit.client.0.smithi047.stdout:0/885: creat d19/d40/d66/d46/f12a x:0 0 0 2024-02-07T12:26:10.835 INFO:tasks.workunit.client.0.smithi047.stdout:0/886: write d19/d40/d66/da9/f119 [1015909,50697] 0 2024-02-07T12:26:10.846 INFO:tasks.workunit.client.0.smithi047.stdout:0/887: dwrite d19/d1c/d2b/f71 [0,4194304] 0 2024-02-07T12:26:10.862 INFO:tasks.workunit.client.0.smithi047.stdout:0/888: dwrite d19/d1c/d2b/dc2/fda [0,4194304] 0 2024-02-07T12:26:10.864 INFO:tasks.workunit.client.0.smithi047.stdout:0/889: rename d19/d1c/d3c/d48/c118 to d19/d1c/d3c/d60/d6f/d95/c12b 0 2024-02-07T12:26:10.866 INFO:tasks.workunit.client.0.smithi047.stdout:0/890: symlink d19/d1c/df1/d82/d9e/df4/l12c 0 2024-02-07T12:26:10.873 INFO:tasks.workunit.client.0.smithi047.stdout:0/891: dread d19/d1c/d2b/fc8 [0,4194304] 0 2024-02-07T12:26:10.885 INFO:tasks.workunit.client.0.smithi047.stdout:0/892: dwrite d19/f8b [0,4194304] 0 2024-02-07T12:26:10.886 INFO:tasks.workunit.client.0.smithi047.stdout:0/893: mkdir d19/d25/d12d 0 2024-02-07T12:26:10.887 INFO:tasks.workunit.client.0.smithi047.stdout:0/894: creat d19/d1c/df1/d82/d9e/df4/f12e x:0 0 0 2024-02-07T12:26:10.889 INFO:tasks.workunit.client.0.smithi047.stdout:0/895: link d19/d40/d66/d46/ff6 d19/d1c/d3c/d60/d6f/f12f 0 2024-02-07T12:26:10.905 INFO:tasks.workunit.client.0.smithi047.stdout:0/896: dwrite d19/d1c/d2b/d5f/d9f/f11a [0,4194304] 0 2024-02-07T12:26:10.907 INFO:tasks.workunit.client.0.smithi047.stdout:0/897: rename d19/d1c/d3c/ca1 to d19/d1c/d3c/d60/c130 0 2024-02-07T12:26:10.922 INFO:tasks.workunit.client.0.smithi047.stdout:0/898: dwrite d19/d1c/d3c/d60/d6f/d95/daa/d8c/f91 [4194304,4194304] 0 2024-02-07T12:26:10.928 INFO:tasks.workunit.client.0.smithi047.stdout:0/899: write d19/d1c/df1/fbe [3729677,102252] 0 2024-02-07T12:26:10.928 INFO:tasks.workunit.client.0.smithi047.stdout:0/900: stat d19/d1c/d24/l4c 0 2024-02-07T12:26:11.019 INFO:tasks.workunit.client.0.smithi047.stdout:0/901: creat d19/d1c/df1/d82/d9e/f131 x:0 0 0 2024-02-07T12:26:11.020 INFO:tasks.workunit.client.0.smithi047.stdout:0/902: truncate d19/d1c/d2b/d5f/d9f/f10f 845688 0 2024-02-07T12:26:11.021 INFO:tasks.workunit.client.0.smithi047.stdout:0/903: symlink d19/d25/l132 0 2024-02-07T12:26:11.022 INFO:tasks.workunit.client.0.smithi047.stdout:0/904: chown d19/d1c/d24/l127 90 1 2024-02-07T12:26:11.033 INFO:tasks.workunit.client.0.smithi047.stdout:0/905: creat d19/d25/d12d/f133 x:0 0 0 2024-02-07T12:26:11.036 INFO:tasks.workunit.client.0.smithi047.stdout:0/906: rmdir d19/d1c/df1/d129 0 2024-02-07T12:26:11.036 INFO:tasks.workunit.client.0.smithi047.stdout:0/907: fsync d19/d1c/df1/f128 0 2024-02-07T12:26:11.039 INFO:tasks.workunit.client.0.smithi047.stdout:0/908: symlink d19/d1c/d24/db1/l134 0 2024-02-07T12:26:11.042 INFO:tasks.workunit.client.0.smithi047.stdout:0/909: mkdir d19/d1c/d3c/d60/d6f/d135 0 2024-02-07T12:26:11.042 INFO:tasks.workunit.client.0.smithi047.stdout:0/910: dread - d19/d40/d66/da9/f120 zero size 2024-02-07T12:26:11.057 INFO:tasks.workunit.client.0.smithi047.stdout:0/911: dwrite d19/d1c/f31 [0,4194304] 0 2024-02-07T12:26:11.059 INFO:tasks.workunit.client.0.smithi047.stdout:0/912: mkdir d19/d40/d66/d136 0 2024-02-07T12:26:11.078 INFO:tasks.workunit.client.0.smithi047.stdout:0/913: dwrite d19/d1c/f43 [0,4194304] 0 2024-02-07T12:26:11.078 INFO:tasks.workunit.client.0.smithi047.stdout:0/914: stat d19/d1c/d3c/c50 0 2024-02-07T12:26:11.078 INFO:tasks.workunit.client.0.smithi047.stdout:0/915: fdatasync d19/f2d 0 2024-02-07T12:26:11.079 INFO:tasks.workunit.client.0.smithi047.stdout:0/916: creat d19/d1c/df1/f137 x:0 0 0 2024-02-07T12:26:11.083 INFO:tasks.workunit.client.0.smithi047.stdout:0/917: truncate d19/d1c/d2b/d5f/ffa 2537878 0 2024-02-07T12:26:11.083 INFO:tasks.workunit.client.0.smithi047.stdout:0/918: truncate d19/f6d 8903316 0 2024-02-07T12:26:11.229 INFO:tasks.workunit.client.0.smithi047.stdout:1/727: sync 2024-02-07T12:26:11.229 INFO:tasks.workunit.client.0.smithi047.stdout:9/870: sync 2024-02-07T12:26:11.230 INFO:tasks.workunit.client.0.smithi047.stdout:6/980: sync 2024-02-07T12:26:11.230 INFO:tasks.workunit.client.0.smithi047.stdout:1/728: fdatasync d1/d6e/dcf/d84/fd6 0 2024-02-07T12:26:11.230 INFO:tasks.workunit.client.0.smithi047.stdout:9/871: dread - d3/d10/d18/d3b/f11b zero size 2024-02-07T12:26:11.230 INFO:tasks.workunit.client.0.smithi047.stdout:1/729: mknod d1/d6e/dcf/cf0 0 2024-02-07T12:26:11.231 INFO:tasks.workunit.client.0.smithi047.stdout:6/981: symlink d3/da/d14/d28/l14a 0 2024-02-07T12:26:11.233 INFO:tasks.workunit.client.0.smithi047.stdout:1/730: creat d1/d6e/dcf/d3e/dbb/de0/ff1 x:0 0 0 2024-02-07T12:26:11.235 INFO:tasks.workunit.client.0.smithi047.stdout:1/731: rename d1/d15/c9d to d1/d15/d30/d46/cf2 0 2024-02-07T12:26:11.235 INFO:tasks.workunit.client.0.smithi047.stdout:1/732: truncate d1/d48/dc9/fe9 734464 0 2024-02-07T12:26:11.236 INFO:tasks.workunit.client.0.smithi047.stdout:1/733: creat d1/d6e/d75/da7/d80/ff3 x:0 0 0 2024-02-07T12:26:11.236 INFO:tasks.workunit.client.0.smithi047.stdout:1/734: fsync d1/d6e/dcf/d3e/f7a 0 2024-02-07T12:26:11.237 INFO:tasks.workunit.client.0.smithi047.stdout:9/872: dread d3/d10/d4c/f8e [0,4194304] 0 2024-02-07T12:26:11.237 INFO:tasks.workunit.client.0.smithi047.stdout:9/873: chown d3/fa0 3675617 1 2024-02-07T12:26:11.237 INFO:tasks.workunit.client.0.smithi047.stdout:9/874: readlink d3/d10/l3e 0 2024-02-07T12:26:11.238 INFO:tasks.workunit.client.0.smithi047.stdout:1/735: dread d1/d48/d74/fc0 [0,4194304] 0 2024-02-07T12:26:11.241 INFO:tasks.workunit.client.0.smithi047.stdout:1/736: creat d1/d6e/d75/da7/ff4 x:0 0 0 2024-02-07T12:26:11.242 INFO:tasks.workunit.client.0.smithi047.stdout:6/982: dread d3/da/d14/fa0 [0,4194304] 0 2024-02-07T12:26:11.242 INFO:tasks.workunit.client.0.smithi047.stdout:6/983: write d3/da/d3b/d87/dc1/f10b [478487,38304] 0 2024-02-07T12:26:11.242 INFO:tasks.workunit.client.0.smithi047.stdout:6/984: read - d3/da/d14/d28/d46/d94/fe5 zero size 2024-02-07T12:26:11.265 INFO:tasks.workunit.client.0.smithi047.stdout:9/875: dwrite d3/d10/d18/f1a [4194304,4194304] 0 2024-02-07T12:26:11.265 INFO:tasks.workunit.client.0.smithi047.stdout:6/985: dwrite d3/d5/d35/f130 [4194304,4194304] 0 2024-02-07T12:26:11.266 INFO:tasks.workunit.client.0.smithi047.stdout:1/737: dwrite d1/d37/f72 [0,4194304] 0 2024-02-07T12:26:11.266 INFO:tasks.workunit.client.0.smithi047.stdout:9/876: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/f133 x:0 0 0 2024-02-07T12:26:11.267 INFO:tasks.workunit.client.0.smithi047.stdout:6/986: rename d3/d5/d35/c56 to d3/da/d3b/df6/c14b 0 2024-02-07T12:26:11.270 INFO:tasks.workunit.client.0.smithi047.stdout:1/738: unlink d1/d15/d30/d46/d66/fb2 0 2024-02-07T12:26:11.270 INFO:tasks.workunit.client.0.smithi047.stdout:1/739: write d1/d48/fc3 [579388,43869] 0 2024-02-07T12:26:11.271 INFO:tasks.workunit.client.0.smithi047.stdout:6/987: symlink d3/d5/d35/d3c/d72/l14c 0 2024-02-07T12:26:11.271 INFO:tasks.workunit.client.0.smithi047.stdout:6/988: dread - d3/da/d34/d6d/f117 zero size 2024-02-07T12:26:11.271 INFO:tasks.workunit.client.0.smithi047.stdout:6/989: dread - d3/da/d2c/d47/d12b/f12c zero size 2024-02-07T12:26:11.271 INFO:tasks.workunit.client.0.smithi047.stdout:1/740: rmdir d1/d15/d2f/de3 39 2024-02-07T12:26:11.273 INFO:tasks.workunit.client.0.smithi047.stdout:1/741: mknod d1/d15/db9/ded/cf5 0 2024-02-07T12:26:11.275 INFO:tasks.workunit.client.0.smithi047.stdout:1/742: creat d1/d6e/d75/ff6 x:0 0 0 2024-02-07T12:26:11.275 INFO:tasks.workunit.client.0.smithi047.stdout:1/743: dread - d1/d6e/d75/da7/d65/fba zero size 2024-02-07T12:26:11.278 INFO:tasks.workunit.client.0.smithi047.stdout:1/744: dread d1/d6e/dcf/d3e/f7a [0,4194304] 0 2024-02-07T12:26:11.291 INFO:tasks.workunit.client.0.smithi047.stdout:9/877: dwrite d3/d10/d18/d3a/f118 [0,4194304] 0 2024-02-07T12:26:11.293 INFO:tasks.workunit.client.0.smithi047.stdout:6/990: dwrite d3/da/d34/d6d/f117 [0,4194304] 0 2024-02-07T12:26:11.293 INFO:tasks.workunit.client.0.smithi047.stdout:6/991: chown d3/da/d3b/d87/dc1/d145/l149 34577 1 2024-02-07T12:26:11.296 INFO:tasks.workunit.client.0.smithi047.stdout:6/992: creat d3/da/f14d x:0 0 0 2024-02-07T12:26:11.298 INFO:tasks.workunit.client.0.smithi047.stdout:6/993: mknod d3/da/d14/d28/df0/c14e 0 2024-02-07T12:26:11.305 INFO:tasks.workunit.client.0.smithi047.stdout:9/878: dwrite d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/de6/f11d [0,4194304] 0 2024-02-07T12:26:11.305 INFO:tasks.workunit.client.0.smithi047.stdout:9/879: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/de6/f134 x:0 0 0 2024-02-07T12:26:11.305 INFO:tasks.workunit.client.0.smithi047.stdout:9/880: fsync d3/d10/d18/d6e/f9f 0 2024-02-07T12:26:11.305 INFO:tasks.workunit.client.0.smithi047.stdout:9/881: chown d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/f101 4328 1 2024-02-07T12:26:11.307 INFO:tasks.workunit.client.0.smithi047.stdout:6/994: write d3/d5/d35/d127/d91/fd6 [1890034,57623] 0 2024-02-07T12:26:11.307 INFO:tasks.workunit.client.0.smithi047.stdout:6/995: readlink d3/da/d3b/df6/lbb 0 2024-02-07T12:26:11.308 INFO:tasks.workunit.client.0.smithi047.stdout:9/882: rmdir d3/d10/d18/d6e 39 2024-02-07T12:26:11.309 INFO:tasks.workunit.client.0.smithi047.stdout:9/883: read - d3/d10/d18/ffa zero size 2024-02-07T12:26:11.311 INFO:tasks.workunit.client.0.smithi047.stdout:6/996: getdents d3/da/d14/d28/d46/d94 0 2024-02-07T12:26:11.311 INFO:tasks.workunit.client.0.smithi047.stdout:6/997: fsync d3/d5/d35/d127/d95/fdc 0 2024-02-07T12:26:11.313 INFO:tasks.workunit.client.0.smithi047.stdout:6/998: symlink d3/da/d3b/l14f 0 2024-02-07T12:26:11.314 INFO:tasks.workunit.client.0.smithi047.stdout:6/999: rmdir d3/da/d34/d6d/d8f/db3/dbc/df5 39 2024-02-07T12:26:11.319 INFO:tasks.workunit.client.0.smithi047.stdout:9/884: write d3/d10/d18/d3b/f57 [486839,126208] 0 2024-02-07T12:26:11.319 INFO:tasks.workunit.client.0.smithi047.stdout:9/885: dread - d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/f101 zero size 2024-02-07T12:26:11.320 INFO:tasks.workunit.client.0.smithi047.stdout:9/886: truncate d3/d10/d18/d3b/fc9 1995488 0 2024-02-07T12:26:11.320 INFO:tasks.workunit.client.0.smithi047.stdout:9/887: write d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/f96 [124551,87614] 0 2024-02-07T12:26:11.320 INFO:tasks.workunit.client.0.smithi047.stdout:9/888: fsync d3/d10/d18/d3a/f118 0 2024-02-07T12:26:11.321 INFO:tasks.workunit.client.0.smithi047.stdout:9/889: dread - d3/d10/d18/fee zero size 2024-02-07T12:26:11.322 INFO:tasks.workunit.client.0.smithi047.stdout:9/890: mknod d3/d10/d4c/d105/d11a/c135 0 2024-02-07T12:26:11.324 INFO:tasks.workunit.client.0.smithi047.stdout:9/891: mkdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/ddf/d136 0 2024-02-07T12:26:11.324 INFO:tasks.workunit.client.0.smithi047.stdout:9/892: chown d3/f115 39499 1 2024-02-07T12:26:11.325 INFO:tasks.workunit.client.0.smithi047.stdout:9/893: symlink d3/d10/d18/d6e/d9a/l137 0 2024-02-07T12:26:11.327 INFO:tasks.workunit.client.0.smithi047.stdout:9/894: fsync d3/d10/d18/d3a/da7/fac 0 2024-02-07T12:26:11.329 INFO:tasks.workunit.client.0.smithi047.stdout:9/895: mknod d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/c138 0 2024-02-07T12:26:11.330 INFO:tasks.workunit.client.0.smithi047.stdout:9/896: truncate d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/de6/f11d 3014965 0 2024-02-07T12:26:11.330 INFO:tasks.workunit.client.0.smithi047.stdout:9/897: truncate d3/d10/d18/d3b/fc9 2957387 0 2024-02-07T12:26:11.413 INFO:tasks.workunit.client.0.smithi047.stdout:0/919: sync 2024-02-07T12:26:11.414 INFO:tasks.workunit.client.0.smithi047.stdout:0/920: mknod d19/d1c/d3c/d60/d6f/d135/c138 0 2024-02-07T12:26:11.414 INFO:tasks.workunit.client.0.smithi047.stdout:0/921: write d19/d1c/df1/d82/d9e/dd6/f116 [585462,75925] 0 2024-02-07T12:26:11.414 INFO:tasks.workunit.client.0.smithi047.stdout:0/922: rename d19/d40 to d19/d40/d66/da9/d139 22 2024-02-07T12:26:11.425 INFO:tasks.workunit.client.0.smithi047.stdout:0/923: write d19/d1c/d3c/fe6 [666477,108977] 0 2024-02-07T12:26:11.426 INFO:tasks.workunit.client.0.smithi047.stdout:0/924: link d19/d1c/df1/d82/c114 d19/d40/d66/c13a 0 2024-02-07T12:26:11.426 INFO:tasks.workunit.client.0.smithi047.stdout:0/925: creat d19/d1c/df1/f13b x:0 0 0 2024-02-07T12:26:11.427 INFO:tasks.workunit.client.0.smithi047.stdout:0/926: symlink d19/d1c/d2b/dc2/l13c 0 2024-02-07T12:26:11.428 INFO:tasks.workunit.client.0.smithi047.stdout:0/927: chown d19/d1c/d3c/d60/d6f/d95 12860 1 2024-02-07T12:26:11.429 INFO:tasks.workunit.client.0.smithi047.stdout:0/928: symlink d19/d40/d66/d46/l13d 0 2024-02-07T12:26:11.429 INFO:tasks.workunit.client.0.smithi047.stdout:0/929: fsync d19/d40/d66/d46/ff7 0 2024-02-07T12:26:11.429 INFO:tasks.workunit.client.0.smithi047.stdout:0/930: truncate d19/d1c/d3c/f9b 319673 0 2024-02-07T12:26:11.429 INFO:tasks.workunit.client.0.smithi047.stdout:0/931: chown d19/d40/d66/d46/l78 281228 1 2024-02-07T12:26:11.435 INFO:tasks.workunit.client.0.smithi047.stdout:0/932: read f1 [265725,52446] 0 2024-02-07T12:26:11.436 INFO:tasks.workunit.client.0.smithi047.stdout:0/933: link d19/d1c/d24/ld9 d19/d25/dd7/l13e 0 2024-02-07T12:26:11.437 INFO:tasks.workunit.client.0.smithi047.stdout:0/934: readlink d19/d1c/d2b/d5f/d9f/dd3/dfd/l107 0 2024-02-07T12:26:11.445 INFO:tasks.workunit.client.0.smithi047.stdout:0/935: dread d19/d40/d66/f8e [0,4194304] 0 2024-02-07T12:26:11.445 INFO:tasks.workunit.client.0.smithi047.stdout:0/936: chown d19/d1c/df1/lc7 502 1 2024-02-07T12:26:11.445 INFO:tasks.workunit.client.0.smithi047.stdout:0/937: fsync d19/d1c/d2b/d5f/f6b 0 2024-02-07T12:26:11.447 INFO:tasks.workunit.client.0.smithi047.stdout:0/938: rename d19/d40/d66/d46/l5d to d19/d1c/d3c/d60/d6f/d95/l13f 0 2024-02-07T12:26:11.447 INFO:tasks.workunit.client.0.smithi047.stdout:0/939: stat d19/d40/d66/f8e 0 2024-02-07T12:26:11.456 INFO:tasks.workunit.client.0.smithi047.stdout:0/940: write d19/f6d [8270203,113667] 0 2024-02-07T12:26:11.462 INFO:tasks.workunit.client.0.smithi047.stdout:0/941: dread d19/d1c/d3c/fea [0,4194304] 0 2024-02-07T12:26:11.462 INFO:tasks.workunit.client.0.smithi047.stdout:0/942: chown d19/d1c/d3c/d60/f87 397217 1 2024-02-07T12:26:11.469 INFO:tasks.workunit.client.0.smithi047.stdout:0/943: write d19/d1c/d2b/f71 [1406518,62013] 0 2024-02-07T12:26:11.471 INFO:tasks.workunit.client.0.smithi047.stdout:0/944: truncate d19/d1c/d3c/d60/d6f/d95/daa/d49/f65 3981751 0 2024-02-07T12:26:11.471 INFO:tasks.workunit.client.0.smithi047.stdout:0/945: write d19/d1c/d2b/d5f/f89 [405809,82147] 0 2024-02-07T12:26:11.473 INFO:tasks.workunit.client.0.smithi047.stdout:0/946: rmdir d19/d1c/d2b/d5f/d9f 39 2024-02-07T12:26:11.475 INFO:tasks.workunit.client.0.smithi047.stdout:0/947: symlink d19/d1c/df1/d82/d9e/df4/l140 0 2024-02-07T12:26:11.475 INFO:tasks.workunit.client.0.smithi047.stdout:0/948: chown d19/d1c/df1/cd4 52423 1 2024-02-07T12:26:11.481 INFO:tasks.workunit.client.0.smithi047.stdout:0/949: read d19/d1c/f43 [3662254,37542] 0 2024-02-07T12:26:11.483 INFO:tasks.workunit.client.0.smithi047.stdout:0/950: link d19/d40/d66/da9/l101 d19/d1c/df1/l141 0 2024-02-07T12:26:11.492 INFO:tasks.workunit.client.0.smithi047.stdout:0/951: dread d19/f2d [0,4194304] 0 2024-02-07T12:26:11.494 INFO:tasks.workunit.client.0.smithi047.stdout:0/952: creat d19/d1c/d3c/d60/d6f/d135/f142 x:0 0 0 2024-02-07T12:26:11.503 INFO:tasks.workunit.client.0.smithi047.stdout:0/953: write d19/d1c/d3c/d60/f87 [340709,102805] 0 2024-02-07T12:26:11.505 INFO:tasks.workunit.client.0.smithi047.stdout:0/954: creat d19/d1c/d3c/f143 x:0 0 0 2024-02-07T12:26:11.515 INFO:tasks.workunit.client.0.smithi047.stdout:0/955: write d19/d40/d66/da9/faf [1059637,71066] 0 2024-02-07T12:26:11.515 INFO:tasks.workunit.client.0.smithi047.stdout:0/956: stat d19/d1c/d3c/d60/cc5 0 2024-02-07T12:26:11.517 INFO:tasks.workunit.client.0.smithi047.stdout:0/957: dread d19/d1c/d3c/d60/d6f/d95/daa/d49/f5c [0,4194304] 0 2024-02-07T12:26:11.517 INFO:tasks.workunit.client.0.smithi047.stdout:0/958: fsync d19/d1c/d3c/d60/fd1 0 2024-02-07T12:26:11.529 INFO:tasks.workunit.client.0.smithi047.stdout:1/745: sync 2024-02-07T12:26:11.529 INFO:tasks.workunit.client.0.smithi047.stdout:1/746: read - d1/d6e/d75/da7/fe1 zero size 2024-02-07T12:26:11.530 INFO:tasks.workunit.client.0.smithi047.stdout:1/747: symlink d1/d15/d2f/de3/lf7 0 2024-02-07T12:26:11.530 INFO:tasks.workunit.client.0.smithi047.stdout:1/748: chown d1/d15/d2f/de3/lf7 948692106 1 2024-02-07T12:26:11.531 INFO:tasks.workunit.client.0.smithi047.stdout:0/959: dwrite d19/d40/d66/d46/ff7 [0,4194304] 0 2024-02-07T12:26:11.531 INFO:tasks.workunit.client.0.smithi047.stdout:1/749: mknod d1/d15/d30/d46/d66/dac/dbc/cf8 0 2024-02-07T12:26:11.533 INFO:tasks.workunit.client.0.smithi047.stdout:0/960: write d19/d40/d66/d46/fd8 [557824,5084] 0 2024-02-07T12:26:11.533 INFO:tasks.workunit.client.0.smithi047.stdout:1/750: link d1/d15/d30/d46/f7e d1/d15/db9/ff9 0 2024-02-07T12:26:11.534 INFO:tasks.workunit.client.0.smithi047.stdout:1/751: truncate d1/d15/f1c 1801829 0 2024-02-07T12:26:11.535 INFO:tasks.workunit.client.0.smithi047.stdout:1/752: stat d1/d15/c83 0 2024-02-07T12:26:11.538 INFO:tasks.workunit.client.0.smithi047.stdout:0/961: creat d19/d1c/d24/db1/f144 x:0 0 0 2024-02-07T12:26:11.539 INFO:tasks.workunit.client.0.smithi047.stdout:1/753: dread d1/d15/d30/f6a [0,4194304] 0 2024-02-07T12:26:11.539 INFO:tasks.workunit.client.0.smithi047.stdout:1/754: dread - d1/d6e/d75/da7/ff4 zero size 2024-02-07T12:26:11.540 INFO:tasks.workunit.client.0.smithi047.stdout:0/962: dread d19/d1c/d3c/d60/d6f/fac [0,4194304] 0 2024-02-07T12:26:11.563 INFO:tasks.workunit.client.0.smithi047.stdout:1/755: dwrite d1/d37/f72 [0,4194304] 0 2024-02-07T12:26:11.563 INFO:tasks.workunit.client.0.smithi047.stdout:0/963: dwrite d19/d1c/df1/dbd/f122 [0,4194304] 0 2024-02-07T12:26:11.564 INFO:tasks.workunit.client.0.smithi047.stdout:1/756: symlink d1/d6e/lfa 0 2024-02-07T12:26:11.564 INFO:tasks.workunit.client.0.smithi047.stdout:1/757: truncate d1/d6e/dcf/d84/f88 1166065 0 2024-02-07T12:26:11.565 INFO:tasks.workunit.client.0.smithi047.stdout:1/758: symlink d1/d48/d81/lfb 0 2024-02-07T12:26:11.565 INFO:tasks.workunit.client.0.smithi047.stdout:1/759: write d1/d6e/d75/da7/f24 [676487,18787] 0 2024-02-07T12:26:11.566 INFO:tasks.workunit.client.0.smithi047.stdout:0/964: mknod d19/d1c/d2b/d5f/c145 0 2024-02-07T12:26:11.582 INFO:tasks.workunit.client.0.smithi047.stdout:9/898: sync 2024-02-07T12:26:11.585 INFO:tasks.workunit.client.0.smithi047.stdout:9/899: truncate d3/d10/d18/d3b/d3c/d5d/f7c 2334011 0 2024-02-07T12:26:11.589 INFO:tasks.workunit.client.0.smithi047.stdout:1/760: dwrite d1/d15/db9/fe2 [0,4194304] 0 2024-02-07T12:26:11.592 INFO:tasks.workunit.client.0.smithi047.stdout:1/761: truncate d1/d15/d30/d46/d66/dac/fbf 4545450 0 2024-02-07T12:26:11.594 INFO:tasks.workunit.client.0.smithi047.stdout:1/762: mkdir d1/d15/d30/d46/d4c/dfc 0 2024-02-07T12:26:11.594 INFO:tasks.workunit.client.0.smithi047.stdout:1/763: mknod d1/d6e/d75/da7/d40/cfd 0 2024-02-07T12:26:11.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:11 smithi138 ceph-mon[35528]: pgmap v22: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 154 MiB/s rd, 182 MiB/s wr, 526 op/s 2024-02-07T12:26:11.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:11 smithi047 ceph-mon[28972]: pgmap v22: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 154 MiB/s rd, 182 MiB/s wr, 526 op/s 2024-02-07T12:26:11.998 INFO:tasks.workunit.client.0.smithi047.stdout:9/900: sync 2024-02-07T12:26:11.998 INFO:tasks.workunit.client.0.smithi047.stdout:0/965: sync 2024-02-07T12:26:11.998 INFO:tasks.workunit.client.0.smithi047.stdout:1/764: sync 2024-02-07T12:26:11.998 INFO:tasks.workunit.client.0.smithi047.stdout:1/765: mknod d1/d15/d2f/de3/cfe 0 2024-02-07T12:26:11.999 INFO:tasks.workunit.client.0.smithi047.stdout:9/901: symlink d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/l139 0 2024-02-07T12:26:12.000 INFO:tasks.workunit.client.0.smithi047.stdout:9/902: chown d3/d10/d18/d3d/f89 0 1 2024-02-07T12:26:12.000 INFO:tasks.workunit.client.0.smithi047.stdout:1/766: rmdir d1/d6e/d75/da7/d65/de8 0 2024-02-07T12:26:12.001 INFO:tasks.workunit.client.0.smithi047.stdout:1/767: creat d1/d15/db9/fff x:0 0 0 2024-02-07T12:26:12.002 INFO:tasks.workunit.client.0.smithi047.stdout:9/903: rename d3/d10/d18/d3d/f89 to d3/d10/d4c/f13a 0 2024-02-07T12:26:12.003 INFO:tasks.workunit.client.0.smithi047.stdout:1/768: rmdir d1/d15/d30/d46 39 2024-02-07T12:26:12.004 INFO:tasks.workunit.client.0.smithi047.stdout:9/904: symlink d3/d10/d18/d3b/d3c/d5d/d70/l13b 0 2024-02-07T12:26:12.005 INFO:tasks.workunit.client.0.smithi047.stdout:1/769: rename d1/d6e/d75/da7/d65/l63 to d1/d15/d30/d46/dae/l100 0 2024-02-07T12:26:12.023 INFO:tasks.workunit.client.0.smithi047.stdout:9/905: dwrite d3/d10/d18/d3d/ffe [0,4194304] 0 2024-02-07T12:26:12.023 INFO:tasks.workunit.client.0.smithi047.stdout:9/906: write d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/d12f/f10b [275618,124213] 0 2024-02-07T12:26:12.032 INFO:tasks.workunit.client.0.smithi047.stdout:1/770: dwrite d1/d6e/d75/da7/f27 [0,4194304] 0 2024-02-07T12:26:12.037 INFO:tasks.workunit.client.0.smithi047.stdout:9/907: dread d3/d10/f60 [0,4194304] 0 2024-02-07T12:26:12.037 INFO:tasks.workunit.client.0.smithi047.stdout:9/908: stat d3/d10/d18/d3b/d3c/d5d 0 2024-02-07T12:26:12.038 INFO:tasks.workunit.client.0.smithi047.stdout:9/909: symlink d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/d127/l13c 0 2024-02-07T12:26:12.049 INFO:tasks.workunit.client.0.smithi047.stdout:9/910: write d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/f86 [1081665,69717] 0 2024-02-07T12:26:12.050 INFO:tasks.workunit.client.0.smithi047.stdout:9/911: creat d3/d10/d18/d3b/dc6/d12d/f13d x:0 0 0 2024-02-07T12:26:12.050 INFO:tasks.workunit.client.0.smithi047.stdout:9/912: stat d3/d10/d18/fa3 0 2024-02-07T12:26:12.050 INFO:tasks.workunit.client.0.smithi047.stdout:9/913: rmdir d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/d12f 39 2024-02-07T12:26:12.059 INFO:tasks.workunit.client.0.smithi047.stdout:9/914: write d3/d10/d18/d3b/f69 [4112686,18226] 0 2024-02-07T12:26:12.059 INFO:tasks.workunit.client.0.smithi047.stdout:9/915: fdatasync d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/dd6/f107 0 2024-02-07T12:26:12.059 INFO:tasks.workunit.client.0.smithi047.stdout:9/916: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/de6/f13e x:0 0 0 2024-02-07T12:26:12.061 INFO:tasks.workunit.client.0.smithi047.stdout:9/917: link d3/d10/cf6 d3/d10/d18/d3b/d3c/d5d/d70/c13f 0 2024-02-07T12:26:12.061 INFO:tasks.workunit.client.0.smithi047.stdout:9/918: write d3/d10/d18/d3d/f46 [5178464,31533] 0 2024-02-07T12:26:12.062 INFO:tasks.workunit.client.0.smithi047.stdout:9/919: mknod d3/d10/d18/d3b/d3c/d5d/c140 0 2024-02-07T12:26:12.489 INFO:tasks.workunit.client.0.smithi047.stdout:0/966: sync 2024-02-07T12:26:12.490 INFO:tasks.workunit.client.0.smithi047.stdout:0/967: symlink d19/d1c/d3c/d60/d6f/d95/da7/l146 0 2024-02-07T12:26:12.490 INFO:tasks.workunit.client.0.smithi047.stdout:0/968: chown d19/d40/d66/d46/ce8 83596293 1 2024-02-07T12:26:12.493 INFO:tasks.workunit.client.0.smithi047.stdout:0/969: unlink d19/d1c/d3c/d48/l8a 0 2024-02-07T12:26:12.512 INFO:tasks.workunit.client.0.smithi047.stdout:0/970: dwrite d19/d1c/d3c/fea [0,4194304] 0 2024-02-07T12:26:12.518 INFO:tasks.workunit.client.0.smithi047.stdout:0/971: getdents d19/d1c/d3c/d60/d6f/d135 0 2024-02-07T12:26:12.522 INFO:tasks.workunit.client.0.smithi047.stdout:0/972: rename d19/d1c/d2b/d5f/d9f/dd3/d103 to d19/d40/d66/d147 0 2024-02-07T12:26:12.526 INFO:tasks.workunit.client.0.smithi047.stdout:0/973: symlink d19/d40/d66/d46/df0/l148 0 2024-02-07T12:26:12.528 INFO:tasks.workunit.client.0.smithi047.stdout:0/974: mknod d19/d40/d66/d46/c149 0 2024-02-07T12:26:12.534 INFO:tasks.workunit.client.0.smithi047.stdout:9/920: sync 2024-02-07T12:26:12.534 INFO:tasks.workunit.client.0.smithi047.stdout:1/771: sync 2024-02-07T12:26:12.534 INFO:tasks.workunit.client.0.smithi047.stdout:9/921: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/f141 x:0 0 0 2024-02-07T12:26:12.535 INFO:tasks.workunit.client.0.smithi047.stdout:9/922: chown d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/f6f 0 1 2024-02-07T12:26:12.537 INFO:tasks.workunit.client.0.smithi047.stdout:9/923: rename d3/fa0 to d3/d10/d4c/f142 0 2024-02-07T12:26:12.538 INFO:tasks.workunit.client.0.smithi047.stdout:9/924: getdents d3/d10/d18/d3b/d3c 0 2024-02-07T12:26:12.539 INFO:tasks.workunit.client.0.smithi047.stdout:9/925: dread d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/f54 [0,4194304] 0 2024-02-07T12:26:12.551 INFO:tasks.workunit.client.0.smithi047.stdout:1/772: dwrite d1/d15/db9/ff9 [0,4194304] 0 2024-02-07T12:26:12.555 INFO:tasks.workunit.client.0.smithi047.stdout:1/773: rename d1/d6e/d75/f8f to d1/d48/d81/f101 0 2024-02-07T12:26:12.555 INFO:tasks.workunit.client.0.smithi047.stdout:1/774: fsync d1/d48/d74/fc0 0 2024-02-07T12:26:12.569 INFO:tasks.workunit.client.0.smithi047.stdout:1/775: dwrite d1/d6e/d75/da7/f23 [4194304,4194304] 0 2024-02-07T12:26:12.569 INFO:tasks.workunit.client.0.smithi047.stdout:1/776: truncate d1/d6e/dcf/d3e/f43 1487358 0 2024-02-07T12:26:12.570 INFO:tasks.workunit.client.0.smithi047.stdout:1/777: mknod d1/d48/d74/c102 0 2024-02-07T12:26:12.571 INFO:tasks.workunit.client.0.smithi047.stdout:1/778: creat d1/d48/dc9/f103 x:0 0 0 2024-02-07T12:26:12.571 INFO:tasks.workunit.client.0.smithi047.stdout:1/779: truncate d1/d15/d30/f6a 1873400 0 2024-02-07T12:26:12.579 INFO:tasks.workunit.client.0.smithi047.stdout:1/780: dread d1/d15/d2f/f6c [0,4194304] 0 2024-02-07T12:26:12.595 INFO:tasks.workunit.client.0.smithi047.stdout:1/781: dwrite d1/f22 [0,4194304] 0 2024-02-07T12:26:12.596 INFO:tasks.workunit.client.0.smithi047.stdout:1/782: mkdir d1/d15/d30/d46/d66/dac/dbc/d104 0 2024-02-07T12:26:12.596 INFO:tasks.workunit.client.0.smithi047.stdout:1/783: chown d1/d2a/la9 1685 1 2024-02-07T12:26:12.618 INFO:tasks.workunit.client.0.smithi047.stdout:1/784: dwrite d1/d48/d81/f91 [0,4194304] 0 2024-02-07T12:26:12.619 INFO:tasks.workunit.client.0.smithi047.stdout:1/785: write d1/d6e/dcf/d84/f88 [255268,124329] 0 2024-02-07T12:26:13.024 INFO:tasks.workunit.client.0.smithi047.stdout:0/975: sync 2024-02-07T12:26:13.025 INFO:tasks.workunit.client.0.smithi047.stdout:9/926: sync 2024-02-07T12:26:13.025 INFO:tasks.workunit.client.0.smithi047.stdout:1/786: sync 2024-02-07T12:26:13.025 INFO:tasks.workunit.client.0.smithi047.stdout:0/976: stat d19/d40/d66/d46/f5e 0 2024-02-07T12:26:13.025 INFO:tasks.workunit.client.0.smithi047.stdout:9/927: chown d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/d12f/fec 68259242 1 2024-02-07T12:26:13.025 INFO:tasks.workunit.client.0.smithi047.stdout:9/928: write d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/d12f/f10b [514460,130107] 0 2024-02-07T12:26:13.025 INFO:tasks.workunit.client.0.smithi047.stdout:9/929: fdatasync d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/fe8 0 2024-02-07T12:26:13.025 INFO:tasks.workunit.client.0.smithi047.stdout:0/977: symlink d19/d1c/df1/dbd/l14a 0 2024-02-07T12:26:13.026 INFO:tasks.workunit.client.0.smithi047.stdout:1/787: unlink d1/d6e/dcf/d84/f88 0 2024-02-07T12:26:13.027 INFO:tasks.workunit.client.0.smithi047.stdout:0/978: mkdir d19/d40/d66/da9/d14b 0 2024-02-07T12:26:13.027 INFO:tasks.workunit.client.0.smithi047.stdout:1/788: mkdir d1/d105 0 2024-02-07T12:26:13.027 INFO:tasks.workunit.client.0.smithi047.stdout:1/789: truncate d1/d37/faf 534801 0 2024-02-07T12:26:13.028 INFO:tasks.workunit.client.0.smithi047.stdout:1/790: rmdir d1/d15/d30/d46/d66/dac 39 2024-02-07T12:26:13.036 INFO:tasks.workunit.client.0.smithi047.stdout:9/930: dread d3/f40 [4194304,4194304] 0 2024-02-07T12:26:13.057 INFO:tasks.workunit.client.0.smithi047.stdout:0/979: dwrite d19/d1c/d2b/d5f/f89 [0,4194304] 0 2024-02-07T12:26:13.057 INFO:tasks.workunit.client.0.smithi047.stdout:0/980: stat d19/d1c/d2b/d5f/f110 0 2024-02-07T12:26:13.057 INFO:tasks.workunit.client.0.smithi047.stdout:0/981: readlink d19/d1c/d3c/d60/d6f/d95/daa/d8c/l126 0 2024-02-07T12:26:13.057 INFO:tasks.workunit.client.0.smithi047.stdout:1/791: dwrite d1/d6e/d75/da7/f2b [4194304,4194304] 0 2024-02-07T12:26:13.057 INFO:tasks.workunit.client.0.smithi047.stdout:9/931: dwrite d3/d10/d18/d3b/d3c/d5d/d70/dad/f125 [0,4194304] 0 2024-02-07T12:26:13.058 INFO:tasks.workunit.client.0.smithi047.stdout:1/792: rename d1/d15/d30/d46/dae/lb0 to d1/d6e/l106 0 2024-02-07T12:26:13.060 INFO:tasks.workunit.client.0.smithi047.stdout:9/932: creat d3/d10/d18/d3b/f143 x:0 0 0 2024-02-07T12:26:13.061 INFO:tasks.workunit.client.0.smithi047.stdout:0/982: mkdir d19/d1c/df1/d82/d9e/d14c 0 2024-02-07T12:26:13.061 INFO:tasks.workunit.client.0.smithi047.stdout:0/983: stat d19/d1c/d3c/d60/d6f/d95/lc3 0 2024-02-07T12:26:13.071 INFO:tasks.workunit.client.0.smithi047.stdout:0/984: read d19/d1c/d2b/f77 [711668,120186] 0 2024-02-07T12:26:13.077 INFO:tasks.workunit.client.0.smithi047.stdout:1/793: dwrite d1/d15/d30/d46/d66/fb6 [0,4194304] 0 2024-02-07T12:26:13.078 INFO:tasks.workunit.client.0.smithi047.stdout:9/933: dwrite d3/d10/d18/d3b/fc9 [0,4194304] 0 2024-02-07T12:26:13.080 INFO:tasks.workunit.client.0.smithi047.stdout:1/794: symlink d1/d15/d30/d46/d4c/dfc/l107 0 2024-02-07T12:26:13.080 INFO:tasks.workunit.client.0.smithi047.stdout:1/795: truncate d1/d15/db9/ff9 4895795 0 2024-02-07T12:26:13.081 INFO:tasks.workunit.client.0.smithi047.stdout:9/934: creat d3/d10/d18/d3b/d3c/d5d/d70/dad/dbf/f144 x:0 0 0 2024-02-07T12:26:13.081 INFO:tasks.workunit.client.0.smithi047.stdout:1/796: symlink d1/d15/d30/d46/d66/l108 0 2024-02-07T12:26:13.083 INFO:tasks.workunit.client.0.smithi047.stdout:9/935: unlink d3/d10/d4c/fcf 0 2024-02-07T12:26:13.083 INFO:tasks.workunit.client.0.smithi047.stdout:9/936: truncate d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/f141 1026825 0 2024-02-07T12:26:13.086 INFO:tasks.workunit.client.0.smithi047.stdout:0/985: dwrite d19/d40/d66/d46/f12a [0,4194304] 0 2024-02-07T12:26:13.101 INFO:tasks.workunit.client.0.smithi047.stdout:1/797: dwrite d1/d6e/d75/da7/f23 [4194304,4194304] 0 2024-02-07T12:26:13.101 INFO:tasks.workunit.client.0.smithi047.stdout:0/986: dwrite d19/d40/d66/d46/ff7 [0,4194304] 0 2024-02-07T12:26:13.108 INFO:tasks.workunit.client.0.smithi047.stdout:1/798: write d1/d6e/dcf/f55 [1226840,60302] 0 2024-02-07T12:26:13.110 INFO:tasks.workunit.client.0.smithi047.stdout:0/987: dread d19/d1c/d3c/d60/d6f/d95/daa/d49/f65 [0,4194304] 0 2024-02-07T12:26:13.110 INFO:tasks.workunit.client.0.smithi047.stdout:0/988: creat d19/d1c/d3c/d60/d6f/d95/f14d x:0 0 0 2024-02-07T12:26:13.110 INFO:tasks.workunit.client.0.smithi047.stdout:0/989: truncate d19/d1c/d3c/d60/d6f/fe7 81247 0 2024-02-07T12:26:13.110 INFO:tasks.workunit.client.0.smithi047.stdout:0/990: readlink d19/d40/l4f 0 2024-02-07T12:26:13.111 INFO:tasks.workunit.client.0.smithi047.stdout:1/799: rename d1/d6e/d75/da7/d80/lca to d1/d15/d30/d46/d66/dac/l109 0 2024-02-07T12:26:13.116 INFO:tasks.workunit.client.0.smithi047.stdout:0/991: rename d19/d1c/d3c/fe6 to d19/d1c/f14e 0 2024-02-07T12:26:13.116 INFO:tasks.workunit.client.0.smithi047.stdout:0/992: write d19/d1c/d3c/d60/f87 [1116338,15772] 0 2024-02-07T12:26:13.127 INFO:tasks.workunit.client.0.smithi047.stdout:1/800: dwrite d1/d6e/d75/da7/f4f [4194304,4194304] 0 2024-02-07T12:26:13.129 INFO:tasks.workunit.client.0.smithi047.stdout:1/801: link d1/d6e/dcf/d3e/f43 d1/d37/f10a 0 2024-02-07T12:26:13.129 INFO:tasks.workunit.client.0.smithi047.stdout:1/802: dread - d1/d48/dc9/f103 zero size 2024-02-07T12:26:13.130 INFO:tasks.workunit.client.0.smithi047.stdout:1/803: read d1/d6e/d75/da7/d65/f92 [27796,34691] 0 2024-02-07T12:26:13.137 INFO:tasks.workunit.client.0.smithi047.stdout:0/993: dwrite d19/d1c/d2b/f88 [0,4194304] 0 2024-02-07T12:26:13.139 INFO:tasks.workunit.client.0.smithi047.stdout:0/994: mkdir d19/d40/d66/da9/d14f 0 2024-02-07T12:26:13.140 INFO:tasks.workunit.client.0.smithi047.stdout:0/995: symlink d19/d40/d66/d46/df0/l150 0 2024-02-07T12:26:13.149 INFO:tasks.workunit.client.0.smithi047.stdout:1/804: dwrite d1/d15/d30/d46/d4c/f6d [0,4194304] 0 2024-02-07T12:26:13.155 INFO:tasks.workunit.client.0.smithi047.stdout:0/996: write d19/f26 [3561030,76280] 0 2024-02-07T12:26:13.155 INFO:tasks.workunit.client.0.smithi047.stdout:0/997: mkdir d19/d1c/d3c/d60/d6f/d135/d151 0 2024-02-07T12:26:13.160 INFO:tasks.workunit.client.0.smithi047.stdout:1/805: write d1/d15/d30/d46/d66/dac/dbc/fbd [635296,10520] 0 2024-02-07T12:26:13.162 INFO:tasks.workunit.client.0.smithi047.stdout:1/806: link d1/d6e/d75/da7/d65/cab d1/d48/c10b 0 2024-02-07T12:26:13.164 INFO:tasks.workunit.client.0.smithi047.stdout:1/807: creat d1/d15/d30/d46/d66/dac/f10c x:0 0 0 2024-02-07T12:26:13.164 INFO:tasks.workunit.client.0.smithi047.stdout:1/808: creat d1/d6e/dcf/d84/f10d x:0 0 0 2024-02-07T12:26:13.165 INFO:tasks.workunit.client.0.smithi047.stdout:1/809: getdents d1/d15/d30/d46/d4c 0 2024-02-07T12:26:13.167 INFO:tasks.workunit.client.0.smithi047.stdout:0/998: dwrite d19/d1c/df1/d82/d9e/f131 [0,4194304] 0 2024-02-07T12:26:13.167 INFO:tasks.workunit.client.0.smithi047.stdout:0/999: readlink d19/d40/d66/d46/df0/l150 0 2024-02-07T12:26:13.167 INFO:tasks.workunit.client.0.smithi047.stdout:1/810: rename d1/d48/d81/f101 to d1/d48/dc9/f10e 0 2024-02-07T12:26:13.179 INFO:tasks.workunit.client.0.smithi047.stdout:1/811: dwrite d1/d37/f60 [0,4194304] 0 2024-02-07T12:26:13.197 INFO:tasks.workunit.client.0.smithi047.stdout:1/812: dwrite d1/d6e/dcf/d84/fa1 [0,4194304] 0 2024-02-07T12:26:13.197 INFO:tasks.workunit.client.0.smithi047.stdout:1/813: read - d1/d15/db9/fff zero size 2024-02-07T12:26:13.201 INFO:tasks.workunit.client.0.smithi047.stdout:1/814: write d1/d6e/d75/da7/f1d [82154,16192] 0 2024-02-07T12:26:13.201 INFO:tasks.workunit.client.0.smithi047.stdout:1/815: write d1/d15/f79 [1301157,112574] 0 2024-02-07T12:26:13.202 INFO:tasks.workunit.client.0.smithi047.stdout:1/816: truncate d1/d6e/dcf/d3e/f4a 2577088 0 2024-02-07T12:26:13.203 INFO:tasks.workunit.client.0.smithi047.stdout:1/817: mknod d1/d15/d2f/c10f 0 2024-02-07T12:26:13.203 INFO:tasks.workunit.client.0.smithi047.stdout:1/818: fsync d1/d48/d74/fa3 0 2024-02-07T12:26:13.203 INFO:tasks.workunit.client.0.smithi047.stdout:1/819: dread - d1/d6e/dcf/d84/f10d zero size 2024-02-07T12:26:13.205 INFO:tasks.workunit.client.0.smithi047.stdout:1/820: dread d1/d15/d30/f6a [0,4194304] 0 2024-02-07T12:26:13.205 INFO:tasks.workunit.client.0.smithi047.stdout:1/821: truncate d1/d6e/d75/da7/d40/fd5 582648 0 2024-02-07T12:26:13.207 INFO:tasks.workunit.client.0.smithi047.stdout:1/822: creat d1/d15/d30/d46/d4c/f110 x:0 0 0 2024-02-07T12:26:13.207 INFO:tasks.workunit.client.0.smithi047.stdout:1/823: creat d1/d6e/d75/da7/d65/f111 x:0 0 0 2024-02-07T12:26:13.209 INFO:tasks.workunit.client.0.smithi047.stdout:1/824: creat d1/d6e/dcf/d3e/dbb/f112 x:0 0 0 2024-02-07T12:26:13.209 INFO:tasks.workunit.client.0.smithi047.stdout:1/825: chown d1/c54 9 1 2024-02-07T12:26:13.209 INFO:tasks.workunit.client.0.smithi047.stdout:1/826: dread - d1/d6e/d75/da7/d65/f111 zero size 2024-02-07T12:26:13.215 INFO:tasks.workunit.client.0.smithi047.stdout:1/827: dread d1/fe [0,4194304] 0 2024-02-07T12:26:13.216 INFO:tasks.workunit.client.0.smithi047.stdout:1/828: rename d1/d6e/dcf/d84/la4 to d1/d15/db9/l113 0 2024-02-07T12:26:13.217 INFO:tasks.workunit.client.0.smithi047.stdout:1/829: write d1/d6e/dcf/d3e/dbb/f112 [492488,121913] 0 2024-02-07T12:26:13.218 INFO:tasks.workunit.client.0.smithi047.stdout:1/830: read d1/d37/f10a [909277,95910] 0 2024-02-07T12:26:13.218 INFO:tasks.workunit.client.0.smithi047.stdout:1/831: dread - d1/d6e/d75/da7/d65/fce zero size 2024-02-07T12:26:13.218 INFO:tasks.workunit.client.0.smithi047.stdout:1/832: read - d1/d6e/dcf/f8b zero size 2024-02-07T12:26:13.218 INFO:tasks.workunit.client.0.smithi047.stdout:1/833: unlink d1/d2a/c31 0 2024-02-07T12:26:13.219 INFO:tasks.workunit.client.0.smithi047.stdout:1/834: creat d1/d15/d30/d46/d66/dac/dbc/d104/f114 x:0 0 0 2024-02-07T12:26:13.220 INFO:tasks.workunit.client.0.smithi047.stdout:1/835: creat d1/d6e/d75/deb/f115 x:0 0 0 2024-02-07T12:26:13.233 INFO:tasks.workunit.client.0.smithi047.stdout:1/836: dwrite d1/d37/f60 [0,4194304] 0 2024-02-07T12:26:13.233 INFO:tasks.workunit.client.0.smithi047.stdout:1/837: creat d1/d48/d74/f116 x:0 0 0 2024-02-07T12:26:13.238 INFO:tasks.workunit.client.0.smithi047.stdout:1/838: fsync d1/d48/d74/f116 0 2024-02-07T12:26:13.239 INFO:tasks.workunit.client.0.smithi047.stdout:1/839: rmdir d1/d15/d30/d46 39 2024-02-07T12:26:13.240 INFO:tasks.workunit.client.0.smithi047.stdout:1/840: getdents d1/d48/d81 0 2024-02-07T12:26:13.240 INFO:tasks.workunit.client.0.smithi047.stdout:1/841: read - d1/d6e/d75/da7/d65/f111 zero size 2024-02-07T12:26:13.256 INFO:tasks.workunit.client.0.smithi047.stdout:1/842: dwrite d1/d15/d30/d46/f59 [0,4194304] 0 2024-02-07T12:26:13.257 INFO:tasks.workunit.client.0.smithi047.stdout:1/843: symlink d1/d48/d81/l117 0 2024-02-07T12:26:13.259 INFO:tasks.workunit.client.0.smithi047.stdout:1/844: creat d1/d6e/dcf/f118 x:0 0 0 2024-02-07T12:26:13.260 INFO:tasks.workunit.client.0.smithi047.stdout:1/845: symlink d1/d48/d74/l119 0 2024-02-07T12:26:13.277 INFO:tasks.workunit.client.0.smithi047.stdout:1/846: dwrite d1/d15/f1c [0,4194304] 0 2024-02-07T12:26:13.277 INFO:tasks.workunit.client.0.smithi047.stdout:1/847: chown d1/d15/d30 382639014 1 2024-02-07T12:26:13.288 INFO:tasks.workunit.client.0.smithi047.stdout:1/848: dread d1/d15/d30/d46/d4c/f6d [0,4194304] 0 2024-02-07T12:26:13.296 INFO:tasks.workunit.client.0.smithi047.stdout:1/849: dread d1/d37/f72 [0,4194304] 0 2024-02-07T12:26:13.296 INFO:tasks.workunit.client.0.smithi047.stdout:1/850: stat d1/d15/d2f 0 2024-02-07T12:26:13.297 INFO:tasks.workunit.client.0.smithi047.stdout:1/851: mkdir d1/d6e/dcf/d3e/dbb/de0/d11a 0 2024-02-07T12:26:13.298 INFO:tasks.workunit.client.0.smithi047.stdout:1/852: truncate d1/d15/d2f/de3/fe4 2745713 0 2024-02-07T12:26:13.314 INFO:tasks.workunit.client.0.smithi047.stdout:1/853: dwrite d1/d6e/dcf/d3e/dbb/f112 [0,4194304] 0 2024-02-07T12:26:13.316 INFO:tasks.workunit.client.0.smithi047.stdout:1/854: mkdir d1/d11b 0 2024-02-07T12:26:13.316 INFO:tasks.workunit.client.0.smithi047.stdout:1/855: readlink d1/d6e/d75/da7/d65/ldb 0 2024-02-07T12:26:13.318 INFO:tasks.workunit.client.0.smithi047.stdout:1/856: mknod d1/d6e/d75/da7/c11c 0 2024-02-07T12:26:13.318 INFO:tasks.workunit.client.0.smithi047.stdout:1/857: write d1/d6e/d75/da7/d65/fba [125472,60082] 0 2024-02-07T12:26:13.318 INFO:tasks.workunit.client.0.smithi047.stdout:1/858: chown d1/d6e/dcf/d3e/dbb/de0 3 1 2024-02-07T12:26:13.318 INFO:tasks.workunit.client.0.smithi047.stdout:1/859: dread - d1/d6e/d75/da7/d65/fd1 zero size 2024-02-07T12:26:13.318 INFO:tasks.workunit.client.0.smithi047.stdout:1/860: getdents d1/d11b 0 2024-02-07T12:26:13.318 INFO:tasks.workunit.client.0.smithi047.stdout:1/861: chown d1/d6e/d75/da7/d65/fd1 954 1 2024-02-07T12:26:13.321 INFO:tasks.workunit.client.0.smithi047.stdout:1/862: dread d1/d6e/d75/da7/f24 [0,4194304] 0 2024-02-07T12:26:13.322 INFO:tasks.workunit.client.0.smithi047.stdout:1/863: getdents d1/d48 0 2024-02-07T12:26:13.452 INFO:tasks.workunit.client.0.smithi047.stdout:9/937: sync 2024-02-07T12:26:13.452 INFO:tasks.workunit.client.0.smithi047.stdout:9/938: truncate d3/d10/d18/d3b/dc6/d12d/f13d 434060 0 2024-02-07T12:26:13.452 INFO:tasks.workunit.client.0.smithi047.stdout:9/939: write d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/d12f/fef [395119,14703] 0 2024-02-07T12:26:13.452 INFO:tasks.workunit.client.0.smithi047.stdout:9/940: readlink d3/d10/d18/d3b/d3c/l131 0 2024-02-07T12:26:13.453 INFO:tasks.workunit.client.0.smithi047.stdout:9/941: stat d3/cb0 0 2024-02-07T12:26:13.453 INFO:tasks.workunit.client.0.smithi047.stdout:9/942: chown d3/d10/d4c/f8d 539 1 2024-02-07T12:26:13.454 INFO:tasks.workunit.client.0.smithi047.stdout:9/943: mknod d3/c145 0 2024-02-07T12:26:13.468 INFO:tasks.workunit.client.0.smithi047.stdout:9/944: dwrite d3/d10/f67 [4194304,4194304] 0 2024-02-07T12:26:13.468 INFO:tasks.workunit.client.0.smithi047.stdout:9/945: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/de6/f146 x:0 0 0 2024-02-07T12:26:13.468 INFO:tasks.workunit.client.0.smithi047.stdout:9/946: chown d3/d10/d18/d6e/d9a/daf/fe3 1910833828 1 2024-02-07T12:26:13.468 INFO:tasks.workunit.client.0.smithi047.stdout:9/947: write d3/d10/d18/d3d/dc0/f108 [895195,27535] 0 2024-02-07T12:26:13.533 INFO:tasks.workunit.client.0.smithi047.stdout:9/948: dread d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/d12f/dcd/fde [0,4194304] 0 2024-02-07T12:26:13.534 INFO:tasks.workunit.client.0.smithi047.stdout:9/949: dread - d3/d10/d18/d3a/f94 zero size 2024-02-07T12:26:13.534 INFO:tasks.workunit.client.0.smithi047.stdout:9/950: fsync d3/d10/d18/d3a/f44 0 2024-02-07T12:26:13.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:13 smithi138 ceph-mon[35528]: pgmap v23: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 98 MiB/s rd, 123 MiB/s wr, 353 op/s 2024-02-07T12:26:13.543 INFO:tasks.workunit.client.0.smithi047.stdout:9/951: dread d3/d10/f67 [0,4194304] 0 2024-02-07T12:26:13.543 INFO:tasks.workunit.client.0.smithi047.stdout:9/952: dread - d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/d127/ff3 zero size 2024-02-07T12:26:13.544 INFO:tasks.workunit.client.0.smithi047.stdout:9/953: mkdir d3/d10/d18/d3b/dc6/d12d/d147 0 2024-02-07T12:26:13.547 INFO:tasks.workunit.client.0.smithi047.stdout:9/954: rmdir d3/d10/d18/d3b/d3c/d5d/d132 0 2024-02-07T12:26:13.548 INFO:tasks.workunit.client.0.smithi047.stdout:9/955: symlink d3/d10/d18/d3b/dc6/d12d/l148 0 2024-02-07T12:26:13.550 INFO:tasks.workunit.client.0.smithi047.stdout:9/956: symlink d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/l149 0 2024-02-07T12:26:13.550 INFO:tasks.workunit.client.0.smithi047.stdout:9/957: stat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/cb8 0 2024-02-07T12:26:13.550 INFO:tasks.workunit.client.0.smithi047.stdout:9/958: chown d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/de6/f146 120150 1 2024-02-07T12:26:13.577 INFO:tasks.workunit.client.0.smithi047.stdout:9/959: dwrite d3/d10/d18/f1b [0,4194304] 0 2024-02-07T12:26:13.580 INFO:tasks.workunit.client.0.smithi047.stdout:9/960: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/d12f/f14a x:0 0 0 2024-02-07T12:26:13.583 INFO:tasks.workunit.client.0.smithi047.stdout:9/961: rename d3/d10/d18/f27 to d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/d127/f14b 0 2024-02-07T12:26:13.585 INFO:tasks.workunit.client.0.smithi047.stdout:9/962: rmdir d3/d10/d11 39 2024-02-07T12:26:13.585 INFO:tasks.workunit.client.0.smithi047.stdout:9/963: stat d3/d10/d11/c64 0 2024-02-07T12:26:13.585 INFO:tasks.workunit.client.0.smithi047.stdout:9/964: chown d3/d10/d18/d3b/f11b 198641 1 2024-02-07T12:26:13.585 INFO:tasks.workunit.client.0.smithi047.stdout:9/965: fdatasync d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/fe8 0 2024-02-07T12:26:13.588 INFO:tasks.workunit.client.0.smithi047.stdout:9/966: unlink d3/d10/d18/d3b/d3c/d47/f11f 0 2024-02-07T12:26:13.589 INFO:tasks.workunit.client.0.smithi047.stdout:9/967: dread d3/d10/d18/d3b/d3c/d5d/fa6 [0,4194304] 0 2024-02-07T12:26:13.591 INFO:tasks.workunit.client.0.smithi047.stdout:9/968: creat d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/ddf/f14c x:0 0 0 2024-02-07T12:26:13.593 INFO:tasks.workunit.client.0.smithi047.stdout:9/969: mknod d3/d10/d18/d3d/c14d 0 2024-02-07T12:26:13.599 INFO:tasks.workunit.client.0.smithi047.stdout:9/970: getdents d3/d10/d18/d3d 0 2024-02-07T12:26:13.601 INFO:tasks.workunit.client.0.smithi047.stdout:9/971: creat d3/d10/f14e x:0 0 0 2024-02-07T12:26:13.625 INFO:tasks.workunit.client.0.smithi047.stdout:9/972: dwrite d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/f10e [0,4194304] 0 2024-02-07T12:26:13.629 INFO:tasks.workunit.client.0.smithi047.stdout:9/973: unlink d3/d10/d18/d3b/d3c/d5d/c140 0 2024-02-07T12:26:13.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:13 smithi047 ceph-mon[28972]: pgmap v23: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 98 MiB/s rd, 123 MiB/s wr, 353 op/s 2024-02-07T12:26:13.878 INFO:tasks.workunit.client.0.smithi047.stdout:1/864: sync 2024-02-07T12:26:13.878 INFO:tasks.workunit.client.0.smithi047.stdout:9/974: sync 2024-02-07T12:26:13.891 INFO:tasks.workunit.client.0.smithi047.stdout:9/975: dwrite d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/de6/f13e [0,4194304] 0 2024-02-07T12:26:13.895 INFO:tasks.workunit.client.0.smithi047.stdout:9/976: rename d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/fe8 to d3/d10/d18/d3b/d3c/d5d/d70/d7a/d90/d6b/de6/f14f 0 2024-02-07T12:26:13.897 INFO:tasks.workunit.client.0.smithi047.stdout:9/977: dread d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/f141 [0,4194304] 0 2024-02-07T12:26:13.897 INFO:tasks.workunit.client.0.smithi047.stdout:9/978: chown d3/d10/d18/d3b/cdc 37555 1 2024-02-07T12:26:13.897 INFO:tasks.workunit.client.0.smithi047.stdout:9/979: fsync d3/d10/d4c/f5b 0 2024-02-07T12:26:13.898 INFO:tasks.workunit.client.0.smithi047.stdout:9/980: symlink d3/d10/d18/d3b/dc6/l150 0 2024-02-07T12:26:13.899 INFO:tasks.workunit.client.0.smithi047.stdout:9/981: creat d3/d10/d18/d6e/d9a/f151 x:0 0 0 2024-02-07T12:26:13.900 INFO:tasks.workunit.client.0.smithi047.stdout:9/982: mkdir d3/d10/d18/d3a/da7/d152 0 2024-02-07T12:26:13.901 INFO:tasks.workunit.client.0.smithi047.stdout:9/983: mknod d3/d10/d18/d3b/d3c/c153 0 2024-02-07T12:26:13.912 INFO:tasks.workunit.client.0.smithi047.stdout:9/984: dread d3/d10/f67 [4194304,4194304] 0 2024-02-07T12:26:13.912 INFO:tasks.workunit.client.0.smithi047.stdout:9/985: stat d3/f11e 0 2024-02-07T12:26:13.912 INFO:tasks.workunit.client.0.smithi047.stdout:9/986: stat d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/d127 0 2024-02-07T12:26:13.912 INFO:tasks.workunit.client.0.smithi047.stdout:9/987: fsync d3/fdd 0 2024-02-07T12:26:13.912 INFO:tasks.workunit.client.0.smithi047.stdout:9/988: fdatasync d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/d127/f14b 0 2024-02-07T12:26:13.912 INFO:tasks.workunit.client.0.smithi047.stdout:9/989: write d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/f128 [234061,121007] 0 2024-02-07T12:26:13.912 INFO:tasks.workunit.client.0.smithi047.stdout:9/990: write d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/d127/f122 [25542,62326] 0 2024-02-07T12:26:13.912 INFO:tasks.workunit.client.0.smithi047.stdout:9/991: creat d3/d10/d18/d3b/d3c/d47/f154 x:0 0 0 2024-02-07T12:26:14.246 INFO:tasks.workunit.client.0.smithi047.stdout:9/992: sync 2024-02-07T12:26:14.246 INFO:tasks.workunit.client.0.smithi047.stdout:1/865: sync 2024-02-07T12:26:14.247 INFO:tasks.workunit.client.0.smithi047.stdout:9/993: mknod d3/d10/d18/d3a/da7/c155 0 2024-02-07T12:26:14.247 INFO:tasks.workunit.client.0.smithi047.stdout:9/994: fdatasync d3/d10/f4b 0 2024-02-07T12:26:14.248 INFO:tasks.workunit.client.0.smithi047.stdout:9/995: symlink d3/d10/d18/d3a/da7/l156 0 2024-02-07T12:26:14.249 INFO:tasks.workunit.client.0.smithi047.stdout:9/996: symlink d3/d10/d18/d3b/d3c/d5d/d70/d7a/dc4/df0/df8/d12f/dcd/l157 0 2024-02-07T12:26:14.249 INFO:tasks.workunit.client.0.smithi047.stdout:9/997: fdatasync d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/ddf/f14c 0 2024-02-07T12:26:14.251 INFO:tasks.workunit.client.0.smithi047.stdout:9/998: rename d3/d10/d4c/d105/d11a/l12b to d3/d10/d18/d3b/d3c/d5d/d70/d7a/d8c/l158 0 2024-02-07T12:26:14.252 INFO:tasks.workunit.client.0.smithi047.stdout:9/999: symlink d3/d10/d11/l159 0 2024-02-07T12:26:14.265 INFO:tasks.workunit.client.0.smithi047.stdout:1/866: dwrite d1/f87 [0,4194304] 0 2024-02-07T12:26:14.267 INFO:tasks.workunit.client.0.smithi047.stdout:1/867: creat d1/d6e/dcf/d3e/dbb/de0/d11a/f11d x:0 0 0 2024-02-07T12:26:14.267 INFO:tasks.workunit.client.0.smithi047.stdout:1/868: readlink d1/d6e/dcf/lea 0 2024-02-07T12:26:14.267 INFO:tasks.workunit.client.0.smithi047.stdout:1/869: creat d1/d15/d30/d46/d66/dac/f11e x:0 0 0 2024-02-07T12:26:14.273 INFO:tasks.workunit.client.0.smithi047.stdout:1/870: write d1/d6e/d75/da7/d40/fd5 [1511723,12939] 0 2024-02-07T12:26:14.293 INFO:tasks.workunit.client.0.smithi047.stdout:1/871: dwrite d1/d15/d30/f6a [0,4194304] 0 2024-02-07T12:26:14.300 INFO:tasks.workunit.client.0.smithi047.stdout:1/872: dread d1/d15/d30/d46/f59 [0,4194304] 0 2024-02-07T12:26:14.300 INFO:tasks.workunit.client.0.smithi047.stdout:1/873: chown d1/d15/db9/fec 407521101 1 2024-02-07T12:26:14.300 INFO:tasks.workunit.client.0.smithi047.stdout:1/874: chown d1/d15/d30/d46/d66/dac/f10c 274 1 2024-02-07T12:26:14.301 INFO:tasks.workunit.client.0.smithi047.stdout:1/875: write d1/d6e/d75/da7/f41 [4373343,73953] 0 2024-02-07T12:26:14.301 INFO:tasks.workunit.client.0.smithi047.stdout:1/876: symlink d1/d48/dc7/l11f 0 2024-02-07T12:26:14.316 INFO:tasks.workunit.client.0.smithi047.stdout:1/877: dwrite d1/d15/f1c [0,4194304] 0 2024-02-07T12:26:14.316 INFO:tasks.workunit.client.0.smithi047.stdout:1/878: truncate d1/d48/d74/f116 982185 0 2024-02-07T12:26:14.316 INFO:tasks.workunit.client.0.smithi047.stdout:1/879: readlink d1/d6e/dcf/lea 0 2024-02-07T12:26:14.316 INFO:tasks.workunit.client.0.smithi047.stdout:1/880: fdatasync d1/d2a/f97 0 2024-02-07T12:26:14.328 INFO:tasks.workunit.client.0.smithi047.stdout:1/881: dread d1/d15/d30/fa5 [0,4194304] 0 2024-02-07T12:26:14.328 INFO:tasks.workunit.client.0.smithi047.stdout:1/882: chown d1/d37/fe7 12225 1 2024-02-07T12:26:14.329 INFO:tasks.workunit.client.0.smithi047.stdout:1/883: symlink d1/d2a/l120 0 2024-02-07T12:26:14.348 INFO:tasks.workunit.client.0.smithi047.stdout:1/884: dwrite d1/d6e/dcf/d84/f10d [0,4194304] 0 2024-02-07T12:26:14.350 INFO:tasks.workunit.client.0.smithi047.stdout:1/885: symlink d1/d48/dc9/l121 0 2024-02-07T12:26:14.356 INFO:tasks.workunit.client.0.smithi047.stdout:1/886: dread d1/d6e/dcf/d3e/f4a [0,4194304] 0 2024-02-07T12:26:14.356 INFO:tasks.workunit.client.0.smithi047.stdout:1/887: write d1/d6e/dcf/d3e/f7a [701215,128141] 0 2024-02-07T12:26:14.359 INFO:tasks.workunit.client.0.smithi047.stdout:1/888: rename d1/d6e/dcf/d3e/f43 to d1/d15/d2f/f122 0 2024-02-07T12:26:14.359 INFO:tasks.workunit.client.0.smithi047.stdout:1/889: creat d1/d6e/dcf/d3e/dbb/f123 x:0 0 0 2024-02-07T12:26:14.359 INFO:tasks.workunit.client.0.smithi047.stdout:1/890: truncate d1/d6e/dcf/d3e/dbb/f123 286728 0 2024-02-07T12:26:14.359 INFO:tasks.workunit.client.0.smithi047.stdout:1/891: dread - d1/d6e/d75/da7/fe1 zero size 2024-02-07T12:26:14.359 INFO:tasks.workunit.client.0.smithi047.stdout:1/892: chown d1/d6e/d75/da7/c11c 115 1 2024-02-07T12:26:14.364 INFO:tasks.workunit.client.0.smithi047.stdout:1/893: getdents d1/d6e/dcf/d3e/dbb 0 2024-02-07T12:26:14.364 INFO:tasks.workunit.client.0.smithi047.stdout:1/894: truncate d1/d6e/dcf/d3e/f94 104416 0 2024-02-07T12:26:14.364 INFO:tasks.workunit.client.0.smithi047.stdout:1/895: fsync d1/d6e/dcf/d3e/dbb/f123 0 2024-02-07T12:26:14.366 INFO:tasks.workunit.client.0.smithi047.stdout:1/896: mknod d1/d6e/dcf/d3e/c124 0 2024-02-07T12:26:14.366 INFO:tasks.workunit.client.0.smithi047.stdout:1/897: truncate d1/d48/dc9/fe9 1300752 0 2024-02-07T12:26:14.381 INFO:tasks.workunit.client.0.smithi047.stdout:1/898: dwrite d1/d37/faf [0,4194304] 0 2024-02-07T12:26:14.384 INFO:tasks.workunit.client.0.smithi047.stdout:1/899: rename d1/d6e/dcf/d84/fd6 to d1/d15/d30/d46/d4c/dfc/f125 0 2024-02-07T12:26:14.388 INFO:tasks.workunit.client.0.smithi047.stdout:1/900: dread d1/d15/f79 [0,4194304] 0 2024-02-07T12:26:14.389 INFO:tasks.workunit.client.0.smithi047.stdout:1/901: mknod d1/d15/d30/d46/d66/c126 0 2024-02-07T12:26:14.389 INFO:tasks.workunit.client.0.smithi047.stdout:1/902: fsync d1/d15/d30/f6a 0 2024-02-07T12:26:14.390 INFO:tasks.workunit.client.0.smithi047.stdout:1/903: mkdir d1/d15/d2f/d127 0 2024-02-07T12:26:14.390 INFO:tasks.workunit.client.0.smithi047.stdout:1/904: truncate d1/d6e/d75/da7/d80/ff3 480556 0 2024-02-07T12:26:14.391 INFO:tasks.workunit.client.0.smithi047.stdout:1/905: mknod d1/d6e/dcf/d84/c128 0 2024-02-07T12:26:14.396 INFO:tasks.workunit.client.0.smithi047.stdout:1/906: dread d1/fe [0,4194304] 0 2024-02-07T12:26:14.404 INFO:tasks.workunit.client.0.smithi047.stdout:1/907: dread d1/d15/d30/d46/d66/fb6 [0,4194304] 0 2024-02-07T12:26:14.405 INFO:tasks.workunit.client.0.smithi047.stdout:1/908: symlink d1/d6e/d75/da7/d40/l129 0 2024-02-07T12:26:14.413 INFO:tasks.workunit.client.0.smithi047.stdout:1/909: dread d1/d6e/d75/da7/f9c [4194304,4194304] 0 2024-02-07T12:26:14.415 INFO:tasks.workunit.client.0.smithi047.stdout:1/910: rename d1/d15/d30/d46/d66/c126 to d1/d6e/dcf/d3e/dbb/de0/d11a/c12a 0 2024-02-07T12:26:14.416 INFO:tasks.workunit.client.0.smithi047.stdout:1/911: creat d1/d15/d30/d46/dae/f12b x:0 0 0 2024-02-07T12:26:14.418 INFO:tasks.workunit.client.0.smithi047.stdout:1/912: creat d1/d6e/f12c x:0 0 0 2024-02-07T12:26:14.418 INFO:tasks.workunit.client.0.smithi047.stdout:1/913: truncate d1/d6e/d75/da7/d65/fba 400069 0 2024-02-07T12:26:14.418 INFO:tasks.workunit.client.0.smithi047.stdout:1/914: creat d1/d6e/dcf/d3e/dbb/de0/d11a/f12d x:0 0 0 2024-02-07T12:26:14.426 INFO:tasks.workunit.client.0.smithi047.stdout:1/915: write d1/d48/d81/f91 [262898,100620] 0 2024-02-07T12:26:14.436 INFO:tasks.workunit.client.0.smithi047.stdout:1/916: write d1/d15/d30/d46/d66/dac/fbf [5065975,94885] 0 2024-02-07T12:26:14.437 INFO:tasks.workunit.client.0.smithi047.stdout:1/917: mkdir d1/d15/d30/d12e 0 2024-02-07T12:26:14.438 INFO:tasks.workunit.client.0.smithi047.stdout:1/918: creat d1/d48/dc7/f12f x:0 0 0 2024-02-07T12:26:14.439 INFO:tasks.workunit.client.0.smithi047.stdout:1/919: dread d1/d6e/dcf/d3e/dbb/f123 [0,4194304] 0 2024-02-07T12:26:14.441 INFO:tasks.workunit.client.0.smithi047.stdout:1/920: mkdir d1/d6e/d75/d130 0 2024-02-07T12:26:14.443 INFO:tasks.workunit.client.0.smithi047.stdout:1/921: rename d1/d6e/dcf/f118 to d1/d6e/d75/da7/f131 0 2024-02-07T12:26:14.443 INFO:tasks.workunit.client.0.smithi047.stdout:1/922: read d1/d6e/dcf/f55 [1277160,107318] 0 2024-02-07T12:26:14.727 INFO:tasks.workunit.client.0.smithi047.stdout:1/923: sync 2024-02-07T12:26:14.727 INFO:tasks.workunit.client.0.smithi047.stdout:1/924: mknod d1/d48/c132 0 2024-02-07T12:26:14.728 INFO:tasks.workunit.client.0.smithi047.stdout:1/925: mkdir d1/d15/d30/d46/d4c/dfc/d133 0 2024-02-07T12:26:14.729 INFO:tasks.workunit.client.0.smithi047.stdout:1/926: getdents d1/d37/da6 0 2024-02-07T12:26:14.729 INFO:tasks.workunit.client.0.smithi047.stdout:1/927: readlink d1/d48/dc7/l11f 0 2024-02-07T12:26:14.731 INFO:tasks.workunit.client.0.smithi047.stdout:1/928: rename d1/d6e/d75/da7/d40/c85 to d1/d15/d30/d46/d4c/c134 0 2024-02-07T12:26:14.740 INFO:tasks.workunit.client.0.smithi047.stdout:1/929: dread d1/d6e/dcf/d3e/dbb/f112 [0,4194304] 0 2024-02-07T12:26:14.740 INFO:tasks.workunit.client.0.smithi047.stdout:1/930: dread - d1/d6e/d75/ff6 zero size 2024-02-07T12:26:14.741 INFO:tasks.workunit.client.0.smithi047.stdout:1/931: chown d1 18022367 1 2024-02-07T12:26:14.744 INFO:tasks.workunit.client.0.smithi047.stdout:1/932: rename d1/d15/d30/d46/d66 to d1/d15/d30/d46/dae/d135 0 2024-02-07T12:26:14.746 INFO:tasks.workunit.client.0.smithi047.stdout:1/933: symlink d1/d105/l136 0 2024-02-07T12:26:14.754 INFO:tasks.workunit.client.0.smithi047.stdout:1/934: read d1/d37/f60 [3449362,120451] 0 2024-02-07T12:26:14.754 INFO:tasks.workunit.client.0.smithi047.stdout:1/935: write d1/d6e/d75/da7/d65/f111 [1038729,72292] 0 2024-02-07T12:26:14.756 INFO:tasks.workunit.client.0.smithi047.stdout:1/936: write d1/d37/fe7 [144177,70408] 0 2024-02-07T12:26:14.758 INFO:tasks.workunit.client.0.smithi047.stdout:1/937: link d1/d2a/l96 d1/d15/d30/l137 0 2024-02-07T12:26:14.758 INFO:tasks.workunit.client.0.smithi047.stdout:1/938: read - d1/d15/d30/d46/d4c/dfc/f125 zero size 2024-02-07T12:26:14.778 INFO:tasks.workunit.client.0.smithi047.stdout:1/939: dwrite d1/f87 [0,4194304] 0 2024-02-07T12:26:14.778 INFO:tasks.workunit.client.0.smithi047.stdout:1/940: fdatasync d1/d6e/d75/da7/f27 0 2024-02-07T12:26:14.780 INFO:tasks.workunit.client.0.smithi047.stdout:1/941: link d1/d6e/dcf/d3e/dbb/f112 d1/d6e/dcf/d3e/dbb/f138 0 2024-02-07T12:26:14.797 INFO:tasks.workunit.client.0.smithi047.stdout:1/942: dwrite d1/d6e/d75/da7/d80/ff3 [0,4194304] 0 2024-02-07T12:26:14.797 INFO:tasks.workunit.client.0.smithi047.stdout:1/943: chown d1/c54 72 1 2024-02-07T12:26:14.797 INFO:tasks.workunit.client.0.smithi047.stdout:1/944: write d1/d6e/d75/da7/f23 [8459120,62155] 0 2024-02-07T12:26:14.799 INFO:tasks.workunit.client.0.smithi047.stdout:1/945: getdents d1/d15/d2f/de3 0 2024-02-07T12:26:14.802 INFO:tasks.workunit.client.0.smithi047.stdout:1/946: mkdir d1/d6e/d75/deb/d139 0 2024-02-07T12:26:14.802 INFO:tasks.workunit.client.0.smithi047.stdout:1/947: write d1/d15/db9/fff [259486,33681] 0 2024-02-07T12:26:14.804 INFO:tasks.workunit.client.0.smithi047.stdout:1/948: creat d1/d15/d30/d46/f13a x:0 0 0 2024-02-07T12:26:14.804 INFO:tasks.workunit.client.0.smithi047.stdout:1/949: write d1/d15/d30/d46/dae/d135/dac/f10c [726334,122520] 0 2024-02-07T12:26:14.804 INFO:tasks.workunit.client.0.smithi047.stdout:1/950: readlink d1/d2a/l3f 0 2024-02-07T12:26:14.813 INFO:tasks.workunit.client.0.smithi047.stdout:1/951: dread d1/d15/d30/d46/f7e [0,4194304] 0 2024-02-07T12:26:14.814 INFO:tasks.workunit.client.0.smithi047.stdout:1/952: symlink d1/d15/d30/d46/dae/d135/l13b 0 2024-02-07T12:26:14.815 INFO:tasks.workunit.client.0.smithi047.stdout:1/953: rename d1/d6e/d75/da7/d65/fba to d1/d15/d30/d46/dae/d135/dac/f13c 0 2024-02-07T12:26:14.816 INFO:tasks.workunit.client.0.smithi047.stdout:1/954: creat d1/f13d x:0 0 0 2024-02-07T12:26:15.219 INFO:tasks.workunit.client.0.smithi047.stdout:1/955: sync 2024-02-07T12:26:15.220 INFO:tasks.workunit.client.0.smithi047.stdout:1/956: write d1/d6e/d75/da7/fe1 [516328,129714] 0 2024-02-07T12:26:15.223 INFO:tasks.workunit.client.0.smithi047.stdout:1/957: write d1/d15/d2f/de3/fe4 [126703,81645] 0 2024-02-07T12:26:15.224 INFO:tasks.workunit.client.0.smithi047.stdout:1/958: readlink d1/d6e/d75/l7d 0 2024-02-07T12:26:15.224 INFO:tasks.workunit.client.0.smithi047.stdout:1/959: readlink d1/d6e/d75/da7/d65/ld4 0 2024-02-07T12:26:15.224 INFO:tasks.workunit.client.0.smithi047.stdout:1/960: rename d1/d15/c9b to d1/d11b/c13e 0 2024-02-07T12:26:15.225 INFO:tasks.workunit.client.0.smithi047.stdout:1/961: mkdir d1/d15/d2f/de3/d13f 0 2024-02-07T12:26:15.225 INFO:tasks.workunit.client.0.smithi047.stdout:1/962: getdents d1/d6e/dcf/d3e/dbb 0 2024-02-07T12:26:15.227 INFO:tasks.workunit.client.0.smithi047.stdout:1/963: unlink d1/d15/d30/d46/dae/d135/dac/dbc/cf8 0 2024-02-07T12:26:15.228 INFO:tasks.workunit.client.0.smithi047.stdout:1/964: rename d1/d6e/d75/da7/d65/f111 to d1/d15/d30/d46/dae/d135/f140 0 2024-02-07T12:26:15.228 INFO:tasks.workunit.client.0.smithi047.stdout:1/965: chown d1/d6e/dcf/d3e/lcc 292 1 2024-02-07T12:26:15.245 INFO:tasks.workunit.client.0.smithi047.stdout:1/966: dwrite d1/d15/d30/d46/dae/d135/dac/f13c [0,4194304] 0 2024-02-07T12:26:15.245 INFO:tasks.workunit.client.0.smithi047.stdout:1/967: write d1/d6e/dcf/d3e/dbb/de0/d11a/f12d [73653,50543] 0 2024-02-07T12:26:15.266 INFO:tasks.workunit.client.0.smithi047.stdout:1/968: dwrite d1/d6e/d75/da7/f131 [0,4194304] 0 2024-02-07T12:26:15.614 INFO:tasks.workunit.client.0.smithi047.stdout:1/969: sync 2024-02-07T12:26:15.615 INFO:tasks.workunit.client.0.smithi047.stdout:1/970: dread d1/d6e/dcf/d3e/dbb/de0/d11a/f12d [0,4194304] 0 2024-02-07T12:26:15.617 INFO:tasks.workunit.client.0.smithi047.stdout:1/971: dread d1/d6e/dcf/d3e/f94 [0,4194304] 0 2024-02-07T12:26:15.617 INFO:tasks.workunit.client.0.smithi047.stdout:1/972: chown d1/d6e/dcf/l45 3300 1 2024-02-07T12:26:15.617 INFO:tasks.workunit.client.0.smithi047.stdout:1/973: dread - d1/d6e/d75/da7/d65/fce zero size 2024-02-07T12:26:15.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:15 smithi138 ceph-mon[35528]: pgmap v24: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 123 MiB/s rd, 158 MiB/s wr, 493 op/s 2024-02-07T12:26:15.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:15 smithi047 ceph-mon[28972]: pgmap v24: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 123 MiB/s rd, 158 MiB/s wr, 493 op/s 2024-02-07T12:26:15.983 INFO:tasks.workunit.client.0.smithi047.stdout:1/974: sync 2024-02-07T12:26:15.984 INFO:tasks.workunit.client.0.smithi047.stdout:1/975: rmdir d1/d15/d30/d46/dae 39 2024-02-07T12:26:15.985 INFO:tasks.workunit.client.0.smithi047.stdout:1/976: rmdir d1/d15/db9/ded 39 2024-02-07T12:26:15.986 INFO:tasks.workunit.client.0.smithi047.stdout:1/977: mknod d1/d6e/dcf/d3e/dbb/de0/c141 0 2024-02-07T12:26:15.986 INFO:tasks.workunit.client.0.smithi047.stdout:1/978: creat d1/d6e/d75/da7/d40/f142 x:0 0 0 2024-02-07T12:26:15.994 INFO:tasks.workunit.client.0.smithi047.stdout:1/979: dread d1/d15/d30/d46/f59 [0,4194304] 0 2024-02-07T12:26:15.994 INFO:tasks.workunit.client.0.smithi047.stdout:1/980: chown d1/d6e/d75/da7/f4f 2275268 1 2024-02-07T12:26:15.995 INFO:tasks.workunit.client.0.smithi047.stdout:1/981: rename d1/d48/dc7/f12f to d1/d37/f143 0 2024-02-07T12:26:15.995 INFO:tasks.workunit.client.0.smithi047.stdout:1/982: rmdir d1/d48/d81 39 2024-02-07T12:26:15.997 INFO:tasks.workunit.client.0.smithi047.stdout:1/983: rmdir d1/d6e/d75/deb 39 2024-02-07T12:26:15.997 INFO:tasks.workunit.client.0.smithi047.stdout:1/984: fsync d1/d6e/d75/ff6 0 2024-02-07T12:26:15.997 INFO:tasks.workunit.client.0.smithi047.stdout:1/985: stat d1/d48/dc9/fe9 0 2024-02-07T12:26:15.997 INFO:tasks.workunit.client.0.smithi047.stdout:1/986: creat d1/d6e/d75/da7/d40/f144 x:0 0 0 2024-02-07T12:26:15.999 INFO:tasks.workunit.client.0.smithi047.stdout:1/987: creat d1/d15/d30/d12e/f145 x:0 0 0 2024-02-07T12:26:16.000 INFO:tasks.workunit.client.0.smithi047.stdout:1/988: symlink d1/d6e/d75/da7/d80/l146 0 2024-02-07T12:26:16.018 INFO:tasks.workunit.client.0.smithi047.stdout:1/989: dwrite d1/f22 [0,4194304] 0 2024-02-07T12:26:16.020 INFO:tasks.workunit.client.0.smithi047.stdout:1/990: rename d1/d48/l82 to d1/d15/d30/d46/dae/d135/l147 0 2024-02-07T12:26:16.037 INFO:tasks.workunit.client.0.smithi047.stdout:1/991: dwrite d1/d6e/d75/da7/f2b [4194304,4194304] 0 2024-02-07T12:26:16.038 INFO:tasks.workunit.client.0.smithi047.stdout:1/992: write d1/d15/f79 [182528,58675] 0 2024-02-07T12:26:16.038 INFO:tasks.workunit.client.0.smithi047.stdout:1/993: truncate d1/d15/d30/d46/f13a 229364 0 2024-02-07T12:26:16.039 INFO:tasks.workunit.client.0.smithi047.stdout:1/994: mknod d1/d48/d81/c148 0 2024-02-07T12:26:16.041 INFO:tasks.workunit.client.0.smithi047.stdout:1/995: rename d1/d6e/cd3 to d1/d15/db9/c149 0 2024-02-07T12:26:16.043 INFO:tasks.workunit.client.0.smithi047.stdout:1/996: dread d1/d6e/d75/da7/d65/f92 [0,4194304] 0 2024-02-07T12:26:16.043 INFO:tasks.workunit.client.0.smithi047.stdout:1/997: fsync d1/d15/d30/d46/f7e 0 2024-02-07T12:26:16.050 INFO:tasks.workunit.client.0.smithi047.stdout:1/998: write d1/d15/db9/fe2 [3156412,26456] 0 2024-02-07T12:26:16.052 INFO:tasks.workunit.client.0.smithi047.stdout:1/999: mkdir d1/d6e/dcf/d14a 0 2024-02-07T12:26:16.055 INFO:tasks.workunit.client.0.smithi047.stderr:+ rm -rf -- ./tmp.gyYfCMUOBs 2024-02-07T12:26:17.645 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:17 smithi047 ceph-mon[28972]: pgmap v25: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 78 MiB/s rd, 97 MiB/s wr, 316 op/s 2024-02-07T12:26:17.645 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:17 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:26:17.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:17 smithi138 ceph-mon[35528]: pgmap v25: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 78 MiB/s rd, 97 MiB/s wr, 316 op/s 2024-02-07T12:26:17.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:17 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:26:19.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:19 smithi047 ceph-mon[28972]: pgmap v26: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 80 MiB/s rd, 98 MiB/s wr, 329 op/s 2024-02-07T12:26:19.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:19 smithi138 ceph-mon[35528]: pgmap v26: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 80 MiB/s rd, 98 MiB/s wr, 329 op/s 2024-02-07T12:26:21.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:20 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:26:21.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:20 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:26:21.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:20 smithi138 ceph-mon[35528]: Reconfiguring grafana.smithi047 (dependencies changed)... 2024-02-07T12:26:21.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:20 smithi138 ceph-mon[35528]: Reconfiguring daemon grafana.smithi047 on smithi047 2024-02-07T12:26:21.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:20 smithi138 ceph-mon[35528]: pgmap v27: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 79 MiB/s rd, 95 MiB/s wr, 444 op/s 2024-02-07T12:26:21.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:20 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:26:21.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:20 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:26:21.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:20 smithi047 ceph-mon[28972]: Reconfiguring grafana.smithi047 (dependencies changed)... 2024-02-07T12:26:21.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:20 smithi047 ceph-mon[28972]: Reconfiguring daemon grafana.smithi047 on smithi047 2024-02-07T12:26:21.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:20 smithi047 ceph-mon[28972]: pgmap v27: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 79 MiB/s rd, 95 MiB/s wr, 444 op/s 2024-02-07T12:26:23.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:23 smithi138 ceph-mon[35528]: pgmap v28: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 32 MiB/s rd, 42 MiB/s wr, 285 op/s 2024-02-07T12:26:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:23 smithi047 ceph-mon[28972]: pgmap v28: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 32 MiB/s rd, 42 MiB/s wr, 285 op/s 2024-02-07T12:26:25.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:25 smithi138 ceph-mon[35528]: pgmap v29: 65 pgs: 65 active+clean; 1.4 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 33 MiB/s rd, 43 MiB/s wr, 462 op/s 2024-02-07T12:26:25.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:25 smithi138 ceph-mon[35528]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:26:25.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:25 smithi047 ceph-mon[28972]: pgmap v29: 65 pgs: 65 active+clean; 1.4 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 33 MiB/s rd, 43 MiB/s wr, 462 op/s 2024-02-07T12:26:25.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:25 smithi047 ceph-mon[28972]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:26:27.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:27 smithi138 ceph-mon[35528]: pgmap v30: 65 pgs: 65 active+clean; 1.4 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 7.2 MiB/s rd, 6.9 MiB/s wr, 322 op/s 2024-02-07T12:26:27.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:27 smithi047 ceph-mon[28972]: pgmap v30: 65 pgs: 65 active+clean; 1.4 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 7.2 MiB/s rd, 6.9 MiB/s wr, 322 op/s 2024-02-07T12:26:29.763 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:29 smithi047 ceph-mon[28972]: pgmap v31: 65 pgs: 65 active+clean; 964 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 7.9 MiB/s rd, 7.6 MiB/s wr, 407 op/s 2024-02-07T12:26:29.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:29 smithi138 ceph-mon[35528]: pgmap v31: 65 pgs: 65 active+clean; 964 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 7.9 MiB/s rd, 7.6 MiB/s wr, 407 op/s 2024-02-07T12:26:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:31 smithi047 ceph-mon[28972]: pgmap v32: 65 pgs: 65 active+clean; 848 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 5.9 MiB/s rd, 6.7 MiB/s wr, 409 op/s 2024-02-07T12:26:31.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:31 smithi138 ceph-mon[35528]: pgmap v32: 65 pgs: 65 active+clean; 848 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 5.9 MiB/s rd, 6.7 MiB/s wr, 409 op/s 2024-02-07T12:26:32.542 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-07T12:26:32.542 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-07T12:26:33.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:33 smithi138 ceph-mon[35528]: pgmap v33: 65 pgs: 65 active+clean; 848 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 277 op/s 2024-02-07T12:26:33.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:26:33.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:33 smithi047 ceph-mon[28972]: pgmap v33: 65 pgs: 65 active+clean; 848 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 277 op/s 2024-02-07T12:26:33.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:26:35.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:35 smithi138 ceph-mon[35528]: pgmap v34: 65 pgs: 65 active+clean; 287 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 369 op/s 2024-02-07T12:26:35.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:35 smithi047 ceph-mon[28972]: pgmap v34: 65 pgs: 65 active+clean; 287 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 369 op/s 2024-02-07T12:26:37.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:37 smithi138 ceph-mon[35528]: pgmap v35: 65 pgs: 65 active+clean; 287 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 192 op/s 2024-02-07T12:26:37.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:37 smithi047 ceph-mon[28972]: pgmap v35: 65 pgs: 65 active+clean; 287 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 192 op/s 2024-02-07T12:26:39.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.731+0000 7f28cedf5700 1 -- 172.21.15.47:0/3006906100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28c80fe0e0 msgr2=0x7f28c80fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:39.736 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:39 smithi047 ceph-mon[28972]: pgmap v36: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 261 op/s 2024-02-07T12:26:39.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.731+0000 7f28cedf5700 1 --2- 172.21.15.47:0/3006906100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28c80fe0e0 0x7f28c80fe550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f28b8004c50 tx=0x7f28b8009ca0 comp rx=0 tx=0).stop 2024-02-07T12:26:39.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.731+0000 7f28cedf5700 1 -- 172.21.15.47:0/3006906100 shutdown_connections 2024-02-07T12:26:39.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.731+0000 7f28cedf5700 1 --2- 172.21.15.47:0/3006906100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28c80fe0e0 0x7f28c80fe550 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:39.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.731+0000 7f28cedf5700 1 --2- 172.21.15.47:0/3006906100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28c80fcef0 0x7f28c80fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:39.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.731+0000 7f28cedf5700 1 -- 172.21.15.47:0/3006906100 >> 172.21.15.47:0/3006906100 conn(0x7f28c80f8620 msgr2=0x7f28c80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:39.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.731+0000 7f28cedf5700 1 -- 172.21.15.47:0/3006906100 shutdown_connections 2024-02-07T12:26:39.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.732+0000 7f28cedf5700 1 -- 172.21.15.47:0/3006906100 wait complete. 2024-02-07T12:26:39.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.733+0000 7f28cedf5700 1 Processor -- start 2024-02-07T12:26:39.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.734+0000 7f28cedf5700 1 -- start start 2024-02-07T12:26:39.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.734+0000 7f28cedf5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28c80fcef0 0x7f28c8114040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:39.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.735+0000 7f28cedf5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28c80fe0e0 0x7f28c8114580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:39.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.735+0000 7f28cedf5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8114b80 con 0x7f28c80fe0e0 2024-02-07T12:26:39.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.735+0000 7f28cedf5700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8115420 con 0x7f28c80fcef0 2024-02-07T12:26:39.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.735+0000 7f28ccb91700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28c80fcef0 0x7f28c8114040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:39.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.735+0000 7f28ccb91700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28c80fcef0 0x7f28c8114040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.47:58472/0 (socket says 172.21.15.47:58472) 2024-02-07T12:26:39.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.735+0000 7f28ccb91700 1 -- 172.21.15.47:0/2028636704 learned_addr learned my addr 172.21.15.47:0/2028636704 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:39.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.735+0000 7f28c7fff700 1 --2- 172.21.15.47:0/2028636704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28c80fe0e0 0x7f28c8114580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:39.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.735+0000 7f28ccb91700 1 -- 172.21.15.47:0/2028636704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28c80fe0e0 msgr2=0x7f28c8114580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:39.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.735+0000 7f28ccb91700 1 --2- 172.21.15.47:0/2028636704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28c80fe0e0 0x7f28c8114580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:39.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.735+0000 7f28ccb91700 1 -- 172.21.15.47:0/2028636704 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b80048f0 con 0x7f28c80fcef0 2024-02-07T12:26:39.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.735+0000 7f28c7fff700 1 --2- 172.21.15.47:0/2028636704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28c80fe0e0 0x7f28c8114580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:26:39.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.736+0000 7f28ccb91700 1 --2- 172.21.15.47:0/2028636704 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28c80fcef0 0x7f28c8114040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f28c000eb40 tx=0x7f28c000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:39.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.736+0000 7f28c57fa700 1 -- 172.21.15.47:0/2028636704 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28c0007cc0 con 0x7f28c80fcef0 2024-02-07T12:26:39.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.736+0000 7f28c57fa700 1 -- 172.21.15.47:0/2028636704 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f28c000f040 con 0x7f28c80fcef0 2024-02-07T12:26:39.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.736+0000 7f28c57fa700 1 -- 172.21.15.47:0/2028636704 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28c0009680 con 0x7f28c80fcef0 2024-02-07T12:26:39.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.736+0000 7f28cedf5700 1 -- 172.21.15.47:0/2028636704 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c8115700 con 0x7f28c80fcef0 2024-02-07T12:26:39.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.736+0000 7f28cedf5700 1 -- 172.21.15.47:0/2028636704 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c8115c40 con 0x7f28c80fcef0 2024-02-07T12:26:39.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.738+0000 7f28cedf5700 1 -- 172.21.15.47:0/2028636704 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c8102210 con 0x7f28c80fcef0 2024-02-07T12:26:39.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.739+0000 7f28c57fa700 1 -- 172.21.15.47:0/2028636704 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7f28c00097e0 con 0x7f28c80fcef0 2024-02-07T12:26:39.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.739+0000 7f28c57fa700 1 --2- 172.21.15.47:0/2028636704 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f28b406b190 0x7f28b406d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:39.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.739+0000 7f28c57fa700 1 -- 172.21.15.47:0/2028636704 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f28c0089670 con 0x7f28c80fcef0 2024-02-07T12:26:39.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.739+0000 7f28c7fff700 1 --2- 172.21.15.47:0/2028636704 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f28b406b190 0x7f28b406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:39.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.740+0000 7f28c7fff700 1 --2- 172.21.15.47:0/2028636704 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f28b406b190 0x7f28b406d640 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009ee0 tx=0x7f28b8009ca0 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:39.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:39.747+0000 7f28c57fa700 1 -- 172.21.15.47:0/2028636704 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f28c004f620 con 0x7f28c80fcef0 2024-02-07T12:26:39.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:39 smithi138 ceph-mon[35528]: pgmap v36: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 261 op/s 2024-02-07T12:26:40.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.019+0000 7f28cedf5700 1 -- 172.21.15.47:0/2028636704 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f28c8115f20 con 0x7f28b406b190 2024-02-07T12:26:40.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.021+0000 7f28c57fa700 1 -- 172.21.15.47:0/2028636704 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f28c8115f20 con 0x7f28b406b190 2024-02-07T12:26:40.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.023+0000 7f28cedf5700 1 -- 172.21.15.47:0/2028636704 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f28b406b190 msgr2=0x7f28b406d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:40.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.023+0000 7f28cedf5700 1 --2- 172.21.15.47:0/2028636704 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f28b406b190 0x7f28b406d640 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009ee0 tx=0x7f28b8009ca0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.023+0000 7f28cedf5700 1 -- 172.21.15.47:0/2028636704 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28c80fcef0 msgr2=0x7f28c8114040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:40.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.023+0000 7f28cedf5700 1 --2- 172.21.15.47:0/2028636704 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28c80fcef0 0x7f28c8114040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f28c000eb40 tx=0x7f28c000b040 comp rx=0 tx=0).stop 2024-02-07T12:26:40.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.023+0000 7f28cedf5700 1 -- 172.21.15.47:0/2028636704 shutdown_connections 2024-02-07T12:26:40.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.023+0000 7f28cedf5700 1 --2- 172.21.15.47:0/2028636704 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f28b406b190 0x7f28b406d640 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.023+0000 7f28cedf5700 1 --2- 172.21.15.47:0/2028636704 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28c80fcef0 0x7f28c8114040 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.023+0000 7f28cedf5700 1 --2- 172.21.15.47:0/2028636704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28c80fe0e0 0x7f28c8114580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.023+0000 7f28cedf5700 1 -- 172.21.15.47:0/2028636704 >> 172.21.15.47:0/2028636704 conn(0x7f28c80f8620 msgr2=0x7f28c80ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:40.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.023+0000 7f28cedf5700 1 -- 172.21.15.47:0/2028636704 shutdown_connections 2024-02-07T12:26:40.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.023+0000 7f28cedf5700 1 -- 172.21.15.47:0/2028636704 wait complete. 2024-02-07T12:26:40.037 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:26:40.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.147+0000 7f1e53c88700 1 -- 172.21.15.47:0/3546727141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e4c0fbe50 msgr2=0x7f1e4c0fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:40.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.147+0000 7f1e53c88700 1 --2- 172.21.15.47:0/3546727141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e4c0fbe50 0x7f1e4c0fc260 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1e48004940 tx=0x7f1e48009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:40.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.147+0000 7f1e53c88700 1 -- 172.21.15.47:0/3546727141 shutdown_connections 2024-02-07T12:26:40.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.147+0000 7f1e53c88700 1 --2- 172.21.15.47:0/3546727141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e4c0fcfc0 0x7f1e4c0fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.147+0000 7f1e53c88700 1 --2- 172.21.15.47:0/3546727141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e4c0fbe50 0x7f1e4c0fc260 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.147+0000 7f1e53c88700 1 -- 172.21.15.47:0/3546727141 >> 172.21.15.47:0/3546727141 conn(0x7f1e4c0f7510 msgr2=0x7f1e4c0f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:40.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.147+0000 7f1e53c88700 1 -- 172.21.15.47:0/3546727141 shutdown_connections 2024-02-07T12:26:40.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.147+0000 7f1e53c88700 1 -- 172.21.15.47:0/3546727141 wait complete. 2024-02-07T12:26:40.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.148+0000 7f1e53c88700 1 Processor -- start 2024-02-07T12:26:40.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.148+0000 7f1e53c88700 1 -- start start 2024-02-07T12:26:40.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.148+0000 7f1e53c88700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e4c0fbe50 0x7f1e4c112a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.148+0000 7f1e53c88700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e4c0fcfc0 0x7f1e4c114f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.148+0000 7f1e53c88700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c066be0 con 0x7f1e4c0fcfc0 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.148+0000 7f1e53c88700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c066d20 con 0x7f1e4c0fbe50 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.148+0000 7f1e51223700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e4c0fcfc0 0x7f1e4c114f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.148+0000 7f1e51a24700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e4c0fbe50 0x7f1e4c112a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.148+0000 7f1e51223700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e4c0fcfc0 0x7f1e4c114f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38580/0 (socket says 172.21.15.47:38580) 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.148+0000 7f1e51223700 1 -- 172.21.15.47:0/1673092084 learned_addr learned my addr 172.21.15.47:0/1673092084 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.149+0000 7f1e51a24700 1 -- 172.21.15.47:0/1673092084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e4c0fcfc0 msgr2=0x7f1e4c114f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.149+0000 7f1e51a24700 1 --2- 172.21.15.47:0/1673092084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e4c0fcfc0 0x7f1e4c114f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.149+0000 7f1e51a24700 1 -- 172.21.15.47:0/1673092084 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e48005040 con 0x7f1e4c0fbe50 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.149+0000 7f1e51223700 1 --2- 172.21.15.47:0/1673092084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e4c0fcfc0 0x7f1e4c114f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.149+0000 7f1e51a24700 1 --2- 172.21.15.47:0/1673092084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e4c0fbe50 0x7f1e4c112a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e48004890 tx=0x7f1e48009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.149+0000 7f1e427fc700 1 -- 172.21.15.47:0/1673092084 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e48021070 con 0x7f1e4c0fbe50 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.149+0000 7f1e427fc700 1 -- 172.21.15.47:0/1673092084 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e4801c400 con 0x7f1e4c0fbe50 2024-02-07T12:26:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.149+0000 7f1e53c88700 1 -- 172.21.15.47:0/1673092084 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4c115490 con 0x7f1e4c0fbe50 2024-02-07T12:26:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.149+0000 7f1e427fc700 1 -- 172.21.15.47:0/1673092084 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e4800e070 con 0x7f1e4c0fbe50 2024-02-07T12:26:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.149+0000 7f1e53c88700 1 -- 172.21.15.47:0/1673092084 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c115830 con 0x7f1e4c0fbe50 2024-02-07T12:26:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.150+0000 7f1e53c88700 1 -- 172.21.15.47:0/1673092084 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4c04bed0 con 0x7f1e4c0fbe50 2024-02-07T12:26:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.151+0000 7f1e427fc700 1 -- 172.21.15.47:0/1673092084 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7f1e4801ca70 con 0x7f1e4c0fbe50 2024-02-07T12:26:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.151+0000 7f1e427fc700 1 --2- 172.21.15.47:0/1673092084 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f1e3806b140 0x7f1e3806d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.151+0000 7f1e427fc700 1 -- 172.21.15.47:0/1673092084 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1e4808ad40 con 0x7f1e4c0fbe50 2024-02-07T12:26:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.151+0000 7f1e51223700 1 --2- 172.21.15.47:0/1673092084 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f1e3806b140 0x7f1e3806d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.152+0000 7f1e51223700 1 --2- 172.21.15.47:0/1673092084 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f1e3806b140 0x7f1e3806d5f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0041d0 tx=0x7f1e3c00b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.156+0000 7f1e427fc700 1 -- 172.21.15.47:0/1673092084 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f1e48054e30 con 0x7f1e4c0fbe50 2024-02-07T12:26:40.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.457+0000 7f1e53c88700 1 -- 172.21.15.47:0/1673092084 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e4c1019a0 con 0x7f1e3806b140 2024-02-07T12:26:40.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.459+0000 7f1e427fc700 1 -- 172.21.15.47:0/1673092084 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f1e4c1019a0 con 0x7f1e3806b140 2024-02-07T12:26:40.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.461+0000 7f1e53c88700 1 -- 172.21.15.47:0/1673092084 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f1e3806b140 msgr2=0x7f1e3806d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:40.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.461+0000 7f1e53c88700 1 --2- 172.21.15.47:0/1673092084 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f1e3806b140 0x7f1e3806d5f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0041d0 tx=0x7f1e3c00b040 comp rx=0 tx=0).stop 2024-02-07T12:26:40.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.461+0000 7f1e53c88700 1 -- 172.21.15.47:0/1673092084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e4c0fbe50 msgr2=0x7f1e4c112a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:40.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.461+0000 7f1e53c88700 1 --2- 172.21.15.47:0/1673092084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e4c0fbe50 0x7f1e4c112a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e48004890 tx=0x7f1e48009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.461+0000 7f1e53c88700 1 -- 172.21.15.47:0/1673092084 shutdown_connections 2024-02-07T12:26:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.461+0000 7f1e53c88700 1 --2- 172.21.15.47:0/1673092084 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f1e3806b140 0x7f1e3806d5f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.461+0000 7f1e53c88700 1 --2- 172.21.15.47:0/1673092084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e4c0fbe50 0x7f1e4c112a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.461+0000 7f1e53c88700 1 --2- 172.21.15.47:0/1673092084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e4c0fcfc0 0x7f1e4c114f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.461+0000 7f1e53c88700 1 -- 172.21.15.47:0/1673092084 >> 172.21.15.47:0/1673092084 conn(0x7f1e4c0f7510 msgr2=0x7f1e4c100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.461+0000 7f1e53c88700 1 -- 172.21.15.47:0/1673092084 shutdown_connections 2024-02-07T12:26:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.461+0000 7f1e53c88700 1 -- 172.21.15.47:0/1673092084 wait complete. 2024-02-07T12:26:40.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.576+0000 7f4befaae700 1 -- 172.21.15.47:0/3322282399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be80fbe40 msgr2=0x7f4be80fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:40.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.576+0000 7f4befaae700 1 --2- 172.21.15.47:0/3322282399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be80fbe40 0x7f4be80fc250 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4be4004940 tx=0x7f4be4009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:40.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.576+0000 7f4befaae700 1 -- 172.21.15.47:0/3322282399 shutdown_connections 2024-02-07T12:26:40.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.576+0000 7f4befaae700 1 --2- 172.21.15.47:0/3322282399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4be80fcfb0 0x7f4be80fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.576+0000 7f4befaae700 1 --2- 172.21.15.47:0/3322282399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be80fbe40 0x7f4be80fc250 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.576+0000 7f4befaae700 1 -- 172.21.15.47:0/3322282399 >> 172.21.15.47:0/3322282399 conn(0x7f4be80f74e0 msgr2=0x7f4be80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:40.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.577+0000 7f4befaae700 1 -- 172.21.15.47:0/3322282399 shutdown_connections 2024-02-07T12:26:40.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.577+0000 7f4befaae700 1 -- 172.21.15.47:0/3322282399 wait complete. 2024-02-07T12:26:40.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.577+0000 7f4befaae700 1 Processor -- start 2024-02-07T12:26:40.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.577+0000 7f4befaae700 1 -- start start 2024-02-07T12:26:40.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.577+0000 7f4befaae700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4be80fbe40 0x7f4be810c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:40.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.577+0000 7f4befaae700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be80fcfb0 0x7f4be810cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:40.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.577+0000 7f4befaae700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be810d380 con 0x7f4be80fcfb0 2024-02-07T12:26:40.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.577+0000 7f4befaae700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be810dc20 con 0x7f4be80fbe40 2024-02-07T12:26:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.578+0000 7f4bed049700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be80fcfb0 0x7f4be810cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.578+0000 7f4bed049700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be80fcfb0 0x7f4be810cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38602/0 (socket says 172.21.15.47:38602) 2024-02-07T12:26:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.578+0000 7f4bed049700 1 -- 172.21.15.47:0/2771610562 learned_addr learned my addr 172.21.15.47:0/2771610562 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.578+0000 7f4bed84a700 1 --2- 172.21.15.47:0/2771610562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4be80fbe40 0x7f4be810c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.578+0000 7f4bed049700 1 -- 172.21.15.47:0/2771610562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4be80fbe40 msgr2=0x7f4be810c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.578+0000 7f4bed049700 1 --2- 172.21.15.47:0/2771610562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4be80fbe40 0x7f4be810c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.578+0000 7f4bed049700 1 -- 172.21.15.47:0/2771610562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be4005040 con 0x7f4be80fcfb0 2024-02-07T12:26:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.578+0000 7f4bed049700 1 --2- 172.21.15.47:0/2771610562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be80fcfb0 0x7f4be810cd80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800fce0 tx=0x7f4bd80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.578+0000 7f4bde7fc700 1 -- 172.21.15.47:0/2771610562 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bd8007ea0 con 0x7f4be80fcfb0 2024-02-07T12:26:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.578+0000 7f4befaae700 1 -- 172.21.15.47:0/2771610562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be810dea0 con 0x7f4be80fcfb0 2024-02-07T12:26:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.578+0000 7f4bde7fc700 1 -- 172.21.15.47:0/2771610562 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4bd800dda0 con 0x7f4be80fcfb0 2024-02-07T12:26:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.579+0000 7f4bde7fc700 1 -- 172.21.15.47:0/2771610562 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bd80099b0 con 0x7f4be80fcfb0 2024-02-07T12:26:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.579+0000 7f4befaae700 1 -- 172.21.15.47:0/2771610562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be810e3e0 con 0x7f4be80fcfb0 2024-02-07T12:26:40.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.580+0000 7f4befaae700 1 -- 172.21.15.47:0/2771610562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be804bed0 con 0x7f4be80fcfb0 2024-02-07T12:26:40.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.580+0000 7f4bde7fc700 1 -- 172.21.15.47:0/2771610562 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7f4bd800d8d0 con 0x7f4be80fcfb0 2024-02-07T12:26:40.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.580+0000 7f4bde7fc700 1 --2- 172.21.15.47:0/2771610562 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f4bd406b140 0x7f4bd406d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:40.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.581+0000 7f4bde7fc700 1 -- 172.21.15.47:0/2771610562 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4bd808c390 con 0x7f4be80fcfb0 2024-02-07T12:26:40.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.581+0000 7f4bed84a700 1 --2- 172.21.15.47:0/2771610562 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f4bd406b140 0x7f4bd406d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:40.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.581+0000 7f4bed84a700 1 --2- 172.21.15.47:0/2771610562 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f4bd406b140 0x7f4bd406d5f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4be400b3b0 tx=0x7f4be4009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:40.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.585+0000 7f4bde7fc700 1 -- 172.21.15.47:0/2771610562 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4bd8059e50 con 0x7f4be80fcfb0 2024-02-07T12:26:40.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.836+0000 7f4befaae700 1 -- 172.21.15.47:0/2771610562 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4be810e8b0 con 0x7f4bd406b140 2024-02-07T12:26:40.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.846+0000 7f4bde7fc700 1 -- 172.21.15.47:0/2771610562 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f4be810e8b0 con 0x7f4bd406b140 2024-02-07T12:26:40.850 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:26:40.850 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 starting - - - - 2024-02-07T12:26:40.850 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (9m) 52s ago 9m 6660k - 17.2.7-491-gf2462625 4ad3622d1b31 bca7317ed169 2024-02-07T12:26:40.850 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (8m) 56s ago 8m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 110c84c6624b 2024-02-07T12:26:40.850 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (7m) 52s ago 8m 84.0M - 9.4.7 954c08fa6188 5b93631efbfc 2024-02-07T12:26:40.850 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (3m) 52s ago 3m 148M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:26:40.850 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (3m) 52s ago 3m 136M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:26:40.850 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (3m) 56s ago 3m 76.3M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:26:40.850 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (3m) 56s ago 3m 95.1M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:26:40.850 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:9283 running (10m) 52s ago 10m 348M - 17.2.7-491-gf2462625 4ad3622d1b31 f3b25479d84e 2024-02-07T12:26:40.850 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283 running (95s) 56s ago 8m 488M - 19.0.0-1252-g44458cce 79957b372307 fd928ea0fb8a 2024-02-07T12:26:40.851 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (10m) 52s ago 10m 46.9M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 105826d9ef9a 2024-02-07T12:26:40.851 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (8m) 56s ago 8m 40.3M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 02dfa0b8d573 2024-02-07T12:26:40.851 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 starting - - - - 2024-02-07T12:26:40.851 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (8m) 56s ago 8m 16.0M - 1.5.0 0da6a335fe13 8823dad6f717 2024-02-07T12:26:40.851 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (7m) 52s ago 7m 226M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 4f37918f583a 2024-02-07T12:26:40.851 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (6m) 52s ago 6m 243M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 1c6e3c603ed3 2024-02-07T12:26:40.851 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (6m) 52s ago 6m 190M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:26:40.851 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (6m) 56s ago 6m 283M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:26:40.851 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (5m) 56s ago 5m 226M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:26:40.851 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (5m) 56s ago 5m 280M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:26:40.851 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (7m) 52s ago 8m 57.3M - 2.43.0 a07b618ecd1d e41b94b0d167 2024-02-07T12:26:40.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.848+0000 7f4befaae700 1 -- 172.21.15.47:0/2771610562 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f4bd406b140 msgr2=0x7f4bd406d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:40.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.848+0000 7f4befaae700 1 --2- 172.21.15.47:0/2771610562 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f4bd406b140 0x7f4bd406d5f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4be400b3b0 tx=0x7f4be4009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:40.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.848+0000 7f4befaae700 1 -- 172.21.15.47:0/2771610562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be80fcfb0 msgr2=0x7f4be810cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:40.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.848+0000 7f4befaae700 1 --2- 172.21.15.47:0/2771610562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be80fcfb0 0x7f4be810cd80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800fce0 tx=0x7f4bd80046b0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.848+0000 7f4befaae700 1 -- 172.21.15.47:0/2771610562 shutdown_connections 2024-02-07T12:26:40.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.848+0000 7f4befaae700 1 --2- 172.21.15.47:0/2771610562 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f4bd406b140 0x7f4bd406d5f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.848+0000 7f4befaae700 1 --2- 172.21.15.47:0/2771610562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4be80fbe40 0x7f4be810c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.848+0000 7f4befaae700 1 --2- 172.21.15.47:0/2771610562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be80fcfb0 0x7f4be810cd80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:40.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.848+0000 7f4befaae700 1 -- 172.21.15.47:0/2771610562 >> 172.21.15.47:0/2771610562 conn(0x7f4be80f74e0 msgr2=0x7f4be8100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:40.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.848+0000 7f4befaae700 1 -- 172.21.15.47:0/2771610562 shutdown_connections 2024-02-07T12:26:40.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:40.848+0000 7f4befaae700 1 -- 172.21.15.47:0/2771610562 wait complete. 2024-02-07T12:26:41.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.009+0000 7f713effd700 1 -- 172.21.15.47:0/688159157 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f712c013b70 con 0x7f7138094cf0 2024-02-07T12:26:41.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.010+0000 7f71452a8700 1 -- 172.21.15.47:0/688159157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7138094cf0 msgr2=0x7f7138095140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.010+0000 7f71452a8700 1 --2- 172.21.15.47:0/688159157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7138094cf0 0x7f7138095140 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f712c004940 tx=0x7f712c009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.011+0000 7f71452a8700 1 -- 172.21.15.47:0/688159157 shutdown_connections 2024-02-07T12:26:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.011+0000 7f71452a8700 1 --2- 172.21.15.47:0/688159157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7138094cf0 0x7f7138095140 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.011+0000 7f71452a8700 1 --2- 172.21.15.47:0/688159157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7138093ae0 0x7f7138093ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.011+0000 7f71452a8700 1 -- 172.21.15.47:0/688159157 >> 172.21.15.47:0/688159157 conn(0x7f713808f1a0 msgr2=0x7f71380915d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:41.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.011+0000 7f71452a8700 1 -- 172.21.15.47:0/688159157 shutdown_connections 2024-02-07T12:26:41.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.011+0000 7f71452a8700 1 -- 172.21.15.47:0/688159157 wait complete. 2024-02-07T12:26:41.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.012+0000 7f71452a8700 1 Processor -- start 2024-02-07T12:26:41.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.012+0000 7f71452a8700 1 -- start start 2024-02-07T12:26:41.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.012+0000 7f71452a8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7138093ae0 0x7f71380051f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:41.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.012+0000 7f71452a8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7138094cf0 0x7f71380aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:41.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.012+0000 7f71452a8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71380aa720 con 0x7f7138094cf0 2024-02-07T12:26:41.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.012+0000 7f71452a8700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71380a3fb0 con 0x7f7138093ae0 2024-02-07T12:26:41.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.013+0000 7f713ffff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7138093ae0 0x7f71380051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:41.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.013+0000 7f713ffff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7138093ae0 0x7f71380051f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.47:58524/0 (socket says 172.21.15.47:58524) 2024-02-07T12:26:41.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.013+0000 7f713ffff700 1 -- 172.21.15.47:0/1553872501 learned_addr learned my addr 172.21.15.47:0/1553872501 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.013+0000 7f713ffff700 1 -- 172.21.15.47:0/1553872501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7138094cf0 msgr2=0x7f71380aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.013+0000 7f713ffff700 1 --2- 172.21.15.47:0/1553872501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7138094cf0 0x7f71380aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.013+0000 7f713ffff700 1 -- 172.21.15.47:0/1553872501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7134005040 con 0x7f7138093ae0 2024-02-07T12:26:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.013+0000 7f713ffff700 1 --2- 172.21.15.47:0/1553872501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7138093ae0 0x7f71380051f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7134007ef0 tx=0x7f7134009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.014+0000 7f713cff9700 1 -- 172.21.15.47:0/1553872501 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7134019070 con 0x7f7138093ae0 2024-02-07T12:26:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.014+0000 7f713cff9700 1 -- 172.21.15.47:0/1553872501 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f713401d890 con 0x7f7138093ae0 2024-02-07T12:26:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.014+0000 7f713cff9700 1 -- 172.21.15.47:0/1553872501 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f713401c7f0 con 0x7f7138093ae0 2024-02-07T12:26:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.014+0000 7f71452a8700 1 -- 172.21.15.47:0/1553872501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c005040 con 0x7f7138093ae0 2024-02-07T12:26:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.014+0000 7f71452a8700 1 -- 172.21.15.47:0/1553872501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71380a4550 con 0x7f7138093ae0 2024-02-07T12:26:41.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.016+0000 7f71452a8700 1 -- 172.21.15.47:0/1553872501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71240052e0 con 0x7f7138093ae0 2024-02-07T12:26:41.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.017+0000 7f713cff9700 1 -- 172.21.15.47:0/1553872501 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7f713401d3c0 con 0x7f7138093ae0 2024-02-07T12:26:41.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.017+0000 7f713cff9700 1 --2- 172.21.15.47:0/1553872501 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f713006b260 0x7f713006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:41.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.017+0000 7f713cff9700 1 -- 172.21.15.47:0/1553872501 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7134092100 con 0x7f7138093ae0 2024-02-07T12:26:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.018+0000 7f713f7fe700 1 --2- 172.21.15.47:0/1553872501 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f713006b260 0x7f713006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:41.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.019+0000 7f713f7fe700 1 --2- 172.21.15.47:0/1553872501 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f713006b260 0x7f713006d710 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f712c004890 tx=0x7f712c009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:41.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.024+0000 7f713cff9700 1 -- 172.21.15.47:0/1553872501 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f713405fbc0 con 0x7f7138093ae0 2024-02-07T12:26:41.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.362+0000 7f71452a8700 1 -- 172.21.15.47:0/1553872501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7124005d00 con 0x7f7138093ae0 2024-02-07T12:26:41.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.363+0000 7f713cff9700 1 -- 172.21.15.47:0/1553872501 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f7134064e60 con 0x7f7138093ae0 2024-02-07T12:26:41.366 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:26:41.366 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:26:41.367 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2 2024-02-07T12:26:41.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:26:41.367 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:26:41.367 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 1, 2024-02-07T12:26:41.367 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 1 2024-02-07T12:26:41.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:26:41.367 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:26:41.367 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 6 2024-02-07T12:26:41.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:26:41.367 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:26:41.367 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:26:41.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:26:41.367 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:26:41.368 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 13, 2024-02-07T12:26:41.368 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 1 2024-02-07T12:26:41.368 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:26:41.368 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:26:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.365+0000 7f71452a8700 1 -- 172.21.15.47:0/1553872501 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f713006b260 msgr2=0x7f713006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.365+0000 7f71452a8700 1 --2- 172.21.15.47:0/1553872501 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f713006b260 0x7f713006d710 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f712c004890 tx=0x7f712c009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.365+0000 7f71452a8700 1 -- 172.21.15.47:0/1553872501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7138093ae0 msgr2=0x7f71380051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.365+0000 7f71452a8700 1 --2- 172.21.15.47:0/1553872501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7138093ae0 0x7f71380051f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7134007ef0 tx=0x7f7134009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.365+0000 7f71452a8700 1 -- 172.21.15.47:0/1553872501 shutdown_connections 2024-02-07T12:26:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.365+0000 7f71452a8700 1 --2- 172.21.15.47:0/1553872501 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f713006b260 0x7f713006d710 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.365+0000 7f71452a8700 1 --2- 172.21.15.47:0/1553872501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7138093ae0 0x7f71380051f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.365+0000 7f71452a8700 1 --2- 172.21.15.47:0/1553872501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7138094cf0 0x7f71380aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.365+0000 7f71452a8700 1 -- 172.21.15.47:0/1553872501 >> 172.21.15.47:0/1553872501 conn(0x7f713808f1a0 msgr2=0x7f7138097f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.366+0000 7f71452a8700 1 -- 172.21.15.47:0/1553872501 shutdown_connections 2024-02-07T12:26:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.366+0000 7f71452a8700 1 -- 172.21.15.47:0/1553872501 wait complete. 2024-02-07T12:26:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.485+0000 7f5fabf1a700 1 -- 172.21.15.47:0/1886501133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fa40fcfb0 msgr2=0x7f5fa40fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.485+0000 7f5fabf1a700 1 --2- 172.21.15.47:0/1886501133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fa40fcfb0 0x7f5fa40fd420 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5f94004940 tx=0x7f5f94009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.485+0000 7f5fabf1a700 1 -- 172.21.15.47:0/1886501133 shutdown_connections 2024-02-07T12:26:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.485+0000 7f5fabf1a700 1 --2- 172.21.15.47:0/1886501133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fa40fcfb0 0x7f5fa40fd420 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.485+0000 7f5fabf1a700 1 --2- 172.21.15.47:0/1886501133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fa40fbe40 0x7f5fa40fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.485+0000 7f5fabf1a700 1 -- 172.21.15.47:0/1886501133 >> 172.21.15.47:0/1886501133 conn(0x7f5fa40f7500 msgr2=0x7f5fa40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.486+0000 7f5fabf1a700 1 -- 172.21.15.47:0/1886501133 shutdown_connections 2024-02-07T12:26:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.486+0000 7f5fabf1a700 1 -- 172.21.15.47:0/1886501133 wait complete. 2024-02-07T12:26:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.486+0000 7f5fabf1a700 1 Processor -- start 2024-02-07T12:26:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.486+0000 7f5fabf1a700 1 -- start start 2024-02-07T12:26:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.486+0000 7f5fabf1a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fa40fbe40 0x7f5fa410fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.486+0000 7f5fabf1a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fa40fcfb0 0x7f5fa410fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.486+0000 7f5fabf1a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa41105f0 con 0x7f5fa40fcfb0 2024-02-07T12:26:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.486+0000 7f5fabf1a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa4110e90 con 0x7f5fa40fbe40 2024-02-07T12:26:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.487+0000 7f5fa94b5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fa40fcfb0 0x7f5fa410fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.487+0000 7f5fa9cb6700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fa40fbe40 0x7f5fa410fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.487+0000 7f5fa94b5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fa40fcfb0 0x7f5fa410fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38654/0 (socket says 172.21.15.47:38654) 2024-02-07T12:26:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.487+0000 7f5fa94b5700 1 -- 172.21.15.47:0/4102873995 learned_addr learned my addr 172.21.15.47:0/4102873995 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.487+0000 7f5fa94b5700 1 -- 172.21.15.47:0/4102873995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fa40fbe40 msgr2=0x7f5fa410fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.487+0000 7f5fa94b5700 1 --2- 172.21.15.47:0/4102873995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fa40fbe40 0x7f5fa410fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.487+0000 7f5fa94b5700 1 -- 172.21.15.47:0/4102873995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f94005040 con 0x7f5fa40fcfb0 2024-02-07T12:26:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.487+0000 7f5fa9cb6700 1 --2- 172.21.15.47:0/4102873995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fa40fbe40 0x7f5fa410fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-07T12:26:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.487+0000 7f5fa94b5700 1 --2- 172.21.15.47:0/4102873995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fa40fcfb0 0x7f5fa410fff0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5f94000c00 tx=0x7f5f94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.487+0000 7f5f9a7fc700 1 -- 172.21.15.47:0/4102873995 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f94021070 con 0x7f5fa40fcfb0 2024-02-07T12:26:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.487+0000 7f5f9a7fc700 1 -- 172.21.15.47:0/4102873995 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f9401c400 con 0x7f5fa40fcfb0 2024-02-07T12:26:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.487+0000 7f5fabf1a700 1 -- 172.21.15.47:0/4102873995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa4111110 con 0x7f5fa40fcfb0 2024-02-07T12:26:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.488+0000 7f5f9a7fc700 1 -- 172.21.15.47:0/4102873995 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f9400e070 con 0x7f5fa40fcfb0 2024-02-07T12:26:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.488+0000 7f5fabf1a700 1 -- 172.21.15.47:0/4102873995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa41115f0 con 0x7f5fa40fcfb0 2024-02-07T12:26:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.489+0000 7f5fabf1a700 1 -- 172.21.15.47:0/4102873995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa404bed0 con 0x7f5fa40fcfb0 2024-02-07T12:26:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.489+0000 7f5f9a7fc700 1 -- 172.21.15.47:0/4102873995 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7f5f9401ca50 con 0x7f5fa40fcfb0 2024-02-07T12:26:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.490+0000 7f5f9a7fc700 1 --2- 172.21.15.47:0/4102873995 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f5f9006b140 0x7f5f9006d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.490+0000 7f5f9a7fc700 1 -- 172.21.15.47:0/4102873995 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5f9408ae50 con 0x7f5fa40fcfb0 2024-02-07T12:26:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.490+0000 7f5fa9cb6700 1 --2- 172.21.15.47:0/4102873995 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f5f9006b140 0x7f5f9006d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.491+0000 7f5fa9cb6700 1 --2- 172.21.15.47:0/4102873995 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f5f9006b140 0x7f5f9006d5f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0009b80 tx=0x7f5fa000b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:41.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.496+0000 7f5f9a7fc700 1 -- 172.21.15.47:0/4102873995 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5f94058990 con 0x7f5fa40fcfb0 2024-02-07T12:26:41.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.762+0000 7f5fabf1a700 1 -- 172.21.15.47:0/4102873995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5fa4104930 con 0x7f5fa40fcfb0 2024-02-07T12:26:41.766 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:41 smithi047 ceph-mon[28972]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:41.766 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:41 smithi047 ceph-mon[28972]: pgmap v37: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 194 op/s 2024-02-07T12:26:41.767 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:41 smithi047 ceph-mon[28972]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:41.767 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:41 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1553872501' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:26:41.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.763+0000 7f5f9a7fc700 1 -- 172.21.15.47:0/4102873995 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1868 (secure 0 0 0) 0x7f5f94058520 con 0x7f5fa40fcfb0 2024-02-07T12:26:41.767 INFO:teuthology.orchestra.run.smithi047.stdout:e20 2024-02-07T12:26:41.767 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:26:41.767 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:26:41.767 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:26:41.767 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 20 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:26:24.336188+0000 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:26:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:26:41.769 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:26:41.769 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:26:41.769 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:26:41.769 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:26:41.769 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:26:41.769 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:26:41.769 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:26:41.769 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:26:41.769 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:26:41.769 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:26:41.769 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:26:41.769 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:26:41.769 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 export targets 1 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:26:41.770 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:26:41.770 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:26:41.770 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:26:41.770 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:26:41.770 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:26:41.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.766+0000 7f5fabf1a700 1 -- 172.21.15.47:0/4102873995 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f5f9006b140 msgr2=0x7f5f9006d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.766+0000 7f5fabf1a700 1 --2- 172.21.15.47:0/4102873995 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f5f9006b140 0x7f5f9006d5f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0009b80 tx=0x7f5fa000b040 comp rx=0 tx=0).stop 2024-02-07T12:26:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.766+0000 7f5fabf1a700 1 -- 172.21.15.47:0/4102873995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fa40fcfb0 msgr2=0x7f5fa410fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.766+0000 7f5fabf1a700 1 --2- 172.21.15.47:0/4102873995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fa40fcfb0 0x7f5fa410fff0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5f94000c00 tx=0x7f5f94009e30 comp rx=0 tx=0).stop 2024-02-07T12:26:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.766+0000 7f5fabf1a700 1 -- 172.21.15.47:0/4102873995 shutdown_connections 2024-02-07T12:26:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.766+0000 7f5fabf1a700 1 --2- 172.21.15.47:0/4102873995 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f5f9006b140 0x7f5f9006d5f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.766+0000 7f5fabf1a700 1 --2- 172.21.15.47:0/4102873995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fa40fbe40 0x7f5fa410fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.766+0000 7f5fabf1a700 1 --2- 172.21.15.47:0/4102873995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fa40fcfb0 0x7f5fa410fff0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.766+0000 7f5fabf1a700 1 -- 172.21.15.47:0/4102873995 >> 172.21.15.47:0/4102873995 conn(0x7f5fa40f7500 msgr2=0x7f5fa4065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.766+0000 7f5fabf1a700 1 -- 172.21.15.47:0/4102873995 shutdown_connections 2024-02-07T12:26:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.766+0000 7f5fabf1a700 1 -- 172.21.15.47:0/4102873995 wait complete. 2024-02-07T12:26:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-02-07T12:26:41.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:41 smithi138 ceph-mon[35528]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:41.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:41 smithi138 ceph-mon[35528]: pgmap v37: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 194 op/s 2024-02-07T12:26:41.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:41 smithi138 ceph-mon[35528]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:41.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:41 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/1553872501' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:26:41.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.916+0000 7f4a8696f700 1 -- 172.21.15.47:0/2796703912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a780a5140 msgr2=0x7f4a780a5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:41.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.916+0000 7f4a8696f700 1 --2- 172.21.15.47:0/2796703912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a780a5140 0x7f4a780a5590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c004a50 tx=0x7f4a7c00af40 comp rx=0 tx=0).stop 2024-02-07T12:26:41.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.917+0000 7f4a8696f700 1 -- 172.21.15.47:0/2796703912 shutdown_connections 2024-02-07T12:26:41.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.917+0000 7f4a8696f700 1 --2- 172.21.15.47:0/2796703912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a780a5140 0x7f4a780a5590 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.917+0000 7f4a8696f700 1 --2- 172.21.15.47:0/2796703912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a780a3e40 0x7f4a780a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.917+0000 7f4a8696f700 1 -- 172.21.15.47:0/2796703912 >> 172.21.15.47:0/2796703912 conn(0x7f4a7809f0b0 msgr2=0x7f4a780a14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:41.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.917+0000 7f4a8696f700 1 -- 172.21.15.47:0/2796703912 shutdown_connections 2024-02-07T12:26:41.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.917+0000 7f4a8696f700 1 -- 172.21.15.47:0/2796703912 wait complete. 2024-02-07T12:26:41.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.918+0000 7f4a8696f700 1 Processor -- start 2024-02-07T12:26:41.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.918+0000 7f4a8696f700 1 -- start start 2024-02-07T12:26:41.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.918+0000 7f4a8696f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a780a3e40 0x7f4a780b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:41.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.918+0000 7f4a8696f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a780a5140 0x7f4a780b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:41.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.918+0000 7f4a8696f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a780b4d10 con 0x7f4a780a5140 2024-02-07T12:26:41.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.918+0000 7f4a8696f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a780b4e80 con 0x7f4a780a3e40 2024-02-07T12:26:41.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.919+0000 7f4a8596d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a780a3e40 0x7f4a780b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:41.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.919+0000 7f4a8596d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a780a3e40 0x7f4a780b41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.47:58566/0 (socket says 172.21.15.47:58566) 2024-02-07T12:26:41.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.919+0000 7f4a8596d700 1 -- 172.21.15.47:0/1073575907 learned_addr learned my addr 172.21.15.47:0/1073575907 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:41.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.919+0000 7f4a8516c700 1 --2- 172.21.15.47:0/1073575907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a780a5140 0x7f4a780b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:41.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.919+0000 7f4a8596d700 1 -- 172.21.15.47:0/1073575907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a780a5140 msgr2=0x7f4a780b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:41.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.919+0000 7f4a8596d700 1 --2- 172.21.15.47:0/1073575907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a780a5140 0x7f4a780b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:41.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.919+0000 7f4a8596d700 1 -- 172.21.15.47:0/1073575907 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c005040 con 0x7f4a780a3e40 2024-02-07T12:26:41.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.919+0000 7f4a8596d700 1 --2- 172.21.15.47:0/1073575907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a780a3e40 0x7f4a780b41d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000eb70 tx=0x7f4a7000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:41.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.920+0000 7f4a767fc700 1 -- 172.21.15.47:0/1073575907 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a70007ea0 con 0x7f4a780a3e40 2024-02-07T12:26:41.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.920+0000 7f4a767fc700 1 -- 172.21.15.47:0/1073575907 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a700095a0 con 0x7f4a780a3e40 2024-02-07T12:26:41.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.920+0000 7f4a767fc700 1 -- 172.21.15.47:0/1073575907 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a7000de80 con 0x7f4a780a3e40 2024-02-07T12:26:41.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.921+0000 7f4a8696f700 1 -- 172.21.15.47:0/1073575907 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a780097b0 con 0x7f4a780a3e40 2024-02-07T12:26:41.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.921+0000 7f4a8696f700 1 -- 172.21.15.47:0/1073575907 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a78009d20 con 0x7f4a780a3e40 2024-02-07T12:26:41.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.922+0000 7f4a8696f700 1 -- 172.21.15.47:0/1073575907 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a780ac4c0 con 0x7f4a780a3e40 2024-02-07T12:26:41.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.924+0000 7f4a767fc700 1 -- 172.21.15.47:0/1073575907 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7f4a70009710 con 0x7f4a780a3e40 2024-02-07T12:26:41.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.924+0000 7f4a767fc700 1 --2- 172.21.15.47:0/1073575907 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f4a6c06b330 0x7f4a6c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:41.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.924+0000 7f4a767fc700 1 -- 172.21.15.47:0/1073575907 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4a70015020 con 0x7f4a780a3e40 2024-02-07T12:26:41.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.925+0000 7f4a8516c700 1 --2- 172.21.15.47:0/1073575907 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f4a6c06b330 0x7f4a6c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:41.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.927+0000 7f4a8516c700 1 --2- 172.21.15.47:0/1073575907 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f4a6c06b330 0x7f4a6c06d7e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c000c00 tx=0x7f4a7c00af40 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:41.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:41.930+0000 7f4a767fc700 1 -- 172.21.15.47:0/1073575907 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4a70057ef0 con 0x7f4a780a3e40 2024-02-07T12:26:42.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.279+0000 7f4a8696f700 1 -- 172.21.15.47:0/1073575907 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a780a9550 con 0x7f4a6c06b330 2024-02-07T12:26:42.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.280+0000 7f4a767fc700 1 -- 172.21.15.47:0/1073575907 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f4a780a9550 con 0x7f4a6c06b330 2024-02-07T12:26:42.284 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:26:42.284 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:26:42.284 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:26:42.284 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:26:42.284 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [], 2024-02-07T12:26:42.284 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "1/21 daemons upgraded", 2024-02-07T12:26:42.284 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "", 2024-02-07T12:26:42.284 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:26:42.284 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:26:42.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.282+0000 7f4a8696f700 1 -- 172.21.15.47:0/1073575907 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f4a6c06b330 msgr2=0x7f4a6c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:42.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.282+0000 7f4a8696f700 1 --2- 172.21.15.47:0/1073575907 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f4a6c06b330 0x7f4a6c06d7e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c000c00 tx=0x7f4a7c00af40 comp rx=0 tx=0).stop 2024-02-07T12:26:42.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.282+0000 7f4a8696f700 1 -- 172.21.15.47:0/1073575907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a780a3e40 msgr2=0x7f4a780b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:42.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.282+0000 7f4a8696f700 1 --2- 172.21.15.47:0/1073575907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a780a3e40 0x7f4a780b41d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000eb70 tx=0x7f4a7000b040 comp rx=0 tx=0).stop 2024-02-07T12:26:42.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.282+0000 7f4a8696f700 1 -- 172.21.15.47:0/1073575907 shutdown_connections 2024-02-07T12:26:42.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.282+0000 7f4a8696f700 1 --2- 172.21.15.47:0/1073575907 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f4a6c06b330 0x7f4a6c06d7e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:42.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.282+0000 7f4a8696f700 1 --2- 172.21.15.47:0/1073575907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a780a3e40 0x7f4a780b41d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:42.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.282+0000 7f4a8696f700 1 --2- 172.21.15.47:0/1073575907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a780a5140 0x7f4a780b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:42.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.282+0000 7f4a8696f700 1 -- 172.21.15.47:0/1073575907 >> 172.21.15.47:0/1073575907 conn(0x7f4a7809f0b0 msgr2=0x7f4a780a7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:42.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.283+0000 7f4a8696f700 1 -- 172.21.15.47:0/1073575907 shutdown_connections 2024-02-07T12:26:42.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.283+0000 7f4a8696f700 1 -- 172.21.15.47:0/1073575907 wait complete. 2024-02-07T12:26:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.397+0000 7f3c1bcea700 1 -- 172.21.15.47:0/3063757046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c140fb220 msgr2=0x7f3c140fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.397+0000 7f3c1bcea700 1 --2- 172.21.15.47:0/3063757046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c140fb220 0x7f3c140fb630 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009ce0 tx=0x7f3c04004d10 comp rx=0 tx=0).stop 2024-02-07T12:26:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.397+0000 7f3c1bcea700 1 -- 172.21.15.47:0/3063757046 shutdown_connections 2024-02-07T12:26:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.397+0000 7f3c1bcea700 1 --2- 172.21.15.47:0/3063757046 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c140fe2b0 0x7f3c140fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.397+0000 7f3c1bcea700 1 --2- 172.21.15.47:0/3063757046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c140fb220 0x7f3c140fb630 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.397+0000 7f3c1bcea700 1 -- 172.21.15.47:0/3063757046 >> 172.21.15.47:0/3063757046 conn(0x7f3c140f6ca0 msgr2=0x7f3c140f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.397+0000 7f3c1bcea700 1 -- 172.21.15.47:0/3063757046 shutdown_connections 2024-02-07T12:26:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.397+0000 7f3c1bcea700 1 -- 172.21.15.47:0/3063757046 wait complete. 2024-02-07T12:26:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c1bcea700 1 Processor -- start 2024-02-07T12:26:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c1bcea700 1 -- start start 2024-02-07T12:26:42.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c1bcea700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c140fb220 0x7f3c140fdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:42.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c1bcea700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c140fe2b0 0x7f3c140fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:42.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c1bcea700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c140fc7c0 con 0x7f3c140fe2b0 2024-02-07T12:26:42.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c1bcea700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c140fc930 con 0x7f3c140fb220 2024-02-07T12:26:42.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c19285700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c140fe2b0 0x7f3c140fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:42.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c19a86700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c140fb220 0x7f3c140fdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:42.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c19285700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c140fe2b0 0x7f3c140fc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38680/0 (socket says 172.21.15.47:38680) 2024-02-07T12:26:42.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c19285700 1 -- 172.21.15.47:0/1372346528 learned_addr learned my addr 172.21.15.47:0/1372346528 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:26:42.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c19285700 1 -- 172.21.15.47:0/1372346528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c140fb220 msgr2=0x7f3c140fdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:42.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c19285700 1 --2- 172.21.15.47:0/1372346528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c140fb220 0x7f3c140fdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:42.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c19285700 1 -- 172.21.15.47:0/1372346528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c04009940 con 0x7f3c140fe2b0 2024-02-07T12:26:42.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.398+0000 7f3c19285700 1 --2- 172.21.15.47:0/1372346528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c140fe2b0 0x7f3c140fc1c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800c8c0 tx=0x7f3c080044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:42.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.399+0000 7f3c127fc700 1 -- 172.21.15.47:0/1372346528 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c0800a760 con 0x7f3c140fe2b0 2024-02-07T12:26:42.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.399+0000 7f3c127fc700 1 -- 172.21.15.47:0/1372346528 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c0800ad90 con 0x7f3c140fe2b0 2024-02-07T12:26:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.399+0000 7f3c127fc700 1 -- 172.21.15.47:0/1372346528 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c080113a0 con 0x7f3c140fe2b0 2024-02-07T12:26:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.399+0000 7f3c1bcea700 1 -- 172.21.15.47:0/1372346528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c140fcc10 con 0x7f3c140fe2b0 2024-02-07T12:26:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.399+0000 7f3c1bcea700 1 -- 172.21.15.47:0/1372346528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c14115c30 con 0x7f3c140fe2b0 2024-02-07T12:26:42.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.400+0000 7f3c1bcea700 1 -- 172.21.15.47:0/1372346528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c14107a80 con 0x7f3c140fe2b0 2024-02-07T12:26:42.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.400+0000 7f3c127fc700 1 -- 172.21.15.47:0/1372346528 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) v1 ==== 88931+0+0 (secure 0 0 0) 0x7f3c08012400 con 0x7f3c140fe2b0 2024-02-07T12:26:42.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.400+0000 7f3c127fc700 1 --2- 172.21.15.47:0/1372346528 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f3bfc06b140 0x7f3bfc06d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:26:42.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.401+0000 7f3c127fc700 1 -- 172.21.15.47:0/1372346528 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3c08089b30 con 0x7f3c140fe2b0 2024-02-07T12:26:42.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.401+0000 7f3c19a86700 1 --2- 172.21.15.47:0/1372346528 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f3bfc06b140 0x7f3bfc06d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:26:42.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.401+0000 7f3c19a86700 1 --2- 172.21.15.47:0/1372346528 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f3bfc06b140 0x7f3bfc06d5f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3c04015040 tx=0x7f3c04004d10 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:26:42.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.406+0000 7f3c127fc700 1 -- 172.21.15.47:0/1372346528 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3c08057780 con 0x7f3c140fe2b0 2024-02-07T12:26:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:42 smithi047 ceph-mon[28972]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:42 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/4102873995' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:26:42.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:42 smithi138 ceph-mon[35528]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:42.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:42 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/4102873995' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:26:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.797+0000 7f3c1bcea700 1 -- 172.21.15.47:0/1372346528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3c1404bed0 con 0x7f3c140fe2b0 2024-02-07T12:26:42.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.798+0000 7f3c127fc700 1 -- 172.21.15.47:0/1372346528 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3c08057310 con 0x7f3c140fe2b0 2024-02-07T12:26:42.800 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:26:42.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.800+0000 7f3c1bcea700 1 -- 172.21.15.47:0/1372346528 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f3bfc06b140 msgr2=0x7f3bfc06d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:42.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.800+0000 7f3c1bcea700 1 --2- 172.21.15.47:0/1372346528 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f3bfc06b140 0x7f3bfc06d5f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3c04015040 tx=0x7f3c04004d10 comp rx=0 tx=0).stop 2024-02-07T12:26:42.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.800+0000 7f3c1bcea700 1 -- 172.21.15.47:0/1372346528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c140fe2b0 msgr2=0x7f3c140fc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:26:42.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.800+0000 7f3c1bcea700 1 --2- 172.21.15.47:0/1372346528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c140fe2b0 0x7f3c140fc1c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800c8c0 tx=0x7f3c080044c0 comp rx=0 tx=0).stop 2024-02-07T12:26:42.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.800+0000 7f3c1bcea700 1 -- 172.21.15.47:0/1372346528 shutdown_connections 2024-02-07T12:26:42.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.800+0000 7f3c1bcea700 1 --2- 172.21.15.47:0/1372346528 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f3bfc06b140 0x7f3bfc06d5f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:42.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.800+0000 7f3c1bcea700 1 --2- 172.21.15.47:0/1372346528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c140fb220 0x7f3c140fdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:42.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.800+0000 7f3c1bcea700 1 --2- 172.21.15.47:0/1372346528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c140fe2b0 0x7f3c140fc1c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:26:42.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.800+0000 7f3c1bcea700 1 -- 172.21.15.47:0/1372346528 >> 172.21.15.47:0/1372346528 conn(0x7f3c140f6ca0 msgr2=0x7f3c140f8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:26:42.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.800+0000 7f3c1bcea700 1 -- 172.21.15.47:0/1372346528 shutdown_connections 2024-02-07T12:26:42.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:26:42.800+0000 7f3c1bcea700 1 -- 172.21.15.47:0/1372346528 wait complete. 2024-02-07T12:26:43.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:43 smithi138 ceph-mon[35528]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:43.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:43 smithi138 ceph-mon[35528]: pgmap v38: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 178 op/s 2024-02-07T12:26:43.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:43 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/1372346528' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:26:43.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:43 smithi047 ceph-mon[28972]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:26:43.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:43 smithi047 ceph-mon[28972]: pgmap v38: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 178 op/s 2024-02-07T12:26:43.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:43 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1372346528' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:26:45.647 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:45 smithi047 ceph-mon[28972]: pgmap v39: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 300 op/s 2024-02-07T12:26:45.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:45 smithi138 ceph-mon[35528]: pgmap v39: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 300 op/s 2024-02-07T12:26:47.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:47 smithi138 ceph-mon[35528]: pgmap v40: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 208 op/s 2024-02-07T12:26:47.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:47 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:26:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:47 smithi047 ceph-mon[28972]: pgmap v40: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 208 op/s 2024-02-07T12:26:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:47 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:26:49.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:49 smithi138 ceph-mon[35528]: pgmap v41: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 336 op/s 2024-02-07T12:26:49.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:49 smithi047 ceph-mon[28972]: pgmap v41: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 336 op/s 2024-02-07T12:26:51.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:51 smithi138 ceph-mon[35528]: pgmap v42: 65 pgs: 65 active+clean; 302 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 292 op/s 2024-02-07T12:26:51.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:51 smithi047 ceph-mon[28972]: pgmap v42: 65 pgs: 65 active+clean; 302 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 292 op/s 2024-02-07T12:26:53.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:53 smithi138 ceph-mon[35528]: pgmap v43: 65 pgs: 65 active+clean; 302 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 275 op/s 2024-02-07T12:26:53.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:53 smithi047 ceph-mon[28972]: pgmap v43: 65 pgs: 65 active+clean; 302 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 275 op/s 2024-02-07T12:26:55.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:55 smithi138 ceph-mon[35528]: pgmap v44: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 417 op/s 2024-02-07T12:26:55.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:55 smithi047 ceph-mon[28972]: pgmap v44: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 417 op/s 2024-02-07T12:26:57.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:57 smithi138 ceph-mon[35528]: pgmap v45: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 295 op/s 2024-02-07T12:26:57.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:57 smithi047 ceph-mon[28972]: pgmap v45: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 295 op/s 2024-02-07T12:26:59.688 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:26:59 smithi138 ceph-mon[35528]: pgmap v46: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 452 op/s 2024-02-07T12:26:59.689 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-07T12:26:59.690 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-07T12:26:59.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:26:59 smithi047 ceph-mon[28972]: pgmap v46: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 452 op/s 2024-02-07T12:26:59.957 DEBUG:teuthology.parallel:result is None 2024-02-07T12:27:01.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:01 smithi138 ceph-mon[35528]: pgmap v47: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 353 op/s 2024-02-07T12:27:01.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:01 smithi047 ceph-mon[28972]: pgmap v47: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 353 op/s 2024-02-07T12:27:02.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:02 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:27:02.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:02 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:27:03.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:03 smithi138 ceph-mon[35528]: pgmap v48: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 328 op/s 2024-02-07T12:27:03.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:03 smithi047 ceph-mon[28972]: pgmap v48: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 328 op/s 2024-02-07T12:27:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:05 smithi047 ceph-mon[28972]: pgmap v49: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 486 op/s 2024-02-07T12:27:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:05 smithi047 ceph-mon[28972]: mgrmap e26: smithi138.fiugmj(active, since 92s), standbys: smithi047.zhgnrm 2024-02-07T12:27:05.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:05 smithi138 ceph-mon[35528]: pgmap v49: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 486 op/s 2024-02-07T12:27:05.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:05 smithi138 ceph-mon[35528]: mgrmap e26: smithi138.fiugmj(active, since 92s), standbys: smithi047.zhgnrm 2024-02-07T12:27:07.688 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:07 smithi047 ceph-mon[28972]: pgmap v50: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 344 op/s 2024-02-07T12:27:07.688 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:07 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:07.689 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:07 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:07.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:07 smithi138 ceph-mon[35528]: pgmap v50: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 344 op/s 2024-02-07T12:27:07.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:07 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:07.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:07 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:08.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:08 smithi138 ceph-mon[35528]: Reconfiguring prometheus.smithi047 (dependencies changed)... 2024-02-07T12:27:08.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:08 smithi138 ceph-mon[35528]: Reconfiguring daemon prometheus.smithi047 on smithi047 2024-02-07T12:27:08.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:08 smithi047 ceph-mon[28972]: Reconfiguring prometheus.smithi047 (dependencies changed)... 2024-02-07T12:27:08.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:08 smithi047 ceph-mon[28972]: Reconfiguring daemon prometheus.smithi047 on smithi047 2024-02-07T12:27:09.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:09 smithi138 ceph-mon[35528]: pgmap v51: 65 pgs: 65 active+clean; 299 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 491 op/s 2024-02-07T12:27:09.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:09 smithi047 ceph-mon[28972]: pgmap v51: 65 pgs: 65 active+clean; 299 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 491 op/s 2024-02-07T12:27:11.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:11 smithi047 ceph-mon[28972]: pgmap v52: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 384 op/s 2024-02-07T12:27:11.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:11 smithi138 ceph-mon[35528]: pgmap v52: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 384 op/s 2024-02-07T12:27:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.933+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/2785690071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb80fbe40 msgr2=0x7f8fb80fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.933+0000 7f8fbcdfe700 1 --2- 172.21.15.47:0/2785690071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb80fbe40 0x7f8fb80fc250 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8004940 tx=0x7f8fa8009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.933+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/2785690071 shutdown_connections 2024-02-07T12:27:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.933+0000 7f8fbcdfe700 1 --2- 172.21.15.47:0/2785690071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fb80fcfb0 0x7f8fb80fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.933+0000 7f8fbcdfe700 1 --2- 172.21.15.47:0/2785690071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb80fbe40 0x7f8fb80fc250 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.933+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/2785690071 >> 172.21.15.47:0/2785690071 conn(0x7f8fb80f7520 msgr2=0x7f8fb80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.933+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/2785690071 shutdown_connections 2024-02-07T12:27:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.933+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/2785690071 wait complete. 2024-02-07T12:27:12.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.934+0000 7f8fbcdfe700 1 Processor -- start 2024-02-07T12:27:12.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.934+0000 7f8fbcdfe700 1 -- start start 2024-02-07T12:27:12.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.934+0000 7f8fbcdfe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fb80fbe40 0x7f8fb810c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:12.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.934+0000 7f8fbcdfe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb80fcfb0 0x7f8fb810cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:12.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.934+0000 7f8fbcdfe700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb810d380 con 0x7f8fb80fcfb0 2024-02-07T12:27:12.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.934+0000 7f8fbcdfe700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb810dc20 con 0x7f8fb80fbe40 2024-02-07T12:27:12.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.934+0000 7f8fb5d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb80fcfb0 0x7f8fb810cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:12.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.934+0000 7f8fb5d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb80fcfb0 0x7f8fb810cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59474/0 (socket says 172.21.15.47:59474) 2024-02-07T12:27:12.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.934+0000 7f8fb5d9b700 1 -- 172.21.15.47:0/166229774 learned_addr learned my addr 172.21.15.47:0/166229774 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:12.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.935+0000 7f8fb659c700 1 --2- 172.21.15.47:0/166229774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fb80fbe40 0x7f8fb810c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:12.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.935+0000 7f8fb5d9b700 1 -- 172.21.15.47:0/166229774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fb80fbe40 msgr2=0x7f8fb810c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:12.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.935+0000 7f8fb5d9b700 1 --2- 172.21.15.47:0/166229774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fb80fbe40 0x7f8fb810c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:12.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.935+0000 7f8fb5d9b700 1 -- 172.21.15.47:0/166229774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa8005040 con 0x7f8fb80fcfb0 2024-02-07T12:27:12.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.935+0000 7f8fb5d9b700 1 --2- 172.21.15.47:0/166229774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb80fcfb0 0x7f8fb810cd80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00ead0 tx=0x7f8fac004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:12.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.935+0000 7f8fa6ffd700 1 -- 172.21.15.47:0/166229774 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fac00cc60 con 0x7f8fb80fcfb0 2024-02-07T12:27:12.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.935+0000 7f8fa6ffd700 1 -- 172.21.15.47:0/166229774 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8fac00cdc0 con 0x7f8fb80fcfb0 2024-02-07T12:27:12.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.935+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/166229774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb810dea0 con 0x7f8fb80fcfb0 2024-02-07T12:27:12.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.935+0000 7f8fa6ffd700 1 -- 172.21.15.47:0/166229774 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fac0109f0 con 0x7f8fb80fcfb0 2024-02-07T12:27:12.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.935+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/166229774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb810e3e0 con 0x7f8fb80fcfb0 2024-02-07T12:27:12.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.936+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/166229774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb804bed0 con 0x7f8fb80fcfb0 2024-02-07T12:27:12.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.937+0000 7f8fa6ffd700 1 -- 172.21.15.47:0/166229774 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 26) v1 ==== 88829+0+0 (secure 0 0 0) 0x7f8fac010b50 con 0x7f8fb80fcfb0 2024-02-07T12:27:12.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.937+0000 7f8fa6ffd700 1 --2- 172.21.15.47:0/166229774 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f8fa006b0f0 0x7f8fa006d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:12.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.938+0000 7f8fa6ffd700 1 -- 172.21.15.47:0/166229774 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8fac08c210 con 0x7f8fb80fcfb0 2024-02-07T12:27:12.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.938+0000 7f8fb659c700 1 --2- 172.21.15.47:0/166229774 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f8fa006b0f0 0x7f8fa006d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:12.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.939+0000 7f8fb659c700 1 --2- 172.21.15.47:0/166229774 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f8fa006b0f0 0x7f8fa006d5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8004f90 tx=0x7f8fa8009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:12.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:12.945+0000 7f8fa6ffd700 1 -- 172.21.15.47:0/166229774 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8fac059f70 con 0x7f8fb80fcfb0 2024-02-07T12:27:13.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.176+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/166229774 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fb810e990 con 0x7f8fa006b0f0 2024-02-07T12:27:13.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.178+0000 7f8fa6ffd700 1 -- 172.21.15.47:0/166229774 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8fb810e990 con 0x7f8fa006b0f0 2024-02-07T12:27:13.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.180+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/166229774 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f8fa006b0f0 msgr2=0x7f8fa006d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:13.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.180+0000 7f8fbcdfe700 1 --2- 172.21.15.47:0/166229774 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f8fa006b0f0 0x7f8fa006d5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8004f90 tx=0x7f8fa8009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:13.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.180+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/166229774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb80fcfb0 msgr2=0x7f8fb810cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:13.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.180+0000 7f8fbcdfe700 1 --2- 172.21.15.47:0/166229774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb80fcfb0 0x7f8fb810cd80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00ead0 tx=0x7f8fac004500 comp rx=0 tx=0).stop 2024-02-07T12:27:13.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.180+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/166229774 shutdown_connections 2024-02-07T12:27:13.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.180+0000 7f8fbcdfe700 1 --2- 172.21.15.47:0/166229774 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f8fa006b0f0 0x7f8fa006d5a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:13.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.180+0000 7f8fbcdfe700 1 --2- 172.21.15.47:0/166229774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fb80fbe40 0x7f8fb810c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:13.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.180+0000 7f8fbcdfe700 1 --2- 172.21.15.47:0/166229774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb80fcfb0 0x7f8fb810cd80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:13.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.180+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/166229774 >> 172.21.15.47:0/166229774 conn(0x7f8fb80f7520 msgr2=0x7f8fb8100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:13.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.180+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/166229774 shutdown_connections 2024-02-07T12:27:13.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.180+0000 7f8fbcdfe700 1 -- 172.21.15.47:0/166229774 wait complete. 2024-02-07T12:27:13.193 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:27:13.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.291+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/2186064671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a681000c0 msgr2=0x7f3a68102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:13.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.291+0000 7f3a6f1d3700 1 --2- 172.21.15.47:0/2186064671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a681000c0 0x7f3a68102520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3a54004940 tx=0x7f3a54009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:13.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.292+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/2186064671 shutdown_connections 2024-02-07T12:27:13.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.292+0000 7f3a6f1d3700 1 --2- 172.21.15.47:0/2186064671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a681000c0 0x7f3a68102520 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:13.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.292+0000 7f3a6f1d3700 1 --2- 172.21.15.47:0/2186064671 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a680663e0 0x7f3a680ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:13.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.292+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/2186064671 >> 172.21.15.47:0/2186064671 conn(0x7f3a680f74e0 msgr2=0x7f3a680f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:13.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.292+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/2186064671 shutdown_connections 2024-02-07T12:27:13.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.292+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/2186064671 wait complete. 2024-02-07T12:27:13.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.292+0000 7f3a6f1d3700 1 Processor -- start 2024-02-07T12:27:13.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.292+0000 7f3a6f1d3700 1 -- start start 2024-02-07T12:27:13.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.293+0000 7f3a6f1d3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a680663e0 0x7f3a680fd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:13.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.293+0000 7f3a6f1d3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a681000c0 0x7f3a680fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:13.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.293+0000 7f3a6f1d3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680fbff0 con 0x7f3a681000c0 2024-02-07T12:27:13.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.293+0000 7f3a6f1d3700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680fc160 con 0x7f3a680663e0 2024-02-07T12:27:13.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.293+0000 7f3a67fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a681000c0 0x7f3a680fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:13.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.293+0000 7f3a67fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a681000c0 0x7f3a680fb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59492/0 (socket says 172.21.15.47:59492) 2024-02-07T12:27:13.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.293+0000 7f3a67fff700 1 -- 172.21.15.47:0/3299613739 learned_addr learned my addr 172.21.15.47:0/3299613739 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:13.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.293+0000 7f3a6cf6f700 1 --2- 172.21.15.47:0/3299613739 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a680663e0 0x7f3a680fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:13.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.293+0000 7f3a67fff700 1 -- 172.21.15.47:0/3299613739 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a680663e0 msgr2=0x7f3a680fd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:13.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.293+0000 7f3a67fff700 1 --2- 172.21.15.47:0/3299613739 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a680663e0 0x7f3a680fd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:13.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.293+0000 7f3a67fff700 1 -- 172.21.15.47:0/3299613739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a54005040 con 0x7f3a681000c0 2024-02-07T12:27:13.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.293+0000 7f3a67fff700 1 --2- 172.21.15.47:0/3299613739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a681000c0 0x7f3a680fb9f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009040 tx=0x7f3a54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:13.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.293+0000 7f3a657fa700 1 -- 172.21.15.47:0/3299613739 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a54021070 con 0x7f3a681000c0 2024-02-07T12:27:13.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.294+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/3299613739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a680fc3e0 con 0x7f3a681000c0 2024-02-07T12:27:13.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.294+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/3299613739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a68115900 con 0x7f3a681000c0 2024-02-07T12:27:13.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.294+0000 7f3a657fa700 1 -- 172.21.15.47:0/3299613739 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a54009430 con 0x7f3a681000c0 2024-02-07T12:27:13.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.294+0000 7f3a657fa700 1 -- 172.21.15.47:0/3299613739 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a5400e070 con 0x7f3a681000c0 2024-02-07T12:27:13.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.295+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/3299613739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6804bed0 con 0x7f3a681000c0 2024-02-07T12:27:13.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.295+0000 7f3a657fa700 1 -- 172.21.15.47:0/3299613739 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 26) v1 ==== 88829+0+0 (secure 0 0 0) 0x7f3a5401c400 con 0x7f3a681000c0 2024-02-07T12:27:13.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.296+0000 7f3a657fa700 1 --2- 172.21.15.47:0/3299613739 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f3a5806b030 0x7f3a5806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:13.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.296+0000 7f3a657fa700 1 -- 172.21.15.47:0/3299613739 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3a5408aad0 con 0x7f3a681000c0 2024-02-07T12:27:13.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.296+0000 7f3a6cf6f700 1 --2- 172.21.15.47:0/3299613739 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f3a5806b030 0x7f3a5806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:13.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.296+0000 7f3a6cf6f700 1 --2- 172.21.15.47:0/3299613739 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f3a5806b030 0x7f3a5806d4e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3a680fd300 tx=0x7f3a5c00b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:13.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.302+0000 7f3a657fa700 1 -- 172.21.15.47:0/3299613739 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3a540588f0 con 0x7f3a681000c0 2024-02-07T12:27:13.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:13 smithi138 ceph-mon[35528]: pgmap v53: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 354 op/s 2024-02-07T12:27:13.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:13 smithi047 ceph-mon[28972]: pgmap v53: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 354 op/s 2024-02-07T12:27:13.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.652+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/3299613739 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a68100d60 con 0x7f3a5806b030 2024-02-07T12:27:13.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.653+0000 7f3a657fa700 1 -- 172.21.15.47:0/3299613739 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f3a68100d60 con 0x7f3a5806b030 2024-02-07T12:27:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.655+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/3299613739 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f3a5806b030 msgr2=0x7f3a5806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.655+0000 7f3a6f1d3700 1 --2- 172.21.15.47:0/3299613739 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f3a5806b030 0x7f3a5806d4e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3a680fd300 tx=0x7f3a5c00b040 comp rx=0 tx=0).stop 2024-02-07T12:27:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.655+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/3299613739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a681000c0 msgr2=0x7f3a680fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.655+0000 7f3a6f1d3700 1 --2- 172.21.15.47:0/3299613739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a681000c0 0x7f3a680fb9f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009040 tx=0x7f3a54009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.656+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/3299613739 shutdown_connections 2024-02-07T12:27:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.656+0000 7f3a6f1d3700 1 --2- 172.21.15.47:0/3299613739 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f3a5806b030 0x7f3a5806d4e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.656+0000 7f3a6f1d3700 1 --2- 172.21.15.47:0/3299613739 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a680663e0 0x7f3a680fd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.656+0000 7f3a6f1d3700 1 --2- 172.21.15.47:0/3299613739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a681000c0 0x7f3a680fb9f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.656+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/3299613739 >> 172.21.15.47:0/3299613739 conn(0x7f3a680f74e0 msgr2=0x7f3a680f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.656+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/3299613739 shutdown_connections 2024-02-07T12:27:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.656+0000 7f3a6f1d3700 1 -- 172.21.15.47:0/3299613739 wait complete. 2024-02-07T12:27:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.763+0000 7fb71281a700 1 -- 172.21.15.47:0/846931873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb70c0fe2b0 msgr2=0x7fb70c0fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.763+0000 7fb71281a700 1 --2- 172.21.15.47:0/846931873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb70c0fe2b0 0x7fb70c0fe700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb700004940 tx=0x7fb700009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.763+0000 7fb71281a700 1 -- 172.21.15.47:0/846931873 shutdown_connections 2024-02-07T12:27:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.763+0000 7fb71281a700 1 --2- 172.21.15.47:0/846931873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb70c0fe2b0 0x7fb70c0fe700 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.763+0000 7fb71281a700 1 --2- 172.21.15.47:0/846931873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb70c0fb220 0x7fb70c0fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.763+0000 7fb71281a700 1 -- 172.21.15.47:0/846931873 >> 172.21.15.47:0/846931873 conn(0x7fb70c0f6ca0 msgr2=0x7fb70c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.763+0000 7fb71281a700 1 -- 172.21.15.47:0/846931873 shutdown_connections 2024-02-07T12:27:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.763+0000 7fb71281a700 1 -- 172.21.15.47:0/846931873 wait complete. 2024-02-07T12:27:13.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.763+0000 7fb71281a700 1 Processor -- start 2024-02-07T12:27:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.764+0000 7fb71281a700 1 -- start start 2024-02-07T12:27:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.764+0000 7fb71281a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb70c0fb220 0x7fb70c0fdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.764+0000 7fb71281a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb70c0fe2b0 0x7fb70c0fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.764+0000 7fb71281a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c0fc7c0 con 0x7fb70c0fe2b0 2024-02-07T12:27:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.764+0000 7fb71281a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c0fc930 con 0x7fb70c0fb220 2024-02-07T12:27:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.764+0000 7fb70b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb70c0fe2b0 0x7fb70c0fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.764+0000 7fb70b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb70c0fe2b0 0x7fb70c0fc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59522/0 (socket says 172.21.15.47:59522) 2024-02-07T12:27:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.764+0000 7fb70b7fe700 1 -- 172.21.15.47:0/2570395025 learned_addr learned my addr 172.21.15.47:0/2570395025 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.764+0000 7fb70bfff700 1 --2- 172.21.15.47:0/2570395025 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb70c0fb220 0x7fb70c0fdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.764+0000 7fb70b7fe700 1 -- 172.21.15.47:0/2570395025 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb70c0fb220 msgr2=0x7fb70c0fdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.764+0000 7fb70b7fe700 1 --2- 172.21.15.47:0/2570395025 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb70c0fb220 0x7fb70c0fdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.764+0000 7fb70b7fe700 1 -- 172.21.15.47:0/2570395025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700005040 con 0x7fb70c0fe2b0 2024-02-07T12:27:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.765+0000 7fb70b7fe700 1 --2- 172.21.15.47:0/2570395025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb70c0fe2b0 0x7fb70c0fc1c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb700009b30 tx=0x7fb700009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.765+0000 7fb708ff9700 1 -- 172.21.15.47:0/2570395025 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb700021070 con 0x7fb70c0fe2b0 2024-02-07T12:27:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.765+0000 7fb71281a700 1 -- 172.21.15.47:0/2570395025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c0fcbb0 con 0x7fb70c0fe2b0 2024-02-07T12:27:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.765+0000 7fb708ff9700 1 -- 172.21.15.47:0/2570395025 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb70001c400 con 0x7fb70c0fe2b0 2024-02-07T12:27:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.765+0000 7fb708ff9700 1 -- 172.21.15.47:0/2570395025 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb70000e070 con 0x7fb70c0fe2b0 2024-02-07T12:27:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.765+0000 7fb71281a700 1 -- 172.21.15.47:0/2570395025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70c115980 con 0x7fb70c0fe2b0 2024-02-07T12:27:13.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.766+0000 7fb71281a700 1 -- 172.21.15.47:0/2570395025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70c04bed0 con 0x7fb70c0fe2b0 2024-02-07T12:27:13.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.767+0000 7fb708ff9700 1 -- 172.21.15.47:0/2570395025 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 26) v1 ==== 88829+0+0 (secure 0 0 0) 0x7fb70001ca00 con 0x7fb70c0fe2b0 2024-02-07T12:27:13.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.767+0000 7fb708ff9700 1 --2- 172.21.15.47:0/2570395025 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fb6f406b020 0x7fb6f406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:13.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.767+0000 7fb708ff9700 1 -- 172.21.15.47:0/2570395025 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb70008aa00 con 0x7fb70c0fe2b0 2024-02-07T12:27:13.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.767+0000 7fb70bfff700 1 --2- 172.21.15.47:0/2570395025 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fb6f406b020 0x7fb6f406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:13.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.768+0000 7fb70bfff700 1 --2- 172.21.15.47:0/2570395025 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fb6f406b020 0x7fb6f406d4d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0fdad0 tx=0x7fb6fc00b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:13.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:13.772+0000 7fb708ff9700 1 -- 172.21.15.47:0/2570395025 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb700058820 con 0x7fb70c0fe2b0 2024-02-07T12:27:14.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.021+0000 7fb71281a700 1 -- 172.21.15.47:0/2570395025 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb70c04bed0 con 0x7fb6f406b020 2024-02-07T12:27:14.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.031+0000 7fb708ff9700 1 -- 172.21.15.47:0/2570395025 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb70c04bed0 con 0x7fb6f406b020 2024-02-07T12:27:14.034 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:27:14.034 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 starting - - - - 2024-02-07T12:27:14.034 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (9m) 85s ago 9m 6660k - 17.2.7-491-gf2462625 4ad3622d1b31 bca7317ed169 2024-02-07T12:27:14.034 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (8m) 89s ago 8m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 110c84c6624b 2024-02-07T12:27:14.034 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 starting - - - - 2024-02-07T12:27:14.034 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (4m) 85s ago 4m 148M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:27:14.034 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (4m) 85s ago 4m 136M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:27:14.034 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (4m) 89s ago 4m 76.3M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:27:14.034 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (4m) 89s ago 4m 95.1M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:27:14.034 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:9283 running (11m) 85s ago 11m 348M - 17.2.7-491-gf2462625 4ad3622d1b31 f3b25479d84e 2024-02-07T12:27:14.035 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283 running (2m) 89s ago 8m 488M - 19.0.0-1252-g44458cce 79957b372307 fd928ea0fb8a 2024-02-07T12:27:14.035 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (11m) 85s ago 11m 46.9M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 105826d9ef9a 2024-02-07T12:27:14.035 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (8m) 89s ago 8m 40.3M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 02dfa0b8d573 2024-02-07T12:27:14.035 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 starting - - - - 2024-02-07T12:27:14.035 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (8m) 89s ago 8m 16.0M - 1.5.0 0da6a335fe13 8823dad6f717 2024-02-07T12:27:14.035 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (7m) 85s ago 7m 226M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 4f37918f583a 2024-02-07T12:27:14.035 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (7m) 85s ago 7m 243M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 1c6e3c603ed3 2024-02-07T12:27:14.035 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (7m) 85s ago 7m 190M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:27:14.035 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (6m) 89s ago 6m 283M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:27:14.035 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (6m) 89s ago 6m 226M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:27:14.035 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (5m) 89s ago 5m 280M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:27:14.035 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (8m) 85s ago 9m 57.3M - 2.43.0 a07b618ecd1d e41b94b0d167 2024-02-07T12:27:14.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.034+0000 7fb71281a700 1 -- 172.21.15.47:0/2570395025 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fb6f406b020 msgr2=0x7fb6f406d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:14.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.034+0000 7fb71281a700 1 --2- 172.21.15.47:0/2570395025 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fb6f406b020 0x7fb6f406d4d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0fdad0 tx=0x7fb6fc00b040 comp rx=0 tx=0).stop 2024-02-07T12:27:14.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.034+0000 7fb71281a700 1 -- 172.21.15.47:0/2570395025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb70c0fe2b0 msgr2=0x7fb70c0fc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:14.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.034+0000 7fb71281a700 1 --2- 172.21.15.47:0/2570395025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb70c0fe2b0 0x7fb70c0fc1c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb700009b30 tx=0x7fb700009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:14.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.034+0000 7fb71281a700 1 -- 172.21.15.47:0/2570395025 shutdown_connections 2024-02-07T12:27:14.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.034+0000 7fb71281a700 1 --2- 172.21.15.47:0/2570395025 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fb6f406b020 0x7fb6f406d4d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:14.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.034+0000 7fb71281a700 1 --2- 172.21.15.47:0/2570395025 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb70c0fb220 0x7fb70c0fdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:14.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.034+0000 7fb71281a700 1 --2- 172.21.15.47:0/2570395025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb70c0fe2b0 0x7fb70c0fc1c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:14.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.034+0000 7fb71281a700 1 -- 172.21.15.47:0/2570395025 >> 172.21.15.47:0/2570395025 conn(0x7fb70c0f6ca0 msgr2=0x7fb70c1014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:14.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.034+0000 7fb71281a700 1 -- 172.21.15.47:0/2570395025 shutdown_connections 2024-02-07T12:27:14.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.035+0000 7fb71281a700 1 -- 172.21.15.47:0/2570395025 wait complete. 2024-02-07T12:27:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.166+0000 7f53c11eb700 1 -- 172.21.15.47:0/4204362344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53bc0fe2b0 msgr2=0x7f53bc0fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.166+0000 7f53c11eb700 1 --2- 172.21.15.47:0/4204362344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53bc0fe2b0 0x7f53bc0fe700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53b0004880 tx=0x7f53b0009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.166+0000 7f53c11eb700 1 -- 172.21.15.47:0/4204362344 shutdown_connections 2024-02-07T12:27:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.166+0000 7f53c11eb700 1 --2- 172.21.15.47:0/4204362344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53bc0fe2b0 0x7f53bc0fe700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.166+0000 7f53c11eb700 1 --2- 172.21.15.47:0/4204362344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53bc0fb220 0x7f53bc0fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.166+0000 7f53c11eb700 1 -- 172.21.15.47:0/4204362344 >> 172.21.15.47:0/4204362344 conn(0x7f53bc0f6ca0 msgr2=0x7f53bc0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.167+0000 7f53c11eb700 1 -- 172.21.15.47:0/4204362344 shutdown_connections 2024-02-07T12:27:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.167+0000 7f53c11eb700 1 -- 172.21.15.47:0/4204362344 wait complete. 2024-02-07T12:27:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.167+0000 7f53c11eb700 1 Processor -- start 2024-02-07T12:27:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.167+0000 7f53c11eb700 1 -- start start 2024-02-07T12:27:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.167+0000 7f53c11eb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53bc0fb220 0x7f53bc10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.167+0000 7f53c11eb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53bc0fe2b0 0x7f53bc10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.167+0000 7f53c11eb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc10e5e0 con 0x7f53bc0fe2b0 2024-02-07T12:27:14.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.167+0000 7f53c11eb700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc10ee80 con 0x7f53bc0fb220 2024-02-07T12:27:14.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.168+0000 7f53ba59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53bc0fe2b0 0x7f53bc10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:14.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.168+0000 7f53ba59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53bc0fe2b0 0x7f53bc10dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59528/0 (socket says 172.21.15.47:59528) 2024-02-07T12:27:14.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.168+0000 7f53ba59c700 1 -- 172.21.15.47:0/1160422511 learned_addr learned my addr 172.21.15.47:0/1160422511 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:14.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.168+0000 7f53bad9d700 1 --2- 172.21.15.47:0/1160422511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53bc0fb220 0x7f53bc10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:14.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.168+0000 7f53ba59c700 1 -- 172.21.15.47:0/1160422511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53bc0fb220 msgr2=0x7f53bc10daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:14.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.168+0000 7f53ba59c700 1 --2- 172.21.15.47:0/1160422511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53bc0fb220 0x7f53bc10daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:14.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.168+0000 7f53ba59c700 1 -- 172.21.15.47:0/1160422511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b0005040 con 0x7f53bc0fe2b0 2024-02-07T12:27:14.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.168+0000 7f53ba59c700 1 --2- 172.21.15.47:0/1160422511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53bc0fe2b0 0x7f53bc10dfe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f53b00134d0 tx=0x7f53b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:14.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.168+0000 7f53a37fe700 1 -- 172.21.15.47:0/1160422511 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53b000e030 con 0x7f53bc0fe2b0 2024-02-07T12:27:14.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.168+0000 7f53c11eb700 1 -- 172.21.15.47:0/1160422511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53bc10f100 con 0x7f53bc0fe2b0 2024-02-07T12:27:14.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.168+0000 7f53a37fe700 1 -- 172.21.15.47:0/1160422511 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f53b0013e60 con 0x7f53bc0fe2b0 2024-02-07T12:27:14.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.168+0000 7f53a37fe700 1 -- 172.21.15.47:0/1160422511 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53b00123c0 con 0x7f53bc0fe2b0 2024-02-07T12:27:14.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.168+0000 7f53c11eb700 1 -- 172.21.15.47:0/1160422511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53bc10f640 con 0x7f53bc0fe2b0 2024-02-07T12:27:14.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.170+0000 7f53c11eb700 1 -- 172.21.15.47:0/1160422511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53bc107a80 con 0x7f53bc0fe2b0 2024-02-07T12:27:14.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.170+0000 7f53a37fe700 1 -- 172.21.15.47:0/1160422511 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 26) v1 ==== 88829+0+0 (secure 0 0 0) 0x7f53b001c890 con 0x7f53bc0fe2b0 2024-02-07T12:27:14.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.171+0000 7f53a37fe700 1 --2- 172.21.15.47:0/1160422511 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f53a406b020 0x7f53a406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:14.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.171+0000 7f53a37fe700 1 -- 172.21.15.47:0/1160422511 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f53b008b2b0 con 0x7f53bc0fe2b0 2024-02-07T12:27:14.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.171+0000 7f53bad9d700 1 --2- 172.21.15.47:0/1160422511 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f53a406b020 0x7f53a406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:14.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.171+0000 7f53bad9d700 1 --2- 172.21.15.47:0/1160422511 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f53a406b020 0x7f53a406d4d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0046c0 tx=0x7f53ac00b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:14.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.179+0000 7f53a37fe700 1 -- 172.21.15.47:0/1160422511 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f53b0059130 con 0x7f53bc0fe2b0 2024-02-07T12:27:14.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.566+0000 7f53c11eb700 1 -- 172.21.15.47:0/1160422511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f53bc105a40 con 0x7f53bc0fe2b0 2024-02-07T12:27:14.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.567+0000 7f53a37fe700 1 -- 172.21.15.47:0/1160422511 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f53b0058cc0 con 0x7f53bc0fe2b0 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 1, 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 1 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 6 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:27:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:27:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:27:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 13, 2024-02-07T12:27:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 1 2024-02-07T12:27:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:27:14.571 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:27:14.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.570+0000 7f53c11eb700 1 -- 172.21.15.47:0/1160422511 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f53a406b020 msgr2=0x7f53a406d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:14.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.570+0000 7f53c11eb700 1 --2- 172.21.15.47:0/1160422511 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f53a406b020 0x7f53a406d4d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0046c0 tx=0x7f53ac00b040 comp rx=0 tx=0).stop 2024-02-07T12:27:14.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.570+0000 7f53c11eb700 1 -- 172.21.15.47:0/1160422511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53bc0fe2b0 msgr2=0x7f53bc10dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:14.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.570+0000 7f53c11eb700 1 --2- 172.21.15.47:0/1160422511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53bc0fe2b0 0x7f53bc10dfe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f53b00134d0 tx=0x7f53b0009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:14.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.570+0000 7f53c11eb700 1 -- 172.21.15.47:0/1160422511 shutdown_connections 2024-02-07T12:27:14.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.570+0000 7f53c11eb700 1 --2- 172.21.15.47:0/1160422511 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f53a406b020 0x7f53a406d4d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:14.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.570+0000 7f53c11eb700 1 --2- 172.21.15.47:0/1160422511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53bc0fb220 0x7f53bc10daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:14.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.570+0000 7f53c11eb700 1 --2- 172.21.15.47:0/1160422511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53bc0fe2b0 0x7f53bc10dfe0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:14.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.570+0000 7f53c11eb700 1 -- 172.21.15.47:0/1160422511 >> 172.21.15.47:0/1160422511 conn(0x7f53bc0f6ca0 msgr2=0x7f53bc0f8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:14.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.570+0000 7f53c11eb700 1 -- 172.21.15.47:0/1160422511 shutdown_connections 2024-02-07T12:27:14.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.570+0000 7f53c11eb700 1 -- 172.21.15.47:0/1160422511 wait complete. 2024-02-07T12:27:14.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.677+0000 7f11bcc34700 1 -- 172.21.15.47:0/3215775681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11b80fda80 msgr2=0x7f11b80ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:14.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.677+0000 7f11bcc34700 1 --2- 172.21.15.47:0/3215775681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11b80fda80 0x7f11b80ffe60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f11a8004940 tx=0x7f11a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:14.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.677+0000 7f11bcc34700 1 -- 172.21.15.47:0/3215775681 shutdown_connections 2024-02-07T12:27:14.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.677+0000 7f11bcc34700 1 --2- 172.21.15.47:0/3215775681 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11b81003a0 0x7f11b8102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:14.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.677+0000 7f11bcc34700 1 --2- 172.21.15.47:0/3215775681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11b80fda80 0x7f11b80ffe60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:14.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.677+0000 7f11bcc34700 1 -- 172.21.15.47:0/3215775681 >> 172.21.15.47:0/3215775681 conn(0x7f11b80f74e0 msgr2=0x7f11b80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:14.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.677+0000 7f11bcc34700 1 -- 172.21.15.47:0/3215775681 shutdown_connections 2024-02-07T12:27:14.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.677+0000 7f11bcc34700 1 -- 172.21.15.47:0/3215775681 wait complete. 2024-02-07T12:27:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.677+0000 7f11bcc34700 1 Processor -- start 2024-02-07T12:27:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.678+0000 7f11bcc34700 1 -- start start 2024-02-07T12:27:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.678+0000 7f11bcc34700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11b80fda80 0x7f11b80fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.678+0000 7f11bcc34700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11b81003a0 0x7f11b80fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.678+0000 7f11bcc34700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80fbf90 con 0x7f11b80fda80 2024-02-07T12:27:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.678+0000 7f11bcc34700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80fc100 con 0x7f11b81003a0 2024-02-07T12:27:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.678+0000 7f11b659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11b80fda80 0x7f11b80fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.678+0000 7f11b659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11b80fda80 0x7f11b80fd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59532/0 (socket says 172.21.15.47:59532) 2024-02-07T12:27:14.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.678+0000 7f11b659c700 1 -- 172.21.15.47:0/2228544178 learned_addr learned my addr 172.21.15.47:0/2228544178 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:14.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.678+0000 7f11b5d9b700 1 --2- 172.21.15.47:0/2228544178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11b81003a0 0x7f11b80fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:14.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.678+0000 7f11b659c700 1 -- 172.21.15.47:0/2228544178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11b81003a0 msgr2=0x7f11b80fb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:14.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.678+0000 7f11b659c700 1 --2- 172.21.15.47:0/2228544178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11b81003a0 0x7f11b80fb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:14.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.678+0000 7f11b659c700 1 -- 172.21.15.47:0/2228544178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a8005040 con 0x7f11b80fda80 2024-02-07T12:27:14.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.678+0000 7f11b659c700 1 --2- 172.21.15.47:0/2228544178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11b80fda80 0x7f11b80fd510 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009fd0 tx=0x7f11a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:14.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.679+0000 7f11a6ffd700 1 -- 172.21.15.47:0/2228544178 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11a800e040 con 0x7f11b80fda80 2024-02-07T12:27:14.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.679+0000 7f11a6ffd700 1 -- 172.21.15.47:0/2228544178 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11a800bcc0 con 0x7f11b80fda80 2024-02-07T12:27:14.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.679+0000 7f11a6ffd700 1 -- 172.21.15.47:0/2228544178 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11a801c630 con 0x7f11b80fda80 2024-02-07T12:27:14.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.679+0000 7f11bcc34700 1 -- 172.21.15.47:0/2228544178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b80fc380 con 0x7f11b80fda80 2024-02-07T12:27:14.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.679+0000 7f11bcc34700 1 -- 172.21.15.47:0/2228544178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b8115980 con 0x7f11b80fda80 2024-02-07T12:27:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.680+0000 7f11bcc34700 1 -- 172.21.15.47:0/2228544178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b804bed0 con 0x7f11b80fda80 2024-02-07T12:27:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.681+0000 7f11a6ffd700 1 -- 172.21.15.47:0/2228544178 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 26) v1 ==== 88829+0+0 (secure 0 0 0) 0x7f11a8013420 con 0x7f11b80fda80 2024-02-07T12:27:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.681+0000 7f11a6ffd700 1 --2- 172.21.15.47:0/2228544178 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f11a006b030 0x7f11a006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:14.684 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:14 smithi047 ceph-mon[28972]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:14.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.681+0000 7f11a6ffd700 1 -- 172.21.15.47:0/2228544178 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f11a808ac80 con 0x7f11b80fda80 2024-02-07T12:27:14.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.681+0000 7f11b5d9b700 1 --2- 172.21.15.47:0/2228544178 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f11a006b030 0x7f11a006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:14.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.682+0000 7f11b5d9b700 1 --2- 172.21.15.47:0/2228544178 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f11a006b030 0x7f11a006d4e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f11ac004f60 tx=0x7f11ac00b040 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:14.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:14.686+0000 7f11a6ffd700 1 -- 172.21.15.47:0/2228544178 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f11a8058aa0 con 0x7f11b80fda80 2024-02-07T12:27:14.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:14 smithi138 ceph-mon[35528]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:15.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.010+0000 7f11bcc34700 1 -- 172.21.15.47:0/2228544178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f11b8105a30 con 0x7f11b80fda80 2024-02-07T12:27:15.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.010+0000 7f11a6ffd700 1 -- 172.21.15.47:0/2228544178 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1868 (secure 0 0 0) 0x7f11a8058630 con 0x7f11b80fda80 2024-02-07T12:27:15.013 INFO:teuthology.orchestra.run.smithi047.stdout:e20 2024-02-07T12:27:15.013 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:27:15.013 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:27:15.013 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:27:15.013 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:27:15.013 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:27:15.013 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:27:15.013 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 20 2024-02-07T12:27:15.013 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:27:15.013 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:27:15.014 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:26:24.336188+0000 2024-02-07T12:27:15.014 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:27:15.014 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:27:15.014 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:27:15.014 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:27:15.014 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:27:15.014 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:27:15.014 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:27:15.014 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:27:15.014 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:27:15.014 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:27:15.014 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:27:15.014 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:27:15.015 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:27:15.015 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:27:15.015 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:27:15.015 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:27:15.015 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:27:15.015 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:27:15.015 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:27:15.015 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:27:15.015 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 export targets 1 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:27:15.015 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:27:15.015 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:27:15.015 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:27:15.016 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:27:15.016 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:27:15.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.012+0000 7f11bcc34700 1 -- 172.21.15.47:0/2228544178 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f11a006b030 msgr2=0x7f11a006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:15.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.012+0000 7f11bcc34700 1 --2- 172.21.15.47:0/2228544178 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f11a006b030 0x7f11a006d4e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f11ac004f60 tx=0x7f11ac00b040 comp rx=0 tx=0).stop 2024-02-07T12:27:15.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.012+0000 7f11bcc34700 1 -- 172.21.15.47:0/2228544178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11b80fda80 msgr2=0x7f11b80fd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:15.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.012+0000 7f11bcc34700 1 --2- 172.21.15.47:0/2228544178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11b80fda80 0x7f11b80fd510 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009fd0 tx=0x7f11a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:15.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.012+0000 7f11bcc34700 1 -- 172.21.15.47:0/2228544178 shutdown_connections 2024-02-07T12:27:15.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.012+0000 7f11bcc34700 1 --2- 172.21.15.47:0/2228544178 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f11a006b030 0x7f11a006d4e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.012+0000 7f11bcc34700 1 --2- 172.21.15.47:0/2228544178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11b80fda80 0x7f11b80fd510 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.012+0000 7f11bcc34700 1 --2- 172.21.15.47:0/2228544178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11b81003a0 0x7f11b80fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.012+0000 7f11bcc34700 1 -- 172.21.15.47:0/2228544178 >> 172.21.15.47:0/2228544178 conn(0x7f11b80f74e0 msgr2=0x7f11b80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:15.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.012+0000 7f11bcc34700 1 -- 172.21.15.47:0/2228544178 shutdown_connections 2024-02-07T12:27:15.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.012+0000 7f11bcc34700 1 -- 172.21.15.47:0/2228544178 wait complete. 2024-02-07T12:27:15.017 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-02-07T12:27:15.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.141+0000 7fa4556fc700 1 -- 172.21.15.47:0/929837086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4500fbe40 msgr2=0x7fa4500fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:15.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.141+0000 7fa4556fc700 1 --2- 172.21.15.47:0/929837086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4500fbe40 0x7fa4500fc250 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa440004940 tx=0x7fa440009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:15.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.141+0000 7fa4556fc700 1 -- 172.21.15.47:0/929837086 shutdown_connections 2024-02-07T12:27:15.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.141+0000 7fa4556fc700 1 --2- 172.21.15.47:0/929837086 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4500fcfb0 0x7fa4500fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.141+0000 7fa4556fc700 1 --2- 172.21.15.47:0/929837086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4500fbe40 0x7fa4500fc250 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.141+0000 7fa4556fc700 1 -- 172.21.15.47:0/929837086 >> 172.21.15.47:0/929837086 conn(0x7fa4500f74e0 msgr2=0x7fa4500f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:15.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.141+0000 7fa4556fc700 1 -- 172.21.15.47:0/929837086 shutdown_connections 2024-02-07T12:27:15.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.142+0000 7fa4556fc700 1 -- 172.21.15.47:0/929837086 wait complete. 2024-02-07T12:27:15.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.142+0000 7fa4556fc700 1 Processor -- start 2024-02-07T12:27:15.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.142+0000 7fa4556fc700 1 -- start start 2024-02-07T12:27:15.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.142+0000 7fa4556fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4500fbe40 0x7fa45010d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:15.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.142+0000 7fa4556fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4500fcfb0 0x7fa45010de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:15.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.142+0000 7fa4556fc700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45010e500 con 0x7fa4500fbe40 2024-02-07T12:27:15.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.142+0000 7fa4556fc700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45010ed40 con 0x7fa4500fcfb0 2024-02-07T12:27:15.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.142+0000 7fa44effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4500fbe40 0x7fa45010d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:15.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.143+0000 7fa44effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4500fbe40 0x7fa45010d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59544/0 (socket says 172.21.15.47:59544) 2024-02-07T12:27:15.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.143+0000 7fa44effd700 1 -- 172.21.15.47:0/3006192789 learned_addr learned my addr 172.21.15.47:0/3006192789 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.143+0000 7fa44e7fc700 1 --2- 172.21.15.47:0/3006192789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4500fcfb0 0x7fa45010de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.143+0000 7fa44effd700 1 -- 172.21.15.47:0/3006192789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4500fcfb0 msgr2=0x7fa45010de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.143+0000 7fa44effd700 1 --2- 172.21.15.47:0/3006192789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4500fcfb0 0x7fa45010de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.143+0000 7fa44effd700 1 -- 172.21.15.47:0/3006192789 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa440005040 con 0x7fa4500fbe40 2024-02-07T12:27:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.143+0000 7fa44effd700 1 --2- 172.21.15.47:0/3006192789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4500fbe40 0x7fa45010d930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa440009360 tx=0x7fa440009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.143+0000 7fa4377fe700 1 -- 172.21.15.47:0/3006192789 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa44000e040 con 0x7fa4500fbe40 2024-02-07T12:27:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.143+0000 7fa4556fc700 1 -- 172.21.15.47:0/3006192789 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45010efc0 con 0x7fa4500fbe40 2024-02-07T12:27:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.143+0000 7fa4377fe700 1 -- 172.21.15.47:0/3006192789 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa440004290 con 0x7fa4500fbe40 2024-02-07T12:27:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.143+0000 7fa4377fe700 1 -- 172.21.15.47:0/3006192789 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa44001c630 con 0x7fa4500fbe40 2024-02-07T12:27:15.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.143+0000 7fa4556fc700 1 -- 172.21.15.47:0/3006192789 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45010f500 con 0x7fa4500fbe40 2024-02-07T12:27:15.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.144+0000 7fa4556fc700 1 -- 172.21.15.47:0/3006192789 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45004bed0 con 0x7fa4500fbe40 2024-02-07T12:27:15.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.145+0000 7fa4377fe700 1 -- 172.21.15.47:0/3006192789 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 26) v1 ==== 88829+0+0 (secure 0 0 0) 0x7fa4400139f0 con 0x7fa4500fbe40 2024-02-07T12:27:15.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.146+0000 7fa4377fe700 1 --2- 172.21.15.47:0/3006192789 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fa43806b030 0x7fa43806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:15.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.146+0000 7fa4377fe700 1 -- 172.21.15.47:0/3006192789 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa44008ad20 con 0x7fa4500fbe40 2024-02-07T12:27:15.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.146+0000 7fa44e7fc700 1 --2- 172.21.15.47:0/3006192789 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fa43806b030 0x7fa43806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:15.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.147+0000 7fa44e7fc700 1 --2- 172.21.15.47:0/3006192789 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fa43806b030 0x7fa43806d4e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa444009bf0 tx=0x7fa4440091a0 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:15.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.154+0000 7fa4377fe700 1 -- 172.21.15.47:0/3006192789 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa440058a80 con 0x7fa4500fbe40 2024-02-07T12:27:15.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.462+0000 7fa4556fc700 1 -- 172.21.15.47:0/3006192789 --> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa450065dd0 con 0x7fa43806b030 2024-02-07T12:27:15.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.464+0000 7fa4377fe700 1 -- 172.21.15.47:0/3006192789 <== mgr.24375 v2:172.21.15.138:6828/764872550 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa450065dd0 con 0x7fa43806b030 2024-02-07T12:27:15.467 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:27:15.467 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:27:15.467 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:27:15.467 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:27:15.467 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [], 2024-02-07T12:27:15.467 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "1/21 daemons upgraded", 2024-02-07T12:27:15.467 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "", 2024-02-07T12:27:15.467 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:27:15.467 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:27:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.467+0000 7fa4556fc700 1 -- 172.21.15.47:0/3006192789 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fa43806b030 msgr2=0x7fa43806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.467+0000 7fa4556fc700 1 --2- 172.21.15.47:0/3006192789 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fa43806b030 0x7fa43806d4e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa444009bf0 tx=0x7fa4440091a0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.468+0000 7fa4556fc700 1 -- 172.21.15.47:0/3006192789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4500fbe40 msgr2=0x7fa45010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.468+0000 7fa4556fc700 1 --2- 172.21.15.47:0/3006192789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4500fbe40 0x7fa45010d930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa440009360 tx=0x7fa440009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.468+0000 7fa4556fc700 1 -- 172.21.15.47:0/3006192789 shutdown_connections 2024-02-07T12:27:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.468+0000 7fa4556fc700 1 --2- 172.21.15.47:0/3006192789 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7fa43806b030 0x7fa43806d4e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.468+0000 7fa4556fc700 1 --2- 172.21.15.47:0/3006192789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4500fbe40 0x7fa45010d930 secure :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa440009360 tx=0x7fa440009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.468+0000 7fa4556fc700 1 --2- 172.21.15.47:0/3006192789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4500fcfb0 0x7fa45010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.468+0000 7fa4556fc700 1 -- 172.21.15.47:0/3006192789 >> 172.21.15.47:0/3006192789 conn(0x7fa4500f74e0 msgr2=0x7fa4500656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.468+0000 7fa4556fc700 1 -- 172.21.15.47:0/3006192789 shutdown_connections 2024-02-07T12:27:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.468+0000 7fa4556fc700 1 -- 172.21.15.47:0/3006192789 wait complete. 2024-02-07T12:27:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.626+0000 7f5d7e693700 1 -- 172.21.15.47:0/4086645457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d78102430 msgr2=0x7f5d78104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.626+0000 7f5d7e693700 1 --2- 172.21.15.47:0/4086645457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d78102430 0x7f5d78104810 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c004940 tx=0x7f5d6c009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.626+0000 7f5d7e693700 1 -- 172.21.15.47:0/4086645457 shutdown_connections 2024-02-07T12:27:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.626+0000 7f5d7e693700 1 --2- 172.21.15.47:0/4086645457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d78102430 0x7f5d78104810 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.626+0000 7f5d7e693700 1 --2- 172.21.15.47:0/4086645457 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d78066c70 0x7f5d78101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.626+0000 7f5d7e693700 1 -- 172.21.15.47:0/4086645457 >> 172.21.15.47:0/4086645457 conn(0x7f5d780f7520 msgr2=0x7f5d780f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.627+0000 7f5d7e693700 1 -- 172.21.15.47:0/4086645457 shutdown_connections 2024-02-07T12:27:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.627+0000 7f5d7e693700 1 -- 172.21.15.47:0/4086645457 wait complete. 2024-02-07T12:27:15.630 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:15 smithi047 ceph-mon[28972]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:15.630 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:15 smithi047 ceph-mon[28972]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:15.630 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:15 smithi047 ceph-mon[28972]: pgmap v54: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 469 op/s 2024-02-07T12:27:15.630 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:15 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/1160422511' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:27:15.630 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:15 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2228544178' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:27:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.627+0000 7f5d7e693700 1 Processor -- start 2024-02-07T12:27:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.627+0000 7f5d7e693700 1 -- start start 2024-02-07T12:27:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.628+0000 7f5d7e693700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d78066c70 0x7f5d7810fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.628+0000 7f5d7e693700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d78102430 0x7f5d781100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.628+0000 7f5d7e693700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d781106b0 con 0x7f5d78066c70 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.628+0000 7f5d7e693700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d78110f50 con 0x7f5d78102430 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.628+0000 7f5d77fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d78066c70 0x7f5d7810fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.628+0000 7f5d77fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d78066c70 0x7f5d7810fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59554/0 (socket says 172.21.15.47:59554) 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.628+0000 7f5d77fff700 1 -- 172.21.15.47:0/3865311549 learned_addr learned my addr 172.21.15.47:0/3865311549 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.628+0000 7f5d777fe700 1 --2- 172.21.15.47:0/3865311549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d78102430 0x7f5d781100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.628+0000 7f5d77fff700 1 -- 172.21.15.47:0/3865311549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d78102430 msgr2=0x7f5d781100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.628+0000 7f5d77fff700 1 --2- 172.21.15.47:0/3865311549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d78102430 0x7f5d781100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.628+0000 7f5d77fff700 1 -- 172.21.15.47:0/3865311549 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c005040 con 0x7f5d78066c70 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.628+0000 7f5d77fff700 1 --2- 172.21.15.47:0/3865311549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d78066c70 0x7f5d7810fb70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5d68002a50 tx=0x7f5d680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.629+0000 7f5d74ff9700 1 -- 172.21.15.47:0/3865311549 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d68007cc0 con 0x7f5d78066c70 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.629+0000 7f5d7e693700 1 -- 172.21.15.47:0/3865311549 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d78111230 con 0x7f5d78066c70 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.629+0000 7f5d74ff9700 1 -- 172.21.15.47:0/3865311549 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d6800f040 con 0x7f5d78066c70 2024-02-07T12:27:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.629+0000 7f5d7e693700 1 -- 172.21.15.47:0/3865311549 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d78111770 con 0x7f5d78066c70 2024-02-07T12:27:15.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.629+0000 7f5d74ff9700 1 -- 172.21.15.47:0/3865311549 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d6800da30 con 0x7f5d78066c70 2024-02-07T12:27:15.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.630+0000 7f5d7e693700 1 -- 172.21.15.47:0/3865311549 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7804bed0 con 0x7f5d78066c70 2024-02-07T12:27:15.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.630+0000 7f5d74ff9700 1 -- 172.21.15.47:0/3865311549 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 26) v1 ==== 88829+0+0 (secure 0 0 0) 0x7f5d6800dc70 con 0x7f5d78066c70 2024-02-07T12:27:15.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.631+0000 7f5d74ff9700 1 --2- 172.21.15.47:0/3865311549 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f5d6006b020 0x7f5d6006d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:15.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.631+0000 7f5d74ff9700 1 -- 172.21.15.47:0/3865311549 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5d68089720 con 0x7f5d78066c70 2024-02-07T12:27:15.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.631+0000 7f5d777fe700 1 --2- 172.21.15.47:0/3865311549 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f5d6006b020 0x7f5d6006d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:15.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.632+0000 7f5d777fe700 1 --2- 172.21.15.47:0/3865311549 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f5d6006b020 0x7f5d6006d4d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c004890 tx=0x7f5d6c009e30 comp rx=0 tx=0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:15.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.638+0000 7f5d74ff9700 1 -- 172.21.15.47:0/3865311549 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5d68057400 con 0x7f5d78066c70 2024-02-07T12:27:15.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:15 smithi138 ceph-mon[35528]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:15.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:15 smithi138 ceph-mon[35528]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:15.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:15 smithi138 ceph-mon[35528]: pgmap v54: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 469 op/s 2024-02-07T12:27:15.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:15 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/1160422511' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:27:15.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:15 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2228544178' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:27:15.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.977+0000 7f5d7e693700 1 -- 172.21.15.47:0/3865311549 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5d78107c10 con 0x7f5d78066c70 2024-02-07T12:27:15.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.977+0000 7f5d74ff9700 1 -- 172.21.15.47:0/3865311549 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5d68056f90 con 0x7f5d78066c70 2024-02-07T12:27:15.980 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:27:15.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.980+0000 7f5d7e693700 1 -- 172.21.15.47:0/3865311549 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f5d6006b020 msgr2=0x7f5d6006d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:15.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.980+0000 7f5d7e693700 1 --2- 172.21.15.47:0/3865311549 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f5d6006b020 0x7f5d6006d4d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c004890 tx=0x7f5d6c009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:15.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.980+0000 7f5d7e693700 1 -- 172.21.15.47:0/3865311549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d78066c70 msgr2=0x7f5d7810fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:15.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.980+0000 7f5d7e693700 1 --2- 172.21.15.47:0/3865311549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d78066c70 0x7f5d7810fb70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5d68002a50 tx=0x7f5d680046b0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.980+0000 7f5d7e693700 1 -- 172.21.15.47:0/3865311549 shutdown_connections 2024-02-07T12:27:15.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.980+0000 7f5d7e693700 1 --2- 172.21.15.47:0/3865311549 >> [v2:172.21.15.138:6828/764872550,v1:172.21.15.138:6829/764872550] conn(0x7f5d6006b020 0x7f5d6006d4d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.980+0000 7f5d7e693700 1 --2- 172.21.15.47:0/3865311549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d78066c70 0x7f5d7810fb70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.980+0000 7f5d7e693700 1 --2- 172.21.15.47:0/3865311549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d78102430 0x7f5d781100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:15.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.980+0000 7f5d7e693700 1 -- 172.21.15.47:0/3865311549 >> 172.21.15.47:0/3865311549 conn(0x7f5d780f7520 msgr2=0x7f5d780f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:15.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.980+0000 7f5d7e693700 1 -- 172.21.15.47:0/3865311549 shutdown_connections 2024-02-07T12:27:15.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:15.980+0000 7f5d7e693700 1 -- 172.21.15.47:0/3865311549 wait complete. 2024-02-07T12:27:16.722 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:16 smithi047 ceph-mon[28972]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:16.722 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:16 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3865311549' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:27:16.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:16 smithi138 ceph-mon[35528]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:16.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:16 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3865311549' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:27:17.773 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:17 smithi047 ceph-mon[28972]: pgmap v55: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 311 op/s 2024-02-07T12:27:17.774 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:17 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:27:17.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:17 smithi138 ceph-mon[35528]: pgmap v55: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 311 op/s 2024-02-07T12:27:17.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:17 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:27:19.670 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:19 smithi138 ceph-mon[35528]: pgmap v56: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 437 op/s 2024-02-07T12:27:19.670 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:19 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:19.670 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:19 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:19.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:19 smithi047 ceph-mon[28972]: pgmap v56: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 437 op/s 2024-02-07T12:27:19.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:19 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:19.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:19 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:20.633 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:20 smithi138 ceph-mon[35528]: Reconfiguring node-exporter.smithi138 (dependencies changed)... 2024-02-07T12:27:20.633 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:20 smithi138 ceph-mon[35528]: Reconfiguring daemon node-exporter.smithi138 on smithi138 2024-02-07T12:27:20.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:20 smithi047 ceph-mon[28972]: Reconfiguring node-exporter.smithi138 (dependencies changed)... 2024-02-07T12:27:20.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:20 smithi047 ceph-mon[28972]: Reconfiguring daemon node-exporter.smithi138 on smithi138 2024-02-07T12:27:21.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:21 smithi138 ceph-mon[35528]: pgmap v57: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 312 op/s 2024-02-07T12:27:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:21 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:21 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:21 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-07T12:27:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:21 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-07T12:27:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:21 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:27:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:21 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:27:21.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:21 smithi047 ceph-mon[28972]: pgmap v57: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 312 op/s 2024-02-07T12:27:21.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:21 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:21.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:21 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:21.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:21 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-07T12:27:21.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:21 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-07T12:27:21.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:21 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:27:21.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:21 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:27:22.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:22 smithi138 ceph-mon[35528]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-07T12:27:22.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:22 smithi138 ceph-mon[35528]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-07T12:27:22.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:22 smithi138 ceph-mon[35528]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:27:22.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:22 smithi138 ceph-mon[35528]: Upgrade: Need to upgrade myself (mgr.smithi138.fiugmj) 2024-02-07T12:27:22.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:22 smithi138 ceph-mon[35528]: Upgrade: Need to upgrade myself (mgr.smithi138.fiugmj) 2024-02-07T12:27:22.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:22 smithi047 ceph-mon[28972]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-07T12:27:22.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:22 smithi047 ceph-mon[28972]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-07T12:27:22.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:22 smithi047 ceph-mon[28972]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:27:22.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:22 smithi047 ceph-mon[28972]: Upgrade: Need to upgrade myself (mgr.smithi138.fiugmj) 2024-02-07T12:27:22.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:22 smithi047 ceph-mon[28972]: Upgrade: Need to upgrade myself (mgr.smithi138.fiugmj) 2024-02-07T12:27:23.642 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-07T12:27:23.642 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-07T12:27:23.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:23 smithi138 ceph-mon[35528]: pgmap v58: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 262 op/s 2024-02-07T12:27:23.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:23 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:23.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:23 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.zhgnrm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:27:23.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:23 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.zhgnrm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:27:23.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:23 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:27:23.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:23 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:27:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:23 smithi047 ceph-mon[28972]: pgmap v58: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 262 op/s 2024-02-07T12:27:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:23 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:23 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.zhgnrm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:27:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:23 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.zhgnrm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:27:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:23 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:27:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:23 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:27:23.980 DEBUG:teuthology.parallel:result is None 2024-02-07T12:27:23.981 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-07T12:27:24.012 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-07T12:27:24.012 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-07T12:27:24.046 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-07T12:27:24.046 DEBUG:teuthology.parallel:result is None 2024-02-07T12:27:24.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:24 smithi138 ceph-mon[35528]: Upgrade: Updating mgr.smithi047.zhgnrm 2024-02-07T12:27:24.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:24 smithi138 ceph-mon[35528]: Deploying daemon mgr.smithi047.zhgnrm on smithi047 2024-02-07T12:27:24.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:24 smithi047 ceph-mon[28972]: Upgrade: Updating mgr.smithi047.zhgnrm 2024-02-07T12:27:24.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:24 smithi047 ceph-mon[28972]: Deploying daemon mgr.smithi047.zhgnrm on smithi047 2024-02-07T12:27:25.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:25 smithi047 ceph-mon[28972]: pgmap v59: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 434 op/s 2024-02-07T12:27:25.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:25 smithi138 ceph-mon[35528]: pgmap v59: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 434 op/s 2024-02-07T12:27:27.741 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:27 smithi047 ceph-mon[28972]: pgmap v60: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 318 op/s 2024-02-07T12:27:27.741 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:27 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:27.741 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:27 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:27.741 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:27 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:27:27.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:27 smithi138 ceph-mon[35528]: pgmap v60: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 318 op/s 2024-02-07T12:27:27.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:27 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:27.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:27 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:27 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:27:29.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:28 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:29.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:28 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:29.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:28 smithi047 ceph-mon[28972]: pgmap v61: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 335 op/s 2024-02-07T12:27:29.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:28 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:29.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:28 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:29.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:28 smithi138 ceph-mon[35528]: pgmap v61: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 335 op/s 2024-02-07T12:27:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:31 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:31 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:31 smithi047 ceph-mon[28972]: pgmap v62: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 722 KiB/s rd, 727 KiB/s wr, 214 op/s 2024-02-07T12:27:31.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:31 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:31.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:31 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:31.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:31 smithi138 ceph-mon[35528]: pgmap v62: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 722 KiB/s rd, 727 KiB/s wr, 214 op/s 2024-02-07T12:27:33.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:33 smithi138 ceph-mon[35528]: pgmap v63: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 722 KiB/s rd, 727 KiB/s wr, 192 op/s 2024-02-07T12:27:33.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:33 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:27:33.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:33 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:33.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:33 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:33.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:33 smithi047 ceph-mon[28972]: pgmap v63: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 722 KiB/s rd, 727 KiB/s wr, 192 op/s 2024-02-07T12:27:33.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:33 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:27:33.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:33 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:33.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:33 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:35 smithi138 ceph-mon[35528]: pgmap v64: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 732 KiB/s rd, 730 KiB/s wr, 197 op/s 2024-02-07T12:27:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:35 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:35 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:35 smithi138 ceph-mon[35528]: Standby manager daemon smithi047.zhgnrm restarted 2024-02-07T12:27:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:35 smithi138 ceph-mon[35528]: Standby manager daemon smithi047.zhgnrm started 2024-02-07T12:27:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:35 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.zhgnrm/crt"}]: dispatch 2024-02-07T12:27:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:35 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:27:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:35 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.zhgnrm/key"}]: dispatch 2024-02-07T12:27:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:35 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:27:35.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:35 smithi047 ceph-mon[28972]: pgmap v64: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 732 KiB/s rd, 730 KiB/s wr, 197 op/s 2024-02-07T12:27:35.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:35 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:35.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:35 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:35.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:35 smithi047 ceph-mon[28972]: Standby manager daemon smithi047.zhgnrm restarted 2024-02-07T12:27:35.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:35 smithi047 ceph-mon[28972]: Standby manager daemon smithi047.zhgnrm started 2024-02-07T12:27:35.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:35 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.zhgnrm/crt"}]: dispatch 2024-02-07T12:27:35.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:35 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:27:35.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:35 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.zhgnrm/key"}]: dispatch 2024-02-07T12:27:35.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:35 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:27:36.737 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:36 smithi047 ceph-mon[28972]: mgrmap e27: smithi138.fiugmj(active, since 2m), standbys: smithi047.zhgnrm 2024-02-07T12:27:36.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:36 smithi138 ceph-mon[35528]: mgrmap e27: smithi138.fiugmj(active, since 2m), standbys: smithi047.zhgnrm 2024-02-07T12:27:37.612 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:37 smithi047 ceph-mon[28972]: pgmap v65: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 198 KiB/s rd, 57 KiB/s wr, 26 op/s 2024-02-07T12:27:37.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:37 smithi138 ceph-mon[35528]: pgmap v65: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 198 KiB/s rd, 57 KiB/s wr, 26 op/s 2024-02-07T12:27:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: pgmap v66: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 201 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-02-07T12:27:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:27:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:27:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:27:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mgr fail", "who": "smithi138.fiugmj"}]: dispatch 2024-02-07T12:27:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mgr fail", "who": "smithi138.fiugmj"}]: dispatch 2024-02-07T12:27:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: osdmap e49: 6 total, 6 up, 6 in 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd='[{"prefix": "mgr fail", "who": "smithi138.fiugmj"}]': finished 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: mgrmap e28: smithi047.zhgnrm(active, starting, since 0.00538129s) 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi047.zhgnrm", "id": "smithi047.zhgnrm"}]: dispatch 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:27:39.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-07T12:27:39.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-07T12:27:39.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-07T12:27:39.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: Manager daemon smithi047.zhgnrm is now available 2024-02-07T12:27:39.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:27:39.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:27:39.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:27:39.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/mirror_snapshot_schedule"}]: dispatch 2024-02-07T12:27:39.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:39 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/trash_purge_schedule"}]: dispatch 2024-02-07T12:27:39.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: pgmap v66: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 201 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-02-07T12:27:39.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:39.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:39.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:27:39.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:27:39.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' 2024-02-07T12:27:39.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:27:39.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.24375 172.21.15.138:0/2675807882' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mgr fail", "who": "smithi138.fiugmj"}]: dispatch 2024-02-07T12:27:39.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "mgr fail", "who": "smithi138.fiugmj"}]: dispatch 2024-02-07T12:27:39.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: osdmap e49: 6 total, 6 up, 6 in 2024-02-07T12:27:39.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.24375 ' entity='mgr.smithi138.fiugmj' cmd='[{"prefix": "mgr fail", "who": "smithi138.fiugmj"}]': finished 2024-02-07T12:27:39.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: mgrmap e28: smithi047.zhgnrm(active, starting, since 0.00538129s) 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi047.zhgnrm", "id": "smithi047.zhgnrm"}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-07T12:27:39.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-07T12:27:39.828 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: Manager daemon smithi047.zhgnrm is now available 2024-02-07T12:27:39.828 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:27:39.828 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:27:39.828 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:27:39.828 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/mirror_snapshot_schedule"}]: dispatch 2024-02-07T12:27:39.828 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:39 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/trash_purge_schedule"}]: dispatch 2024-02-07T12:27:41.008 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:40 smithi138 ceph-mon[35528]: [07/Feb/2024:12:27:39] ENGINE Bus STARTING 2024-02-07T12:27:41.009 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:40 smithi138 ceph-mon[35528]: [07/Feb/2024:12:27:39] ENGINE Serving on https://172.21.15.47:7150 2024-02-07T12:27:41.009 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:40 smithi138 ceph-mon[35528]: [07/Feb/2024:12:27:39] ENGINE Serving on http://172.21.15.47:8765 2024-02-07T12:27:41.009 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:40 smithi138 ceph-mon[35528]: [07/Feb/2024:12:27:39] ENGINE Bus STARTED 2024-02-07T12:27:41.009 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:40 smithi138 ceph-mon[35528]: mgrmap e29: smithi047.zhgnrm(active, since 1.00756s) 2024-02-07T12:27:41.009 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:40 smithi138 ceph-mon[35528]: pgmap v3: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:27:41.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:40 smithi047 ceph-mon[28972]: [07/Feb/2024:12:27:39] ENGINE Bus STARTING 2024-02-07T12:27:41.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:40 smithi047 ceph-mon[28972]: [07/Feb/2024:12:27:39] ENGINE Serving on https://172.21.15.47:7150 2024-02-07T12:27:41.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:40 smithi047 ceph-mon[28972]: [07/Feb/2024:12:27:39] ENGINE Serving on http://172.21.15.47:8765 2024-02-07T12:27:41.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:40 smithi047 ceph-mon[28972]: [07/Feb/2024:12:27:39] ENGINE Bus STARTED 2024-02-07T12:27:41.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:40 smithi047 ceph-mon[28972]: mgrmap e29: smithi047.zhgnrm(active, since 1.00756s) 2024-02-07T12:27:41.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:40 smithi047 ceph-mon[28972]: pgmap v3: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:27:42.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:41 smithi138 ceph-mon[35528]: pgmap v4: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:27:42.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:41 smithi138 ceph-mon[35528]: mgrmap e30: smithi047.zhgnrm(active, since 2s) 2024-02-07T12:27:42.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:41 smithi047 ceph-mon[28972]: pgmap v4: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:27:42.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:41 smithi047 ceph-mon[28972]: mgrmap e30: smithi047.zhgnrm(active, since 2s) 2024-02-07T12:27:43.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:43 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:43.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:43 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:43.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:43 smithi138 ceph-mon[35528]: pgmap v5: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:27:43.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:43 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:43.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:43 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:43.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:43 smithi047 ceph-mon[28972]: pgmap v5: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:27:44.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:44 smithi138 ceph-mon[35528]: mgrmap e31: smithi047.zhgnrm(active, since 4s) 2024-02-07T12:27:44.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:44 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:44.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:44 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:44.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:44 smithi047 ceph-mon[28972]: mgrmap e31: smithi047.zhgnrm(active, since 4s) 2024-02-07T12:27:44.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:44 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:44.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:44 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:45.382 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:45 smithi047 ceph-mon[28972]: pgmap v6: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:27:45.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:45 smithi138 ceph-mon[35528]: pgmap v6: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:27:46.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.091+0000 7f8c13859700 1 -- 172.21.15.47:0/3954946700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c0c0fcef0 msgr2=0x7f8c0c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:46.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.091+0000 7f8c13859700 1 --2- 172.21.15.47:0/3954946700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c0c0fcef0 0x7f8c0c0fd320 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009ce0 tx=0x7f8c04004d10 comp rx=0 tx=0).stop 2024-02-07T12:27:46.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.091+0000 7f8c13859700 1 -- 172.21.15.47:0/3954946700 shutdown_connections 2024-02-07T12:27:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.091+0000 7f8c13859700 1 --2- 172.21.15.47:0/3954946700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c0c0fe0e0 0x7f8c0c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.091+0000 7f8c13859700 1 --2- 172.21.15.47:0/3954946700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c0c0fcef0 0x7f8c0c0fd320 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.091+0000 7f8c13859700 1 -- 172.21.15.47:0/3954946700 >> 172.21.15.47:0/3954946700 conn(0x7f8c0c0f8620 msgr2=0x7f8c0c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.092+0000 7f8c13859700 1 -- 172.21.15.47:0/3954946700 shutdown_connections 2024-02-07T12:27:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.092+0000 7f8c13859700 1 -- 172.21.15.47:0/3954946700 wait complete. 2024-02-07T12:27:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.092+0000 7f8c13859700 1 Processor -- start 2024-02-07T12:27:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.092+0000 7f8c13859700 1 -- start start 2024-02-07T12:27:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.092+0000 7f8c13859700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c0c0fcef0 0x7f8c0c10dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.092+0000 7f8c13859700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c0c0fe0e0 0x7f8c0c10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.092+0000 7f8c13859700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c10e5f0 con 0x7f8c0c0fe0e0 2024-02-07T12:27:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.092+0000 7f8c13859700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c10ee90 con 0x7f8c0c0fcef0 2024-02-07T12:27:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.092+0000 7f8c10df4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c0c0fe0e0 0x7f8c0c10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.092+0000 7f8c10df4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c0c0fe0e0 0x7f8c0c10dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60278/0 (socket says 172.21.15.47:60278) 2024-02-07T12:27:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.092+0000 7f8c10df4700 1 -- 172.21.15.47:0/394285706 learned_addr learned my addr 172.21.15.47:0/394285706 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.093+0000 7f8c115f5700 1 --2- 172.21.15.47:0/394285706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c0c0fcef0 0x7f8c0c10dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.093+0000 7f8c10df4700 1 -- 172.21.15.47:0/394285706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c0c0fcef0 msgr2=0x7f8c0c10dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.093+0000 7f8c10df4700 1 --2- 172.21.15.47:0/394285706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c0c0fcef0 0x7f8c0c10dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.093+0000 7f8c10df4700 1 -- 172.21.15.47:0/394285706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04009940 con 0x7f8c0c0fe0e0 2024-02-07T12:27:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.093+0000 7f8c10df4700 1 --2- 172.21.15.47:0/394285706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c0c0fe0e0 0x7f8c0c10dff0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8c00002a80 tx=0x7f8c000046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.093+0000 7f8c09ffb700 1 -- 172.21.15.47:0/394285706 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c00007cc0 con 0x7f8c0c0fe0e0 2024-02-07T12:27:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.093+0000 7f8c13859700 1 -- 172.21.15.47:0/394285706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c10f170 con 0x7f8c0c0fe0e0 2024-02-07T12:27:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.093+0000 7f8c09ffb700 1 -- 172.21.15.47:0/394285706 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c0000f040 con 0x7f8c0c0fe0e0 2024-02-07T12:27:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.093+0000 7f8c09ffb700 1 -- 172.21.15.47:0/394285706 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c0000dac0 con 0x7f8c0c0fe0e0 2024-02-07T12:27:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.093+0000 7f8c13859700 1 -- 172.21.15.47:0/394285706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c10f6b0 con 0x7f8c0c0fe0e0 2024-02-07T12:27:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.094+0000 7f8c09ffb700 1 -- 172.21.15.47:0/394285706 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 31) v1 ==== 45932+0+0 (secure 0 0 0) 0x7f8c0000dc20 con 0x7f8c0c0fe0e0 2024-02-07T12:27:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.094+0000 7f8c09ffb700 1 --2- 172.21.15.47:0/394285706 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f8bf4038a70 0x7f8bf403af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.094+0000 7f8c09ffb700 1 -- 172.21.15.47:0/394285706 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8c0004c280 con 0x7f8c0c0fe0e0 2024-02-07T12:27:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.094+0000 7f8c115f5700 1 --2- 172.21.15.47:0/394285706 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f8bf4038a70 0x7f8bf403af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.095+0000 7f8c13859700 1 -- 172.21.15.47:0/394285706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c04bed0 con 0x7f8c0c0fe0e0 2024-02-07T12:27:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.095+0000 7f8c115f5700 1 --2- 172.21.15.47:0/394285706 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f8bf4038a70 0x7f8bf403af20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009cb0 tx=0x7f8c04004d10 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.101+0000 7f8c09ffb700 1 -- 172.21.15.47:0/394285706 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8c0001ce40 con 0x7f8c0c0fe0e0 2024-02-07T12:27:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.330+0000 7f8c13859700 1 -- 172.21.15.47:0/394285706 --> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c0c10fa90 con 0x7f8bf4038a70 2024-02-07T12:27:46.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.331+0000 7f8c09ffb700 1 -- 172.21.15.47:0/394285706 <== mgr.14774 v2:172.21.15.47:6800/1750591204 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f8c0c10fa90 con 0x7f8bf4038a70 2024-02-07T12:27:46.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.333+0000 7f8c13859700 1 -- 172.21.15.47:0/394285706 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f8bf4038a70 msgr2=0x7f8bf403af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.333+0000 7f8c13859700 1 --2- 172.21.15.47:0/394285706 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f8bf4038a70 0x7f8bf403af20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009cb0 tx=0x7f8c04004d10 comp rx=0 tx=0).stop 2024-02-07T12:27:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.333+0000 7f8c13859700 1 -- 172.21.15.47:0/394285706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c0c0fe0e0 msgr2=0x7f8c0c10dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.333+0000 7f8c13859700 1 --2- 172.21.15.47:0/394285706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c0c0fe0e0 0x7f8c0c10dff0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8c00002a80 tx=0x7f8c000046b0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.333+0000 7f8c13859700 1 -- 172.21.15.47:0/394285706 shutdown_connections 2024-02-07T12:27:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.333+0000 7f8c13859700 1 --2- 172.21.15.47:0/394285706 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f8bf4038a70 0x7f8bf403af20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.333+0000 7f8c13859700 1 --2- 172.21.15.47:0/394285706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c0c0fcef0 0x7f8c0c10dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.333+0000 7f8c13859700 1 --2- 172.21.15.47:0/394285706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c0c0fe0e0 0x7f8c0c10dff0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.333+0000 7f8c13859700 1 -- 172.21.15.47:0/394285706 >> 172.21.15.47:0/394285706 conn(0x7f8c0c0f8620 msgr2=0x7f8c0c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.333+0000 7f8c13859700 1 -- 172.21.15.47:0/394285706 shutdown_connections 2024-02-07T12:27:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.333+0000 7f8c13859700 1 -- 172.21.15.47:0/394285706 wait complete. 2024-02-07T12:27:46.345 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:27:46.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.450+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2439808980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc40fcef0 msgr2=0x7fbbc40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:46.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.450+0000 7fbbcc1f3700 1 --2- 172.21.15.47:0/2439808980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc40fcef0 0x7fbbc40fd320 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0004940 tx=0x7fbbc0009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:46.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.450+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2439808980 shutdown_connections 2024-02-07T12:27:46.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.450+0000 7fbbcc1f3700 1 --2- 172.21.15.47:0/2439808980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbbc40fe0e0 0x7fbbc40fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.450+0000 7fbbcc1f3700 1 --2- 172.21.15.47:0/2439808980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc40fcef0 0x7fbbc40fd320 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.450+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2439808980 >> 172.21.15.47:0/2439808980 conn(0x7fbbc40f8620 msgr2=0x7fbbc40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:46.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.450+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2439808980 shutdown_connections 2024-02-07T12:27:46.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.450+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2439808980 wait complete. 2024-02-07T12:27:46.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.451+0000 7fbbcc1f3700 1 Processor -- start 2024-02-07T12:27:46.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.451+0000 7fbbcc1f3700 1 -- start start 2024-02-07T12:27:46.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.451+0000 7fbbcc1f3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbbc40fcef0 0x7fbbc4071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:46.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.451+0000 7fbbcc1f3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc40fe0e0 0x7fbbc40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:46.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.451+0000 7fbbcc1f3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40708e0 con 0x7fbbc40fe0e0 2024-02-07T12:27:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.451+0000 7fbbcc1f3700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc4070a50 con 0x7fbbc40fcef0 2024-02-07T12:27:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.451+0000 7fbbc978e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc40fe0e0 0x7fbbc40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.451+0000 7fbbc978e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc40fe0e0 0x7fbbc40702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60298/0 (socket says 172.21.15.47:60298) 2024-02-07T12:27:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.451+0000 7fbbc978e700 1 -- 172.21.15.47:0/2443832372 learned_addr learned my addr 172.21.15.47:0/2443832372 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.451+0000 7fbbc9f8f700 1 --2- 172.21.15.47:0/2443832372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbbc40fcef0 0x7fbbc4071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.451+0000 7fbbc978e700 1 -- 172.21.15.47:0/2443832372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbbc40fcef0 msgr2=0x7fbbc4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.451+0000 7fbbc978e700 1 --2- 172.21.15.47:0/2443832372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbbc40fcef0 0x7fbbc4071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.451+0000 7fbbc978e700 1 -- 172.21.15.47:0/2443832372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0005040 con 0x7fbbc40fe0e0 2024-02-07T12:27:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.452+0000 7fbbc978e700 1 --2- 172.21.15.47:0/2443832372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc40fe0e0 0x7fbbc40702e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4002a50 tx=0x7fbbb40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.452+0000 7fbbba7fc700 1 -- 172.21.15.47:0/2443832372 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbb4007cc0 con 0x7fbbc40fe0e0 2024-02-07T12:27:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.452+0000 7fbbba7fc700 1 -- 172.21.15.47:0/2443832372 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbbb400f040 con 0x7fbbc40fe0e0 2024-02-07T12:27:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.452+0000 7fbbba7fc700 1 -- 172.21.15.47:0/2443832372 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbb400da30 con 0x7fbbc40fe0e0 2024-02-07T12:27:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.452+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2443832372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc4070d30 con 0x7fbbc40fe0e0 2024-02-07T12:27:46.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.452+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2443832372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc41159a0 con 0x7fbbc40fe0e0 2024-02-07T12:27:46.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.453+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2443832372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc404bed0 con 0x7fbbc40fe0e0 2024-02-07T12:27:46.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.453+0000 7fbbba7fc700 1 -- 172.21.15.47:0/2443832372 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 32) v1 ==== 91309+0+0 (secure 0 0 0) 0x7fbbb400db90 con 0x7fbbc40fe0e0 2024-02-07T12:27:46.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.454+0000 7fbbba7fc700 1 --2- 172.21.15.47:0/2443832372 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fbbb006d200 0x7fbbb006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:46.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.454+0000 7fbbba7fc700 1 -- 172.21.15.47:0/2443832372 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fbbb408c580 con 0x7fbbc40fe0e0 2024-02-07T12:27:46.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.454+0000 7fbbc9f8f700 1 --2- 172.21.15.47:0/2443832372 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fbbb006d200 0x7fbbb006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:46.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.454+0000 7fbbc9f8f700 1 --2- 172.21.15.47:0/2443832372 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fbbb006d200 0x7fbbb006f6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000b840 tx=0x7fbbc0009e30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:46.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.459+0000 7fbbba7fc700 1 -- 172.21.15.47:0/2443832372 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fbbb4059f30 con 0x7fbbc40fe0e0 2024-02-07T12:27:46.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:46 smithi047 ceph-mon[28972]: Standby manager daemon smithi138.fiugmj started 2024-02-07T12:27:46.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:46 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/3580969955' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/crt"}]: dispatch 2024-02-07T12:27:46.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:46 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/3580969955' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:27:46.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:46 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/3580969955' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/key"}]: dispatch 2024-02-07T12:27:46.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:46 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/3580969955' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:27:46.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.689+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2443832372 --> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbc4102ac0 con 0x7fbbb006d200 2024-02-07T12:27:46.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.691+0000 7fbbba7fc700 1 -- 172.21.15.47:0/2443832372 <== mgr.14774 v2:172.21.15.47:6800/1750591204 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fbbc4102ac0 con 0x7fbbb006d200 2024-02-07T12:27:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.693+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2443832372 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fbbb006d200 msgr2=0x7fbbb006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.693+0000 7fbbcc1f3700 1 --2- 172.21.15.47:0/2443832372 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fbbb006d200 0x7fbbb006f6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000b840 tx=0x7fbbc0009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.693+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2443832372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc40fe0e0 msgr2=0x7fbbc40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.693+0000 7fbbcc1f3700 1 --2- 172.21.15.47:0/2443832372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc40fe0e0 0x7fbbc40702e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4002a50 tx=0x7fbbb40046b0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.693+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2443832372 shutdown_connections 2024-02-07T12:27:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.693+0000 7fbbcc1f3700 1 --2- 172.21.15.47:0/2443832372 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fbbb006d200 0x7fbbb006f6b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.693+0000 7fbbcc1f3700 1 --2- 172.21.15.47:0/2443832372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbbc40fcef0 0x7fbbc4071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.693+0000 7fbbcc1f3700 1 --2- 172.21.15.47:0/2443832372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc40fe0e0 0x7fbbc40702e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.693+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2443832372 >> 172.21.15.47:0/2443832372 conn(0x7fbbc40f8620 msgr2=0x7fbbc41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.693+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2443832372 shutdown_connections 2024-02-07T12:27:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.693+0000 7fbbcc1f3700 1 -- 172.21.15.47:0/2443832372 wait complete. 2024-02-07T12:27:46.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:46 smithi138 ceph-mon[35528]: Standby manager daemon smithi138.fiugmj started 2024-02-07T12:27:46.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:46 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/3580969955' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/crt"}]: dispatch 2024-02-07T12:27:46.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:46 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/3580969955' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:27:46.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:46 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/3580969955' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/key"}]: dispatch 2024-02-07T12:27:46.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:46 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/3580969955' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:27:46.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 -- 172.21.15.47:0/3022226458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9941003a0 msgr2=0x7fe994102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 --2- 172.21.15.47:0/3022226458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9941003a0 0x7fe994102780 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe97c004940 tx=0x7fe97c009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 -- 172.21.15.47:0/3022226458 shutdown_connections 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 --2- 172.21.15.47:0/3022226458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9941003a0 0x7fe994102780 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 --2- 172.21.15.47:0/3022226458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9940fda80 0x7fe9940ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 -- 172.21.15.47:0/3022226458 >> 172.21.15.47:0/3022226458 conn(0x7fe9940f74e0 msgr2=0x7fe9940f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 -- 172.21.15.47:0/3022226458 shutdown_connections 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 -- 172.21.15.47:0/3022226458 wait complete. 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 Processor -- start 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 -- start start 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9940fda80 0x7fe9940fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9941003a0 0x7fe9940fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9940fbf90 con 0x7fe9941003a0 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.797+0000 7fe998e87700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9940fc100 con 0x7fe9940fda80 2024-02-07T12:27:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe991d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9941003a0 0x7fe9940fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe991d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9941003a0 0x7fe9940fb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60310/0 (socket says 172.21.15.47:60310) 2024-02-07T12:27:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe991d9b700 1 -- 172.21.15.47:0/567630519 learned_addr learned my addr 172.21.15.47:0/567630519 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe99259c700 1 --2- 172.21.15.47:0/567630519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9940fda80 0x7fe9940fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe991d9b700 1 -- 172.21.15.47:0/567630519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9940fda80 msgr2=0x7fe9940fd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe991d9b700 1 --2- 172.21.15.47:0/567630519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9940fda80 0x7fe9940fd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe991d9b700 1 -- 172.21.15.47:0/567630519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c005040 con 0x7fe9941003a0 2024-02-07T12:27:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe99259c700 1 --2- 172.21.15.47:0/567630519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9940fda80 0x7fe9940fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:27:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe991d9b700 1 --2- 172.21.15.47:0/567630519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9941003a0 0x7fe9940fb990 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009fd0 tx=0x7fe97c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe98affd700 1 -- 172.21.15.47:0/567630519 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe97c00e040 con 0x7fe9941003a0 2024-02-07T12:27:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe98affd700 1 -- 172.21.15.47:0/567630519 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe97c00bcc0 con 0x7fe9941003a0 2024-02-07T12:27:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe998e87700 1 -- 172.21.15.47:0/567630519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9940fc380 con 0x7fe9941003a0 2024-02-07T12:27:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe98affd700 1 -- 172.21.15.47:0/567630519 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe97c01c630 con 0x7fe9941003a0 2024-02-07T12:27:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.798+0000 7fe998e87700 1 -- 172.21.15.47:0/567630519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe994115970 con 0x7fe9941003a0 2024-02-07T12:27:46.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.799+0000 7fe998e87700 1 -- 172.21.15.47:0/567630519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99404bed0 con 0x7fe9941003a0 2024-02-07T12:27:46.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.800+0000 7fe98affd700 1 -- 172.21.15.47:0/567630519 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 32) v1 ==== 91309+0+0 (secure 0 0 0) 0x7fe97c013980 con 0x7fe9941003a0 2024-02-07T12:27:46.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.800+0000 7fe98affd700 1 --2- 172.21.15.47:0/567630519 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe98006d200 0x7fe98006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:46.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.800+0000 7fe98affd700 1 -- 172.21.15.47:0/567630519 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe97c08dcd0 con 0x7fe9941003a0 2024-02-07T12:27:46.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.800+0000 7fe99259c700 1 --2- 172.21.15.47:0/567630519 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe98006d200 0x7fe98006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:46.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.801+0000 7fe99259c700 1 --2- 172.21.15.47:0/567630519 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe98006d200 0x7fe98006f6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe98c004550 tx=0x7fe98c009040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:46.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:46.805+0000 7fe98affd700 1 -- 172.21.15.47:0/567630519 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe97c05b6a0 con 0x7fe9941003a0 2024-02-07T12:27:47.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.021+0000 7fe998e87700 1 -- 172.21.15.47:0/567630519 --> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe994101000 con 0x7fe98006d200 2024-02-07T12:27:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.032+0000 7fe98affd700 1 -- 172.21.15.47:0/567630519 <== mgr.14774 v2:172.21.15.47:6800/1750591204 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe994101000 con 0x7fe98006d200 2024-02-07T12:27:47.034 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:27:47.034 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (87s) 13s ago 10m 15.3M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:27:47.034 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (10m) 13s ago 10m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 bca7317ed169 2024-02-07T12:27:47.034 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (9m) 4s ago 9m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 110c84c6624b 2024-02-07T12:27:47.034 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (41s) 13s ago 9m 79.8M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (4m) 13s ago 4m 111M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (4m) 13s ago 4m 142M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (4m) 4s ago 4m 68.4M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (4m) 4s ago 4m 69.7M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (20s) 13s ago 11m 92.9M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283 running (2m) 4s ago 9m 73.4M - 19.0.0-1252-g44458cce 79957b372307 fd928ea0fb8a 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (11m) 13s ago 11m 50.8M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 105826d9ef9a 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (9m) 4s ago 9m 44.1M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 02dfa0b8d573 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (106s) 13s ago 10m 8224k - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (26s) 4s ago 9m 8363k - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (8m) 13s ago 8m 213M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 4f37918f583a 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (8m) 13s ago 8m 229M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 1c6e3c603ed3 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (7m) 13s ago 7m 178M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (7m) 4s ago 7m 262M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:27:47.035 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (6m) 4s ago 6m 233M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:27:47.036 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (6m) 4s ago 6m 217M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:27:47.036 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (28s) 13s ago 9m 44.6M - 2.43.0 a07b618ecd1d e0227ad2044d 2024-02-07T12:27:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.034+0000 7fe998e87700 1 -- 172.21.15.47:0/567630519 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe98006d200 msgr2=0x7fe98006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.034+0000 7fe998e87700 1 --2- 172.21.15.47:0/567630519 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe98006d200 0x7fe98006f6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe98c004550 tx=0x7fe98c009040 comp rx=0 tx=0).stop 2024-02-07T12:27:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.034+0000 7fe998e87700 1 -- 172.21.15.47:0/567630519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9941003a0 msgr2=0x7fe9940fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.034+0000 7fe998e87700 1 --2- 172.21.15.47:0/567630519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9941003a0 0x7fe9940fb990 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009fd0 tx=0x7fe97c009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.034+0000 7fe998e87700 1 -- 172.21.15.47:0/567630519 shutdown_connections 2024-02-07T12:27:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.034+0000 7fe998e87700 1 --2- 172.21.15.47:0/567630519 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe98006d200 0x7fe98006f6b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.034+0000 7fe998e87700 1 --2- 172.21.15.47:0/567630519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9940fda80 0x7fe9940fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.034+0000 7fe998e87700 1 --2- 172.21.15.47:0/567630519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9941003a0 0x7fe9940fb990 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.034+0000 7fe998e87700 1 -- 172.21.15.47:0/567630519 >> 172.21.15.47:0/567630519 conn(0x7fe9940f74e0 msgr2=0x7fe9940f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.034+0000 7fe998e87700 1 -- 172.21.15.47:0/567630519 shutdown_connections 2024-02-07T12:27:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.034+0000 7fe998e87700 1 -- 172.21.15.47:0/567630519 wait complete. 2024-02-07T12:27:47.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.136+0000 7f138d25c700 1 -- 172.21.15.47:0/1482634001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13880fbca0 msgr2=0x7f13880fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:47.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.136+0000 7f138d25c700 1 --2- 172.21.15.47:0/1482634001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13880fbca0 0x7f13880fe550 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1370004940 tx=0x7f1370009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:47.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.136+0000 7f138d25c700 1 -- 172.21.15.47:0/1482634001 shutdown_connections 2024-02-07T12:27:47.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.136+0000 7f138d25c700 1 --2- 172.21.15.47:0/1482634001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13880fbca0 0x7f13880fe550 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.136+0000 7f138d25c700 1 --2- 172.21.15.47:0/1482634001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13880fb2c0 0x7f13880fb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.136+0000 7f138d25c700 1 -- 172.21.15.47:0/1482634001 >> 172.21.15.47:0/1482634001 conn(0x7f13880f6ca0 msgr2=0x7f13880f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:47.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.136+0000 7f138d25c700 1 -- 172.21.15.47:0/1482634001 shutdown_connections 2024-02-07T12:27:47.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.136+0000 7f138d25c700 1 -- 172.21.15.47:0/1482634001 wait complete. 2024-02-07T12:27:47.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.136+0000 7f138d25c700 1 Processor -- start 2024-02-07T12:27:47.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.136+0000 7f138d25c700 1 -- start start 2024-02-07T12:27:47.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f138d25c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13880fb2c0 0x7f13880fde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:47.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f138d25c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13880fc2a0 0x7f13880fc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:47.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f138d25c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13880fcca0 con 0x7f13880fc2a0 2024-02-07T12:27:47.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f138d25c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13880fcde0 con 0x7f13880fb2c0 2024-02-07T12:27:47.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f138659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13880fc2a0 0x7f13880fc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:47.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f138659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13880fc2a0 0x7f13880fc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60328/0 (socket says 172.21.15.47:60328) 2024-02-07T12:27:47.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f138659c700 1 -- 172.21.15.47:0/3674897872 learned_addr learned my addr 172.21.15.47:0/3674897872 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:47.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f1386d9d700 1 --2- 172.21.15.47:0/3674897872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13880fb2c0 0x7f13880fde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:47.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f138659c700 1 -- 172.21.15.47:0/3674897872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13880fb2c0 msgr2=0x7f13880fde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:47.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f138659c700 1 --2- 172.21.15.47:0/3674897872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13880fb2c0 0x7f13880fde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f138659c700 1 -- 172.21.15.47:0/3674897872 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1370005040 con 0x7f13880fc2a0 2024-02-07T12:27:47.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f138659c700 1 --2- 172.21.15.47:0/3674897872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13880fc2a0 0x7f13880fc710 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1370009180 tx=0x7f1370009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:47.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f137f7fe700 1 -- 172.21.15.47:0/3674897872 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f137000e040 con 0x7f13880fc2a0 2024-02-07T12:27:47.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f138d25c700 1 -- 172.21.15.47:0/3674897872 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13880fd060 con 0x7f13880fc2a0 2024-02-07T12:27:47.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f137f7fe700 1 -- 172.21.15.47:0/3674897872 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1370004290 con 0x7f13880fc2a0 2024-02-07T12:27:47.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.137+0000 7f137f7fe700 1 -- 172.21.15.47:0/3674897872 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1370013ea0 con 0x7f13880fc2a0 2024-02-07T12:27:47.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.138+0000 7f138d25c700 1 -- 172.21.15.47:0/3674897872 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1388115f60 con 0x7f13880fc2a0 2024-02-07T12:27:47.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.138+0000 7f138d25c700 1 -- 172.21.15.47:0/3674897872 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138804bed0 con 0x7f13880fc2a0 2024-02-07T12:27:47.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.139+0000 7f137f7fe700 1 -- 172.21.15.47:0/3674897872 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 32) v1 ==== 91309+0+0 (secure 0 0 0) 0x7f137001c790 con 0x7f13880fc2a0 2024-02-07T12:27:47.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.139+0000 7f137f7fe700 1 --2- 172.21.15.47:0/3674897872 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f137406d200 0x7f137406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:47.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.139+0000 7f137f7fe700 1 -- 172.21.15.47:0/3674897872 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f137008dbe0 con 0x7f13880fc2a0 2024-02-07T12:27:47.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.139+0000 7f1386d9d700 1 --2- 172.21.15.47:0/3674897872 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f137406d200 0x7f137406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:47.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.140+0000 7f1386d9d700 1 --2- 172.21.15.47:0/3674897872 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f137406d200 0x7f137406f6b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1378004550 tx=0x7f1378009040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:47.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.144+0000 7f137f7fe700 1 -- 172.21.15.47:0/3674897872 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f137005b610 con 0x7f13880fc2a0 2024-02-07T12:27:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.446+0000 7f138d25c700 1 -- 172.21.15.47:0/3674897872 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1388105c70 con 0x7f13880fc2a0 2024-02-07T12:27:47.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.447+0000 7f137f7fe700 1 -- 172.21.15.47:0/3674897872 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f137005b1a0 con 0x7f13880fc2a0 2024-02-07T12:27:47.449 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:27:47.449 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:27:47.449 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2 2024-02-07T12:27:47.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:27:47.449 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:27:47.449 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:27:47.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:27:47.450 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:27:47.450 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 6 2024-02-07T12:27:47.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:27:47.450 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:27:47.450 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:27:47.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:27:47.450 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:27:47.450 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 12, 2024-02-07T12:27:47.450 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:27:47.450 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:27:47.450 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:27:47.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.449+0000 7f138d25c700 1 -- 172.21.15.47:0/3674897872 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f137406d200 msgr2=0x7f137406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:47.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.449+0000 7f138d25c700 1 --2- 172.21.15.47:0/3674897872 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f137406d200 0x7f137406f6b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1378004550 tx=0x7f1378009040 comp rx=0 tx=0).stop 2024-02-07T12:27:47.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.449+0000 7f138d25c700 1 -- 172.21.15.47:0/3674897872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13880fc2a0 msgr2=0x7f13880fc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:47.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.449+0000 7f138d25c700 1 --2- 172.21.15.47:0/3674897872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13880fc2a0 0x7f13880fc710 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1370009180 tx=0x7f1370009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:47.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.449+0000 7f138d25c700 1 -- 172.21.15.47:0/3674897872 shutdown_connections 2024-02-07T12:27:47.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.449+0000 7f138d25c700 1 --2- 172.21.15.47:0/3674897872 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f137406d200 0x7f137406f6b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.449+0000 7f138d25c700 1 --2- 172.21.15.47:0/3674897872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13880fb2c0 0x7f13880fde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.449+0000 7f138d25c700 1 --2- 172.21.15.47:0/3674897872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13880fc2a0 0x7f13880fc710 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.449+0000 7f138d25c700 1 -- 172.21.15.47:0/3674897872 >> 172.21.15.47:0/3674897872 conn(0x7f13880f6ca0 msgr2=0x7f1388101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:47.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.449+0000 7f138d25c700 1 -- 172.21.15.47:0/3674897872 shutdown_connections 2024-02-07T12:27:47.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.449+0000 7f138d25c700 1 -- 172.21.15.47:0/3674897872 wait complete. 2024-02-07T12:27:47.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 -- 172.21.15.47:0/1114025477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6740fbe40 msgr2=0x7fe6740fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 --2- 172.21.15.47:0/1114025477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6740fbe40 0x7fe6740fc250 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe670004940 tx=0x7fe670009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 -- 172.21.15.47:0/1114025477 shutdown_connections 2024-02-07T12:27:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 --2- 172.21.15.47:0/1114025477 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6740fcfb0 0x7fe6740fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 --2- 172.21.15.47:0/1114025477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6740fbe40 0x7fe6740fc250 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 -- 172.21.15.47:0/1114025477 >> 172.21.15.47:0/1114025477 conn(0x7fe6740f74e0 msgr2=0x7fe6740f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 -- 172.21.15.47:0/1114025477 shutdown_connections 2024-02-07T12:27:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 -- 172.21.15.47:0/1114025477 wait complete. 2024-02-07T12:27:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 Processor -- start 2024-02-07T12:27:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 -- start start 2024-02-07T12:27:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6740fbe40 0x7fe6740fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6740fcfb0 0x7fe6740fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740fea10 con 0x7fe6740fbe40 2024-02-07T12:27:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.555+0000 7fe67b7be700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740feb80 con 0x7fe6740fcfb0 2024-02-07T12:27:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.556+0000 7fe67955a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6740fbe40 0x7fe6740fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.556+0000 7fe67955a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6740fbe40 0x7fe6740fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60354/0 (socket says 172.21.15.47:60354) 2024-02-07T12:27:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.556+0000 7fe67955a700 1 -- 172.21.15.47:0/2465269887 learned_addr learned my addr 172.21.15.47:0/2465269887 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.556+0000 7fe67955a700 1 -- 172.21.15.47:0/2465269887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6740fcfb0 msgr2=0x7fe6740fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.556+0000 7fe67955a700 1 --2- 172.21.15.47:0/2465269887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6740fcfb0 0x7fe6740fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.556+0000 7fe67955a700 1 -- 172.21.15.47:0/2465269887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe670005040 con 0x7fe6740fbe40 2024-02-07T12:27:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.556+0000 7fe67955a700 1 --2- 172.21.15.47:0/2465269887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6740fbe40 0x7fe6740fff00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe6700093b0 tx=0x7fe670009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.556+0000 7fe669ffb700 1 -- 172.21.15.47:0/2465269887 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe67000e040 con 0x7fe6740fbe40 2024-02-07T12:27:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.556+0000 7fe669ffb700 1 -- 172.21.15.47:0/2465269887 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe67000bcc0 con 0x7fe6740fbe40 2024-02-07T12:27:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.556+0000 7fe67b7be700 1 -- 172.21.15.47:0/2465269887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6740fee00 con 0x7fe6740fbe40 2024-02-07T12:27:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.556+0000 7fe669ffb700 1 -- 172.21.15.47:0/2465269887 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe67001c630 con 0x7fe6740fbe40 2024-02-07T12:27:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.556+0000 7fe67b7be700 1 -- 172.21.15.47:0/2465269887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe674115960 con 0x7fe6740fbe40 2024-02-07T12:27:47.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.558+0000 7fe67b7be700 1 -- 172.21.15.47:0/2465269887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67404bed0 con 0x7fe6740fbe40 2024-02-07T12:27:47.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.558+0000 7fe669ffb700 1 -- 172.21.15.47:0/2465269887 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 32) v1 ==== 91309+0+0 (secure 0 0 0) 0x7fe6700139f0 con 0x7fe6740fbe40 2024-02-07T12:27:47.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.558+0000 7fe669ffb700 1 --2- 172.21.15.47:0/2465269887 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe66006d200 0x7fe66006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.559+0000 7fe669ffb700 1 -- 172.21.15.47:0/2465269887 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe67008dc40 con 0x7fe6740fbe40 2024-02-07T12:27:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.559+0000 7fe678d59700 1 --2- 172.21.15.47:0/2465269887 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe66006d200 0x7fe66006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.559+0000 7fe678d59700 1 --2- 172.21.15.47:0/2465269887 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe66006d200 0x7fe66006f6b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe664006fd0 tx=0x7fe664006db0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:47.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.563+0000 7fe669ffb700 1 -- 172.21.15.47:0/2465269887 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe67005b670 con 0x7fe6740fbe40 2024-02-07T12:27:47.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:47 smithi138 ceph-mon[35528]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:47.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:47 smithi138 ceph-mon[35528]: mgrmap e32: smithi047.zhgnrm(active, since 7s), standbys: smithi138.fiugmj 2024-02-07T12:27:47.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:47 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi138.fiugmj", "id": "smithi138.fiugmj"}]: dispatch 2024-02-07T12:27:47.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:47 smithi138 ceph-mon[35528]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:47.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:47 smithi138 ceph-mon[35528]: pgmap v7: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-07T12:27:47.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:47 smithi138 ceph-mon[35528]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:47 smithi047 ceph-mon[28972]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:47 smithi047 ceph-mon[28972]: mgrmap e32: smithi047.zhgnrm(active, since 7s), standbys: smithi138.fiugmj 2024-02-07T12:27:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:47 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi138.fiugmj", "id": "smithi138.fiugmj"}]: dispatch 2024-02-07T12:27:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:47 smithi047 ceph-mon[28972]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:47 smithi047 ceph-mon[28972]: pgmap v7: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-07T12:27:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:47 smithi047 ceph-mon[28972]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:47.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.829+0000 7fe67b7be700 1 -- 172.21.15.47:0/2465269887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe674115d50 con 0x7fe6740fbe40 2024-02-07T12:27:47.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.830+0000 7fe669ffb700 1 -- 172.21.15.47:0/2465269887 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1868 (secure 0 0 0) 0x7fe67005b200 con 0x7fe6740fbe40 2024-02-07T12:27:47.832 INFO:teuthology.orchestra.run.smithi047.stdout:e20 2024-02-07T12:27:47.832 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 20 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:26:24.336188+0000 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:27:47.833 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 export targets 1 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:27:47.834 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:27:47.835 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:27:47.835 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:27:47.835 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:27:47.835 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:27:47.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.832+0000 7fe67b7be700 1 -- 172.21.15.47:0/2465269887 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe66006d200 msgr2=0x7fe66006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:47.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.832+0000 7fe67b7be700 1 --2- 172.21.15.47:0/2465269887 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe66006d200 0x7fe66006f6b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe664006fd0 tx=0x7fe664006db0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.832+0000 7fe67b7be700 1 -- 172.21.15.47:0/2465269887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6740fbe40 msgr2=0x7fe6740fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:47.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.832+0000 7fe67b7be700 1 --2- 172.21.15.47:0/2465269887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6740fbe40 0x7fe6740fff00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe6700093b0 tx=0x7fe670009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:47.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.832+0000 7fe67b7be700 1 -- 172.21.15.47:0/2465269887 shutdown_connections 2024-02-07T12:27:47.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.832+0000 7fe67b7be700 1 --2- 172.21.15.47:0/2465269887 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe66006d200 0x7fe66006f6b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.832+0000 7fe67b7be700 1 --2- 172.21.15.47:0/2465269887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6740fbe40 0x7fe6740fff00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.832+0000 7fe67b7be700 1 --2- 172.21.15.47:0/2465269887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6740fcfb0 0x7fe6740fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.832+0000 7fe67b7be700 1 -- 172.21.15.47:0/2465269887 >> 172.21.15.47:0/2465269887 conn(0x7fe6740f74e0 msgr2=0x7fe6740656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:47.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.832+0000 7fe67b7be700 1 -- 172.21.15.47:0/2465269887 shutdown_connections 2024-02-07T12:27:47.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.832+0000 7fe67b7be700 1 -- 172.21.15.47:0/2465269887 wait complete. 2024-02-07T12:27:47.836 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-02-07T12:27:47.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.939+0000 7eff44d7d700 1 -- 172.21.15.47:0/2074928448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff400fcfb0 msgr2=0x7eff400fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:47.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.939+0000 7eff44d7d700 1 --2- 172.21.15.47:0/2074928448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff400fcfb0 0x7eff400fd420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7eff30004940 tx=0x7eff30009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:47.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.939+0000 7eff44d7d700 1 -- 172.21.15.47:0/2074928448 shutdown_connections 2024-02-07T12:27:47.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.939+0000 7eff44d7d700 1 --2- 172.21.15.47:0/2074928448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff400fcfb0 0x7eff400fd420 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.939+0000 7eff44d7d700 1 --2- 172.21.15.47:0/2074928448 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff400fbe40 0x7eff400fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.939+0000 7eff44d7d700 1 -- 172.21.15.47:0/2074928448 >> 172.21.15.47:0/2074928448 conn(0x7eff400f7520 msgr2=0x7eff400f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:47.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.939+0000 7eff44d7d700 1 -- 172.21.15.47:0/2074928448 shutdown_connections 2024-02-07T12:27:47.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.939+0000 7eff44d7d700 1 -- 172.21.15.47:0/2074928448 wait complete. 2024-02-07T12:27:47.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff44d7d700 1 Processor -- start 2024-02-07T12:27:47.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff44d7d700 1 -- start start 2024-02-07T12:27:47.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff44d7d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff400fbe40 0x7eff400fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:47.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff44d7d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff400fcfb0 0x7eff400fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:47.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff44d7d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff400fe980 con 0x7eff400fbe40 2024-02-07T12:27:47.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff44d7d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff400feaf0 con 0x7eff400fcfb0 2024-02-07T12:27:47.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff3e59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff400fbe40 0x7eff400fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:47.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff3e59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff400fbe40 0x7eff400fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60372/0 (socket says 172.21.15.47:60372) 2024-02-07T12:27:47.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff3e59c700 1 -- 172.21.15.47:0/4185549390 learned_addr learned my addr 172.21.15.47:0/4185549390 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:47.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff3dd9b700 1 --2- 172.21.15.47:0/4185549390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff400fcfb0 0x7eff400fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:47.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff3e59c700 1 -- 172.21.15.47:0/4185549390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff400fcfb0 msgr2=0x7eff400fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:47.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff3e59c700 1 --2- 172.21.15.47:0/4185549390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff400fcfb0 0x7eff400fe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:47.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff3e59c700 1 -- 172.21.15.47:0/4185549390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff30005040 con 0x7eff400fbe40 2024-02-07T12:27:47.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.940+0000 7eff3e59c700 1 --2- 172.21.15.47:0/4185549390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff400fbe40 0x7eff400fff00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7eff34002a50 tx=0x7eff340046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:47.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.941+0000 7eff2effd700 1 -- 172.21.15.47:0/4185549390 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff34007cc0 con 0x7eff400fbe40 2024-02-07T12:27:47.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.941+0000 7eff44d7d700 1 -- 172.21.15.47:0/4185549390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff400fedd0 con 0x7eff400fbe40 2024-02-07T12:27:47.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.941+0000 7eff2effd700 1 -- 172.21.15.47:0/4185549390 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff3400f040 con 0x7eff400fbe40 2024-02-07T12:27:47.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.941+0000 7eff2effd700 1 -- 172.21.15.47:0/4185549390 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff34009640 con 0x7eff400fbe40 2024-02-07T12:27:47.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.941+0000 7eff44d7d700 1 -- 172.21.15.47:0/4185549390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff40115970 con 0x7eff400fbe40 2024-02-07T12:27:47.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.942+0000 7eff44d7d700 1 -- 172.21.15.47:0/4185549390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4004bed0 con 0x7eff400fbe40 2024-02-07T12:27:47.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.942+0000 7eff2effd700 1 -- 172.21.15.47:0/4185549390 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 32) v1 ==== 91309+0+0 (secure 0 0 0) 0x7eff340097a0 con 0x7eff400fbe40 2024-02-07T12:27:47.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.943+0000 7eff2effd700 1 --2- 172.21.15.47:0/4185549390 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7eff2806d200 0x7eff2806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:47.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.943+0000 7eff2effd700 1 -- 172.21.15.47:0/4185549390 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7eff3408c5a0 con 0x7eff400fbe40 2024-02-07T12:27:47.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.943+0000 7eff3dd9b700 1 --2- 172.21.15.47:0/4185549390 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7eff2806d200 0x7eff2806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:47.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.943+0000 7eff3dd9b700 1 --2- 172.21.15.47:0/4185549390 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7eff2806d200 0x7eff2806f6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7eff30004f90 tx=0x7eff30009e30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:47.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:47.947+0000 7eff2effd700 1 -- 172.21.15.47:0/4185549390 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7eff34059f50 con 0x7eff400fbe40 2024-02-07T12:27:48.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.176+0000 7eff44d7d700 1 -- 172.21.15.47:0/4185549390 --> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff40066660 con 0x7eff2806d200 2024-02-07T12:27:48.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.177+0000 7eff2effd700 1 -- 172.21.15.47:0/4185549390 <== mgr.14774 v2:172.21.15.47:6800/1750591204 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7eff40066660 con 0x7eff2806d200 2024-02-07T12:27:48.179 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:27:48.179 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:27:48.179 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:27:48.179 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:27:48.179 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:27:48.180 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr" 2024-02-07T12:27:48.180 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:27:48.180 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "2/21 daemons upgraded", 2024-02-07T12:27:48.181 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "", 2024-02-07T12:27:48.181 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:27:48.181 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:27:48.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.179+0000 7eff44d7d700 1 -- 172.21.15.47:0/4185549390 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7eff2806d200 msgr2=0x7eff2806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:48.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.179+0000 7eff44d7d700 1 --2- 172.21.15.47:0/4185549390 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7eff2806d200 0x7eff2806f6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7eff30004f90 tx=0x7eff30009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:48.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.179+0000 7eff44d7d700 1 -- 172.21.15.47:0/4185549390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff400fbe40 msgr2=0x7eff400fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:48.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.179+0000 7eff44d7d700 1 --2- 172.21.15.47:0/4185549390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff400fbe40 0x7eff400fff00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7eff34002a50 tx=0x7eff340046b0 comp rx=0 tx=0).stop 2024-02-07T12:27:48.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.179+0000 7eff44d7d700 1 -- 172.21.15.47:0/4185549390 shutdown_connections 2024-02-07T12:27:48.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.179+0000 7eff44d7d700 1 --2- 172.21.15.47:0/4185549390 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7eff2806d200 0x7eff2806f6b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:48.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.179+0000 7eff44d7d700 1 --2- 172.21.15.47:0/4185549390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff400fbe40 0x7eff400fff00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:48.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.179+0000 7eff44d7d700 1 --2- 172.21.15.47:0/4185549390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff400fcfb0 0x7eff400fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:48.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.179+0000 7eff44d7d700 1 -- 172.21.15.47:0/4185549390 >> 172.21.15.47:0/4185549390 conn(0x7eff400f7520 msgr2=0x7eff40065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:48.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.180+0000 7eff44d7d700 1 -- 172.21.15.47:0/4185549390 shutdown_connections 2024-02-07T12:27:48.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.180+0000 7eff44d7d700 1 -- 172.21.15.47:0/4185549390 wait complete. 2024-02-07T12:27:48.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.284+0000 7f4b40338700 1 -- 172.21.15.47:0/2289753393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b380fe2b0 msgr2=0x7f4b380fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.284+0000 7f4b40338700 1 --2- 172.21.15.47:0/2289753393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b380fe2b0 0x7f4b380fe700 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c004940 tx=0x7f4b2c009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.284+0000 7f4b40338700 1 -- 172.21.15.47:0/2289753393 shutdown_connections 2024-02-07T12:27:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.284+0000 7f4b40338700 1 --2- 172.21.15.47:0/2289753393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b380fe2b0 0x7f4b380fe700 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.284+0000 7f4b40338700 1 --2- 172.21.15.47:0/2289753393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4b380fb220 0x7f4b380fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.284+0000 7f4b40338700 1 -- 172.21.15.47:0/2289753393 >> 172.21.15.47:0/2289753393 conn(0x7f4b380f6ca0 msgr2=0x7f4b380f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.284+0000 7f4b40338700 1 -- 172.21.15.47:0/2289753393 shutdown_connections 2024-02-07T12:27:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.284+0000 7f4b40338700 1 -- 172.21.15.47:0/2289753393 wait complete. 2024-02-07T12:27:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.285+0000 7f4b40338700 1 Processor -- start 2024-02-07T12:27:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.285+0000 7f4b40338700 1 -- start start 2024-02-07T12:27:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.285+0000 7f4b40338700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4b380fb220 0x7f4b380fdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.285+0000 7f4b40338700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b380fe2b0 0x7f4b380fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.285+0000 7f4b40338700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b380fc7c0 con 0x7f4b380fe2b0 2024-02-07T12:27:48.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.285+0000 7f4b40338700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b380fc930 con 0x7f4b380fb220 2024-02-07T12:27:48.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.285+0000 7f4b3d8d3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b380fe2b0 0x7f4b380fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:48.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.285+0000 7f4b3d8d3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b380fe2b0 0x7f4b380fc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60388/0 (socket says 172.21.15.47:60388) 2024-02-07T12:27:48.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.285+0000 7f4b3d8d3700 1 -- 172.21.15.47:0/4290929115 learned_addr learned my addr 172.21.15.47:0/4290929115 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:27:48.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.285+0000 7f4b3e0d4700 1 --2- 172.21.15.47:0/4290929115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4b380fb220 0x7f4b380fdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:48.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.285+0000 7f4b3d8d3700 1 -- 172.21.15.47:0/4290929115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4b380fb220 msgr2=0x7f4b380fdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:48.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.285+0000 7f4b3d8d3700 1 --2- 172.21.15.47:0/4290929115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4b380fb220 0x7f4b380fdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:48.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.285+0000 7f4b3d8d3700 1 -- 172.21.15.47:0/4290929115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c005040 con 0x7f4b380fe2b0 2024-02-07T12:27:48.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.286+0000 7f4b3d8d3700 1 --2- 172.21.15.47:0/4290929115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b380fe2b0 0x7f4b380fc1c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00b3b0 tx=0x7f4b2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:48.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.286+0000 7f4b2affd700 1 -- 172.21.15.47:0/4290929115 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b2c00e040 con 0x7f4b380fe2b0 2024-02-07T12:27:48.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.286+0000 7f4b2affd700 1 -- 172.21.15.47:0/4290929115 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b2c00bbf0 con 0x7f4b380fe2b0 2024-02-07T12:27:48.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.286+0000 7f4b40338700 1 -- 172.21.15.47:0/4290929115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b380fcbb0 con 0x7f4b380fe2b0 2024-02-07T12:27:48.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.286+0000 7f4b2affd700 1 -- 172.21.15.47:0/4290929115 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b2c01c630 con 0x7f4b380fe2b0 2024-02-07T12:27:48.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.286+0000 7f4b40338700 1 -- 172.21.15.47:0/4290929115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b38115a40 con 0x7f4b380fe2b0 2024-02-07T12:27:48.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.287+0000 7f4b2affd700 1 -- 172.21.15.47:0/4290929115 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 32) v1 ==== 91309+0+0 (secure 0 0 0) 0x7f4b2c00bd60 con 0x7f4b380fe2b0 2024-02-07T12:27:48.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.287+0000 7f4b40338700 1 -- 172.21.15.47:0/4290929115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3804bed0 con 0x7f4b380fe2b0 2024-02-07T12:27:48.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.288+0000 7f4b2affd700 1 --2- 172.21.15.47:0/4290929115 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f4b2406d200 0x7f4b2406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:27:48.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.288+0000 7f4b2affd700 1 -- 172.21.15.47:0/4290929115 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4b2c08dae0 con 0x7f4b380fe2b0 2024-02-07T12:27:48.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.288+0000 7f4b3e0d4700 1 --2- 172.21.15.47:0/4290929115 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f4b2406d200 0x7f4b2406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:27:48.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.288+0000 7f4b3e0d4700 1 --2- 172.21.15.47:0/4290929115 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f4b2406d200 0x7f4b2406f6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4b380fdad0 tx=0x7f4b34009040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:27:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.292+0000 7f4b2affd700 1 -- 172.21.15.47:0/4290929115 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4b2c05b5b0 con 0x7f4b380fe2b0 2024-02-07T12:27:48.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:48 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:48.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:48 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:48.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:48 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/3674897872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:27:48.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:48 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/2465269887' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:27:48.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:48 smithi047 ceph-mon[28972]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:48.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.599+0000 7f4b40338700 1 -- 172.21.15.47:0/4290929115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4b38105a40 con 0x7f4b380fe2b0 2024-02-07T12:27:48.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.599+0000 7f4b2affd700 1 -- 172.21.15.47:0/4290929115 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4b2c05b140 con 0x7f4b380fe2b0 2024-02-07T12:27:48.601 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:27:48.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.601+0000 7f4b40338700 1 -- 172.21.15.47:0/4290929115 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f4b2406d200 msgr2=0x7f4b2406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:48.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.601+0000 7f4b40338700 1 --2- 172.21.15.47:0/4290929115 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f4b2406d200 0x7f4b2406f6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4b380fdad0 tx=0x7f4b34009040 comp rx=0 tx=0).stop 2024-02-07T12:27:48.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.601+0000 7f4b40338700 1 -- 172.21.15.47:0/4290929115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b380fe2b0 msgr2=0x7f4b380fc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:27:48.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.601+0000 7f4b40338700 1 --2- 172.21.15.47:0/4290929115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b380fe2b0 0x7f4b380fc1c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00b3b0 tx=0x7f4b2c009e30 comp rx=0 tx=0).stop 2024-02-07T12:27:48.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.601+0000 7f4b40338700 1 -- 172.21.15.47:0/4290929115 shutdown_connections 2024-02-07T12:27:48.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.601+0000 7f4b40338700 1 --2- 172.21.15.47:0/4290929115 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f4b2406d200 0x7f4b2406f6b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:48.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.601+0000 7f4b40338700 1 --2- 172.21.15.47:0/4290929115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4b380fb220 0x7f4b380fdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:48.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.601+0000 7f4b40338700 1 --2- 172.21.15.47:0/4290929115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b380fe2b0 0x7f4b380fc1c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:27:48.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.601+0000 7f4b40338700 1 -- 172.21.15.47:0/4290929115 >> 172.21.15.47:0/4290929115 conn(0x7f4b380f6ca0 msgr2=0x7f4b381014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:27:48.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.601+0000 7f4b40338700 1 -- 172.21.15.47:0/4290929115 shutdown_connections 2024-02-07T12:27:48.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:27:48.601+0000 7f4b40338700 1 -- 172.21.15.47:0/4290929115 wait complete. 2024-02-07T12:27:48.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:48 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:48.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:48 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:48.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:48 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3674897872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:27:48.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:48 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2465269887' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:27:48.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:48 smithi138 ceph-mon[35528]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:27:49.494 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:49 smithi047 ceph-mon[28972]: from='client.? 172.21.15.47:0/4290929115' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:27:49.494 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:49 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:49.494 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:49 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:49.494 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:49 smithi047 ceph-mon[28972]: pgmap v8: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-07T12:27:49.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:49 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/4290929115' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:27:49.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:49 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:49.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:49 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:49.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:49 smithi138 ceph-mon[35528]: pgmap v8: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-07T12:27:51.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:51 smithi138 ceph-mon[35528]: pgmap v9: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-07T12:27:51.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:51 smithi047 ceph-mon[28972]: pgmap v9: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-07T12:27:53.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:53.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:53.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: Updating smithi047:/etc/ceph/ceph.conf 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: pgmap v10: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:53.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:53 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:27:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:27:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: Updating smithi047:/etc/ceph/ceph.conf 2024-02-07T12:27:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-07T12:27:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:27:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:27:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:27:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:27:53.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: pgmap v10: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-07T12:27:53.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:27:53.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:27:53.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:53.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:53.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:53.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:53.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:53 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:27:54.386 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:54 smithi047 ceph-mon[28972]: Reconfiguring prometheus.smithi047 (dependencies changed)... 2024-02-07T12:27:54.386 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:54 smithi047 ceph-mon[28972]: Reconfiguring daemon prometheus.smithi047 on smithi047 2024-02-07T12:27:54.387 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:54 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:27:54.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:54 smithi138 ceph-mon[35528]: Reconfiguring prometheus.smithi047 (dependencies changed)... 2024-02-07T12:27:54.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:54 smithi138 ceph-mon[35528]: Reconfiguring daemon prometheus.smithi047 on smithi047 2024-02-07T12:27:54.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:54 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:27:55.461 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:55 smithi047 ceph-mon[28972]: pgmap v11: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-07T12:27:55.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:55 smithi138 ceph-mon[35528]: pgmap v11: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-07T12:27:57.960 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:57 smithi047 ceph-mon[28972]: pgmap v12: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-07T12:27:58.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:57 smithi138 ceph-mon[35528]: pgmap v12: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-07T12:28:00.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:59 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:00.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:59 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:00.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:59 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:28:00.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:59 smithi138 ceph-mon[35528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:28:00.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:59 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:00.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:27:59 smithi138 ceph-mon[35528]: pgmap v13: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:00.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:59 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:00.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:59 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:00.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:59 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:28:00.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:59 smithi047 ceph-mon[28972]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:28:00.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:59 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:00.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:27:59 smithi047 ceph-mon[28972]: pgmap v13: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:01.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:01 smithi138 ceph-mon[35528]: Upgrade: Updating mgr.smithi138.fiugmj 2024-02-07T12:28:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:01 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.fiugmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:28:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:01 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:28:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:01 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:01 smithi138 ceph-mon[35528]: Deploying daemon mgr.smithi138.fiugmj on smithi138 2024-02-07T12:28:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:01 smithi138 ceph-mon[35528]: pgmap v14: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:01.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:01 smithi047 ceph-mon[28972]: Upgrade: Updating mgr.smithi138.fiugmj 2024-02-07T12:28:01.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:01 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.fiugmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:28:01.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:01 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:28:01.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:01 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:01 smithi047 ceph-mon[28972]: Deploying daemon mgr.smithi138.fiugmj on smithi138 2024-02-07T12:28:01.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:01 smithi047 ceph-mon[28972]: pgmap v14: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:04.184 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:03 smithi138 ceph-mon[35528]: pgmap v15: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:04.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:03 smithi047 ceph-mon[28972]: pgmap v15: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:05.351 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:05 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:05.351 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:05 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:05.352 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:05 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:05.352 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:05 smithi138 ceph-mon[35528]: pgmap v16: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:05 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:05 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:05 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:05 smithi047 ceph-mon[28972]: pgmap v16: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:08.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:07 smithi138 ceph-mon[35528]: pgmap v17: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:08.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:07 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:08.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:07 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:08.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:07 smithi047 ceph-mon[28972]: pgmap v17: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:08.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:07 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:08.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:07 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:09.557 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:09 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:09.558 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:09 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:09.558 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:09 smithi138 ceph-mon[35528]: pgmap v18: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:09.558 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:09 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:28:09.558 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:09 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:09.558 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:09 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:09.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:09 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:09.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:09 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:09.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:09 smithi047 ceph-mon[28972]: pgmap v18: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:09.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:09 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:28:09.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:09 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:09.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:09 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:11.744 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:11 smithi138 ceph-mon[35528]: pgmap v19: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:11.744 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:11 smithi138 ceph-mon[35528]: Standby manager daemon smithi138.fiugmj restarted 2024-02-07T12:28:11.744 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:11 smithi138 ceph-mon[35528]: Standby manager daemon smithi138.fiugmj started 2024-02-07T12:28:11.745 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:11 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/4200948173' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/crt"}]: dispatch 2024-02-07T12:28:11.745 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:11 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/4200948173' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:28:11.745 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:11 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/4200948173' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/key"}]: dispatch 2024-02-07T12:28:11.745 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:11 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/4200948173' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:28:11.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:11 smithi047 ceph-mon[28972]: pgmap v19: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:11.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:11 smithi047 ceph-mon[28972]: Standby manager daemon smithi138.fiugmj restarted 2024-02-07T12:28:11.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:11 smithi047 ceph-mon[28972]: Standby manager daemon smithi138.fiugmj started 2024-02-07T12:28:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:11 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/4200948173' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/crt"}]: dispatch 2024-02-07T12:28:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:11 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/4200948173' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:28:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:11 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/4200948173' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/key"}]: dispatch 2024-02-07T12:28:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:11 smithi047 ceph-mon[28972]: from='mgr.? 172.21.15.138:0/4200948173' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:28:12.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: mgrmap e33: smithi047.zhgnrm(active, since 32s), standbys: smithi138.fiugmj 2024-02-07T12:28:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:28:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:28:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi047.zhgnrm"}]: dispatch 2024-02-07T12:28:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi047.zhgnrm"}]': finished 2024-02-07T12:28:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi138.fiugmj"}]: dispatch 2024-02-07T12:28:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi138.fiugmj"}]': finished 2024-02-07T12:28:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:12 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-07T12:28:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: mgrmap e33: smithi047.zhgnrm(active, since 32s), standbys: smithi138.fiugmj 2024-02-07T12:28:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:28:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:28:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi047.zhgnrm"}]: dispatch 2024-02-07T12:28:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi047.zhgnrm"}]': finished 2024-02-07T12:28:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi138.fiugmj"}]: dispatch 2024-02-07T12:28:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi138.fiugmj"}]': finished 2024-02-07T12:28:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:12 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-07T12:28:13.686 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:13 smithi138 ceph-mon[35528]: Upgrade: Setting container_image for all mgr 2024-02-07T12:28:13.687 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:13 smithi138 ceph-mon[35528]: pgmap v20: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:13.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:13 smithi047 ceph-mon[28972]: Upgrade: Setting container_image for all mgr 2024-02-07T12:28:13.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:13 smithi047 ceph-mon[28972]: pgmap v20: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:15.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:15 smithi047 ceph-mon[28972]: Upgrade: Updating mon.smithi047 2024-02-07T12:28:15.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:15 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:15.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:15 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-07T12:28:15.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:15 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-07T12:28:15.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:15 smithi047 ceph-mon[28972]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:15.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:15 smithi047 ceph-mon[28972]: Deploying daemon mon.smithi047 on smithi047 2024-02-07T12:28:15.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:15 smithi138 ceph-mon[35528]: Upgrade: Updating mon.smithi047 2024-02-07T12:28:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:15 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:15 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-07T12:28:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:15 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-07T12:28:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:15 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:15 smithi138 ceph-mon[35528]: Deploying daemon mon.smithi047 on smithi047 2024-02-07T12:28:16.390 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:16 smithi047 ceph-mon[28972]: pgmap v21: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:16.390 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:16 smithi047 systemd[1]: Stopping Ceph mon.smithi047 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:28:16.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:16 smithi138 ceph-mon[35528]: pgmap v21: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:16.808 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:16 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047[28968]: 2024-02-07T12:28:16.386+0000 7f4070d03700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi047 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:28:16.808 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:16 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047[28968]: 2024-02-07T12:28:16.386+0000 7f4070d03700 -1 mon.smithi047@0(leader) e2 *** Got Signal Terminated *** 2024-02-07T12:28:16.808 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:16 smithi047 podman[93038]: 2024-02-07 12:28:16.522639539 +0000 UTC m=+0.247207336 container died 105826d9ef9abb56f3079127276e2cbc7b3c9b9c2f5d6e58fb991ee05937acea (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-f246262, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:28:17.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:16 smithi047 podman[93038]: 2024-02-07 12:28:16.921140289 +0000 UTC m=+0.645708067 container cleanup 105826d9ef9abb56f3079127276e2cbc7b3c9b9c2f5d6e58fb991ee05937acea (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-f246262, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.2) 2024-02-07T12:28:17.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:16 smithi047 bash[93038]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047 2024-02-07T12:28:17.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:17 smithi047 podman[93066]: 2024-02-07 12:28:17.172560448 +0000 UTC m=+0.652678106 container remove 105826d9ef9abb56f3079127276e2cbc7b3c9b9c2f5d6e58fb991ee05937acea (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=quincy-f246262, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-07T12:28:17.550 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:17 smithi047 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi047.service: Deactivated successfully. 2024-02-07T12:28:17.550 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:17 smithi047 systemd[1]: Stopped Ceph mon.smithi047 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:28:17.550 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:17 smithi047 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi047.service: Consumed 11.709s CPU time. 2024-02-07T12:28:17.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:17 smithi047 systemd[1]: Starting Ceph mon.smithi047 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:28:18.100 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:17 smithi047 podman[93205]: 2024-02-07 12:28:17.74943309 +0000 UTC m=+0.018356658 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:28:18.100 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:17 smithi047 podman[93205]: 2024-02-07 12:28:17.848699966 +0000 UTC m=+0.117623569 container create 70d584f39f5c3fec0c49465c79396d24379bad6763ffca5cc4e18fcf3a2fe5cb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-07T12:28:18.100 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 podman[93205]: 2024-02-07 12:28:18.067931315 +0000 UTC m=+0.336854886 container init 70d584f39f5c3fec0c49465c79396d24379bad6763ffca5cc4e18fcf3a2fe5cb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-02-07T12:28:18.100 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 podman[93205]: 2024-02-07 12:28:18.070802526 +0000 UTC m=+0.339726084 container start 70d584f39f5c3fec0c49465c79396d24379bad6763ffca5cc4e18fcf3a2fe5cb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-02-07T12:28:18.100 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: set uid:gid to 167:167 (ceph:ceph) 2024-02-07T12:28:18.100 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev), process ceph-mon, pid 2 2024-02-07T12:28:18.101 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: pidfile_write: ignore empty --pid-file 2024-02-07T12:28:18.101 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: load: jerasure load: lrc 2024-02-07T12:28:18.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: RocksDB version: 7.9.2 2024-02-07T12:28:18.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Git sha 0 2024-02-07T12:28:18.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Compile date 2024-02-05 19:41:51 2024-02-07T12:28:18.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: DB SUMMARY 2024-02-07T12:28:18.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: DB Session ID: ERXHENFCBMEIZUNU2GCI 2024-02-07T12:28:18.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: CURRENT file: CURRENT 2024-02-07T12:28:18.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: IDENTITY file: IDENTITY 2024-02-07T12:28:18.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1170 Bytes 2024-02-07T12:28:18.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi047/store.db dir, Total Num: 1, files: 000033.sst 2024-02-07T12:28:18.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi047/store.db: 000031.log size: 2238527 ; 2024-02-07T12:28:18.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.error_if_exists: 0 2024-02-07T12:28:18.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.create_if_missing: 0 2024-02-07T12:28:18.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.paranoid_checks: 1 2024-02-07T12:28:18.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-07T12:28:18.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-07T12:28:18.578 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-07T12:28:18.578 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.env: 0x5592fe065ae0 2024-02-07T12:28:18.578 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.fs: PosixFileSystem 2024-02-07T12:28:18.578 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.info_log: 0x5592ffab7760 2024-02-07T12:28:18.578 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_file_opening_threads: 16 2024-02-07T12:28:18.578 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.statistics: (nil) 2024-02-07T12:28:18.578 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.use_fsync: 0 2024-02-07T12:28:18.578 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_log_file_size: 0 2024-02-07T12:28:18.578 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-07T12:28:18.578 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-07T12:28:18.578 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.keep_log_file_num: 1000 2024-02-07T12:28:18.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.recycle_log_file_num: 0 2024-02-07T12:28:18.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.allow_fallocate: 1 2024-02-07T12:28:18.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.allow_mmap_reads: 0 2024-02-07T12:28:18.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.allow_mmap_writes: 0 2024-02-07T12:28:18.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.use_direct_reads: 0 2024-02-07T12:28:18.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-07T12:28:18.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.create_missing_column_families: 0 2024-02-07T12:28:18.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.db_log_dir: 2024-02-07T12:28:18.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.wal_dir: 2024-02-07T12:28:18.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-07T12:28:18.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-07T12:28:18.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-07T12:28:18.580 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-07T12:28:18.584 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-07T12:28:18.584 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-07T12:28:18.584 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.advise_random_on_open: 1 2024-02-07T12:28:18.584 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.db_write_buffer_size: 0 2024-02-07T12:28:18.584 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.write_buffer_manager: 0x5592ffa8b400 2024-02-07T12:28:18.584 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-07T12:28:18.584 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-07T12:28:18.584 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-07T12:28:18.584 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.rate_limiter: (nil) 2024-02-07T12:28:18.584 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-07T12:28:18.584 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.wal_recovery_mode: 2 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.enable_thread_tracking: 0 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.enable_pipelined_write: 0 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.unordered_write: 0 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.row_cache: None 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.wal_filter: None 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.allow_ingest_behind: 0 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.two_write_queues: 0 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.manual_wal_flush: 0 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.wal_compression: 0 2024-02-07T12:28:18.585 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.atomic_flush: 0 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.log_readahead_size: 0 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.best_efforts_recovery: 0 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.allow_data_in_errors: 0 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.db_host_id: __hostname__ 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_background_jobs: 2 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_background_compactions: -1 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_subcompactions: 1 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-07T12:28:18.586 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_total_wal_size: 0 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_open_files: -1 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.bytes_per_sync: 0 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compaction_readahead_size: 0 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_background_flushes: -1 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Compression algorithms supported: 2024-02-07T12:28:18.587 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-07T12:28:18.588 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: kZSTD supported: 0 2024-02-07T12:28:18.588 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: kXpressCompression supported: 0 2024-02-07T12:28:18.588 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: kLZ4HCCompression supported: 1 2024-02-07T12:28:18.588 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: kZlibCompression supported: 1 2024-02-07T12:28:18.588 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: kSnappyCompression supported: 1 2024-02-07T12:28:18.588 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: kLZ4Compression supported: 1 2024-02-07T12:28:18.588 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: kBZip2Compression supported: 0 2024-02-07T12:28:18.588 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-07T12:28:18.588 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-07T12:28:18.588 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi047/store.db/MANIFEST-000015 2024-02-07T12:28:18.588 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-07T12:28:18.588 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-07T12:28:18.588 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.merge_operator: 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compaction_filter: None 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compaction_filter_factory: None 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.sst_partitioner_factory: None 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5592ffab7880) 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: cache_index_and_filter_blocks: 1 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: pin_top_level_index_and_filter: 1 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: index_type: 0 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: data_block_index_type: 0 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: index_shortening: 1 2024-02-07T12:28:18.589 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: checksum: 4 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: no_block_cache: 0 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache: 0x5592ffabb090 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache_name: BinnedLRUCache 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache_options: 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: capacity : 536870912 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: num_shard_bits : 4 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: strict_capacity_limit : 0 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: high_pri_pool_ratio: 0.000 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache_compressed: (nil) 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: persistent_cache: (nil) 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_size: 4096 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_size_deviation: 10 2024-02-07T12:28:18.590 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_restart_interval: 16 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: index_block_restart_interval: 1 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: metadata_block_size: 4096 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: partition_filters: 0 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: use_delta_encoding: 1 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: filter_policy: bloomfilter 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: whole_key_filtering: 1 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: verify_compression: 0 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: read_amp_bytes_per_bit: 0 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: format_version: 5 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: enable_index_compression: 1 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_align: 0 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: max_auto_readahead_size: 262144 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: prepopulate_block_cache: 0 2024-02-07T12:28:18.591 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: initial_auto_readahead_size: 8192 2024-02-07T12:28:18.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: num_file_reads_for_auto_readahead: 2 2024-02-07T12:28:18.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.write_buffer_size: 33554432 2024-02-07T12:28:18.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_write_buffer_number: 2 2024-02-07T12:28:18.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compression: NoCompression 2024-02-07T12:28:18.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.bottommost_compression: Disabled 2024-02-07T12:28:18.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.prefix_extractor: nullptr 2024-02-07T12:28:18.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-07T12:28:18.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.num_levels: 7 2024-02-07T12:28:18.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-07T12:28:18.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-07T12:28:18.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-07T12:28:18.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-07T12:28:18.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compression_opts.level: 32767 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compression_opts.strategy: 0 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-07T12:28:18.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-07T12:28:18.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compression_opts.enabled: false 2024-02-07T12:28:18.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-07T12:28:18.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-07T12:28:18.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-07T12:28:18.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-07T12:28:18.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.target_file_size_base: 67108864 2024-02-07T12:28:18.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-07T12:28:18.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-07T12:28:18.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-07T12:28:18.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-07T12:28:18.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-07T12:28:18.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-07T12:28:18.594 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-07T12:28:18.595 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-07T12:28:18.595 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-07T12:28:18.595 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-07T12:28:18.595 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-07T12:28:18.595 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-07T12:28:18.595 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-07T12:28:18.595 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-07T12:28:18.595 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.arena_block_size: 1048576 2024-02-07T12:28:18.595 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-07T12:28:18.595 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-07T12:28:18.595 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.disable_auto_compactions: 0 2024-02-07T12:28:18.595 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-07T12:28:18.595 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-07T12:28:18.596 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-07T12:28:18.596 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-07T12:28:18.596 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-07T12:28:18.596 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-07T12:28:18.596 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-07T12:28:18.596 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-07T12:28:18.596 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-07T12:28:18.596 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-07T12:28:18.596 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.table_properties_collectors: 2024-02-07T12:28:18.596 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.inplace_update_support: 0 2024-02-07T12:28:18.596 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-07T12:28:18.596 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-07T12:28:18.597 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-07T12:28:18.597 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-07T12:28:18.597 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.bloom_locality: 0 2024-02-07T12:28:18.597 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.max_successive_merges: 0 2024-02-07T12:28:18.597 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-07T12:28:18.597 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.paranoid_file_checks: 0 2024-02-07T12:28:18.597 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.force_consistency_checks: 1 2024-02-07T12:28:18.597 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.report_bg_io_stats: 0 2024-02-07T12:28:18.597 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.ttl: 2592000 2024-02-07T12:28:18.597 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-07T12:28:18.597 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-07T12:28:18.597 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-07T12:28:18.597 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.enable_blob_files: false 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.min_blob_size: 0 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.blob_file_size: 268435456 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.blob_file_starting_level: 0 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi047/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12299, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 510a5f04-ded8-4e49-88be-c04557364a05 2024-02-07T12:28:18.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707308898100463, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-02-07T12:28:18.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-02-07T12:28:18.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707308898107241, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 2072004, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12300, "largest_seqno": 13184, "table_properties": {"data_size": 2067368, "index_size": 2598, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1029, "raw_key_size": 9405, "raw_average_key_size": 23, "raw_value_size": 2058709, "raw_average_value_size": 5159, "num_data_blocks": 119, "num_entries": 399, "num_filter_entries": 399, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1707308898, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "510a5f04-ded8-4e49-88be-c04557364a05", "db_session_id": "ERXHENFCBMEIZUNU2GCI", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-02-07T12:28:18.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707308898107339, "job": 1, "event": "recovery_finished"} 2024-02-07T12:28:18.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-02-07T12:28:18.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-07T12:28:18.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi047/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-07T12:28:18.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5592ffbaa000 2024-02-07T12:28:18.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: DB pointer 0x5592ffb96000 2024-02-07T12:28:18.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-07T12:28:18.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-07T12:28:18.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** DB Stats ** 2024-02-07T12:28:18.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-07T12:28:18.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-07T12:28:18.600 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-07T12:28:18.600 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-07T12:28:18.600 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-07T12:28:18.600 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-07T12:28:18.600 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-07T12:28:18.600 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:28:18.600 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** Compaction Stats [default] ** 2024-02-07T12:28:18.600 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-07T12:28:18.600 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-07T12:28:18.600 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: L0 1/0 1.98 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 548.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-02-07T12:28:18.600 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: L6 1/0 5.22 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-07T12:28:18.600 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Sum 2/0 7.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 548.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-02-07T12:28:18.600 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 548.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** Compaction Stats [default] ** 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 548.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-07T12:28:18.601 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-07T12:28:18.602 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative compaction: 0.00 GB write, 218.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-07T12:28:18.602 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval compaction: 0.00 GB write, 218.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-07T12:28:18.602 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-07T12:28:18.602 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Block cache BinnedLRUCache@0x5592ffabb090#2 capacity: 512.00 MB usage: 3.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.6e-05 secs_since: 0 2024-02-07T12:28:18.602 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.16 KB,0.000220537%) IndexBlock(1,2.83 KB,0.000539422%) Misc(1,0.00 KB,0%) 2024-02-07T12:28:18.602 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:28:18.602 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-07T12:28:18.602 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: starting mon.smithi047 rank 0 at public addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] at bind addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi047 fsid 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:28:18.602 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: mon.smithi047@-1(???) e2 preinit fsid 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:28:18.602 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: mon.smithi047@-1(???).mds e20 new map 2024-02-07T12:28:18.602 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: mon.smithi047@-1(???).mds e20 print_map 2024-02-07T12:28:18.602 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: e20 2024-02-07T12:28:18.602 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: legacy client fscid: 1 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Filesystem 'cephfs' (1) 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: fs_name cephfs 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: epoch 20 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: modified 2024-02-07T12:26:24.336188+0000 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: tableserver 0 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: root 0 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: session_timeout 60 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: session_autoclose 300 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: max_file_size 1099511627776 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: max_xattr_size 65536 2024-02-07T12:28:18.603 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: required_client_features {} 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: last_failure 0 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: last_failure_osd_epoch 47 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: max_mds 2 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: in 0,1 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: up {0=14460,1=14472} 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: failed 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: damaged 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: stopped 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: data_pools [3] 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: metadata_pool 2 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: inline_data disabled 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: balancer 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: bal_rank_mask -1 2024-02-07T12:28:18.604 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: standby_count_wanted 1 2024-02-07T12:28:18.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: [mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 export targets 1 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:28:18.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: [mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:28:18.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: [mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:28:18.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: [mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:28:18.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:28:18.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-02-07T12:28:18.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: mon.smithi047@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-07T12:28:18.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: mon.smithi047@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-07T12:28:18.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: mon.smithi047@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-07T12:28:18.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: mon.smithi047@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-07T12:28:18.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 ceph-mon[93224]: mon.smithi047@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-02-07T12:28:18.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 bash[93205]: 70d584f39f5c3fec0c49465c79396d24379bad6763ffca5cc4e18fcf3a2fe5cb 2024-02-07T12:28:18.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:18 smithi047 systemd[1]: Started Ceph mon.smithi047 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:28:18.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.708+0000 7efeb33c3700 1 -- 172.21.15.47:0/2632756427 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efeac0fcef0 msgr2=0x7efeac0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.708+0000 7efeb33c3700 1 --2- 172.21.15.47:0/2632756427 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efeac0fcef0 0x7efeac0fd320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efe9c004c50 tx=0x7efe9c009ca0 comp rx=0 tx=0).stop 2024-02-07T12:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.708+0000 7efeb33c3700 1 -- 172.21.15.47:0/2632756427 shutdown_connections 2024-02-07T12:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.708+0000 7efeb33c3700 1 --2- 172.21.15.47:0/2632756427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeac0fe0e0 0x7efeac0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.708+0000 7efeb33c3700 1 --2- 172.21.15.47:0/2632756427 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efeac0fcef0 0x7efeac0fd320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.708+0000 7efeb33c3700 1 -- 172.21.15.47:0/2632756427 >> 172.21.15.47:0/2632756427 conn(0x7efeac0f8620 msgr2=0x7efeac0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.708+0000 7efeb33c3700 1 -- 172.21.15.47:0/2632756427 shutdown_connections 2024-02-07T12:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.708+0000 7efeb33c3700 1 -- 172.21.15.47:0/2632756427 wait complete. 2024-02-07T12:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.708+0000 7efeb33c3700 1 Processor -- start 2024-02-07T12:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb33c3700 1 -- start start 2024-02-07T12:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb33c3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efeac0fcef0 0x7efeac071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb33c3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeac0fe0e0 0x7efeac0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb33c3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0708e0 con 0x7efeac0fe0e0 2024-02-07T12:28:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb33c3700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac070a50 con 0x7efeac0fcef0 2024-02-07T12:28:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb095e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeac0fe0e0 0x7efeac0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb095e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeac0fe0e0 0x7efeac0702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44886/0 (socket says 172.21.15.47:44886) 2024-02-07T12:28:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb095e700 1 -- 172.21.15.47:0/37717355 learned_addr learned my addr 172.21.15.47:0/37717355 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:28:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb095e700 1 -- 172.21.15.47:0/37717355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeac0fe0e0 msgr2=0x7efeac0702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-07T12:28:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb095e700 1 -- 172.21.15.47:0/37717355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeac0fe0e0 msgr2=0x7efeac0702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-07T12:28:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb095e700 1 --2- 172.21.15.47:0/37717355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeac0fe0e0 0x7efeac0702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-07T12:28:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb095e700 1 --2- 172.21.15.47:0/37717355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeac0fe0e0 0x7efeac0702e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-07T12:28:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb115f700 1 --2- 172.21.15.47:0/37717355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efeac0fcef0 0x7efeac071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb115f700 1 -- 172.21.15.47:0/37717355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeac0fe0e0 msgr2=0x7efeac0702e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-07T12:28:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb115f700 1 --2- 172.21.15.47:0/37717355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeac0fe0e0 0x7efeac0702e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.709+0000 7efeb115f700 1 -- 172.21.15.47:0/37717355 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c0048f0 con 0x7efeac0fcef0 2024-02-07T12:28:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.710+0000 7efeb115f700 1 --2- 172.21.15.47:0/37717355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efeac0fcef0 0x7efeac071e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00b700 tx=0x7efe9c009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:18.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.710+0000 7efea9ffb700 1 -- 172.21.15.47:0/37717355 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe9c00e040 con 0x7efeac0fcef0 2024-02-07T12:28:18.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.710+0000 7efea9ffb700 1 -- 172.21.15.47:0/37717355 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe9c00be00 con 0x7efeac0fcef0 2024-02-07T12:28:18.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.710+0000 7efeb33c3700 1 -- 172.21.15.47:0/37717355 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeac070cd0 con 0x7efeac0fcef0 2024-02-07T12:28:18.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.710+0000 7efea9ffb700 1 -- 172.21.15.47:0/37717355 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe9c01c8a0 con 0x7efeac0fcef0 2024-02-07T12:28:18.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.710+0000 7efeb33c3700 1 -- 172.21.15.47:0/37717355 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac1159c0 con 0x7efeac0fcef0 2024-02-07T12:28:18.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.711+0000 7efeb33c3700 1 -- 172.21.15.47:0/37717355 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeac04bed0 con 0x7efeac0fcef0 2024-02-07T12:28:18.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.712+0000 7efea9ffb700 1 -- 172.21.15.47:0/37717355 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 33) v1 ==== 91309+0+0 (secure 0 0 0) 0x7efe9c01ca50 con 0x7efeac0fcef0 2024-02-07T12:28:18.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.712+0000 7efea9ffb700 1 --2- 172.21.15.47:0/37717355 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7efe9406d200 0x7efe9406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:18.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.712+0000 7efea9ffb700 1 -- 172.21.15.47:0/37717355 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7efe9c08e590 con 0x7efeac0fcef0 2024-02-07T12:28:18.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.712+0000 7efeb095e700 1 --2- 172.21.15.47:0/37717355 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7efe9406d200 0x7efe9406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:18.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.713+0000 7efeb095e700 1 --2- 172.21.15.47:0/37717355 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7efe9406d200 0x7efe9406f6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efea00041d0 tx=0x7efea0009f50 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:18.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.717+0000 7efea9ffb700 1 -- 172.21.15.47:0/37717355 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7efe9c05bf20 con 0x7efeac0fcef0 2024-02-07T12:28:18.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.939+0000 7efeb33c3700 1 -- 172.21.15.47:0/37717355 --> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efeac102ac0 con 0x7efe9406d200 2024-02-07T12:28:18.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.941+0000 7efea9ffb700 1 -- 172.21.15.47:0/37717355 <== mgr.14774 v2:172.21.15.47:6800/1750591204 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7efeac102ac0 con 0x7efe9406d200 2024-02-07T12:28:18.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.942+0000 7efeb33c3700 1 -- 172.21.15.47:0/37717355 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7efe9406d200 msgr2=0x7efe9406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:18.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.942+0000 7efeb33c3700 1 --2- 172.21.15.47:0/37717355 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7efe9406d200 0x7efe9406f6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efea00041d0 tx=0x7efea0009f50 comp rx=0 tx=0).stop 2024-02-07T12:28:18.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.942+0000 7efeb33c3700 1 -- 172.21.15.47:0/37717355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efeac0fcef0 msgr2=0x7efeac071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:18.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.942+0000 7efeb33c3700 1 --2- 172.21.15.47:0/37717355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efeac0fcef0 0x7efeac071e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00b700 tx=0x7efe9c009ca0 comp rx=0 tx=0).stop 2024-02-07T12:28:18.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.942+0000 7efeb33c3700 1 -- 172.21.15.47:0/37717355 shutdown_connections 2024-02-07T12:28:18.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.942+0000 7efeb33c3700 1 --2- 172.21.15.47:0/37717355 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7efe9406d200 0x7efe9406f6b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:18.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.942+0000 7efeb33c3700 1 --2- 172.21.15.47:0/37717355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efeac0fcef0 0x7efeac071e60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:18.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.942+0000 7efeb33c3700 1 --2- 172.21.15.47:0/37717355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeac0fe0e0 0x7efeac0702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:18.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.942+0000 7efeb33c3700 1 -- 172.21.15.47:0/37717355 >> 172.21.15.47:0/37717355 conn(0x7efeac0f8620 msgr2=0x7efeac1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:18.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.942+0000 7efeb33c3700 1 -- 172.21.15.47:0/37717355 shutdown_connections 2024-02-07T12:28:18.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:18.942+0000 7efeb33c3700 1 -- 172.21.15.47:0/37717355 wait complete. 2024-02-07T12:28:18.956 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:28:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.046+0000 7f78eb1b0700 1 -- 172.21.15.47:0/3365977523 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e40fe0e0 msgr2=0x7f78e40fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.046+0000 7f78eb1b0700 1 --2- 172.21.15.47:0/3365977523 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e40fe0e0 0x7f78e40fe550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f78d00048b0 tx=0x7f78d0009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.046+0000 7f78eb1b0700 1 -- 172.21.15.47:0/3365977523 shutdown_connections 2024-02-07T12:28:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.046+0000 7f78eb1b0700 1 --2- 172.21.15.47:0/3365977523 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e40fe0e0 0x7f78e40fe550 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.046+0000 7f78eb1b0700 1 --2- 172.21.15.47:0/3365977523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e40fcef0 0x7f78e40fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.046+0000 7f78eb1b0700 1 -- 172.21.15.47:0/3365977523 >> 172.21.15.47:0/3365977523 conn(0x7f78e40f8620 msgr2=0x7f78e40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.046+0000 7f78eb1b0700 1 -- 172.21.15.47:0/3365977523 shutdown_connections 2024-02-07T12:28:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.046+0000 7f78eb1b0700 1 -- 172.21.15.47:0/3365977523 wait complete. 2024-02-07T12:28:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.046+0000 7f78eb1b0700 1 Processor -- start 2024-02-07T12:28:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.046+0000 7f78eb1b0700 1 -- start start 2024-02-07T12:28:19.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78eb1b0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e40fcef0 0x7f78e410fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:19.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78eb1b0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e40fe0e0 0x7f78e4110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:19.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78eb1b0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e4110640 con 0x7f78e40fcef0 2024-02-07T12:28:19.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78eb1b0700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e4110ee0 con 0x7f78e40fe0e0 2024-02-07T12:28:19.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78e8f4c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e40fcef0 0x7f78e410fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:19.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78e8f4c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e40fcef0 0x7f78e410fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44908/0 (socket says 172.21.15.47:44908) 2024-02-07T12:28:19.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78e8f4c700 1 -- 172.21.15.47:0/1075543357 learned_addr learned my addr 172.21.15.47:0/1075543357 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:28:19.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78e8f4c700 1 -- 172.21.15.47:0/1075543357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e40fcef0 msgr2=0x7f78e410fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-07T12:28:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78e8f4c700 1 -- 172.21.15.47:0/1075543357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e40fcef0 msgr2=0x7f78e410fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-07T12:28:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78e8f4c700 1 --2- 172.21.15.47:0/1075543357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e40fcef0 0x7f78e410fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-07T12:28:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78e3fff700 1 --2- 172.21.15.47:0/1075543357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e40fe0e0 0x7f78e4110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78e8f4c700 1 --2- 172.21.15.47:0/1075543357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e40fcef0 0x7f78e410fb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-07T12:28:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78e3fff700 1 -- 172.21.15.47:0/1075543357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e40fcef0 msgr2=0x7f78e410fb00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-07T12:28:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78e3fff700 1 --2- 172.21.15.47:0/1075543357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e40fcef0 0x7f78e410fb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78e3fff700 1 -- 172.21.15.47:0/1075543357 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d0005040 con 0x7f78e40fe0e0 2024-02-07T12:28:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.047+0000 7f78e3fff700 1 --2- 172.21.15.47:0/1075543357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e40fe0e0 0x7f78e4110040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f78d0000c00 tx=0x7f78d0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.048+0000 7f78e17fa700 1 -- 172.21.15.47:0/1075543357 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78d0020070 con 0x7f78e40fe0e0 2024-02-07T12:28:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.048+0000 7f78eb1b0700 1 -- 172.21.15.47:0/1075543357 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e4111160 con 0x7f78e40fe0e0 2024-02-07T12:28:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.048+0000 7f78e17fa700 1 -- 172.21.15.47:0/1075543357 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78d0014d30 con 0x7f78e40fe0e0 2024-02-07T12:28:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.048+0000 7f78e17fa700 1 -- 172.21.15.47:0/1075543357 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78d000e040 con 0x7f78e40fe0e0 2024-02-07T12:28:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.048+0000 7f78eb1b0700 1 -- 172.21.15.47:0/1075543357 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e4111640 con 0x7f78e40fe0e0 2024-02-07T12:28:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.048+0000 7f78eb1b0700 1 -- 172.21.15.47:0/1075543357 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e4102210 con 0x7f78e40fe0e0 2024-02-07T12:28:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.049+0000 7f78e17fa700 1 -- 172.21.15.47:0/1075543357 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 33) v1 ==== 91309+0+0 (secure 0 0 0) 0x7f78d001ca90 con 0x7f78e40fe0e0 2024-02-07T12:28:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.050+0000 7f78e17fa700 1 --2- 172.21.15.47:0/1075543357 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f78d406d200 0x7f78d406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.050+0000 7f78e17fa700 1 -- 172.21.15.47:0/1075543357 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f78d008dce0 con 0x7f78e40fe0e0 2024-02-07T12:28:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.050+0000 7f78e8f4c700 1 --2- 172.21.15.47:0/1075543357 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f78d406d200 0x7f78d406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.050+0000 7f78e8f4c700 1 --2- 172.21.15.47:0/1075543357 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f78d406d200 0x7f78d406f6b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009fd0 tx=0x7f78d8009f20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:19.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.054+0000 7f78e17fa700 1 -- 172.21.15.47:0/1075543357 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f78d005b6f0 con 0x7f78e40fe0e0 2024-02-07T12:28:19.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.278+0000 7f78eb1b0700 1 -- 172.21.15.47:0/1075543357 --> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f78e402b3b0 con 0x7f78d406d200 2024-02-07T12:28:19.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.279+0000 7f78e17fa700 1 -- 172.21.15.47:0/1075543357 <== mgr.14774 v2:172.21.15.47:6800/1750591204 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f78e402b3b0 con 0x7f78d406d200 2024-02-07T12:28:19.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.281+0000 7f78eb1b0700 1 -- 172.21.15.47:0/1075543357 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f78d406d200 msgr2=0x7f78d406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:19.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.281+0000 7f78eb1b0700 1 --2- 172.21.15.47:0/1075543357 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f78d406d200 0x7f78d406f6b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009fd0 tx=0x7f78d8009f20 comp rx=0 tx=0).stop 2024-02-07T12:28:19.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.281+0000 7f78eb1b0700 1 -- 172.21.15.47:0/1075543357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e40fe0e0 msgr2=0x7f78e4110040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:19.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.281+0000 7f78eb1b0700 1 --2- 172.21.15.47:0/1075543357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e40fe0e0 0x7f78e4110040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f78d0000c00 tx=0x7f78d0009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:19.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.281+0000 7f78eb1b0700 1 -- 172.21.15.47:0/1075543357 shutdown_connections 2024-02-07T12:28:19.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.281+0000 7f78eb1b0700 1 --2- 172.21.15.47:0/1075543357 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7f78d406d200 0x7f78d406f6b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:19.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.281+0000 7f78eb1b0700 1 --2- 172.21.15.47:0/1075543357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e40fcef0 0x7f78e410fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:19.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.281+0000 7f78eb1b0700 1 --2- 172.21.15.47:0/1075543357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78e40fe0e0 0x7f78e4110040 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:19.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.281+0000 7f78eb1b0700 1 -- 172.21.15.47:0/1075543357 >> 172.21.15.47:0/1075543357 conn(0x7f78e40f8620 msgr2=0x7f78e40ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:19.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.281+0000 7f78eb1b0700 1 -- 172.21.15.47:0/1075543357 shutdown_connections 2024-02-07T12:28:19.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.281+0000 7f78eb1b0700 1 -- 172.21.15.47:0/1075543357 wait complete. 2024-02-07T12:28:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.384+0000 7fe40c379700 1 -- 172.21.15.47:0/3289930494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4040fcef0 msgr2=0x7fe4040fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.384+0000 7fe40c379700 1 --2- 172.21.15.47:0/3289930494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4040fcef0 0x7fe4040fd320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe4000048b0 tx=0x7fe400009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.384+0000 7fe40c379700 1 -- 172.21.15.47:0/3289930494 shutdown_connections 2024-02-07T12:28:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.384+0000 7fe40c379700 1 --2- 172.21.15.47:0/3289930494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4040fe0e0 0x7fe4040fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.384+0000 7fe40c379700 1 --2- 172.21.15.47:0/3289930494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4040fcef0 0x7fe4040fd320 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.384+0000 7fe40c379700 1 -- 172.21.15.47:0/3289930494 >> 172.21.15.47:0/3289930494 conn(0x7fe4040f8620 msgr2=0x7fe4040faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.384+0000 7fe40c379700 1 -- 172.21.15.47:0/3289930494 shutdown_connections 2024-02-07T12:28:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.384+0000 7fe40c379700 1 -- 172.21.15.47:0/3289930494 wait complete. 2024-02-07T12:28:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.384+0000 7fe40c379700 1 Processor -- start 2024-02-07T12:28:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.384+0000 7fe40c379700 1 -- start start 2024-02-07T12:28:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe40c379700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4040fcef0 0x7fe40410d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe40c379700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4040fe0e0 0x7fe40410de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe40c379700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40410e440 con 0x7fe4040fcef0 2024-02-07T12:28:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe40c379700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40410ece0 con 0x7fe4040fe0e0 2024-02-07T12:28:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe40a115700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4040fcef0 0x7fe40410d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe40a115700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4040fcef0 0x7fe40410d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44932/0 (socket says 172.21.15.47:44932) 2024-02-07T12:28:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe40a115700 1 -- 172.21.15.47:0/3974715133 learned_addr learned my addr 172.21.15.47:0/3974715133 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:28:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe40a115700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4040fcef0 msgr2=0x7fe40410d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-07T12:28:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe40a115700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4040fcef0 msgr2=0x7fe40410d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-07T12:28:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4040fcef0 0x7fe40410d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-07T12:28:19.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4040fcef0 0x7fe40410d900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-07T12:28:19.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe409914700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4040fe0e0 0x7fe40410de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe409914700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4040fcef0 msgr2=0x7fe40410d900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-07T12:28:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe409914700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4040fcef0 0x7fe40410d900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe409914700 1 -- 172.21.15.47:0/3974715133 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400005040 con 0x7fe4040fe0e0 2024-02-07T12:28:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.385+0000 7fe409914700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4040fe0e0 0x7fe40410de40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4002a50 tx=0x7fe3f4009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.386+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3f4007cc0 con 0x7fe4040fe0e0 2024-02-07T12:28:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.386+0000 7fe40c379700 1 -- 172.21.15.47:0/3974715133 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40410efc0 con 0x7fe4040fe0e0 2024-02-07T12:28:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.386+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3f400f040 con 0x7fe4040fe0e0 2024-02-07T12:28:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.386+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3f400da60 con 0x7fe4040fe0e0 2024-02-07T12:28:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.386+0000 7fe40c379700 1 -- 172.21.15.47:0/3974715133 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40410f500 con 0x7fe4040fe0e0 2024-02-07T12:28:19.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.386+0000 7fe40c379700 1 -- 172.21.15.47:0/3974715133 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe40404bed0 con 0x7fe4040fe0e0 2024-02-07T12:28:19.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.387+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 33) v1 ==== 91309+0+0 (secure 0 0 0) 0x7fe3f400dbc0 con 0x7fe4040fe0e0 2024-02-07T12:28:19.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.388+0000 7fe3faffd700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe3f006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:19.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.388+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe3f408cc50 con 0x7fe4040fe0e0 2024-02-07T12:28:19.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.388+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe3f006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:19.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.388+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe3f006f6b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe400009fd0 tx=0x7fe400009e30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:19.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.392+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe3f405a5e0 con 0x7fe4040fe0e0 2024-02-07T12:28:19.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.564+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mgrmap(e 34) v1 ==== 91587+0+0 (secure 0 0 0) 0x7fe3f4056e80 con 0x7fe4040fe0e0 2024-02-07T12:28:19.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.590+0000 7fe40a115700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 msgr2=0x7fe3f006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-02-07T12:28:19.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.590+0000 7fe40a115700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 msgr2=0x7fe3f006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-07T12:28:19.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.590+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe3f006f6b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe400009fd0 tx=0x7fe400009e30 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-07T12:28:19.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.590+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe3f006f6b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe400009fd0 tx=0x7fe400009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:19.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.590+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 msgr2=0x7fe3f006f6b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-02-07T12:28:19.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:19.590+0000 7fe3faffd700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe3f006f6b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:19.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:28:19.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:28:19.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: pgmap v22: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:19.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: pgmap v23: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:19.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: from='client.24553 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:28:19.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: mon.smithi047 calling monitor election 2024-02-07T12:28:19.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: mon.smithi047 is new leader, mons smithi047,smithi138 in quorum (ranks 0,1) 2024-02-07T12:28:19.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: monmap e2: 2 mons at {smithi047=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0],smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-07T12:28:19.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:28:19.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: osdmap e49: 6 total, 6 up, 6 in 2024-02-07T12:28:19.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: mgrmap e33: smithi047.zhgnrm(active, since 40s), standbys: smithi138.fiugmj 2024-02-07T12:28:19.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: from='mgr.14774 ' entity='' 2024-02-07T12:28:19.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: mgrmap e34: smithi047.zhgnrm(active, since 40s), standbys: smithi138.fiugmj 2024-02-07T12:28:19.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:19 smithi047 ceph-mon[93224]: overall HEALTH_OK 2024-02-07T12:28:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:28:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: from='mgr.14774 172.21.15.47:0/2375542396' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:28:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: pgmap v22: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: pgmap v23: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: from='client.24553 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:28:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: mon.smithi047 calling monitor election 2024-02-07T12:28:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: mon.smithi047 is new leader, mons smithi047,smithi138 in quorum (ranks 0,1) 2024-02-07T12:28:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: monmap e2: 2 mons at {smithi047=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0],smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-07T12:28:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:28:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: osdmap e49: 6 total, 6 up, 6 in 2024-02-07T12:28:20.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: mgrmap e33: smithi047.zhgnrm(active, since 40s), standbys: smithi138.fiugmj 2024-02-07T12:28:20.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: from='mgr.14774 ' entity='' 2024-02-07T12:28:20.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: mgrmap e34: smithi047.zhgnrm(active, since 40s), standbys: smithi138.fiugmj 2024-02-07T12:28:20.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:19 smithi138 ceph-mon[35528]: overall HEALTH_OK 2024-02-07T12:28:20.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:20.388+0000 7fe3f97fa700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe404102ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:20.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:20.388+0000 7fe3f97fa700 1 -- 172.21.15.47:0/3974715133 --> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe40410f960 con 0x7fe3f006d200 2024-02-07T12:28:20.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:20.388+0000 7fe40a115700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 msgr2=0x7fe404102ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/1750591204 2024-02-07T12:28:20.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:20.388+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe404102ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-07T12:28:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:20.589+0000 7fe40a115700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 msgr2=0x7fe404102ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/1750591204 2024-02-07T12:28:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:20.589+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe404102ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-07T12:28:20.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:20.990+0000 7fe40a115700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 msgr2=0x7fe404102ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/1750591204 2024-02-07T12:28:20.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:20.990+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe404102ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-07T12:28:21.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:21.791+0000 7fe40a115700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 msgr2=0x7fe404102ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/1750591204 2024-02-07T12:28:21.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:21.791+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe404102ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-07T12:28:23.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:23.392+0000 7fe40a115700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 msgr2=0x7fe404102ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/1750591204 2024-02-07T12:28:23.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:23.392+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe404102ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-07T12:28:26.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:26.460+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 <== mon.1 v2:172.21.15.138:3300/0 8 ==== mgrmap(e 35) v1 ==== 91587+0+0 (secure 0 0 0) 0x7fe3f401aa30 con 0x7fe4040fe0e0 2024-02-07T12:28:26.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:26 smithi047 ceph-mon[93224]: Standby manager daemon smithi138.fiugmj restarted 2024-02-07T12:28:26.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:26 smithi047 ceph-mon[93224]: Standby manager daemon smithi138.fiugmj started 2024-02-07T12:28:26.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:26 smithi047 ceph-mon[93224]: from='mgr.? 172.21.15.138:0/281027072' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/crt"}]: dispatch 2024-02-07T12:28:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:26 smithi047 ceph-mon[93224]: from='mgr.? 172.21.15.138:0/281027072' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:28:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:26 smithi047 ceph-mon[93224]: from='mgr.? 172.21.15.138:0/281027072' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/key"}]: dispatch 2024-02-07T12:28:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:26 smithi047 ceph-mon[93224]: from='mgr.? 172.21.15.138:0/281027072' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:28:26.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:26.596+0000 7fe40a115700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 msgr2=0x7fe404102ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/1750591204 2024-02-07T12:28:26.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:26.596+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe404102ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-07T12:28:26.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:26.601+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 <== mon.1 v2:172.21.15.138:3300/0 9 ==== mgrmap(e 36) v1 ==== 91110+0+0 (secure 0 0 0) 0x7fe3f4057750 con 0x7fe4040fe0e0 2024-02-07T12:28:26.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:26.602+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 msgr2=0x7fe404102ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-07T12:28:26.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:26.602+0000 7fe3faffd700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe404102ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:26.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:26 smithi138 ceph-mon[35528]: Standby manager daemon smithi138.fiugmj restarted 2024-02-07T12:28:26.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:26 smithi138 ceph-mon[35528]: Standby manager daemon smithi138.fiugmj started 2024-02-07T12:28:26.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:26 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/281027072' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/crt"}]: dispatch 2024-02-07T12:28:26.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:26 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/281027072' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-07T12:28:26.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:26 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/281027072' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.fiugmj/key"}]: dispatch 2024-02-07T12:28:26.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:26 smithi138 ceph-mon[35528]: from='mgr.? 172.21.15.138:0/281027072' entity='mgr.smithi138.fiugmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-07T12:28:26.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:26 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138[35510]: 2024-02-07T12:28:26.594+0000 7f641e7e8700 -1 mon.smithi138@1(peon).osd e50 update_from_paxos full map CRC mismatch, resetting to canonical 2024-02-07T12:28:27.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.604+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 <== mon.1 v2:172.21.15.138:3300/0 10 ==== mgrmap(e 37) v1 ==== 91237+0+0 (secure 0 0 0) 0x7fe3f407a5f0 con 0x7fe4040fe0e0 2024-02-07T12:28:27.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.604+0000 7fe3faffd700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe3f0027190 0x7fe3f0027560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:27.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.604+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe40410f960 con 0x7fe3f0027190 2024-02-07T12:28:27.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.605+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe3f0027190 0x7fe3f0027560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:27.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.606+0000 7fe40a115700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe3f0027190 0x7fe3f0027560 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe400004880 tx=0x7fe400009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:27.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.617+0000 7fe3faffd700 1 -- 172.21.15.47:0/3974715133 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe40410f960 con 0x7fe3f0027190 2024-02-07T12:28:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:28:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (2m) 18s ago 10m 15.3M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:28:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (11m) 18s ago 11m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 bca7317ed169 2024-02-07T12:28:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (10m) 20s ago 10m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 110c84c6624b 2024-02-07T12:28:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (81s) 18s ago 10m 75.8M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:28:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (5m) 18s ago 5m 111M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:28:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (5m) 18s ago 5m 129M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:28:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (5m) 20s ago 5m 68.2M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:28:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (5m) 20s ago 5m 69.5M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:28:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (60s) 18s ago 12m 492M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:28:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (23s) 20s ago 10m 66.0M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:28:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (12m) 18s ago 12m 53.5M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 105826d9ef9a 2024-02-07T12:28:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (9m) 20s ago 9m 43.6M 2048M 17.2.7-491-gf2462625 4ad3622d1b31 02dfa0b8d573 2024-02-07T12:28:27.621 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (2m) 18s ago 11m 8124k - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:28:27.621 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (66s) 20s ago 10m 15.7M - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:28:27.621 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (9m) 18s ago 9m 214M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 4f37918f583a 2024-02-07T12:28:27.621 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (8m) 18s ago 8m 229M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 1c6e3c603ed3 2024-02-07T12:28:27.621 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (8m) 18s ago 8m 179M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:28:27.621 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (7m) 20s ago 7m 264M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:28:27.621 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (7m) 20s ago 7m 234M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:28:27.621 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (7m) 20s ago 7m 218M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:28:27.621 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (29s) 18s ago 10m 37.9M - 2.43.0 a07b618ecd1d 32840d82c54b 2024-02-07T12:28:27.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.619+0000 7fe40c379700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe3f0027190 msgr2=0x7fe3f0027560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:27.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.619+0000 7fe40c379700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe3f0027190 0x7fe3f0027560 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe400004880 tx=0x7fe400009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:27.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.619+0000 7fe40c379700 1 -- 172.21.15.47:0/3974715133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4040fe0e0 msgr2=0x7fe40410de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:27.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.619+0000 7fe40c379700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4040fe0e0 0x7fe40410de40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4002a50 tx=0x7fe3f4009f90 comp rx=0 tx=0).stop 2024-02-07T12:28:27.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.619+0000 7fe40c379700 1 -- 172.21.15.47:0/3974715133 shutdown_connections 2024-02-07T12:28:27.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.619+0000 7fe40c379700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/1750591204,v1:172.21.15.47:6801/1750591204] conn(0x7fe3f006d200 0x7fe404102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:27.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.619+0000 7fe40c379700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4040fcef0 0x7fe40410d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:27.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.619+0000 7fe40c379700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe3f0027190 0x7fe3f0027560 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:27.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.619+0000 7fe40c379700 1 --2- 172.21.15.47:0/3974715133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4040fe0e0 0x7fe40410de40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:27.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.619+0000 7fe40c379700 1 -- 172.21.15.47:0/3974715133 >> 172.21.15.47:0/3974715133 conn(0x7fe4040f8620 msgr2=0x7fe4041013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:27.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.619+0000 7fe40c379700 1 -- 172.21.15.47:0/3974715133 shutdown_connections 2024-02-07T12:28:27.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.619+0000 7fe40c379700 1 -- 172.21.15.47:0/3974715133 wait complete. 2024-02-07T12:28:27.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.722+0000 7f553fff5700 1 -- 172.21.15.47:0/1238747134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55380fbe40 msgr2=0x7f55380fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:27.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.722+0000 7f553fff5700 1 --2- 172.21.15.47:0/1238747134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55380fbe40 0x7f55380fc250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5534004940 tx=0x7f5534009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:27.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.722+0000 7f553fff5700 1 -- 172.21.15.47:0/1238747134 shutdown_connections 2024-02-07T12:28:27.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.722+0000 7f553fff5700 1 --2- 172.21.15.47:0/1238747134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55380fcfb0 0x7f55380fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:27.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.722+0000 7f553fff5700 1 --2- 172.21.15.47:0/1238747134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55380fbe40 0x7f55380fc250 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:27.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.722+0000 7f553fff5700 1 -- 172.21.15.47:0/1238747134 >> 172.21.15.47:0/1238747134 conn(0x7f55380f74e0 msgr2=0x7f55380f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:27.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.722+0000 7f553fff5700 1 -- 172.21.15.47:0/1238747134 shutdown_connections 2024-02-07T12:28:27.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.722+0000 7f553fff5700 1 -- 172.21.15.47:0/1238747134 wait complete. 2024-02-07T12:28:27.725 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: mgrmap e35: smithi047.zhgnrm(active, since 47s), standbys: smithi138.fiugmj 2024-02-07T12:28:27.726 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: Active manager daemon smithi047.zhgnrm restarted 2024-02-07T12:28:27.726 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: Activating manager daemon smithi047.zhgnrm 2024-02-07T12:28:27.726 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: osdmap e50: 6 total, 6 up, 6 in 2024-02-07T12:28:27.726 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: mgrmap e36: smithi047.zhgnrm(active, starting, since 0.00522327s), standbys: smithi138.fiugmj 2024-02-07T12:28:27.726 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: failed to encode map e50 with expected crc 2024-02-07T12:28:27.726 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:28:27.726 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:28:27.726 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:28:27.726 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:28:27.726 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:28:27.726 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:28:27.726 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi047.zhgnrm", "id": "smithi047.zhgnrm"}]: dispatch 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi138.fiugmj", "id": "smithi138.fiugmj"}]: dispatch 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: failed to encode map e50 with expected crc 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: failed to encode map e50 with expected crc 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: failed to encode map e50 with expected crc 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-07T12:28:27.727 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: Manager daemon smithi047.zhgnrm is now available 2024-02-07T12:28:27.728 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:27.728 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:27.728 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:28:27.728 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/mirror_snapshot_schedule"}]: dispatch 2024-02-07T12:28:27.728 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/trash_purge_schedule"}]: dispatch 2024-02-07T12:28:27.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.723+0000 7f553fff5700 1 Processor -- start 2024-02-07T12:28:27.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.723+0000 7f553fff5700 1 -- start start 2024-02-07T12:28:27.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.723+0000 7f553fff5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55380fbe40 0x7f5538110660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:27.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.723+0000 7f553fff5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55380fcfb0 0x7f5538112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:27.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.723+0000 7f553fff5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5538066460 con 0x7f55380fbe40 2024-02-07T12:28:27.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.723+0000 7f553fff5700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55380665a0 con 0x7f55380fcfb0 2024-02-07T12:28:27.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.723+0000 7f553dd91700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55380fbe40 0x7f5538110660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:27.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.723+0000 7f553dd91700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55380fbe40 0x7f5538110660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60792/0 (socket says 172.21.15.47:60792) 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.723+0000 7f553dd91700 1 -- 172.21.15.47:0/3802360473 learned_addr learned my addr 172.21.15.47:0/3802360473 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.723+0000 7f553d590700 1 --2- 172.21.15.47:0/3802360473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55380fcfb0 0x7f5538112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.724+0000 7f553dd91700 1 -- 172.21.15.47:0/3802360473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55380fcfb0 msgr2=0x7f5538112bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.724+0000 7f553dd91700 1 --2- 172.21.15.47:0/3802360473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55380fcfb0 0x7f5538112bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.724+0000 7f553dd91700 1 -- 172.21.15.47:0/3802360473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5534005040 con 0x7f55380fbe40 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.724+0000 7f553dd91700 1 --2- 172.21.15.47:0/3802360473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55380fbe40 0x7f5538110660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f55340093b0 tx=0x7f5534009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.724+0000 7f552e7fc700 1 -- 172.21.15.47:0/3802360473 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f553400e040 con 0x7f55380fbe40 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.724+0000 7f552e7fc700 1 -- 172.21.15.47:0/3802360473 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f553400bcc0 con 0x7f55380fbe40 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.724+0000 7f553fff5700 1 -- 172.21.15.47:0/3802360473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55381131b0 con 0x7f55380fbe40 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.724+0000 7f552e7fc700 1 -- 172.21.15.47:0/3802360473 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f553401c630 con 0x7f55380fbe40 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.724+0000 7f553fff5700 1 -- 172.21.15.47:0/3802360473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55381136f0 con 0x7f55380fbe40 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.725+0000 7f553fff5700 1 -- 172.21.15.47:0/3802360473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553804bed0 con 0x7f55380fbe40 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.726+0000 7f552e7fc700 1 -- 172.21.15.47:0/3802360473 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 37) v1 ==== 91245+0+0 (secure 0 0 0) 0x7f5534013980 con 0x7f55380fbe40 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.726+0000 7f552e7fc700 1 --2- 172.21.15.47:0/3802360473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f552406d4e0 0x7f552406f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:27.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.726+0000 7f552e7fc700 1 -- 172.21.15.47:0/3802360473 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f553408ddd0 con 0x7f55380fbe40 2024-02-07T12:28:27.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.726+0000 7f553d590700 1 --2- 172.21.15.47:0/3802360473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f552406d4e0 0x7f552406f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:27.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.726+0000 7f553d590700 1 --2- 172.21.15.47:0/3802360473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f552406d4e0 0x7f552406f990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5528004f40 tx=0x7f552800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:27.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:27.731+0000 7f552e7fc700 1 -- 172.21.15.47:0/3802360473 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5534057900 con 0x7f55380fbe40 2024-02-07T12:28:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: mgrmap e35: smithi047.zhgnrm(active, since 47s), standbys: smithi138.fiugmj 2024-02-07T12:28:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: Active manager daemon smithi047.zhgnrm restarted 2024-02-07T12:28:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: Activating manager daemon smithi047.zhgnrm 2024-02-07T12:28:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: osdmap e50: 6 total, 6 up, 6 in 2024-02-07T12:28:27.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: mgrmap e36: smithi047.zhgnrm(active, starting, since 0.00522327s), standbys: smithi138.fiugmj 2024-02-07T12:28:27.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: failed to encode map e50 with expected crc 2024-02-07T12:28:27.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:28:27.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:28:27.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:28:27.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:28:27.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:28:27.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:28:27.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi047.zhgnrm", "id": "smithi047.zhgnrm"}]: dispatch 2024-02-07T12:28:27.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr metadata", "who": "smithi138.fiugmj", "id": "smithi138.fiugmj"}]: dispatch 2024-02-07T12:28:27.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:28:27.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:28:27.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:28:27.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:28:27.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:28:27.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: failed to encode map e50 with expected crc 2024-02-07T12:28:27.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: failed to encode map e50 with expected crc 2024-02-07T12:28:27.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: failed to encode map e50 with expected crc 2024-02-07T12:28:27.787 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:28:27.788 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-07T12:28:27.788 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-07T12:28:27.788 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-07T12:28:27.788 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: Manager daemon smithi047.zhgnrm is now available 2024-02-07T12:28:27.788 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:27.788 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:27.788 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:28:27.788 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/mirror_snapshot_schedule"}]: dispatch 2024-02-07T12:28:27.788 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:27 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.zhgnrm/trash_purge_schedule"}]: dispatch 2024-02-07T12:28:28.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.023+0000 7f553fff5700 1 -- 172.21.15.47:0/3802360473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5538113b30 con 0x7f55380fbe40 2024-02-07T12:28:28.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.024+0000 7f552e7fc700 1 -- 172.21.15.47:0/3802360473 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f553405afc0 con 0x7f55380fbe40 2024-02-07T12:28:28.026 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:28:28.027 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:28:28.027 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 1, 2024-02-07T12:28:28.027 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 1 2024-02-07T12:28:28.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:28:28.027 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:28:28.027 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:28:28.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:28:28.027 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:28:28.027 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 6 2024-02-07T12:28:28.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:28:28.027 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:28:28.027 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:28:28.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:28:28.028 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:28:28.028 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 11, 2024-02-07T12:28:28.028 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 3 2024-02-07T12:28:28.028 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:28:28.028 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:28:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.026+0000 7f553fff5700 1 -- 172.21.15.47:0/3802360473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f552406d4e0 msgr2=0x7f552406f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.026+0000 7f553fff5700 1 --2- 172.21.15.47:0/3802360473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f552406d4e0 0x7f552406f990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5528004f40 tx=0x7f552800b040 comp rx=0 tx=0).stop 2024-02-07T12:28:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.026+0000 7f553fff5700 1 -- 172.21.15.47:0/3802360473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55380fbe40 msgr2=0x7f5538110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.026+0000 7f553fff5700 1 --2- 172.21.15.47:0/3802360473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55380fbe40 0x7f5538110660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f55340093b0 tx=0x7f5534009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.026+0000 7f553fff5700 1 -- 172.21.15.47:0/3802360473 shutdown_connections 2024-02-07T12:28:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.026+0000 7f553fff5700 1 --2- 172.21.15.47:0/3802360473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55380fbe40 0x7f5538110660 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.026+0000 7f553fff5700 1 --2- 172.21.15.47:0/3802360473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f552406d4e0 0x7f552406f990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.026+0000 7f553fff5700 1 --2- 172.21.15.47:0/3802360473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55380fcfb0 0x7f5538112bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.026+0000 7f553fff5700 1 -- 172.21.15.47:0/3802360473 >> 172.21.15.47:0/3802360473 conn(0x7f55380f74e0 msgr2=0x7f5538100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.026+0000 7f553fff5700 1 -- 172.21.15.47:0/3802360473 shutdown_connections 2024-02-07T12:28:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.026+0000 7f553fff5700 1 -- 172.21.15.47:0/3802360473 wait complete. 2024-02-07T12:28:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.130+0000 7fc4088a8700 1 -- 172.21.15.47:0/3313920479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4040fc7f0 msgr2=0x7fc4040fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.130+0000 7fc4088a8700 1 --2- 172.21.15.47:0/3313920479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4040fc7f0 0x7fc4040fcc40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec004a50 tx=0x7fc3ec00af40 comp rx=0 tx=0).stop 2024-02-07T12:28:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.130+0000 7fc4088a8700 1 -- 172.21.15.47:0/3313920479 shutdown_connections 2024-02-07T12:28:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.130+0000 7fc4088a8700 1 --2- 172.21.15.47:0/3313920479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4040fc7f0 0x7fc4040fcc40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.130+0000 7fc4088a8700 1 --2- 172.21.15.47:0/3313920479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4040fb5e0 0x7fc4040fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.130+0000 7fc4088a8700 1 -- 172.21.15.47:0/3313920479 >> 172.21.15.47:0/3313920479 conn(0x7fc4040f6ca0 msgr2=0x7fc4040f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.130+0000 7fc4088a8700 1 -- 172.21.15.47:0/3313920479 shutdown_connections 2024-02-07T12:28:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.130+0000 7fc4088a8700 1 -- 172.21.15.47:0/3313920479 wait complete. 2024-02-07T12:28:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.130+0000 7fc4088a8700 1 Processor -- start 2024-02-07T12:28:28.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.130+0000 7fc4088a8700 1 -- start start 2024-02-07T12:28:28.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc4088a8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4040fb5e0 0x7fc40410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:28.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc4088a8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4040fc7f0 0x7fc40410df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:28.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc4088a8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40410e550 con 0x7fc4040fc7f0 2024-02-07T12:28:28.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc4088a8700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40410edf0 con 0x7fc4040fb5e0 2024-02-07T12:28:28.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc401d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4040fc7f0 0x7fc40410df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:28.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc401d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4040fc7f0 0x7fc40410df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60820/0 (socket says 172.21.15.47:60820) 2024-02-07T12:28:28.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc401d9b700 1 -- 172.21.15.47:0/3736627855 learned_addr learned my addr 172.21.15.47:0/3736627855 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:28:28.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc40259c700 1 --2- 172.21.15.47:0/3736627855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4040fb5e0 0x7fc40410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:28.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc401d9b700 1 -- 172.21.15.47:0/3736627855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4040fb5e0 msgr2=0x7fc40410da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:28.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc401d9b700 1 --2- 172.21.15.47:0/3736627855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4040fb5e0 0x7fc40410da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc401d9b700 1 -- 172.21.15.47:0/3736627855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec005040 con 0x7fc4040fc7f0 2024-02-07T12:28:28.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc401d9b700 1 --2- 172.21.15.47:0/3736627855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4040fc7f0 0x7fc40410df50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00aaf0 tx=0x7fc3ec00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:28.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc3faffd700 1 -- 172.21.15.47:0/3736627855 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ec00f070 con 0x7fc4040fc7f0 2024-02-07T12:28:28.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc3faffd700 1 -- 172.21.15.47:0/3736627855 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3ec00ca30 con 0x7fc4040fc7f0 2024-02-07T12:28:28.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc4088a8700 1 -- 172.21.15.47:0/3736627855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40410f070 con 0x7fc4040fc7f0 2024-02-07T12:28:28.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc3faffd700 1 -- 172.21.15.47:0/3736627855 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ec014890 con 0x7fc4040fc7f0 2024-02-07T12:28:28.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.131+0000 7fc4088a8700 1 -- 172.21.15.47:0/3736627855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40410f550 con 0x7fc4040fc7f0 2024-02-07T12:28:28.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.132+0000 7fc4088a8700 1 -- 172.21.15.47:0/3736627855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40404bed0 con 0x7fc4040fc7f0 2024-02-07T12:28:28.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.133+0000 7fc3faffd700 1 -- 172.21.15.47:0/3736627855 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 37) v1 ==== 91245+0+0 (secure 0 0 0) 0x7fc3ec014ac0 con 0x7fc4040fc7f0 2024-02-07T12:28:28.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.133+0000 7fc3faffd700 1 --2- 172.21.15.47:0/3736627855 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc3f006d4e0 0x7fc3f006f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:28.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.133+0000 7fc40259c700 1 --2- 172.21.15.47:0/3736627855 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc3f006d4e0 0x7fc3f006f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:28.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.133+0000 7fc3faffd700 1 -- 172.21.15.47:0/3736627855 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc3ec08e2d0 con 0x7fc4040fc7f0 2024-02-07T12:28:28.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.134+0000 7fc40259c700 1 --2- 172.21.15.47:0/3736627855 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc3f006d4e0 0x7fc3f006f990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc4040fc650 tx=0x7fc3f400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:28.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.138+0000 7fc3faffd700 1 -- 172.21.15.47:0/3736627855 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc3ec057e80 con 0x7fc4040fc7f0 2024-02-07T12:28:28.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.408+0000 7fc4088a8700 1 -- 172.21.15.47:0/3736627855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc404103840 con 0x7fc4040fc7f0 2024-02-07T12:28:28.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.409+0000 7fc3faffd700 1 -- 172.21.15.47:0/3736627855 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1906 (secure 0 0 0) 0x7fc3ec05b540 con 0x7fc4040fc7f0 2024-02-07T12:28:28.411 INFO:teuthology.orchestra.run.smithi047.stdout:e20 2024-02-07T12:28:28.412 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:28:28.412 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:28:28.412 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:28:28.412 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:28:28.412 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:28:28.412 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:28:28.412 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 20 2024-02-07T12:28:28.412 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:28:28.412 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:28:28.412 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:26:24.336188+0000 2024-02-07T12:28:28.412 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:28:28.412 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:28:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:28:28.414 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:28:28.414 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:28:28.414 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:28:28.414 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:28:28.414 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:28:28.414 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 export targets 1 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:28:28.414 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:28:28.414 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:28:28.414 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:28:28.414 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:28:28.414 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:28:28.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.411+0000 7fc4088a8700 1 -- 172.21.15.47:0/3736627855 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc3f006d4e0 msgr2=0x7fc3f006f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:28.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.411+0000 7fc4088a8700 1 --2- 172.21.15.47:0/3736627855 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc3f006d4e0 0x7fc3f006f990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc4040fc650 tx=0x7fc3f400b040 comp rx=0 tx=0).stop 2024-02-07T12:28:28.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.412+0000 7fc4088a8700 1 -- 172.21.15.47:0/3736627855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4040fc7f0 msgr2=0x7fc40410df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:28.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.412+0000 7fc4088a8700 1 --2- 172.21.15.47:0/3736627855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4040fc7f0 0x7fc40410df50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00aaf0 tx=0x7fc3ec00af40 comp rx=0 tx=0).stop 2024-02-07T12:28:28.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.412+0000 7fc4088a8700 1 -- 172.21.15.47:0/3736627855 shutdown_connections 2024-02-07T12:28:28.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.412+0000 7fc4088a8700 1 --2- 172.21.15.47:0/3736627855 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc3f006d4e0 0x7fc3f006f990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.412+0000 7fc4088a8700 1 --2- 172.21.15.47:0/3736627855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4040fb5e0 0x7fc40410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.412+0000 7fc4088a8700 1 --2- 172.21.15.47:0/3736627855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4040fc7f0 0x7fc40410df50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.412+0000 7fc4088a8700 1 -- 172.21.15.47:0/3736627855 >> 172.21.15.47:0/3736627855 conn(0x7fc4040f6ca0 msgr2=0x7fc4040ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:28.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.412+0000 7fc4088a8700 1 -- 172.21.15.47:0/3736627855 shutdown_connections 2024-02-07T12:28:28.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.412+0000 7fc4088a8700 1 -- 172.21.15.47:0/3736627855 wait complete. 2024-02-07T12:28:28.416 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-02-07T12:28:28.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 -- 172.21.15.47:0/211285366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99100fbe40 msgr2=0x7f99100fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:28.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 --2- 172.21.15.47:0/211285366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99100fbe40 0x7f99100fc250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9900004940 tx=0x7f9900009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:28.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 -- 172.21.15.47:0/211285366 shutdown_connections 2024-02-07T12:28:28.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 --2- 172.21.15.47:0/211285366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99100fcfb0 0x7f99100fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 --2- 172.21.15.47:0/211285366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99100fbe40 0x7f99100fc250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 -- 172.21.15.47:0/211285366 >> 172.21.15.47:0/211285366 conn(0x7f99100f74e0 msgr2=0x7f99100f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:28.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 -- 172.21.15.47:0/211285366 shutdown_connections 2024-02-07T12:28:28.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 -- 172.21.15.47:0/211285366 wait complete. 2024-02-07T12:28:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 Processor -- start 2024-02-07T12:28:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 -- start start 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99100fbe40 0x7f991010c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99100fcfb0 0x7f991010cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991010d380 con 0x7f99100fcfb0 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.516+0000 7f991518d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991010dc20 con 0x7f99100fbe40 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.517+0000 7f990e59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99100fcfb0 0x7f991010cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.517+0000 7f990e59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99100fcfb0 0x7f991010cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60842/0 (socket says 172.21.15.47:60842) 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.517+0000 7f990e59c700 1 -- 172.21.15.47:0/1160317367 learned_addr learned my addr 172.21.15.47:0/1160317367 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.517+0000 7f990ed9d700 1 --2- 172.21.15.47:0/1160317367 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99100fbe40 0x7f991010c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.517+0000 7f990e59c700 1 -- 172.21.15.47:0/1160317367 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99100fbe40 msgr2=0x7f991010c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.517+0000 7f990e59c700 1 --2- 172.21.15.47:0/1160317367 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99100fbe40 0x7f991010c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.517+0000 7f990e59c700 1 -- 172.21.15.47:0/1160317367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9900005040 con 0x7f99100fcfb0 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.517+0000 7f990e59c700 1 --2- 172.21.15.47:0/1160317367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99100fcfb0 0x7f991010cd80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f98f8002a50 tx=0x7f98f80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.517+0000 7f99077fe700 1 -- 172.21.15.47:0/1160317367 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98f8007cc0 con 0x7f99100fcfb0 2024-02-07T12:28:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.517+0000 7f99077fe700 1 -- 172.21.15.47:0/1160317367 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98f800f040 con 0x7f99100fcfb0 2024-02-07T12:28:28.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.517+0000 7f991518d700 1 -- 172.21.15.47:0/1160317367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991010df00 con 0x7f99100fcfb0 2024-02-07T12:28:28.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.517+0000 7f99077fe700 1 -- 172.21.15.47:0/1160317367 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98f800da30 con 0x7f99100fcfb0 2024-02-07T12:28:28.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.517+0000 7f991518d700 1 -- 172.21.15.47:0/1160317367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991010e440 con 0x7f99100fcfb0 2024-02-07T12:28:28.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.518+0000 7f991518d700 1 -- 172.21.15.47:0/1160317367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991004bed0 con 0x7f99100fcfb0 2024-02-07T12:28:28.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.519+0000 7f99077fe700 1 -- 172.21.15.47:0/1160317367 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 37) v1 ==== 91245+0+0 (secure 0 0 0) 0x7f98f800db90 con 0x7f99100fcfb0 2024-02-07T12:28:28.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.519+0000 7f99077fe700 1 --2- 172.21.15.47:0/1160317367 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f98fc06d4e0 0x7f98fc06f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.520+0000 7f990ed9d700 1 --2- 172.21.15.47:0/1160317367 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f98fc06d4e0 0x7f98fc06f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.520+0000 7f99077fe700 1 -- 172.21.15.47:0/1160317367 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f98f808c740 con 0x7f99100fcfb0 2024-02-07T12:28:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.520+0000 7f990ed9d700 1 --2- 172.21.15.47:0/1160317367 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f98fc06d4e0 0x7f98fc06f990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f990000b7a0 tx=0x7f9900009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:28.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.524+0000 7f99077fe700 1 -- 172.21.15.47:0/1160317367 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f98f80561f0 con 0x7f99100fcfb0 2024-02-07T12:28:28.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:28 smithi138 ceph-mon[35528]: [07/Feb/2024:12:28:26] ENGINE Bus STARTING 2024-02-07T12:28:28.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:28 smithi138 ceph-mon[35528]: [07/Feb/2024:12:28:27] ENGINE Serving on https://172.21.15.47:7150 2024-02-07T12:28:28.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:28 smithi138 ceph-mon[35528]: [07/Feb/2024:12:28:27] ENGINE Serving on http://172.21.15.47:8765 2024-02-07T12:28:28.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:28 smithi138 ceph-mon[35528]: [07/Feb/2024:12:28:27] ENGINE Bus STARTED 2024-02-07T12:28:28.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:28 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:28.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:28 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:28.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:28 smithi138 ceph-mon[35528]: mgrmap e37: smithi047.zhgnrm(active, since 1.01007s), standbys: smithi138.fiugmj 2024-02-07T12:28:28.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:28 smithi138 ceph-mon[35528]: from='client.24561 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:28:28.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:28 smithi138 ceph-mon[35528]: pgmap v3: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:28:28.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:28 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3802360473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:28:28.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:28 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/3736627855' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:28:28.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.754+0000 7f991518d700 1 -- 172.21.15.47:0/1160317367 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f991010e8e0 con 0x7f98fc06d4e0 2024-02-07T12:28:28.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:28 smithi047 ceph-mon[93224]: [07/Feb/2024:12:28:26] ENGINE Bus STARTING 2024-02-07T12:28:28.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:28 smithi047 ceph-mon[93224]: [07/Feb/2024:12:28:27] ENGINE Serving on https://172.21.15.47:7150 2024-02-07T12:28:28.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:28 smithi047 ceph-mon[93224]: [07/Feb/2024:12:28:27] ENGINE Serving on http://172.21.15.47:8765 2024-02-07T12:28:28.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:28 smithi047 ceph-mon[93224]: [07/Feb/2024:12:28:27] ENGINE Bus STARTED 2024-02-07T12:28:28.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:28 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:28.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:28 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:28.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:28 smithi047 ceph-mon[93224]: mgrmap e37: smithi047.zhgnrm(active, since 1.01007s), standbys: smithi138.fiugmj 2024-02-07T12:28:28.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:28 smithi047 ceph-mon[93224]: from='client.24561 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:28:28.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:28 smithi047 ceph-mon[93224]: pgmap v3: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:28:28.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:28 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3802360473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:28:28.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:28 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3736627855' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:28:28.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.756+0000 7f99077fe700 1 -- 172.21.15.47:0/1160317367 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f991010e8e0 con 0x7f98fc06d4e0 2024-02-07T12:28:28.759 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:28:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:28:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:28:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:28:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:28:28.759 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr" 2024-02-07T12:28:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:28:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "2/21 daemons upgraded", 2024-02-07T12:28:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "", 2024-02-07T12:28:28.760 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:28:28.760 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:28:28.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.758+0000 7f991518d700 1 -- 172.21.15.47:0/1160317367 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f98fc06d4e0 msgr2=0x7f98fc06f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:28.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.758+0000 7f991518d700 1 --2- 172.21.15.47:0/1160317367 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f98fc06d4e0 0x7f98fc06f990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f990000b7a0 tx=0x7f9900009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:28.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.758+0000 7f991518d700 1 -- 172.21.15.47:0/1160317367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99100fcfb0 msgr2=0x7f991010cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:28.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.758+0000 7f991518d700 1 --2- 172.21.15.47:0/1160317367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99100fcfb0 0x7f991010cd80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f98f8002a50 tx=0x7f98f80046b0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.758+0000 7f991518d700 1 -- 172.21.15.47:0/1160317367 shutdown_connections 2024-02-07T12:28:28.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.758+0000 7f991518d700 1 --2- 172.21.15.47:0/1160317367 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f98fc06d4e0 0x7f98fc06f990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.758+0000 7f991518d700 1 --2- 172.21.15.47:0/1160317367 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99100fbe40 0x7f991010c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.758+0000 7f991518d700 1 --2- 172.21.15.47:0/1160317367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99100fcfb0 0x7f991010cd80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.758+0000 7f991518d700 1 -- 172.21.15.47:0/1160317367 >> 172.21.15.47:0/1160317367 conn(0x7f99100f74e0 msgr2=0x7f9910100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:28.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.758+0000 7f991518d700 1 -- 172.21.15.47:0/1160317367 shutdown_connections 2024-02-07T12:28:28.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.758+0000 7f991518d700 1 -- 172.21.15.47:0/1160317367 wait complete. 2024-02-07T12:28:28.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.860+0000 7f9e51493700 1 -- 172.21.15.47:0/3352979983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4c0fc1c0 msgr2=0x7f9e4c0fc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:28.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.860+0000 7f9e51493700 1 --2- 172.21.15.47:0/3352979983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4c0fc1c0 0x7f9e4c0fc630 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9e40004940 tx=0x7f9e40009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:28.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.860+0000 7f9e51493700 1 -- 172.21.15.47:0/3352979983 shutdown_connections 2024-02-07T12:28:28.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.860+0000 7f9e51493700 1 --2- 172.21.15.47:0/3352979983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4c0fc1c0 0x7f9e4c0fc630 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.860+0000 7f9e51493700 1 --2- 172.21.15.47:0/3352979983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c0fb870 0x7f9e4c0fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.860+0000 7f9e51493700 1 -- 172.21.15.47:0/3352979983 >> 172.21.15.47:0/3352979983 conn(0x7f9e4c0f7520 msgr2=0x7f9e4c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:28.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.860+0000 7f9e51493700 1 -- 172.21.15.47:0/3352979983 shutdown_connections 2024-02-07T12:28:28.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.861+0000 7f9e51493700 1 -- 172.21.15.47:0/3352979983 wait complete. 2024-02-07T12:28:28.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.861+0000 7f9e51493700 1 Processor -- start 2024-02-07T12:28:28.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.861+0000 7f9e51493700 1 -- start start 2024-02-07T12:28:28.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.861+0000 7f9e51493700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4c0fb870 0x7f9e4c10fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:28.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.861+0000 7f9e51493700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c0fc1c0 0x7f9e4c110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:28.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.861+0000 7f9e51493700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c110600 con 0x7f9e4c0fb870 2024-02-07T12:28:28.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.861+0000 7f9e51493700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c110ea0 con 0x7f9e4c0fc1c0 2024-02-07T12:28:28.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.861+0000 7f9e4affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4c0fb870 0x7f9e4c10fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:28.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.861+0000 7f9e4affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4c0fb870 0x7f9e4c10fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60888/0 (socket says 172.21.15.47:60888) 2024-02-07T12:28:28.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.861+0000 7f9e4affd700 1 -- 172.21.15.47:0/2864647337 learned_addr learned my addr 172.21.15.47:0/2864647337 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:28:28.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.861+0000 7f9e4a7fc700 1 --2- 172.21.15.47:0/2864647337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c0fc1c0 0x7f9e4c110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:28.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.862+0000 7f9e4affd700 1 -- 172.21.15.47:0/2864647337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c0fc1c0 msgr2=0x7f9e4c110000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:28.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.862+0000 7f9e4affd700 1 --2- 172.21.15.47:0/2864647337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c0fc1c0 0x7f9e4c110000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:28.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.862+0000 7f9e4affd700 1 -- 172.21.15.47:0/2864647337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e40005040 con 0x7f9e4c0fb870 2024-02-07T12:28:28.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.862+0000 7f9e4affd700 1 --2- 172.21.15.47:0/2864647337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4c0fb870 0x7f9e4c10fac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00eb40 tx=0x7f9e3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:28.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.862+0000 7f9e337fe700 1 -- 172.21.15.47:0/2864647337 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e3c007cc0 con 0x7f9e4c0fb870 2024-02-07T12:28:28.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.862+0000 7f9e337fe700 1 -- 172.21.15.47:0/2864647337 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e3c00f040 con 0x7f9e4c0fb870 2024-02-07T12:28:28.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.862+0000 7f9e51493700 1 -- 172.21.15.47:0/2864647337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4c111120 con 0x7f9e4c0fb870 2024-02-07T12:28:28.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.862+0000 7f9e337fe700 1 -- 172.21.15.47:0/2864647337 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e3c00ca10 con 0x7f9e4c0fb870 2024-02-07T12:28:28.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.862+0000 7f9e51493700 1 -- 172.21.15.47:0/2864647337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c111660 con 0x7f9e4c0fb870 2024-02-07T12:28:28.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.863+0000 7f9e51493700 1 -- 172.21.15.47:0/2864647337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4c04bed0 con 0x7f9e4c0fb870 2024-02-07T12:28:28.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.864+0000 7f9e337fe700 1 -- 172.21.15.47:0/2864647337 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 37) v1 ==== 91245+0+0 (secure 0 0 0) 0x7f9e3c00cc80 con 0x7f9e4c0fb870 2024-02-07T12:28:28.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.864+0000 7f9e337fe700 1 --2- 172.21.15.47:0/2864647337 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9e3406d4e0 0x7f9e3406f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:28.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.864+0000 7f9e337fe700 1 -- 172.21.15.47:0/2864647337 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9e3c08c5d0 con 0x7f9e4c0fb870 2024-02-07T12:28:28.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.864+0000 7f9e4a7fc700 1 --2- 172.21.15.47:0/2864647337 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9e3406d4e0 0x7f9e3406f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:28.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.864+0000 7f9e4a7fc700 1 --2- 172.21.15.47:0/2864647337 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9e3406d4e0 0x7f9e3406f990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9e40013740 tx=0x7f9e40009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:28.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:28.869+0000 7f9e337fe700 1 -- 172.21.15.47:0/2864647337 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9e3c056130 con 0x7f9e4c0fb870 2024-02-07T12:28:29.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:29.159+0000 7f9e51493700 1 -- 172.21.15.47:0/2864647337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9e4c107c00 con 0x7f9e4c0fb870 2024-02-07T12:28:29.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:29.159+0000 7f9e337fe700 1 -- 172.21.15.47:0/2864647337 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9e3c0597f0 con 0x7f9e4c0fb870 2024-02-07T12:28:29.162 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:28:29.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:29.161+0000 7f9e51493700 1 -- 172.21.15.47:0/2864647337 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9e3406d4e0 msgr2=0x7f9e3406f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:29.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:29.161+0000 7f9e51493700 1 --2- 172.21.15.47:0/2864647337 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9e3406d4e0 0x7f9e3406f990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9e40013740 tx=0x7f9e40009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:29.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:29.161+0000 7f9e51493700 1 -- 172.21.15.47:0/2864647337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4c0fb870 msgr2=0x7f9e4c10fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:29.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:29.161+0000 7f9e51493700 1 --2- 172.21.15.47:0/2864647337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4c0fb870 0x7f9e4c10fac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00eb40 tx=0x7f9e3c00b040 comp rx=0 tx=0).stop 2024-02-07T12:28:29.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:29.161+0000 7f9e51493700 1 -- 172.21.15.47:0/2864647337 shutdown_connections 2024-02-07T12:28:29.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:29.161+0000 7f9e51493700 1 --2- 172.21.15.47:0/2864647337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4c0fb870 0x7f9e4c10fac0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:29.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:29.161+0000 7f9e51493700 1 --2- 172.21.15.47:0/2864647337 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9e3406d4e0 0x7f9e3406f990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:29.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:29.161+0000 7f9e51493700 1 --2- 172.21.15.47:0/2864647337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c0fc1c0 0x7f9e4c110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:29.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:29.161+0000 7f9e51493700 1 -- 172.21.15.47:0/2864647337 >> 172.21.15.47:0/2864647337 conn(0x7f9e4c0f7520 msgr2=0x7f9e4c103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:29.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:29.161+0000 7f9e51493700 1 -- 172.21.15.47:0/2864647337 shutdown_connections 2024-02-07T12:28:29.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:29.161+0000 7f9e51493700 1 -- 172.21.15.47:0/2864647337 wait complete. 2024-02-07T12:28:29.699 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:29 smithi047 ceph-mon[93224]: pgmap v4: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:28:29.699 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:29 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2864647337' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:28:30.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:29 smithi138 ceph-mon[35528]: pgmap v4: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:28:30.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:29 smithi138 ceph-mon[35528]: from='client.? 172.21.15.47:0/2864647337' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:28:31.011 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:30 smithi047 ceph-mon[93224]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:28:31.011 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:30 smithi047 ceph-mon[93224]: mgrmap e38: smithi047.zhgnrm(active, since 3s), standbys: smithi138.fiugmj 2024-02-07T12:28:31.011 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:30 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:31.011 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:30 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:31.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:30 smithi138 ceph-mon[35528]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:28:31.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:30 smithi138 ceph-mon[35528]: mgrmap e38: smithi047.zhgnrm(active, since 3s), standbys: smithi138.fiugmj 2024-02-07T12:28:31.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:30 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:31.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:30 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:31.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:31 smithi047 ceph-mon[93224]: pgmap v5: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:28:31.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:31 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:31.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:31 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:31.995 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:31 smithi138 ceph-mon[35528]: pgmap v5: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:28:31.996 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:31 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:31.996 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:31 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:32.986 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:32 smithi138 ceph-mon[35528]: mgrmap e39: smithi047.zhgnrm(active, since 5s), standbys: smithi138.fiugmj 2024-02-07T12:28:32.986 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:32 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:32.986 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:32 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:33.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:32 smithi047 ceph-mon[93224]: mgrmap e39: smithi047.zhgnrm(active, since 5s), standbys: smithi138.fiugmj 2024-02-07T12:28:33.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:32 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:33.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:32 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:34.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:33 smithi138 ceph-mon[35528]: pgmap v6: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:28:34.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:33 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:34.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:33 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:34.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:33 smithi047 ceph-mon[93224]: pgmap v6: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:28:34.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:34.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:36.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:35 smithi138 ceph-mon[35528]: pgmap v7: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-07T12:28:36.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:35 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:36.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:35 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:36.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:35 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:36.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:35 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:28:36.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:35 smithi047 ceph-mon[93224]: pgmap v7: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-07T12:28:36.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:35 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:36.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:35 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:36.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:35 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:36.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:35 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:28:36.886 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: Updating smithi047:/etc/ceph/ceph.conf 2024-02-07T12:28:36.886 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-07T12:28:36.886 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:28:36.886 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:28:36.886 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:28:36.886 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:28:36.886 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:36.886 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:36.886 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:36.886 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:36.886 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:36.887 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:36.887 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:28:36.887 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:36 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-07T12:28:37.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: Updating smithi047:/etc/ceph/ceph.conf 2024-02-07T12:28:37.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-07T12:28:37.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:28:37.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-07T12:28:37.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:28:37.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-02-07T12:28:37.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:37.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:37.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:37.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:37.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:37.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:37.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:28:37.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:36 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-07T12:28:38.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:37 smithi138 ceph-mon[35528]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:28:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:37 smithi138 ceph-mon[35528]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:28:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:37 smithi138 ceph-mon[35528]: pgmap v8: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-07T12:28:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:37 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:37 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-07T12:28:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:37 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-07T12:28:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:37 smithi138 ceph-mon[35528]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:38.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:37 smithi047 ceph-mon[93224]: Updating smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:28:38.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:37 smithi047 ceph-mon[93224]: Updating smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-07T12:28:38.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:37 smithi047 ceph-mon[93224]: pgmap v8: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-07T12:28:38.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-07T12:28:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-07T12:28:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:38.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:38 smithi138 ceph-mon[35528]: Upgrade: Updating mon.smithi138 2024-02-07T12:28:38.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:38 smithi138 ceph-mon[35528]: Deploying daemon mon.smithi138 on smithi138 2024-02-07T12:28:39.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:38 smithi047 ceph-mon[93224]: Upgrade: Updating mon.smithi138 2024-02-07T12:28:39.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:38 smithi047 ceph-mon[93224]: Deploying daemon mon.smithi138 on smithi138 2024-02-07T12:28:39.672 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:39 smithi138 systemd[1]: Stopping Ceph mon.smithi138 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:28:39.672 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:39 smithi138 ceph-mon[35528]: pgmap v9: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-07T12:28:39.988 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:39 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138[35510]: 2024-02-07T12:28:39.669+0000 7f6423ff3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi138 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:28:39.989 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:39 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138[35510]: 2024-02-07T12:28:39.669+0000 7f6423ff3700 -1 mon.smithi138@1(peon) e2 *** Got Signal Terminated *** 2024-02-07T12:28:39.989 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:39 smithi138 podman[81897]: 2024-02-07 12:28:39.700707698 +0000 UTC m=+0.145935026 container died 02dfa0b8d573d3a2c00cd76f49d700a8225607217bfe7bdd888b159986647535 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, RELEASE=quincy-f246262, ceph=True) 2024-02-07T12:28:39.989 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:39 smithi138 podman[81897]: 2024-02-07 12:28:39.986917442 +0000 UTC m=+0.432144724 container cleanup 02dfa0b8d573d3a2c00cd76f49d700a8225607217bfe7bdd888b159986647535 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138, ceph=True, GIT_BRANCH=HEAD, RELEASE=quincy-f246262, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:28:39.989 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:39 smithi138 bash[81897]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138 2024-02-07T12:28:40.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:39 smithi047 ceph-mon[93224]: pgmap v9: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-07T12:28:40.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:40 smithi138 podman[81911]: 2024-02-07 12:28:40.238836597 +0000 UTC m=+0.532944457 container remove 02dfa0b8d573d3a2c00cd76f49d700a8225607217bfe7bdd888b159986647535 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=quincy-f246262, org.label-schema.schema-version=1.0) 2024-02-07T12:28:40.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:40 smithi138 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi138.service: Deactivated successfully. 2024-02-07T12:28:40.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:40 smithi138 systemd[1]: Stopped Ceph mon.smithi138 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:28:40.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:40 smithi138 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi138.service: Consumed 6.448s CPU time. 2024-02-07T12:28:40.940 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:40 smithi138 systemd[1]: Starting Ceph mon.smithi138 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:28:40.940 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:40 smithi138 podman[82037]: 2024-02-07 12:28:40.713257164 +0000 UTC m=+0.018042746 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:28:40.940 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:40 smithi138 podman[82037]: 2024-02-07 12:28:40.815107031 +0000 UTC m=+0.119892669 container create 14527280e47ecbba63ec8eeae27ee403f2683b1754ef0de255c3d9a359f061a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, GIT_BRANCH=HEAD) 2024-02-07T12:28:41.429 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 podman[82037]: 2024-02-07 12:28:41.052565292 +0000 UTC m=+0.357350885 container init 14527280e47ecbba63ec8eeae27ee403f2683b1754ef0de255c3d9a359f061a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-07T12:28:41.429 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 podman[82037]: 2024-02-07 12:28:41.055913357 +0000 UTC m=+0.360698948 container start 14527280e47ecbba63ec8eeae27ee403f2683b1754ef0de255c3d9a359f061a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2) 2024-02-07T12:28:41.429 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: set uid:gid to 167:167 (ceph:ceph) 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev), process ceph-mon, pid 2 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: pidfile_write: ignore empty --pid-file 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: load: jerasure load: lrc 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: RocksDB version: 7.9.2 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Git sha 0 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Compile date 2024-02-05 19:41:51 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: DB SUMMARY 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: DB Session ID: ZYRGE9JYBYJC677NOL7I 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: CURRENT file: CURRENT 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: IDENTITY file: IDENTITY 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1095 Bytes 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi138/store.db dir, Total Num: 1, files: 000027.sst 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi138/store.db: 000025.log size: 6248390 ; 2024-02-07T12:28:41.430 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.error_if_exists: 0 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.create_if_missing: 0 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.paranoid_checks: 1 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.env: 0x55c7d79d2ae0 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.fs: PosixFileSystem 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.info_log: 0x55c7da095760 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_file_opening_threads: 16 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.statistics: (nil) 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.use_fsync: 0 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_log_file_size: 0 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-07T12:28:41.431 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.keep_log_file_num: 1000 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.recycle_log_file_num: 0 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.allow_fallocate: 1 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.allow_mmap_reads: 0 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.allow_mmap_writes: 0 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.use_direct_reads: 0 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.create_missing_column_families: 0 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.db_log_dir: 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.wal_dir: 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-07T12:28:41.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.advise_random_on_open: 1 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.db_write_buffer_size: 0 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.write_buffer_manager: 0x55c7da069400 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.rate_limiter: (nil) 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.wal_recovery_mode: 2 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.enable_thread_tracking: 0 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.enable_pipelined_write: 0 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.unordered_write: 0 2024-02-07T12:28:41.433 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-07T12:28:41.434 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-07T12:28:41.434 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-07T12:28:41.434 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-07T12:28:41.434 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.row_cache: None 2024-02-07T12:28:41.434 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.wal_filter: None 2024-02-07T12:28:41.435 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-07T12:28:41.435 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.allow_ingest_behind: 0 2024-02-07T12:28:41.435 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.two_write_queues: 0 2024-02-07T12:28:41.435 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.manual_wal_flush: 0 2024-02-07T12:28:41.435 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.wal_compression: 0 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.atomic_flush: 0 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.log_readahead_size: 0 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.best_efforts_recovery: 0 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.allow_data_in_errors: 0 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.db_host_id: __hostname__ 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_background_jobs: 2 2024-02-07T12:28:41.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_background_compactions: -1 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_subcompactions: 1 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_total_wal_size: 0 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_open_files: -1 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.bytes_per_sync: 0 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compaction_readahead_size: 0 2024-02-07T12:28:41.437 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_background_flushes: -1 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Compression algorithms supported: 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: kZSTD supported: 0 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: kXpressCompression supported: 0 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: kLZ4HCCompression supported: 1 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: kZlibCompression supported: 1 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: kSnappyCompression supported: 1 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: kLZ4Compression supported: 1 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: kBZip2Compression supported: 0 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi138/store.db/MANIFEST-000009 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.merge_operator: 2024-02-07T12:28:41.438 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compaction_filter: None 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compaction_filter_factory: None 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.sst_partitioner_factory: None 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c7da095880) 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: cache_index_and_filter_blocks: 1 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: pin_top_level_index_and_filter: 1 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: index_type: 0 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: data_block_index_type: 0 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: index_shortening: 1 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: checksum: 4 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: no_block_cache: 0 2024-02-07T12:28:41.439 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_cache: 0x55c7da099090 2024-02-07T12:28:41.440 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_cache_name: BinnedLRUCache 2024-02-07T12:28:41.440 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_cache_options: 2024-02-07T12:28:41.440 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: capacity : 536870912 2024-02-07T12:28:41.440 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: num_shard_bits : 4 2024-02-07T12:28:41.440 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: strict_capacity_limit : 0 2024-02-07T12:28:41.440 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: high_pri_pool_ratio: 0.000 2024-02-07T12:28:41.440 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_cache_compressed: (nil) 2024-02-07T12:28:41.440 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: persistent_cache: (nil) 2024-02-07T12:28:41.440 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_size: 4096 2024-02-07T12:28:41.440 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_size_deviation: 10 2024-02-07T12:28:41.440 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_restart_interval: 16 2024-02-07T12:28:41.440 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: index_block_restart_interval: 1 2024-02-07T12:28:41.440 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: metadata_block_size: 4096 2024-02-07T12:28:41.441 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: partition_filters: 0 2024-02-07T12:28:41.441 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: use_delta_encoding: 1 2024-02-07T12:28:41.441 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: filter_policy: bloomfilter 2024-02-07T12:28:41.441 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: whole_key_filtering: 1 2024-02-07T12:28:41.441 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: verify_compression: 0 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: read_amp_bytes_per_bit: 0 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: format_version: 5 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: enable_index_compression: 1 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_align: 0 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: max_auto_readahead_size: 262144 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: prepopulate_block_cache: 0 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: initial_auto_readahead_size: 8192 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: num_file_reads_for_auto_readahead: 2 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.write_buffer_size: 33554432 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_write_buffer_number: 2 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compression: NoCompression 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.bottommost_compression: Disabled 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.prefix_extractor: nullptr 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-07T12:28:41.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.num_levels: 7 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compression_opts.level: 32767 2024-02-07T12:28:41.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compression_opts.strategy: 0 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compression_opts.enabled: false 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.target_file_size_base: 67108864 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-07T12:28:41.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.arena_block_size: 1048576 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.disable_auto_compactions: 0 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-07T12:28:41.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.table_properties_collectors: 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.inplace_update_support: 0 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.bloom_locality: 0 2024-02-07T12:28:41.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.max_successive_merges: 0 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.paranoid_file_checks: 0 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.force_consistency_checks: 1 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.report_bg_io_stats: 0 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.ttl: 2592000 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.enable_blob_files: false 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.min_blob_size: 0 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.blob_file_size: 268435456 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-07T12:28:41.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.blob_file_starting_level: 0 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi138/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12491, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 660ce76b-4f03-48fe-8a1f-1d5e3aa6cd6b 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707308921084852, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707308921097584, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 3790801, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12496, "largest_seqno": 14012, "table_properties": {"data_size": 3784140, "index_size": 4106, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1541, "raw_key_size": 14353, "raw_average_key_size": 23, "raw_value_size": 3770995, "raw_average_value_size": 6151, "num_data_blocks": 186, "num_entries": 613, "num_filter_entries": 613, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1707308921, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "660ce76b-4f03-48fe-8a1f-1d5e3aa6cd6b", "db_session_id": "ZYRGE9JYBYJC677NOL7I", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707308921097703, "job": 1, "event": "recovery_finished"} 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-02-07T12:28:41.448 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi138/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c7da188000 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: DB pointer 0x55c7da174000 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ** DB Stats ** 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-07T12:28:41.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ** Compaction Stats [default] ** 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: L0 1/0 3.62 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 730.6 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: L6 1/0 5.22 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Sum 2/0 8.84 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 730.6 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 730.6 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ** Compaction Stats [default] ** 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 730.6 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-07T12:28:41.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Cumulative compaction: 0.00 GB write, 212.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Interval compaction: 0.00 GB write, 212.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Block cache BinnedLRUCache@0x55c7da099090#2 capacity: 512.00 MB usage: 6.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: starting mon.smithi138 rank 1 at public addrs [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] at bind addrs [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi138 fsid 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: mon.smithi138@-1(???) e2 preinit fsid 818049ec-c5b2-11ee-95b6-87774f69a715 2024-02-07T12:28:41.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: mon.smithi138@-1(???).mds e20 new map 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: mon.smithi138@-1(???).mds e20 print_map 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: e20 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: legacy client fscid: 1 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Filesystem 'cephfs' (1) 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: fs_name cephfs 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: epoch 20 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: modified 2024-02-07T12:26:24.336188+0000 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: tableserver 0 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: root 0 2024-02-07T12:28:41.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: session_timeout 60 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: session_autoclose 300 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: max_file_size 1099511627776 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: max_xattr_size 65536 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: required_client_features {} 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: last_failure 0 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: last_failure_osd_epoch 47 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: max_mds 2 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: in 0,1 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: up {0=14460,1=14472} 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: failed 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: damaged 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: stopped 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: data_pools [3] 2024-02-07T12:28:41.453 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: metadata_pool 2 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: inline_data disabled 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: balancer 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: bal_rank_mask -1 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: standby_count_wanted 1 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: [mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 export targets 1 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: [mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: [mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: [mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: mon.smithi138@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: mon.smithi138@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: mon.smithi138@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: mon.smithi138@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 ceph-mon[82055]: mon.smithi138@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-02-07T12:28:41.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 bash[82037]: 14527280e47ecbba63ec8eeae27ee403f2683b1754ef0de255c3d9a359f061a2 2024-02-07T12:28:41.455 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:41 smithi138 systemd[1]: Started Ceph mon.smithi138 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:28:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: overall HEALTH_OK 2024-02-07T12:28:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:28:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:28:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: mon.smithi047 calling monitor election 2024-02-07T12:28:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: mon.smithi138 calling monitor election 2024-02-07T12:28:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: mon.smithi047 is new leader, mons smithi047,smithi138 in quorum (ranks 0,1) 2024-02-07T12:28:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: monmap e3: 2 mons at {smithi047=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0],smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-07T12:28:42.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:28:42.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: osdmap e50: 6 total, 6 up, 6 in 2024-02-07T12:28:42.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: mgrmap e39: smithi047.zhgnrm(active, since 14s), standbys: smithi138.fiugmj 2024-02-07T12:28:42.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: overall HEALTH_OK 2024-02-07T12:28:42.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:42.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:42.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:42.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:28:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: overall HEALTH_OK 2024-02-07T12:28:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-02-07T12:28:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-07T12:28:42.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: mon.smithi047 calling monitor election 2024-02-07T12:28:42.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: mon.smithi138 calling monitor election 2024-02-07T12:28:42.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: mon.smithi047 is new leader, mons smithi047,smithi138 in quorum (ranks 0,1) 2024-02-07T12:28:42.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: monmap e3: 2 mons at {smithi047=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0],smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-07T12:28:42.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:28:42.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: osdmap e50: 6 total, 6 up, 6 in 2024-02-07T12:28:42.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: mgrmap e39: smithi047.zhgnrm(active, since 14s), standbys: smithi138.fiugmj 2024-02-07T12:28:42.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: overall HEALTH_OK 2024-02-07T12:28:42.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:42.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:42.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:28:42.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:28:43.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:43 smithi138 ceph-mon[82055]: pgmap v11: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-07T12:28:43.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:43 smithi047 ceph-mon[93224]: pgmap v11: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-07T12:28:45.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:45 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:45.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:45 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:45.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:45 smithi138 ceph-mon[82055]: pgmap v12: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-07T12:28:45.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:45 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:45.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:45 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:45.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:45 smithi047 ceph-mon[93224]: pgmap v12: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-07T12:28:46.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:46 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:46.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:46 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:46.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:46 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:46.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:46 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:47.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:47 smithi138 ceph-mon[82055]: pgmap v13: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:47.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:47 smithi047 ceph-mon[93224]: pgmap v13: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:49 smithi138 ceph-mon[82055]: pgmap v14: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:28:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-07T12:28:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-07T12:28:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:49.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:49 smithi047 ceph-mon[93224]: pgmap v14: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:49.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:49.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:49.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:49.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:28:49.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:49.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-07T12:28:49.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-07T12:28:49.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:50.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:50 smithi138 ceph-mon[82055]: Reconfiguring mon.smithi047 (monmap changed)... 2024-02-07T12:28:50.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:50 smithi138 ceph-mon[82055]: Reconfiguring daemon mon.smithi047 on smithi047 2024-02-07T12:28:50.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:50 smithi047 ceph-mon[93224]: Reconfiguring mon.smithi047 (monmap changed)... 2024-02-07T12:28:50.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:50 smithi047 ceph-mon[93224]: Reconfiguring daemon mon.smithi047 on smithi047 2024-02-07T12:28:51.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:51 smithi047 ceph-mon[93224]: pgmap v15: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:51.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:51.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:51.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.zhgnrm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:28:51.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:28:51.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:51.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:51 smithi138 ceph-mon[82055]: pgmap v15: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:51.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:51.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:51.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.zhgnrm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:28:51.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:28:51.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:52.362 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:52 smithi047 ceph-mon[93224]: Reconfiguring mgr.smithi047.zhgnrm (monmap changed)... 2024-02-07T12:28:52.362 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:52 smithi047 ceph-mon[93224]: Reconfiguring daemon mgr.smithi047.zhgnrm on smithi047 2024-02-07T12:28:52.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:52 smithi138 ceph-mon[82055]: Reconfiguring mgr.smithi047.zhgnrm (monmap changed)... 2024-02-07T12:28:52.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:52 smithi138 ceph-mon[82055]: Reconfiguring daemon mgr.smithi047.zhgnrm on smithi047 2024-02-07T12:28:53.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:53 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:53.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:53 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:53.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:53 smithi047 ceph-mon[93224]: Reconfiguring crash.smithi047 (monmap changed)... 2024-02-07T12:28:53.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:53 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:28:53.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:53 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:53.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:53 smithi047 ceph-mon[93224]: Reconfiguring daemon crash.smithi047 on smithi047 2024-02-07T12:28:53.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:53 smithi047 ceph-mon[93224]: pgmap v16: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:53.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:53 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:53 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:53 smithi138 ceph-mon[82055]: Reconfiguring crash.smithi047 (monmap changed)... 2024-02-07T12:28:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:53 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:28:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:53 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:53 smithi138 ceph-mon[82055]: Reconfiguring daemon crash.smithi047 on smithi047 2024-02-07T12:28:53.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:53 smithi138 ceph-mon[82055]: pgmap v16: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:55.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:55 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:55.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:55 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:55.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:55 smithi047 ceph-mon[93224]: Reconfiguring osd.0 (monmap changed)... 2024-02-07T12:28:55.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:55 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-07T12:28:55.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:55 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:55.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:55 smithi047 ceph-mon[93224]: Reconfiguring daemon osd.0 on smithi047 2024-02-07T12:28:55.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:55 smithi047 ceph-mon[93224]: pgmap v17: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:55 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:55 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:55 smithi138 ceph-mon[82055]: Reconfiguring osd.0 (monmap changed)... 2024-02-07T12:28:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:55 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-07T12:28:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:55 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:55 smithi138 ceph-mon[82055]: Reconfiguring daemon osd.0 on smithi047 2024-02-07T12:28:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:55 smithi138 ceph-mon[82055]: pgmap v17: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:57.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:57.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:57.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:56 smithi047 ceph-mon[93224]: Reconfiguring osd.1 (monmap changed)... 2024-02-07T12:28:57.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-07T12:28:57.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:57.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:56 smithi047 ceph-mon[93224]: Reconfiguring daemon osd.1 on smithi047 2024-02-07T12:28:57.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:56 smithi047 ceph-mon[93224]: pgmap v18: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:57.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:28:57.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:57.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:57.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:56 smithi138 ceph-mon[82055]: Reconfiguring osd.1 (monmap changed)... 2024-02-07T12:28:57.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-07T12:28:57.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:57.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:56 smithi138 ceph-mon[82055]: Reconfiguring daemon osd.1 on smithi047 2024-02-07T12:28:57.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:56 smithi138 ceph-mon[82055]: pgmap v18: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:28:57.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:28:58.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:58 smithi047 ceph-mon[93224]: Reconfiguring osd.2 (monmap changed)... 2024-02-07T12:28:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-07T12:28:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:58 smithi047 ceph-mon[93224]: Reconfiguring daemon osd.2 on smithi047 2024-02-07T12:28:58.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:58.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:58.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:58 smithi138 ceph-mon[82055]: Reconfiguring osd.2 (monmap changed)... 2024-02-07T12:28:58.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-07T12:28:58.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:58.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:58 smithi138 ceph-mon[82055]: Reconfiguring daemon osd.2 on smithi047 2024-02-07T12:28:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.275+0000 7fda490f9700 1 -- 172.21.15.47:0/836875014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda440fcef0 msgr2=0x7fda440fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.275+0000 7fda490f9700 1 --2- 172.21.15.47:0/836875014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda440fcef0 0x7fda440fd320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fda34009ce0 tx=0x7fda34004d10 comp rx=0 tx=0).stop 2024-02-07T12:28:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.275+0000 7fda490f9700 1 -- 172.21.15.47:0/836875014 shutdown_connections 2024-02-07T12:28:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.275+0000 7fda490f9700 1 --2- 172.21.15.47:0/836875014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda440fe0e0 0x7fda440fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.275+0000 7fda490f9700 1 --2- 172.21.15.47:0/836875014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda440fcef0 0x7fda440fd320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.275+0000 7fda490f9700 1 -- 172.21.15.47:0/836875014 >> 172.21.15.47:0/836875014 conn(0x7fda440f8620 msgr2=0x7fda440faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.275+0000 7fda490f9700 1 -- 172.21.15.47:0/836875014 shutdown_connections 2024-02-07T12:28:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.275+0000 7fda490f9700 1 -- 172.21.15.47:0/836875014 wait complete. 2024-02-07T12:28:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.276+0000 7fda490f9700 1 Processor -- start 2024-02-07T12:28:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.276+0000 7fda490f9700 1 -- start start 2024-02-07T12:28:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.276+0000 7fda490f9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda440fcef0 0x7fda44071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.276+0000 7fda490f9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda440fe0e0 0x7fda440702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.276+0000 7fda490f9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44070970 con 0x7fda440fe0e0 2024-02-07T12:28:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.276+0000 7fda490f9700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44070ae0 con 0x7fda440fcef0 2024-02-07T12:28:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.276+0000 7fda4259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda440fe0e0 0x7fda440702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.276+0000 7fda4259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda440fe0e0 0x7fda440702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44704/0 (socket says 172.21.15.47:44704) 2024-02-07T12:28:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.276+0000 7fda4259c700 1 -- 172.21.15.47:0/25702021 learned_addr learned my addr 172.21.15.47:0/25702021 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:28:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.276+0000 7fda42d9d700 1 --2- 172.21.15.47:0/25702021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda440fcef0 0x7fda44071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:59.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.276+0000 7fda4259c700 1 -- 172.21.15.47:0/25702021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda440fcef0 msgr2=0x7fda44071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:59.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.276+0000 7fda4259c700 1 --2- 172.21.15.47:0/25702021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda440fcef0 0x7fda44071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.276+0000 7fda4259c700 1 -- 172.21.15.47:0/25702021 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda34009940 con 0x7fda440fe0e0 2024-02-07T12:28:59.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.277+0000 7fda4259c700 1 --2- 172.21.15.47:0/25702021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda440fe0e0 0x7fda440702e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00b790 tx=0x7fda2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:59.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.277+0000 7fda3b7fe700 1 -- 172.21.15.47:0/25702021 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda2c00f770 con 0x7fda440fe0e0 2024-02-07T12:28:59.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.277+0000 7fda3b7fe700 1 -- 172.21.15.47:0/25702021 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda2c00fda0 con 0x7fda440fe0e0 2024-02-07T12:28:59.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.277+0000 7fda490f9700 1 -- 172.21.15.47:0/25702021 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda44070dc0 con 0x7fda440fe0e0 2024-02-07T12:28:59.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.277+0000 7fda3b7fe700 1 -- 172.21.15.47:0/25702021 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda2c00d310 con 0x7fda440fe0e0 2024-02-07T12:28:59.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.277+0000 7fda490f9700 1 -- 172.21.15.47:0/25702021 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda44071140 con 0x7fda440fe0e0 2024-02-07T12:28:59.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.278+0000 7fda490f9700 1 -- 172.21.15.47:0/25702021 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4404bed0 con 0x7fda440fe0e0 2024-02-07T12:28:59.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.278+0000 7fda3b7fe700 1 -- 172.21.15.47:0/25702021 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fda2c010420 con 0x7fda440fe0e0 2024-02-07T12:28:59.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.279+0000 7fda3b7fe700 1 --2- 172.21.15.47:0/25702021 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fda3006d900 0x7fda3006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:59.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.279+0000 7fda3b7fe700 1 -- 172.21.15.47:0/25702021 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fda2c08d090 con 0x7fda440fe0e0 2024-02-07T12:28:59.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.279+0000 7fda42d9d700 1 --2- 172.21.15.47:0/25702021 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fda3006d900 0x7fda3006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:59.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.279+0000 7fda42d9d700 1 --2- 172.21.15.47:0/25702021 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fda3006d900 0x7fda3006fdb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fda34009cb0 tx=0x7fda34004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:59.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.284+0000 7fda3b7fe700 1 -- 172.21.15.47:0/25702021 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fda2c05a380 con 0x7fda440fe0e0 2024-02-07T12:28:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.507+0000 7fda490f9700 1 -- 172.21.15.47:0/25702021 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda44102ac0 con 0x7fda3006d900 2024-02-07T12:28:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.508+0000 7fda3b7fe700 1 -- 172.21.15.47:0/25702021 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fda44102ac0 con 0x7fda3006d900 2024-02-07T12:28:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.510+0000 7fda490f9700 1 -- 172.21.15.47:0/25702021 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fda3006d900 msgr2=0x7fda3006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.510+0000 7fda490f9700 1 --2- 172.21.15.47:0/25702021 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fda3006d900 0x7fda3006fdb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fda34009cb0 tx=0x7fda34004d10 comp rx=0 tx=0).stop 2024-02-07T12:28:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.510+0000 7fda490f9700 1 -- 172.21.15.47:0/25702021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda440fe0e0 msgr2=0x7fda440702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.510+0000 7fda490f9700 1 --2- 172.21.15.47:0/25702021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda440fe0e0 0x7fda440702e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00b790 tx=0x7fda2c009250 comp rx=0 tx=0).stop 2024-02-07T12:28:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.510+0000 7fda490f9700 1 -- 172.21.15.47:0/25702021 shutdown_connections 2024-02-07T12:28:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.510+0000 7fda490f9700 1 --2- 172.21.15.47:0/25702021 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fda3006d900 0x7fda3006fdb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.510+0000 7fda490f9700 1 --2- 172.21.15.47:0/25702021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda440fcef0 0x7fda44071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.510+0000 7fda490f9700 1 --2- 172.21.15.47:0/25702021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda440fe0e0 0x7fda440702e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.510+0000 7fda490f9700 1 -- 172.21.15.47:0/25702021 >> 172.21.15.47:0/25702021 conn(0x7fda440f8620 msgr2=0x7fda441013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.511+0000 7fda490f9700 1 -- 172.21.15.47:0/25702021 shutdown_connections 2024-02-07T12:28:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.511+0000 7fda490f9700 1 -- 172.21.15.47:0/25702021 wait complete. 2024-02-07T12:28:59.527 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:28:59.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.618+0000 7fac45413700 1 -- 172.21.15.47:0/769150257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac401003a0 msgr2=0x7fac40102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:59.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.618+0000 7fac45413700 1 --2- 172.21.15.47:0/769150257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac401003a0 0x7fac40102780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fac28004940 tx=0x7fac28009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:59.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.618+0000 7fac45413700 1 -- 172.21.15.47:0/769150257 shutdown_connections 2024-02-07T12:28:59.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.618+0000 7fac45413700 1 --2- 172.21.15.47:0/769150257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac401003a0 0x7fac40102780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.618+0000 7fac45413700 1 --2- 172.21.15.47:0/769150257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac400fda80 0x7fac400ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.618+0000 7fac45413700 1 -- 172.21.15.47:0/769150257 >> 172.21.15.47:0/769150257 conn(0x7fac400f7520 msgr2=0x7fac400f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:59.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.618+0000 7fac45413700 1 -- 172.21.15.47:0/769150257 shutdown_connections 2024-02-07T12:28:59.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.618+0000 7fac45413700 1 -- 172.21.15.47:0/769150257 wait complete. 2024-02-07T12:28:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.619+0000 7fac45413700 1 Processor -- start 2024-02-07T12:28:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.619+0000 7fac45413700 1 -- start start 2024-02-07T12:28:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.619+0000 7fac45413700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac400fda80 0x7fac4010d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.619+0000 7fac45413700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac401003a0 0x7fac4010dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.619+0000 7fac45413700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4010e530 con 0x7fac400fda80 2024-02-07T12:28:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.619+0000 7fac45413700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4010ed70 con 0x7fac401003a0 2024-02-07T12:28:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.619+0000 7fac3effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac400fda80 0x7fac4010d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.619+0000 7fac3effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac400fda80 0x7fac4010d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33932/0 (socket says 172.21.15.47:33932) 2024-02-07T12:28:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.619+0000 7fac3effd700 1 -- 172.21.15.47:0/3151733667 learned_addr learned my addr 172.21.15.47:0/3151733667 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:28:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.620+0000 7fac3e7fc700 1 --2- 172.21.15.47:0/3151733667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac401003a0 0x7fac4010dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.620+0000 7fac3effd700 1 -- 172.21.15.47:0/3151733667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac401003a0 msgr2=0x7fac4010dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.620+0000 7fac3effd700 1 --2- 172.21.15.47:0/3151733667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac401003a0 0x7fac4010dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.620+0000 7fac3effd700 1 -- 172.21.15.47:0/3151733667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac28005040 con 0x7fac400fda80 2024-02-07T12:28:59.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.620+0000 7fac3effd700 1 --2- 172.21.15.47:0/3151733667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac400fda80 0x7fac4010d960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fac3000b790 tx=0x7fac30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:59.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.620+0000 7fac377fe700 1 -- 172.21.15.47:0/3151733667 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac3000f770 con 0x7fac400fda80 2024-02-07T12:28:59.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.620+0000 7fac377fe700 1 -- 172.21.15.47:0/3151733667 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac3000fda0 con 0x7fac400fda80 2024-02-07T12:28:59.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.620+0000 7fac45413700 1 -- 172.21.15.47:0/3151733667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4010f050 con 0x7fac400fda80 2024-02-07T12:28:59.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.621+0000 7fac377fe700 1 -- 172.21.15.47:0/3151733667 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac3000d310 con 0x7fac400fda80 2024-02-07T12:28:59.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.621+0000 7fac45413700 1 -- 172.21.15.47:0/3151733667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4010f590 con 0x7fac400fda80 2024-02-07T12:28:59.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.622+0000 7fac377fe700 1 -- 172.21.15.47:0/3151733667 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fac30010420 con 0x7fac400fda80 2024-02-07T12:28:59.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.622+0000 7fac45413700 1 -- 172.21.15.47:0/3151733667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac40107ad0 con 0x7fac400fda80 2024-02-07T12:28:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.622+0000 7fac377fe700 1 --2- 172.21.15.47:0/3151733667 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fac2c06d900 0x7fac2c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.622+0000 7fac377fe700 1 -- 172.21.15.47:0/3151733667 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fac3008cfa0 con 0x7fac400fda80 2024-02-07T12:28:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.622+0000 7fac3e7fc700 1 --2- 172.21.15.47:0/3151733667 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fac2c06d900 0x7fac2c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.623+0000 7fac3e7fc700 1 --2- 172.21.15.47:0/3151733667 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fac2c06d900 0x7fac2c06fdb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fac28004f90 tx=0x7fac28009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.627+0000 7fac377fe700 1 -- 172.21.15.47:0/3151733667 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fac300c0d20 con 0x7fac400fda80 2024-02-07T12:28:59.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:59 smithi138 ceph-mon[82055]: pgmap v19: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:59.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:59 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:59.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:59 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:59.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:59 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.lagmef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:28:59.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:28:59 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:59.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:59 smithi047 ceph-mon[93224]: pgmap v19: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:28:59.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:59 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:59.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:59 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:28:59.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:59 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.lagmef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:28:59.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:28:59 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:28:59.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.859+0000 7fac45413700 1 -- 172.21.15.47:0/3151733667 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac4010f900 con 0x7fac2c06d900 2024-02-07T12:28:59.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.860+0000 7fac377fe700 1 -- 172.21.15.47:0/3151733667 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fac4010f900 con 0x7fac2c06d900 2024-02-07T12:28:59.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.862+0000 7fac45413700 1 -- 172.21.15.47:0/3151733667 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fac2c06d900 msgr2=0x7fac2c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:59.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.862+0000 7fac45413700 1 --2- 172.21.15.47:0/3151733667 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fac2c06d900 0x7fac2c06fdb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fac28004f90 tx=0x7fac28009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:59.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.862+0000 7fac45413700 1 -- 172.21.15.47:0/3151733667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac400fda80 msgr2=0x7fac4010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:59.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.862+0000 7fac45413700 1 --2- 172.21.15.47:0/3151733667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac400fda80 0x7fac4010d960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fac3000b790 tx=0x7fac30009250 comp rx=0 tx=0).stop 2024-02-07T12:28:59.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.862+0000 7fac45413700 1 -- 172.21.15.47:0/3151733667 shutdown_connections 2024-02-07T12:28:59.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.862+0000 7fac45413700 1 --2- 172.21.15.47:0/3151733667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac400fda80 0x7fac4010d960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.862+0000 7fac45413700 1 --2- 172.21.15.47:0/3151733667 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fac2c06d900 0x7fac2c06fdb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.862+0000 7fac45413700 1 --2- 172.21.15.47:0/3151733667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac401003a0 0x7fac4010dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.862+0000 7fac45413700 1 -- 172.21.15.47:0/3151733667 >> 172.21.15.47:0/3151733667 conn(0x7fac400f7520 msgr2=0x7fac400f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:59.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.862+0000 7fac45413700 1 -- 172.21.15.47:0/3151733667 shutdown_connections 2024-02-07T12:28:59.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.862+0000 7fac45413700 1 -- 172.21.15.47:0/3151733667 wait complete. 2024-02-07T12:28:59.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.966+0000 7faebdca4700 1 -- 172.21.15.47:0/2975194602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb80fcfb0 msgr2=0x7faeb80fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:59.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.966+0000 7faebdca4700 1 --2- 172.21.15.47:0/2975194602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb80fcfb0 0x7faeb80fd420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faeac004940 tx=0x7faeac009e30 comp rx=0 tx=0).stop 2024-02-07T12:28:59.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.966+0000 7faebdca4700 1 -- 172.21.15.47:0/2975194602 shutdown_connections 2024-02-07T12:28:59.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.966+0000 7faebdca4700 1 --2- 172.21.15.47:0/2975194602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb80fcfb0 0x7faeb80fd420 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.966+0000 7faebdca4700 1 --2- 172.21.15.47:0/2975194602 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faeb80fbe40 0x7faeb80fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.966+0000 7faebdca4700 1 -- 172.21.15.47:0/2975194602 >> 172.21.15.47:0/2975194602 conn(0x7faeb80f74e0 msgr2=0x7faeb80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:28:59.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.966+0000 7faebdca4700 1 -- 172.21.15.47:0/2975194602 shutdown_connections 2024-02-07T12:28:59.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.966+0000 7faebdca4700 1 -- 172.21.15.47:0/2975194602 wait complete. 2024-02-07T12:28:59.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.967+0000 7faebdca4700 1 Processor -- start 2024-02-07T12:28:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.967+0000 7faebdca4700 1 -- start start 2024-02-07T12:28:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.967+0000 7faebdca4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb80fbe40 0x7faeb8110690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.967+0000 7faebdca4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faeb80fcfb0 0x7faeb8112be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.967+0000 7faebdca4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8066460 con 0x7faeb80fbe40 2024-02-07T12:28:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.967+0000 7faebdca4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80665a0 con 0x7faeb80fcfb0 2024-02-07T12:28:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.967+0000 7faeb77fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb80fbe40 0x7faeb8110690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.967+0000 7faeb77fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb80fbe40 0x7faeb8110690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33942/0 (socket says 172.21.15.47:33942) 2024-02-07T12:28:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.967+0000 7faeb77fe700 1 -- 172.21.15.47:0/1749581481 learned_addr learned my addr 172.21.15.47:0/1749581481 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:28:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.967+0000 7faeb6ffd700 1 --2- 172.21.15.47:0/1749581481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faeb80fcfb0 0x7faeb8112be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.968+0000 7faeb77fe700 1 -- 172.21.15.47:0/1749581481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faeb80fcfb0 msgr2=0x7faeb8112be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:28:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.968+0000 7faeb77fe700 1 --2- 172.21.15.47:0/1749581481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faeb80fcfb0 0x7faeb8112be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:28:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.968+0000 7faeb77fe700 1 -- 172.21.15.47:0/1749581481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac005040 con 0x7faeb80fbe40 2024-02-07T12:28:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.968+0000 7faeb77fe700 1 --2- 172.21.15.47:0/1749581481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb80fbe40 0x7faeb8110690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faea8002a50 tx=0x7faea80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:59.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.968+0000 7fae9ffff700 1 -- 172.21.15.47:0/1749581481 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea8007cc0 con 0x7faeb80fbe40 2024-02-07T12:28:59.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.968+0000 7faebdca4700 1 -- 172.21.15.47:0/1749581481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb81131e0 con 0x7faeb80fbe40 2024-02-07T12:28:59.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.968+0000 7fae9ffff700 1 -- 172.21.15.47:0/1749581481 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faea800f040 con 0x7faeb80fbe40 2024-02-07T12:28:59.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.968+0000 7fae9ffff700 1 -- 172.21.15.47:0/1749581481 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea800da30 con 0x7faeb80fbe40 2024-02-07T12:28:59.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.968+0000 7faebdca4700 1 -- 172.21.15.47:0/1749581481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb8113720 con 0x7faeb80fbe40 2024-02-07T12:28:59.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.969+0000 7faebdca4700 1 -- 172.21.15.47:0/1749581481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb804bed0 con 0x7faeb80fbe40 2024-02-07T12:28:59.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.969+0000 7fae9ffff700 1 -- 172.21.15.47:0/1749581481 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7faea800dbf0 con 0x7faeb80fbe40 2024-02-07T12:28:59.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.970+0000 7fae9ffff700 1 --2- 172.21.15.47:0/1749581481 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7faea006d900 0x7faea006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:28:59.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.970+0000 7fae9ffff700 1 -- 172.21.15.47:0/1749581481 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7faea808cf10 con 0x7faeb80fbe40 2024-02-07T12:28:59.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.970+0000 7faeb6ffd700 1 --2- 172.21.15.47:0/1749581481 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7faea006d900 0x7faea006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:28:59.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.970+0000 7faeb6ffd700 1 --2- 172.21.15.47:0/1749581481 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7faea006d900 0x7faea006fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faeac00b7a0 tx=0x7faeac009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:28:59.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:28:59.974+0000 7fae9ffff700 1 -- 172.21.15.47:0/1749581481 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faea8056540 con 0x7faeb80fbe40 2024-02-07T12:29:00.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.199+0000 7faebdca4700 1 -- 172.21.15.47:0/1749581481 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faeb8101990 con 0x7faea006d900 2024-02-07T12:29:00.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.209+0000 7fae9ffff700 1 -- 172.21.15.47:0/1749581481 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7faeb8101990 con 0x7faea006d900 2024-02-07T12:29:00.213 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:29:00.213 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (2m) 27s ago 11m 15.4M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:29:00.213 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (11m) 27s ago 11m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 bca7317ed169 2024-02-07T12:29:00.213 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (10m) 15s ago 10m 6665k - 17.2.7-491-gf2462625 4ad3622d1b31 110c84c6624b 2024-02-07T12:29:00.213 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (114s) 27s ago 11m 77.9M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:29:00.213 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (5m) 27s ago 5m 111M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:29:00.213 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (6m) 27s ago 6m 129M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:29:00.214 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (5m) 15s ago 5m 68.6M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:29:00.214 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (5m) 15s ago 5m 69.6M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:29:00.214 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (93s) 27s ago 12m 472M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:29:00.214 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (56s) 15s ago 10m 450M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:29:00.214 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (42s) 27s ago 12m 29.5M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:29:00.214 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (19s) 15s ago 10m 23.4M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:29:00.214 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (2m) 27s ago 11m 8154k - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:29:00.214 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (99s) 15s ago 10m 15.2M - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:29:00.214 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (9m) 27s ago 9m 214M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 4f37918f583a 2024-02-07T12:29:00.215 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (9m) 27s ago 9m 230M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 1c6e3c603ed3 2024-02-07T12:29:00.215 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (8m) 27s ago 8m 180M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:29:00.215 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (8m) 15s ago 8m 265M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:29:00.215 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (7m) 15s ago 7m 233M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:29:00.215 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (7m) 15s ago 7m 217M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:29:00.215 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (61s) 27s ago 11m 45.0M - 2.43.0 a07b618ecd1d 32840d82c54b 2024-02-07T12:29:00.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.212+0000 7faebdca4700 1 -- 172.21.15.47:0/1749581481 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7faea006d900 msgr2=0x7faea006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:00.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.212+0000 7faebdca4700 1 --2- 172.21.15.47:0/1749581481 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7faea006d900 0x7faea006fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faeac00b7a0 tx=0x7faeac009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:00.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.212+0000 7faebdca4700 1 -- 172.21.15.47:0/1749581481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb80fbe40 msgr2=0x7faeb8110690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:00.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.212+0000 7faebdca4700 1 --2- 172.21.15.47:0/1749581481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb80fbe40 0x7faeb8110690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faea8002a50 tx=0x7faea80046b0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.212+0000 7faebdca4700 1 -- 172.21.15.47:0/1749581481 shutdown_connections 2024-02-07T12:29:00.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.212+0000 7faebdca4700 1 --2- 172.21.15.47:0/1749581481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb80fbe40 0x7faeb8110690 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.212+0000 7faebdca4700 1 --2- 172.21.15.47:0/1749581481 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7faea006d900 0x7faea006fdb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.212+0000 7faebdca4700 1 --2- 172.21.15.47:0/1749581481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faeb80fcfb0 0x7faeb8112be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.212+0000 7faebdca4700 1 -- 172.21.15.47:0/1749581481 >> 172.21.15.47:0/1749581481 conn(0x7faeb80f74e0 msgr2=0x7faeb8100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:00.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.212+0000 7faebdca4700 1 -- 172.21.15.47:0/1749581481 shutdown_connections 2024-02-07T12:29:00.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.212+0000 7faebdca4700 1 -- 172.21.15.47:0/1749581481 wait complete. 2024-02-07T12:29:00.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.314+0000 7f20d5087700 1 -- 172.21.15.47:0/927364839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20d00fcfb0 msgr2=0x7f20d00fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:00.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.314+0000 7f20d5087700 1 --2- 172.21.15.47:0/927364839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20d00fcfb0 0x7f20d00fd420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f20b8004940 tx=0x7f20b8009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:00.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.314+0000 7f20d5087700 1 -- 172.21.15.47:0/927364839 shutdown_connections 2024-02-07T12:29:00.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.314+0000 7f20d5087700 1 --2- 172.21.15.47:0/927364839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20d00fcfb0 0x7f20d00fd420 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.314+0000 7f20d5087700 1 --2- 172.21.15.47:0/927364839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20d00fbe40 0x7f20d00fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.314+0000 7f20d5087700 1 -- 172.21.15.47:0/927364839 >> 172.21.15.47:0/927364839 conn(0x7f20d00f74e0 msgr2=0x7f20d00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:00.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.314+0000 7f20d5087700 1 -- 172.21.15.47:0/927364839 shutdown_connections 2024-02-07T12:29:00.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.314+0000 7f20d5087700 1 -- 172.21.15.47:0/927364839 wait complete. 2024-02-07T12:29:00.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.314+0000 7f20d5087700 1 Processor -- start 2024-02-07T12:29:00.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20d5087700 1 -- start start 2024-02-07T12:29:00.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20d5087700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20d00fbe40 0x7f20d0110690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:00.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20d5087700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20d00fcfb0 0x7f20d0112be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:00.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20d5087700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d0066460 con 0x7f20d00fcfb0 2024-02-07T12:29:00.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20d5087700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00665a0 con 0x7f20d00fbe40 2024-02-07T12:29:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20ce59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20d00fcfb0 0x7f20d0112be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20ce59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20d00fcfb0 0x7f20d0112be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33970/0 (socket says 172.21.15.47:33970) 2024-02-07T12:29:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20ce59c700 1 -- 172.21.15.47:0/829928567 learned_addr learned my addr 172.21.15.47:0/829928567 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:29:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20ced9d700 1 --2- 172.21.15.47:0/829928567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20d00fbe40 0x7f20d0110690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20ce59c700 1 -- 172.21.15.47:0/829928567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20d00fbe40 msgr2=0x7f20d0110690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20ce59c700 1 --2- 172.21.15.47:0/829928567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20d00fbe40 0x7f20d0110690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20ce59c700 1 -- 172.21.15.47:0/829928567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b8005040 con 0x7f20d00fcfb0 2024-02-07T12:29:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20ce59c700 1 --2- 172.21.15.47:0/829928567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20d00fcfb0 0x7f20d0112be0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f20b80093b0 tx=0x7f20b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20c77fe700 1 -- 172.21.15.47:0/829928567 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20b800e040 con 0x7f20d00fcfb0 2024-02-07T12:29:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.315+0000 7f20c77fe700 1 -- 172.21.15.47:0/829928567 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20b800bcc0 con 0x7f20d00fcfb0 2024-02-07T12:29:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.316+0000 7f20d5087700 1 -- 172.21.15.47:0/829928567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d01131e0 con 0x7f20d00fcfb0 2024-02-07T12:29:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.316+0000 7f20c77fe700 1 -- 172.21.15.47:0/829928567 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20b801c630 con 0x7f20d00fcfb0 2024-02-07T12:29:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.316+0000 7f20d5087700 1 -- 172.21.15.47:0/829928567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d0113720 con 0x7f20d00fcfb0 2024-02-07T12:29:00.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.316+0000 7f20d5087700 1 -- 172.21.15.47:0/829928567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d004bed0 con 0x7f20d00fcfb0 2024-02-07T12:29:00.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.317+0000 7f20c77fe700 1 -- 172.21.15.47:0/829928567 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f20b80139f0 con 0x7f20d00fcfb0 2024-02-07T12:29:00.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.317+0000 7f20c77fe700 1 --2- 172.21.15.47:0/829928567 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f20bc06d900 0x7f20bc06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:00.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.318+0000 7f20ced9d700 1 --2- 172.21.15.47:0/829928567 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f20bc06d900 0x7f20bc06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:00.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.318+0000 7f20c77fe700 1 -- 172.21.15.47:0/829928567 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f20b808e660 con 0x7f20d00fcfb0 2024-02-07T12:29:00.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.318+0000 7f20ced9d700 1 --2- 172.21.15.47:0/829928567 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f20bc06d900 0x7f20bc06fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20d00660e0 tx=0x7f20c0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:00.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.322+0000 7f20c77fe700 1 -- 172.21.15.47:0/829928567 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f20b8057c70 con 0x7f20d00fcfb0 2024-02-07T12:29:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.615+0000 7f20d5087700 1 -- 172.21.15.47:0/829928567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f20d0104930 con 0x7f20d00fcfb0 2024-02-07T12:29:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.616+0000 7f20c77fe700 1 -- 172.21.15.47:0/829928567 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f20b805b330 con 0x7f20d00fcfb0 2024-02-07T12:29:00.619 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:29:00.620 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:29:00.620 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:29:00.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:29:00.620 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:29:00.620 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:29:00.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:29:00.620 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:29:00.620 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 6 2024-02-07T12:29:00.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:29:00.620 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:29:00.620 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:29:00.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:29:00.621 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:29:00.621 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 10, 2024-02-07T12:29:00.621 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 4 2024-02-07T12:29:00.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:29:00.621 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:29:00.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.618+0000 7f20d5087700 1 -- 172.21.15.47:0/829928567 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f20bc06d900 msgr2=0x7f20bc06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:00.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.618+0000 7f20d5087700 1 --2- 172.21.15.47:0/829928567 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f20bc06d900 0x7f20bc06fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20d00660e0 tx=0x7f20c0009040 comp rx=0 tx=0).stop 2024-02-07T12:29:00.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.618+0000 7f20d5087700 1 -- 172.21.15.47:0/829928567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20d00fcfb0 msgr2=0x7f20d0112be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:00.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.618+0000 7f20d5087700 1 --2- 172.21.15.47:0/829928567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20d00fcfb0 0x7f20d0112be0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f20b80093b0 tx=0x7f20b8009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:00.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.618+0000 7f20d5087700 1 -- 172.21.15.47:0/829928567 shutdown_connections 2024-02-07T12:29:00.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.618+0000 7f20d5087700 1 --2- 172.21.15.47:0/829928567 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f20bc06d900 0x7f20bc06fdb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.618+0000 7f20d5087700 1 --2- 172.21.15.47:0/829928567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20d00fbe40 0x7f20d0110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.618+0000 7f20d5087700 1 --2- 172.21.15.47:0/829928567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20d00fcfb0 0x7f20d0112be0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.618+0000 7f20d5087700 1 -- 172.21.15.47:0/829928567 >> 172.21.15.47:0/829928567 conn(0x7f20d00f74e0 msgr2=0x7f20d0100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:00.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.618+0000 7f20d5087700 1 -- 172.21.15.47:0/829928567 shutdown_connections 2024-02-07T12:29:00.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.618+0000 7f20d5087700 1 -- 172.21.15.47:0/829928567 wait complete. 2024-02-07T12:29:00.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.720+0000 7fc0e63ce700 1 -- 172.21.15.47:0/2064588081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e00fcfb0 msgr2=0x7fc0e00fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:00.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.720+0000 7fc0e63ce700 1 --2- 172.21.15.47:0/2064588081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e00fcfb0 0x7fc0e00fd420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4004940 tx=0x7fc0d4009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:00.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.720+0000 7fc0e63ce700 1 -- 172.21.15.47:0/2064588081 shutdown_connections 2024-02-07T12:29:00.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.720+0000 7fc0e63ce700 1 --2- 172.21.15.47:0/2064588081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e00fcfb0 0x7fc0e00fd420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.720+0000 7fc0e63ce700 1 --2- 172.21.15.47:0/2064588081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0e00fbe40 0x7fc0e00fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.720+0000 7fc0e63ce700 1 -- 172.21.15.47:0/2064588081 >> 172.21.15.47:0/2064588081 conn(0x7fc0e00f74e0 msgr2=0x7fc0e00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:00.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.720+0000 7fc0e63ce700 1 -- 172.21.15.47:0/2064588081 shutdown_connections 2024-02-07T12:29:00.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.720+0000 7fc0e63ce700 1 -- 172.21.15.47:0/2064588081 wait complete. 2024-02-07T12:29:00.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.721+0000 7fc0e63ce700 1 Processor -- start 2024-02-07T12:29:00.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.721+0000 7fc0e63ce700 1 -- start start 2024-02-07T12:29:00.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.721+0000 7fc0e63ce700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0e00fbe40 0x7fc0e00fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:00.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.721+0000 7fc0e63ce700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e00fcfb0 0x7fc0e00fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:00.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.721+0000 7fc0e63ce700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e00fe980 con 0x7fc0e00fcfb0 2024-02-07T12:29:00.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.721+0000 7fc0e63ce700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e00feaf0 con 0x7fc0e00fbe40 2024-02-07T12:29:00.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.721+0000 7fc0df7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e00fcfb0 0x7fc0e00fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:00.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.721+0000 7fc0df7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e00fcfb0 0x7fc0e00fe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33988/0 (socket says 172.21.15.47:33988) 2024-02-07T12:29:00.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.721+0000 7fc0df7fe700 1 -- 172.21.15.47:0/1835654224 learned_addr learned my addr 172.21.15.47:0/1835654224 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:29:00.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.721+0000 7fc0dffff700 1 --2- 172.21.15.47:0/1835654224 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0e00fbe40 0x7fc0e00fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:00.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.722+0000 7fc0df7fe700 1 -- 172.21.15.47:0/1835654224 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0e00fbe40 msgr2=0x7fc0e00fff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:00.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.722+0000 7fc0df7fe700 1 --2- 172.21.15.47:0/1835654224 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0e00fbe40 0x7fc0e00fff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.722+0000 7fc0df7fe700 1 -- 172.21.15.47:0/1835654224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d4005040 con 0x7fc0e00fcfb0 2024-02-07T12:29:00.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.722+0000 7fc0df7fe700 1 --2- 172.21.15.47:0/1835654224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e00fcfb0 0x7fc0e00fe380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40093b0 tx=0x7fc0d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:00.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.722+0000 7fc0dcff9700 1 -- 172.21.15.47:0/1835654224 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0d400e040 con 0x7fc0e00fcfb0 2024-02-07T12:29:00.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.722+0000 7fc0dcff9700 1 -- 172.21.15.47:0/1835654224 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0d400bcc0 con 0x7fc0e00fcfb0 2024-02-07T12:29:00.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.722+0000 7fc0e63ce700 1 -- 172.21.15.47:0/1835654224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e00fed70 con 0x7fc0e00fcfb0 2024-02-07T12:29:00.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.722+0000 7fc0dcff9700 1 -- 172.21.15.47:0/1835654224 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0d401c630 con 0x7fc0e00fcfb0 2024-02-07T12:29:00.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.722+0000 7fc0e63ce700 1 -- 172.21.15.47:0/1835654224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e0115990 con 0x7fc0e00fcfb0 2024-02-07T12:29:00.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.723+0000 7fc0e63ce700 1 -- 172.21.15.47:0/1835654224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e004bed0 con 0x7fc0e00fcfb0 2024-02-07T12:29:00.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.723+0000 7fc0dcff9700 1 -- 172.21.15.47:0/1835654224 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fc0d4013980 con 0x7fc0e00fcfb0 2024-02-07T12:29:00.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.724+0000 7fc0dcff9700 1 --2- 172.21.15.47:0/1835654224 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc0c806d900 0x7fc0c806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:00.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.724+0000 7fc0dffff700 1 --2- 172.21.15.47:0/1835654224 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc0c806d900 0x7fc0c806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:00.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.724+0000 7fc0dcff9700 1 -- 172.21.15.47:0/1835654224 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc0d408e4f0 con 0x7fc0e00fcfb0 2024-02-07T12:29:00.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.724+0000 7fc0dffff700 1 --2- 172.21.15.47:0/1835654224 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc0c806d900 0x7fc0c806fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00ffc90 tx=0x7fc0d000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:00.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.729+0000 7fc0dcff9700 1 -- 172.21.15.47:0/1835654224 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc0d405b6d0 con 0x7fc0e00fcfb0 2024-02-07T12:29:00.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:00 smithi138 ceph-mon[82055]: Reconfiguring mds.cephfs.smithi047.lagmef (monmap changed)... 2024-02-07T12:29:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:00 smithi138 ceph-mon[82055]: Reconfiguring daemon mds.cephfs.smithi047.lagmef on smithi047 2024-02-07T12:29:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:00 smithi138 ceph-mon[82055]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:00.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:00 smithi047 ceph-mon[93224]: Reconfiguring mds.cephfs.smithi047.lagmef (monmap changed)... 2024-02-07T12:29:00.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:00 smithi047 ceph-mon[93224]: Reconfiguring daemon mds.cephfs.smithi047.lagmef on smithi047 2024-02-07T12:29:00.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:00 smithi047 ceph-mon[93224]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:00.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.989+0000 7fc0e63ce700 1 -- 172.21.15.47:0/1835654224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc0e0104930 con 0x7fc0e00fcfb0 2024-02-07T12:29:00.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.990+0000 7fc0dcff9700 1 -- 172.21.15.47:0/1835654224 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1906 (secure 0 0 0) 0x7fc0d405b260 con 0x7fc0e00fcfb0 2024-02-07T12:29:00.993 INFO:teuthology.orchestra.run.smithi047.stdout:e20 2024-02-07T12:29:00.993 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:29:00.993 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:29:00.993 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:29:00.993 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 20 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:26:24.336188+0000 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:29:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 export targets 1 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:29:00.995 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:29:00.996 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:29:00.996 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:29:00.996 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:29:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.992+0000 7fc0e63ce700 1 -- 172.21.15.47:0/1835654224 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc0c806d900 msgr2=0x7fc0c806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.992+0000 7fc0e63ce700 1 --2- 172.21.15.47:0/1835654224 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc0c806d900 0x7fc0c806fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00ffc90 tx=0x7fc0d000b040 comp rx=0 tx=0).stop 2024-02-07T12:29:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.992+0000 7fc0e63ce700 1 -- 172.21.15.47:0/1835654224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e00fcfb0 msgr2=0x7fc0e00fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.992+0000 7fc0e63ce700 1 --2- 172.21.15.47:0/1835654224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e00fcfb0 0x7fc0e00fe380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40093b0 tx=0x7fc0d4009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.992+0000 7fc0e63ce700 1 -- 172.21.15.47:0/1835654224 shutdown_connections 2024-02-07T12:29:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.992+0000 7fc0e63ce700 1 --2- 172.21.15.47:0/1835654224 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc0c806d900 0x7fc0c806fdb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.992+0000 7fc0e63ce700 1 --2- 172.21.15.47:0/1835654224 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0e00fbe40 0x7fc0e00fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.992+0000 7fc0e63ce700 1 --2- 172.21.15.47:0/1835654224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e00fcfb0 0x7fc0e00fe380 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.992+0000 7fc0e63ce700 1 -- 172.21.15.47:0/1835654224 >> 172.21.15.47:0/1835654224 conn(0x7fc0e00f74e0 msgr2=0x7fc0e00656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.992+0000 7fc0e63ce700 1 -- 172.21.15.47:0/1835654224 shutdown_connections 2024-02-07T12:29:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:00.992+0000 7fc0e63ce700 1 -- 172.21.15.47:0/1835654224 wait complete. 2024-02-07T12:29:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-02-07T12:29:01.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.100+0000 7f0ad6e45700 1 -- 172.21.15.47:0/3318672480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad00fcfb0 msgr2=0x7f0ad00fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:01.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.100+0000 7f0ad6e45700 1 --2- 172.21.15.47:0/3318672480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad00fcfb0 0x7f0ad00fd420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0abc004940 tx=0x7f0abc009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:01.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.100+0000 7f0ad6e45700 1 -- 172.21.15.47:0/3318672480 shutdown_connections 2024-02-07T12:29:01.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.100+0000 7f0ad6e45700 1 --2- 172.21.15.47:0/3318672480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad00fcfb0 0x7f0ad00fd420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:01.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.100+0000 7f0ad6e45700 1 --2- 172.21.15.47:0/3318672480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ad00fbe40 0x7f0ad00fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:01.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.100+0000 7f0ad6e45700 1 -- 172.21.15.47:0/3318672480 >> 172.21.15.47:0/3318672480 conn(0x7f0ad00f7500 msgr2=0x7f0ad00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:01.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.100+0000 7f0ad6e45700 1 -- 172.21.15.47:0/3318672480 shutdown_connections 2024-02-07T12:29:01.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.100+0000 7f0ad6e45700 1 -- 172.21.15.47:0/3318672480 wait complete. 2024-02-07T12:29:01.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.101+0000 7f0ad6e45700 1 Processor -- start 2024-02-07T12:29:01.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.101+0000 7f0ad6e45700 1 -- start start 2024-02-07T12:29:01.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.101+0000 7f0ad6e45700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ad00fbe40 0x7f0ad010d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:01.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.101+0000 7f0ad6e45700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad00fcfb0 0x7f0ad010de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.101+0000 7f0ad6e45700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad010e480 con 0x7f0ad00fcfb0 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.101+0000 7f0ad6e45700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad010ed20 con 0x7f0ad00fbe40 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.101+0000 7f0acffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad00fcfb0 0x7f0ad010de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.101+0000 7f0acffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad00fcfb0 0x7f0ad010de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34014/0 (socket says 172.21.15.47:34014) 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.101+0000 7f0acffff700 1 -- 172.21.15.47:0/2670125328 learned_addr learned my addr 172.21.15.47:0/2670125328 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.102+0000 7f0ad4be1700 1 --2- 172.21.15.47:0/2670125328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ad00fbe40 0x7f0ad010d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.102+0000 7f0acffff700 1 -- 172.21.15.47:0/2670125328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ad00fbe40 msgr2=0x7f0ad010d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.102+0000 7f0acffff700 1 --2- 172.21.15.47:0/2670125328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ad00fbe40 0x7f0ad010d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.102+0000 7f0acffff700 1 -- 172.21.15.47:0/2670125328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc005040 con 0x7f0ad00fcfb0 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.102+0000 7f0acffff700 1 --2- 172.21.15.47:0/2670125328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad00fcfb0 0x7f0ad010de80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0093b0 tx=0x7f0abc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.102+0000 7f0acd7fa700 1 -- 172.21.15.47:0/2670125328 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0abc00e040 con 0x7f0ad00fcfb0 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.102+0000 7f0ad6e45700 1 -- 172.21.15.47:0/2670125328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad010efa0 con 0x7f0ad00fcfb0 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.102+0000 7f0acd7fa700 1 -- 172.21.15.47:0/2670125328 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0abc00bcc0 con 0x7f0ad00fcfb0 2024-02-07T12:29:01.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.102+0000 7f0ad6e45700 1 -- 172.21.15.47:0/2670125328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad010f4e0 con 0x7f0ad00fcfb0 2024-02-07T12:29:01.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.102+0000 7f0acd7fa700 1 -- 172.21.15.47:0/2670125328 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0abc01c630 con 0x7f0ad00fcfb0 2024-02-07T12:29:01.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.103+0000 7f0ad6e45700 1 -- 172.21.15.47:0/2670125328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad00fb1a0 con 0x7f0ad00fcfb0 2024-02-07T12:29:01.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.104+0000 7f0acd7fa700 1 -- 172.21.15.47:0/2670125328 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f0abc01c8a0 con 0x7f0ad00fcfb0 2024-02-07T12:29:01.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.105+0000 7f0acd7fa700 1 --2- 172.21.15.47:0/2670125328 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0ac006d900 0x7f0ac006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:01.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.105+0000 7f0acd7fa700 1 -- 172.21.15.47:0/2670125328 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0abc08e5e0 con 0x7f0ad00fcfb0 2024-02-07T12:29:01.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.105+0000 7f0ad4be1700 1 --2- 172.21.15.47:0/2670125328 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0ac006d900 0x7f0ac006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:01.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.105+0000 7f0ad4be1700 1 --2- 172.21.15.47:0/2670125328 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0ac006d900 0x7f0ac006fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4007fd0 tx=0x7f0ac4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:01.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.110+0000 7f0acd7fa700 1 -- 172.21.15.47:0/2670125328 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0abc05b7c0 con 0x7f0ad00fcfb0 2024-02-07T12:29:01.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.330+0000 7f0ad6e45700 1 -- 172.21.15.47:0/2670125328 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ad010f8d0 con 0x7f0ac006d900 2024-02-07T12:29:01.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.332+0000 7f0acd7fa700 1 -- 172.21.15.47:0/2670125328 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f0ad010f8d0 con 0x7f0ac006d900 2024-02-07T12:29:01.335 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:29:01.335 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:29:01.335 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:29:01.335 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:29:01.335 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:29:01.335 INFO:teuthology.orchestra.run.smithi047.stdout: "mon", 2024-02-07T12:29:01.335 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr" 2024-02-07T12:29:01.335 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:29:01.335 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "4/21 daemons upgraded", 2024-02-07T12:29:01.335 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading mon daemons", 2024-02-07T12:29:01.336 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:29:01.336 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:29:01.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.334+0000 7f0ad6e45700 1 -- 172.21.15.47:0/2670125328 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0ac006d900 msgr2=0x7f0ac006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:01.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.334+0000 7f0ad6e45700 1 --2- 172.21.15.47:0/2670125328 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0ac006d900 0x7f0ac006fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4007fd0 tx=0x7f0ac4009040 comp rx=0 tx=0).stop 2024-02-07T12:29:01.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.334+0000 7f0ad6e45700 1 -- 172.21.15.47:0/2670125328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad00fcfb0 msgr2=0x7f0ad010de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:01.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.334+0000 7f0ad6e45700 1 --2- 172.21.15.47:0/2670125328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad00fcfb0 0x7f0ad010de80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0093b0 tx=0x7f0abc009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:01.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.334+0000 7f0ad6e45700 1 -- 172.21.15.47:0/2670125328 shutdown_connections 2024-02-07T12:29:01.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.334+0000 7f0ad6e45700 1 --2- 172.21.15.47:0/2670125328 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0ac006d900 0x7f0ac006fdb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:01.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.334+0000 7f0ad6e45700 1 --2- 172.21.15.47:0/2670125328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ad00fbe40 0x7f0ad010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:01.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.334+0000 7f0ad6e45700 1 --2- 172.21.15.47:0/2670125328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad00fcfb0 0x7f0ad010de80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:01.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.334+0000 7f0ad6e45700 1 -- 172.21.15.47:0/2670125328 >> 172.21.15.47:0/2670125328 conn(0x7f0ad00f7500 msgr2=0x7f0ad0100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:01.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.334+0000 7f0ad6e45700 1 -- 172.21.15.47:0/2670125328 shutdown_connections 2024-02-07T12:29:01.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.334+0000 7f0ad6e45700 1 -- 172.21.15.47:0/2670125328 wait complete. 2024-02-07T12:29:01.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.454+0000 7fd956989700 1 -- 172.21.15.47:0/4131094765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9500fda80 msgr2=0x7fd9500ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:01.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.454+0000 7fd956989700 1 --2- 172.21.15.47:0/4131094765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9500fda80 0x7fd9500ffe60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd940004940 tx=0x7fd940009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:01.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.455+0000 7fd956989700 1 -- 172.21.15.47:0/4131094765 shutdown_connections 2024-02-07T12:29:01.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.455+0000 7fd956989700 1 --2- 172.21.15.47:0/4131094765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9501003a0 0x7fd950102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:01.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.455+0000 7fd956989700 1 --2- 172.21.15.47:0/4131094765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9500fda80 0x7fd9500ffe60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:01.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.455+0000 7fd956989700 1 -- 172.21.15.47:0/4131094765 >> 172.21.15.47:0/4131094765 conn(0x7fd9500f7520 msgr2=0x7fd9500f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:01.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.455+0000 7fd956989700 1 -- 172.21.15.47:0/4131094765 shutdown_connections 2024-02-07T12:29:01.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.455+0000 7fd956989700 1 -- 172.21.15.47:0/4131094765 wait complete. 2024-02-07T12:29:01.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.455+0000 7fd956989700 1 Processor -- start 2024-02-07T12:29:01.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.455+0000 7fd956989700 1 -- start start 2024-02-07T12:29:01.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd956989700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9500fda80 0x7fd95010fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:01.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd956989700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9501003a0 0x7fd950110020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:01.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd956989700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd950110620 con 0x7fd9500fda80 2024-02-07T12:29:01.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd956989700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd950110ec0 con 0x7fd9501003a0 2024-02-07T12:29:01.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd94ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9500fda80 0x7fd95010fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:01.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd94ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9500fda80 0x7fd95010fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34026/0 (socket says 172.21.15.47:34026) 2024-02-07T12:29:01.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd94ffff700 1 -- 172.21.15.47:0/3948412202 learned_addr learned my addr 172.21.15.47:0/3948412202 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:29:01.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd94f7fe700 1 --2- 172.21.15.47:0/3948412202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9501003a0 0x7fd950110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:01.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd94ffff700 1 -- 172.21.15.47:0/3948412202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9501003a0 msgr2=0x7fd950110020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:01.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd94ffff700 1 --2- 172.21.15.47:0/3948412202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9501003a0 0x7fd950110020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:01.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd94ffff700 1 -- 172.21.15.47:0/3948412202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd940005040 con 0x7fd9500fda80 2024-02-07T12:29:01.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd94ffff700 1 --2- 172.21.15.47:0/3948412202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9500fda80 0x7fd95010fae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd940009fd0 tx=0x7fd940009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:01.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd94cff9700 1 -- 172.21.15.47:0/3948412202 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd94000e040 con 0x7fd9500fda80 2024-02-07T12:29:01.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd94cff9700 1 -- 172.21.15.47:0/3948412202 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd94000bcc0 con 0x7fd9500fda80 2024-02-07T12:29:01.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd956989700 1 -- 172.21.15.47:0/3948412202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd950111140 con 0x7fd9500fda80 2024-02-07T12:29:01.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd94cff9700 1 -- 172.21.15.47:0/3948412202 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd94001c630 con 0x7fd9500fda80 2024-02-07T12:29:01.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.456+0000 7fd956989700 1 -- 172.21.15.47:0/3948412202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd950111680 con 0x7fd9500fda80 2024-02-07T12:29:01.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.457+0000 7fd956989700 1 -- 172.21.15.47:0/3948412202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95004bed0 con 0x7fd9500fda80 2024-02-07T12:29:01.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.458+0000 7fd94cff9700 1 -- 172.21.15.47:0/3948412202 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fd940013420 con 0x7fd9500fda80 2024-02-07T12:29:01.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.458+0000 7fd94cff9700 1 --2- 172.21.15.47:0/3948412202 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd93806d900 0x7fd93806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:01.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.459+0000 7fd94cff9700 1 -- 172.21.15.47:0/3948412202 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd94008e5e0 con 0x7fd9500fda80 2024-02-07T12:29:01.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.459+0000 7fd94f7fe700 1 --2- 172.21.15.47:0/3948412202 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd93806d900 0x7fd93806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:01.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.459+0000 7fd94f7fe700 1 --2- 172.21.15.47:0/3948412202 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd93806d900 0x7fd93806fdb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd944007fd0 tx=0x7fd944009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:01.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.463+0000 7fd94cff9700 1 -- 172.21.15.47:0/3948412202 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd94005b760 con 0x7fd9500fda80 2024-02-07T12:29:01.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.751+0000 7fd956989700 1 -- 172.21.15.47:0/3948412202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd950105a10 con 0x7fd9500fda80 2024-02-07T12:29:01.755 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:01 smithi047 ceph-mon[93224]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:01.755 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:01 smithi047 ceph-mon[93224]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:01.755 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:01 smithi047 ceph-mon[93224]: pgmap v20: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:01.755 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:01 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/829928567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:01.755 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:01 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:01.755 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:01 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:01.755 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:01 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.jsgfge", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:29:01.756 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:01 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:01.756 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:01 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1835654224' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:29:01.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.752+0000 7fd94cff9700 1 -- 172.21.15.47:0/3948412202 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd94005b2f0 con 0x7fd9500fda80 2024-02-07T12:29:01.756 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:29:01.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.754+0000 7fd956989700 1 -- 172.21.15.47:0/3948412202 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd93806d900 msgr2=0x7fd93806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:01.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.754+0000 7fd956989700 1 --2- 172.21.15.47:0/3948412202 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd93806d900 0x7fd93806fdb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd944007fd0 tx=0x7fd944009040 comp rx=0 tx=0).stop 2024-02-07T12:29:01.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.754+0000 7fd956989700 1 -- 172.21.15.47:0/3948412202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9500fda80 msgr2=0x7fd95010fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:01.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.754+0000 7fd956989700 1 --2- 172.21.15.47:0/3948412202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9500fda80 0x7fd95010fae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd940009fd0 tx=0x7fd940009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:01.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.754+0000 7fd956989700 1 -- 172.21.15.47:0/3948412202 shutdown_connections 2024-02-07T12:29:01.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.754+0000 7fd956989700 1 --2- 172.21.15.47:0/3948412202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9500fda80 0x7fd95010fae0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:01.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.754+0000 7fd956989700 1 --2- 172.21.15.47:0/3948412202 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd93806d900 0x7fd93806fdb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:01.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.754+0000 7fd956989700 1 --2- 172.21.15.47:0/3948412202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9501003a0 0x7fd950110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:01.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.754+0000 7fd956989700 1 -- 172.21.15.47:0/3948412202 >> 172.21.15.47:0/3948412202 conn(0x7fd9500f7520 msgr2=0x7fd9500fb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:01.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.754+0000 7fd956989700 1 -- 172.21.15.47:0/3948412202 shutdown_connections 2024-02-07T12:29:01.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:01.754+0000 7fd956989700 1 -- 172.21.15.47:0/3948412202 wait complete. 2024-02-07T12:29:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:01 smithi138 ceph-mon[82055]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:01 smithi138 ceph-mon[82055]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:01 smithi138 ceph-mon[82055]: pgmap v20: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:01 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/829928567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:01 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:01 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:01 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.jsgfge", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:29:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:01 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:01.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:01 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1835654224' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:29:02.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:02 smithi138 ceph-mon[82055]: Reconfiguring mds.cephfs.smithi047.jsgfge (monmap changed)... 2024-02-07T12:29:02.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:02 smithi138 ceph-mon[82055]: Reconfiguring daemon mds.cephfs.smithi047.jsgfge on smithi047 2024-02-07T12:29:02.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:02 smithi138 ceph-mon[82055]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:02.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:02 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3948412202' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:29:02.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:02 smithi047 ceph-mon[93224]: Reconfiguring mds.cephfs.smithi047.jsgfge (monmap changed)... 2024-02-07T12:29:02.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:02 smithi047 ceph-mon[93224]: Reconfiguring daemon mds.cephfs.smithi047.jsgfge on smithi047 2024-02-07T12:29:02.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:02 smithi047 ceph-mon[93224]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:02.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:02 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3948412202' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:29:03.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:03 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:03.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:03 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:03.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:03 smithi138 ceph-mon[82055]: pgmap v21: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:03.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:03 smithi138 ceph-mon[82055]: Reconfiguring crash.smithi138 (monmap changed)... 2024-02-07T12:29:03.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:03 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:29:03.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:03 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:03.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:03 smithi138 ceph-mon[82055]: Reconfiguring daemon crash.smithi138 on smithi138 2024-02-07T12:29:04.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:03 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:04.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:03 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:04.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:03 smithi047 ceph-mon[93224]: pgmap v21: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:04.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:03 smithi047 ceph-mon[93224]: Reconfiguring crash.smithi138 (monmap changed)... 2024-02-07T12:29:04.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:03 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:29:04.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:03 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:04.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:03 smithi047 ceph-mon[93224]: Reconfiguring daemon crash.smithi138 on smithi138 2024-02-07T12:29:05.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:05 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:05 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:05 smithi138 ceph-mon[82055]: Reconfiguring mgr.smithi138.fiugmj (monmap changed)... 2024-02-07T12:29:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:05 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.fiugmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:29:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:05 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:29:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:05 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:05 smithi138 ceph-mon[82055]: Reconfiguring daemon mgr.smithi138.fiugmj on smithi138 2024-02-07T12:29:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:05 smithi138 ceph-mon[82055]: pgmap v22: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:05 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:05 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:05 smithi047 ceph-mon[93224]: Reconfiguring mgr.smithi138.fiugmj (monmap changed)... 2024-02-07T12:29:05.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:05 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.fiugmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-07T12:29:05.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:05 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-07T12:29:05.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:05 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:05.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:05 smithi047 ceph-mon[93224]: Reconfiguring daemon mgr.smithi138.fiugmj on smithi138 2024-02-07T12:29:05.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:05 smithi047 ceph-mon[93224]: pgmap v22: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:07.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:06 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:07.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:06 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:07.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:06 smithi138 ceph-mon[82055]: Reconfiguring mon.smithi138 (monmap changed)... 2024-02-07T12:29:07.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:06 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-07T12:29:07.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:06 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-07T12:29:07.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:06 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:07.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:06 smithi138 ceph-mon[82055]: Reconfiguring daemon mon.smithi138 on smithi138 2024-02-07T12:29:07.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:06 smithi138 ceph-mon[82055]: pgmap v23: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:07.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:06 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:07.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:06 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:07.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:06 smithi047 ceph-mon[93224]: Reconfiguring mon.smithi138 (monmap changed)... 2024-02-07T12:29:07.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:06 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-07T12:29:07.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:06 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-07T12:29:07.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:06 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:07.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:06 smithi047 ceph-mon[93224]: Reconfiguring daemon mon.smithi138 on smithi138 2024-02-07T12:29:07.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:06 smithi047 ceph-mon[93224]: pgmap v23: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:08.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:08 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:08.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:08 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:08.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:08 smithi138 ceph-mon[82055]: Reconfiguring osd.3 (monmap changed)... 2024-02-07T12:29:08.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:08 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-07T12:29:08.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:08 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:08.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:08 smithi138 ceph-mon[82055]: Reconfiguring daemon osd.3 on smithi138 2024-02-07T12:29:08.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:08 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:08.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:08 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:08.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:08 smithi047 ceph-mon[93224]: Reconfiguring osd.3 (monmap changed)... 2024-02-07T12:29:08.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:08 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-07T12:29:08.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:08 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:08.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:08 smithi047 ceph-mon[93224]: Reconfiguring daemon osd.3 on smithi138 2024-02-07T12:29:09.727 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:09 smithi138 ceph-mon[82055]: pgmap v24: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:09.727 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:09.728 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:09.728 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-07T12:29:09.728 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:09.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:09 smithi047 ceph-mon[93224]: pgmap v24: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:09.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:09.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:09.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-07T12:29:09.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:10.583 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:10 smithi138 ceph-mon[82055]: Reconfiguring osd.4 (monmap changed)... 2024-02-07T12:29:10.583 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:10 smithi138 ceph-mon[82055]: Reconfiguring daemon osd.4 on smithi138 2024-02-07T12:29:10.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:10 smithi047 ceph-mon[93224]: Reconfiguring osd.4 (monmap changed)... 2024-02-07T12:29:10.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:10 smithi047 ceph-mon[93224]: Reconfiguring daemon osd.4 on smithi138 2024-02-07T12:29:11.579 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:11 smithi138 ceph-mon[82055]: pgmap v25: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:11.579 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:11.580 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:11.580 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-07T12:29:11.580 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:11.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:11 smithi047 ceph-mon[93224]: pgmap v25: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:11.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:11.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:11.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-07T12:29:11.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:12 smithi138 ceph-mon[82055]: Reconfiguring osd.5 (monmap changed)... 2024-02-07T12:29:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:12 smithi138 ceph-mon[82055]: Reconfiguring daemon osd.5 on smithi138 2024-02-07T12:29:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:29:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.jhsygn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:29:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:12 smithi047 ceph-mon[93224]: Reconfiguring osd.5 (monmap changed)... 2024-02-07T12:29:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:12 smithi047 ceph-mon[93224]: Reconfiguring daemon osd.5 on smithi138 2024-02-07T12:29:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:29:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.jhsygn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:29:12.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:13.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:13 smithi138 ceph-mon[82055]: Reconfiguring mds.cephfs.smithi138.jhsygn (monmap changed)... 2024-02-07T12:29:13.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:13 smithi138 ceph-mon[82055]: Reconfiguring daemon mds.cephfs.smithi138.jhsygn on smithi138 2024-02-07T12:29:13.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:13 smithi138 ceph-mon[82055]: pgmap v26: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:13.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:13 smithi047 ceph-mon[93224]: Reconfiguring mds.cephfs.smithi138.jhsygn (monmap changed)... 2024-02-07T12:29:13.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:13 smithi047 ceph-mon[93224]: Reconfiguring daemon mds.cephfs.smithi138.jhsygn on smithi138 2024-02-07T12:29:13.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:13 smithi047 ceph-mon[93224]: pgmap v26: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:15.226 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:14 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:15.226 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:14 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:15.226 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:14 smithi138 ceph-mon[82055]: Reconfiguring mds.cephfs.smithi138.axpdsx (monmap changed)... 2024-02-07T12:29:15.226 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:14 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.axpdsx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:29:15.226 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:14 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:15.226 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:14 smithi138 ceph-mon[82055]: Reconfiguring daemon mds.cephfs.smithi138.axpdsx on smithi138 2024-02-07T12:29:15.226 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:14 smithi138 ceph-mon[82055]: pgmap v27: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:15.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:14 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:15.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:14 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:15.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:14 smithi047 ceph-mon[93224]: Reconfiguring mds.cephfs.smithi138.axpdsx (monmap changed)... 2024-02-07T12:29:15.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:14 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.axpdsx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:29:15.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:14 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:15.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:14 smithi047 ceph-mon[93224]: Reconfiguring daemon mds.cephfs.smithi138.axpdsx on smithi138 2024-02-07T12:29:15.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:14 smithi047 ceph-mon[93224]: pgmap v27: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:16.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:16.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:16.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:29:16.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:16.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:16.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:16 smithi138 ceph-mon[82055]: Upgrade: Setting container_image for all mon 2024-02-07T12:29:16.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:16.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi047"}]: dispatch 2024-02-07T12:29:16.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi047"}]': finished 2024-02-07T12:29:16.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi138"}]: dispatch 2024-02-07T12:29:16.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi138"}]': finished 2024-02-07T12:29:16.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:16.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:16.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:29:16.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:16.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:16.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:16 smithi047 ceph-mon[93224]: Upgrade: Setting container_image for all mon 2024-02-07T12:29:16.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:16.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi047"}]: dispatch 2024-02-07T12:29:16.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi047"}]': finished 2024-02-07T12:29:16.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi138"}]: dispatch 2024-02-07T12:29:16.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi138"}]': finished 2024-02-07T12:29:17.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:17 smithi047 ceph-mon[93224]: pgmap v28: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:17.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:17 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:17.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:17 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:29:17.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:17 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:18.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:17 smithi138 ceph-mon[82055]: pgmap v28: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:18.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:17 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:18.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:17 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:29:18.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:17 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:18.734 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:18 smithi047 ceph-mon[93224]: Upgrade: Updating crash.smithi047 (1/2) 2024-02-07T12:29:18.734 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:18 smithi047 ceph-mon[93224]: Deploying daemon crash.smithi047 on smithi047 2024-02-07T12:29:19.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:18 smithi138 ceph-mon[82055]: Upgrade: Updating crash.smithi047 (1/2) 2024-02-07T12:29:19.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:18 smithi138 ceph-mon[82055]: Deploying daemon crash.smithi047 on smithi047 2024-02-07T12:29:19.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:19 smithi047 ceph-mon[93224]: pgmap v29: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:20.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:19 smithi138 ceph-mon[82055]: pgmap v29: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:20.872 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:20 smithi047 ceph-mon[93224]: pgmap v30: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:21.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:20 smithi138 ceph-mon[82055]: pgmap v30: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:22.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:21 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:22.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:21 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:22.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:21 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:22.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:21 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:23.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:23 smithi138 ceph-mon[82055]: Upgrade: Updating crash.smithi138 (2/2) 2024-02-07T12:29:23.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:23 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:23.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:23 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:29:23.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:23 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:23.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:23 smithi138 ceph-mon[82055]: Deploying daemon crash.smithi138 on smithi138 2024-02-07T12:29:23.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:23 smithi138 ceph-mon[82055]: pgmap v31: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:23 smithi047 ceph-mon[93224]: Upgrade: Updating crash.smithi138 (2/2) 2024-02-07T12:29:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:23 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:23 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-07T12:29:23.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:23 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:23.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:23 smithi047 ceph-mon[93224]: Deploying daemon crash.smithi138 on smithi138 2024-02-07T12:29:23.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:23 smithi047 ceph-mon[93224]: pgmap v31: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:25.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:24 smithi138 ceph-mon[82055]: pgmap v32: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:25.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:24 smithi047 ceph-mon[93224]: pgmap v32: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:27.023 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:27.023 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:27.023 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:29:27.023 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:27 smithi138 ceph-mon[82055]: pgmap v33: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:27.023 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:29:27.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:27.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:27.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:29:27.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:27 smithi047 ceph-mon[93224]: pgmap v33: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:27.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:29:29.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:29 smithi138 ceph-mon[82055]: pgmap v34: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:29.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:29 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:29.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:29 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:29.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:29 smithi047 ceph-mon[93224]: pgmap v34: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:29.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:29 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:29.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:29 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:31.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:31 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:31.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:31 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:31.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:31 smithi138 ceph-mon[82055]: pgmap v35: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:31 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:31 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:31 smithi047 ceph-mon[93224]: pgmap v35: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:31.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 -- 172.21.15.47:0/1610946196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36b80fe5c0 msgr2=0x7f36b80fe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:31.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 --2- 172.21.15.47:0/1610946196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36b80fe5c0 0x7f36b80fe9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f36b0004940 tx=0x7f36b0009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:31.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 -- 172.21.15.47:0/1610946196 shutdown_connections 2024-02-07T12:29:31.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 --2- 172.21.15.47:0/1610946196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36b80fefa0 0x7f36b80fb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:31.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 --2- 172.21.15.47:0/1610946196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36b80fe5c0 0x7f36b80fe9d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:31.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 -- 172.21.15.47:0/1610946196 >> 172.21.15.47:0/1610946196 conn(0x7f36b80f6ca0 msgr2=0x7f36b80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:31.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 -- 172.21.15.47:0/1610946196 shutdown_connections 2024-02-07T12:29:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 -- 172.21.15.47:0/1610946196 wait complete. 2024-02-07T12:29:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 Processor -- start 2024-02-07T12:29:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 -- start start 2024-02-07T12:29:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36b80fe5c0 0x7f36b80fde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36b80fc280 0x7f36b80fc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80fcc80 con 0x7f36b80fc280 2024-02-07T12:29:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.863+0000 7f36bcdfa700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80fcdc0 con 0x7f36b80fe5c0 2024-02-07T12:29:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.864+0000 7f36b5d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36b80fc280 0x7f36b80fc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.864+0000 7f36b5d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36b80fc280 0x7f36b80fc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58588/0 (socket says 172.21.15.47:58588) 2024-02-07T12:29:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.864+0000 7f36b5d9b700 1 -- 172.21.15.47:0/2437158835 learned_addr learned my addr 172.21.15.47:0/2437158835 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:29:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.864+0000 7f36b659c700 1 --2- 172.21.15.47:0/2437158835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36b80fe5c0 0x7f36b80fde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.864+0000 7f36b5d9b700 1 -- 172.21.15.47:0/2437158835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36b80fe5c0 msgr2=0x7f36b80fde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.864+0000 7f36b5d9b700 1 --2- 172.21.15.47:0/2437158835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36b80fe5c0 0x7f36b80fde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:31.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.864+0000 7f36b5d9b700 1 -- 172.21.15.47:0/2437158835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b0005040 con 0x7f36b80fc280 2024-02-07T12:29:31.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.864+0000 7f36b5d9b700 1 --2- 172.21.15.47:0/2437158835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36b80fc280 0x7f36b80fc6f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c800 tx=0x7f36a0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:31.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.864+0000 7f36aeffd700 1 -- 172.21.15.47:0/2437158835 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a000a760 con 0x7f36b80fc280 2024-02-07T12:29:31.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.864+0000 7f36aeffd700 1 -- 172.21.15.47:0/2437158835 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36a000ad90 con 0x7f36b80fc280 2024-02-07T12:29:31.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.864+0000 7f36bcdfa700 1 -- 172.21.15.47:0/2437158835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b80fd0a0 con 0x7f36b80fc280 2024-02-07T12:29:31.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.864+0000 7f36aeffd700 1 -- 172.21.15.47:0/2437158835 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a00113a0 con 0x7f36b80fc280 2024-02-07T12:29:31.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.864+0000 7f36bcdfa700 1 -- 172.21.15.47:0/2437158835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b8115de0 con 0x7f36b80fc280 2024-02-07T12:29:31.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.865+0000 7f36bcdfa700 1 -- 172.21.15.47:0/2437158835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b804bed0 con 0x7f36b80fc280 2024-02-07T12:29:31.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.866+0000 7f36aeffd700 1 -- 172.21.15.47:0/2437158835 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f36a0012400 con 0x7f36b80fc280 2024-02-07T12:29:31.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.866+0000 7f36aeffd700 1 --2- 172.21.15.47:0/2437158835 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f36a406d900 0x7f36a406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:31.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.867+0000 7f36aeffd700 1 -- 172.21.15.47:0/2437158835 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f36a008d080 con 0x7f36b80fc280 2024-02-07T12:29:31.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.867+0000 7f36b659c700 1 --2- 172.21.15.47:0/2437158835 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f36a406d900 0x7f36a406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:31.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.867+0000 7f36b659c700 1 --2- 172.21.15.47:0/2437158835 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f36a406d900 0x7f36a406fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f36b000b3b0 tx=0x7f36b0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:31.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:31.871+0000 7f36aeffd700 1 -- 172.21.15.47:0/2437158835 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f36a005a370 con 0x7f36b80fc280 2024-02-07T12:29:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.097+0000 7f36bcdfa700 1 -- 172.21.15.47:0/2437158835 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36b8102ce0 con 0x7f36a406d900 2024-02-07T12:29:32.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.098+0000 7f36aeffd700 1 -- 172.21.15.47:0/2437158835 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f36b8102ce0 con 0x7f36a406d900 2024-02-07T12:29:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.100+0000 7f36bcdfa700 1 -- 172.21.15.47:0/2437158835 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f36a406d900 msgr2=0x7f36a406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.100+0000 7f36bcdfa700 1 --2- 172.21.15.47:0/2437158835 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f36a406d900 0x7f36a406fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f36b000b3b0 tx=0x7f36b0009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.100+0000 7f36bcdfa700 1 -- 172.21.15.47:0/2437158835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36b80fc280 msgr2=0x7f36b80fc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.100+0000 7f36bcdfa700 1 --2- 172.21.15.47:0/2437158835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36b80fc280 0x7f36b80fc6f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c800 tx=0x7f36a0004470 comp rx=0 tx=0).stop 2024-02-07T12:29:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.101+0000 7f36bcdfa700 1 -- 172.21.15.47:0/2437158835 shutdown_connections 2024-02-07T12:29:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.101+0000 7f36bcdfa700 1 --2- 172.21.15.47:0/2437158835 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f36a406d900 0x7f36a406fdb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.101+0000 7f36bcdfa700 1 --2- 172.21.15.47:0/2437158835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36b80fe5c0 0x7f36b80fde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.101+0000 7f36bcdfa700 1 --2- 172.21.15.47:0/2437158835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36b80fc280 0x7f36b80fc6f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.101+0000 7f36bcdfa700 1 -- 172.21.15.47:0/2437158835 >> 172.21.15.47:0/2437158835 conn(0x7f36b80f6ca0 msgr2=0x7f36b81015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.101+0000 7f36bcdfa700 1 -- 172.21.15.47:0/2437158835 shutdown_connections 2024-02-07T12:29:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.101+0000 7f36bcdfa700 1 -- 172.21.15.47:0/2437158835 wait complete. 2024-02-07T12:29:32.113 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:29:32.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.208+0000 7ff21af64700 1 -- 172.21.15.47:0/3664899084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2140fbe40 msgr2=0x7ff2140fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:32.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.208+0000 7ff21af64700 1 --2- 172.21.15.47:0/3664899084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2140fbe40 0x7ff2140fc250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff208004940 tx=0x7ff208009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:32.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.208+0000 7ff21af64700 1 -- 172.21.15.47:0/3664899084 shutdown_connections 2024-02-07T12:29:32.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.208+0000 7ff21af64700 1 --2- 172.21.15.47:0/3664899084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2140fcfb0 0x7ff2140fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.208+0000 7ff21af64700 1 --2- 172.21.15.47:0/3664899084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2140fbe40 0x7ff2140fc250 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.208+0000 7ff21af64700 1 -- 172.21.15.47:0/3664899084 >> 172.21.15.47:0/3664899084 conn(0x7ff2140f74e0 msgr2=0x7ff2140f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:32.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.208+0000 7ff21af64700 1 -- 172.21.15.47:0/3664899084 shutdown_connections 2024-02-07T12:29:32.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.208+0000 7ff21af64700 1 -- 172.21.15.47:0/3664899084 wait complete. 2024-02-07T12:29:32.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.209+0000 7ff21af64700 1 Processor -- start 2024-02-07T12:29:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.209+0000 7ff21af64700 1 -- start start 2024-02-07T12:29:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.209+0000 7ff21af64700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2140fbe40 0x7ff2140fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.209+0000 7ff21af64700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2140fcfb0 0x7ff2140fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.209+0000 7ff21af64700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140fe980 con 0x7ff2140fbe40 2024-02-07T12:29:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.209+0000 7ff21af64700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140feaf0 con 0x7ff2140fcfb0 2024-02-07T12:29:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff218d00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2140fbe40 0x7ff2140fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff218d00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2140fbe40 0x7ff2140fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58612/0 (socket says 172.21.15.47:58612) 2024-02-07T12:29:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff218d00700 1 -- 172.21.15.47:0/3531472892 learned_addr learned my addr 172.21.15.47:0/3531472892 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:29:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff213fff700 1 --2- 172.21.15.47:0/3531472892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2140fcfb0 0x7ff2140fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff218d00700 1 -- 172.21.15.47:0/3531472892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2140fcfb0 msgr2=0x7ff2140fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff218d00700 1 --2- 172.21.15.47:0/3531472892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2140fcfb0 0x7ff2140fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff218d00700 1 -- 172.21.15.47:0/3531472892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff208005040 con 0x7ff2140fbe40 2024-02-07T12:29:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff213fff700 1 --2- 172.21.15.47:0/3531472892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2140fcfb0 0x7ff2140fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-07T12:29:32.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff218d00700 1 --2- 172.21.15.47:0/3531472892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2140fbe40 0x7ff2140fff00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff208000c00 tx=0x7ff208009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:32.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff2117fa700 1 -- 172.21.15.47:0/3531472892 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff208021070 con 0x7ff2140fbe40 2024-02-07T12:29:32.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff21af64700 1 -- 172.21.15.47:0/3531472892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2140fed70 con 0x7ff2140fbe40 2024-02-07T12:29:32.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff2117fa700 1 -- 172.21.15.47:0/3531472892 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff20801c400 con 0x7ff2140fbe40 2024-02-07T12:29:32.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff2117fa700 1 -- 172.21.15.47:0/3531472892 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff20800e070 con 0x7ff2140fbe40 2024-02-07T12:29:32.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.210+0000 7ff21af64700 1 -- 172.21.15.47:0/3531472892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff214115900 con 0x7ff2140fbe40 2024-02-07T12:29:32.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.212+0000 7ff21af64700 1 -- 172.21.15.47:0/3531472892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21404bed0 con 0x7ff2140fbe40 2024-02-07T12:29:32.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.212+0000 7ff2117fa700 1 -- 172.21.15.47:0/3531472892 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7ff20800b790 con 0x7ff2140fbe40 2024-02-07T12:29:32.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.212+0000 7ff2117fa700 1 --2- 172.21.15.47:0/3531472892 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff20406d900 0x7ff20406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:32.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.213+0000 7ff2117fa700 1 -- 172.21.15.47:0/3531472892 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff20808e350 con 0x7ff2140fbe40 2024-02-07T12:29:32.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.213+0000 7ff213fff700 1 --2- 172.21.15.47:0/3531472892 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff20406d900 0x7ff20406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:32.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.213+0000 7ff213fff700 1 --2- 172.21.15.47:0/3531472892 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff20406d900 0x7ff20406fdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff200004fd0 tx=0x7ff20000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:32.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.217+0000 7ff2117fa700 1 -- 172.21.15.47:0/3531472892 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff20805b530 con 0x7ff2140fbe40 2024-02-07T12:29:32.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:32 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:32.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:32 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:32.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.457+0000 7ff21af64700 1 -- 172.21.15.47:0/3531472892 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff214065dd0 con 0x7ff20406d900 2024-02-07T12:29:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.458+0000 7ff2117fa700 1 -- 172.21.15.47:0/3531472892 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7ff214065dd0 con 0x7ff20406d900 2024-02-07T12:29:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.460+0000 7ff21af64700 1 -- 172.21.15.47:0/3531472892 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff20406d900 msgr2=0x7ff20406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.460+0000 7ff21af64700 1 --2- 172.21.15.47:0/3531472892 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff20406d900 0x7ff20406fdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff200004fd0 tx=0x7ff20000b040 comp rx=0 tx=0).stop 2024-02-07T12:29:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.460+0000 7ff21af64700 1 -- 172.21.15.47:0/3531472892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2140fbe40 msgr2=0x7ff2140fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.460+0000 7ff21af64700 1 --2- 172.21.15.47:0/3531472892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2140fbe40 0x7ff2140fff00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff208000c00 tx=0x7ff208009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:32.463 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:32 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:32.463 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:32 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.460+0000 7ff21af64700 1 -- 172.21.15.47:0/3531472892 shutdown_connections 2024-02-07T12:29:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.460+0000 7ff21af64700 1 --2- 172.21.15.47:0/3531472892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2140fbe40 0x7ff2140fff00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.460+0000 7ff21af64700 1 --2- 172.21.15.47:0/3531472892 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff20406d900 0x7ff20406fdb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.460+0000 7ff21af64700 1 --2- 172.21.15.47:0/3531472892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2140fcfb0 0x7ff2140fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.460+0000 7ff21af64700 1 -- 172.21.15.47:0/3531472892 >> 172.21.15.47:0/3531472892 conn(0x7ff2140f74e0 msgr2=0x7ff2140656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.460+0000 7ff21af64700 1 -- 172.21.15.47:0/3531472892 shutdown_connections 2024-02-07T12:29:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.460+0000 7ff21af64700 1 -- 172.21.15.47:0/3531472892 wait complete. 2024-02-07T12:29:32.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.566+0000 7fa79385a700 1 -- 172.21.15.47:0/2500752263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c0fbca0 msgr2=0x7fa78c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:32.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.566+0000 7fa79385a700 1 --2- 172.21.15.47:0/2500752263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c0fbca0 0x7fa78c0fe550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa77c004940 tx=0x7fa77c009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:32.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.566+0000 7fa79385a700 1 -- 172.21.15.47:0/2500752263 shutdown_connections 2024-02-07T12:29:32.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.566+0000 7fa79385a700 1 --2- 172.21.15.47:0/2500752263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c0fbca0 0x7fa78c0fe550 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.566+0000 7fa79385a700 1 --2- 172.21.15.47:0/2500752263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa78c0fb2c0 0x7fa78c0fb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.566+0000 7fa79385a700 1 -- 172.21.15.47:0/2500752263 >> 172.21.15.47:0/2500752263 conn(0x7fa78c0f6ca0 msgr2=0x7fa78c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:32.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.566+0000 7fa79385a700 1 -- 172.21.15.47:0/2500752263 shutdown_connections 2024-02-07T12:29:32.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.566+0000 7fa79385a700 1 -- 172.21.15.47:0/2500752263 wait complete. 2024-02-07T12:29:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.567+0000 7fa79385a700 1 Processor -- start 2024-02-07T12:29:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.567+0000 7fa79385a700 1 -- start start 2024-02-07T12:29:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.567+0000 7fa79385a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa78c0fb2c0 0x7fa78c10db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.567+0000 7fa79385a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c10e0c0 0x7fa78c10ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.567+0000 7fa79385a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c10e580 con 0x7fa78c10e0c0 2024-02-07T12:29:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.567+0000 7fa79385a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c10e6c0 con 0x7fa78c0fb2c0 2024-02-07T12:29:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.567+0000 7fa790df5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c10e0c0 0x7fa78c10ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.567+0000 7fa790df5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c10e0c0 0x7fa78c10ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58622/0 (socket says 172.21.15.47:58622) 2024-02-07T12:29:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.567+0000 7fa790df5700 1 -- 172.21.15.47:0/4086366812 learned_addr learned my addr 172.21.15.47:0/4086366812 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:29:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.567+0000 7fa7915f6700 1 --2- 172.21.15.47:0/4086366812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa78c0fb2c0 0x7fa78c10db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:32.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.567+0000 7fa790df5700 1 -- 172.21.15.47:0/4086366812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa78c0fb2c0 msgr2=0x7fa78c10db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:32.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.567+0000 7fa790df5700 1 --2- 172.21.15.47:0/4086366812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa78c0fb2c0 0x7fa78c10db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.567+0000 7fa790df5700 1 -- 172.21.15.47:0/4086366812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c005040 con 0x7fa78c10e0c0 2024-02-07T12:29:32.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.568+0000 7fa790df5700 1 --2- 172.21.15.47:0/4086366812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c10e0c0 0x7fa78c10ef60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa77c000c00 tx=0x7fa77c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:32.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.568+0000 7fa781ffb700 1 -- 172.21.15.47:0/4086366812 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa77c021070 con 0x7fa78c10e0c0 2024-02-07T12:29:32.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.568+0000 7fa781ffb700 1 -- 172.21.15.47:0/4086366812 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa77c009430 con 0x7fa78c10e0c0 2024-02-07T12:29:32.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.568+0000 7fa781ffb700 1 -- 172.21.15.47:0/4086366812 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa77c00e070 con 0x7fa78c10e0c0 2024-02-07T12:29:32.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.568+0000 7fa79385a700 1 -- 172.21.15.47:0/4086366812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c10f560 con 0x7fa78c10e0c0 2024-02-07T12:29:32.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.568+0000 7fa79385a700 1 -- 172.21.15.47:0/4086366812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78c10fa10 con 0x7fa78c10e0c0 2024-02-07T12:29:32.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.569+0000 7fa79385a700 1 -- 172.21.15.47:0/4086366812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78c04bed0 con 0x7fa78c10e0c0 2024-02-07T12:29:32.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.570+0000 7fa781ffb700 1 -- 172.21.15.47:0/4086366812 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fa77c01c400 con 0x7fa78c10e0c0 2024-02-07T12:29:32.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.570+0000 7fa781ffb700 1 --2- 172.21.15.47:0/4086366812 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa77806d900 0x7fa77806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:32.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.571+0000 7fa781ffb700 1 -- 172.21.15.47:0/4086366812 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa77c08e150 con 0x7fa78c10e0c0 2024-02-07T12:29:32.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.571+0000 7fa7915f6700 1 --2- 172.21.15.47:0/4086366812 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa77806d900 0x7fa77806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:32.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.571+0000 7fa7915f6700 1 --2- 172.21.15.47:0/4086366812 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa77806d900 0x7fa77806fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa788009b80 tx=0x7fa78800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:32.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.575+0000 7fa781ffb700 1 -- 172.21.15.47:0/4086366812 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa77c05b3d0 con 0x7fa78c10e0c0 2024-02-07T12:29:32.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.792+0000 7fa79385a700 1 -- 172.21.15.47:0/4086366812 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa78c105db0 con 0x7fa77806d900 2024-02-07T12:29:32.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.803+0000 7fa781ffb700 1 -- 172.21.15.47:0/4086366812 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa78c105db0 con 0x7fa77806d900 2024-02-07T12:29:32.806 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:29:32.806 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (3m) 1s ago 11m 27.0M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:29:32.806 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (12s) 1s ago 12m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:29:32.806 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (7s) 3s ago 11m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:29:32.806 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (2m) 1s ago 11m 80.1M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:29:32.806 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (6m) 1s ago 6m 111M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:29:32.806 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (6m) 1s ago 6m 129M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:29:32.806 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (6m) 3s ago 6m 68.6M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (6m) 3s ago 6m 69.6M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (2m) 1s ago 13m 497M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (89s) 3s ago 11m 450M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (75s) 1s ago 13m 43.5M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (52s) 3s ago 11m 32.9M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (3m) 1s ago 12m 15.1M - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (2m) 3s ago 11m 15.3M - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (10m) 1s ago 10m 214M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 4f37918f583a 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (9m) 1s ago 9m 230M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 1c6e3c603ed3 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (9m) 1s ago 9m 180M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (8m) 3s ago 8m 264M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (8m) 3s ago 8m 234M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (8m) 3s ago 8m 218M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:29:32.807 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (94s) 1s ago 11m 48.6M - 2.43.0 a07b618ecd1d 32840d82c54b 2024-02-07T12:29:32.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.806+0000 7fa79385a700 1 -- 172.21.15.47:0/4086366812 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa77806d900 msgr2=0x7fa77806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:32.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.806+0000 7fa79385a700 1 --2- 172.21.15.47:0/4086366812 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa77806d900 0x7fa77806fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa788009b80 tx=0x7fa78800b040 comp rx=0 tx=0).stop 2024-02-07T12:29:32.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.806+0000 7fa79385a700 1 -- 172.21.15.47:0/4086366812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c10e0c0 msgr2=0x7fa78c10ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:32.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.806+0000 7fa79385a700 1 --2- 172.21.15.47:0/4086366812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c10e0c0 0x7fa78c10ef60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa77c000c00 tx=0x7fa77c009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:32.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.806+0000 7fa79385a700 1 -- 172.21.15.47:0/4086366812 shutdown_connections 2024-02-07T12:29:32.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.806+0000 7fa79385a700 1 --2- 172.21.15.47:0/4086366812 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa77806d900 0x7fa77806fdb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.806+0000 7fa79385a700 1 --2- 172.21.15.47:0/4086366812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa78c0fb2c0 0x7fa78c10db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.806+0000 7fa79385a700 1 --2- 172.21.15.47:0/4086366812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c10e0c0 0x7fa78c10ef60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.806+0000 7fa79385a700 1 -- 172.21.15.47:0/4086366812 >> 172.21.15.47:0/4086366812 conn(0x7fa78c0f6ca0 msgr2=0x7fa78c101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:32.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.806+0000 7fa79385a700 1 -- 172.21.15.47:0/4086366812 shutdown_connections 2024-02-07T12:29:32.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.806+0000 7fa79385a700 1 -- 172.21.15.47:0/4086366812 wait complete. 2024-02-07T12:29:32.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.931+0000 7f34fa0d8700 1 -- 172.21.15.47:0/241423483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34f4066c70 msgr2=0x7f34f4101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:32.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.931+0000 7f34fa0d8700 1 --2- 172.21.15.47:0/241423483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34f4066c70 0x7f34f4101ef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f34e4004940 tx=0x7f34e4009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:32.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.931+0000 7f34fa0d8700 1 -- 172.21.15.47:0/241423483 shutdown_connections 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.931+0000 7f34fa0d8700 1 --2- 172.21.15.47:0/241423483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f4102430 0x7f34f4104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.931+0000 7f34fa0d8700 1 --2- 172.21.15.47:0/241423483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34f4066c70 0x7f34f4101ef0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.931+0000 7f34fa0d8700 1 -- 172.21.15.47:0/241423483 >> 172.21.15.47:0/241423483 conn(0x7f34f40f7500 msgr2=0x7f34f40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.931+0000 7f34fa0d8700 1 -- 172.21.15.47:0/241423483 shutdown_connections 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.931+0000 7f34fa0d8700 1 -- 172.21.15.47:0/241423483 wait complete. 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.931+0000 7f34fa0d8700 1 Processor -- start 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.931+0000 7f34fa0d8700 1 -- start start 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.932+0000 7f34fa0d8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f4066c70 0x7f34f410fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.932+0000 7f34fa0d8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34f4102430 0x7f34f41100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.932+0000 7f34fa0d8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41106d0 con 0x7f34f4102430 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.932+0000 7f34fa0d8700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f4110f70 con 0x7f34f4066c70 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.932+0000 7f34f2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34f4102430 0x7f34f41100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.932+0000 7f34f37fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f4066c70 0x7f34f410fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.932+0000 7f34f2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34f4102430 0x7f34f41100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58630/0 (socket says 172.21.15.47:58630) 2024-02-07T12:29:32.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.932+0000 7f34f2ffd700 1 -- 172.21.15.47:0/1792704191 learned_addr learned my addr 172.21.15.47:0/1792704191 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:29:32.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.932+0000 7f34f37fe700 1 -- 172.21.15.47:0/1792704191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34f4102430 msgr2=0x7f34f41100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:32.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.932+0000 7f34f37fe700 1 --2- 172.21.15.47:0/1792704191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34f4102430 0x7f34f41100d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:32.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.932+0000 7f34f37fe700 1 -- 172.21.15.47:0/1792704191 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e4005040 con 0x7f34f4066c70 2024-02-07T12:29:32.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.932+0000 7f34f2ffd700 1 --2- 172.21.15.47:0/1792704191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34f4102430 0x7f34f41100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-07T12:29:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.933+0000 7f34f37fe700 1 --2- 172.21.15.47:0/1792704191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f4066c70 0x7f34f410fb90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009fd0 tx=0x7f34e4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.933+0000 7f34dbfff700 1 -- 172.21.15.47:0/1792704191 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e400e040 con 0x7f34f4066c70 2024-02-07T12:29:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.933+0000 7f34dbfff700 1 -- 172.21.15.47:0/1792704191 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f34e400bbf0 con 0x7f34f4066c70 2024-02-07T12:29:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.933+0000 7f34fa0d8700 1 -- 172.21.15.47:0/1792704191 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f41111f0 con 0x7f34f4066c70 2024-02-07T12:29:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.933+0000 7f34fa0d8700 1 -- 172.21.15.47:0/1792704191 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f4111730 con 0x7f34f4066c70 2024-02-07T12:29:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.933+0000 7f34dbfff700 1 -- 172.21.15.47:0/1792704191 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e4013660 con 0x7f34f4066c70 2024-02-07T12:29:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.934+0000 7f34dbfff700 1 -- 172.21.15.47:0/1792704191 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f34e40137c0 con 0x7f34f4066c70 2024-02-07T12:29:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.934+0000 7f34fa0d8700 1 -- 172.21.15.47:0/1792704191 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f404bed0 con 0x7f34f4066c70 2024-02-07T12:29:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.935+0000 7f34dbfff700 1 --2- 172.21.15.47:0/1792704191 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f34dc06d900 0x7f34dc06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.935+0000 7f34dbfff700 1 -- 172.21.15.47:0/1792704191 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f34e408d980 con 0x7f34f4066c70 2024-02-07T12:29:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.935+0000 7f34f2ffd700 1 --2- 172.21.15.47:0/1792704191 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f34dc06d900 0x7f34dc06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.936+0000 7f34f2ffd700 1 --2- 172.21.15.47:0/1792704191 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f34dc06d900 0x7f34dc06fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009fd0 tx=0x7f34e800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:32.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:32.940+0000 7f34dbfff700 1 -- 172.21.15.47:0/1792704191 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f34e405ab40 con 0x7f34f4066c70 2024-02-07T12:29:33.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.231+0000 7f34fa0d8700 1 -- 172.21.15.47:0/1792704191 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f34f4107c30 con 0x7f34f4066c70 2024-02-07T12:29:33.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.232+0000 7f34dbfff700 1 -- 172.21.15.47:0/1792704191 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f34e405a6d0 con 0x7f34f4066c70 2024-02-07T12:29:33.234 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:29:33.234 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 6 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 10, 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 4 2024-02-07T12:29:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:29:33.236 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:29:33.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.234+0000 7f34fa0d8700 1 -- 172.21.15.47:0/1792704191 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f34dc06d900 msgr2=0x7f34dc06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:33.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.234+0000 7f34fa0d8700 1 --2- 172.21.15.47:0/1792704191 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f34dc06d900 0x7f34dc06fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009fd0 tx=0x7f34e800b040 comp rx=0 tx=0).stop 2024-02-07T12:29:33.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.234+0000 7f34fa0d8700 1 -- 172.21.15.47:0/1792704191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f4066c70 msgr2=0x7f34f410fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:33.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.234+0000 7f34fa0d8700 1 --2- 172.21.15.47:0/1792704191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f4066c70 0x7f34f410fb90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009fd0 tx=0x7f34e4009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:33.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.234+0000 7f34fa0d8700 1 -- 172.21.15.47:0/1792704191 shutdown_connections 2024-02-07T12:29:33.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.234+0000 7f34fa0d8700 1 --2- 172.21.15.47:0/1792704191 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f34dc06d900 0x7f34dc06fdb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.234+0000 7f34fa0d8700 1 --2- 172.21.15.47:0/1792704191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f4066c70 0x7f34f410fb90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.234+0000 7f34fa0d8700 1 --2- 172.21.15.47:0/1792704191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34f4102430 0x7f34f41100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.234+0000 7f34fa0d8700 1 -- 172.21.15.47:0/1792704191 >> 172.21.15.47:0/1792704191 conn(0x7f34f40f7500 msgr2=0x7f34f40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:33.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.234+0000 7f34fa0d8700 1 -- 172.21.15.47:0/1792704191 shutdown_connections 2024-02-07T12:29:33.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.234+0000 7f34fa0d8700 1 -- 172.21.15.47:0/1792704191 wait complete. 2024-02-07T12:29:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 -- 172.21.15.47:0/2532372240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f682c1003a0 msgr2=0x7f682c102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 --2- 172.21.15.47:0/2532372240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f682c1003a0 0x7f682c102780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f681c004940 tx=0x7f681c009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 -- 172.21.15.47:0/2532372240 shutdown_connections 2024-02-07T12:29:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 --2- 172.21.15.47:0/2532372240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f682c1003a0 0x7f682c102780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 --2- 172.21.15.47:0/2532372240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f682c0fda80 0x7f682c0ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 -- 172.21.15.47:0/2532372240 >> 172.21.15.47:0/2532372240 conn(0x7f682c0f7520 msgr2=0x7f682c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 -- 172.21.15.47:0/2532372240 shutdown_connections 2024-02-07T12:29:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 -- 172.21.15.47:0/2532372240 wait complete. 2024-02-07T12:29:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 Processor -- start 2024-02-07T12:29:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 -- start start 2024-02-07T12:29:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f682c0fda80 0x7f682c10d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f682c1003a0 0x7f682c10de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c10e420 con 0x7f682c0fda80 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.341+0000 7f683384d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c10ecc0 con 0x7f682c1003a0 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.342+0000 7f68315e9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f682c0fda80 0x7f682c10d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.342+0000 7f68315e9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f682c0fda80 0x7f682c10d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58646/0 (socket says 172.21.15.47:58646) 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.342+0000 7f68315e9700 1 -- 172.21.15.47:0/3086684146 learned_addr learned my addr 172.21.15.47:0/3086684146 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.342+0000 7f6830de8700 1 --2- 172.21.15.47:0/3086684146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f682c1003a0 0x7f682c10de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.342+0000 7f68315e9700 1 -- 172.21.15.47:0/3086684146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f682c1003a0 msgr2=0x7f682c10de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.342+0000 7f68315e9700 1 --2- 172.21.15.47:0/3086684146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f682c1003a0 0x7f682c10de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.342+0000 7f68315e9700 1 -- 172.21.15.47:0/3086684146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c005040 con 0x7f682c0fda80 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.342+0000 7f6830de8700 1 --2- 172.21.15.47:0/3086684146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f682c1003a0 0x7f682c10de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.342+0000 7f68315e9700 1 --2- 172.21.15.47:0/3086684146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f682c0fda80 0x7f682c10d8e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f682800eb40 tx=0x7f682800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.342+0000 7f6821ffb700 1 -- 172.21.15.47:0/3086684146 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6828007cc0 con 0x7f682c0fda80 2024-02-07T12:29:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.342+0000 7f6821ffb700 1 -- 172.21.15.47:0/3086684146 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f682800f040 con 0x7f682c0fda80 2024-02-07T12:29:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.342+0000 7f683384d700 1 -- 172.21.15.47:0/3086684146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682c10ef40 con 0x7f682c0fda80 2024-02-07T12:29:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.342+0000 7f6821ffb700 1 -- 172.21.15.47:0/3086684146 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6828009620 con 0x7f682c0fda80 2024-02-07T12:29:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.343+0000 7f683384d700 1 -- 172.21.15.47:0/3086684146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c10f480 con 0x7f682c0fda80 2024-02-07T12:29:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.343+0000 7f683384d700 1 -- 172.21.15.47:0/3086684146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682c107a50 con 0x7f682c0fda80 2024-02-07T12:29:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.344+0000 7f6821ffb700 1 -- 172.21.15.47:0/3086684146 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f6828009780 con 0x7f682c0fda80 2024-02-07T12:29:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.344+0000 7f6821ffb700 1 --2- 172.21.15.47:0/3086684146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f681806d900 0x7f681806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.345+0000 7f6830de8700 1 --2- 172.21.15.47:0/3086684146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f681806d900 0x7f681806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.345+0000 7f6821ffb700 1 -- 172.21.15.47:0/3086684146 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f682808cd30 con 0x7f682c0fda80 2024-02-07T12:29:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.345+0000 7f6830de8700 1 --2- 172.21.15.47:0/3086684146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f681806d900 0x7f681806fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f681c009b30 tx=0x7f681c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.349+0000 7f6821ffb700 1 -- 172.21.15.47:0/3086684146 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6828059fc0 con 0x7f682c0fda80 2024-02-07T12:29:33.421 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:33 smithi138 ceph-mon[82055]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:33.422 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:33.422 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:33.422 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:33 smithi138 ceph-mon[82055]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:33.422 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:33 smithi138 ceph-mon[82055]: pgmap v36: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:33.422 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:33 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1792704191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:33.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:33 smithi047 ceph-mon[93224]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:33.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:33.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:33.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:33 smithi047 ceph-mon[93224]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:33.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:33 smithi047 ceph-mon[93224]: pgmap v36: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:33.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:33 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1792704191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:33.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.602+0000 7f683384d700 1 -- 172.21.15.47:0/3086684146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f682c02b2a0 con 0x7f682c0fda80 2024-02-07T12:29:33.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.602+0000 7f6821ffb700 1 -- 172.21.15.47:0/3086684146 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1889 (secure 0 0 0) 0x7f6828019780 con 0x7f682c0fda80 2024-02-07T12:29:33.605 INFO:teuthology.orchestra.run.smithi047.stdout:e21 2024-02-07T12:29:33.605 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:29:33.605 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:29:33.605 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:29:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:29:33.605 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:29:33.605 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:29:33.605 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 21 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:29:32.945302+0000 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:29:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:29:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:29:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:29:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.604+0000 7f683384d700 1 -- 172.21.15.47:0/3086684146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f681806d900 msgr2=0x7f681806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.605+0000 7f683384d700 1 --2- 172.21.15.47:0/3086684146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f681806d900 0x7f681806fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f681c009b30 tx=0x7f681c009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.605+0000 7f683384d700 1 -- 172.21.15.47:0/3086684146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f682c0fda80 msgr2=0x7f682c10d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.605+0000 7f683384d700 1 --2- 172.21.15.47:0/3086684146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f682c0fda80 0x7f682c10d8e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f682800eb40 tx=0x7f682800b040 comp rx=0 tx=0).stop 2024-02-07T12:29:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.605+0000 7f683384d700 1 -- 172.21.15.47:0/3086684146 shutdown_connections 2024-02-07T12:29:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.605+0000 7f683384d700 1 --2- 172.21.15.47:0/3086684146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f682c0fda80 0x7f682c10d8e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.605+0000 7f683384d700 1 --2- 172.21.15.47:0/3086684146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f681806d900 0x7f681806fdb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.605+0000 7f683384d700 1 --2- 172.21.15.47:0/3086684146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f682c1003a0 0x7f682c10de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.605+0000 7f683384d700 1 -- 172.21.15.47:0/3086684146 >> 172.21.15.47:0/3086684146 conn(0x7f682c0f7520 msgr2=0x7f682c0f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.605+0000 7f683384d700 1 -- 172.21.15.47:0/3086684146 shutdown_connections 2024-02-07T12:29:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.605+0000 7f683384d700 1 -- 172.21.15.47:0/3086684146 wait complete. 2024-02-07T12:29:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 21 2024-02-07T12:29:33.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.710+0000 7f3155ed9700 1 -- 172.21.15.47:0/3221054098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3150071eb0 msgr2=0x7f3150070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:33.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.710+0000 7f3155ed9700 1 --2- 172.21.15.47:0/3221054098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3150071eb0 0x7f3150070320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3138004940 tx=0x7f3138009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:33.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.710+0000 7f3155ed9700 1 -- 172.21.15.47:0/3221054098 shutdown_connections 2024-02-07T12:29:33.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.710+0000 7f3155ed9700 1 --2- 172.21.15.47:0/3221054098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3150070860 0x7f3150070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.710+0000 7f3155ed9700 1 --2- 172.21.15.47:0/3221054098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3150071eb0 0x7f3150070320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.710+0000 7f3155ed9700 1 -- 172.21.15.47:0/3221054098 >> 172.21.15.47:0/3221054098 conn(0x7f31500f8620 msgr2=0x7f31500faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.710+0000 7f3155ed9700 1 -- 172.21.15.47:0/3221054098 shutdown_connections 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.710+0000 7f3155ed9700 1 -- 172.21.15.47:0/3221054098 wait complete. 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.710+0000 7f3155ed9700 1 Processor -- start 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f3155ed9700 1 -- start start 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f3155ed9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3150070860 0x7f315010fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f3155ed9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3150071eb0 0x7f31501100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f3155ed9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31501106a0 con 0x7f3150071eb0 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f3155ed9700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3150110f40 con 0x7f3150070860 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f314effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3150071eb0 0x7f31501100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f314effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3150071eb0 0x7f31501100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58656/0 (socket says 172.21.15.47:58656) 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f314effd700 1 -- 172.21.15.47:0/2181223819 learned_addr learned my addr 172.21.15.47:0/2181223819 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:29:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f314f7fe700 1 --2- 172.21.15.47:0/2181223819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3150070860 0x7f315010fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:33.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f314effd700 1 -- 172.21.15.47:0/2181223819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3150070860 msgr2=0x7f315010fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:33.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f314effd700 1 --2- 172.21.15.47:0/2181223819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3150070860 0x7f315010fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f314effd700 1 -- 172.21.15.47:0/2181223819 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3138005040 con 0x7f3150071eb0 2024-02-07T12:29:33.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f314effd700 1 --2- 172.21.15.47:0/2181223819 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3150071eb0 0x7f31501100a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f314000c8c0 tx=0x7f31400044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.711+0000 7f3147fff700 1 -- 172.21.15.47:0/2181223819 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f314000a760 con 0x7f3150071eb0 2024-02-07T12:29:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.712+0000 7f3147fff700 1 -- 172.21.15.47:0/2181223819 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f314000ad90 con 0x7f3150071eb0 2024-02-07T12:29:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.712+0000 7f3147fff700 1 -- 172.21.15.47:0/2181223819 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31400113a0 con 0x7f3150071eb0 2024-02-07T12:29:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.712+0000 7f3155ed9700 1 -- 172.21.15.47:0/2181223819 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3150111220 con 0x7f3150071eb0 2024-02-07T12:29:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.712+0000 7f3155ed9700 1 -- 172.21.15.47:0/2181223819 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3150111710 con 0x7f3150071eb0 2024-02-07T12:29:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.713+0000 7f3155ed9700 1 -- 172.21.15.47:0/2181223819 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315004bed0 con 0x7f3150071eb0 2024-02-07T12:29:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.713+0000 7f3147fff700 1 -- 172.21.15.47:0/2181223819 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f3140012400 con 0x7f3150071eb0 2024-02-07T12:29:33.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.714+0000 7f3147fff700 1 --2- 172.21.15.47:0/2181223819 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f313c06d900 0x7f313c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.714+0000 7f3147fff700 1 -- 172.21.15.47:0/2181223819 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f314008d000 con 0x7f3150071eb0 2024-02-07T12:29:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.714+0000 7f314f7fe700 1 --2- 172.21.15.47:0/2181223819 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f313c06d900 0x7f313c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.714+0000 7f314f7fe700 1 --2- 172.21.15.47:0/2181223819 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f313c06d900 0x7f313c06fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3138004f90 tx=0x7f3138009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:33.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.718+0000 7f3147fff700 1 -- 172.21.15.47:0/2181223819 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f314005a2f0 con 0x7f3150071eb0 2024-02-07T12:29:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.944+0000 7f3155ed9700 1 -- 172.21.15.47:0/2181223819 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3150111b90 con 0x7f313c06d900 2024-02-07T12:29:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.945+0000 7f3147fff700 1 -- 172.21.15.47:0/2181223819 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f3150111b90 con 0x7f313c06d900 2024-02-07T12:29:33.948 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:29:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:29:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:29:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:29:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:29:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-02-07T12:29:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "mon", 2024-02-07T12:29:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr" 2024-02-07T12:29:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:29:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "6/21 daemons upgraded", 2024-02-07T12:29:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading crash daemons", 2024-02-07T12:29:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:29:33.948 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:29:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.947+0000 7f3155ed9700 1 -- 172.21.15.47:0/2181223819 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f313c06d900 msgr2=0x7f313c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.947+0000 7f3155ed9700 1 --2- 172.21.15.47:0/2181223819 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f313c06d900 0x7f313c06fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3138004f90 tx=0x7f3138009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.947+0000 7f3155ed9700 1 -- 172.21.15.47:0/2181223819 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3150071eb0 msgr2=0x7f31501100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.947+0000 7f3155ed9700 1 --2- 172.21.15.47:0/2181223819 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3150071eb0 0x7f31501100a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f314000c8c0 tx=0x7f31400044c0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.947+0000 7f3155ed9700 1 -- 172.21.15.47:0/2181223819 shutdown_connections 2024-02-07T12:29:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.947+0000 7f3155ed9700 1 --2- 172.21.15.47:0/2181223819 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f313c06d900 0x7f313c06fdb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.947+0000 7f3155ed9700 1 --2- 172.21.15.47:0/2181223819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3150070860 0x7f315010fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.947+0000 7f3155ed9700 1 --2- 172.21.15.47:0/2181223819 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3150071eb0 0x7f31501100a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.947+0000 7f3155ed9700 1 -- 172.21.15.47:0/2181223819 >> 172.21.15.47:0/2181223819 conn(0x7f31500f8620 msgr2=0x7f3150102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.947+0000 7f3155ed9700 1 -- 172.21.15.47:0/2181223819 shutdown_connections 2024-02-07T12:29:33.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:33.947+0000 7f3155ed9700 1 -- 172.21.15.47:0/2181223819 wait complete. 2024-02-07T12:29:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.052+0000 7f3c467a2700 1 -- 172.21.15.47:0/3192895104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c400fedb0 msgr2=0x7f3c400fae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.052+0000 7f3c467a2700 1 --2- 172.21.15.47:0/3192895104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c400fedb0 0x7f3c400fae60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3c30004940 tx=0x7f3c30009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.052+0000 7f3c467a2700 1 -- 172.21.15.47:0/3192895104 shutdown_connections 2024-02-07T12:29:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.052+0000 7f3c467a2700 1 --2- 172.21.15.47:0/3192895104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c400fedb0 0x7f3c400fae60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.052+0000 7f3c467a2700 1 --2- 172.21.15.47:0/3192895104 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c400fe3d0 0x7f3c400fe7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.052+0000 7f3c467a2700 1 -- 172.21.15.47:0/3192895104 >> 172.21.15.47:0/3192895104 conn(0x7f3c400f6ab0 msgr2=0x7f3c400f8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.053+0000 7f3c467a2700 1 -- 172.21.15.47:0/3192895104 shutdown_connections 2024-02-07T12:29:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.053+0000 7f3c467a2700 1 -- 172.21.15.47:0/3192895104 wait complete. 2024-02-07T12:29:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.053+0000 7f3c467a2700 1 Processor -- start 2024-02-07T12:29:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.053+0000 7f3c467a2700 1 -- start start 2024-02-07T12:29:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.053+0000 7f3c467a2700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c400fe3d0 0x7f3c4010d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.053+0000 7f3c467a2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c4010dd00 0x7f3c4010eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.053+0000 7f3c467a2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4010e1c0 con 0x7f3c4010dd00 2024-02-07T12:29:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.053+0000 7f3c467a2700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4010e300 con 0x7f3c400fe3d0 2024-02-07T12:29:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.053+0000 7f3c44f9f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c4010dd00 0x7f3c4010eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.053+0000 7f3c44f9f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c4010dd00 0x7f3c4010eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58670/0 (socket says 172.21.15.47:58670) 2024-02-07T12:29:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.053+0000 7f3c44f9f700 1 -- 172.21.15.47:0/604846252 learned_addr learned my addr 172.21.15.47:0/604846252 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:29:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.054+0000 7f3c457a0700 1 --2- 172.21.15.47:0/604846252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c400fe3d0 0x7f3c4010d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.054+0000 7f3c44f9f700 1 -- 172.21.15.47:0/604846252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c400fe3d0 msgr2=0x7f3c4010d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.054+0000 7f3c44f9f700 1 --2- 172.21.15.47:0/604846252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c400fe3d0 0x7f3c4010d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.054+0000 7f3c44f9f700 1 -- 172.21.15.47:0/604846252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c30005040 con 0x7f3c4010dd00 2024-02-07T12:29:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.054+0000 7f3c44f9f700 1 --2- 172.21.15.47:0/604846252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c4010dd00 0x7f3c4010eba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009150 tx=0x7f3c30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.054+0000 7f3c35ffb700 1 -- 172.21.15.47:0/604846252 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c3000e040 con 0x7f3c4010dd00 2024-02-07T12:29:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.054+0000 7f3c35ffb700 1 -- 172.21.15.47:0/604846252 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c30009af0 con 0x7f3c4010dd00 2024-02-07T12:29:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.054+0000 7f3c467a2700 1 -- 172.21.15.47:0/604846252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4010f1a0 con 0x7f3c4010dd00 2024-02-07T12:29:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.054+0000 7f3c35ffb700 1 -- 172.21.15.47:0/604846252 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c3001c630 con 0x7f3c4010dd00 2024-02-07T12:29:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.054+0000 7f3c467a2700 1 -- 172.21.15.47:0/604846252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4010f730 con 0x7f3c4010dd00 2024-02-07T12:29:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.055+0000 7f3c467a2700 1 -- 172.21.15.47:0/604846252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4005f5c0 con 0x7f3c4010dd00 2024-02-07T12:29:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.056+0000 7f3c35ffb700 1 -- 172.21.15.47:0/604846252 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f3c30013420 con 0x7f3c4010dd00 2024-02-07T12:29:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.056+0000 7f3c35ffb700 1 --2- 172.21.15.47:0/604846252 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3c2c06d900 0x7f3c2c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:29:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.056+0000 7f3c35ffb700 1 -- 172.21.15.47:0/604846252 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3c3008e420 con 0x7f3c4010dd00 2024-02-07T12:29:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.056+0000 7f3c457a0700 1 --2- 172.21.15.47:0/604846252 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3c2c06d900 0x7f3c2c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:29:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.057+0000 7f3c457a0700 1 --2- 172.21.15.47:0/604846252 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3c2c06d900 0x7f3c2c06fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c40065bf0 tx=0x7f3c3c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:29:34.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.061+0000 7f3c35ffb700 1 -- 172.21.15.47:0/604846252 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3c3005b600 con 0x7f3c4010dd00 2024-02-07T12:29:34.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.349+0000 7f3c467a2700 1 -- 172.21.15.47:0/604846252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3c40105860 con 0x7f3c4010dd00 2024-02-07T12:29:34.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.350+0000 7f3c35ffb700 1 -- 172.21.15.47:0/604846252 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3c3005b190 con 0x7f3c4010dd00 2024-02-07T12:29:34.352 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:29:34.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.352+0000 7f3c467a2700 1 -- 172.21.15.47:0/604846252 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3c2c06d900 msgr2=0x7f3c2c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:34.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.352+0000 7f3c467a2700 1 --2- 172.21.15.47:0/604846252 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3c2c06d900 0x7f3c2c06fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c40065bf0 tx=0x7f3c3c00b040 comp rx=0 tx=0).stop 2024-02-07T12:29:34.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.352+0000 7f3c467a2700 1 -- 172.21.15.47:0/604846252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c4010dd00 msgr2=0x7f3c4010eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:29:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.352+0000 7f3c467a2700 1 --2- 172.21.15.47:0/604846252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c4010dd00 0x7f3c4010eba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009150 tx=0x7f3c30009e30 comp rx=0 tx=0).stop 2024-02-07T12:29:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.352+0000 7f3c467a2700 1 -- 172.21.15.47:0/604846252 shutdown_connections 2024-02-07T12:29:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.352+0000 7f3c467a2700 1 --2- 172.21.15.47:0/604846252 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3c2c06d900 0x7f3c2c06fdb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.352+0000 7f3c467a2700 1 --2- 172.21.15.47:0/604846252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c400fe3d0 0x7f3c4010d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.352+0000 7f3c467a2700 1 --2- 172.21.15.47:0/604846252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c4010dd00 0x7f3c4010eba0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:29:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.352+0000 7f3c467a2700 1 -- 172.21.15.47:0/604846252 >> 172.21.15.47:0/604846252 conn(0x7f3c400f6ab0 msgr2=0x7f3c401013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:29:34.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.352+0000 7f3c467a2700 1 -- 172.21.15.47:0/604846252 shutdown_connections 2024-02-07T12:29:34.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:29:34.353+0000 7f3c467a2700 1 -- 172.21.15.47:0/604846252 wait complete. 2024-02-07T12:29:34.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:34 smithi047 ceph-mon[93224]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:34.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:34 smithi047 ceph-mon[93224]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:29:34.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:34 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:34.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:34 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:34.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:34 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3086684146' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:29:34.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:34 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/604846252' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:29:34.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:34 smithi138 ceph-mon[82055]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:34 smithi138 ceph-mon[82055]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:29:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:34 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:34 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:34 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3086684146' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:29:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:34 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/604846252' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:29:35.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:35 smithi047 ceph-mon[93224]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:35.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:35 smithi047 ceph-mon[93224]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:29:35.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:35 smithi047 ceph-mon[93224]: pgmap v37: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:35.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:35 smithi138 ceph-mon[82055]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:29:35.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:35 smithi138 ceph-mon[82055]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:29:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:35 smithi138 ceph-mon[82055]: pgmap v37: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:37.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:37.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:37.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:37.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:29:37.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:37.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:29:37.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:37.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:37.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:37.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: Upgrade: Setting container_image for all crash 2024-02-07T12:29:37.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:37.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi047"}]: dispatch 2024-02-07T12:29:37.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi047"}]': finished 2024-02-07T12:29:37.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi138"}]: dispatch 2024-02-07T12:29:37.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi138"}]': finished 2024-02-07T12:29:37.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-07T12:29:37.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-07T12:29:37.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: Upgrade: osd.0 is safe to restart 2024-02-07T12:29:37.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:37 smithi138 ceph-mon[82055]: pgmap v38: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:37.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:37.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:37.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:37.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: Upgrade: Setting container_image for all crash 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi047"}]: dispatch 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi047"}]': finished 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi138"}]: dispatch 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi138"}]': finished 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-07T12:29:37.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: Upgrade: osd.0 is safe to restart 2024-02-07T12:29:37.577 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:37 smithi047 ceph-mon[93224]: pgmap v38: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:39.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:38 smithi047 ceph-mon[93224]: Upgrade: Updating osd.0 2024-02-07T12:29:39.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:38 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:39.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:38 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-07T12:29:39.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:38 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:39.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:38 smithi047 ceph-mon[93224]: Deploying daemon osd.0 on smithi047 2024-02-07T12:29:39.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:38 smithi047 ceph-mon[93224]: pgmap v39: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:39.093 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:38 smithi138 ceph-mon[82055]: Upgrade: Updating osd.0 2024-02-07T12:29:39.093 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:38 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:39.094 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:38 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-07T12:29:39.094 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:38 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:39.094 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:38 smithi138 ceph-mon[82055]: Deploying daemon osd.0 on smithi047 2024-02-07T12:29:39.094 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:38 smithi138 ceph-mon[82055]: pgmap v39: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:29:40.703 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:40 smithi047 ceph-mon[93224]: pgmap v40: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:41.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:40 smithi138 ceph-mon[82055]: pgmap v40: 65 pgs: 65 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:29:41.355 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:41 smithi047 systemd[1]: Stopping Ceph osd.0 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:29:41.684 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:41 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0[47653]: 2024-02-07T12:29:41.352+0000 7f817496c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:29:41.684 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:41 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0[47653]: 2024-02-07T12:29:41.352+0000 7f817496c700 -1 osd.0 50 *** Got signal Terminated *** 2024-02-07T12:29:41.684 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:41 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0[47653]: 2024-02-07T12:29:41.352+0000 7f817496c700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-07T12:29:42.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:41 smithi138 ceph-mon[82055]: osd.0 marked itself down and dead 2024-02-07T12:29:42.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:29:42.049 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:41 smithi047 ceph-mon[93224]: osd.0 marked itself down and dead 2024-02-07T12:29:42.049 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:29:42.325 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:42 smithi047 podman[101615]: 2024-02-07 12:29:42.047984473 +0000 UTC m=+0.814975180 container died 4f37918f583a5b26fa9db652cdced0020623d434e4e2b5dc33b36779fe7b0d37 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=quincy-f246262, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-02-07T12:29:42.685 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:42 smithi047 podman[101615]: 2024-02-07 12:29:42.427895026 +0000 UTC m=+1.194885749 container cleanup 4f37918f583a5b26fa9db652cdced0020623d434e4e2b5dc33b36779fe7b0d37 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=quincy-f246262, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-07T12:29:42.685 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:42 smithi047 bash[101615]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0 2024-02-07T12:29:43.027 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:42 smithi047 podman[101635]: 2024-02-07 12:29:42.729345405 +0000 UTC m=+0.675801961 container remove 4f37918f583a5b26fa9db652cdced0020623d434e4e2b5dc33b36779fe7b0d37 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=quincy-f246262, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-07T12:29:43.027 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:42 smithi047 ceph-mon[93224]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-07T12:29:43.027 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:42 smithi047 ceph-mon[93224]: failed to encode map e51 with expected crc 2024-02-07T12:29:43.027 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:42 smithi047 ceph-mon[93224]: osdmap e51: 6 total, 5 up, 6 in 2024-02-07T12:29:43.027 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:42 smithi047 ceph-mon[93224]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-02-07T12:29:43.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:42 smithi138 ceph-mon[82055]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-07T12:29:43.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:42 smithi138 ceph-mon[82055]: failed to encode map e51 with expected crc 2024-02-07T12:29:43.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:42 smithi138 ceph-mon[82055]: osdmap e51: 6 total, 5 up, 6 in 2024-02-07T12:29:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:42 smithi138 ceph-mon[82055]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-02-07T12:29:43.279 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:43 smithi047 podman[101728]: 2024-02-07 12:29:42.928312945 +0000 UTC m=+0.017770038 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:29:43.279 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:43 smithi047 podman[101728]: 2024-02-07 12:29:43.066082441 +0000 UTC m=+0.155539571 container create 39511937d98e194478a0522ceb28f9363c4f38e12589b34548362c97fe621e93 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-07T12:29:43.279 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:43 smithi047 podman[101728]: 2024-02-07 12:29:43.277822813 +0000 UTC m=+0.367279909 container init 39511937d98e194478a0522ceb28f9363c4f38e12589b34548362c97fe621e93 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-02-07T12:29:43.575 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:43 smithi047 podman[101728]: 2024-02-07 12:29:43.280952892 +0000 UTC m=+0.370409980 container start 39511937d98e194478a0522ceb28f9363c4f38e12589b34548362c97fe621e93 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD) 2024-02-07T12:29:43.575 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:43 smithi047 podman[101728]: 2024-02-07 12:29:43.418702701 +0000 UTC m=+0.508159796 container attach 39511937d98e194478a0522ceb28f9363c4f38e12589b34548362c97fe621e93 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc) 2024-02-07T12:29:43.932 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:43 smithi047 podman[101728]: 2024-02-07 12:29:43.585538676 +0000 UTC m=+0.674995773 container died 39511937d98e194478a0522ceb28f9363c4f38e12589b34548362c97fe621e93 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS) 2024-02-07T12:29:43.932 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:43 smithi047 ceph-mon[93224]: Health check failed: Reduced data availability: 33 pgs peering (PG_AVAILABILITY) 2024-02-07T12:29:43.932 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:43 smithi047 ceph-mon[93224]: failed to encode map e52 with expected crc 2024-02-07T12:29:43.933 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:43 smithi047 ceph-mon[93224]: osdmap e52: 6 total, 5 up, 6 in 2024-02-07T12:29:43.933 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:43 smithi047 ceph-mon[93224]: failed to encode map e52 with expected crc 2024-02-07T12:29:43.933 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:43 smithi047 ceph-mon[93224]: failed to encode map e52 with expected crc 2024-02-07T12:29:43.933 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:43 smithi047 ceph-mon[93224]: failed to encode map e52 with expected crc 2024-02-07T12:29:43.933 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:43 smithi047 ceph-mon[93224]: failed to encode map e52 with expected crc 2024-02-07T12:29:43.956 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:43 smithi138 ceph-mon[82055]: Health check failed: Reduced data availability: 33 pgs peering (PG_AVAILABILITY) 2024-02-07T12:29:43.956 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:43 smithi138 ceph-mon[82055]: failed to encode map e52 with expected crc 2024-02-07T12:29:43.956 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:43 smithi138 ceph-mon[82055]: osdmap e52: 6 total, 5 up, 6 in 2024-02-07T12:29:43.956 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:43 smithi138 ceph-mon[82055]: failed to encode map e52 with expected crc 2024-02-07T12:29:43.956 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:43 smithi138 ceph-mon[82055]: failed to encode map e52 with expected crc 2024-02-07T12:29:43.956 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:43 smithi138 ceph-mon[82055]: failed to encode map e52 with expected crc 2024-02-07T12:29:43.956 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:43 smithi138 ceph-mon[82055]: failed to encode map e52 with expected crc 2024-02-07T12:29:44.575 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:44 smithi047 podman[101753]: 2024-02-07 12:29:44.206064425 +0000 UTC m=+0.615667044 container remove 39511937d98e194478a0522ceb28f9363c4f38e12589b34548362c97fe621e93 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-02-07T12:29:44.575 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:44 smithi047 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.0.service: Deactivated successfully. 2024-02-07T12:29:44.575 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:44 smithi047 systemd[1]: Stopped Ceph osd.0 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:29:44.575 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:44 smithi047 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.0.service: Consumed 55.461s CPU time. 2024-02-07T12:29:44.575 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:44 smithi047 systemd[1]: Starting Ceph osd.0 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:29:44.919 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:44 smithi047 ceph-mon[93224]: failed to encode map e52 with expected crc 2024-02-07T12:29:44.920 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:44 smithi047 ceph-mon[93224]: pgmap v44: 65 pgs: 34 peering, 31 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-02-07T12:29:44.920 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:44 smithi047 podman[101853]: 2024-02-07 12:29:44.553831251 +0000 UTC m=+0.018274196 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:29:44.920 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:44 smithi047 podman[101853]: 2024-02-07 12:29:44.682161222 +0000 UTC m=+0.146604218 container create dc32f9964eb53cb302cb470887437d8c7afbfbe82c7e1d116920cdd41fe9e4ef (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-07T12:29:44.920 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:44 smithi047 podman[101853]: 2024-02-07 12:29:44.918102786 +0000 UTC m=+0.382545724 container init dc32f9964eb53cb302cb470887437d8c7afbfbe82c7e1d116920cdd41fe9e4ef (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-07T12:29:45.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:44 smithi138 ceph-mon[82055]: failed to encode map e52 with expected crc 2024-02-07T12:29:45.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:44 smithi138 ceph-mon[82055]: pgmap v44: 65 pgs: 34 peering, 31 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-02-07T12:29:45.325 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:44 smithi047 podman[101853]: 2024-02-07 12:29:44.921376742 +0000 UTC m=+0.385819691 container start dc32f9964eb53cb302cb470887437d8c7afbfbe82c7e1d116920cdd41fe9e4ef (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux ) 2024-02-07T12:29:45.325 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 podman[101853]: 2024-02-07 12:29:45.001522346 +0000 UTC m=+0.465965292 container attach dc32f9964eb53cb302cb470887437d8c7afbfbe82c7e1d116920cdd41fe9e4ef (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-activate, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:29:45.732 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-activate[101869]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-07T12:29:45.732 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-activate[101869]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-07T12:29:45.732 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 bash[101853]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-07T12:29:45.732 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 bash[101853]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-07T12:29:45.732 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 bash[101853]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-07T12:29:45.732 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 bash[101853]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-07T12:29:45.732 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 bash[101853]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-07T12:29:45.732 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 bash[101853]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-07T12:29:45.733 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 bash[101853]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-07T12:29:45.733 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-activate[101869]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-07T12:29:45.733 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-activate[101869]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-07T12:29:45.733 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-activate[101869]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-07T12:29:45.733 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-activate[101869]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-07T12:29:45.733 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-activate[101869]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-07T12:29:45.733 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:45 smithi047 podman[101853]: 2024-02-07 12:29:45.389474366 +0000 UTC m=+0.853917306 container died dc32f9964eb53cb302cb470887437d8c7afbfbe82c7e1d116920cdd41fe9e4ef (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-activate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc) 2024-02-07T12:29:46.291 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:46 smithi047 podman[101997]: 2024-02-07 12:29:46.030595674 +0000 UTC m=+0.635639453 container remove dc32f9964eb53cb302cb470887437d8c7afbfbe82c7e1d116920cdd41fe9e4ef (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-07T12:29:46.291 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:46 smithi047 podman[102061]: 2024-02-07 12:29:46.154221864 +0000 UTC m=+0.018018390 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:29:46.291 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:46 smithi047 podman[102061]: 2024-02-07 12:29:46.289930858 +0000 UTC m=+0.153727419 container create e26f0405946059f5d59e6b38fb4761037b9c26e781a57291e3d29048c76b2ee6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-07T12:29:46.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:46 smithi047 ceph-mon[93224]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:29:46.826 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:46 smithi047 podman[102061]: 2024-02-07 12:29:46.551327179 +0000 UTC m=+0.415123716 container init e26f0405946059f5d59e6b38fb4761037b9c26e781a57291e3d29048c76b2ee6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2) 2024-02-07T12:29:46.826 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:46 smithi047 podman[102061]: 2024-02-07 12:29:46.554973491 +0000 UTC m=+0.418770012 container start e26f0405946059f5d59e6b38fb4761037b9c26e781a57291e3d29048c76b2ee6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:29:46.826 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:46 smithi047 ceph-osd[102080]: -- 172.21.15.47:0/2897132926 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b58f7516c0 con 0x55b58f722c00 2024-02-07T12:29:46.826 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:46 smithi047 bash[102061]: e26f0405946059f5d59e6b38fb4761037b9c26e781a57291e3d29048c76b2ee6 2024-02-07T12:29:46.826 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:46 smithi047 systemd[1]: Started Ceph osd.0 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:29:47.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:46 smithi138 ceph-mon[82055]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-02-07T12:29:47.328 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:47 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0[102075]: 2024-02-07T12:29:47.091+0000 7f6c004e37c0 -1 Falling back to public interface 2024-02-07T12:29:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:47 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:47 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:47 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:29:48.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:47 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:48.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:47 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:48.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:47 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:29:49.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:49 smithi047 ceph-mon[93224]: pgmap v46: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 70/354 objects degraded (19.774%) 2024-02-07T12:29:49.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:49 smithi138 ceph-mon[82055]: pgmap v46: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 70/354 objects degraded (19.774%) 2024-02-07T12:29:50.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:50 smithi047 ceph-mon[93224]: Health check failed: Degraded data redundancy: 70/354 objects degraded (19.774%), 20 pgs degraded (PG_DEGRADED) 2024-02-07T12:29:50.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:50 smithi047 ceph-mon[93224]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 33 pgs peering) 2024-02-07T12:29:50.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:50 smithi138 ceph-mon[82055]: Health check failed: Degraded data redundancy: 70/354 objects degraded (19.774%), 20 pgs degraded (PG_DEGRADED) 2024-02-07T12:29:50.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:50 smithi138 ceph-mon[82055]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 33 pgs peering) 2024-02-07T12:29:51.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:51 smithi047 ceph-mon[93224]: pgmap v47: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 70/354 objects degraded (19.774%) 2024-02-07T12:29:51.325 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:51 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0[102075]: 2024-02-07T12:29:51.035+0000 7f6c004e37c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-02-07T12:29:51.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:51 smithi138 ceph-mon[82055]: pgmap v47: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 298 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 70/354 objects degraded (19.774%) 2024-02-07T12:29:51.825 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:51 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0[102075]: 2024-02-07T12:29:51.476+0000 7f6c004e37c0 -1 osd.0 50 log_to_monitors true 2024-02-07T12:29:52.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:52 smithi138 ceph-mon[82055]: from='osd.0 [v2:172.21.15.47:6802/1557469797,v1:172.21.15.47:6803/1557469797]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-07T12:29:52.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:52.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:52.575 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:29:52 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0[102075]: 2024-02-07T12:29:52.164+0000 7f6bf1942700 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-07T12:29:52.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:52 smithi047 ceph-mon[93224]: from='osd.0 [v2:172.21.15.47:6802/1557469797,v1:172.21.15.47:6803/1557469797]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-07T12:29:52.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:52.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:53.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:53 smithi138 ceph-mon[82055]: from='osd.0 [v2:172.21.15.47:6802/1557469797,v1:172.21.15.47:6803/1557469797]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-07T12:29:53.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:53 smithi138 ceph-mon[82055]: failed to encode map e53 with expected crc 2024-02-07T12:29:53.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:53 smithi138 ceph-mon[82055]: osdmap e53: 6 total, 5 up, 6 in 2024-02-07T12:29:53.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:53 smithi138 ceph-mon[82055]: from='osd.0 [v2:172.21.15.47:6802/1557469797,v1:172.21.15.47:6803/1557469797]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-02-07T12:29:53.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:53 smithi138 ceph-mon[82055]: pgmap v49: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 70/354 objects degraded (19.774%) 2024-02-07T12:29:53.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:53 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:53.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:53 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:53.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:53 smithi047 ceph-mon[93224]: from='osd.0 [v2:172.21.15.47:6802/1557469797,v1:172.21.15.47:6803/1557469797]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-07T12:29:53.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:53 smithi047 ceph-mon[93224]: failed to encode map e53 with expected crc 2024-02-07T12:29:53.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:53 smithi047 ceph-mon[93224]: osdmap e53: 6 total, 5 up, 6 in 2024-02-07T12:29:53.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:53 smithi047 ceph-mon[93224]: from='osd.0 [v2:172.21.15.47:6802/1557469797,v1:172.21.15.47:6803/1557469797]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-02-07T12:29:53.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:53 smithi047 ceph-mon[93224]: pgmap v49: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 70/354 objects degraded (19.774%) 2024-02-07T12:29:53.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:53 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:53 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:54.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:54 smithi047 ceph-mon[93224]: failed to encode map e53 with expected crc 2024-02-07T12:29:54.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:54 smithi047 ceph-mon[93224]: failed to encode map e53 with expected crc 2024-02-07T12:29:54.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:54 smithi047 ceph-mon[93224]: failed to encode map e53 with expected crc 2024-02-07T12:29:54.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:54 smithi047 ceph-mon[93224]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-07T12:29:54.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:54 smithi047 ceph-mon[93224]: failed to encode map e54 with expected crc 2024-02-07T12:29:54.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:54 smithi047 ceph-mon[93224]: osd.0 [v2:172.21.15.47:6802/1557469797,v1:172.21.15.47:6803/1557469797] boot 2024-02-07T12:29:54.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:54 smithi047 ceph-mon[93224]: osdmap e54: 6 total, 6 up, 6 in 2024-02-07T12:29:54.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:29:54.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:54 smithi138 ceph-mon[82055]: failed to encode map e53 with expected crc 2024-02-07T12:29:54.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:54 smithi138 ceph-mon[82055]: failed to encode map e53 with expected crc 2024-02-07T12:29:54.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:54 smithi138 ceph-mon[82055]: failed to encode map e53 with expected crc 2024-02-07T12:29:54.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:54 smithi138 ceph-mon[82055]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-07T12:29:54.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:54 smithi138 ceph-mon[82055]: failed to encode map e54 with expected crc 2024-02-07T12:29:54.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:54 smithi138 ceph-mon[82055]: osd.0 [v2:172.21.15.47:6802/1557469797,v1:172.21.15.47:6803/1557469797] boot 2024-02-07T12:29:54.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:54 smithi138 ceph-mon[82055]: osdmap e54: 6 total, 6 up, 6 in 2024-02-07T12:29:54.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-07T12:29:55.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:55 smithi047 ceph-mon[93224]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:55 smithi047 ceph-mon[93224]: osdmap e55: 6 total, 6 up, 6 in 2024-02-07T12:29:55.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:55 smithi047 ceph-mon[93224]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:55 smithi047 ceph-mon[93224]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:55 smithi047 ceph-mon[93224]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:55 smithi047 ceph-mon[93224]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:55 smithi047 ceph-mon[93224]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:55 smithi047 ceph-mon[93224]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:55 smithi047 ceph-mon[93224]: pgmap v52: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 70/354 objects degraded (19.774%) 2024-02-07T12:29:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:55 smithi138 ceph-mon[82055]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:55 smithi138 ceph-mon[82055]: osdmap e55: 6 total, 6 up, 6 in 2024-02-07T12:29:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:55 smithi138 ceph-mon[82055]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:55 smithi138 ceph-mon[82055]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:55 smithi138 ceph-mon[82055]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:55 smithi138 ceph-mon[82055]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:55 smithi138 ceph-mon[82055]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:55 smithi138 ceph-mon[82055]: failed to encode map e55 with expected crc 2024-02-07T12:29:55.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:55 smithi138 ceph-mon[82055]: pgmap v52: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 70/354 objects degraded (19.774%) 2024-02-07T12:29:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:29:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:29:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:57.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:57.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:57.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-07T12:29:57.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-07T12:29:57.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-07T12:29:57.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: pgmap v53: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 70/354 objects degraded (19.774%) 2024-02-07T12:29:57.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:57.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:29:57.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:57.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:57.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:29:57.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:29:57.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:57.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:29:57.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:57.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:57.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:29:57.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-07T12:29:57.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-07T12:29:57.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-07T12:29:57.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: pgmap v53: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 70/354 objects degraded (19.774%) 2024-02-07T12:29:57.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:29:57.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:29:59.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:58 smithi138 ceph-mon[82055]: mgrmap e40: smithi047.zhgnrm(active, since 91s), standbys: smithi138.fiugmj 2024-02-07T12:29:59.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:58 smithi138 ceph-mon[82055]: pgmap v54: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.4 KiB/s rd, 949 B/s wr, 7 op/s 2024-02-07T12:29:59.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:58 smithi047 ceph-mon[93224]: mgrmap e40: smithi047.zhgnrm(active, since 91s), standbys: smithi138.fiugmj 2024-02-07T12:29:59.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:58 smithi047 ceph-mon[93224]: pgmap v54: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.4 KiB/s rd, 949 B/s wr, 7 op/s 2024-02-07T12:30:00.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:59 smithi138 ceph-mon[82055]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 70/354 objects degraded (19.774%), 20 pgs degraded) 2024-02-07T12:30:00.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:29:59 smithi138 ceph-mon[82055]: Cluster is now healthy 2024-02-07T12:30:00.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:59 smithi047 ceph-mon[93224]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 70/354 objects degraded (19.774%), 20 pgs degraded) 2024-02-07T12:30:00.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:29:59 smithi047 ceph-mon[93224]: Cluster is now healthy 2024-02-07T12:30:01.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:00 smithi138 ceph-mon[82055]: overall HEALTH_OK 2024-02-07T12:30:01.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:00 smithi138 ceph-mon[82055]: pgmap v55: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-07T12:30:01.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:00 smithi047 ceph-mon[93224]: overall HEALTH_OK 2024-02-07T12:30:01.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:00 smithi047 ceph-mon[93224]: pgmap v55: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-07T12:30:03.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:02 smithi138 ceph-mon[82055]: pgmap v56: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 648 B/s wr, 4 op/s 2024-02-07T12:30:03.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:02 smithi047 ceph-mon[93224]: pgmap v56: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 648 B/s wr, 4 op/s 2024-02-07T12:30:04.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.471+0000 7f8eb14ae700 1 -- 172.21.15.47:0/2303966305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8eac0fcef0 msgr2=0x7f8eac0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:04.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.471+0000 7f8eb14ae700 1 --2- 172.21.15.47:0/2303966305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8eac0fcef0 0x7f8eac0fd320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009ce0 tx=0x7f8ea4004d10 comp rx=0 tx=0).stop 2024-02-07T12:30:04.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.471+0000 7f8eb14ae700 1 -- 172.21.15.47:0/2303966305 shutdown_connections 2024-02-07T12:30:04.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.471+0000 7f8eb14ae700 1 --2- 172.21.15.47:0/2303966305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8eac0fe0e0 0x7f8eac0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:04.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.471+0000 7f8eb14ae700 1 --2- 172.21.15.47:0/2303966305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8eac0fcef0 0x7f8eac0fd320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:04.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.471+0000 7f8eb14ae700 1 -- 172.21.15.47:0/2303966305 >> 172.21.15.47:0/2303966305 conn(0x7f8eac0f8620 msgr2=0x7f8eac0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:04.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.471+0000 7f8eb14ae700 1 -- 172.21.15.47:0/2303966305 shutdown_connections 2024-02-07T12:30:04.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.471+0000 7f8eb14ae700 1 -- 172.21.15.47:0/2303966305 wait complete. 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.472+0000 7f8eb14ae700 1 Processor -- start 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.472+0000 7f8eb14ae700 1 -- start start 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.472+0000 7f8eb14ae700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8eac0fcef0 0x7f8eac10dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.472+0000 7f8eb14ae700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8eac0fe0e0 0x7f8eac10e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.472+0000 7f8eb14ae700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac10e620 con 0x7f8eac0fcef0 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.472+0000 7f8eb14ae700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac10eec0 con 0x7f8eac0fe0e0 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.472+0000 7f8eaaffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8eac0fcef0 0x7f8eac10dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.473+0000 7f8eaaffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8eac0fcef0 0x7f8eac10dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58602/0 (socket says 172.21.15.47:58602) 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.473+0000 7f8eaaffd700 1 -- 172.21.15.47:0/1513577734 learned_addr learned my addr 172.21.15.47:0/1513577734 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.473+0000 7f8eaa7fc700 1 --2- 172.21.15.47:0/1513577734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8eac0fe0e0 0x7f8eac10e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.473+0000 7f8eaaffd700 1 -- 172.21.15.47:0/1513577734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8eac0fe0e0 msgr2=0x7f8eac10e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.473+0000 7f8eaaffd700 1 --2- 172.21.15.47:0/1513577734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8eac0fe0e0 0x7f8eac10e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.473+0000 7f8eaaffd700 1 -- 172.21.15.47:0/1513577734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4009940 con 0x7f8eac0fcef0 2024-02-07T12:30:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.473+0000 7f8eaaffd700 1 --2- 172.21.15.47:0/1513577734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8eac0fcef0 0x7f8eac10dae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4000f80 tx=0x7f8ea4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.473+0000 7f8ea37fe700 1 -- 172.21.15.47:0/1513577734 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea400e040 con 0x7f8eac0fcef0 2024-02-07T12:30:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.473+0000 7f8ea37fe700 1 -- 172.21.15.47:0/1513577734 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ea40128e0 con 0x7f8eac0fcef0 2024-02-07T12:30:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.473+0000 7f8eb14ae700 1 -- 172.21.15.47:0/1513577734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac10f140 con 0x7f8eac0fcef0 2024-02-07T12:30:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.473+0000 7f8ea37fe700 1 -- 172.21.15.47:0/1513577734 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea401c8b0 con 0x7f8eac0fcef0 2024-02-07T12:30:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.473+0000 7f8eb14ae700 1 -- 172.21.15.47:0/1513577734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac10f680 con 0x7f8eac0fcef0 2024-02-07T12:30:04.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.474+0000 7f8eb14ae700 1 -- 172.21.15.47:0/1513577734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac04bed0 con 0x7f8eac0fcef0 2024-02-07T12:30:04.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.475+0000 7f8ea37fe700 1 -- 172.21.15.47:0/1513577734 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8ea4012a50 con 0x7f8eac0fcef0 2024-02-07T12:30:04.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.475+0000 7f8ea37fe700 1 --2- 172.21.15.47:0/1513577734 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8e9806d7e0 0x7f8e9806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:04.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.475+0000 7f8ea37fe700 1 -- 172.21.15.47:0/1513577734 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8ea408ebf0 con 0x7f8eac0fcef0 2024-02-07T12:30:04.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.475+0000 7f8eaa7fc700 1 --2- 172.21.15.47:0/1513577734 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8e9806d7e0 0x7f8e9806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:04.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.476+0000 7f8eaa7fc700 1 --2- 172.21.15.47:0/1513577734 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8e9806d7e0 0x7f8e9806fc90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e94004990 tx=0x7f8e94009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:04.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.480+0000 7f8ea37fe700 1 -- 172.21.15.47:0/1513577734 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8ea405bf70 con 0x7f8eac0fcef0 2024-02-07T12:30:04.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.704+0000 7f8eb14ae700 1 -- 172.21.15.47:0/1513577734 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8eac102ac0 con 0x7f8e9806d7e0 2024-02-07T12:30:04.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.705+0000 7f8ea37fe700 1 -- 172.21.15.47:0/1513577734 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8eac102ac0 con 0x7f8e9806d7e0 2024-02-07T12:30:04.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.707+0000 7f8eb14ae700 1 -- 172.21.15.47:0/1513577734 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8e9806d7e0 msgr2=0x7f8e9806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:04.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.707+0000 7f8eb14ae700 1 --2- 172.21.15.47:0/1513577734 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8e9806d7e0 0x7f8e9806fc90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e94004990 tx=0x7f8e94009ee0 comp rx=0 tx=0).stop 2024-02-07T12:30:04.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.707+0000 7f8eb14ae700 1 -- 172.21.15.47:0/1513577734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8eac0fcef0 msgr2=0x7f8eac10dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:04.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.707+0000 7f8eb14ae700 1 --2- 172.21.15.47:0/1513577734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8eac0fcef0 0x7f8eac10dae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4000f80 tx=0x7f8ea4004d10 comp rx=0 tx=0).stop 2024-02-07T12:30:04.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.707+0000 7f8eb14ae700 1 -- 172.21.15.47:0/1513577734 shutdown_connections 2024-02-07T12:30:04.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.707+0000 7f8eb14ae700 1 --2- 172.21.15.47:0/1513577734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8eac0fcef0 0x7f8eac10dae0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:04.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.707+0000 7f8eb14ae700 1 --2- 172.21.15.47:0/1513577734 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8e9806d7e0 0x7f8e9806fc90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:04.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.707+0000 7f8eb14ae700 1 --2- 172.21.15.47:0/1513577734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8eac0fe0e0 0x7f8eac10e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:04.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.707+0000 7f8eb14ae700 1 -- 172.21.15.47:0/1513577734 >> 172.21.15.47:0/1513577734 conn(0x7f8eac0f8620 msgr2=0x7f8eac1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:04.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.707+0000 7f8eb14ae700 1 -- 172.21.15.47:0/1513577734 shutdown_connections 2024-02-07T12:30:04.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.707+0000 7f8eb14ae700 1 -- 172.21.15.47:0/1513577734 wait complete. 2024-02-07T12:30:04.720 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:30:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.811+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/3654148890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc0fe0e0 msgr2=0x7fb5bc0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.811+0000 7fb5c2d0e700 1 --2- 172.21.15.47:0/3654148890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc0fe0e0 0x7fb5bc0fe550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8004940 tx=0x7fb5a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:04.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.811+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/3654148890 shutdown_connections 2024-02-07T12:30:04.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.811+0000 7fb5c2d0e700 1 --2- 172.21.15.47:0/3654148890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc0fe0e0 0x7fb5bc0fe550 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:04.815 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:04 smithi047 ceph-mon[93224]: pgmap v57: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 587 B/s wr, 4 op/s 2024-02-07T12:30:04.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.811+0000 7fb5c2d0e700 1 --2- 172.21.15.47:0/3654148890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5bc0fcef0 0x7fb5bc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:04.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.811+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/3654148890 >> 172.21.15.47:0/3654148890 conn(0x7fb5bc0f8620 msgr2=0x7fb5bc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:04.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.811+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/3654148890 shutdown_connections 2024-02-07T12:30:04.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.811+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/3654148890 wait complete. 2024-02-07T12:30:04.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.812+0000 7fb5c2d0e700 1 Processor -- start 2024-02-07T12:30:04.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.812+0000 7fb5c2d0e700 1 -- start start 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.812+0000 7fb5c2d0e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5bc0fcef0 0x7fb5bc10fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.812+0000 7fb5c2d0e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc0fe0e0 0x7fb5bc1100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.812+0000 7fb5c2d0e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc1106a0 con 0x7fb5bc0fe0e0 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.812+0000 7fb5c2d0e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc110f40 con 0x7fb5bc0fcef0 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.812+0000 7fb5bbfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc0fe0e0 0x7fb5bc1100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.813+0000 7fb5bbfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc0fe0e0 0x7fb5bc1100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58618/0 (socket says 172.21.15.47:58618) 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.813+0000 7fb5bbfff700 1 -- 172.21.15.47:0/2287960202 learned_addr learned my addr 172.21.15.47:0/2287960202 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.813+0000 7fb5c0aaa700 1 --2- 172.21.15.47:0/2287960202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5bc0fcef0 0x7fb5bc10fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.813+0000 7fb5bbfff700 1 -- 172.21.15.47:0/2287960202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5bc0fcef0 msgr2=0x7fb5bc10fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.813+0000 7fb5bbfff700 1 --2- 172.21.15.47:0/2287960202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5bc0fcef0 0x7fb5bc10fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.813+0000 7fb5bbfff700 1 -- 172.21.15.47:0/2287960202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a8005040 con 0x7fb5bc0fe0e0 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.813+0000 7fb5bbfff700 1 --2- 172.21.15.47:0/2287960202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc0fe0e0 0x7fb5bc1100a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80093b0 tx=0x7fb5a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.813+0000 7fb5b97fa700 1 -- 172.21.15.47:0/2287960202 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5a800e040 con 0x7fb5bc0fe0e0 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.813+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/2287960202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc1111c0 con 0x7fb5bc0fe0e0 2024-02-07T12:30:04.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.813+0000 7fb5b97fa700 1 -- 172.21.15.47:0/2287960202 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5a800bcc0 con 0x7fb5bc0fe0e0 2024-02-07T12:30:04.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.813+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/2287960202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc111700 con 0x7fb5bc0fe0e0 2024-02-07T12:30:04.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.814+0000 7fb5b97fa700 1 -- 172.21.15.47:0/2287960202 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5a80255e0 con 0x7fb5bc0fe0e0 2024-02-07T12:30:04.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.814+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/2287960202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5bc102210 con 0x7fb5bc0fe0e0 2024-02-07T12:30:04.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.815+0000 7fb5b97fa700 1 -- 172.21.15.47:0/2287960202 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb5a8013980 con 0x7fb5bc0fe0e0 2024-02-07T12:30:04.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.815+0000 7fb5b97fa700 1 --2- 172.21.15.47:0/2287960202 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb5ac06d7e0 0x7fb5ac06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:04.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.816+0000 7fb5b97fa700 1 -- 172.21.15.47:0/2287960202 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb5a808e240 con 0x7fb5bc0fe0e0 2024-02-07T12:30:04.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.816+0000 7fb5c0aaa700 1 --2- 172.21.15.47:0/2287960202 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb5ac06d7e0 0x7fb5ac06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:04.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.816+0000 7fb5c0aaa700 1 --2- 172.21.15.47:0/2287960202 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb5ac06d7e0 0x7fb5ac06fc90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0fcc30 tx=0x7fb5b000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:04.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:04.820+0000 7fb5b97fa700 1 -- 172.21.15.47:0/2287960202 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb5a805b640 con 0x7fb5bc0fe0e0 2024-02-07T12:30:05.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:04 smithi138 ceph-mon[82055]: pgmap v57: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 587 B/s wr, 4 op/s 2024-02-07T12:30:05.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.042+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/2287960202 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5bc02b310 con 0x7fb5ac06d7e0 2024-02-07T12:30:05.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.043+0000 7fb5b97fa700 1 -- 172.21.15.47:0/2287960202 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb5bc02b310 con 0x7fb5ac06d7e0 2024-02-07T12:30:05.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.045+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/2287960202 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb5ac06d7e0 msgr2=0x7fb5ac06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:05.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.045+0000 7fb5c2d0e700 1 --2- 172.21.15.47:0/2287960202 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb5ac06d7e0 0x7fb5ac06fc90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0fcc30 tx=0x7fb5b000b040 comp rx=0 tx=0).stop 2024-02-07T12:30:05.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.045+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/2287960202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc0fe0e0 msgr2=0x7fb5bc1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:05.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.045+0000 7fb5c2d0e700 1 --2- 172.21.15.47:0/2287960202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc0fe0e0 0x7fb5bc1100a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80093b0 tx=0x7fb5a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:05.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.045+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/2287960202 shutdown_connections 2024-02-07T12:30:05.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.045+0000 7fb5c2d0e700 1 --2- 172.21.15.47:0/2287960202 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb5ac06d7e0 0x7fb5ac06fc90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.045+0000 7fb5c2d0e700 1 --2- 172.21.15.47:0/2287960202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5bc0fcef0 0x7fb5bc10fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.045+0000 7fb5c2d0e700 1 --2- 172.21.15.47:0/2287960202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc0fe0e0 0x7fb5bc1100a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.045+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/2287960202 >> 172.21.15.47:0/2287960202 conn(0x7fb5bc0f8620 msgr2=0x7fb5bc0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:05.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.045+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/2287960202 shutdown_connections 2024-02-07T12:30:05.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.045+0000 7fb5c2d0e700 1 -- 172.21.15.47:0/2287960202 wait complete. 2024-02-07T12:30:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.148+0000 7f3082017700 1 -- 172.21.15.47:0/3695357106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f307c1003a0 msgr2=0x7f307c102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.148+0000 7f3082017700 1 --2- 172.21.15.47:0/3695357106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f307c1003a0 0x7f307c102780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3070004940 tx=0x7f3070009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.148+0000 7f3082017700 1 -- 172.21.15.47:0/3695357106 shutdown_connections 2024-02-07T12:30:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.148+0000 7f3082017700 1 --2- 172.21.15.47:0/3695357106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f307c1003a0 0x7f307c102780 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.148+0000 7f3082017700 1 --2- 172.21.15.47:0/3695357106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f307c0fda80 0x7f307c0ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.148+0000 7f3082017700 1 -- 172.21.15.47:0/3695357106 >> 172.21.15.47:0/3695357106 conn(0x7f307c0f7500 msgr2=0x7f307c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.148+0000 7f3082017700 1 -- 172.21.15.47:0/3695357106 shutdown_connections 2024-02-07T12:30:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.148+0000 7f3082017700 1 -- 172.21.15.47:0/3695357106 wait complete. 2024-02-07T12:30:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.149+0000 7f3082017700 1 Processor -- start 2024-02-07T12:30:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.149+0000 7f3082017700 1 -- start start 2024-02-07T12:30:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.149+0000 7f3082017700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f307c0fda80 0x7f307c0fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.149+0000 7f3082017700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f307c1003a0 0x7f307c0fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.149+0000 7f3082017700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c0fbf90 con 0x7f307c0fda80 2024-02-07T12:30:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.149+0000 7f3082017700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c0fc100 con 0x7f307c1003a0 2024-02-07T12:30:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.150+0000 7f307b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f307c0fda80 0x7f307c0fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.150+0000 7f307b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f307c0fda80 0x7f307c0fd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58632/0 (socket says 172.21.15.47:58632) 2024-02-07T12:30:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.150+0000 7f307b7fe700 1 -- 172.21.15.47:0/1417324134 learned_addr learned my addr 172.21.15.47:0/1417324134 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.150+0000 7f307affd700 1 --2- 172.21.15.47:0/1417324134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f307c1003a0 0x7f307c0fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.150+0000 7f307b7fe700 1 -- 172.21.15.47:0/1417324134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f307c1003a0 msgr2=0x7f307c0fb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.150+0000 7f307b7fe700 1 --2- 172.21.15.47:0/1417324134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f307c1003a0 0x7f307c0fb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.150+0000 7f307b7fe700 1 -- 172.21.15.47:0/1417324134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3070005040 con 0x7f307c0fda80 2024-02-07T12:30:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.150+0000 7f307b7fe700 1 --2- 172.21.15.47:0/1417324134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f307c0fda80 0x7f307c0fd510 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f306c00c8c0 tx=0x7f306c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.150+0000 7f3063fff700 1 -- 172.21.15.47:0/1417324134 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f306c00a760 con 0x7f307c0fda80 2024-02-07T12:30:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.150+0000 7f3082017700 1 -- 172.21.15.47:0/1417324134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307c0fc3e0 con 0x7f307c0fda80 2024-02-07T12:30:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.150+0000 7f3063fff700 1 -- 172.21.15.47:0/1417324134 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f306c00ad90 con 0x7f307c0fda80 2024-02-07T12:30:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.150+0000 7f3063fff700 1 -- 172.21.15.47:0/1417324134 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f306c0113a0 con 0x7f307c0fda80 2024-02-07T12:30:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.150+0000 7f3082017700 1 -- 172.21.15.47:0/1417324134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307c115960 con 0x7f307c0fda80 2024-02-07T12:30:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.151+0000 7f3082017700 1 -- 172.21.15.47:0/1417324134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307c04bed0 con 0x7f307c0fda80 2024-02-07T12:30:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.152+0000 7f3063fff700 1 -- 172.21.15.47:0/1417324134 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f306c012400 con 0x7f307c0fda80 2024-02-07T12:30:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.153+0000 7f3063fff700 1 --2- 172.21.15.47:0/1417324134 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f306406d7e0 0x7f306406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.153+0000 7f3063fff700 1 -- 172.21.15.47:0/1417324134 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f306c08ce90 con 0x7f307c0fda80 2024-02-07T12:30:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.153+0000 7f307affd700 1 --2- 172.21.15.47:0/1417324134 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f306406d7e0 0x7f306406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.153+0000 7f307affd700 1 --2- 172.21.15.47:0/1417324134 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f306406d7e0 0x7f306406fc90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3070004f90 tx=0x7f3070009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:05.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.160+0000 7f3063fff700 1 -- 172.21.15.47:0/1417324134 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f306c05a290 con 0x7f307c0fda80 2024-02-07T12:30:05.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.395+0000 7f3082017700 1 -- 172.21.15.47:0/1417324134 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f307c101000 con 0x7f306406d7e0 2024-02-07T12:30:05.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.406+0000 7f3063fff700 1 -- 172.21.15.47:0/1417324134 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f307c101000 con 0x7f306406d7e0 2024-02-07T12:30:05.409 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:30:05.409 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (3m) 13s ago 12m 27.0M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:30:05.409 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (45s) 13s ago 12m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:30:05.409 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (39s) 36s ago 11m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:30:05.410 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (2m) 13s ago 12m 78.3M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:30:05.410 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (7m) 13s ago 7m 111M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:30:05.410 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (7m) 13s ago 7m 129M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:30:05.410 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (6m) 36s ago 6m 68.6M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:30:05.410 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (7m) 36s ago 7m 69.6M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:30:05.410 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (2m) 13s ago 13m 499M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:30:05.411 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (2m) 36s ago 11m 450M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:30:05.411 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (107s) 13s ago 14m 44.6M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:30:05.411 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (84s) 36s ago 11m 32.9M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:30:05.411 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (4m) 13s ago 12m 14.9M - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:30:05.411 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (2m) 36s ago 11m 15.3M - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:30:05.411 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (19s) 13s ago 10m 12.6M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:30:05.412 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (10m) 13s ago 10m 230M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 1c6e3c603ed3 2024-02-07T12:30:05.412 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (9m) 13s ago 9m 180M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:30:05.412 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (9m) 36s ago 9m 264M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:30:05.412 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (9m) 36s ago 9m 234M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:30:05.412 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (8m) 36s ago 8m 218M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:30:05.412 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (2m) 13s ago 12m 48.6M - 2.43.0 a07b618ecd1d 32840d82c54b 2024-02-07T12:30:05.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.409+0000 7f3082017700 1 -- 172.21.15.47:0/1417324134 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f306406d7e0 msgr2=0x7f306406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:05.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.409+0000 7f3082017700 1 --2- 172.21.15.47:0/1417324134 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f306406d7e0 0x7f306406fc90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3070004f90 tx=0x7f3070009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:05.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.409+0000 7f3082017700 1 -- 172.21.15.47:0/1417324134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f307c0fda80 msgr2=0x7f307c0fd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:05.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.409+0000 7f3082017700 1 --2- 172.21.15.47:0/1417324134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f307c0fda80 0x7f307c0fd510 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f306c00c8c0 tx=0x7f306c0044c0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.409+0000 7f3082017700 1 -- 172.21.15.47:0/1417324134 shutdown_connections 2024-02-07T12:30:05.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.409+0000 7f3082017700 1 --2- 172.21.15.47:0/1417324134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f307c0fda80 0x7f307c0fd510 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.409+0000 7f3082017700 1 --2- 172.21.15.47:0/1417324134 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f306406d7e0 0x7f306406fc90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.409+0000 7f3082017700 1 --2- 172.21.15.47:0/1417324134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f307c1003a0 0x7f307c0fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.409+0000 7f3082017700 1 -- 172.21.15.47:0/1417324134 >> 172.21.15.47:0/1417324134 conn(0x7f307c0f7500 msgr2=0x7f307c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:05.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.409+0000 7f3082017700 1 -- 172.21.15.47:0/1417324134 shutdown_connections 2024-02-07T12:30:05.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.409+0000 7f3082017700 1 -- 172.21.15.47:0/1417324134 wait complete. 2024-02-07T12:30:05.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.510+0000 7f62e8d16700 1 -- 172.21.15.47:0/1745597650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62e40fc7f0 msgr2=0x7f62e40fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:05.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.510+0000 7f62e8d16700 1 --2- 172.21.15.47:0/1745597650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62e40fc7f0 0x7f62e40fcc40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f62d4004940 tx=0x7f62d4009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.510+0000 7f62e8d16700 1 -- 172.21.15.47:0/1745597650 shutdown_connections 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.510+0000 7f62e8d16700 1 --2- 172.21.15.47:0/1745597650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62e40fc7f0 0x7f62e40fcc40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.510+0000 7f62e8d16700 1 --2- 172.21.15.47:0/1745597650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62e40fb5e0 0x7f62e40fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.510+0000 7f62e8d16700 1 -- 172.21.15.47:0/1745597650 >> 172.21.15.47:0/1745597650 conn(0x7f62e40f6ca0 msgr2=0x7f62e40f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.510+0000 7f62e8d16700 1 -- 172.21.15.47:0/1745597650 shutdown_connections 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.510+0000 7f62e8d16700 1 -- 172.21.15.47:0/1745597650 wait complete. 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.511+0000 7f62e8d16700 1 Processor -- start 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.511+0000 7f62e8d16700 1 -- start start 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.511+0000 7f62e8d16700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62e40fb5e0 0x7f62e4110690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.511+0000 7f62e8d16700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62e40fc7f0 0x7f62e4112be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.511+0000 7f62e8d16700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40fe7b0 con 0x7f62e40fb5e0 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.511+0000 7f62e8d16700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40fe8f0 con 0x7f62e40fc7f0 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.511+0000 7f62e259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62e40fb5e0 0x7f62e4110690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.511+0000 7f62e259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62e40fb5e0 0x7f62e4110690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58658/0 (socket says 172.21.15.47:58658) 2024-02-07T12:30:05.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.511+0000 7f62e259c700 1 -- 172.21.15.47:0/2041601850 learned_addr learned my addr 172.21.15.47:0/2041601850 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.512+0000 7f62e1d9b700 1 --2- 172.21.15.47:0/2041601850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62e40fc7f0 0x7f62e4112be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.512+0000 7f62e259c700 1 -- 172.21.15.47:0/2041601850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62e40fc7f0 msgr2=0x7f62e4112be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.512+0000 7f62e259c700 1 --2- 172.21.15.47:0/2041601850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62e40fc7f0 0x7f62e4112be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.512+0000 7f62e259c700 1 -- 172.21.15.47:0/2041601850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d4005040 con 0x7f62e40fb5e0 2024-02-07T12:30:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.512+0000 7f62e1d9b700 1 --2- 172.21.15.47:0/2041601850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62e40fc7f0 0x7f62e4112be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:30:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.512+0000 7f62e259c700 1 --2- 172.21.15.47:0/2041601850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62e40fb5e0 0x7f62e4110690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f62d800eb40 tx=0x7f62d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.512+0000 7f62d2ffd700 1 -- 172.21.15.47:0/2041601850 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62d8007cc0 con 0x7f62e40fb5e0 2024-02-07T12:30:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.512+0000 7f62d2ffd700 1 -- 172.21.15.47:0/2041601850 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62d800f040 con 0x7f62e40fb5e0 2024-02-07T12:30:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.512+0000 7f62d2ffd700 1 -- 172.21.15.47:0/2041601850 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62d800cb30 con 0x7f62e40fb5e0 2024-02-07T12:30:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.512+0000 7f62e8d16700 1 -- 172.21.15.47:0/2041601850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e41131e0 con 0x7f62e40fb5e0 2024-02-07T12:30:05.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.512+0000 7f62e8d16700 1 -- 172.21.15.47:0/2041601850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e4113720 con 0x7f62e40fb5e0 2024-02-07T12:30:05.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.513+0000 7f62e8d16700 1 -- 172.21.15.47:0/2041601850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e404bed0 con 0x7f62e40fb5e0 2024-02-07T12:30:05.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.513+0000 7f62d2ffd700 1 -- 172.21.15.47:0/2041601850 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f62d800cc90 con 0x7f62e40fb5e0 2024-02-07T12:30:05.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.514+0000 7f62d2ffd700 1 --2- 172.21.15.47:0/2041601850 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f62cc06d7e0 0x7f62cc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:05.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.514+0000 7f62d2ffd700 1 -- 172.21.15.47:0/2041601850 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f62d808ca10 con 0x7f62e40fb5e0 2024-02-07T12:30:05.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.514+0000 7f62e1d9b700 1 --2- 172.21.15.47:0/2041601850 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f62cc06d7e0 0x7f62cc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:05.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.514+0000 7f62e1d9b700 1 --2- 172.21.15.47:0/2041601850 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f62cc06d7e0 0x7f62cc06fc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009b30 tx=0x7f62d4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:05.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.519+0000 7f62d2ffd700 1 -- 172.21.15.47:0/2041601850 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f62d80562e0 con 0x7f62e40fb5e0 2024-02-07T12:30:05.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.810+0000 7f62e8d16700 1 -- 172.21.15.47:0/2041601850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f62e4113990 con 0x7f62e40fb5e0 2024-02-07T12:30:05.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.810+0000 7f62d2ffd700 1 -- 172.21.15.47:0/2041601850 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f62e4113990 con 0x7f62e40fb5e0 2024-02-07T12:30:05.813 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:30:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:30:05.813 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:30:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:30:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:30:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:30:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:30:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:30:05.814 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 5, 2024-02-07T12:30:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 1 2024-02-07T12:30:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:30:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:30:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:30:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:30:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:30:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 9, 2024-02-07T12:30:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 5 2024-02-07T12:30:05.816 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:30:05.816 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:30:05.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.812+0000 7f62e8d16700 1 -- 172.21.15.47:0/2041601850 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f62cc06d7e0 msgr2=0x7f62cc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:05.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.812+0000 7f62e8d16700 1 --2- 172.21.15.47:0/2041601850 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f62cc06d7e0 0x7f62cc06fc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009b30 tx=0x7f62d4009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:05.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.812+0000 7f62e8d16700 1 -- 172.21.15.47:0/2041601850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62e40fb5e0 msgr2=0x7f62e4110690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:05.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.812+0000 7f62e8d16700 1 --2- 172.21.15.47:0/2041601850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62e40fb5e0 0x7f62e4110690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f62d800eb40 tx=0x7f62d800b040 comp rx=0 tx=0).stop 2024-02-07T12:30:05.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.812+0000 7f62e8d16700 1 -- 172.21.15.47:0/2041601850 shutdown_connections 2024-02-07T12:30:05.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.812+0000 7f62e8d16700 1 --2- 172.21.15.47:0/2041601850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62e40fb5e0 0x7f62e4110690 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.812+0000 7f62e8d16700 1 --2- 172.21.15.47:0/2041601850 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f62cc06d7e0 0x7f62cc06fc90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.812+0000 7f62e8d16700 1 --2- 172.21.15.47:0/2041601850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62e40fc7f0 0x7f62e4112be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.812+0000 7f62e8d16700 1 -- 172.21.15.47:0/2041601850 >> 172.21.15.47:0/2041601850 conn(0x7f62e40f6ca0 msgr2=0x7f62e4100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:05.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.813+0000 7f62e8d16700 1 -- 172.21.15.47:0/2041601850 shutdown_connections 2024-02-07T12:30:05.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.813+0000 7f62e8d16700 1 -- 172.21.15.47:0/2041601850 wait complete. 2024-02-07T12:30:05.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.915+0000 7fa6d9842700 1 -- 172.21.15.47:0/3474406160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d40fdd90 msgr2=0x7fa6d40fc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:05.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.915+0000 7fa6d9842700 1 --2- 172.21.15.47:0/3474406160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d40fdd90 0x7fa6d40fc1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8004940 tx=0x7fa6c8009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:05.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.915+0000 7fa6d9842700 1 -- 172.21.15.47:0/3474406160 shutdown_connections 2024-02-07T12:30:05.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.915+0000 7fa6d9842700 1 --2- 172.21.15.47:0/3474406160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d40fdd90 0x7fa6d40fc1a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.915+0000 7fa6d9842700 1 --2- 172.21.15.47:0/3474406160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6d40fd440 0x7fa6d40fd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.915+0000 7fa6d9842700 1 -- 172.21.15.47:0/3474406160 >> 172.21.15.47:0/3474406160 conn(0x7fa6d40f6d20 msgr2=0x7fa6d40f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:05.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.915+0000 7fa6d9842700 1 -- 172.21.15.47:0/3474406160 shutdown_connections 2024-02-07T12:30:05.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.915+0000 7fa6d9842700 1 -- 172.21.15.47:0/3474406160 wait complete. 2024-02-07T12:30:05.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.915+0000 7fa6d9842700 1 Processor -- start 2024-02-07T12:30:05.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.915+0000 7fa6d9842700 1 -- start start 2024-02-07T12:30:05.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d9842700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d40fd440 0x7fa6d410dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:05.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d9842700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6d40fdd90 0x7fa6d410e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:05.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d9842700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d410e890 con 0x7fa6d40fd440 2024-02-07T12:30:05.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d9842700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d410f020 con 0x7fa6d40fdd90 2024-02-07T12:30:05.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d40fd440 0x7fa6d410dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:05.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d40fd440 0x7fa6d410dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58678/0 (socket says 172.21.15.47:58678) 2024-02-07T12:30:05.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d2ffd700 1 -- 172.21.15.47:0/1495490869 learned_addr learned my addr 172.21.15.47:0/1495490869 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:05.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d27fc700 1 --2- 172.21.15.47:0/1495490869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6d40fdd90 0x7fa6d410e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:05.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d2ffd700 1 -- 172.21.15.47:0/1495490869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6d40fdd90 msgr2=0x7fa6d410e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:05.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d2ffd700 1 --2- 172.21.15.47:0/1495490869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6d40fdd90 0x7fa6d410e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:05.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d2ffd700 1 -- 172.21.15.47:0/1495490869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c8005040 con 0x7fa6d40fd440 2024-02-07T12:30:05.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d2ffd700 1 --2- 172.21.15.47:0/1495490869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d40fd440 0x7fa6d410dd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc002a50 tx=0x7fa6cc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:05.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6bb7fe700 1 -- 172.21.15.47:0/1495490869 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6cc007cc0 con 0x7fa6d40fd440 2024-02-07T12:30:05.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6bb7fe700 1 -- 172.21.15.47:0/1495490869 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6cc00f040 con 0x7fa6d40fd440 2024-02-07T12:30:05.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6bb7fe700 1 -- 172.21.15.47:0/1495490869 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6cc00da30 con 0x7fa6d40fd440 2024-02-07T12:30:05.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d9842700 1 -- 172.21.15.47:0/1495490869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d410f300 con 0x7fa6d40fd440 2024-02-07T12:30:05.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.916+0000 7fa6d9842700 1 -- 172.21.15.47:0/1495490869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d410f840 con 0x7fa6d40fd440 2024-02-07T12:30:05.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.917+0000 7fa6d9842700 1 -- 172.21.15.47:0/1495490869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d404bed0 con 0x7fa6d40fd440 2024-02-07T12:30:05.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.918+0000 7fa6bb7fe700 1 -- 172.21.15.47:0/1495490869 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa6cc00db90 con 0x7fa6d40fd440 2024-02-07T12:30:05.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.918+0000 7fa6bb7fe700 1 --2- 172.21.15.47:0/1495490869 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa6bc06d7e0 0x7fa6bc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:05.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.918+0000 7fa6bb7fe700 1 -- 172.21.15.47:0/1495490869 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa6cc08cc70 con 0x7fa6d40fd440 2024-02-07T12:30:05.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.918+0000 7fa6d27fc700 1 --2- 172.21.15.47:0/1495490869 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa6bc06d7e0 0x7fa6bc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:05.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.919+0000 7fa6d27fc700 1 --2- 172.21.15.47:0/1495490869 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa6bc06d7e0 0x7fa6bc06fc90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8004890 tx=0x7fa6c8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:05.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:05.923+0000 7fa6bb7fe700 1 -- 172.21.15.47:0/1495490869 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa6cc059ff0 con 0x7fa6d40fd440 2024-02-07T12:30:06.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:05 smithi138 ceph-mon[82055]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:06.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:05 smithi138 ceph-mon[82055]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:06.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:05 smithi138 ceph-mon[82055]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:06.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:05 smithi047 ceph-mon[93224]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:06.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:05 smithi047 ceph-mon[93224]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:06.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:05 smithi047 ceph-mon[93224]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:06.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.173+0000 7fa6d9842700 1 -- 172.21.15.47:0/1495490869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa6d410fa60 con 0x7fa6d40fd440 2024-02-07T12:30:06.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.173+0000 7fa6bb7fe700 1 -- 172.21.15.47:0/1495490869 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1872 (secure 0 0 0) 0x7fa6cc059b80 con 0x7fa6d40fd440 2024-02-07T12:30:06.176 INFO:teuthology.orchestra.run.smithi047.stdout:e22 2024-02-07T12:30:06.176 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:30:06.176 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:30:06.176 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:30:06.176 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:30:06.176 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:30:06.177 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:30:06.177 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 22 2024-02-07T12:30:06.177 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:30:06.177 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:30:06.177 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:29:33.611202+0000 2024-02-07T12:30:06.177 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:30:06.177 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:30:06.177 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:30:06.177 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:30:06.177 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:30:06.178 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:30:06.178 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:30:06.179 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:30:06.179 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:30:06.179 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:30:06.179 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:30:06.179 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:30:06.179 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:30:06.179 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:30:06.180 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:30:06.180 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:30:06.180 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:30:06.180 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:30:06.180 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:30:06.180 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:30:06.180 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:30:06.180 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:30:06.180 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:30:06.181 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:30:06.181 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:30:06.181 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:30:06.181 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:30:06.181 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:30:06.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.175+0000 7fa6d9842700 1 -- 172.21.15.47:0/1495490869 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa6bc06d7e0 msgr2=0x7fa6bc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:06.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.175+0000 7fa6d9842700 1 --2- 172.21.15.47:0/1495490869 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa6bc06d7e0 0x7fa6bc06fc90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8004890 tx=0x7fa6c8009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:06.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.175+0000 7fa6d9842700 1 -- 172.21.15.47:0/1495490869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d40fd440 msgr2=0x7fa6d410dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:06.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.175+0000 7fa6d9842700 1 --2- 172.21.15.47:0/1495490869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d40fd440 0x7fa6d410dd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc002a50 tx=0x7fa6cc0046b0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.176+0000 7fa6d9842700 1 -- 172.21.15.47:0/1495490869 shutdown_connections 2024-02-07T12:30:06.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.176+0000 7fa6d9842700 1 --2- 172.21.15.47:0/1495490869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d40fd440 0x7fa6d410dd50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.176+0000 7fa6d9842700 1 --2- 172.21.15.47:0/1495490869 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa6bc06d7e0 0x7fa6bc06fc90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.176+0000 7fa6d9842700 1 --2- 172.21.15.47:0/1495490869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6d40fdd90 0x7fa6d410e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.176+0000 7fa6d9842700 1 -- 172.21.15.47:0/1495490869 >> 172.21.15.47:0/1495490869 conn(0x7fa6d40f6d20 msgr2=0x7fa6d40fb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:06.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.176+0000 7fa6d9842700 1 -- 172.21.15.47:0/1495490869 shutdown_connections 2024-02-07T12:30:06.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.176+0000 7fa6d9842700 1 -- 172.21.15.47:0/1495490869 wait complete. 2024-02-07T12:30:06.188 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 22 2024-02-07T12:30:06.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.279+0000 7f66edabd700 1 -- 172.21.15.47:0/67036619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66e80fb300 msgr2=0x7f66e80fb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:06.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.279+0000 7f66edabd700 1 --2- 172.21.15.47:0/67036619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66e80fb300 0x7f66e80fb710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f66dc004940 tx=0x7f66dc009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:06.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.279+0000 7f66edabd700 1 -- 172.21.15.47:0/67036619 shutdown_connections 2024-02-07T12:30:06.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.279+0000 7f66edabd700 1 --2- 172.21.15.47:0/67036619 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66e80fbce0 0x7f66e8102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.279+0000 7f66edabd700 1 --2- 172.21.15.47:0/67036619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66e80fb300 0x7f66e80fb710 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.279+0000 7f66edabd700 1 -- 172.21.15.47:0/67036619 >> 172.21.15.47:0/67036619 conn(0x7f66e80f6ca0 msgr2=0x7f66e80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:06.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.279+0000 7f66edabd700 1 -- 172.21.15.47:0/67036619 shutdown_connections 2024-02-07T12:30:06.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.279+0000 7f66edabd700 1 -- 172.21.15.47:0/67036619 wait complete. 2024-02-07T12:30:06.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.280+0000 7f66edabd700 1 Processor -- start 2024-02-07T12:30:06.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.280+0000 7f66edabd700 1 -- start start 2024-02-07T12:30:06.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.280+0000 7f66edabd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66e80fb300 0x7f66e810d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:06.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.280+0000 7f66edabd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66e810ded0 0x7f66e810ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:06.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.280+0000 7f66edabd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e810e390 con 0x7f66e810ded0 2024-02-07T12:30:06.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.280+0000 7f66edabd700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e810e4d0 con 0x7f66e80fb300 2024-02-07T12:30:06.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.280+0000 7f66e6ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66e810ded0 0x7f66e810ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:06.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.280+0000 7f66e6ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66e810ded0 0x7f66e810ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58694/0 (socket says 172.21.15.47:58694) 2024-02-07T12:30:06.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.280+0000 7f66e6ffd700 1 -- 172.21.15.47:0/3818115650 learned_addr learned my addr 172.21.15.47:0/3818115650 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:06.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.280+0000 7f66e77fe700 1 --2- 172.21.15.47:0/3818115650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66e80fb300 0x7f66e810d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:06.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.281+0000 7f66e6ffd700 1 -- 172.21.15.47:0/3818115650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66e80fb300 msgr2=0x7f66e810d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:06.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.281+0000 7f66e6ffd700 1 --2- 172.21.15.47:0/3818115650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66e80fb300 0x7f66e810d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.281+0000 7f66e6ffd700 1 -- 172.21.15.47:0/3818115650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc005040 con 0x7f66e810ded0 2024-02-07T12:30:06.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.281+0000 7f66e6ffd700 1 --2- 172.21.15.47:0/3818115650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66e810ded0 0x7f66e810ed70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f66d8002a50 tx=0x7f66d80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:06.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.281+0000 7f66cffff700 1 -- 172.21.15.47:0/3818115650 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66d8007cc0 con 0x7f66e810ded0 2024-02-07T12:30:06.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.281+0000 7f66cffff700 1 -- 172.21.15.47:0/3818115650 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66d800f040 con 0x7f66e810ded0 2024-02-07T12:30:06.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.281+0000 7f66edabd700 1 -- 172.21.15.47:0/3818115650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e810f3d0 con 0x7f66e810ded0 2024-02-07T12:30:06.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.281+0000 7f66edabd700 1 -- 172.21.15.47:0/3818115650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e810f8e0 con 0x7f66e810ded0 2024-02-07T12:30:06.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.281+0000 7f66cffff700 1 -- 172.21.15.47:0/3818115650 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66d800db30 con 0x7f66e810ded0 2024-02-07T12:30:06.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.282+0000 7f66edabd700 1 -- 172.21.15.47:0/3818115650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d40052e0 con 0x7f66e810ded0 2024-02-07T12:30:06.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.282+0000 7f66cffff700 1 -- 172.21.15.47:0/3818115650 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f66d800dd30 con 0x7f66e810ded0 2024-02-07T12:30:06.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.283+0000 7f66cffff700 1 --2- 172.21.15.47:0/3818115650 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f66d006d7e0 0x7f66d006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:06.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.283+0000 7f66cffff700 1 -- 172.21.15.47:0/3818115650 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f66d808c950 con 0x7f66e810ded0 2024-02-07T12:30:06.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.283+0000 7f66e77fe700 1 --2- 172.21.15.47:0/3818115650 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f66d006d7e0 0x7f66d006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:06.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.283+0000 7f66e77fe700 1 --2- 172.21.15.47:0/3818115650 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f66d006d7e0 0x7f66d006fc90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f66dc004f90 tx=0x7f66dc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:06.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.287+0000 7f66cffff700 1 -- 172.21.15.47:0/3818115650 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f66d8059d50 con 0x7f66e810ded0 2024-02-07T12:30:06.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.511+0000 7f66edabd700 1 -- 172.21.15.47:0/3818115650 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66d4000bf0 con 0x7f66d006d7e0 2024-02-07T12:30:06.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.512+0000 7f66cffff700 1 -- 172.21.15.47:0/3818115650 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f66d4000bf0 con 0x7f66d006d7e0 2024-02-07T12:30:06.515 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:30:06.515 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:30:06.515 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:30:06.515 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:30:06.515 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:30:06.515 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-02-07T12:30:06.515 INFO:teuthology.orchestra.run.smithi047.stdout: "mon", 2024-02-07T12:30:06.515 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr" 2024-02-07T12:30:06.515 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:30:06.515 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "7/21 daemons upgraded", 2024-02-07T12:30:06.515 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading osd daemons", 2024-02-07T12:30:06.515 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:30:06.515 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:30:06.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.514+0000 7f66edabd700 1 -- 172.21.15.47:0/3818115650 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f66d006d7e0 msgr2=0x7f66d006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.514+0000 7f66edabd700 1 --2- 172.21.15.47:0/3818115650 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f66d006d7e0 0x7f66d006fc90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f66dc004f90 tx=0x7f66dc009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.514+0000 7f66edabd700 1 -- 172.21.15.47:0/3818115650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66e810ded0 msgr2=0x7f66e810ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.514+0000 7f66edabd700 1 --2- 172.21.15.47:0/3818115650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66e810ded0 0x7f66e810ed70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f66d8002a50 tx=0x7f66d80046b0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.514+0000 7f66edabd700 1 -- 172.21.15.47:0/3818115650 shutdown_connections 2024-02-07T12:30:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.514+0000 7f66edabd700 1 --2- 172.21.15.47:0/3818115650 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f66d006d7e0 0x7f66d006fc90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.514+0000 7f66edabd700 1 --2- 172.21.15.47:0/3818115650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66e80fb300 0x7f66e810d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.514+0000 7f66edabd700 1 --2- 172.21.15.47:0/3818115650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66e810ded0 0x7f66e810ed70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.514+0000 7f66edabd700 1 -- 172.21.15.47:0/3818115650 >> 172.21.15.47:0/3818115650 conn(0x7f66e80f6ca0 msgr2=0x7f66e8100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.514+0000 7f66edabd700 1 -- 172.21.15.47:0/3818115650 shutdown_connections 2024-02-07T12:30:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.514+0000 7f66edabd700 1 -- 172.21.15.47:0/3818115650 wait complete. 2024-02-07T12:30:06.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.624+0000 7f34e41ee700 1 -- 172.21.15.47:0/1576610574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34dc0fb870 msgr2=0x7f34dc0fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:06.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.624+0000 7f34e41ee700 1 --2- 172.21.15.47:0/1576610574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34dc0fb870 0x7f34dc0fbc80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f34d8004940 tx=0x7f34d8009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:06.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.624+0000 7f34e41ee700 1 -- 172.21.15.47:0/1576610574 shutdown_connections 2024-02-07T12:30:06.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.624+0000 7f34e41ee700 1 --2- 172.21.15.47:0/1576610574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34dc0fc1c0 0x7f34dc0fc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.624+0000 7f34e41ee700 1 --2- 172.21.15.47:0/1576610574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34dc0fb870 0x7f34dc0fbc80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.624+0000 7f34e41ee700 1 -- 172.21.15.47:0/1576610574 >> 172.21.15.47:0/1576610574 conn(0x7f34dc0f7520 msgr2=0x7f34dc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.625+0000 7f34e41ee700 1 -- 172.21.15.47:0/1576610574 shutdown_connections 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.625+0000 7f34e41ee700 1 -- 172.21.15.47:0/1576610574 wait complete. 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.625+0000 7f34e41ee700 1 Processor -- start 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.625+0000 7f34e41ee700 1 -- start start 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.625+0000 7f34e41ee700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34dc0fb870 0x7f34dc10fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.625+0000 7f34e41ee700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34dc0fc1c0 0x7f34dc110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.625+0000 7f34e41ee700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc110650 con 0x7f34dc0fb870 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.625+0000 7f34e41ee700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc110ef0 con 0x7f34dc0fc1c0 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.625+0000 7f34e1f8a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34dc0fb870 0x7f34dc10fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.625+0000 7f34e1f8a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34dc0fb870 0x7f34dc10fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58708/0 (socket says 172.21.15.47:58708) 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.625+0000 7f34e1f8a700 1 -- 172.21.15.47:0/927085305 learned_addr learned my addr 172.21.15.47:0/927085305 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:06.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.626+0000 7f34e1789700 1 --2- 172.21.15.47:0/927085305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34dc0fc1c0 0x7f34dc110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:06.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.626+0000 7f34e1f8a700 1 -- 172.21.15.47:0/927085305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34dc0fc1c0 msgr2=0x7f34dc110050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:06.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.626+0000 7f34e1f8a700 1 --2- 172.21.15.47:0/927085305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34dc0fc1c0 0x7f34dc110050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.626+0000 7f34e1f8a700 1 -- 172.21.15.47:0/927085305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d8005040 con 0x7f34dc0fb870 2024-02-07T12:30:06.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.626+0000 7f34e1f8a700 1 --2- 172.21.15.47:0/927085305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34dc0fb870 0x7f34dc10fb10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009fd0 tx=0x7f34d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:06.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.626+0000 7f34d27fc700 1 -- 172.21.15.47:0/927085305 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34d800e040 con 0x7f34dc0fb870 2024-02-07T12:30:06.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.626+0000 7f34d27fc700 1 -- 172.21.15.47:0/927085305 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f34d800bcc0 con 0x7f34dc0fb870 2024-02-07T12:30:06.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.626+0000 7f34e41ee700 1 -- 172.21.15.47:0/927085305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc111170 con 0x7f34dc0fb870 2024-02-07T12:30:06.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.626+0000 7f34d27fc700 1 -- 172.21.15.47:0/927085305 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34d801c630 con 0x7f34dc0fb870 2024-02-07T12:30:06.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.626+0000 7f34e41ee700 1 -- 172.21.15.47:0/927085305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34dc1116b0 con 0x7f34dc0fb870 2024-02-07T12:30:06.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.627+0000 7f34e41ee700 1 -- 172.21.15.47:0/927085305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34dc04bed0 con 0x7f34dc0fb870 2024-02-07T12:30:06.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.628+0000 7f34d27fc700 1 -- 172.21.15.47:0/927085305 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f34d8013420 con 0x7f34dc0fb870 2024-02-07T12:30:06.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.628+0000 7f34d27fc700 1 --2- 172.21.15.47:0/927085305 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f34c806d7f0 0x7f34c806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:06.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.628+0000 7f34d27fc700 1 -- 172.21.15.47:0/927085305 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f34d808e330 con 0x7f34dc0fb870 2024-02-07T12:30:06.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.628+0000 7f34e1789700 1 --2- 172.21.15.47:0/927085305 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f34c806d7f0 0x7f34c806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:06.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.628+0000 7f34e1789700 1 --2- 172.21.15.47:0/927085305 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f34c806d7f0 0x7f34c806fca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f34cc004f40 tx=0x7f34cc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:06.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.633+0000 7f34d27fc700 1 -- 172.21.15.47:0/927085305 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f34d805b730 con 0x7f34dc0fb870 2024-02-07T12:30:06.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:06 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2041601850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:30:06.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:06 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1495490869' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:30:06.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:06 smithi047 ceph-mon[93224]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:06.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:06 smithi047 ceph-mon[93224]: pgmap v58: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-07T12:30:06.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.919+0000 7f34e41ee700 1 -- 172.21.15.47:0/927085305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f34dc116130 con 0x7f34dc0fb870 2024-02-07T12:30:06.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.920+0000 7f34d27fc700 1 -- 172.21.15.47:0/927085305 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f34d805b2c0 con 0x7f34dc0fb870 2024-02-07T12:30:06.922 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:30:06.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.922+0000 7f34e41ee700 1 -- 172.21.15.47:0/927085305 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f34c806d7f0 msgr2=0x7f34c806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:06.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.922+0000 7f34e41ee700 1 --2- 172.21.15.47:0/927085305 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f34c806d7f0 0x7f34c806fca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f34cc004f40 tx=0x7f34cc00b040 comp rx=0 tx=0).stop 2024-02-07T12:30:06.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.922+0000 7f34e41ee700 1 -- 172.21.15.47:0/927085305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34dc0fb870 msgr2=0x7f34dc10fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:06.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.922+0000 7f34e41ee700 1 --2- 172.21.15.47:0/927085305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34dc0fb870 0x7f34dc10fb10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009fd0 tx=0x7f34d8009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:06.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.922+0000 7f34e41ee700 1 -- 172.21.15.47:0/927085305 shutdown_connections 2024-02-07T12:30:06.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.922+0000 7f34e41ee700 1 --2- 172.21.15.47:0/927085305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34dc0fb870 0x7f34dc10fb10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.922+0000 7f34e41ee700 1 --2- 172.21.15.47:0/927085305 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f34c806d7f0 0x7f34c806fca0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.922+0000 7f34e41ee700 1 --2- 172.21.15.47:0/927085305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34dc0fc1c0 0x7f34dc110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:06.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.922+0000 7f34e41ee700 1 -- 172.21.15.47:0/927085305 >> 172.21.15.47:0/927085305 conn(0x7f34dc0f7520 msgr2=0x7f34dc103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:06.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.922+0000 7f34e41ee700 1 -- 172.21.15.47:0/927085305 shutdown_connections 2024-02-07T12:30:06.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:06.922+0000 7f34e41ee700 1 -- 172.21.15.47:0/927085305 wait complete. 2024-02-07T12:30:07.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:06 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2041601850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:30:07.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:06 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1495490869' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:30:07.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:06 smithi138 ceph-mon[82055]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:07.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:06 smithi138 ceph-mon[82055]: pgmap v58: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-07T12:30:08.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:07 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:08.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:07 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/927085305' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:30:08.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:07 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:08.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:07 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/927085305' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:30:09.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:09 smithi138 ceph-mon[82055]: pgmap v59: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-07T12:30:09.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:09 smithi047 ceph-mon[93224]: pgmap v59: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-07T12:30:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:10 smithi138 ceph-mon[82055]: pgmap v60: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:30:11.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:10 smithi047 ceph-mon[93224]: pgmap v60: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:30:12.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-07T12:30:12.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:11 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-07T12:30:12.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:11 smithi138 ceph-mon[82055]: Upgrade: osd.1 is safe to restart 2024-02-07T12:30:12.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:12.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:30:12.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-07T12:30:12.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:11 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-07T12:30:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:11 smithi047 ceph-mon[93224]: Upgrade: osd.1 is safe to restart 2024-02-07T12:30:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:30:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:12 smithi047 ceph-mon[93224]: pgmap v61: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:30:13.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:12 smithi138 ceph-mon[82055]: pgmap v61: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:30:14.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:14 smithi047 ceph-mon[93224]: Upgrade: Updating osd.1 2024-02-07T12:30:14.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:14 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:14.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:14 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-07T12:30:14.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:14 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:30:14.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:14 smithi047 ceph-mon[93224]: Deploying daemon osd.1 on smithi047 2024-02-07T12:30:14.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:14 smithi138 ceph-mon[82055]: Upgrade: Updating osd.1 2024-02-07T12:30:14.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:14 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:14.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:14 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-07T12:30:14.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:14 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:30:14.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:14 smithi138 ceph-mon[82055]: Deploying daemon osd.1 on smithi047 2024-02-07T12:30:15.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:15 smithi047 ceph-mon[93224]: pgmap v62: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:30:15.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:15 smithi138 ceph-mon[82055]: pgmap v62: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:30:16.853 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:16 smithi047 ceph-mon[93224]: pgmap v63: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:30:16.854 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:16 smithi047 systemd[1]: Stopping Ceph osd.1 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:30:17.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:16 smithi138 ceph-mon[82055]: pgmap v63: 65 pgs: 65 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:30:17.325 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:16 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1[54865]: 2024-02-07T12:30:16.864+0000 7f4d2a6c7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:30:17.325 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:16 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1[54865]: 2024-02-07T12:30:16.864+0000 7f4d2a6c7700 -1 osd.1 55 *** Got signal Terminated *** 2024-02-07T12:30:17.325 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:16 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1[54865]: 2024-02-07T12:30:16.864+0000 7f4d2a6c7700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-07T12:30:18.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:17 smithi138 ceph-mon[82055]: osd.1 marked itself down and dead 2024-02-07T12:30:18.066 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:17 smithi047 ceph-mon[93224]: osd.1 marked itself down and dead 2024-02-07T12:30:18.325 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:18 smithi047 podman[107156]: 2024-02-07 12:30:18.06466969 +0000 UTC m=+1.327542515 container died 1c6e3c603ed3b315c2e2458ed4dda72144e491f386420685aba3288011b9323d (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, RELEASE=quincy-f246262, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:30:18.662 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:18 smithi047 podman[107156]: 2024-02-07 12:30:18.415085244 +0000 UTC m=+1.677958068 container cleanup 1c6e3c603ed3b315c2e2458ed4dda72144e491f386420685aba3288011b9323d (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=quincy-f246262, io.buildah.version=1.33.2) 2024-02-07T12:30:18.662 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:18 smithi047 bash[107156]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1 2024-02-07T12:30:19.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:18 smithi047 ceph-mon[93224]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-07T12:30:19.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:18 smithi047 ceph-mon[93224]: osdmap e56: 6 total, 5 up, 6 in 2024-02-07T12:30:19.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:18 smithi047 ceph-mon[93224]: failed to encode map e56 with expected crc 2024-02-07T12:30:19.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:18 smithi047 ceph-mon[93224]: failed to encode map e56 with expected crc 2024-02-07T12:30:19.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:18 smithi047 ceph-mon[93224]: failed to encode map e56 with expected crc 2024-02-07T12:30:19.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:18 smithi047 ceph-mon[93224]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:30:19.032 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:18 smithi047 podman[107187]: 2024-02-07 12:30:18.708256248 +0000 UTC m=+0.643893538 container remove 1c6e3c603ed3b315c2e2458ed4dda72144e491f386420685aba3288011b9323d (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, GIT_CLEAN=True, ceph=True, RELEASE=quincy-f246262, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-07T12:30:19.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:18 smithi138 ceph-mon[82055]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-07T12:30:19.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:18 smithi138 ceph-mon[82055]: osdmap e56: 6 total, 5 up, 6 in 2024-02-07T12:30:19.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:18 smithi138 ceph-mon[82055]: failed to encode map e56 with expected crc 2024-02-07T12:30:19.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:18 smithi138 ceph-mon[82055]: failed to encode map e56 with expected crc 2024-02-07T12:30:19.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:18 smithi138 ceph-mon[82055]: failed to encode map e56 with expected crc 2024-02-07T12:30:19.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:18 smithi138 ceph-mon[82055]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:30:19.313 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:19 smithi047 podman[107283]: 2024-02-07 12:30:18.932508993 +0000 UTC m=+0.018061142 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:30:19.313 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:19 smithi047 podman[107283]: 2024-02-07 12:30:19.061893678 +0000 UTC m=+0.147445859 container create f1561ea56c56b71b32e1c2d332d8cf219e9f69e7d93d2c26125a7cbe5bc09dce (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:30:19.313 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:19 smithi047 podman[107283]: 2024-02-07 12:30:19.312069431 +0000 UTC m=+0.397621568 container init f1561ea56c56b71b32e1c2d332d8cf219e9f69e7d93d2c26125a7cbe5bc09dce (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux ) 2024-02-07T12:30:19.575 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:19 smithi047 podman[107283]: 2024-02-07 12:30:19.315394197 +0000 UTC m=+0.400946338 container start f1561ea56c56b71b32e1c2d332d8cf219e9f69e7d93d2c26125a7cbe5bc09dce (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc) 2024-02-07T12:30:19.575 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:19 smithi047 podman[107283]: 2024-02-07 12:30:19.403675196 +0000 UTC m=+0.489227341 container attach f1561ea56c56b71b32e1c2d332d8cf219e9f69e7d93d2c26125a7cbe5bc09dce (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-02-07T12:30:19.976 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:19 smithi047 podman[107283]: 2024-02-07 12:30:19.618448019 +0000 UTC m=+0.704000147 container died f1561ea56c56b71b32e1c2d332d8cf219e9f69e7d93d2c26125a7cbe5bc09dce (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:30:19.976 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:19 smithi047 ceph-mon[93224]: failed to encode map e56 with expected crc 2024-02-07T12:30:19.976 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:19 smithi047 ceph-mon[93224]: failed to encode map e57 with expected crc 2024-02-07T12:30:19.976 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:19 smithi047 ceph-mon[93224]: osdmap e57: 6 total, 5 up, 6 in 2024-02-07T12:30:19.977 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:19 smithi047 ceph-mon[93224]: failed to encode map e57 with expected crc 2024-02-07T12:30:19.977 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:19 smithi047 ceph-mon[93224]: failed to encode map e57 with expected crc 2024-02-07T12:30:19.977 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:19 smithi047 ceph-mon[93224]: failed to encode map e57 with expected crc 2024-02-07T12:30:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:19 smithi138 ceph-mon[82055]: failed to encode map e56 with expected crc 2024-02-07T12:30:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:19 smithi138 ceph-mon[82055]: failed to encode map e57 with expected crc 2024-02-07T12:30:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:19 smithi138 ceph-mon[82055]: osdmap e57: 6 total, 5 up, 6 in 2024-02-07T12:30:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:19 smithi138 ceph-mon[82055]: failed to encode map e57 with expected crc 2024-02-07T12:30:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:19 smithi138 ceph-mon[82055]: failed to encode map e57 with expected crc 2024-02-07T12:30:20.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:19 smithi138 ceph-mon[82055]: failed to encode map e57 with expected crc 2024-02-07T12:30:20.575 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:20 smithi047 podman[107309]: 2024-02-07 12:30:20.291173797 +0000 UTC m=+0.666716611 container remove f1561ea56c56b71b32e1c2d332d8cf219e9f69e7d93d2c26125a7cbe5bc09dce (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:30:20.575 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:20 smithi047 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.1.service: Deactivated successfully. 2024-02-07T12:30:20.575 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:20 smithi047 systemd[1]: Stopped Ceph osd.1 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:30:20.576 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:20 smithi047 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.1.service: Consumed 59.535s CPU time. 2024-02-07T12:30:20.929 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:20 smithi047 ceph-mon[93224]: failed to encode map e57 with expected crc 2024-02-07T12:30:20.930 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:20 smithi047 ceph-mon[93224]: pgmap v67: 65 pgs: 12 stale+active+clean, 53 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-07T12:30:20.930 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:20 smithi047 systemd[1]: Starting Ceph osd.1 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:30:20.930 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:20 smithi047 podman[107412]: 2024-02-07 12:30:20.800600644 +0000 UTC m=+0.102141036 container create 341638a42ec4d54fc16602da54640344f5054182dbf94f0b868934fb16736e03 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-activate, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, ceph=True) 2024-02-07T12:30:20.930 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:20 smithi047 podman[107412]: 2024-02-07 12:30:20.716483085 +0000 UTC m=+0.018023440 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:30:21.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:20 smithi138 ceph-mon[82055]: failed to encode map e57 with expected crc 2024-02-07T12:30:21.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:20 smithi138 ceph-mon[82055]: pgmap v67: 65 pgs: 12 stale+active+clean, 53 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-07T12:30:21.325 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 podman[107412]: 2024-02-07 12:30:21.061773853 +0000 UTC m=+0.363314221 container init 341638a42ec4d54fc16602da54640344f5054182dbf94f0b868934fb16736e03 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-activate, org.label-schema.build-date=20240131, GIT_CLEAN=True, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-07T12:30:21.326 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 podman[107412]: 2024-02-07 12:30:21.065139453 +0000 UTC m=+0.366679813 container start 341638a42ec4d54fc16602da54640344f5054182dbf94f0b868934fb16736e03 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-activate, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-07T12:30:21.326 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 podman[107412]: 2024-02-07 12:30:21.169658535 +0000 UTC m=+0.471198908 container attach 341638a42ec4d54fc16602da54640344f5054182dbf94f0b868934fb16736e03 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , ceph=True) 2024-02-07T12:30:21.826 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-activate[107427]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-07T12:30:21.826 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-activate[107427]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-07T12:30:21.826 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 bash[107412]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-07T12:30:21.826 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 bash[107412]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-07T12:30:21.826 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 bash[107412]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-07T12:30:21.826 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 bash[107412]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-07T12:30:21.826 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 bash[107412]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-07T12:30:21.826 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 bash[107412]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-07T12:30:21.826 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 bash[107412]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-07T12:30:21.826 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-activate[107427]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-07T12:30:21.827 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-activate[107427]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-07T12:30:21.827 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-activate[107427]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-07T12:30:21.827 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-activate[107427]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-07T12:30:21.827 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-activate[107427]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-07T12:30:21.827 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:21 smithi047 podman[107412]: 2024-02-07 12:30:21.5359239 +0000 UTC m=+0.837464241 container died 341638a42ec4d54fc16602da54640344f5054182dbf94f0b868934fb16736e03 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-activate, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-02-07T12:30:22.496 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:22 smithi047 podman[107566]: 2024-02-07 12:30:22.165289182 +0000 UTC m=+0.619702039 container remove 341638a42ec4d54fc16602da54640344f5054182dbf94f0b868934fb16736e03 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc) 2024-02-07T12:30:22.496 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:22 smithi047 podman[107631]: 2024-02-07 12:30:22.382867113 +0000 UTC m=+0.115421031 container create 0f2b0eea74d7e041145a773fa3fd1e6e6058950b56e58fc80efa545c5d7f9aa3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-02-07T12:30:22.496 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:22 smithi047 podman[107631]: 2024-02-07 12:30:22.285934021 +0000 UTC m=+0.018487938 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:30:22.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:22 smithi047 ceph-mon[93224]: pgmap v68: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:30:22.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:22 smithi047 ceph-mon[93224]: Health check failed: Degraded data redundancy: 54/354 objects degraded (15.254%), 16 pgs degraded (PG_DEGRADED) 2024-02-07T12:30:22.825 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:22 smithi047 podman[107631]: 2024-02-07 12:30:22.610194371 +0000 UTC m=+0.342748281 container init 0f2b0eea74d7e041145a773fa3fd1e6e6058950b56e58fc80efa545c5d7f9aa3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:30:22.825 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:22 smithi047 podman[107631]: 2024-02-07 12:30:22.61344291 +0000 UTC m=+0.345996820 container start 0f2b0eea74d7e041145a773fa3fd1e6e6058950b56e58fc80efa545c5d7f9aa3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-02-07T12:30:22.826 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:22 smithi047 ceph-osd[107650]: -- 172.21.15.47:0/3340808753 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555caee416c0 con 0x555caee13000 2024-02-07T12:30:22.826 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:22 smithi047 bash[107631]: 0f2b0eea74d7e041145a773fa3fd1e6e6058950b56e58fc80efa545c5d7f9aa3 2024-02-07T12:30:22.826 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:22 smithi047 systemd[1]: Started Ceph osd.1 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:30:23.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:22 smithi138 ceph-mon[82055]: pgmap v68: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:30:23.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:22 smithi138 ceph-mon[82055]: Health check failed: Degraded data redundancy: 54/354 objects degraded (15.254%), 16 pgs degraded (PG_DEGRADED) 2024-02-07T12:30:23.575 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:23 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1[107646]: 2024-02-07T12:30:23.156+0000 7f4ef39ba7c0 -1 Falling back to public interface 2024-02-07T12:30:23.865 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:23 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:23.866 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:23 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:23.866 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:23 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:30:24.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:23 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:24.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:23 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:24.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:23 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:30:25.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:24 smithi138 ceph-mon[82055]: pgmap v69: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:30:25.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:24 smithi047 ceph-mon[93224]: pgmap v69: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:30:26.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:26 smithi047 ceph-mon[93224]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:30:26.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:26.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:30:27.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:26 smithi138 ceph-mon[82055]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:30:27.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:27.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:30:28.075 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:27 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1[107646]: 2024-02-07T12:30:27.666+0000 7f4ef39ba7c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-02-07T12:30:28.575 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:28 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1[107646]: 2024-02-07T12:30:28.210+0000 7f4ef39ba7c0 -1 osd.1 55 log_to_monitors true 2024-02-07T12:30:29.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:28 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:29.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:28 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:29.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:28 smithi138 ceph-mon[82055]: from='osd.1 [v2:172.21.15.47:6810/3632128293,v1:172.21.15.47:6811/3632128293]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-07T12:30:29.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:28 smithi138 ceph-mon[82055]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:30:29.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:28 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:29.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:28 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:29.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:28 smithi047 ceph-mon[93224]: from='osd.1 [v2:172.21.15.47:6810/3632128293,v1:172.21.15.47:6811/3632128293]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-07T12:30:29.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:28 smithi047 ceph-mon[93224]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:30:30.024 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:30:29 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1[107646]: 2024-02-07T12:30:29.883+0000 7f4ee0e11700 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-07T12:30:30.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:30 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:30.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:30 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:30.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:30 smithi138 ceph-mon[82055]: from='osd.1 [v2:172.21.15.47:6810/3632128293,v1:172.21.15.47:6811/3632128293]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-07T12:30:30.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:30 smithi138 ceph-mon[82055]: osdmap e58: 6 total, 5 up, 6 in 2024-02-07T12:30:30.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:30 smithi138 ceph-mon[82055]: from='osd.1 [v2:172.21.15.47:6810/3632128293,v1:172.21.15.47:6811/3632128293]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-02-07T12:30:30.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:30 smithi138 ceph-mon[82055]: from='osd.1 [v2:172.21.15.47:6810/3632128293,v1:172.21.15.47:6811/3632128293]' entity='osd.1' 2024-02-07T12:30:30.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:30 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:30.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:30 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:30.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:30 smithi047 ceph-mon[93224]: from='osd.1 [v2:172.21.15.47:6810/3632128293,v1:172.21.15.47:6811/3632128293]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-07T12:30:30.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:30 smithi047 ceph-mon[93224]: osdmap e58: 6 total, 5 up, 6 in 2024-02-07T12:30:30.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:30 smithi047 ceph-mon[93224]: from='osd.1 [v2:172.21.15.47:6810/3632128293,v1:172.21.15.47:6811/3632128293]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-02-07T12:30:30.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:30 smithi047 ceph-mon[93224]: from='osd.1 [v2:172.21.15.47:6810/3632128293,v1:172.21.15.47:6811/3632128293]' entity='osd.1' 2024-02-07T12:30:31.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:31 smithi138 ceph-mon[82055]: failed to encode map e58 with expected crc 2024-02-07T12:30:31.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:31 smithi138 ceph-mon[82055]: failed to encode map e58 with expected crc 2024-02-07T12:30:31.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:31 smithi138 ceph-mon[82055]: failed to encode map e58 with expected crc 2024-02-07T12:30:31.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:31 smithi138 ceph-mon[82055]: failed to encode map e58 with expected crc 2024-02-07T12:30:31.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:31 smithi138 ceph-mon[82055]: pgmap v73: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:30:31.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:31 smithi138 ceph-mon[82055]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-07T12:30:31.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:31 smithi138 ceph-mon[82055]: osd.1 [v2:172.21.15.47:6810/3632128293,v1:172.21.15.47:6811/3632128293] boot 2024-02-07T12:30:31.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:31 smithi138 ceph-mon[82055]: osdmap e59: 6 total, 6 up, 6 in 2024-02-07T12:30:31.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:31 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:30:31.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:31 smithi047 ceph-mon[93224]: failed to encode map e58 with expected crc 2024-02-07T12:30:31.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:31 smithi047 ceph-mon[93224]: failed to encode map e58 with expected crc 2024-02-07T12:30:31.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:31 smithi047 ceph-mon[93224]: failed to encode map e58 with expected crc 2024-02-07T12:30:31.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:31 smithi047 ceph-mon[93224]: failed to encode map e58 with expected crc 2024-02-07T12:30:31.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:31 smithi047 ceph-mon[93224]: pgmap v73: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:30:31.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:31 smithi047 ceph-mon[93224]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-07T12:30:31.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:31 smithi047 ceph-mon[93224]: osd.1 [v2:172.21.15.47:6810/3632128293,v1:172.21.15.47:6811/3632128293] boot 2024-02-07T12:30:31.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:31 smithi047 ceph-mon[93224]: osdmap e59: 6 total, 6 up, 6 in 2024-02-07T12:30:31.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:31 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-07T12:30:32.242 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:32 smithi047 ceph-mon[93224]: failed to encode map e59 with expected crc 2024-02-07T12:30:32.243 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:32 smithi047 ceph-mon[93224]: osdmap e60: 6 total, 6 up, 6 in 2024-02-07T12:30:32.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:32 smithi138 ceph-mon[82055]: failed to encode map e59 with expected crc 2024-02-07T12:30:32.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:32 smithi138 ceph-mon[82055]: osdmap e60: 6 total, 6 up, 6 in 2024-02-07T12:30:33.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:33.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:33.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:30:33.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:30:33.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:33.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 6 op/s; 23/354 objects degraded (6.497%) 2024-02-07T12:30:33.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:30:33.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:30:33.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:30:33.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:30:33.286 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-07T12:30:33.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: failed to encode map e60 with expected crc 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:30:33.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:33.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 6 op/s; 23/354 objects degraded (6.497%) 2024-02-07T12:30:33.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:30:33.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:30:33.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:30:33.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:30:33.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-07T12:30:34.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:34 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-07T12:30:34.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:34 smithi138 ceph-mon[82055]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-02-07T12:30:34.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:34 smithi138 ceph-mon[82055]: Health check update: Degraded data redundancy: 23/354 objects degraded (6.497%), 7 pgs degraded (PG_DEGRADED) 2024-02-07T12:30:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:34 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-07T12:30:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:34 smithi047 ceph-mon[93224]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-02-07T12:30:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:34 smithi047 ceph-mon[93224]: Health check update: Degraded data redundancy: 23/354 objects degraded (6.497%), 7 pgs degraded (PG_DEGRADED) 2024-02-07T12:30:35.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:35 smithi138 ceph-mon[82055]: pgmap v77: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-07T12:30:35.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:35 smithi047 ceph-mon[93224]: pgmap v77: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-07T12:30:36.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:36 smithi138 ceph-mon[82055]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/354 objects degraded (6.497%), 7 pgs degraded) 2024-02-07T12:30:36.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:36 smithi138 ceph-mon[82055]: Cluster is now healthy 2024-02-07T12:30:36.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:36 smithi047 ceph-mon[93224]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/354 objects degraded (6.497%), 7 pgs degraded) 2024-02-07T12:30:36.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:36 smithi047 ceph-mon[93224]: Cluster is now healthy 2024-02-07T12:30:37.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.039+0000 7f91ba34d700 1 -- 172.21.15.47:0/2677247642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b40fcfb0 msgr2=0x7f91b40fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:37.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.039+0000 7f91ba34d700 1 --2- 172.21.15.47:0/2677247642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b40fcfb0 0x7f91b40fd420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91a8004940 tx=0x7f91a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.039+0000 7f91ba34d700 1 -- 172.21.15.47:0/2677247642 shutdown_connections 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.039+0000 7f91ba34d700 1 --2- 172.21.15.47:0/2677247642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b40fcfb0 0x7f91b40fd420 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.039+0000 7f91ba34d700 1 --2- 172.21.15.47:0/2677247642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91b40fbe40 0x7f91b40fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.039+0000 7f91ba34d700 1 -- 172.21.15.47:0/2677247642 >> 172.21.15.47:0/2677247642 conn(0x7f91b40f74e0 msgr2=0x7f91b40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.039+0000 7f91ba34d700 1 -- 172.21.15.47:0/2677247642 shutdown_connections 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.039+0000 7f91ba34d700 1 -- 172.21.15.47:0/2677247642 wait complete. 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.040+0000 7f91ba34d700 1 Processor -- start 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.040+0000 7f91ba34d700 1 -- start start 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.040+0000 7f91ba34d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b40fbe40 0x7f91b40fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.040+0000 7f91ba34d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91b40fcfb0 0x7f91b40fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.040+0000 7f91ba34d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40fea10 con 0x7f91b40fbe40 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.040+0000 7f91ba34d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40feb80 con 0x7f91b40fcfb0 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.040+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b40fbe40 0x7f91b40fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.040+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b40fbe40 0x7f91b40fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41146/0 (socket says 172.21.15.47:41146) 2024-02-07T12:30:37.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.040+0000 7f91b3fff700 1 -- 172.21.15.47:0/3999660388 learned_addr learned my addr 172.21.15.47:0/3999660388 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:37.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.040+0000 7f91b37fe700 1 --2- 172.21.15.47:0/3999660388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91b40fcfb0 0x7f91b40fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:37.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.041+0000 7f91b3fff700 1 -- 172.21.15.47:0/3999660388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91b40fcfb0 msgr2=0x7f91b40fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:37.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.041+0000 7f91b3fff700 1 --2- 172.21.15.47:0/3999660388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91b40fcfb0 0x7f91b40fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.041+0000 7f91b3fff700 1 -- 172.21.15.47:0/3999660388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8005040 con 0x7f91b40fbe40 2024-02-07T12:30:37.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.041+0000 7f91b3fff700 1 --2- 172.21.15.47:0/3999660388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b40fbe40 0x7f91b40fff00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f91a400b790 tx=0x7f91a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:37.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.041+0000 7f91b0ff9700 1 -- 172.21.15.47:0/3999660388 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91a400f6f0 con 0x7f91b40fbe40 2024-02-07T12:30:37.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.041+0000 7f91ba34d700 1 -- 172.21.15.47:0/3999660388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b40fee60 con 0x7f91b40fbe40 2024-02-07T12:30:37.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.041+0000 7f91b0ff9700 1 -- 172.21.15.47:0/3999660388 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91a400fd20 con 0x7f91b40fbe40 2024-02-07T12:30:37.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.041+0000 7f91b0ff9700 1 -- 172.21.15.47:0/3999660388 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91a40103a0 con 0x7f91b40fbe40 2024-02-07T12:30:37.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.041+0000 7f91ba34d700 1 -- 172.21.15.47:0/3999660388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b40ff1e0 con 0x7f91b40fbe40 2024-02-07T12:30:37.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.042+0000 7f91ba34d700 1 -- 172.21.15.47:0/3999660388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b404bed0 con 0x7f91b40fbe40 2024-02-07T12:30:37.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.043+0000 7f91b0ff9700 1 -- 172.21.15.47:0/3999660388 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f91a4011400 con 0x7f91b40fbe40 2024-02-07T12:30:37.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.043+0000 7f91b0ff9700 1 --2- 172.21.15.47:0/3999660388 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f919c06d7e0 0x7f919c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:37.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.043+0000 7f91b37fe700 1 --2- 172.21.15.47:0/3999660388 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f919c06d7e0 0x7f919c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:37.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.043+0000 7f91b0ff9700 1 -- 172.21.15.47:0/3999660388 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f91a408ccc0 con 0x7f91b40fbe40 2024-02-07T12:30:37.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.044+0000 7f91b37fe700 1 --2- 172.21.15.47:0/3999660388 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f919c06d7e0 0x7f919c06fc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f91a800b3b0 tx=0x7f91a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:37.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.048+0000 7f91b0ff9700 1 -- 172.21.15.47:0/3999660388 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f91a405a0c0 con 0x7f91b40fbe40 2024-02-07T12:30:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.270+0000 7f91ba34d700 1 -- 172.21.15.47:0/3999660388 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91b4065dd0 con 0x7f919c06d7e0 2024-02-07T12:30:37.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.271+0000 7f91b0ff9700 1 -- 172.21.15.47:0/3999660388 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f91b4065dd0 con 0x7f919c06d7e0 2024-02-07T12:30:37.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.273+0000 7f91ba34d700 1 -- 172.21.15.47:0/3999660388 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f919c06d7e0 msgr2=0x7f919c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:37.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.273+0000 7f91ba34d700 1 --2- 172.21.15.47:0/3999660388 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f919c06d7e0 0x7f919c06fc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f91a800b3b0 tx=0x7f91a8009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:37.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.273+0000 7f91ba34d700 1 -- 172.21.15.47:0/3999660388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b40fbe40 msgr2=0x7f91b40fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:37.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.273+0000 7f91ba34d700 1 --2- 172.21.15.47:0/3999660388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b40fbe40 0x7f91b40fff00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f91a400b790 tx=0x7f91a4009250 comp rx=0 tx=0).stop 2024-02-07T12:30:37.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.273+0000 7f91ba34d700 1 -- 172.21.15.47:0/3999660388 shutdown_connections 2024-02-07T12:30:37.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.273+0000 7f91ba34d700 1 --2- 172.21.15.47:0/3999660388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b40fbe40 0x7f91b40fff00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.273+0000 7f91ba34d700 1 --2- 172.21.15.47:0/3999660388 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f919c06d7e0 0x7f919c06fc90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.273+0000 7f91ba34d700 1 --2- 172.21.15.47:0/3999660388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91b40fcfb0 0x7f91b40fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.273+0000 7f91ba34d700 1 -- 172.21.15.47:0/3999660388 >> 172.21.15.47:0/3999660388 conn(0x7f91b40f74e0 msgr2=0x7f91b40656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:37.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.273+0000 7f91ba34d700 1 -- 172.21.15.47:0/3999660388 shutdown_connections 2024-02-07T12:30:37.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.273+0000 7f91ba34d700 1 -- 172.21.15.47:0/3999660388 wait complete. 2024-02-07T12:30:37.286 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:30:37.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:37 smithi047 ceph-mon[93224]: pgmap v78: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-02-07T12:30:37.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.376+0000 7f8b86f6c700 1 -- 172.21.15.47:0/3327617364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b800fbe40 msgr2=0x7f8b800fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:37.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.376+0000 7f8b86f6c700 1 --2- 172.21.15.47:0/3327617364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b800fbe40 0x7f8b800fc250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b74004940 tx=0x7f8b74009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:37.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.376+0000 7f8b86f6c700 1 -- 172.21.15.47:0/3327617364 shutdown_connections 2024-02-07T12:30:37.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.376+0000 7f8b86f6c700 1 --2- 172.21.15.47:0/3327617364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b800fcfb0 0x7f8b800fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.376+0000 7f8b86f6c700 1 --2- 172.21.15.47:0/3327617364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b800fbe40 0x7f8b800fc250 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.376+0000 7f8b86f6c700 1 -- 172.21.15.47:0/3327617364 >> 172.21.15.47:0/3327617364 conn(0x7f8b800f7520 msgr2=0x7f8b800f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.376+0000 7f8b86f6c700 1 -- 172.21.15.47:0/3327617364 shutdown_connections 2024-02-07T12:30:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.376+0000 7f8b86f6c700 1 -- 172.21.15.47:0/3327617364 wait complete. 2024-02-07T12:30:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.377+0000 7f8b86f6c700 1 Processor -- start 2024-02-07T12:30:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.377+0000 7f8b86f6c700 1 -- start start 2024-02-07T12:30:37.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.377+0000 7f8b86f6c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b800fbe40 0x7f8b80110650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:37.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.377+0000 7f8b86f6c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b800fcfb0 0x7f8b80112ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.377+0000 7f8b86f6c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b80066cf0 con 0x7f8b800fcfb0 2024-02-07T12:30:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.377+0000 7f8b86f6c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b80066e30 con 0x7f8b800fbe40 2024-02-07T12:30:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.378+0000 7f8b7ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b800fcfb0 0x7f8b80112ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.378+0000 7f8b7ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b800fcfb0 0x7f8b80112ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41162/0 (socket says 172.21.15.47:41162) 2024-02-07T12:30:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.378+0000 7f8b7ffff700 1 -- 172.21.15.47:0/2577390979 learned_addr learned my addr 172.21.15.47:0/2577390979 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.378+0000 7f8b84d08700 1 --2- 172.21.15.47:0/2577390979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b800fbe40 0x7f8b80110650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.378+0000 7f8b7ffff700 1 -- 172.21.15.47:0/2577390979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b800fbe40 msgr2=0x7f8b80110650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.378+0000 7f8b7ffff700 1 --2- 172.21.15.47:0/2577390979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b800fbe40 0x7f8b80110650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.378+0000 7f8b7ffff700 1 -- 172.21.15.47:0/2577390979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b74005040 con 0x7f8b800fcfb0 2024-02-07T12:30:37.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.378+0000 7f8b7ffff700 1 --2- 172.21.15.47:0/2577390979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b800fcfb0 0x7f8b80112ba0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00c830 tx=0x7f8b6c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:37.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.378+0000 7f8b7d7fa700 1 -- 172.21.15.47:0/2577390979 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b6c0106f0 con 0x7f8b800fcfb0 2024-02-07T12:30:37.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.378+0000 7f8b7d7fa700 1 -- 172.21.15.47:0/2577390979 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b6c010d20 con 0x7f8b800fcfb0 2024-02-07T12:30:37.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.378+0000 7f8b86f6c700 1 -- 172.21.15.47:0/2577390979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b801131a0 con 0x7f8b800fcfb0 2024-02-07T12:30:37.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.378+0000 7f8b7d7fa700 1 -- 172.21.15.47:0/2577390979 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b6c0113a0 con 0x7f8b800fcfb0 2024-02-07T12:30:37.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.378+0000 7f8b86f6c700 1 -- 172.21.15.47:0/2577390979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b801136e0 con 0x7f8b800fcfb0 2024-02-07T12:30:37.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.379+0000 7f8b86f6c700 1 -- 172.21.15.47:0/2577390979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8004bed0 con 0x7f8b800fcfb0 2024-02-07T12:30:37.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.380+0000 7f8b7d7fa700 1 -- 172.21.15.47:0/2577390979 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8b6c012400 con 0x7f8b800fcfb0 2024-02-07T12:30:37.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.380+0000 7f8b7d7fa700 1 --2- 172.21.15.47:0/2577390979 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8b7006d7e0 0x7f8b7006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:37.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.380+0000 7f8b7d7fa700 1 -- 172.21.15.47:0/2577390979 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8b6c08ce70 con 0x7f8b800fcfb0 2024-02-07T12:30:37.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.380+0000 7f8b84d08700 1 --2- 172.21.15.47:0/2577390979 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8b7006d7e0 0x7f8b7006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:37.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.381+0000 7f8b84d08700 1 --2- 172.21.15.47:0/2577390979 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8b7006d7e0 0x7f8b7006fc90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8b74004890 tx=0x7f8b74009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:37.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.385+0000 7f8b7d7fa700 1 -- 172.21.15.47:0/2577390979 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8b6c056740 con 0x7f8b800fcfb0 2024-02-07T12:30:37.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:37 smithi138 ceph-mon[82055]: pgmap v78: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-02-07T12:30:37.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.605+0000 7f8b86f6c700 1 -- 172.21.15.47:0/2577390979 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b80101990 con 0x7f8b7006d7e0 2024-02-07T12:30:37.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.606+0000 7f8b7d7fa700 1 -- 172.21.15.47:0/2577390979 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8b80101990 con 0x7f8b7006d7e0 2024-02-07T12:30:37.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.608+0000 7f8b86f6c700 1 -- 172.21.15.47:0/2577390979 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8b7006d7e0 msgr2=0x7f8b7006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:37.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.608+0000 7f8b86f6c700 1 --2- 172.21.15.47:0/2577390979 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8b7006d7e0 0x7f8b7006fc90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8b74004890 tx=0x7f8b74009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:37.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.608+0000 7f8b86f6c700 1 -- 172.21.15.47:0/2577390979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b800fcfb0 msgr2=0x7f8b80112ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:37.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.608+0000 7f8b86f6c700 1 --2- 172.21.15.47:0/2577390979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b800fcfb0 0x7f8b80112ba0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00c830 tx=0x7f8b6c004470 comp rx=0 tx=0).stop 2024-02-07T12:30:37.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.609+0000 7f8b86f6c700 1 -- 172.21.15.47:0/2577390979 shutdown_connections 2024-02-07T12:30:37.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.609+0000 7f8b86f6c700 1 --2- 172.21.15.47:0/2577390979 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8b7006d7e0 0x7f8b7006fc90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.609+0000 7f8b86f6c700 1 --2- 172.21.15.47:0/2577390979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b800fbe40 0x7f8b80110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.609+0000 7f8b86f6c700 1 --2- 172.21.15.47:0/2577390979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b800fcfb0 0x7f8b80112ba0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.609+0000 7f8b86f6c700 1 -- 172.21.15.47:0/2577390979 >> 172.21.15.47:0/2577390979 conn(0x7f8b800f7520 msgr2=0x7f8b80100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:37.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.609+0000 7f8b86f6c700 1 -- 172.21.15.47:0/2577390979 shutdown_connections 2024-02-07T12:30:37.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.609+0000 7f8b86f6c700 1 -- 172.21.15.47:0/2577390979 wait complete. 2024-02-07T12:30:37.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.713+0000 7f6dee41a700 1 -- 172.21.15.47:0/3169455041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6de80fcfb0 msgr2=0x7f6de80fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:37.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.713+0000 7f6dee41a700 1 --2- 172.21.15.47:0/3169455041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6de80fcfb0 0x7f6de80fd420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8004940 tx=0x7f6dd8009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:37.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.713+0000 7f6dee41a700 1 -- 172.21.15.47:0/3169455041 shutdown_connections 2024-02-07T12:30:37.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.713+0000 7f6dee41a700 1 --2- 172.21.15.47:0/3169455041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6de80fcfb0 0x7f6de80fd420 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.713+0000 7f6dee41a700 1 --2- 172.21.15.47:0/3169455041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6de80fbe40 0x7f6de80fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.713+0000 7f6dee41a700 1 -- 172.21.15.47:0/3169455041 >> 172.21.15.47:0/3169455041 conn(0x7f6de80f7500 msgr2=0x7f6de80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:37.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.713+0000 7f6dee41a700 1 -- 172.21.15.47:0/3169455041 shutdown_connections 2024-02-07T12:30:37.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.713+0000 7f6dee41a700 1 -- 172.21.15.47:0/3169455041 wait complete. 2024-02-07T12:30:37.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.714+0000 7f6dee41a700 1 Processor -- start 2024-02-07T12:30:37.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.714+0000 7f6dee41a700 1 -- start start 2024-02-07T12:30:37.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.714+0000 7f6dee41a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6de80fbe40 0x7f6de8110660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:37.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.714+0000 7f6dee41a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6de80fcfb0 0x7f6de8112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:37.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.714+0000 7f6dee41a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8066cf0 con 0x7f6de80fcfb0 2024-02-07T12:30:37.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.714+0000 7f6dee41a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8066e30 con 0x7f6de80fbe40 2024-02-07T12:30:37.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.714+0000 7f6de77fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6de80fcfb0 0x7f6de8112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:37.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.714+0000 7f6de77fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6de80fcfb0 0x7f6de8112bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41178/0 (socket says 172.21.15.47:41178) 2024-02-07T12:30:37.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.714+0000 7f6de77fe700 1 -- 172.21.15.47:0/2894361491 learned_addr learned my addr 172.21.15.47:0/2894361491 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:37.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.714+0000 7f6de7fff700 1 --2- 172.21.15.47:0/2894361491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6de80fbe40 0x7f6de8110660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:37.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.715+0000 7f6de77fe700 1 -- 172.21.15.47:0/2894361491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6de80fbe40 msgr2=0x7f6de8110660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:37.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.715+0000 7f6de77fe700 1 --2- 172.21.15.47:0/2894361491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6de80fbe40 0x7f6de8110660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.715+0000 7f6de77fe700 1 -- 172.21.15.47:0/2894361491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd8005040 con 0x7f6de80fcfb0 2024-02-07T12:30:37.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.715+0000 7f6de77fe700 1 --2- 172.21.15.47:0/2894361491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6de80fcfb0 0x7f6de8112bb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80093b0 tx=0x7f6dd8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:37.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.715+0000 7f6de4ff9700 1 -- 172.21.15.47:0/2894361491 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dd800e040 con 0x7f6de80fcfb0 2024-02-07T12:30:37.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.715+0000 7f6de4ff9700 1 -- 172.21.15.47:0/2894361491 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6dd800bcc0 con 0x7f6de80fcfb0 2024-02-07T12:30:37.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.715+0000 7f6dee41a700 1 -- 172.21.15.47:0/2894361491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de81131b0 con 0x7f6de80fcfb0 2024-02-07T12:30:37.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.715+0000 7f6de4ff9700 1 -- 172.21.15.47:0/2894361491 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dd801c630 con 0x7f6de80fcfb0 2024-02-07T12:30:37.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.715+0000 7f6dee41a700 1 -- 172.21.15.47:0/2894361491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de81136f0 con 0x7f6de80fcfb0 2024-02-07T12:30:37.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.716+0000 7f6dee41a700 1 -- 172.21.15.47:0/2894361491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de804bed0 con 0x7f6de80fcfb0 2024-02-07T12:30:37.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.717+0000 7f6de4ff9700 1 -- 172.21.15.47:0/2894361491 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6dd8013980 con 0x7f6de80fcfb0 2024-02-07T12:30:37.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.717+0000 7f6de4ff9700 1 --2- 172.21.15.47:0/2894361491 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6dd006d7e0 0x7f6dd006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:37.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.717+0000 7f6de4ff9700 1 -- 172.21.15.47:0/2894361491 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6dd808e2c0 con 0x7f6de80fcfb0 2024-02-07T12:30:37.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.717+0000 7f6de7fff700 1 --2- 172.21.15.47:0/2894361491 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6dd006d7e0 0x7f6dd006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:37.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.718+0000 7f6de7fff700 1 --2- 172.21.15.47:0/2894361491 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6dd006d7e0 0x7f6dd006fc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0041d0 tx=0x7f6ddc0043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:37.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.722+0000 7f6de4ff9700 1 -- 172.21.15.47:0/2894361491 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6dd8057b30 con 0x7f6de80fcfb0 2024-02-07T12:30:37.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.935+0000 7f6dee41a700 1 -- 172.21.15.47:0/2894361491 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6de8101990 con 0x7f6dd006d7e0 2024-02-07T12:30:37.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.945+0000 7f6de4ff9700 1 -- 172.21.15.47:0/2894361491 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f6de8101990 con 0x7f6dd006d7e0 2024-02-07T12:30:37.949 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:30:37.949 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (4m) 10s ago 13m 26.6M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:30:37.949 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (77s) 10s ago 13m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:30:37.949 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (72s) 68s ago 12m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:30:37.949 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (3m) 10s ago 12m 78.3M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:30:37.950 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (7m) 10s ago 7m 111M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:30:37.950 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (7m) 10s ago 7m 129M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:30:37.950 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (7m) 68s ago 7m 68.6M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:30:37.950 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (7m) 68s ago 7m 69.6M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:30:37.950 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (3m) 10s ago 14m 501M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:30:37.950 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (2m) 68s ago 12m 450M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:30:37.950 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (2m) 10s ago 14m 46.3M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:30:37.950 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (117s) 68s ago 12m 32.9M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:30:37.950 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (4m) 10s ago 13m 15.2M - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:30:37.950 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (3m) 68s ago 12m 15.3M - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:30:37.950 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (51s) 10s ago 11m 86.6M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:30:37.950 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (15s) 10s ago 10m 12.5M 1559M 19.0.0-1252-g44458cce 79957b372307 0f2b0eea74d7 2024-02-07T12:30:37.951 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (10m) 10s ago 10m 180M 1559M 17.2.7-491-gf2462625 4ad3622d1b31 80e323c37d17 2024-02-07T12:30:37.951 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (10m) 68s ago 10m 264M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:30:37.951 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (9m) 68s ago 9m 234M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:30:37.951 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (9m) 68s ago 9m 218M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:30:37.951 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (2m) 10s ago 12m 51.4M - 2.43.0 a07b618ecd1d 32840d82c54b 2024-02-07T12:30:37.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.947+0000 7f6dee41a700 1 -- 172.21.15.47:0/2894361491 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6dd006d7e0 msgr2=0x7f6dd006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:37.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.947+0000 7f6dee41a700 1 --2- 172.21.15.47:0/2894361491 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6dd006d7e0 0x7f6dd006fc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0041d0 tx=0x7f6ddc0043c0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.948+0000 7f6dee41a700 1 -- 172.21.15.47:0/2894361491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6de80fcfb0 msgr2=0x7f6de8112bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:37.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.948+0000 7f6dee41a700 1 --2- 172.21.15.47:0/2894361491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6de80fcfb0 0x7f6de8112bb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80093b0 tx=0x7f6dd8009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:37.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.948+0000 7f6dee41a700 1 -- 172.21.15.47:0/2894361491 shutdown_connections 2024-02-07T12:30:37.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.948+0000 7f6dee41a700 1 --2- 172.21.15.47:0/2894361491 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6dd006d7e0 0x7f6dd006fc90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.948+0000 7f6dee41a700 1 --2- 172.21.15.47:0/2894361491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6de80fbe40 0x7f6de8110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.948+0000 7f6dee41a700 1 --2- 172.21.15.47:0/2894361491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6de80fcfb0 0x7f6de8112bb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:37.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.948+0000 7f6dee41a700 1 -- 172.21.15.47:0/2894361491 >> 172.21.15.47:0/2894361491 conn(0x7f6de80f7500 msgr2=0x7f6de8100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:37.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.948+0000 7f6dee41a700 1 -- 172.21.15.47:0/2894361491 shutdown_connections 2024-02-07T12:30:37.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:37.948+0000 7f6dee41a700 1 -- 172.21.15.47:0/2894361491 wait complete. 2024-02-07T12:30:38.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.049+0000 7f6d55c30700 1 -- 172.21.15.47:0/3439807695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d500fcfb0 msgr2=0x7f6d500fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:38.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.049+0000 7f6d55c30700 1 --2- 172.21.15.47:0/3439807695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d500fcfb0 0x7f6d500fd420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d44004940 tx=0x7f6d44009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:38.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.049+0000 7f6d55c30700 1 -- 172.21.15.47:0/3439807695 shutdown_connections 2024-02-07T12:30:38.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.049+0000 7f6d55c30700 1 --2- 172.21.15.47:0/3439807695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d500fcfb0 0x7f6d500fd420 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.049+0000 7f6d55c30700 1 --2- 172.21.15.47:0/3439807695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500fbe40 0x7f6d500fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.049+0000 7f6d55c30700 1 -- 172.21.15.47:0/3439807695 >> 172.21.15.47:0/3439807695 conn(0x7f6d500f74e0 msgr2=0x7f6d500f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:38.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.049+0000 7f6d55c30700 1 -- 172.21.15.47:0/3439807695 shutdown_connections 2024-02-07T12:30:38.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.049+0000 7f6d55c30700 1 -- 172.21.15.47:0/3439807695 wait complete. 2024-02-07T12:30:38.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.049+0000 7f6d55c30700 1 Processor -- start 2024-02-07T12:30:38.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.050+0000 7f6d55c30700 1 -- start start 2024-02-07T12:30:38.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.050+0000 7f6d55c30700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500fbe40 0x7f6d5010d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:38.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.050+0000 7f6d55c30700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d500fcfb0 0x7f6d5010dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:38.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.050+0000 7f6d55c30700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5010e4a0 con 0x7f6d500fcfb0 2024-02-07T12:30:38.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.050+0000 7f6d55c30700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5010ed40 con 0x7f6d500fbe40 2024-02-07T12:30:38.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.050+0000 7f6d4effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d500fcfb0 0x7f6d5010dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:38.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.050+0000 7f6d4effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d500fcfb0 0x7f6d5010dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41194/0 (socket says 172.21.15.47:41194) 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.050+0000 7f6d4f7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500fbe40 0x7f6d5010d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.050+0000 7f6d4effd700 1 -- 172.21.15.47:0/3392475342 learned_addr learned my addr 172.21.15.47:0/3392475342 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.051+0000 7f6d4effd700 1 -- 172.21.15.47:0/3392475342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500fbe40 msgr2=0x7f6d5010d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.051+0000 7f6d4effd700 1 --2- 172.21.15.47:0/3392475342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500fbe40 0x7f6d5010d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.051+0000 7f6d4effd700 1 -- 172.21.15.47:0/3392475342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44005040 con 0x7f6d500fcfb0 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.051+0000 7f6d4f7fe700 1 --2- 172.21.15.47:0/3392475342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500fbe40 0x7f6d5010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.051+0000 7f6d4effd700 1 --2- 172.21.15.47:0/3392475342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d500fcfb0 0x7f6d5010dea0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6d440093b0 tx=0x7f6d44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.051+0000 7f6d37fff700 1 -- 172.21.15.47:0/3392475342 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d4400e040 con 0x7f6d500fcfb0 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.051+0000 7f6d55c30700 1 -- 172.21.15.47:0/3392475342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5010efc0 con 0x7f6d500fcfb0 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.051+0000 7f6d37fff700 1 -- 172.21.15.47:0/3392475342 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d4400bcc0 con 0x7f6d500fcfb0 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.051+0000 7f6d37fff700 1 -- 172.21.15.47:0/3392475342 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d4401c630 con 0x7f6d500fcfb0 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.051+0000 7f6d55c30700 1 -- 172.21.15.47:0/3392475342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5010f500 con 0x7f6d500fcfb0 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.052+0000 7f6d55c30700 1 -- 172.21.15.47:0/3392475342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5004bed0 con 0x7f6d500fcfb0 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.053+0000 7f6d37fff700 1 -- 172.21.15.47:0/3392475342 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6d44013980 con 0x7f6d500fcfb0 2024-02-07T12:30:38.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.053+0000 7f6d37fff700 1 --2- 172.21.15.47:0/3392475342 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6d3806d7e0 0x7f6d3806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:38.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.053+0000 7f6d37fff700 1 -- 172.21.15.47:0/3392475342 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6d4408e330 con 0x7f6d500fcfb0 2024-02-07T12:30:38.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.053+0000 7f6d4f7fe700 1 --2- 172.21.15.47:0/3392475342 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6d3806d7e0 0x7f6d3806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:38.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.054+0000 7f6d4f7fe700 1 --2- 172.21.15.47:0/3392475342 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6d3806d7e0 0x7f6d3806fc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d40010520 tx=0x7f6d4000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:38.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.058+0000 7f6d37fff700 1 -- 172.21.15.47:0/3392475342 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6d4405b690 con 0x7f6d500fcfb0 2024-02-07T12:30:38.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:38 smithi047 ceph-mon[93224]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:38.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:38 smithi047 ceph-mon[93224]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:38.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.353+0000 7f6d55c30700 1 -- 172.21.15.47:0/3392475342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6d50104930 con 0x7f6d500fcfb0 2024-02-07T12:30:38.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.354+0000 7f6d37fff700 1 -- 172.21.15.47:0/3392475342 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f6d4405b220 con 0x7f6d500fcfb0 2024-02-07T12:30:38.357 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:30:38.357 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:30:38.357 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:30:38.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:30:38.357 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:30:38.357 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:30:38.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:30:38.358 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:30:38.358 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4, 2024-02-07T12:30:38.358 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:30:38.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:30:38.358 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:30:38.358 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:30:38.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:30:38.358 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:30:38.358 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 8, 2024-02-07T12:30:38.358 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 6 2024-02-07T12:30:38.358 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:30:38.358 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:30:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.356+0000 7f6d55c30700 1 -- 172.21.15.47:0/3392475342 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6d3806d7e0 msgr2=0x7f6d3806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.356+0000 7f6d55c30700 1 --2- 172.21.15.47:0/3392475342 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6d3806d7e0 0x7f6d3806fc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d40010520 tx=0x7f6d4000b040 comp rx=0 tx=0).stop 2024-02-07T12:30:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.356+0000 7f6d55c30700 1 -- 172.21.15.47:0/3392475342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d500fcfb0 msgr2=0x7f6d5010dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.356+0000 7f6d55c30700 1 --2- 172.21.15.47:0/3392475342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d500fcfb0 0x7f6d5010dea0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6d440093b0 tx=0x7f6d44009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.356+0000 7f6d55c30700 1 -- 172.21.15.47:0/3392475342 shutdown_connections 2024-02-07T12:30:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.356+0000 7f6d55c30700 1 --2- 172.21.15.47:0/3392475342 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6d3806d7e0 0x7f6d3806fc90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.356+0000 7f6d55c30700 1 --2- 172.21.15.47:0/3392475342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500fbe40 0x7f6d5010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.356+0000 7f6d55c30700 1 --2- 172.21.15.47:0/3392475342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d500fcfb0 0x7f6d5010dea0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.356+0000 7f6d55c30700 1 -- 172.21.15.47:0/3392475342 >> 172.21.15.47:0/3392475342 conn(0x7f6d500f74e0 msgr2=0x7f6d500656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:38.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.357+0000 7f6d55c30700 1 -- 172.21.15.47:0/3392475342 shutdown_connections 2024-02-07T12:30:38.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.357+0000 7f6d55c30700 1 -- 172.21.15.47:0/3392475342 wait complete. 2024-02-07T12:30:38.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.459+0000 7f9668714700 1 -- 172.21.15.47:0/670684441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96601000d0 msgr2=0x7f9660102530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:38.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.459+0000 7f9668714700 1 --2- 172.21.15.47:0/670684441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96601000d0 0x7f9660102530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f965c004940 tx=0x7f965c009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.459+0000 7f9668714700 1 -- 172.21.15.47:0/670684441 shutdown_connections 2024-02-07T12:30:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.459+0000 7f9668714700 1 --2- 172.21.15.47:0/670684441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96601000d0 0x7f9660102530 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.459+0000 7f9668714700 1 --2- 172.21.15.47:0/670684441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9660066c70 0x7f96600ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.459+0000 7f9668714700 1 -- 172.21.15.47:0/670684441 >> 172.21.15.47:0/670684441 conn(0x7f96600f7510 msgr2=0x7f96600f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.459+0000 7f9668714700 1 -- 172.21.15.47:0/670684441 shutdown_connections 2024-02-07T12:30:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.459+0000 7f9668714700 1 -- 172.21.15.47:0/670684441 wait complete. 2024-02-07T12:30:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.459+0000 7f9668714700 1 Processor -- start 2024-02-07T12:30:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.459+0000 7f9668714700 1 -- start start 2024-02-07T12:30:38.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9668714700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9660066c70 0x7f966010d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:38.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9668714700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96601000d0 0x7f966010dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:38.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9668714700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966010e570 con 0x7f96601000d0 2024-02-07T12:30:38.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9668714700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966010edb0 con 0x7f9660066c70 2024-02-07T12:30:38.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9665caf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96601000d0 0x7f966010dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:38.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9665caf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96601000d0 0x7f966010dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41214/0 (socket says 172.21.15.47:41214) 2024-02-07T12:30:38.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9665caf700 1 -- 172.21.15.47:0/1238985391 learned_addr learned my addr 172.21.15.47:0/1238985391 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:38.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f96664b0700 1 --2- 172.21.15.47:0/1238985391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9660066c70 0x7f966010d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:38.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9665caf700 1 -- 172.21.15.47:0/1238985391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9660066c70 msgr2=0x7f966010d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:38.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9665caf700 1 --2- 172.21.15.47:0/1238985391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9660066c70 0x7f966010d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9665caf700 1 -- 172.21.15.47:0/1238985391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c005040 con 0x7f96601000d0 2024-02-07T12:30:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f96664b0700 1 --2- 172.21.15.47:0/1238985391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9660066c70 0x7f966010d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:30:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9665caf700 1 --2- 172.21.15.47:0/1238985391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96601000d0 0x7f966010dee0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f965c009380 tx=0x7f965c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9652ffd700 1 -- 172.21.15.47:0/1238985391 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f965c00e040 con 0x7f96601000d0 2024-02-07T12:30:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9652ffd700 1 -- 172.21.15.47:0/1238985391 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f965c00bcc0 con 0x7f96601000d0 2024-02-07T12:30:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9668714700 1 -- 172.21.15.47:0/1238985391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966010f030 con 0x7f96601000d0 2024-02-07T12:30:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9652ffd700 1 -- 172.21.15.47:0/1238985391 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f965c01c630 con 0x7f96601000d0 2024-02-07T12:30:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.460+0000 7f9668714700 1 -- 172.21.15.47:0/1238985391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966010f570 con 0x7f96601000d0 2024-02-07T12:30:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.461+0000 7f9668714700 1 -- 172.21.15.47:0/1238985391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966004bed0 con 0x7f96601000d0 2024-02-07T12:30:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.462+0000 7f9652ffd700 1 -- 172.21.15.47:0/1238985391 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f965c013a60 con 0x7f96601000d0 2024-02-07T12:30:38.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.462+0000 7f9652ffd700 1 --2- 172.21.15.47:0/1238985391 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f964c06d7e0 0x7f964c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:38.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.462+0000 7f9652ffd700 1 -- 172.21.15.47:0/1238985391 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f965c08e240 con 0x7f96601000d0 2024-02-07T12:30:38.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.462+0000 7f96664b0700 1 --2- 172.21.15.47:0/1238985391 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f964c06d7e0 0x7f964c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:38.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.463+0000 7f96664b0700 1 --2- 172.21.15.47:0/1238985391 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f964c06d7e0 0x7f964c06fc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9654006fd0 tx=0x7f9654008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.467+0000 7f9652ffd700 1 -- 172.21.15.47:0/1238985391 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f965c05b6e0 con 0x7f96601000d0 2024-02-07T12:30:38.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:38 smithi138 ceph-mon[82055]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:38.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:38 smithi138 ceph-mon[82055]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:38.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.719+0000 7f9668714700 1 -- 172.21.15.47:0/1238985391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f966010fa80 con 0x7f96601000d0 2024-02-07T12:30:38.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.719+0000 7f9652ffd700 1 -- 172.21.15.47:0/1238985391 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1872 (secure 0 0 0) 0x7f965c05b270 con 0x7f96601000d0 2024-02-07T12:30:38.723 INFO:teuthology.orchestra.run.smithi047.stdout:e22 2024-02-07T12:30:38.723 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:30:38.723 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:30:38.723 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:30:38.723 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:30:38.723 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:30:38.723 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:30:38.723 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 22 2024-02-07T12:30:38.723 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:30:38.724 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:30:38.724 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:29:33.611202+0000 2024-02-07T12:30:38.724 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:30:38.724 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:30:38.724 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:30:38.724 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:30:38.724 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:30:38.724 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:30:38.724 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:30:38.724 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:30:38.724 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:30:38.724 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:30:38.724 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:30:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:30:38.726 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:30:38.726 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:30:38.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.722+0000 7f9668714700 1 -- 172.21.15.47:0/1238985391 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f964c06d7e0 msgr2=0x7f964c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:38.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.722+0000 7f9668714700 1 --2- 172.21.15.47:0/1238985391 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f964c06d7e0 0x7f964c06fc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9654006fd0 tx=0x7f9654008040 comp rx=0 tx=0).stop 2024-02-07T12:30:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.722+0000 7f9668714700 1 -- 172.21.15.47:0/1238985391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96601000d0 msgr2=0x7f966010dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.722+0000 7f9668714700 1 --2- 172.21.15.47:0/1238985391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96601000d0 0x7f966010dee0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f965c009380 tx=0x7f965c009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.722+0000 7f9668714700 1 -- 172.21.15.47:0/1238985391 shutdown_connections 2024-02-07T12:30:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.722+0000 7f9668714700 1 --2- 172.21.15.47:0/1238985391 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f964c06d7e0 0x7f964c06fc90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.722+0000 7f9668714700 1 --2- 172.21.15.47:0/1238985391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9660066c70 0x7f966010d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.722+0000 7f9668714700 1 --2- 172.21.15.47:0/1238985391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96601000d0 0x7f966010dee0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.722+0000 7f9668714700 1 -- 172.21.15.47:0/1238985391 >> 172.21.15.47:0/1238985391 conn(0x7f96600f7510 msgr2=0x7f96600f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.722+0000 7f9668714700 1 -- 172.21.15.47:0/1238985391 shutdown_connections 2024-02-07T12:30:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.722+0000 7f9668714700 1 -- 172.21.15.47:0/1238985391 wait complete. 2024-02-07T12:30:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 22 2024-02-07T12:30:38.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.825+0000 7efe7a763700 1 -- 172.21.15.47:0/3254889788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe740fbe80 msgr2=0x7efe740fc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:38.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.825+0000 7efe7a763700 1 --2- 172.21.15.47:0/3254889788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe740fbe80 0x7efe740fc290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe64004940 tx=0x7efe64009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:38.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.825+0000 7efe7a763700 1 -- 172.21.15.47:0/3254889788 shutdown_connections 2024-02-07T12:30:38.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.825+0000 7efe7a763700 1 --2- 172.21.15.47:0/3254889788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe740fd080 0x7efe740fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.825+0000 7efe7a763700 1 --2- 172.21.15.47:0/3254889788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe740fbe80 0x7efe740fc290 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.825+0000 7efe7a763700 1 -- 172.21.15.47:0/3254889788 >> 172.21.15.47:0/3254889788 conn(0x7efe740f7590 msgr2=0x7efe740f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:38.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.825+0000 7efe7a763700 1 -- 172.21.15.47:0/3254889788 shutdown_connections 2024-02-07T12:30:38.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.825+0000 7efe7a763700 1 -- 172.21.15.47:0/3254889788 wait complete. 2024-02-07T12:30:38.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.825+0000 7efe7a763700 1 Processor -- start 2024-02-07T12:30:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.825+0000 7efe7a763700 1 -- start start 2024-02-07T12:30:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe7a763700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe740fbe80 0x7efe74110740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe7a763700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe740fd080 0x7efe74112c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe7a763700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe74066d10 con 0x7efe740fbe80 2024-02-07T12:30:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe7a763700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe74066e50 con 0x7efe740fd080 2024-02-07T12:30:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe73fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe740fbe80 0x7efe74110740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe73fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe740fbe80 0x7efe74110740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41224/0 (socket says 172.21.15.47:41224) 2024-02-07T12:30:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe73fff700 1 -- 172.21.15.47:0/2037193425 learned_addr learned my addr 172.21.15.47:0/2037193425 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe737fe700 1 --2- 172.21.15.47:0/2037193425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe740fd080 0x7efe74112c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe73fff700 1 -- 172.21.15.47:0/2037193425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe740fd080 msgr2=0x7efe74112c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe73fff700 1 --2- 172.21.15.47:0/2037193425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe740fd080 0x7efe74112c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe73fff700 1 -- 172.21.15.47:0/2037193425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe64005040 con 0x7efe740fbe80 2024-02-07T12:30:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe73fff700 1 --2- 172.21.15.47:0/2037193425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe740fbe80 0x7efe74110740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efe6400b3b0 tx=0x7efe64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:38.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe70ff9700 1 -- 172.21.15.47:0/2037193425 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe6400e040 con 0x7efe740fbe80 2024-02-07T12:30:38.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe70ff9700 1 -- 172.21.15.47:0/2037193425 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe6400bcc0 con 0x7efe740fbe80 2024-02-07T12:30:38.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe7a763700 1 -- 172.21.15.47:0/2037193425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe74113290 con 0x7efe740fbe80 2024-02-07T12:30:38.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe70ff9700 1 -- 172.21.15.47:0/2037193425 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe6401c630 con 0x7efe740fbe80 2024-02-07T12:30:38.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.826+0000 7efe7a763700 1 -- 172.21.15.47:0/2037193425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe741137d0 con 0x7efe740fbe80 2024-02-07T12:30:38.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.828+0000 7efe7a763700 1 -- 172.21.15.47:0/2037193425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7404bed0 con 0x7efe740fbe80 2024-02-07T12:30:38.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.828+0000 7efe70ff9700 1 -- 172.21.15.47:0/2037193425 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7efe64013980 con 0x7efe740fbe80 2024-02-07T12:30:38.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.828+0000 7efe70ff9700 1 --2- 172.21.15.47:0/2037193425 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efe5c06d7e0 0x7efe5c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:38.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.829+0000 7efe70ff9700 1 -- 172.21.15.47:0/2037193425 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7efe6408e380 con 0x7efe740fbe80 2024-02-07T12:30:38.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.829+0000 7efe737fe700 1 --2- 172.21.15.47:0/2037193425 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efe5c06d7e0 0x7efe5c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:38.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.829+0000 7efe737fe700 1 --2- 172.21.15.47:0/2037193425 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efe5c06d7e0 0x7efe5c06fc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efe68004f40 tx=0x7efe6800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:38.833+0000 7efe70ff9700 1 -- 172.21.15.47:0/2037193425 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efe64057c50 con 0x7efe740fbe80 2024-02-07T12:30:39.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.056+0000 7efe7a763700 1 -- 172.21.15.47:0/2037193425 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe741019d0 con 0x7efe5c06d7e0 2024-02-07T12:30:39.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.058+0000 7efe70ff9700 1 -- 172.21.15.47:0/2037193425 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7efe741019d0 con 0x7efe5c06d7e0 2024-02-07T12:30:39.061 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:30:39.061 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:30:39.061 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:30:39.061 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:30:39.061 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:30:39.061 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-02-07T12:30:39.061 INFO:teuthology.orchestra.run.smithi047.stdout: "mon", 2024-02-07T12:30:39.061 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr" 2024-02-07T12:30:39.062 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:30:39.062 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "8/21 daemons upgraded", 2024-02-07T12:30:39.062 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading osd daemons", 2024-02-07T12:30:39.062 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:30:39.062 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:30:39.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.060+0000 7efe7a763700 1 -- 172.21.15.47:0/2037193425 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efe5c06d7e0 msgr2=0x7efe5c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:39.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.060+0000 7efe7a763700 1 --2- 172.21.15.47:0/2037193425 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efe5c06d7e0 0x7efe5c06fc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efe68004f40 tx=0x7efe6800b040 comp rx=0 tx=0).stop 2024-02-07T12:30:39.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.060+0000 7efe7a763700 1 -- 172.21.15.47:0/2037193425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe740fbe80 msgr2=0x7efe74110740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:39.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.060+0000 7efe7a763700 1 --2- 172.21.15.47:0/2037193425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe740fbe80 0x7efe74110740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efe6400b3b0 tx=0x7efe64009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:39.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.060+0000 7efe7a763700 1 -- 172.21.15.47:0/2037193425 shutdown_connections 2024-02-07T12:30:39.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.060+0000 7efe7a763700 1 --2- 172.21.15.47:0/2037193425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe740fbe80 0x7efe74110740 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:39.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.060+0000 7efe7a763700 1 --2- 172.21.15.47:0/2037193425 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efe5c06d7e0 0x7efe5c06fc90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:39.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.060+0000 7efe7a763700 1 --2- 172.21.15.47:0/2037193425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe740fd080 0x7efe74112c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:39.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.060+0000 7efe7a763700 1 -- 172.21.15.47:0/2037193425 >> 172.21.15.47:0/2037193425 conn(0x7efe740f7590 msgr2=0x7efe741002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:39.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.060+0000 7efe7a763700 1 -- 172.21.15.47:0/2037193425 shutdown_connections 2024-02-07T12:30:39.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.060+0000 7efe7a763700 1 -- 172.21.15.47:0/2037193425 wait complete. 2024-02-07T12:30:39.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.163+0000 7f1caa230700 1 -- 172.21.15.47:0/3858691917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca4102430 msgr2=0x7f1ca4104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:39.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.163+0000 7f1caa230700 1 --2- 172.21.15.47:0/3858691917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca4102430 0x7f1ca4104810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c98004940 tx=0x7f1c98009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:39.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.163+0000 7f1caa230700 1 -- 172.21.15.47:0/3858691917 shutdown_connections 2024-02-07T12:30:39.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.163+0000 7f1caa230700 1 --2- 172.21.15.47:0/3858691917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca4102430 0x7f1ca4104810 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.163+0000 7f1caa230700 1 --2- 172.21.15.47:0/3858691917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ca40663e0 0x7f1ca4101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.163+0000 7f1caa230700 1 -- 172.21.15.47:0/3858691917 >> 172.21.15.47:0/3858691917 conn(0x7f1ca40f74e0 msgr2=0x7f1ca40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.163+0000 7f1caa230700 1 -- 172.21.15.47:0/3858691917 shutdown_connections 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.163+0000 7f1caa230700 1 -- 172.21.15.47:0/3858691917 wait complete. 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.164+0000 7f1caa230700 1 Processor -- start 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.164+0000 7f1caa230700 1 -- start start 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.164+0000 7f1caa230700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ca40663e0 0x7f1ca410faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.164+0000 7f1caa230700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca4102430 0x7f1ca4110030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.164+0000 7f1caa230700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca4110630 con 0x7f1ca4102430 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.164+0000 7f1caa230700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca4110ed0 con 0x7f1ca40663e0 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.164+0000 7f1ca2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca4102430 0x7f1ca4110030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.164+0000 7f1ca2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca4102430 0x7f1ca4110030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41242/0 (socket says 172.21.15.47:41242) 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.164+0000 7f1ca2ffd700 1 -- 172.21.15.47:0/258732216 learned_addr learned my addr 172.21.15.47:0/258732216 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:30:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.164+0000 7f1ca37fe700 1 --2- 172.21.15.47:0/258732216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ca40663e0 0x7f1ca410faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.165+0000 7f1ca2ffd700 1 -- 172.21.15.47:0/258732216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ca40663e0 msgr2=0x7f1ca410faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.165+0000 7f1ca2ffd700 1 --2- 172.21.15.47:0/258732216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ca40663e0 0x7f1ca410faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.165+0000 7f1ca2ffd700 1 -- 172.21.15.47:0/258732216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c98005040 con 0x7f1ca4102430 2024-02-07T12:30:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.165+0000 7f1ca2ffd700 1 --2- 172.21.15.47:0/258732216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca4102430 0x7f1ca4110030 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1c98000c00 tx=0x7f1c98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.165+0000 7f1c8bfff700 1 -- 172.21.15.47:0/258732216 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c9800e040 con 0x7f1ca4102430 2024-02-07T12:30:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.165+0000 7f1c8bfff700 1 -- 172.21.15.47:0/258732216 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c9800bbf0 con 0x7f1ca4102430 2024-02-07T12:30:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.165+0000 7f1caa230700 1 -- 172.21.15.47:0/258732216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca4111150 con 0x7f1ca4102430 2024-02-07T12:30:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.165+0000 7f1c8bfff700 1 -- 172.21.15.47:0/258732216 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c9801c630 con 0x7f1ca4102430 2024-02-07T12:30:39.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.165+0000 7f1caa230700 1 -- 172.21.15.47:0/258732216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca4111690 con 0x7f1ca4102430 2024-02-07T12:30:39.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.166+0000 7f1caa230700 1 -- 172.21.15.47:0/258732216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca4109c50 con 0x7f1ca4102430 2024-02-07T12:30:39.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.166+0000 7f1c8bfff700 1 -- 172.21.15.47:0/258732216 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f1c9800bd60 con 0x7f1ca4102430 2024-02-07T12:30:39.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.167+0000 7f1c8bfff700 1 --2- 172.21.15.47:0/258732216 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1c8c06d7f0 0x7f1c8c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:30:39.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.167+0000 7f1c8bfff700 1 -- 172.21.15.47:0/258732216 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1c9808e0e0 con 0x7f1ca4102430 2024-02-07T12:30:39.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.167+0000 7f1ca37fe700 1 --2- 172.21.15.47:0/258732216 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1c8c06d7f0 0x7f1c8c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:30:39.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.167+0000 7f1ca37fe700 1 --2- 172.21.15.47:0/258732216 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1c8c06d7f0 0x7f1c8c06fca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009fd0 tx=0x7f1c9400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:30:39.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.172+0000 7f1c8bfff700 1 -- 172.21.15.47:0/258732216 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1c9805b580 con 0x7f1ca4102430 2024-02-07T12:30:39.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:39 smithi047 ceph-mon[93224]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:39.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:39 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3392475342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:30:39.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:39 smithi047 ceph-mon[93224]: pgmap v79: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-07T12:30:39.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:39 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1238985391' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:30:39.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.457+0000 7f1caa230700 1 -- 172.21.15.47:0/258732216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1ca4107c10 con 0x7f1ca4102430 2024-02-07T12:30:39.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.457+0000 7f1c8bfff700 1 -- 172.21.15.47:0/258732216 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1c98013e60 con 0x7f1ca4102430 2024-02-07T12:30:39.461 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:30:39.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.459+0000 7f1caa230700 1 -- 172.21.15.47:0/258732216 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1c8c06d7f0 msgr2=0x7f1c8c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:39.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.459+0000 7f1caa230700 1 --2- 172.21.15.47:0/258732216 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1c8c06d7f0 0x7f1c8c06fca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009fd0 tx=0x7f1c9400b040 comp rx=0 tx=0).stop 2024-02-07T12:30:39.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.459+0000 7f1caa230700 1 -- 172.21.15.47:0/258732216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca4102430 msgr2=0x7f1ca4110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:30:39.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.459+0000 7f1caa230700 1 --2- 172.21.15.47:0/258732216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca4102430 0x7f1ca4110030 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1c98000c00 tx=0x7f1c98009e30 comp rx=0 tx=0).stop 2024-02-07T12:30:39.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.459+0000 7f1caa230700 1 -- 172.21.15.47:0/258732216 shutdown_connections 2024-02-07T12:30:39.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.459+0000 7f1caa230700 1 --2- 172.21.15.47:0/258732216 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1c8c06d7f0 0x7f1c8c06fca0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:39.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.459+0000 7f1caa230700 1 --2- 172.21.15.47:0/258732216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ca40663e0 0x7f1ca410faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:39.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.459+0000 7f1caa230700 1 --2- 172.21.15.47:0/258732216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca4102430 0x7f1ca4110030 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:30:39.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.459+0000 7f1caa230700 1 -- 172.21.15.47:0/258732216 >> 172.21.15.47:0/258732216 conn(0x7f1ca40f74e0 msgr2=0x7f1ca40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:30:39.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.459+0000 7f1caa230700 1 -- 172.21.15.47:0/258732216 shutdown_connections 2024-02-07T12:30:39.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:30:39.459+0000 7f1caa230700 1 -- 172.21.15.47:0/258732216 wait complete. 2024-02-07T12:30:39.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:39 smithi138 ceph-mon[82055]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:39.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:39 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3392475342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:30:39.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:39 smithi138 ceph-mon[82055]: pgmap v79: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-07T12:30:39.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:39 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1238985391' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:30:40.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:40 smithi138 ceph-mon[82055]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:40.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:40 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/258732216' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:30:40.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:40 smithi047 ceph-mon[93224]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:30:40.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:40 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/258732216' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:30:41.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:41 smithi138 ceph-mon[82055]: pgmap v80: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-07T12:30:41.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:41 smithi047 ceph-mon[93224]: pgmap v80: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-07T12:30:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:30:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:42 smithi138 ceph-mon[82055]: pgmap v81: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2024-02-07T12:30:43.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:43.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:30:43.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:43.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:42 smithi047 ceph-mon[93224]: pgmap v81: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2024-02-07T12:30:45.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:44 smithi138 ceph-mon[82055]: pgmap v82: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:30:45.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:44 smithi047 ceph-mon[93224]: pgmap v82: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:30:47.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:46 smithi138 ceph-mon[82055]: pgmap v83: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:30:47.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:46 smithi047 ceph-mon[93224]: pgmap v83: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:30:48.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:47 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-07T12:30:48.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:47 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-07T12:30:49.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:49 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-07T12:30:49.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:49 smithi047 ceph-mon[93224]: Upgrade: osd.2 is safe to restart 2024-02-07T12:30:49.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:49 smithi047 ceph-mon[93224]: pgmap v84: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:30:49.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:49 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-07T12:30:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:49 smithi138 ceph-mon[82055]: Upgrade: osd.2 is safe to restart 2024-02-07T12:30:49.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:49 smithi138 ceph-mon[82055]: pgmap v84: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:30:50.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:50 smithi047 ceph-mon[93224]: Upgrade: Updating osd.2 2024-02-07T12:30:50.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:50 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:50.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:50 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-07T12:30:50.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:50 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:30:50.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:50 smithi047 ceph-mon[93224]: Deploying daemon osd.2 on smithi047 2024-02-07T12:30:50.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:50 smithi138 ceph-mon[82055]: Upgrade: Updating osd.2 2024-02-07T12:30:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:50 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:50 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-07T12:30:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:50 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:30:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:50 smithi138 ceph-mon[82055]: Deploying daemon osd.2 on smithi047 2024-02-07T12:30:51.496 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:51 smithi047 ceph-mon[93224]: pgmap v85: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:30:51.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:51 smithi138 ceph-mon[82055]: pgmap v85: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:30:52.989 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:52 smithi047 ceph-mon[93224]: pgmap v86: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:30:52.989 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:52 smithi047 systemd[1]: Stopping Ceph osd.2 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:30:53.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:52 smithi138 ceph-mon[82055]: pgmap v86: 65 pgs: 65 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:30:53.325 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:52 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2[62214]: 2024-02-07T12:30:52.985+0000 7fa274602700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:30:53.326 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:52 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2[62214]: 2024-02-07T12:30:52.985+0000 7fa274602700 -1 osd.2 60 *** Got signal Terminated *** 2024-02-07T12:30:53.326 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:52 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2[62214]: 2024-02-07T12:30:52.985+0000 7fa274602700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-07T12:30:54.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:53 smithi138 ceph-mon[82055]: osd.2 marked itself down and dead 2024-02-07T12:30:54.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:53 smithi047 ceph-mon[93224]: osd.2 marked itself down and dead 2024-02-07T12:30:54.489 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:54 smithi047 podman[112838]: 2024-02-07 12:30:54.211567966 +0000 UTC m=+1.336898233 container died 80e323c37d17f0f36598b05e263b3f8ba437c72eb05b0c7ac9c0ef6d1c9b526d (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2, org.label-schema.build-date=20240131, RELEASE=quincy-f246262, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-07T12:30:54.825 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:54 smithi047 podman[112838]: 2024-02-07 12:30:54.677914014 +0000 UTC m=+1.803244280 container cleanup 80e323c37d17f0f36598b05e263b3f8ba437c72eb05b0c7ac9c0ef6d1c9b526d (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2, RELEASE=quincy-f246262, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-07T12:30:54.825 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:54 smithi047 bash[112838]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2 2024-02-07T12:30:54.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:54 smithi047 ceph-mon[93224]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-07T12:30:54.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:54 smithi047 ceph-mon[93224]: osdmap e61: 6 total, 5 up, 6 in 2024-02-07T12:30:54.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:54 smithi047 ceph-mon[93224]: failed to encode map e61 with expected crc 2024-02-07T12:30:54.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:54 smithi047 ceph-mon[93224]: failed to encode map e61 with expected crc 2024-02-07T12:30:54.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:54 smithi047 ceph-mon[93224]: failed to encode map e61 with expected crc 2024-02-07T12:30:54.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:54 smithi047 ceph-mon[93224]: pgmap v88: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-02-07T12:30:55.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:54 smithi138 ceph-mon[82055]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-07T12:30:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:54 smithi138 ceph-mon[82055]: osdmap e61: 6 total, 5 up, 6 in 2024-02-07T12:30:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:54 smithi138 ceph-mon[82055]: failed to encode map e61 with expected crc 2024-02-07T12:30:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:54 smithi138 ceph-mon[82055]: failed to encode map e61 with expected crc 2024-02-07T12:30:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:54 smithi138 ceph-mon[82055]: failed to encode map e61 with expected crc 2024-02-07T12:30:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:54 smithi138 ceph-mon[82055]: pgmap v88: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-02-07T12:30:55.307 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:54 smithi047 podman[112856]: 2024-02-07 12:30:54.954458675 +0000 UTC m=+0.746078755 container remove 80e323c37d17f0f36598b05e263b3f8ba437c72eb05b0c7ac9c0ef6d1c9b526d (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-f246262, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:30:55.575 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:55 smithi047 podman[112951]: 2024-02-07 12:30:55.305474861 +0000 UTC m=+0.105123157 container create fa538c325fc8b1d2cc169d7685cb5887f980e4a88a1e7843279947287a475a2a (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.2) 2024-02-07T12:30:55.575 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:55 smithi047 podman[112951]: 2024-02-07 12:30:55.218973206 +0000 UTC m=+0.018621503 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:30:55.575 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:55 smithi047 podman[112951]: 2024-02-07 12:30:55.533309753 +0000 UTC m=+0.332958052 container init fa538c325fc8b1d2cc169d7685cb5887f980e4a88a1e7843279947287a475a2a (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-07T12:30:55.576 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:55 smithi047 podman[112951]: 2024-02-07 12:30:55.53640377 +0000 UTC m=+0.336052067 container start fa538c325fc8b1d2cc169d7685cb5887f980e4a88a1e7843279947287a475a2a (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-02-07T12:30:56.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:55 smithi138 ceph-mon[82055]: failed to encode map e61 with expected crc 2024-02-07T12:30:56.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:55 smithi138 ceph-mon[82055]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-02-07T12:30:56.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:55 smithi138 ceph-mon[82055]: failed to encode map e62 with expected crc 2024-02-07T12:30:56.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:55 smithi138 ceph-mon[82055]: osdmap e62: 6 total, 5 up, 6 in 2024-02-07T12:30:56.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:55 smithi138 ceph-mon[82055]: failed to encode map e62 with expected crc 2024-02-07T12:30:56.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:55 smithi138 ceph-mon[82055]: failed to encode map e62 with expected crc 2024-02-07T12:30:56.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:55 smithi138 ceph-mon[82055]: failed to encode map e62 with expected crc 2024-02-07T12:30:56.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:55 smithi138 ceph-mon[82055]: failed to encode map e62 with expected crc 2024-02-07T12:30:56.075 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:55 smithi047 podman[112951]: 2024-02-07 12:30:55.624791916 +0000 UTC m=+0.424440226 container attach fa538c325fc8b1d2cc169d7685cb5887f980e4a88a1e7843279947287a475a2a (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-07T12:30:56.076 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:55 smithi047 podman[112951]: 2024-02-07 12:30:55.836096698 +0000 UTC m=+0.635744988 container died fa538c325fc8b1d2cc169d7685cb5887f980e4a88a1e7843279947287a475a2a (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, ceph=True, io.buildah.version=1.33.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-07T12:30:56.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:55 smithi047 ceph-mon[93224]: failed to encode map e61 with expected crc 2024-02-07T12:30:56.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:55 smithi047 ceph-mon[93224]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-02-07T12:30:56.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:55 smithi047 ceph-mon[93224]: failed to encode map e62 with expected crc 2024-02-07T12:30:56.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:55 smithi047 ceph-mon[93224]: osdmap e62: 6 total, 5 up, 6 in 2024-02-07T12:30:56.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:55 smithi047 ceph-mon[93224]: failed to encode map e62 with expected crc 2024-02-07T12:30:56.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:55 smithi047 ceph-mon[93224]: failed to encode map e62 with expected crc 2024-02-07T12:30:56.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:55 smithi047 ceph-mon[93224]: failed to encode map e62 with expected crc 2024-02-07T12:30:56.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:55 smithi047 ceph-mon[93224]: failed to encode map e62 with expected crc 2024-02-07T12:30:56.701 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:56 smithi047 podman[112977]: 2024-02-07 12:30:56.387079768 +0000 UTC m=+0.541466262 container remove fa538c325fc8b1d2cc169d7685cb5887f980e4a88a1e7843279947287a475a2a (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:30:56.702 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:56 smithi047 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.2.service: Deactivated successfully. 2024-02-07T12:30:56.702 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:56 smithi047 systemd[1]: Stopped Ceph osd.2 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:30:56.702 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:56 smithi047 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.2.service: Consumed 49.494s CPU time. 2024-02-07T12:30:56.702 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:56 smithi047 systemd[1]: Starting Ceph osd.2 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:30:56.986 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:56 smithi047 ceph-mon[93224]: failed to encode map e62 with expected crc 2024-02-07T12:30:56.986 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:56 smithi047 ceph-mon[93224]: failed to encode map e62 with expected crc 2024-02-07T12:30:56.986 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:56 smithi047 ceph-mon[93224]: pgmap v90: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-02-07T12:30:56.986 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:56.986 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:30:56.987 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:56 smithi047 podman[113080]: 2024-02-07 12:30:56.747346969 +0000 UTC m=+0.017715988 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:30:56.987 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:56 smithi047 podman[113080]: 2024-02-07 12:30:56.863337429 +0000 UTC m=+0.133706440 container create 6075b07874a3d6d1e6e567bc331926d82fa4cb5e0e63d59cf5c731dc56707c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-07T12:30:57.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:56 smithi138 ceph-mon[82055]: failed to encode map e62 with expected crc 2024-02-07T12:30:57.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:56 smithi138 ceph-mon[82055]: failed to encode map e62 with expected crc 2024-02-07T12:30:57.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:56 smithi138 ceph-mon[82055]: pgmap v90: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-02-07T12:30:57.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:57.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:30:57.325 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 podman[113080]: 2024-02-07 12:30:57.082476865 +0000 UTC m=+0.352845877 container init 6075b07874a3d6d1e6e567bc331926d82fa4cb5e0e63d59cf5c731dc56707c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131) 2024-02-07T12:30:57.325 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 podman[113080]: 2024-02-07 12:30:57.085501451 +0000 UTC m=+0.355870470 container start 6075b07874a3d6d1e6e567bc331926d82fa4cb5e0e63d59cf5c731dc56707c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-02-07T12:30:57.325 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 podman[113080]: 2024-02-07 12:30:57.165838098 +0000 UTC m=+0.436207113 container attach 6075b07874a3d6d1e6e567bc331926d82fa4cb5e0e63d59cf5c731dc56707c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-activate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=) 2024-02-07T12:30:57.826 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-activate[113096]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-07T12:30:57.826 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-activate[113096]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-07T12:30:57.826 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 bash[113080]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-07T12:30:57.826 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 bash[113080]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-07T12:30:57.827 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 bash[113080]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-07T12:30:57.827 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 bash[113080]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-07T12:30:57.827 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 bash[113080]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-07T12:30:57.827 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 bash[113080]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-07T12:30:57.827 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 bash[113080]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-07T12:30:57.827 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-activate[113096]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-07T12:30:57.827 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-activate[113096]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-07T12:30:57.828 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-activate[113096]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-07T12:30:57.828 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-activate[113096]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-07T12:30:57.828 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-activate[113096]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-07T12:30:57.828 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:57 smithi047 podman[113080]: 2024-02-07 12:30:57.559027583 +0000 UTC m=+0.829396602 container died 6075b07874a3d6d1e6e567bc331926d82fa4cb5e0e63d59cf5c731dc56707c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_BRANCH=HEAD) 2024-02-07T12:30:58.325 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:58 smithi047 podman[113234]: 2024-02-07 12:30:58.153092776 +0000 UTC m=+0.588794019 container remove 6075b07874a3d6d1e6e567bc331926d82fa4cb5e0e63d59cf5c731dc56707c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.vendor=CentOS) 2024-02-07T12:30:58.623 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:58 smithi047 podman[113300]: 2024-02-07 12:30:58.362952883 +0000 UTC m=+0.111332240 container create 0b8c7834634693c9898c8976ac54825ebed2f0e5ca1bf68d15e517286bdcc5fb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:30:58.623 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:58 smithi047 podman[113300]: 2024-02-07 12:30:58.269696082 +0000 UTC m=+0.018075444 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:30:58.623 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:58 smithi047 podman[113300]: 2024-02-07 12:30:58.598631611 +0000 UTC m=+0.347010969 container init 0b8c7834634693c9898c8976ac54825ebed2f0e5ca1bf68d15e517286bdcc5fb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2) 2024-02-07T12:30:58.623 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:58 smithi047 podman[113300]: 2024-02-07 12:30:58.601646656 +0000 UTC m=+0.350026014 container start 0b8c7834634693c9898c8976ac54825ebed2f0e5ca1bf68d15e517286bdcc5fb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:30:59.075 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:58 smithi047 ceph-osd[113320]: -- 172.21.15.47:0/343435818 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556936faf6c0 con 0x556936f80c00 2024-02-07T12:30:59.075 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:58 smithi047 bash[113300]: 0b8c7834634693c9898c8976ac54825ebed2f0e5ca1bf68d15e517286bdcc5fb 2024-02-07T12:30:59.075 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:58 smithi047 systemd[1]: Started Ceph osd.2 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:30:59.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:59 smithi138 ceph-mon[82055]: pgmap v91: 65 pgs: 10 active+undersized+degraded, 7 peering, 10 active+undersized, 38 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/354 objects degraded (8.475%) 2024-02-07T12:30:59.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:59 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:59.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:59 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:59.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:30:59 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:30:59.575 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:30:59 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2[113316]: 2024-02-07T12:30:59.150+0000 7fa4046227c0 -1 Falling back to public interface 2024-02-07T12:30:59.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:59 smithi047 ceph-mon[93224]: pgmap v91: 65 pgs: 10 active+undersized+degraded, 7 peering, 10 active+undersized, 38 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/354 objects degraded (8.475%) 2024-02-07T12:30:59.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:59 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:59.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:59 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:30:59.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:30:59 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:31:00.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:00 smithi047 ceph-mon[93224]: Health check failed: Degraded data redundancy: 30/354 objects degraded (8.475%), 10 pgs degraded (PG_DEGRADED) 2024-02-07T12:31:00.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:00 smithi138 ceph-mon[82055]: Health check failed: Degraded data redundancy: 30/354 objects degraded (8.475%), 10 pgs degraded (PG_DEGRADED) 2024-02-07T12:31:01.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:01 smithi138 ceph-mon[82055]: pgmap v92: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-02-07T12:31:01.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:01 smithi047 ceph-mon[93224]: pgmap v92: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-02-07T12:31:02.532 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:02 smithi047 ceph-mon[93224]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-02-07T12:31:02.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:02 smithi138 ceph-mon[82055]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-02-07T12:31:03.530 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:03 smithi047 ceph-mon[93224]: pgmap v93: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-02-07T12:31:03.531 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:31:03 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2[113316]: 2024-02-07T12:31:03.097+0000 7fa4046227c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-02-07T12:31:03.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:03 smithi138 ceph-mon[82055]: pgmap v93: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 298 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-02-07T12:31:03.825 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:31:03 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2[113316]: 2024-02-07T12:31:03.535+0000 7fa4046227c0 -1 osd.2 60 log_to_monitors true 2024-02-07T12:31:04.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:04 smithi138 ceph-mon[82055]: from='osd.2 [v2:172.21.15.47:6818/4120407081,v1:172.21.15.47:6819/4120407081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-07T12:31:04.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:04 smithi047 ceph-mon[93224]: from='osd.2 [v2:172.21.15.47:6818/4120407081,v1:172.21.15.47:6819/4120407081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-07T12:31:04.575 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:31:04 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2[113316]: 2024-02-07T12:31:04.196+0000 7fa3f5a81700 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-07T12:31:05.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:05 smithi138 ceph-mon[82055]: from='osd.2 [v2:172.21.15.47:6818/4120407081,v1:172.21.15.47:6819/4120407081]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-07T12:31:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:05 smithi138 ceph-mon[82055]: osdmap e63: 6 total, 5 up, 6 in 2024-02-07T12:31:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:05 smithi138 ceph-mon[82055]: from='osd.2 [v2:172.21.15.47:6818/4120407081,v1:172.21.15.47:6819/4120407081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-02-07T12:31:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:05 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:05 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:05 smithi138 ceph-mon[82055]: failed to encode map e63 with expected crc 2024-02-07T12:31:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:05 smithi138 ceph-mon[82055]: failed to encode map e63 with expected crc 2024-02-07T12:31:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:05 smithi138 ceph-mon[82055]: failed to encode map e63 with expected crc 2024-02-07T12:31:05.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:05 smithi138 ceph-mon[82055]: pgmap v95: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-02-07T12:31:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:05 smithi047 ceph-mon[93224]: from='osd.2 [v2:172.21.15.47:6818/4120407081,v1:172.21.15.47:6819/4120407081]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-07T12:31:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:05 smithi047 ceph-mon[93224]: osdmap e63: 6 total, 5 up, 6 in 2024-02-07T12:31:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:05 smithi047 ceph-mon[93224]: from='osd.2 [v2:172.21.15.47:6818/4120407081,v1:172.21.15.47:6819/4120407081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-02-07T12:31:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:05 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:05 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:05 smithi047 ceph-mon[93224]: failed to encode map e63 with expected crc 2024-02-07T12:31:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:05 smithi047 ceph-mon[93224]: failed to encode map e63 with expected crc 2024-02-07T12:31:05.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:05 smithi047 ceph-mon[93224]: failed to encode map e63 with expected crc 2024-02-07T12:31:05.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:05 smithi047 ceph-mon[93224]: pgmap v95: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-02-07T12:31:06.276 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:06 smithi047 ceph-mon[93224]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-07T12:31:06.277 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:06 smithi047 ceph-mon[93224]: osd.2 [v2:172.21.15.47:6818/4120407081,v1:172.21.15.47:6819/4120407081] boot 2024-02-07T12:31:06.277 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:06 smithi047 ceph-mon[93224]: osdmap e64: 6 total, 6 up, 6 in 2024-02-07T12:31:06.277 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:06 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:31:06.277 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:06 smithi047 ceph-mon[93224]: failed to encode map e64 with expected crc 2024-02-07T12:31:06.277 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:06 smithi047 ceph-mon[93224]: failed to encode map e64 with expected crc 2024-02-07T12:31:06.277 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:06 smithi047 ceph-mon[93224]: failed to encode map e64 with expected crc 2024-02-07T12:31:06.277 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:06 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:06.277 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:06 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:06 smithi138 ceph-mon[82055]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-07T12:31:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:06 smithi138 ceph-mon[82055]: osd.2 [v2:172.21.15.47:6818/4120407081,v1:172.21.15.47:6819/4120407081] boot 2024-02-07T12:31:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:06 smithi138 ceph-mon[82055]: osdmap e64: 6 total, 6 up, 6 in 2024-02-07T12:31:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:06 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-07T12:31:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:06 smithi138 ceph-mon[82055]: failed to encode map e64 with expected crc 2024-02-07T12:31:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:06 smithi138 ceph-mon[82055]: failed to encode map e64 with expected crc 2024-02-07T12:31:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:06 smithi138 ceph-mon[82055]: failed to encode map e64 with expected crc 2024-02-07T12:31:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:06 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:06 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:07.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:07 smithi138 ceph-mon[82055]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:07 smithi138 ceph-mon[82055]: osdmap e65: 6 total, 6 up, 6 in 2024-02-07T12:31:07.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:07 smithi138 ceph-mon[82055]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:07 smithi138 ceph-mon[82055]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:07 smithi138 ceph-mon[82055]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:07 smithi138 ceph-mon[82055]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:07 smithi138 ceph-mon[82055]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:07 smithi138 ceph-mon[82055]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:07 smithi138 ceph-mon[82055]: pgmap v98: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 43/354 objects degraded (12.147%) 2024-02-07T12:31:07.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:07 smithi047 ceph-mon[93224]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:07 smithi047 ceph-mon[93224]: osdmap e65: 6 total, 6 up, 6 in 2024-02-07T12:31:07.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:07 smithi047 ceph-mon[93224]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:07 smithi047 ceph-mon[93224]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:07 smithi047 ceph-mon[93224]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:07 smithi047 ceph-mon[93224]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:07 smithi047 ceph-mon[93224]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:07 smithi047 ceph-mon[93224]: failed to encode map e65 with expected crc 2024-02-07T12:31:07.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:07 smithi047 ceph-mon[93224]: pgmap v98: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 43/354 objects degraded (12.147%) 2024-02-07T12:31:08.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:08 smithi047 ceph-mon[93224]: Health check update: Degraded data redundancy: 43/354 objects degraded (12.147%), 13 pgs degraded (PG_DEGRADED) 2024-02-07T12:31:08.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:08 smithi138 ceph-mon[82055]: Health check update: Degraded data redundancy: 43/354 objects degraded (12.147%), 13 pgs degraded (PG_DEGRADED) 2024-02-07T12:31:09.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:09 smithi047 ceph-mon[93224]: pgmap v99: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 19/354 objects degraded (5.367%) 2024-02-07T12:31:09.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:09.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:09.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:31:09.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:31:09.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:09.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:31:09.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:09.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:09.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:09.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:09 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-07T12:31:09.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:09 smithi138 ceph-mon[82055]: pgmap v99: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 19/354 objects degraded (5.367%) 2024-02-07T12:31:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:31:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:31:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:31:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:09.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:09 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-07T12:31:09.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.566+0000 7f7875e05700 1 -- 172.21.15.47:0/335192922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78700fe0e0 msgr2=0x7f78700fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.566+0000 7f7875e05700 1 --2- 172.21.15.47:0/335192922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78700fe0e0 0x7f78700fe550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7864004940 tx=0x7f7864009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.566+0000 7f7875e05700 1 -- 172.21.15.47:0/335192922 shutdown_connections 2024-02-07T12:31:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.566+0000 7f7875e05700 1 --2- 172.21.15.47:0/335192922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78700fe0e0 0x7f78700fe550 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.566+0000 7f7875e05700 1 --2- 172.21.15.47:0/335192922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78700fcef0 0x7f78700fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.566+0000 7f7875e05700 1 -- 172.21.15.47:0/335192922 >> 172.21.15.47:0/335192922 conn(0x7f78700f8620 msgr2=0x7f78700faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.567+0000 7f7875e05700 1 -- 172.21.15.47:0/335192922 shutdown_connections 2024-02-07T12:31:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.567+0000 7f7875e05700 1 -- 172.21.15.47:0/335192922 wait complete. 2024-02-07T12:31:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.567+0000 7f7875e05700 1 Processor -- start 2024-02-07T12:31:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.567+0000 7f7875e05700 1 -- start start 2024-02-07T12:31:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.567+0000 7f7875e05700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78700fcef0 0x7f787010d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.567+0000 7f7875e05700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78700fe0e0 0x7f787010ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.567+0000 7f7875e05700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787010e560 con 0x7f78700fcef0 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.567+0000 7f7875e05700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787010eda0 con 0x7f78700fe0e0 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.567+0000 7f786f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78700fcef0 0x7f787010d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.567+0000 7f786f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78700fcef0 0x7f787010d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54636/0 (socket says 172.21.15.47:54636) 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.567+0000 7f786f7fe700 1 -- 172.21.15.47:0/674511736 learned_addr learned my addr 172.21.15.47:0/674511736 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.568+0000 7f786f7fe700 1 -- 172.21.15.47:0/674511736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78700fe0e0 msgr2=0x7f787010ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.568+0000 7f786effd700 1 --2- 172.21.15.47:0/674511736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78700fe0e0 0x7f787010ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.568+0000 7f786f7fe700 1 --2- 172.21.15.47:0/674511736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78700fe0e0 0x7f787010ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.568+0000 7f786f7fe700 1 -- 172.21.15.47:0/674511736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7864005040 con 0x7f78700fcef0 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.568+0000 7f786effd700 1 --2- 172.21.15.47:0/674511736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78700fe0e0 0x7f787010ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.568+0000 7f786f7fe700 1 --2- 172.21.15.47:0/674511736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78700fcef0 0x7f787010d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f786000b790 tx=0x7f7860009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.568+0000 7f7857fff700 1 -- 172.21.15.47:0/674511736 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f786000f6f0 con 0x7f78700fcef0 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.568+0000 7f7857fff700 1 -- 172.21.15.47:0/674511736 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f786000fd20 con 0x7f78700fcef0 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.568+0000 7f7875e05700 1 -- 172.21.15.47:0/674511736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787010f080 con 0x7f78700fcef0 2024-02-07T12:31:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.568+0000 7f7857fff700 1 -- 172.21.15.47:0/674511736 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78600103a0 con 0x7f78700fcef0 2024-02-07T12:31:09.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.568+0000 7f7875e05700 1 -- 172.21.15.47:0/674511736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787010f5c0 con 0x7f78700fcef0 2024-02-07T12:31:09.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.569+0000 7f7875e05700 1 -- 172.21.15.47:0/674511736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787004bed0 con 0x7f78700fcef0 2024-02-07T12:31:09.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.570+0000 7f7857fff700 1 -- 172.21.15.47:0/674511736 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f7860011400 con 0x7f78700fcef0 2024-02-07T12:31:09.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.570+0000 7f7857fff700 1 --2- 172.21.15.47:0/674511736 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f785806d7f0 0x7f785806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:09.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.570+0000 7f7857fff700 1 -- 172.21.15.47:0/674511736 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f786008cc60 con 0x7f78700fcef0 2024-02-07T12:31:09.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.570+0000 7f786effd700 1 --2- 172.21.15.47:0/674511736 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f785806d7f0 0x7f785806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:09.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.571+0000 7f786effd700 1 --2- 172.21.15.47:0/674511736 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f785806d7f0 0x7f785806fca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f786400b7a0 tx=0x7f7864009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:09.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.575+0000 7f7857fff700 1 -- 172.21.15.47:0/674511736 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f786005a060 con 0x7f78700fcef0 2024-02-07T12:31:09.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.799+0000 7f7875e05700 1 -- 172.21.15.47:0/674511736 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7870102ac0 con 0x7f785806d7f0 2024-02-07T12:31:09.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.801+0000 7f7857fff700 1 -- 172.21.15.47:0/674511736 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7870102ac0 con 0x7f785806d7f0 2024-02-07T12:31:09.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.803+0000 7f7875e05700 1 -- 172.21.15.47:0/674511736 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f785806d7f0 msgr2=0x7f785806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:09.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.803+0000 7f7875e05700 1 --2- 172.21.15.47:0/674511736 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f785806d7f0 0x7f785806fca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f786400b7a0 tx=0x7f7864009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:09.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.803+0000 7f7875e05700 1 -- 172.21.15.47:0/674511736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78700fcef0 msgr2=0x7f787010d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:09.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.803+0000 7f7875e05700 1 --2- 172.21.15.47:0/674511736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78700fcef0 0x7f787010d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f786000b790 tx=0x7f7860009220 comp rx=0 tx=0).stop 2024-02-07T12:31:09.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.803+0000 7f7875e05700 1 -- 172.21.15.47:0/674511736 shutdown_connections 2024-02-07T12:31:09.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.803+0000 7f7875e05700 1 --2- 172.21.15.47:0/674511736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78700fcef0 0x7f787010d990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:09.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.803+0000 7f7875e05700 1 --2- 172.21.15.47:0/674511736 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f785806d7f0 0x7f785806fca0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:09.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.803+0000 7f7875e05700 1 --2- 172.21.15.47:0/674511736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78700fe0e0 0x7f787010ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:09.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.803+0000 7f7875e05700 1 -- 172.21.15.47:0/674511736 >> 172.21.15.47:0/674511736 conn(0x7f78700f8620 msgr2=0x7f78701013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:09.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.803+0000 7f7875e05700 1 -- 172.21.15.47:0/674511736 shutdown_connections 2024-02-07T12:31:09.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.803+0000 7f7875e05700 1 -- 172.21.15.47:0/674511736 wait complete. 2024-02-07T12:31:09.816 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:31:09.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.906+0000 7f659d95a700 1 -- 172.21.15.47:0/3875022212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65980fe0e0 msgr2=0x7f65980fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:09.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.906+0000 7f659d95a700 1 --2- 172.21.15.47:0/3875022212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65980fe0e0 0x7f65980fe550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6580004940 tx=0x7f6580009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:09.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.906+0000 7f659d95a700 1 -- 172.21.15.47:0/3875022212 shutdown_connections 2024-02-07T12:31:09.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.906+0000 7f659d95a700 1 --2- 172.21.15.47:0/3875022212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65980fe0e0 0x7f65980fe550 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:09.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.906+0000 7f659d95a700 1 --2- 172.21.15.47:0/3875022212 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65980fcef0 0x7f65980fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:09.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.906+0000 7f659d95a700 1 -- 172.21.15.47:0/3875022212 >> 172.21.15.47:0/3875022212 conn(0x7f65980f8620 msgr2=0x7f65980faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:09.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.906+0000 7f659d95a700 1 -- 172.21.15.47:0/3875022212 shutdown_connections 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.906+0000 7f659d95a700 1 -- 172.21.15.47:0/3875022212 wait complete. 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.907+0000 7f659d95a700 1 Processor -- start 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.907+0000 7f659d95a700 1 -- start start 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.907+0000 7f659d95a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65980fcef0 0x7f659810d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.907+0000 7f659d95a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65980fe0e0 0x7f659810dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.907+0000 7f659d95a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659810e4a0 con 0x7f65980fe0e0 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.907+0000 7f659d95a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659810ed40 con 0x7f65980fcef0 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.907+0000 7f65967fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65980fe0e0 0x7f659810dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.907+0000 7f65967fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65980fe0e0 0x7f659810dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54644/0 (socket says 172.21.15.47:54644) 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.907+0000 7f65967fc700 1 -- 172.21.15.47:0/3697823172 learned_addr learned my addr 172.21.15.47:0/3697823172 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.907+0000 7f6596ffd700 1 --2- 172.21.15.47:0/3697823172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65980fcef0 0x7f659810d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.908+0000 7f65967fc700 1 -- 172.21.15.47:0/3697823172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65980fcef0 msgr2=0x7f659810d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.908+0000 7f65967fc700 1 --2- 172.21.15.47:0/3697823172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65980fcef0 0x7f659810d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:09.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.908+0000 7f65967fc700 1 -- 172.21.15.47:0/3697823172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6580005040 con 0x7f65980fe0e0 2024-02-07T12:31:09.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.908+0000 7f65967fc700 1 --2- 172.21.15.47:0/3697823172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65980fe0e0 0x7f659810dea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f65800093b0 tx=0x7f6580009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:09.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.908+0000 7f658f7fe700 1 -- 172.21.15.47:0/3697823172 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f658000e040 con 0x7f65980fe0e0 2024-02-07T12:31:09.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.908+0000 7f659d95a700 1 -- 172.21.15.47:0/3697823172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659810efc0 con 0x7f65980fe0e0 2024-02-07T12:31:09.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.908+0000 7f658f7fe700 1 -- 172.21.15.47:0/3697823172 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f658000bcc0 con 0x7f65980fe0e0 2024-02-07T12:31:09.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.908+0000 7f658f7fe700 1 -- 172.21.15.47:0/3697823172 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f658001c630 con 0x7f65980fe0e0 2024-02-07T12:31:09.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.908+0000 7f659d95a700 1 -- 172.21.15.47:0/3697823172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659810f500 con 0x7f65980fe0e0 2024-02-07T12:31:09.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.909+0000 7f659d95a700 1 -- 172.21.15.47:0/3697823172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659804bed0 con 0x7f65980fe0e0 2024-02-07T12:31:09.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.909+0000 7f658f7fe700 1 -- 172.21.15.47:0/3697823172 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6580013980 con 0x7f65980fe0e0 2024-02-07T12:31:09.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.910+0000 7f658f7fe700 1 --2- 172.21.15.47:0/3697823172 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f658406d7e0 0x7f658406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:09.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.910+0000 7f658f7fe700 1 -- 172.21.15.47:0/3697823172 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f658008e250 con 0x7f65980fe0e0 2024-02-07T12:31:09.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.910+0000 7f6596ffd700 1 --2- 172.21.15.47:0/3697823172 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f658406d7e0 0x7f658406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:09.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.910+0000 7f6596ffd700 1 --2- 172.21.15.47:0/3697823172 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f658406d7e0 0x7f658406fc90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f65980fcc30 tx=0x7f659000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:09.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:09.915+0000 7f658f7fe700 1 -- 172.21.15.47:0/3697823172 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f658005b650 con 0x7f65980fe0e0 2024-02-07T12:31:10.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.139+0000 7f659d95a700 1 -- 172.21.15.47:0/3697823172 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f659810f960 con 0x7f658406d7e0 2024-02-07T12:31:10.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.140+0000 7f658f7fe700 1 -- 172.21.15.47:0/3697823172 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f659810f960 con 0x7f658406d7e0 2024-02-07T12:31:10.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.143+0000 7f659d95a700 1 -- 172.21.15.47:0/3697823172 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f658406d7e0 msgr2=0x7f658406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:10.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.143+0000 7f659d95a700 1 --2- 172.21.15.47:0/3697823172 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f658406d7e0 0x7f658406fc90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f65980fcc30 tx=0x7f659000b040 comp rx=0 tx=0).stop 2024-02-07T12:31:10.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.143+0000 7f659d95a700 1 -- 172.21.15.47:0/3697823172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65980fe0e0 msgr2=0x7f659810dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:10.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.143+0000 7f659d95a700 1 --2- 172.21.15.47:0/3697823172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65980fe0e0 0x7f659810dea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f65800093b0 tx=0x7f6580009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:10.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.143+0000 7f659d95a700 1 -- 172.21.15.47:0/3697823172 shutdown_connections 2024-02-07T12:31:10.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.143+0000 7f659d95a700 1 --2- 172.21.15.47:0/3697823172 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f658406d7e0 0x7f658406fc90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.143+0000 7f659d95a700 1 --2- 172.21.15.47:0/3697823172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65980fcef0 0x7f659810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.143+0000 7f659d95a700 1 --2- 172.21.15.47:0/3697823172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65980fe0e0 0x7f659810dea0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.143+0000 7f659d95a700 1 -- 172.21.15.47:0/3697823172 >> 172.21.15.47:0/3697823172 conn(0x7f65980f8620 msgr2=0x7f65981013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:10.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.143+0000 7f659d95a700 1 -- 172.21.15.47:0/3697823172 shutdown_connections 2024-02-07T12:31:10.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.143+0000 7f659d95a700 1 -- 172.21.15.47:0/3697823172 wait complete. 2024-02-07T12:31:10.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.246+0000 7fc13c929700 1 -- 172.21.15.47:0/3060147905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1380fe0e0 msgr2=0x7fc1380fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:10.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.246+0000 7fc13c929700 1 --2- 172.21.15.47:0/3060147905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1380fe0e0 0x7fc1380fe550 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc120004940 tx=0x7fc120009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:10.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.246+0000 7fc13c929700 1 -- 172.21.15.47:0/3060147905 shutdown_connections 2024-02-07T12:31:10.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.246+0000 7fc13c929700 1 --2- 172.21.15.47:0/3060147905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1380fe0e0 0x7fc1380fe550 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.246+0000 7fc13c929700 1 --2- 172.21.15.47:0/3060147905 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1380fcef0 0x7fc1380fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.246+0000 7fc13c929700 1 -- 172.21.15.47:0/3060147905 >> 172.21.15.47:0/3060147905 conn(0x7fc1380f8620 msgr2=0x7fc1380faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:10.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.246+0000 7fc13c929700 1 -- 172.21.15.47:0/3060147905 shutdown_connections 2024-02-07T12:31:10.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.246+0000 7fc13c929700 1 -- 172.21.15.47:0/3060147905 wait complete. 2024-02-07T12:31:10.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.247+0000 7fc13c929700 1 Processor -- start 2024-02-07T12:31:10.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.247+0000 7fc13c929700 1 -- start start 2024-02-07T12:31:10.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.247+0000 7fc13c929700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1380fcef0 0x7fc13810d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:10.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.247+0000 7fc13c929700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1380fe0e0 0x7fc13810de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:10.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.247+0000 7fc13c929700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13810e410 con 0x7fc1380fe0e0 2024-02-07T12:31:10.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.247+0000 7fc13c929700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13810ecb0 con 0x7fc1380fcef0 2024-02-07T12:31:10.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.247+0000 7fc135d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1380fe0e0 0x7fc13810de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:10.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.247+0000 7fc135d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1380fe0e0 0x7fc13810de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54670/0 (socket says 172.21.15.47:54670) 2024-02-07T12:31:10.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.247+0000 7fc135d9b700 1 -- 172.21.15.47:0/3348029337 learned_addr learned my addr 172.21.15.47:0/3348029337 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:10.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.247+0000 7fc13659c700 1 --2- 172.21.15.47:0/3348029337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1380fcef0 0x7fc13810d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:10.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.247+0000 7fc135d9b700 1 -- 172.21.15.47:0/3348029337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1380fcef0 msgr2=0x7fc13810d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:10.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.247+0000 7fc135d9b700 1 --2- 172.21.15.47:0/3348029337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1380fcef0 0x7fc13810d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.247+0000 7fc135d9b700 1 -- 172.21.15.47:0/3348029337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc120005040 con 0x7fc1380fe0e0 2024-02-07T12:31:10.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.248+0000 7fc135d9b700 1 --2- 172.21.15.47:0/3348029337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1380fe0e0 0x7fc13810de10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc1200093b0 tx=0x7fc120009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:10.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.248+0000 7fc12effd700 1 -- 172.21.15.47:0/3348029337 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc12000e040 con 0x7fc1380fe0e0 2024-02-07T12:31:10.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.248+0000 7fc13c929700 1 -- 172.21.15.47:0/3348029337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13810ef30 con 0x7fc1380fe0e0 2024-02-07T12:31:10.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.248+0000 7fc12effd700 1 -- 172.21.15.47:0/3348029337 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc12000bcc0 con 0x7fc1380fe0e0 2024-02-07T12:31:10.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.248+0000 7fc12effd700 1 -- 172.21.15.47:0/3348029337 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc12001c630 con 0x7fc1380fe0e0 2024-02-07T12:31:10.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.248+0000 7fc13c929700 1 -- 172.21.15.47:0/3348029337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13810f470 con 0x7fc1380fe0e0 2024-02-07T12:31:10.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.249+0000 7fc13c929700 1 -- 172.21.15.47:0/3348029337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13804bed0 con 0x7fc1380fe0e0 2024-02-07T12:31:10.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.249+0000 7fc12effd700 1 -- 172.21.15.47:0/3348029337 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc120013980 con 0x7fc1380fe0e0 2024-02-07T12:31:10.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.250+0000 7fc12effd700 1 --2- 172.21.15.47:0/3348029337 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc12406d7e0 0x7fc12406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:10.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.250+0000 7fc12effd700 1 -- 172.21.15.47:0/3348029337 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc12008e250 con 0x7fc1380fe0e0 2024-02-07T12:31:10.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.250+0000 7fc13659c700 1 --2- 172.21.15.47:0/3348029337 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc12406d7e0 0x7fc12406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:10.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.250+0000 7fc13659c700 1 --2- 172.21.15.47:0/3348029337 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc12406d7e0 0x7fc12406fc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc128009fd0 tx=0x7fc12800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:10.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.254+0000 7fc12effd700 1 -- 172.21.15.47:0/3348029337 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc12005b650 con 0x7fc1380fe0e0 2024-02-07T12:31:10.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.467+0000 7fc13c929700 1 -- 172.21.15.47:0/3348029337 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc138102ac0 con 0x7fc12406d7e0 2024-02-07T12:31:10.470 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:10 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-07T12:31:10.470 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:10 smithi047 ceph-mon[93224]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-02-07T12:31:10.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.477+0000 7fc12effd700 1 -- 172.21.15.47:0/3348029337 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc138102ac0 con 0x7fc12406d7e0 2024-02-07T12:31:10.479 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:31:10.480 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (4m) 6s ago 13m 26.6M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:31:10.480 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (110s) 6s ago 13m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:31:10.480 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (104s) 101s ago 12m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:31:10.480 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (4m) 6s ago 13m 78.4M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:31:10.480 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (8m) 6s ago 8m 111M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:31:10.480 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (8m) 6s ago 8m 129M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:31:10.480 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (8m) 101s ago 8m 68.6M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:31:10.480 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (8m) 101s ago 8m 69.6M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:31:10.480 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (3m) 6s ago 14m 503M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:31:10.480 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (3m) 101s ago 12m 450M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:31:10.480 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (2m) 6s ago 15m 47.4M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:31:10.480 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (2m) 101s ago 12m 32.9M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:31:10.480 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (5m) 6s ago 13m 15.1M - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:31:10.481 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (3m) 101s ago 12m 15.3M - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:31:10.481 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (84s) 6s ago 11m 87.4M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:31:10.481 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (48s) 6s ago 11m 98.5M 1559M 19.0.0-1252-g44458cce 79957b372307 0f2b0eea74d7 2024-02-07T12:31:10.481 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (12s) 6s ago 10m 12.6M 1559M 19.0.0-1252-g44458cce 79957b372307 0b8c78346346 2024-02-07T12:31:10.481 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (10m) 101s ago 10m 264M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 18af5eac8a8f 2024-02-07T12:31:10.481 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (10m) 101s ago 10m 234M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:31:10.481 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (9m) 101s ago 9m 218M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:31:10.481 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (3m) 6s ago 13m 51.5M - 2.43.0 a07b618ecd1d 32840d82c54b 2024-02-07T12:31:10.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.479+0000 7fc13c929700 1 -- 172.21.15.47:0/3348029337 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc12406d7e0 msgr2=0x7fc12406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:10.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.479+0000 7fc13c929700 1 --2- 172.21.15.47:0/3348029337 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc12406d7e0 0x7fc12406fc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc128009fd0 tx=0x7fc12800b040 comp rx=0 tx=0).stop 2024-02-07T12:31:10.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.479+0000 7fc13c929700 1 -- 172.21.15.47:0/3348029337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1380fe0e0 msgr2=0x7fc13810de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:10.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.479+0000 7fc13c929700 1 --2- 172.21.15.47:0/3348029337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1380fe0e0 0x7fc13810de10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc1200093b0 tx=0x7fc120009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:10.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.479+0000 7fc13c929700 1 -- 172.21.15.47:0/3348029337 shutdown_connections 2024-02-07T12:31:10.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.479+0000 7fc13c929700 1 --2- 172.21.15.47:0/3348029337 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc12406d7e0 0x7fc12406fc90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.479+0000 7fc13c929700 1 --2- 172.21.15.47:0/3348029337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1380fcef0 0x7fc13810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.479+0000 7fc13c929700 1 --2- 172.21.15.47:0/3348029337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1380fe0e0 0x7fc13810de10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.479+0000 7fc13c929700 1 -- 172.21.15.47:0/3348029337 >> 172.21.15.47:0/3348029337 conn(0x7fc1380f8620 msgr2=0x7fc1381013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:10.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.480+0000 7fc13c929700 1 -- 172.21.15.47:0/3348029337 shutdown_connections 2024-02-07T12:31:10.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.480+0000 7fc13c929700 1 -- 172.21.15.47:0/3348029337 wait complete. 2024-02-07T12:31:10.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:10 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-07T12:31:10.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:10 smithi138 ceph-mon[82055]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-02-07T12:31:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.581+0000 7ff56b226700 1 -- 172.21.15.47:0/3834721965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5640fcef0 msgr2=0x7ff5640fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.581+0000 7ff56b226700 1 --2- 172.21.15.47:0/3834721965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5640fcef0 0x7ff5640fd320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009ce0 tx=0x7ff55c004d10 comp rx=0 tx=0).stop 2024-02-07T12:31:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.581+0000 7ff56b226700 1 -- 172.21.15.47:0/3834721965 shutdown_connections 2024-02-07T12:31:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.581+0000 7ff56b226700 1 --2- 172.21.15.47:0/3834721965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5640fe0e0 0x7ff5640fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.581+0000 7ff56b226700 1 --2- 172.21.15.47:0/3834721965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5640fcef0 0x7ff5640fd320 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.581+0000 7ff56b226700 1 -- 172.21.15.47:0/3834721965 >> 172.21.15.47:0/3834721965 conn(0x7ff5640f8620 msgr2=0x7ff5640faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:10.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.581+0000 7ff56b226700 1 -- 172.21.15.47:0/3834721965 shutdown_connections 2024-02-07T12:31:10.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.581+0000 7ff56b226700 1 -- 172.21.15.47:0/3834721965 wait complete. 2024-02-07T12:31:10.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.581+0000 7ff56b226700 1 Processor -- start 2024-02-07T12:31:10.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.581+0000 7ff56b226700 1 -- start start 2024-02-07T12:31:10.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff56b226700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5640fcef0 0x7ff56410db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:10.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff56b226700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5640fe0e0 0x7ff56410e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:10.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff56b226700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56410e640 con 0x7ff5640fe0e0 2024-02-07T12:31:10.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff56b226700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56410eee0 con 0x7ff5640fcef0 2024-02-07T12:31:10.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff563fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5640fe0e0 0x7ff56410e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:10.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff563fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5640fe0e0 0x7ff56410e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54682/0 (socket says 172.21.15.47:54682) 2024-02-07T12:31:10.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff563fff700 1 -- 172.21.15.47:0/3346028842 learned_addr learned my addr 172.21.15.47:0/3346028842 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:10.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff568fc2700 1 --2- 172.21.15.47:0/3346028842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5640fcef0 0x7ff56410db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:10.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff563fff700 1 -- 172.21.15.47:0/3346028842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5640fcef0 msgr2=0x7ff56410db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:10.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff563fff700 1 --2- 172.21.15.47:0/3346028842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5640fcef0 0x7ff56410db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff563fff700 1 -- 172.21.15.47:0/3346028842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c009940 con 0x7ff5640fe0e0 2024-02-07T12:31:10.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff563fff700 1 --2- 172.21.15.47:0/3346028842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5640fe0e0 0x7ff56410e040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff55800c810 tx=0x7ff558004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:10.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff5617fa700 1 -- 172.21.15.47:0/3346028842 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff558012810 con 0x7ff5640fe0e0 2024-02-07T12:31:10.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff5617fa700 1 -- 172.21.15.47:0/3346028842 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff558012e40 con 0x7ff5640fe0e0 2024-02-07T12:31:10.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.582+0000 7ff56b226700 1 -- 172.21.15.47:0/3346028842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56410f1c0 con 0x7ff5640fe0e0 2024-02-07T12:31:10.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.583+0000 7ff5617fa700 1 -- 172.21.15.47:0/3346028842 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5580102e0 con 0x7ff5640fe0e0 2024-02-07T12:31:10.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.583+0000 7ff56b226700 1 -- 172.21.15.47:0/3346028842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56410f700 con 0x7ff5640fe0e0 2024-02-07T12:31:10.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.584+0000 7ff56b226700 1 -- 172.21.15.47:0/3346028842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56404bed0 con 0x7ff5640fe0e0 2024-02-07T12:31:10.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.584+0000 7ff5617fa700 1 -- 172.21.15.47:0/3346028842 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff558012970 con 0x7ff5640fe0e0 2024-02-07T12:31:10.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.584+0000 7ff5617fa700 1 --2- 172.21.15.47:0/3346028842 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff54c06d7e0 0x7ff54c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:10.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.584+0000 7ff5617fa700 1 -- 172.21.15.47:0/3346028842 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff55808d260 con 0x7ff5640fe0e0 2024-02-07T12:31:10.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.584+0000 7ff568fc2700 1 --2- 172.21.15.47:0/3346028842 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff54c06d7e0 0x7ff54c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:10.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.585+0000 7ff568fc2700 1 --2- 172.21.15.47:0/3346028842 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff54c06d7e0 0x7ff54c06fc90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009cb0 tx=0x7ff55c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:10.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.589+0000 7ff5617fa700 1 -- 172.21.15.47:0/3346028842 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff55805a5e0 con 0x7ff5640fe0e0 2024-02-07T12:31:10.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.876+0000 7ff56b226700 1 -- 172.21.15.47:0/3346028842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff564105a50 con 0x7ff5640fe0e0 2024-02-07T12:31:10.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.876+0000 7ff5617fa700 1 -- 172.21.15.47:0/3346028842 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7ff55805a170 con 0x7ff5640fe0e0 2024-02-07T12:31:10.879 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:31:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:31:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:31:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:31:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:31:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:31:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:31:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:31:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 3, 2024-02-07T12:31:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 3 2024-02-07T12:31:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:31:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:31:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:31:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:31:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:31:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 7, 2024-02-07T12:31:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 7 2024-02-07T12:31:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:31:10.880 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:31:10.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.878+0000 7ff56b226700 1 -- 172.21.15.47:0/3346028842 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff54c06d7e0 msgr2=0x7ff54c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:10.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.878+0000 7ff56b226700 1 --2- 172.21.15.47:0/3346028842 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff54c06d7e0 0x7ff54c06fc90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009cb0 tx=0x7ff55c004d10 comp rx=0 tx=0).stop 2024-02-07T12:31:10.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.878+0000 7ff56b226700 1 -- 172.21.15.47:0/3346028842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5640fe0e0 msgr2=0x7ff56410e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:10.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.878+0000 7ff56b226700 1 --2- 172.21.15.47:0/3346028842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5640fe0e0 0x7ff56410e040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff55800c810 tx=0x7ff558004470 comp rx=0 tx=0).stop 2024-02-07T12:31:10.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.879+0000 7ff56b226700 1 -- 172.21.15.47:0/3346028842 shutdown_connections 2024-02-07T12:31:10.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.879+0000 7ff56b226700 1 --2- 172.21.15.47:0/3346028842 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff54c06d7e0 0x7ff54c06fc90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.879+0000 7ff56b226700 1 --2- 172.21.15.47:0/3346028842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5640fcef0 0x7ff56410db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.879+0000 7ff56b226700 1 --2- 172.21.15.47:0/3346028842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5640fe0e0 0x7ff56410e040 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.879+0000 7ff56b226700 1 -- 172.21.15.47:0/3346028842 >> 172.21.15.47:0/3346028842 conn(0x7ff5640f8620 msgr2=0x7ff5641013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:10.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.879+0000 7ff56b226700 1 -- 172.21.15.47:0/3346028842 shutdown_connections 2024-02-07T12:31:10.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.879+0000 7ff56b226700 1 -- 172.21.15.47:0/3346028842 wait complete. 2024-02-07T12:31:10.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.980+0000 7f5d6ab44700 1 -- 172.21.15.47:0/1388881062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d640fe0e0 msgr2=0x7f5d640fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.980+0000 7f5d6ab44700 1 --2- 172.21.15.47:0/1388881062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d640fe0e0 0x7f5d640fe550 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d50004940 tx=0x7f5d50009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.980+0000 7f5d6ab44700 1 -- 172.21.15.47:0/1388881062 shutdown_connections 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.980+0000 7f5d6ab44700 1 --2- 172.21.15.47:0/1388881062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d640fe0e0 0x7f5d640fe550 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.980+0000 7f5d6ab44700 1 --2- 172.21.15.47:0/1388881062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d640fcef0 0x7f5d640fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.980+0000 7f5d6ab44700 1 -- 172.21.15.47:0/1388881062 >> 172.21.15.47:0/1388881062 conn(0x7f5d640f8620 msgr2=0x7f5d640faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.981+0000 7f5d6ab44700 1 -- 172.21.15.47:0/1388881062 shutdown_connections 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.981+0000 7f5d6ab44700 1 -- 172.21.15.47:0/1388881062 wait complete. 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.981+0000 7f5d6ab44700 1 Processor -- start 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.981+0000 7f5d6ab44700 1 -- start start 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.981+0000 7f5d6ab44700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d640fcef0 0x7f5d6410fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.981+0000 7f5d6ab44700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d640fe0e0 0x7f5d641100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.981+0000 7f5d6ab44700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d641106b0 con 0x7f5d640fcef0 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.981+0000 7f5d6ab44700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d64110f50 con 0x7f5d640fe0e0 2024-02-07T12:31:10.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.981+0000 7f5d688e0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d640fcef0 0x7f5d6410fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:10.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.981+0000 7f5d688e0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d640fcef0 0x7f5d6410fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54698/0 (socket says 172.21.15.47:54698) 2024-02-07T12:31:10.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.982+0000 7f5d688e0700 1 -- 172.21.15.47:0/2166832663 learned_addr learned my addr 172.21.15.47:0/2166832663 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:10.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.982+0000 7f5d63fff700 1 --2- 172.21.15.47:0/2166832663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d640fe0e0 0x7f5d641100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:10.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.982+0000 7f5d688e0700 1 -- 172.21.15.47:0/2166832663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d640fe0e0 msgr2=0x7f5d641100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:10.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.982+0000 7f5d688e0700 1 --2- 172.21.15.47:0/2166832663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d640fe0e0 0x7f5d641100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:10.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.982+0000 7f5d688e0700 1 -- 172.21.15.47:0/2166832663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d50005040 con 0x7f5d640fcef0 2024-02-07T12:31:10.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.982+0000 7f5d688e0700 1 --2- 172.21.15.47:0/2166832663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d640fcef0 0x7f5d6410fb70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d58002a50 tx=0x7f5d58004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:10.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.982+0000 7f5d617fa700 1 -- 172.21.15.47:0/2166832663 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d58007cc0 con 0x7f5d640fcef0 2024-02-07T12:31:10.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.982+0000 7f5d617fa700 1 -- 172.21.15.47:0/2166832663 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d5800f040 con 0x7f5d640fcef0 2024-02-07T12:31:10.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.982+0000 7f5d6ab44700 1 -- 172.21.15.47:0/2166832663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d64111230 con 0x7f5d640fcef0 2024-02-07T12:31:10.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.982+0000 7f5d617fa700 1 -- 172.21.15.47:0/2166832663 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d5800d940 con 0x7f5d640fcef0 2024-02-07T12:31:10.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.982+0000 7f5d6ab44700 1 -- 172.21.15.47:0/2166832663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d64111770 con 0x7f5d640fcef0 2024-02-07T12:31:10.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.983+0000 7f5d6ab44700 1 -- 172.21.15.47:0/2166832663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d64102210 con 0x7f5d640fcef0 2024-02-07T12:31:10.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.984+0000 7f5d617fa700 1 -- 172.21.15.47:0/2166832663 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f5d5800dbb0 con 0x7f5d640fcef0 2024-02-07T12:31:10.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.984+0000 7f5d617fa700 1 --2- 172.21.15.47:0/2166832663 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5d5406d7e0 0x7f5d5406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:10.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.984+0000 7f5d617fa700 1 -- 172.21.15.47:0/2166832663 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5d5808cc40 con 0x7f5d640fcef0 2024-02-07T12:31:10.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.984+0000 7f5d63fff700 1 --2- 172.21.15.47:0/2166832663 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5d5406d7e0 0x7f5d5406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:10.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.985+0000 7f5d63fff700 1 --2- 172.21.15.47:0/2166832663 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5d5406d7e0 0x7f5d5406fc90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000b3b0 tx=0x7f5d50009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:10.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:10.989+0000 7f5d617fa700 1 -- 172.21.15.47:0/2166832663 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5d58059fc0 con 0x7f5d640fcef0 2024-02-07T12:31:11.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.240+0000 7f5d6ab44700 1 -- 172.21.15.47:0/2166832663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5d64111a50 con 0x7f5d640fcef0 2024-02-07T12:31:11.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.240+0000 7f5d617fa700 1 -- 172.21.15.47:0/2166832663 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1872 (secure 0 0 0) 0x7f5d5800de60 con 0x7f5d640fcef0 2024-02-07T12:31:11.243 INFO:teuthology.orchestra.run.smithi047.stdout:e22 2024-02-07T12:31:11.243 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:31:11.243 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:31:11.243 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:31:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:31:11.243 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:31:11.243 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:31:11.243 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 22 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:29:33.611202+0000 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:31:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:31:11.245 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:31:11.246 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:31:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:31:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:31:11.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.242+0000 7f5d6ab44700 1 -- 172.21.15.47:0/2166832663 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5d5406d7e0 msgr2=0x7f5d5406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:11.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.242+0000 7f5d6ab44700 1 --2- 172.21.15.47:0/2166832663 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5d5406d7e0 0x7f5d5406fc90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000b3b0 tx=0x7f5d50009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:11.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.242+0000 7f5d6ab44700 1 -- 172.21.15.47:0/2166832663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d640fcef0 msgr2=0x7f5d6410fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:11.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.242+0000 7f5d6ab44700 1 --2- 172.21.15.47:0/2166832663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d640fcef0 0x7f5d6410fb70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d58002a50 tx=0x7f5d58004600 comp rx=0 tx=0).stop 2024-02-07T12:31:11.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.243+0000 7f5d6ab44700 1 -- 172.21.15.47:0/2166832663 shutdown_connections 2024-02-07T12:31:11.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.243+0000 7f5d6ab44700 1 --2- 172.21.15.47:0/2166832663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d640fcef0 0x7f5d6410fb70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.243+0000 7f5d6ab44700 1 --2- 172.21.15.47:0/2166832663 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5d5406d7e0 0x7f5d5406fc90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.243+0000 7f5d6ab44700 1 --2- 172.21.15.47:0/2166832663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d640fe0e0 0x7f5d641100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.243+0000 7f5d6ab44700 1 -- 172.21.15.47:0/2166832663 >> 172.21.15.47:0/2166832663 conn(0x7f5d640f8620 msgr2=0x7f5d640ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:11.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.243+0000 7f5d6ab44700 1 -- 172.21.15.47:0/2166832663 shutdown_connections 2024-02-07T12:31:11.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.243+0000 7f5d6ab44700 1 -- 172.21.15.47:0/2166832663 wait complete. 2024-02-07T12:31:11.247 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 22 2024-02-07T12:31:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.347+0000 7fa6aae13700 1 -- 172.21.15.47:0/4212411681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a40fe0e0 msgr2=0x7fa6a40fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.347+0000 7fa6aae13700 1 --2- 172.21.15.47:0/4212411681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a40fe0e0 0x7fa6a40fe550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa698004940 tx=0x7fa698009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.347+0000 7fa6aae13700 1 -- 172.21.15.47:0/4212411681 shutdown_connections 2024-02-07T12:31:11.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.347+0000 7fa6aae13700 1 --2- 172.21.15.47:0/4212411681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a40fe0e0 0x7fa6a40fe550 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.347+0000 7fa6aae13700 1 --2- 172.21.15.47:0/4212411681 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6a40fcef0 0x7fa6a40fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.347+0000 7fa6aae13700 1 -- 172.21.15.47:0/4212411681 >> 172.21.15.47:0/4212411681 conn(0x7fa6a40f8620 msgr2=0x7fa6a40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:11.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.347+0000 7fa6aae13700 1 -- 172.21.15.47:0/4212411681 shutdown_connections 2024-02-07T12:31:11.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.347+0000 7fa6aae13700 1 -- 172.21.15.47:0/4212411681 wait complete. 2024-02-07T12:31:11.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.347+0000 7fa6aae13700 1 Processor -- start 2024-02-07T12:31:11.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.347+0000 7fa6aae13700 1 -- start start 2024-02-07T12:31:11.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.348+0000 7fa6aae13700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6a40fcef0 0x7fa6a4071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:11.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.348+0000 7fa6aae13700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a40fe0e0 0x7fa6a40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:11.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.348+0000 7fa6aae13700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a40708e0 con 0x7fa6a40fe0e0 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.348+0000 7fa6aae13700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a4070a50 con 0x7fa6a40fcef0 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.348+0000 7fa6a3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a40fe0e0 0x7fa6a40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.348+0000 7fa6a3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a40fe0e0 0x7fa6a40702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54710/0 (socket says 172.21.15.47:54710) 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.348+0000 7fa6a3fff700 1 -- 172.21.15.47:0/858459119 learned_addr learned my addr 172.21.15.47:0/858459119 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.348+0000 7fa6a8baf700 1 --2- 172.21.15.47:0/858459119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6a40fcef0 0x7fa6a4071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.348+0000 7fa6a3fff700 1 -- 172.21.15.47:0/858459119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6a40fcef0 msgr2=0x7fa6a4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.348+0000 7fa6a3fff700 1 --2- 172.21.15.47:0/858459119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6a40fcef0 0x7fa6a4071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.348+0000 7fa6a3fff700 1 -- 172.21.15.47:0/858459119 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa698005040 con 0x7fa6a40fe0e0 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.348+0000 7fa6a3fff700 1 --2- 172.21.15.47:0/858459119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a40fe0e0 0x7fa6a40702e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa6980093b0 tx=0x7fa698009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.348+0000 7fa6a17fa700 1 -- 172.21.15.47:0/858459119 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa69800e040 con 0x7fa6a40fe0e0 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.349+0000 7fa6a17fa700 1 -- 172.21.15.47:0/858459119 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa69800bcc0 con 0x7fa6a40fe0e0 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.349+0000 7fa6aae13700 1 -- 172.21.15.47:0/858459119 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a4070cd0 con 0x7fa6a40fe0e0 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.349+0000 7fa6a17fa700 1 -- 172.21.15.47:0/858459119 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa69801c630 con 0x7fa6a40fe0e0 2024-02-07T12:31:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.349+0000 7fa6aae13700 1 -- 172.21.15.47:0/858459119 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a41159b0 con 0x7fa6a40fe0e0 2024-02-07T12:31:11.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.350+0000 7fa6aae13700 1 -- 172.21.15.47:0/858459119 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a404bed0 con 0x7fa6a40fe0e0 2024-02-07T12:31:11.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.350+0000 7fa6a17fa700 1 -- 172.21.15.47:0/858459119 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa6980139f0 con 0x7fa6a40fe0e0 2024-02-07T12:31:11.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.351+0000 7fa6a17fa700 1 --2- 172.21.15.47:0/858459119 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa68c06d7e0 0x7fa68c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:11.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.351+0000 7fa6a8baf700 1 --2- 172.21.15.47:0/858459119 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa68c06d7e0 0x7fa68c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:11.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.351+0000 7fa6a17fa700 1 -- 172.21.15.47:0/858459119 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa69808e330 con 0x7fa6a40fe0e0 2024-02-07T12:31:11.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.351+0000 7fa6a8baf700 1 --2- 172.21.15.47:0/858459119 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa68c06d7e0 0x7fa68c06fc90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa6940041d0 tx=0x7fa694009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:11.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.355+0000 7fa6a17fa700 1 -- 172.21.15.47:0/858459119 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa69805b730 con 0x7fa6a40fe0e0 2024-02-07T12:31:11.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:11 smithi138 ceph-mon[82055]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:11.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:11 smithi138 ceph-mon[82055]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:11.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:11 smithi138 ceph-mon[82055]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:11.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:11 smithi138 ceph-mon[82055]: pgmap v100: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-02-07T12:31:11.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:11 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3346028842' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:11.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:11 smithi047 ceph-mon[93224]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:11.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:11 smithi047 ceph-mon[93224]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:11.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:11 smithi047 ceph-mon[93224]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:11.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:11 smithi047 ceph-mon[93224]: pgmap v100: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-02-07T12:31:11.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:11 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3346028842' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:11.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.577+0000 7fa6aae13700 1 -- 172.21.15.47:0/858459119 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6a4102ac0 con 0x7fa68c06d7e0 2024-02-07T12:31:11.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.578+0000 7fa6a17fa700 1 -- 172.21.15.47:0/858459119 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa6a4102ac0 con 0x7fa68c06d7e0 2024-02-07T12:31:11.580 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:31:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:31:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:31:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:31:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:31:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-02-07T12:31:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "mon", 2024-02-07T12:31:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr" 2024-02-07T12:31:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:31:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "9/21 daemons upgraded", 2024-02-07T12:31:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading osd daemons", 2024-02-07T12:31:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:31:11.581 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:31:11.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.580+0000 7fa6aae13700 1 -- 172.21.15.47:0/858459119 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa68c06d7e0 msgr2=0x7fa68c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:11.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.580+0000 7fa6aae13700 1 --2- 172.21.15.47:0/858459119 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa68c06d7e0 0x7fa68c06fc90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa6940041d0 tx=0x7fa694009040 comp rx=0 tx=0).stop 2024-02-07T12:31:11.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.580+0000 7fa6aae13700 1 -- 172.21.15.47:0/858459119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a40fe0e0 msgr2=0x7fa6a40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:11.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.580+0000 7fa6aae13700 1 --2- 172.21.15.47:0/858459119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a40fe0e0 0x7fa6a40702e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa6980093b0 tx=0x7fa698009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:11.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.580+0000 7fa6aae13700 1 -- 172.21.15.47:0/858459119 shutdown_connections 2024-02-07T12:31:11.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.580+0000 7fa6aae13700 1 --2- 172.21.15.47:0/858459119 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa68c06d7e0 0x7fa68c06fc90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.580+0000 7fa6aae13700 1 --2- 172.21.15.47:0/858459119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6a40fcef0 0x7fa6a4071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.580+0000 7fa6aae13700 1 --2- 172.21.15.47:0/858459119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a40fe0e0 0x7fa6a40702e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.580+0000 7fa6aae13700 1 -- 172.21.15.47:0/858459119 >> 172.21.15.47:0/858459119 conn(0x7fa6a40f8620 msgr2=0x7fa6a41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:11.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.580+0000 7fa6aae13700 1 -- 172.21.15.47:0/858459119 shutdown_connections 2024-02-07T12:31:11.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.580+0000 7fa6aae13700 1 -- 172.21.15.47:0/858459119 wait complete. 2024-02-07T12:31:11.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.683+0000 7fa4fb26a700 1 -- 172.21.15.47:0/2074431204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f41000c0 msgr2=0x7fa4f4102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:11.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.683+0000 7fa4fb26a700 1 --2- 172.21.15.47:0/2074431204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f41000c0 0x7fa4f4102520 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4004940 tx=0x7fa4e4009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:11.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.683+0000 7fa4fb26a700 1 -- 172.21.15.47:0/2074431204 shutdown_connections 2024-02-07T12:31:11.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.683+0000 7fa4fb26a700 1 --2- 172.21.15.47:0/2074431204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f41000c0 0x7fa4f4102520 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.683+0000 7fa4fb26a700 1 --2- 172.21.15.47:0/2074431204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4f4066c70 0x7fa4f40ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.683+0000 7fa4fb26a700 1 -- 172.21.15.47:0/2074431204 >> 172.21.15.47:0/2074431204 conn(0x7fa4f40f7500 msgr2=0x7fa4f40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:11.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.684+0000 7fa4fb26a700 1 -- 172.21.15.47:0/2074431204 shutdown_connections 2024-02-07T12:31:11.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.684+0000 7fa4fb26a700 1 -- 172.21.15.47:0/2074431204 wait complete. 2024-02-07T12:31:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.684+0000 7fa4fb26a700 1 Processor -- start 2024-02-07T12:31:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.684+0000 7fa4fb26a700 1 -- start start 2024-02-07T12:31:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.684+0000 7fa4fb26a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f4066c70 0x7fa4f410d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4fb26a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4f41000c0 0x7fa4f410dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4fb26a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f410e3a0 con 0x7fa4f4066c70 2024-02-07T12:31:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4fb26a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f410ec40 con 0x7fa4f41000c0 2024-02-07T12:31:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4f9006700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f4066c70 0x7fa4f410d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4f9006700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f4066c70 0x7fa4f410d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54724/0 (socket says 172.21.15.47:54724) 2024-02-07T12:31:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4f9006700 1 -- 172.21.15.47:0/4253334992 learned_addr learned my addr 172.21.15.47:0/4253334992 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4f8805700 1 --2- 172.21.15.47:0/4253334992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4f41000c0 0x7fa4f410dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4f9006700 1 -- 172.21.15.47:0/4253334992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4f41000c0 msgr2=0x7fa4f410dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4f9006700 1 --2- 172.21.15.47:0/4253334992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4f41000c0 0x7fa4f410dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4f9006700 1 -- 172.21.15.47:0/4253334992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e4005040 con 0x7fa4f4066c70 2024-02-07T12:31:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4f9006700 1 --2- 172.21.15.47:0/4253334992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f4066c70 0x7fa4f410d860 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000eb40 tx=0x7fa4f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4e9ffb700 1 -- 172.21.15.47:0/4253334992 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4f0007cc0 con 0x7fa4f4066c70 2024-02-07T12:31:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4e9ffb700 1 -- 172.21.15.47:0/4253334992 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4f000f040 con 0x7fa4f4066c70 2024-02-07T12:31:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.685+0000 7fa4fb26a700 1 -- 172.21.15.47:0/4253334992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f410eec0 con 0x7fa4f4066c70 2024-02-07T12:31:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.686+0000 7fa4e9ffb700 1 -- 172.21.15.47:0/4253334992 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4f0009620 con 0x7fa4f4066c70 2024-02-07T12:31:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.686+0000 7fa4fb26a700 1 -- 172.21.15.47:0/4253334992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f410f400 con 0x7fa4f4066c70 2024-02-07T12:31:11.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.687+0000 7fa4fb26a700 1 -- 172.21.15.47:0/4253334992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f404bed0 con 0x7fa4f4066c70 2024-02-07T12:31:11.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.687+0000 7fa4e9ffb700 1 -- 172.21.15.47:0/4253334992 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa4f0009780 con 0x7fa4f4066c70 2024-02-07T12:31:11.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.687+0000 7fa4e9ffb700 1 --2- 172.21.15.47:0/4253334992 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa4e006d7e0 0x7fa4e006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:11.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.688+0000 7fa4f8805700 1 --2- 172.21.15.47:0/4253334992 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa4e006d7e0 0x7fa4e006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:11.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.688+0000 7fa4e9ffb700 1 -- 172.21.15.47:0/4253334992 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa4f008cb80 con 0x7fa4f4066c70 2024-02-07T12:31:11.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.688+0000 7fa4f8805700 1 --2- 172.21.15.47:0/4253334992 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa4e006d7e0 0x7fa4e006fc90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4000c00 tx=0x7fa4e4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:11.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.692+0000 7fa4e9ffb700 1 -- 172.21.15.47:0/4253334992 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa4f0059fb0 con 0x7fa4f4066c70 2024-02-07T12:31:11.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.976+0000 7fa4fb26a700 1 -- 172.21.15.47:0/4253334992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa4f410f7c0 con 0x7fa4f4066c70 2024-02-07T12:31:11.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.976+0000 7fa4e9ffb700 1 -- 172.21.15.47:0/4253334992 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa4f0059b40 con 0x7fa4f4066c70 2024-02-07T12:31:11.979 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:31:11.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.978+0000 7fa4fb26a700 1 -- 172.21.15.47:0/4253334992 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa4e006d7e0 msgr2=0x7fa4e006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:11.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.978+0000 7fa4fb26a700 1 --2- 172.21.15.47:0/4253334992 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa4e006d7e0 0x7fa4e006fc90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4000c00 tx=0x7fa4e4009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:11.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.978+0000 7fa4fb26a700 1 -- 172.21.15.47:0/4253334992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f4066c70 msgr2=0x7fa4f410d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:11.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.978+0000 7fa4fb26a700 1 --2- 172.21.15.47:0/4253334992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f4066c70 0x7fa4f410d860 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000eb40 tx=0x7fa4f000b040 comp rx=0 tx=0).stop 2024-02-07T12:31:11.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.978+0000 7fa4fb26a700 1 -- 172.21.15.47:0/4253334992 shutdown_connections 2024-02-07T12:31:11.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.978+0000 7fa4fb26a700 1 --2- 172.21.15.47:0/4253334992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f4066c70 0x7fa4f410d860 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.978+0000 7fa4fb26a700 1 --2- 172.21.15.47:0/4253334992 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa4e006d7e0 0x7fa4e006fc90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.978+0000 7fa4fb26a700 1 --2- 172.21.15.47:0/4253334992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4f41000c0 0x7fa4f410dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:11.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.978+0000 7fa4fb26a700 1 -- 172.21.15.47:0/4253334992 >> 172.21.15.47:0/4253334992 conn(0x7fa4f40f7500 msgr2=0x7fa4f40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:11.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.978+0000 7fa4fb26a700 1 -- 172.21.15.47:0/4253334992 shutdown_connections 2024-02-07T12:31:11.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:11.978+0000 7fa4fb26a700 1 -- 172.21.15.47:0/4253334992 wait complete. 2024-02-07T12:31:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:12 smithi047 ceph-mon[93224]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/354 objects degraded (5.367%), 6 pgs degraded) 2024-02-07T12:31:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:12 smithi047 ceph-mon[93224]: Cluster is now healthy 2024-02-07T12:31:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:12 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2166832663' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:31:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:12 smithi047 ceph-mon[93224]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:31:12.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:12 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/4253334992' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:31:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:12 smithi138 ceph-mon[82055]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/354 objects degraded (5.367%), 6 pgs degraded) 2024-02-07T12:31:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:12 smithi138 ceph-mon[82055]: Cluster is now healthy 2024-02-07T12:31:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:12 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2166832663' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:31:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:12 smithi138 ceph-mon[82055]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:31:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:12 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/4253334992' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:31:13.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:13 smithi138 ceph-mon[82055]: pgmap v101: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-07T12:31:13.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:13 smithi047 ceph-mon[93224]: pgmap v101: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-07T12:31:15.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:14 smithi138 ceph-mon[82055]: pgmap v102: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-07T12:31:15.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:14 smithi047 ceph-mon[93224]: pgmap v102: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-07T12:31:17.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:16 smithi138 ceph-mon[82055]: pgmap v103: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-07T12:31:17.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:16 smithi047 ceph-mon[93224]: pgmap v103: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-07T12:31:18.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:17 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:18.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:17 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:20.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:20 smithi138 ceph-mon[82055]: pgmap v104: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-07T12:31:20.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:20 smithi047 ceph-mon[93224]: pgmap v104: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-07T12:31:22.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:22 smithi138 ceph-mon[82055]: pgmap v105: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:31:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:22 smithi047 ceph-mon[93224]: pgmap v105: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:31:24.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:24 smithi138 ceph-mon[82055]: pgmap v106: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:31:24.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:24 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-07T12:31:24.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:24 smithi047 ceph-mon[93224]: pgmap v106: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:31:24.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:24 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-07T12:31:25.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:25 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-07T12:31:25.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:25 smithi138 ceph-mon[82055]: Upgrade: osd.3 is safe to restart 2024-02-07T12:31:25.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:25 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-07T12:31:25.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:25 smithi047 ceph-mon[93224]: Upgrade: osd.3 is safe to restart 2024-02-07T12:31:26.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:26 smithi138 ceph-mon[82055]: pgmap v107: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:31:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:26 smithi138 ceph-mon[82055]: Upgrade: Updating osd.3 2024-02-07T12:31:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-07T12:31:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:31:27.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:26 smithi047 ceph-mon[93224]: pgmap v107: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:31:27.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:26 smithi047 ceph-mon[93224]: Upgrade: Updating osd.3 2024-02-07T12:31:27.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:27.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-07T12:31:27.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:31:27.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:27 smithi138 ceph-mon[82055]: Deploying daemon osd.3 on smithi138 2024-02-07T12:31:27.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:31:28.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:27 smithi047 ceph-mon[93224]: Deploying daemon osd.3 on smithi138 2024-02-07T12:31:28.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:31:28.999 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:28 smithi138 ceph-mon[82055]: pgmap v108: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:31:29.000 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:28 smithi138 systemd[1]: Stopping Ceph osd.3 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:31:29.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:28 smithi047 ceph-mon[93224]: pgmap v108: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:31:29.284 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:28 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[41088]: 2024-02-07T12:31:28.995+0000 7fd1328db700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:31:29.285 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:28 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[41088]: 2024-02-07T12:31:28.995+0000 7fd1328db700 -1 osd.3 65 *** Got signal Terminated *** 2024-02-07T12:31:29.285 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:28 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[41088]: 2024-02-07T12:31:28.995+0000 7fd1328db700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-07T12:31:29.919 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:29 smithi138 ceph-mon[82055]: pgmap v109: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:31:29.920 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:29 smithi138 ceph-mon[82055]: osd.3 marked itself down and dead 2024-02-07T12:31:30.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:29 smithi047 ceph-mon[93224]: pgmap v109: 65 pgs: 65 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:31:30.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:29 smithi047 ceph-mon[93224]: osd.3 marked itself down and dead 2024-02-07T12:31:30.285 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:30 smithi138 podman[90998]: 2024-02-07 12:31:30.116517548 +0000 UTC m=+1.217432981 container died 18af5eac8a8f06e5a0fa079fdd5637fe554d1c4b09d7bbd57dae0cc96a48d5b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, GIT_CLEAN=True, RELEASE=quincy-f246262, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux ) 2024-02-07T12:31:30.692 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:30 smithi138 ceph-mon[82055]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-07T12:31:30.692 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:30 smithi138 ceph-mon[82055]: failed to encode map e66 with expected crc 2024-02-07T12:31:30.692 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:30 smithi138 ceph-mon[82055]: osdmap e66: 6 total, 5 up, 6 in 2024-02-07T12:31:30.692 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:30 smithi138 podman[90998]: 2024-02-07 12:31:30.480614841 +0000 UTC m=+1.581530262 container cleanup 18af5eac8a8f06e5a0fa079fdd5637fe554d1c4b09d7bbd57dae0cc96a48d5b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, RELEASE=quincy-f246262, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-02-07T12:31:30.693 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:30 smithi138 bash[90998]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3 2024-02-07T12:31:31.034 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:30 smithi138 podman[91028]: 2024-02-07 12:31:30.690596499 +0000 UTC m=+0.574286467 container remove 18af5eac8a8f06e5a0fa079fdd5637fe554d1c4b09d7bbd57dae0cc96a48d5b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=quincy-f246262, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:31:31.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:30 smithi047 ceph-mon[93224]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-07T12:31:31.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:30 smithi047 ceph-mon[93224]: failed to encode map e66 with expected crc 2024-02-07T12:31:31.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:30 smithi047 ceph-mon[93224]: osdmap e66: 6 total, 5 up, 6 in 2024-02-07T12:31:31.429 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:31 smithi138 podman[91115]: 2024-02-07 12:31:31.033373432 +0000 UTC m=+0.017834871 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:31:31.429 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:31 smithi138 podman[91115]: 2024-02-07 12:31:31.141572536 +0000 UTC m=+0.126033962 container create 9228d2f0dd1128cdd45fd3bd9799b151171add01ec0342473a846564758257e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-02-07T12:31:31.429 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:31 smithi138 podman[91115]: 2024-02-07 12:31:31.343940862 +0000 UTC m=+0.328402287 container init 9228d2f0dd1128cdd45fd3bd9799b151171add01ec0342473a846564758257e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-07T12:31:31.429 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:31 smithi138 podman[91115]: 2024-02-07 12:31:31.347297869 +0000 UTC m=+0.331759297 container start 9228d2f0dd1128cdd45fd3bd9799b151171add01ec0342473a846564758257e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0) 2024-02-07T12:31:31.429 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:31 smithi138 podman[91115]: 2024-02-07 12:31:31.427244871 +0000 UTC m=+0.411706298 container attach 9228d2f0dd1128cdd45fd3bd9799b151171add01ec0342473a846564758257e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, ceph=True) 2024-02-07T12:31:31.784 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:31 smithi138 podman[91115]: 2024-02-07 12:31:31.636786002 +0000 UTC m=+0.621247427 container died 9228d2f0dd1128cdd45fd3bd9799b151171add01ec0342473a846564758257e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-deactivate, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:31:31.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:31 smithi138 ceph-mon[82055]: pgmap v111: 65 pgs: 16 stale+active+clean, 49 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:31:31.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:31 smithi138 ceph-mon[82055]: osdmap e67: 6 total, 5 up, 6 in 2024-02-07T12:31:31.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:31 smithi138 ceph-mon[82055]: failed to encode map e67 with expected crc 2024-02-07T12:31:31.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:31 smithi138 ceph-mon[82055]: failed to encode map e67 with expected crc 2024-02-07T12:31:31.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:31 smithi138 ceph-mon[82055]: failed to encode map e67 with expected crc 2024-02-07T12:31:31.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:31 smithi138 ceph-mon[82055]: failed to encode map e67 with expected crc 2024-02-07T12:31:32.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:31 smithi047 ceph-mon[93224]: pgmap v111: 65 pgs: 16 stale+active+clean, 49 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:31:32.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:31 smithi047 ceph-mon[93224]: osdmap e67: 6 total, 5 up, 6 in 2024-02-07T12:31:32.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:31 smithi047 ceph-mon[93224]: failed to encode map e67 with expected crc 2024-02-07T12:31:32.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:31 smithi047 ceph-mon[93224]: failed to encode map e67 with expected crc 2024-02-07T12:31:32.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:31 smithi047 ceph-mon[93224]: failed to encode map e67 with expected crc 2024-02-07T12:31:32.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:31 smithi047 ceph-mon[93224]: failed to encode map e67 with expected crc 2024-02-07T12:31:32.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:32 smithi138 podman[91141]: 2024-02-07 12:31:32.18127758 +0000 UTC m=+0.539793269 container remove 9228d2f0dd1128cdd45fd3bd9799b151171add01ec0342473a846564758257e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, ceph=True, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-02-07T12:31:32.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:32 smithi138 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.3.service: Deactivated successfully. 2024-02-07T12:31:32.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:32 smithi138 systemd[1]: Stopped Ceph osd.3 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:31:32.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:32 smithi138 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.3.service: Consumed 1min 9.068s CPU time. 2024-02-07T12:31:32.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:32 smithi138 systemd[1]: Starting Ceph osd.3 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:31:32.945 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:32 smithi138 ceph-mon[82055]: Health check failed: Degraded data redundancy: 50/354 objects degraded (14.124%), 12 pgs degraded (PG_DEGRADED) 2024-02-07T12:31:32.945 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:32 smithi138 podman[91241]: 2024-02-07 12:31:32.520161614 +0000 UTC m=+0.017641914 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:31:32.945 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:32 smithi138 podman[91241]: 2024-02-07 12:31:32.632414498 +0000 UTC m=+0.129894840 container create 477509c9e5da9a3be3813a7bc108fc0b866d0ecaf7baf33008fbb48c7d76413b (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-07T12:31:32.945 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:32 smithi138 podman[91241]: 2024-02-07 12:31:32.826757218 +0000 UTC m=+0.324237515 container init 477509c9e5da9a3be3813a7bc108fc0b866d0ecaf7baf33008fbb48c7d76413b (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True) 2024-02-07T12:31:32.945 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:32 smithi138 podman[91241]: 2024-02-07 12:31:32.830028563 +0000 UTC m=+0.327508870 container start 477509c9e5da9a3be3813a7bc108fc0b866d0ecaf7baf33008fbb48c7d76413b (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-activate, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-07T12:31:32.945 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:32 smithi138 podman[91241]: 2024-02-07 12:31:32.943362403 +0000 UTC m=+0.440842728 container attach 477509c9e5da9a3be3813a7bc108fc0b866d0ecaf7baf33008fbb48c7d76413b (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-07T12:31:33.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:32 smithi047 ceph-mon[93224]: Health check failed: Degraded data redundancy: 50/354 objects degraded (14.124%), 12 pgs degraded (PG_DEGRADED) 2024-02-07T12:31:33.535 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-activate[91256]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-07T12:31:33.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-activate[91256]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-07T12:31:33.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-activate[91256]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-07T12:31:33.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-activate[91256]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-07T12:31:33.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-activate[91256]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-07T12:31:33.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-activate[91256]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-07T12:31:33.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-activate[91256]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-07T12:31:33.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 bash[91241]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-07T12:31:33.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 bash[91241]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-07T12:31:33.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 bash[91241]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-07T12:31:33.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 bash[91241]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-07T12:31:33.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 bash[91241]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-07T12:31:33.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 bash[91241]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-07T12:31:33.536 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 bash[91241]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-07T12:31:33.537 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 podman[91241]: 2024-02-07 12:31:33.296014931 +0000 UTC m=+0.793495229 container died 477509c9e5da9a3be3813a7bc108fc0b866d0ecaf7baf33008fbb48c7d76413b (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux ) 2024-02-07T12:31:34.034 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:33 smithi138 podman[91375]: 2024-02-07 12:31:33.880272591 +0000 UTC m=+0.579309596 container remove 477509c9e5da9a3be3813a7bc108fc0b866d0ecaf7baf33008fbb48c7d76413b (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240131, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux ) 2024-02-07T12:31:34.369 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:34 smithi138 ceph-mon[82055]: pgmap v113: 65 pgs: 12 active+undersized+degraded, 3 stale+active+clean, 13 active+undersized, 37 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 50/354 objects degraded (14.124%) 2024-02-07T12:31:34.371 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:34 smithi138 podman[91440]: 2024-02-07 12:31:33.993447756 +0000 UTC m=+0.017990582 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:31:34.371 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:34 smithi138 podman[91440]: 2024-02-07 12:31:34.123309987 +0000 UTC m=+0.147852808 container create dea45db021dbdab238a0f0481ed3a261aa8dafc015aa2846a9f9a99fbbe91eb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-02-07T12:31:34.371 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:34 smithi138 podman[91440]: 2024-02-07 12:31:34.367615583 +0000 UTC m=+0.392158409 container init dea45db021dbdab238a0f0481ed3a261aa8dafc015aa2846a9f9a99fbbe91eb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-07T12:31:34.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:34 smithi047 ceph-mon[93224]: pgmap v113: 65 pgs: 12 active+undersized+degraded, 3 stale+active+clean, 13 active+undersized, 37 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 50/354 objects degraded (14.124%) 2024-02-07T12:31:34.784 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:34 smithi138 podman[91440]: 2024-02-07 12:31:34.37085818 +0000 UTC m=+0.395401002 container start dea45db021dbdab238a0f0481ed3a261aa8dafc015aa2846a9f9a99fbbe91eb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-02-07T12:31:34.785 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:34 smithi138 ceph-osd[91458]: -- 172.21.15.138:0/2963698386 <== mon.1 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556ca6f676c0 con 0x556ca6f39000 2024-02-07T12:31:34.785 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:34 smithi138 bash[91440]: dea45db021dbdab238a0f0481ed3a261aa8dafc015aa2846a9f9a99fbbe91eb3 2024-02-07T12:31:34.785 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:34 smithi138 systemd[1]: Started Ceph osd.3 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:31:35.284 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:34 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[91454]: 2024-02-07T12:31:34.912+0000 7f54ebdb17c0 -1 Falling back to public interface 2024-02-07T12:31:35.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:35 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:35 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:35 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:31:35.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:35 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:35.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:35 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:35.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:35 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:31:36.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:36 smithi138 ceph-mon[82055]: pgmap v114: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 74/354 objects degraded (20.904%) 2024-02-07T12:31:36.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:36 smithi047 ceph-mon[93224]: pgmap v114: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 74/354 objects degraded (20.904%) 2024-02-07T12:31:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:38 smithi047 ceph-mon[93224]: pgmap v115: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 74/354 objects degraded (20.904%) 2024-02-07T12:31:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:38 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:38 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:38 smithi047 ceph-mon[93224]: Health check update: Degraded data redundancy: 74/354 objects degraded (20.904%), 20 pgs degraded (PG_DEGRADED) 2024-02-07T12:31:38.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:38 smithi138 ceph-mon[82055]: pgmap v115: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 74/354 objects degraded (20.904%) 2024-02-07T12:31:38.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:38 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:38.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:38 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:38.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:38 smithi138 ceph-mon[82055]: Health check update: Degraded data redundancy: 74/354 objects degraded (20.904%), 20 pgs degraded (PG_DEGRADED) 2024-02-07T12:31:39.785 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:39 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[91454]: 2024-02-07T12:31:39.473+0000 7f54ebdb17c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-02-07T12:31:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:39 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:39.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:39 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:39.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:39 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:39.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:39 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:40.234 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:40 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[91454]: 2024-02-07T12:31:40.031+0000 7f54ebdb17c0 -1 osd.3 65 log_to_monitors true 2024-02-07T12:31:40.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:40 smithi138 ceph-mon[82055]: pgmap v116: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 74/354 objects degraded (20.904%) 2024-02-07T12:31:40.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:40 smithi138 ceph-mon[82055]: from='osd.3 [v2:172.21.15.138:6800/1616507148,v1:172.21.15.138:6801/1616507148]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-07T12:31:40.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:40 smithi138 ceph-mon[82055]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-07T12:31:40.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:40 smithi047 ceph-mon[93224]: pgmap v116: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 298 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 74/354 objects degraded (20.904%) 2024-02-07T12:31:40.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:40 smithi047 ceph-mon[93224]: from='osd.3 [v2:172.21.15.138:6800/1616507148,v1:172.21.15.138:6801/1616507148]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-07T12:31:40.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:40 smithi047 ceph-mon[93224]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-07T12:31:41.785 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:31:41 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[91454]: 2024-02-07T12:31:41.435+0000 7f54d9208700 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-07T12:31:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:41 smithi138 ceph-mon[82055]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-07T12:31:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:41 smithi138 ceph-mon[82055]: from='osd.3 [v2:172.21.15.138:6800/1616507148,v1:172.21.15.138:6801/1616507148]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:31:41.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:41 smithi138 ceph-mon[82055]: osdmap e68: 6 total, 5 up, 6 in 2024-02-07T12:31:41.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:41 smithi138 ceph-mon[82055]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:31:41.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:41 smithi138 ceph-mon[82055]: failed to encode map e68 with expected crc 2024-02-07T12:31:41.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:41 smithi138 ceph-mon[82055]: failed to encode map e68 with expected crc 2024-02-07T12:31:41.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:41 smithi138 ceph-mon[82055]: from='osd.3 ' entity='osd.3' 2024-02-07T12:31:41.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:41 smithi047 ceph-mon[93224]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-07T12:31:41.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:41 smithi047 ceph-mon[93224]: from='osd.3 [v2:172.21.15.138:6800/1616507148,v1:172.21.15.138:6801/1616507148]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:31:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:41 smithi047 ceph-mon[93224]: osdmap e68: 6 total, 5 up, 6 in 2024-02-07T12:31:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:41 smithi047 ceph-mon[93224]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:31:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:41 smithi047 ceph-mon[93224]: failed to encode map e68 with expected crc 2024-02-07T12:31:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:41 smithi047 ceph-mon[93224]: failed to encode map e68 with expected crc 2024-02-07T12:31:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:41 smithi047 ceph-mon[93224]: from='osd.3 ' entity='osd.3' 2024-02-07T12:31:42.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.095+0000 7f85d9bee700 1 -- 172.21.15.47:0/3669809859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d40fe1e0 msgr2=0x7f85d40fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:42.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.095+0000 7f85d9bee700 1 --2- 172.21.15.47:0/3669809859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d40fe1e0 0x7f85d40fe650 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f85c8004940 tx=0x7f85c8009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:42.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.095+0000 7f85d9bee700 1 -- 172.21.15.47:0/3669809859 shutdown_connections 2024-02-07T12:31:42.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.095+0000 7f85d9bee700 1 --2- 172.21.15.47:0/3669809859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d40fe1e0 0x7f85d40fe650 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.095+0000 7f85d9bee700 1 --2- 172.21.15.47:0/3669809859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d40fcf30 0x7f85d40fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.095+0000 7f85d9bee700 1 -- 172.21.15.47:0/3669809859 >> 172.21.15.47:0/3669809859 conn(0x7f85d40f86b0 msgr2=0x7f85d40faac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:42.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.095+0000 7f85d9bee700 1 -- 172.21.15.47:0/3669809859 shutdown_connections 2024-02-07T12:31:42.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.095+0000 7f85d9bee700 1 -- 172.21.15.47:0/3669809859 wait complete. 2024-02-07T12:31:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.096+0000 7f85d9bee700 1 Processor -- start 2024-02-07T12:31:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.096+0000 7f85d9bee700 1 -- start start 2024-02-07T12:31:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.096+0000 7f85d9bee700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d40fcf30 0x7f85d410d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.096+0000 7f85d9bee700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d40fe1e0 0x7f85d410de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.096+0000 7f85d9bee700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d410e4f0 con 0x7f85d40fe1e0 2024-02-07T12:31:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.096+0000 7f85d9bee700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d410ed30 con 0x7f85d40fcf30 2024-02-07T12:31:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.096+0000 7f85d2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d40fe1e0 0x7f85d410de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.096+0000 7f85d2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d40fe1e0 0x7f85d410de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60936/0 (socket says 172.21.15.47:60936) 2024-02-07T12:31:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.096+0000 7f85d2ffd700 1 -- 172.21.15.47:0/3419966318 learned_addr learned my addr 172.21.15.47:0/3419966318 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:42.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.096+0000 7f85d37fe700 1 --2- 172.21.15.47:0/3419966318 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d40fcf30 0x7f85d410d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:42.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.097+0000 7f85d2ffd700 1 -- 172.21.15.47:0/3419966318 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d40fcf30 msgr2=0x7f85d410d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:42.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.097+0000 7f85d2ffd700 1 --2- 172.21.15.47:0/3419966318 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d40fcf30 0x7f85d410d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.097+0000 7f85d2ffd700 1 -- 172.21.15.47:0/3419966318 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c8005040 con 0x7f85d40fe1e0 2024-02-07T12:31:42.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.097+0000 7f85d2ffd700 1 --2- 172.21.15.47:0/3419966318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d40fe1e0 0x7f85d410de60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f85c80093b0 tx=0x7f85c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:42.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.097+0000 7f85bbfff700 1 -- 172.21.15.47:0/3419966318 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c800e040 con 0x7f85d40fe1e0 2024-02-07T12:31:42.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.097+0000 7f85bbfff700 1 -- 172.21.15.47:0/3419966318 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85c800bcc0 con 0x7f85d40fe1e0 2024-02-07T12:31:42.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.097+0000 7f85d9bee700 1 -- 172.21.15.47:0/3419966318 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d410efb0 con 0x7f85d40fe1e0 2024-02-07T12:31:42.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.097+0000 7f85bbfff700 1 -- 172.21.15.47:0/3419966318 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c801c630 con 0x7f85d40fe1e0 2024-02-07T12:31:42.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.097+0000 7f85d9bee700 1 -- 172.21.15.47:0/3419966318 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d410f4f0 con 0x7f85d40fe1e0 2024-02-07T12:31:42.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.098+0000 7f85d9bee700 1 -- 172.21.15.47:0/3419966318 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d404bed0 con 0x7f85d40fe1e0 2024-02-07T12:31:42.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.099+0000 7f85bbfff700 1 -- 172.21.15.47:0/3419966318 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f85c8013980 con 0x7f85d40fe1e0 2024-02-07T12:31:42.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.099+0000 7f85bbfff700 1 --2- 172.21.15.47:0/3419966318 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f85bc06d7e0 0x7f85bc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:42.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.099+0000 7f85bbfff700 1 -- 172.21.15.47:0/3419966318 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f85c808e250 con 0x7f85d40fe1e0 2024-02-07T12:31:42.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.099+0000 7f85d37fe700 1 --2- 172.21.15.47:0/3419966318 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f85bc06d7e0 0x7f85bc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:42.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.100+0000 7f85d37fe700 1 --2- 172.21.15.47:0/3419966318 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f85bc06d7e0 0x7f85bc06fc90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009bf0 tx=0x7f85c40091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:42.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.104+0000 7f85bbfff700 1 -- 172.21.15.47:0/3419966318 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f85c805b650 con 0x7f85d40fe1e0 2024-02-07T12:31:42.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.348+0000 7f85d9bee700 1 -- 172.21.15.47:0/3419966318 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85d410f9f0 con 0x7f85bc06d7e0 2024-02-07T12:31:42.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.349+0000 7f85bbfff700 1 -- 172.21.15.47:0/3419966318 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f85d410f9f0 con 0x7f85bc06d7e0 2024-02-07T12:31:42.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.351+0000 7f85d9bee700 1 -- 172.21.15.47:0/3419966318 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f85bc06d7e0 msgr2=0x7f85bc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:42.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.351+0000 7f85d9bee700 1 --2- 172.21.15.47:0/3419966318 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f85bc06d7e0 0x7f85bc06fc90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009bf0 tx=0x7f85c40091a0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.351+0000 7f85d9bee700 1 -- 172.21.15.47:0/3419966318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d40fe1e0 msgr2=0x7f85d410de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:42.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.351+0000 7f85d9bee700 1 --2- 172.21.15.47:0/3419966318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d40fe1e0 0x7f85d410de60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f85c80093b0 tx=0x7f85c8009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:42.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.351+0000 7f85d9bee700 1 -- 172.21.15.47:0/3419966318 shutdown_connections 2024-02-07T12:31:42.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.351+0000 7f85d9bee700 1 --2- 172.21.15.47:0/3419966318 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f85bc06d7e0 0x7f85bc06fc90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.351+0000 7f85d9bee700 1 --2- 172.21.15.47:0/3419966318 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d40fcf30 0x7f85d410d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.351+0000 7f85d9bee700 1 --2- 172.21.15.47:0/3419966318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d40fe1e0 0x7f85d410de60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.351+0000 7f85d9bee700 1 -- 172.21.15.47:0/3419966318 >> 172.21.15.47:0/3419966318 conn(0x7f85d40f86b0 msgr2=0x7f85d4101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:42.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.351+0000 7f85d9bee700 1 -- 172.21.15.47:0/3419966318 shutdown_connections 2024-02-07T12:31:42.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.352+0000 7f85d9bee700 1 -- 172.21.15.47:0/3419966318 wait complete. 2024-02-07T12:31:42.364 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:31:42.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.464+0000 7f95b6fc4700 1 -- 172.21.15.47:0/1840887241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95b01000c0 msgr2=0x7f95b0102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:42.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.464+0000 7f95b6fc4700 1 --2- 172.21.15.47:0/1840887241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95b01000c0 0x7f95b0102520 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f959c004940 tx=0x7f959c009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:42.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.464+0000 7f95b6fc4700 1 -- 172.21.15.47:0/1840887241 shutdown_connections 2024-02-07T12:31:42.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.464+0000 7f95b6fc4700 1 --2- 172.21.15.47:0/1840887241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95b01000c0 0x7f95b0102520 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.464+0000 7f95b6fc4700 1 --2- 172.21.15.47:0/1840887241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95b0066c70 0x7f95b00ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.464+0000 7f95b6fc4700 1 -- 172.21.15.47:0/1840887241 >> 172.21.15.47:0/1840887241 conn(0x7f95b00f7520 msgr2=0x7f95b00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:42.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.464+0000 7f95b6fc4700 1 -- 172.21.15.47:0/1840887241 shutdown_connections 2024-02-07T12:31:42.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.464+0000 7f95b6fc4700 1 -- 172.21.15.47:0/1840887241 wait complete. 2024-02-07T12:31:42.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.464+0000 7f95b6fc4700 1 Processor -- start 2024-02-07T12:31:42.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.464+0000 7f95b6fc4700 1 -- start start 2024-02-07T12:31:42.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.465+0000 7f95b6fc4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95b0066c70 0x7f95b010d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:42.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.465+0000 7f95b6fc4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95b01000c0 0x7f95b010ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.465+0000 7f95b6fc4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b010e3f0 con 0x7f95b01000c0 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.465+0000 7f95b6fc4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b010ec90 con 0x7f95b0066c70 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.465+0000 7f95affff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95b01000c0 0x7f95b010ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.465+0000 7f95affff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95b01000c0 0x7f95b010ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60942/0 (socket says 172.21.15.47:60942) 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.465+0000 7f95affff700 1 -- 172.21.15.47:0/2801344230 learned_addr learned my addr 172.21.15.47:0/2801344230 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.465+0000 7f95b4d60700 1 --2- 172.21.15.47:0/2801344230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95b0066c70 0x7f95b010d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.465+0000 7f95affff700 1 -- 172.21.15.47:0/2801344230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95b0066c70 msgr2=0x7f95b010d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.465+0000 7f95affff700 1 --2- 172.21.15.47:0/2801344230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95b0066c70 0x7f95b010d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.465+0000 7f95affff700 1 -- 172.21.15.47:0/2801344230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c005040 con 0x7f95b01000c0 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.465+0000 7f95b4d60700 1 --2- 172.21.15.47:0/2801344230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95b0066c70 0x7f95b010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.465+0000 7f95affff700 1 --2- 172.21.15.47:0/2801344230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95b01000c0 0x7f95b010ddf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f959c000c00 tx=0x7f959c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.466+0000 7f95ad7fa700 1 -- 172.21.15.47:0/2801344230 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959c00e040 con 0x7f95b01000c0 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.466+0000 7f95b6fc4700 1 -- 172.21.15.47:0/2801344230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b010ef10 con 0x7f95b01000c0 2024-02-07T12:31:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.466+0000 7f95ad7fa700 1 -- 172.21.15.47:0/2801344230 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f959c00bcc0 con 0x7f95b01000c0 2024-02-07T12:31:42.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.466+0000 7f95ad7fa700 1 -- 172.21.15.47:0/2801344230 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959c01c630 con 0x7f95b01000c0 2024-02-07T12:31:42.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.466+0000 7f95b6fc4700 1 -- 172.21.15.47:0/2801344230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b010f450 con 0x7f95b01000c0 2024-02-07T12:31:42.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.467+0000 7f95b6fc4700 1 -- 172.21.15.47:0/2801344230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b0107a50 con 0x7f95b01000c0 2024-02-07T12:31:42.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.467+0000 7f95ad7fa700 1 -- 172.21.15.47:0/2801344230 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f959c013980 con 0x7f95b01000c0 2024-02-07T12:31:42.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.467+0000 7f95ad7fa700 1 --2- 172.21.15.47:0/2801344230 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f95a006d7e0 0x7f95a006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:42.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.468+0000 7f95b4d60700 1 --2- 172.21.15.47:0/2801344230 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f95a006d7e0 0x7f95a006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:42.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.468+0000 7f95ad7fa700 1 -- 172.21.15.47:0/2801344230 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f959c08e240 con 0x7f95b01000c0 2024-02-07T12:31:42.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.468+0000 7f95b4d60700 1 --2- 172.21.15.47:0/2801344230 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f95a006d7e0 0x7f95a006fc90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95a4007fd0 tx=0x7f95a4009f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:42.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.472+0000 7f95ad7fa700 1 -- 172.21.15.47:0/2801344230 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f959c05b640 con 0x7f95b01000c0 2024-02-07T12:31:42.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.697+0000 7f95b6fc4700 1 -- 172.21.15.47:0/2801344230 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95b010f6c0 con 0x7f95a006d7e0 2024-02-07T12:31:42.700 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: pgmap v118: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 74/354 objects degraded (20.904%) 2024-02-07T12:31:42.700 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:42.700 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:31:42.700 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:42.700 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:42.700 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:31:42.700 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:31:42.701 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:42.701 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:31:42.701 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:42.701 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:42.701 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:42.701 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-07T12:31:42.701 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-07T12:31:42.701 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: failed to encode map e69 with expected crc 2024-02-07T12:31:42.701 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: osd.3 [v2:172.21.15.138:6800/1616507148,v1:172.21.15.138:6801/1616507148] boot 2024-02-07T12:31:42.701 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: osdmap e69: 6 total, 6 up, 6 in 2024-02-07T12:31:42.701 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:31:42.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.698+0000 7f95ad7fa700 1 -- 172.21.15.47:0/2801344230 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f95b010f6c0 con 0x7f95a006d7e0 2024-02-07T12:31:42.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.700+0000 7f95b6fc4700 1 -- 172.21.15.47:0/2801344230 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f95a006d7e0 msgr2=0x7f95a006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:42.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.700+0000 7f95b6fc4700 1 --2- 172.21.15.47:0/2801344230 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f95a006d7e0 0x7f95a006fc90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95a4007fd0 tx=0x7f95a4009f60 comp rx=0 tx=0).stop 2024-02-07T12:31:42.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.700+0000 7f95b6fc4700 1 -- 172.21.15.47:0/2801344230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95b01000c0 msgr2=0x7f95b010ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:42.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.700+0000 7f95b6fc4700 1 --2- 172.21.15.47:0/2801344230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95b01000c0 0x7f95b010ddf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f959c000c00 tx=0x7f959c009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:42.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.700+0000 7f95b6fc4700 1 -- 172.21.15.47:0/2801344230 shutdown_connections 2024-02-07T12:31:42.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.700+0000 7f95b6fc4700 1 --2- 172.21.15.47:0/2801344230 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f95a006d7e0 0x7f95a006fc90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.700+0000 7f95b6fc4700 1 --2- 172.21.15.47:0/2801344230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95b0066c70 0x7f95b010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.700+0000 7f95b6fc4700 1 --2- 172.21.15.47:0/2801344230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95b01000c0 0x7f95b010ddf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.700+0000 7f95b6fc4700 1 -- 172.21.15.47:0/2801344230 >> 172.21.15.47:0/2801344230 conn(0x7f95b00f7520 msgr2=0x7f95b00f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:42.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.700+0000 7f95b6fc4700 1 -- 172.21.15.47:0/2801344230 shutdown_connections 2024-02-07T12:31:42.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.700+0000 7f95b6fc4700 1 -- 172.21.15.47:0/2801344230 wait complete. 2024-02-07T12:31:42.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.802+0000 7f0f61865700 1 -- 172.21.15.47:0/121307995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0fcfb0 msgr2=0x7f0f5c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:42.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.802+0000 7f0f61865700 1 --2- 172.21.15.47:0/121307995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0fcfb0 0x7f0f5c0fd420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f44004940 tx=0x7f0f44009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:42.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.802+0000 7f0f61865700 1 -- 172.21.15.47:0/121307995 shutdown_connections 2024-02-07T12:31:42.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.802+0000 7f0f61865700 1 --2- 172.21.15.47:0/121307995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0fcfb0 0x7f0f5c0fd420 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.802+0000 7f0f61865700 1 --2- 172.21.15.47:0/121307995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f5c0fbe40 0x7f0f5c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.802+0000 7f0f61865700 1 -- 172.21.15.47:0/121307995 >> 172.21.15.47:0/121307995 conn(0x7f0f5c0f7520 msgr2=0x7f0f5c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:42.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.803+0000 7f0f61865700 1 -- 172.21.15.47:0/121307995 shutdown_connections 2024-02-07T12:31:42.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.803+0000 7f0f61865700 1 -- 172.21.15.47:0/121307995 wait complete. 2024-02-07T12:31:42.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.803+0000 7f0f61865700 1 Processor -- start 2024-02-07T12:31:42.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.803+0000 7f0f61865700 1 -- start start 2024-02-07T12:31:42.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.803+0000 7f0f61865700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0fbe40 0x7f0f5c110640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:42.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.803+0000 7f0f61865700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f5c0fcfb0 0x7f0f5c112b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:42.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.803+0000 7f0f61865700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c066d80 con 0x7f0f5c0fbe40 2024-02-07T12:31:42.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.803+0000 7f0f61865700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c066ec0 con 0x7f0f5c0fcfb0 2024-02-07T12:31:42.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.804+0000 7f0f5affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0fbe40 0x7f0f5c110640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:42.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.804+0000 7f0f5affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0fbe40 0x7f0f5c110640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60960/0 (socket says 172.21.15.47:60960) 2024-02-07T12:31:42.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.804+0000 7f0f5affd700 1 -- 172.21.15.47:0/4013178507 learned_addr learned my addr 172.21.15.47:0/4013178507 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:42.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.804+0000 7f0f5a7fc700 1 --2- 172.21.15.47:0/4013178507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f5c0fcfb0 0x7f0f5c112b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:42.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.804+0000 7f0f5affd700 1 -- 172.21.15.47:0/4013178507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f5c0fcfb0 msgr2=0x7f0f5c112b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:42.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.804+0000 7f0f5affd700 1 --2- 172.21.15.47:0/4013178507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f5c0fcfb0 0x7f0f5c112b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:42.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.804+0000 7f0f5affd700 1 -- 172.21.15.47:0/4013178507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f44005040 con 0x7f0f5c0fbe40 2024-02-07T12:31:42.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.804+0000 7f0f5affd700 1 --2- 172.21.15.47:0/4013178507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0fbe40 0x7f0f5c110640 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00b790 tx=0x7f0f4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:42.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.804+0000 7f0f537fe700 1 -- 172.21.15.47:0/4013178507 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f4c00f6f0 con 0x7f0f5c0fbe40 2024-02-07T12:31:42.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.804+0000 7f0f61865700 1 -- 172.21.15.47:0/4013178507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c113220 con 0x7f0f5c0fbe40 2024-02-07T12:31:42.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.804+0000 7f0f537fe700 1 -- 172.21.15.47:0/4013178507 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f4c00fd20 con 0x7f0f5c0fbe40 2024-02-07T12:31:42.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.804+0000 7f0f537fe700 1 -- 172.21.15.47:0/4013178507 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f4c0103a0 con 0x7f0f5c0fbe40 2024-02-07T12:31:42.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.804+0000 7f0f61865700 1 -- 172.21.15.47:0/4013178507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c113760 con 0x7f0f5c0fbe40 2024-02-07T12:31:42.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.805+0000 7f0f61865700 1 -- 172.21.15.47:0/4013178507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c04bed0 con 0x7f0f5c0fbe40 2024-02-07T12:31:42.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.806+0000 7f0f537fe700 1 -- 172.21.15.47:0/4013178507 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0f4c00f850 con 0x7f0f5c0fbe40 2024-02-07T12:31:42.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.806+0000 7f0f537fe700 1 --2- 172.21.15.47:0/4013178507 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0f4806d7f0 0x7f0f4806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:42.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.806+0000 7f0f537fe700 1 -- 172.21.15.47:0/4013178507 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0f4c08cd30 con 0x7f0f5c0fbe40 2024-02-07T12:31:42.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.806+0000 7f0f5a7fc700 1 --2- 172.21.15.47:0/4013178507 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0f4806d7f0 0x7f0f4806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:42.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.807+0000 7f0f5a7fc700 1 --2- 172.21.15.47:0/4013178507 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0f4806d7f0 0x7f0f4806fca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f440043d0 tx=0x7f0f44009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:42.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:42.811+0000 7f0f537fe700 1 -- 172.21.15.47:0/4013178507 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0f4c056600 con 0x7f0f5c0fbe40 2024-02-07T12:31:43.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.022+0000 7f0f61865700 1 -- 172.21.15.47:0/4013178507 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f5c101990 con 0x7f0f4806d7f0 2024-02-07T12:31:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: pgmap v118: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 74/354 objects degraded (20.904%) 2024-02-07T12:31:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:31:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:31:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:31:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:31:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:43.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-07T12:31:43.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-07T12:31:43.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: failed to encode map e69 with expected crc 2024-02-07T12:31:43.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: osd.3 [v2:172.21.15.138:6800/1616507148,v1:172.21.15.138:6801/1616507148] boot 2024-02-07T12:31:43.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: osdmap e69: 6 total, 6 up, 6 in 2024-02-07T12:31:43.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-07T12:31:43.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.033+0000 7f0f537fe700 1 -- 172.21.15.47:0/4013178507 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f0f5c101990 con 0x7f0f4806d7f0 2024-02-07T12:31:43.036 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (5m) 38s ago 14m 26.6M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (2m) 38s ago 14m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (2m) 5s ago 13m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (4m) 38s ago 13m 78.4M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (8m) 38s ago 8m 111M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (8m) 38s ago 8m 129M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (8m) 5s ago 8m 68.4M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (8m) 5s ago 8m 69.6M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (4m) 38s ago 15m 503M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (3m) 5s ago 13m 451M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (3m) 38s ago 15m 47.4M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (3m) 5s ago 13m 35.2M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (5m) 38s ago 14m 15.1M - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:31:43.037 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (4m) 5s ago 13m 14.6M - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:31:43.038 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (116s) 38s ago 12m 87.4M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:31:43.038 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (80s) 38s ago 11m 98.5M 1559M 19.0.0-1252-g44458cce 79957b372307 0f2b0eea74d7 2024-02-07T12:31:43.038 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (44s) 38s ago 11m 12.6M 1559M 19.0.0-1252-g44458cce 79957b372307 0b8c78346346 2024-02-07T12:31:43.038 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (9s) 5s ago 11m 12.6M 2581M 19.0.0-1252-g44458cce 79957b372307 dea45db021db 2024-02-07T12:31:43.038 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (10m) 5s ago 10m 235M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 1e36c61a9e39 2024-02-07T12:31:43.038 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (10m) 5s ago 10m 220M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:31:43.038 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (3m) 38s ago 13m 51.5M - 2.43.0 a07b618ecd1d 32840d82c54b 2024-02-07T12:31:43.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.035+0000 7f0f61865700 1 -- 172.21.15.47:0/4013178507 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0f4806d7f0 msgr2=0x7f0f4806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:43.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.035+0000 7f0f61865700 1 --2- 172.21.15.47:0/4013178507 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0f4806d7f0 0x7f0f4806fca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f440043d0 tx=0x7f0f44009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:43.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.035+0000 7f0f61865700 1 -- 172.21.15.47:0/4013178507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0fbe40 msgr2=0x7f0f5c110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:43.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.035+0000 7f0f61865700 1 --2- 172.21.15.47:0/4013178507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0fbe40 0x7f0f5c110640 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00b790 tx=0x7f0f4c009250 comp rx=0 tx=0).stop 2024-02-07T12:31:43.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.035+0000 7f0f61865700 1 -- 172.21.15.47:0/4013178507 shutdown_connections 2024-02-07T12:31:43.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.035+0000 7f0f61865700 1 --2- 172.21.15.47:0/4013178507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0fbe40 0x7f0f5c110640 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.035+0000 7f0f61865700 1 --2- 172.21.15.47:0/4013178507 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0f4806d7f0 0x7f0f4806fca0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.035+0000 7f0f61865700 1 --2- 172.21.15.47:0/4013178507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f5c0fcfb0 0x7f0f5c112b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.035+0000 7f0f61865700 1 -- 172.21.15.47:0/4013178507 >> 172.21.15.47:0/4013178507 conn(0x7f0f5c0f7520 msgr2=0x7f0f5c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:43.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.035+0000 7f0f61865700 1 -- 172.21.15.47:0/4013178507 shutdown_connections 2024-02-07T12:31:43.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.035+0000 7f0f61865700 1 -- 172.21.15.47:0/4013178507 wait complete. 2024-02-07T12:31:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.136+0000 7f80773ef700 1 -- 172.21.15.47:0/4263520583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80700fde10 msgr2=0x7f80700faff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.136+0000 7f80773ef700 1 --2- 172.21.15.47:0/4263520583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80700fde10 0x7f80700faff0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8060004940 tx=0x7f8060009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.137+0000 7f80773ef700 1 -- 172.21.15.47:0/4263520583 shutdown_connections 2024-02-07T12:31:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.137+0000 7f80773ef700 1 --2- 172.21.15.47:0/4263520583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80700fde10 0x7f80700faff0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.137+0000 7f80773ef700 1 --2- 172.21.15.47:0/4263520583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80700fd430 0x7f80700fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.137+0000 7f80773ef700 1 -- 172.21.15.47:0/4263520583 >> 172.21.15.47:0/4263520583 conn(0x7f80700f6ca0 msgr2=0x7f80700f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.137+0000 7f80773ef700 1 -- 172.21.15.47:0/4263520583 shutdown_connections 2024-02-07T12:31:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.137+0000 7f80773ef700 1 -- 172.21.15.47:0/4263520583 wait complete. 2024-02-07T12:31:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.137+0000 7f80773ef700 1 Processor -- start 2024-02-07T12:31:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.137+0000 7f80773ef700 1 -- start start 2024-02-07T12:31:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.137+0000 7f80773ef700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80700fd430 0x7f807010fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.137+0000 7f80773ef700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8070110210 0x7f8070110f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.137+0000 7f80773ef700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80701106d0 con 0x7f80700fd430 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.137+0000 7f80773ef700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8070110810 con 0x7f8070110210 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.137+0000 7f807518b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80700fd430 0x7f807010fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.138+0000 7f807518b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80700fd430 0x7f807010fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60978/0 (socket says 172.21.15.47:60978) 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.138+0000 7f807518b700 1 -- 172.21.15.47:0/2709317520 learned_addr learned my addr 172.21.15.47:0/2709317520 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.138+0000 7f807498a700 1 --2- 172.21.15.47:0/2709317520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8070110210 0x7f8070110f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.138+0000 7f807518b700 1 -- 172.21.15.47:0/2709317520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8070110210 msgr2=0x7f8070110f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.138+0000 7f807518b700 1 --2- 172.21.15.47:0/2709317520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8070110210 0x7f8070110f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.138+0000 7f807518b700 1 -- 172.21.15.47:0/2709317520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8060005040 con 0x7f80700fd430 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.138+0000 7f807518b700 1 --2- 172.21.15.47:0/2709317520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80700fd430 0x7f807010fcd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f806c00c830 tx=0x7f806c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.138+0000 7f8065ffb700 1 -- 172.21.15.47:0/2709317520 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f806c0106f0 con 0x7f80700fd430 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.138+0000 7f8065ffb700 1 -- 172.21.15.47:0/2709317520 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f806c010d20 con 0x7f80700fd430 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.138+0000 7f80773ef700 1 -- 172.21.15.47:0/2709317520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8070111650 con 0x7f80700fd430 2024-02-07T12:31:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.138+0000 7f8065ffb700 1 -- 172.21.15.47:0/2709317520 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f806c0113a0 con 0x7f80700fd430 2024-02-07T12:31:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.138+0000 7f80773ef700 1 -- 172.21.15.47:0/2709317520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8070111b90 con 0x7f80700fd430 2024-02-07T12:31:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.139+0000 7f80773ef700 1 -- 172.21.15.47:0/2709317520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8070109c80 con 0x7f80700fd430 2024-02-07T12:31:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.140+0000 7f8065ffb700 1 -- 172.21.15.47:0/2709317520 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f806c012400 con 0x7f80700fd430 2024-02-07T12:31:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.140+0000 7f8065ffb700 1 --2- 172.21.15.47:0/2709317520 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f805c06d7e0 0x7f805c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.140+0000 7f8065ffb700 1 -- 172.21.15.47:0/2709317520 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f806c08ce30 con 0x7f80700fd430 2024-02-07T12:31:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.140+0000 7f807498a700 1 --2- 172.21.15.47:0/2709317520 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f805c06d7e0 0x7f805c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.141+0000 7f807498a700 1 --2- 172.21.15.47:0/2709317520 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f805c06d7e0 0x7f805c06fc90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8060004f90 tx=0x7f8060009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:43.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.145+0000 7f8065ffb700 1 -- 172.21.15.47:0/2709317520 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f806c05a230 con 0x7f80700fd430 2024-02-07T12:31:43.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.433+0000 7f80773ef700 1 -- 172.21.15.47:0/2709317520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f80700fde10 con 0x7f80700fd430 2024-02-07T12:31:43.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.434+0000 7f8065ffb700 1 -- 172.21.15.47:0/2709317520 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f806c059dc0 con 0x7f80700fd430 2024-02-07T12:31:43.436 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2, 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 4 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:31:43.437 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:31:43.438 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 6, 2024-02-07T12:31:43.438 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 8 2024-02-07T12:31:43.438 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:31:43.438 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:31:43.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.440+0000 7f80773ef700 1 -- 172.21.15.47:0/2709317520 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f805c06d7e0 msgr2=0x7f805c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:43.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.440+0000 7f80773ef700 1 --2- 172.21.15.47:0/2709317520 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f805c06d7e0 0x7f805c06fc90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8060004f90 tx=0x7f8060009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:43.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.440+0000 7f80773ef700 1 -- 172.21.15.47:0/2709317520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80700fd430 msgr2=0x7f807010fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:43.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.440+0000 7f80773ef700 1 --2- 172.21.15.47:0/2709317520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80700fd430 0x7f807010fcd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f806c00c830 tx=0x7f806c004470 comp rx=0 tx=0).stop 2024-02-07T12:31:43.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.440+0000 7f80773ef700 1 -- 172.21.15.47:0/2709317520 shutdown_connections 2024-02-07T12:31:43.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.440+0000 7f80773ef700 1 --2- 172.21.15.47:0/2709317520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80700fd430 0x7f807010fcd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.440+0000 7f80773ef700 1 --2- 172.21.15.47:0/2709317520 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f805c06d7e0 0x7f805c06fc90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.440+0000 7f80773ef700 1 --2- 172.21.15.47:0/2709317520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8070110210 0x7f8070110f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.440+0000 7f80773ef700 1 -- 172.21.15.47:0/2709317520 >> 172.21.15.47:0/2709317520 conn(0x7f80700f6ca0 msgr2=0x7f80700f8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:43.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.440+0000 7f80773ef700 1 -- 172.21.15.47:0/2709317520 shutdown_connections 2024-02-07T12:31:43.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.441+0000 7f80773ef700 1 -- 172.21.15.47:0/2709317520 wait complete. 2024-02-07T12:31:43.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 -- 172.21.15.47:0/179686686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e400fbe40 msgr2=0x7f5e400fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:43.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 --2- 172.21.15.47:0/179686686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e400fbe40 0x7f5e400fc250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009ce0 tx=0x7f5e30004d10 comp rx=0 tx=0).stop 2024-02-07T12:31:43.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 -- 172.21.15.47:0/179686686 shutdown_connections 2024-02-07T12:31:43.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 --2- 172.21.15.47:0/179686686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e400fcfb0 0x7f5e400fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 --2- 172.21.15.47:0/179686686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e400fbe40 0x7f5e400fc250 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 -- 172.21.15.47:0/179686686 >> 172.21.15.47:0/179686686 conn(0x7f5e400f7520 msgr2=0x7f5e400f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 -- 172.21.15.47:0/179686686 shutdown_connections 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 -- 172.21.15.47:0/179686686 wait complete. 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 Processor -- start 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 -- start start 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e400fbe40 0x7f5e40112c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e400fcfb0 0x7f5e40115150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40066be0 con 0x7f5e400fbe40 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.558+0000 7f5e48024700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40066d20 con 0x7f5e400fcfb0 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e45dc0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e400fbe40 0x7f5e40112c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e45dc0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e400fbe40 0x7f5e40112c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32774/0 (socket says 172.21.15.47:32774) 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e45dc0700 1 -- 172.21.15.47:0/1647550886 learned_addr learned my addr 172.21.15.47:0/1647550886 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e455bf700 1 --2- 172.21.15.47:0/1647550886 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e400fcfb0 0x7f5e40115150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e45dc0700 1 -- 172.21.15.47:0/1647550886 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e400fcfb0 msgr2=0x7f5e40115150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:43.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e45dc0700 1 --2- 172.21.15.47:0/1647550886 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e400fcfb0 0x7f5e40115150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e45dc0700 1 -- 172.21.15.47:0/1647550886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30009940 con 0x7f5e400fbe40 2024-02-07T12:31:43.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e455bf700 1 --2- 172.21.15.47:0/1647550886 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e400fcfb0 0x7f5e40115150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:31:43.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e45dc0700 1 --2- 172.21.15.47:0/1647550886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e400fbe40 0x7f5e40112c00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5e30015040 tx=0x7f5e30004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:43.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e3e7fc700 1 -- 172.21.15.47:0/1647550886 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e3000e040 con 0x7f5e400fbe40 2024-02-07T12:31:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e3e7fc700 1 -- 172.21.15.47:0/1647550886 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e300128e0 con 0x7f5e400fbe40 2024-02-07T12:31:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e3e7fc700 1 -- 172.21.15.47:0/1647550886 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e3001c8d0 con 0x7f5e400fbe40 2024-02-07T12:31:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e48024700 1 -- 172.21.15.47:0/1647550886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e40115690 con 0x7f5e400fbe40 2024-02-07T12:31:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.559+0000 7f5e48024700 1 -- 172.21.15.47:0/1647550886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e40115af0 con 0x7f5e400fbe40 2024-02-07T12:31:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.561+0000 7f5e48024700 1 -- 172.21.15.47:0/1647550886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4004bed0 con 0x7f5e400fbe40 2024-02-07T12:31:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.561+0000 7f5e3e7fc700 1 -- 172.21.15.47:0/1647550886 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f5e30012410 con 0x7f5e400fbe40 2024-02-07T12:31:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.561+0000 7f5e3e7fc700 1 --2- 172.21.15.47:0/1647550886 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5e2806d7f0 0x7f5e2806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.562+0000 7f5e3e7fc700 1 -- 172.21.15.47:0/1647550886 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5e3008ead0 con 0x7f5e400fbe40 2024-02-07T12:31:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.562+0000 7f5e455bf700 1 --2- 172.21.15.47:0/1647550886 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5e2806d7f0 0x7f5e2806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.562+0000 7f5e455bf700 1 --2- 172.21.15.47:0/1647550886 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5e2806d7f0 0x7f5e2806fca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e34006fd0 tx=0x7f5e34008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:43.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.566+0000 7f5e3e7fc700 1 -- 172.21.15.47:0/1647550886 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5e300583a0 con 0x7f5e400fbe40 2024-02-07T12:31:43.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.815+0000 7f5e48024700 1 -- 172.21.15.47:0/1647550886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5e40115f90 con 0x7f5e400fbe40 2024-02-07T12:31:43.818 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:43 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-07T12:31:43.818 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:43 smithi047 ceph-mon[93224]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-07T12:31:43.818 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:43 smithi047 ceph-mon[93224]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:43.818 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:43 smithi047 ceph-mon[93224]: failed to encode map e70 with expected crc 2024-02-07T12:31:43.818 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:43 smithi047 ceph-mon[93224]: osdmap e70: 6 total, 6 up, 6 in 2024-02-07T12:31:43.818 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:43 smithi047 ceph-mon[93224]: failed to encode map e70 with expected crc 2024-02-07T12:31:43.818 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:43 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2709317520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:43.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.815+0000 7f5e3e7fc700 1 -- 172.21.15.47:0/1647550886 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1872 (secure 0 0 0) 0x7f5e3002a760 con 0x7f5e400fbe40 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout:e22 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 22 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:29:33.611202+0000 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:31:43.819 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:31:43.820 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:31:43.821 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:31:43.821 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:31:43.821 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:31:43.821 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:31:43.821 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:31:43.821 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:31:43.821 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:31:43.821 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:31:43.821 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:31:43.821 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:31:43.821 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:31:43.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.817+0000 7f5e48024700 1 -- 172.21.15.47:0/1647550886 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5e2806d7f0 msgr2=0x7f5e2806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:43.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.817+0000 7f5e48024700 1 --2- 172.21.15.47:0/1647550886 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5e2806d7f0 0x7f5e2806fca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e34006fd0 tx=0x7f5e34008040 comp rx=0 tx=0).stop 2024-02-07T12:31:43.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.817+0000 7f5e48024700 1 -- 172.21.15.47:0/1647550886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e400fbe40 msgr2=0x7f5e40112c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:43.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.817+0000 7f5e48024700 1 --2- 172.21.15.47:0/1647550886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e400fbe40 0x7f5e40112c00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5e30015040 tx=0x7f5e30004d10 comp rx=0 tx=0).stop 2024-02-07T12:31:43.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.818+0000 7f5e48024700 1 -- 172.21.15.47:0/1647550886 shutdown_connections 2024-02-07T12:31:43.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.818+0000 7f5e48024700 1 --2- 172.21.15.47:0/1647550886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e400fbe40 0x7f5e40112c00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.818+0000 7f5e48024700 1 --2- 172.21.15.47:0/1647550886 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5e2806d7f0 0x7f5e2806fca0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.818+0000 7f5e48024700 1 --2- 172.21.15.47:0/1647550886 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e400fcfb0 0x7f5e40115150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.818+0000 7f5e48024700 1 -- 172.21.15.47:0/1647550886 >> 172.21.15.47:0/1647550886 conn(0x7f5e400f7520 msgr2=0x7f5e40100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:43.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.818+0000 7f5e48024700 1 -- 172.21.15.47:0/1647550886 shutdown_connections 2024-02-07T12:31:43.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.818+0000 7f5e48024700 1 -- 172.21.15.47:0/1647550886 wait complete. 2024-02-07T12:31:43.823 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 22 2024-02-07T12:31:43.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.922+0000 7f0ca9e36700 1 -- 172.21.15.47:0/2107291692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ca40fe2b0 msgr2=0x7f0ca40fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:43.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.922+0000 7f0ca9e36700 1 --2- 172.21.15.47:0/2107291692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ca40fe2b0 0x7f0ca40fe700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c98004940 tx=0x7f0c98009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:43.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.922+0000 7f0ca9e36700 1 -- 172.21.15.47:0/2107291692 shutdown_connections 2024-02-07T12:31:43.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.922+0000 7f0ca9e36700 1 --2- 172.21.15.47:0/2107291692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ca40fe2b0 0x7f0ca40fe700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.922+0000 7f0ca9e36700 1 --2- 172.21.15.47:0/2107291692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ca40fb220 0x7f0ca40fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.922+0000 7f0ca9e36700 1 -- 172.21.15.47:0/2107291692 >> 172.21.15.47:0/2107291692 conn(0x7f0ca40f6ca0 msgr2=0x7f0ca40f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:43.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.922+0000 7f0ca9e36700 1 -- 172.21.15.47:0/2107291692 shutdown_connections 2024-02-07T12:31:43.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.922+0000 7f0ca9e36700 1 -- 172.21.15.47:0/2107291692 wait complete. 2024-02-07T12:31:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.922+0000 7f0ca9e36700 1 Processor -- start 2024-02-07T12:31:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.922+0000 7f0ca9e36700 1 -- start start 2024-02-07T12:31:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.923+0000 7f0ca9e36700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ca40fb220 0x7f0ca410d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.923+0000 7f0ca9e36700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ca40fe2b0 0x7f0ca410df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.923+0000 7f0ca9e36700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca410e5c0 con 0x7f0ca40fe2b0 2024-02-07T12:31:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.923+0000 7f0ca9e36700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca410ee00 con 0x7f0ca40fb220 2024-02-07T12:31:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.923+0000 7f0ca2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ca40fe2b0 0x7f0ca410df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:43.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.923+0000 7f0ca2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ca40fe2b0 0x7f0ca410df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32798/0 (socket says 172.21.15.47:32798) 2024-02-07T12:31:43.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.923+0000 7f0ca2ffd700 1 -- 172.21.15.47:0/1524100187 learned_addr learned my addr 172.21.15.47:0/1524100187 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:43.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.923+0000 7f0ca37fe700 1 --2- 172.21.15.47:0/1524100187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ca40fb220 0x7f0ca410d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:43.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.923+0000 7f0ca2ffd700 1 -- 172.21.15.47:0/1524100187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ca40fb220 msgr2=0x7f0ca410d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:43.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.923+0000 7f0ca2ffd700 1 --2- 172.21.15.47:0/1524100187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ca40fb220 0x7f0ca410d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:43.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.923+0000 7f0ca2ffd700 1 -- 172.21.15.47:0/1524100187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c98005040 con 0x7f0ca40fe2b0 2024-02-07T12:31:43.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.923+0000 7f0ca37fe700 1 --2- 172.21.15.47:0/1524100187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ca40fb220 0x7f0ca410d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:31:43.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.923+0000 7f0ca2ffd700 1 --2- 172.21.15.47:0/1524100187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ca40fe2b0 0x7f0ca410df30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009fd0 tx=0x7f0c98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:43.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.924+0000 7f0c8bfff700 1 -- 172.21.15.47:0/1524100187 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c9800e040 con 0x7f0ca40fe2b0 2024-02-07T12:31:43.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.924+0000 7f0c8bfff700 1 -- 172.21.15.47:0/1524100187 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c9800bbf0 con 0x7f0ca40fe2b0 2024-02-07T12:31:43.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.924+0000 7f0ca9e36700 1 -- 172.21.15.47:0/1524100187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca410f080 con 0x7f0ca40fe2b0 2024-02-07T12:31:43.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.924+0000 7f0c8bfff700 1 -- 172.21.15.47:0/1524100187 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c9801c630 con 0x7f0ca40fe2b0 2024-02-07T12:31:43.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.924+0000 7f0ca9e36700 1 -- 172.21.15.47:0/1524100187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca410f5c0 con 0x7f0ca40fe2b0 2024-02-07T12:31:43.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.925+0000 7f0ca9e36700 1 -- 172.21.15.47:0/1524100187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca404bed0 con 0x7f0ca40fe2b0 2024-02-07T12:31:43.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.925+0000 7f0c8bfff700 1 -- 172.21.15.47:0/1524100187 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0c98013980 con 0x7f0ca40fe2b0 2024-02-07T12:31:43.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.926+0000 7f0c8bfff700 1 --2- 172.21.15.47:0/1524100187 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0c8c06d7f0 0x7f0c8c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:43.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.926+0000 7f0c8bfff700 1 -- 172.21.15.47:0/1524100187 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0c9808e2d0 con 0x7f0ca40fe2b0 2024-02-07T12:31:43.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.926+0000 7f0ca37fe700 1 --2- 172.21.15.47:0/1524100187 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0c8c06d7f0 0x7f0c8c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:43.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.926+0000 7f0ca37fe700 1 --2- 172.21.15.47:0/1524100187 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0c8c06d7f0 0x7f0c8c06fca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4065cb0 tx=0x7f0c94008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:43.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:43.930+0000 7f0c8bfff700 1 -- 172.21.15.47:0/1524100187 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0c9805b6d0 con 0x7f0ca40fe2b0 2024-02-07T12:31:44.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:43 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-07T12:31:44.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:43 smithi138 ceph-mon[82055]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-07T12:31:44.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:43 smithi138 ceph-mon[82055]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:44.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:43 smithi138 ceph-mon[82055]: failed to encode map e70 with expected crc 2024-02-07T12:31:44.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:43 smithi138 ceph-mon[82055]: osdmap e70: 6 total, 6 up, 6 in 2024-02-07T12:31:44.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:43 smithi138 ceph-mon[82055]: failed to encode map e70 with expected crc 2024-02-07T12:31:44.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:43 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2709317520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:31:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.154+0000 7f0ca9e36700 1 -- 172.21.15.47:0/1524100187 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ca410fae0 con 0x7f0c8c06d7f0 2024-02-07T12:31:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.155+0000 7f0c8bfff700 1 -- 172.21.15.47:0/1524100187 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0ca410fae0 con 0x7f0c8c06d7f0 2024-02-07T12:31:44.158 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:31:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:31:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:31:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:31:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:31:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-02-07T12:31:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: "mon", 2024-02-07T12:31:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr" 2024-02-07T12:31:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:31:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "10/21 daemons upgraded", 2024-02-07T12:31:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading osd daemons", 2024-02-07T12:31:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:31:44.159 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:31:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.157+0000 7f0ca9e36700 1 -- 172.21.15.47:0/1524100187 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0c8c06d7f0 msgr2=0x7f0c8c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.157+0000 7f0ca9e36700 1 --2- 172.21.15.47:0/1524100187 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0c8c06d7f0 0x7f0c8c06fca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4065cb0 tx=0x7f0c94008040 comp rx=0 tx=0).stop 2024-02-07T12:31:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.157+0000 7f0ca9e36700 1 -- 172.21.15.47:0/1524100187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ca40fe2b0 msgr2=0x7f0ca410df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.157+0000 7f0ca9e36700 1 --2- 172.21.15.47:0/1524100187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ca40fe2b0 0x7f0ca410df30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009fd0 tx=0x7f0c98009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.158+0000 7f0ca9e36700 1 -- 172.21.15.47:0/1524100187 shutdown_connections 2024-02-07T12:31:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.158+0000 7f0ca9e36700 1 --2- 172.21.15.47:0/1524100187 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0c8c06d7f0 0x7f0c8c06fca0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.158+0000 7f0ca9e36700 1 --2- 172.21.15.47:0/1524100187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ca40fb220 0x7f0ca410d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.158+0000 7f0ca9e36700 1 --2- 172.21.15.47:0/1524100187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ca40fe2b0 0x7f0ca410df30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.158+0000 7f0ca9e36700 1 -- 172.21.15.47:0/1524100187 >> 172.21.15.47:0/1524100187 conn(0x7f0ca40f6ca0 msgr2=0x7f0ca41014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.158+0000 7f0ca9e36700 1 -- 172.21.15.47:0/1524100187 shutdown_connections 2024-02-07T12:31:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.158+0000 7f0ca9e36700 1 -- 172.21.15.47:0/1524100187 wait complete. 2024-02-07T12:31:44.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.260+0000 7f560ad59700 1 -- 172.21.15.47:0/4241861606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56040fe0e0 msgr2=0x7f56040fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:44.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.260+0000 7f560ad59700 1 --2- 172.21.15.47:0/4241861606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56040fe0e0 0x7f56040fe550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f55f8004940 tx=0x7f55f8009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:44.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.260+0000 7f560ad59700 1 -- 172.21.15.47:0/4241861606 shutdown_connections 2024-02-07T12:31:44.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.260+0000 7f560ad59700 1 --2- 172.21.15.47:0/4241861606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56040fe0e0 0x7f56040fe550 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:44.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.260+0000 7f560ad59700 1 --2- 172.21.15.47:0/4241861606 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56040fcef0 0x7f56040fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:44.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.260+0000 7f560ad59700 1 -- 172.21.15.47:0/4241861606 >> 172.21.15.47:0/4241861606 conn(0x7f56040f8620 msgr2=0x7f56040faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:44.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.260+0000 7f560ad59700 1 -- 172.21.15.47:0/4241861606 shutdown_connections 2024-02-07T12:31:44.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.260+0000 7f560ad59700 1 -- 172.21.15.47:0/4241861606 wait complete. 2024-02-07T12:31:44.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.261+0000 7f560ad59700 1 Processor -- start 2024-02-07T12:31:44.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.261+0000 7f560ad59700 1 -- start start 2024-02-07T12:31:44.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.261+0000 7f560ad59700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56040fcef0 0x7f560410d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:44.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.261+0000 7f560ad59700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56040fe0e0 0x7f560410ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:44.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.261+0000 7f560ad59700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560410e560 con 0x7f56040fe0e0 2024-02-07T12:31:44.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.261+0000 7f560ad59700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560410eda0 con 0x7f56040fcef0 2024-02-07T12:31:44.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.261+0000 7f5603fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56040fe0e0 0x7f560410ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:44.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.261+0000 7f5603fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56040fe0e0 0x7f560410ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32810/0 (socket says 172.21.15.47:32810) 2024-02-07T12:31:44.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.261+0000 7f5603fff700 1 -- 172.21.15.47:0/391482985 learned_addr learned my addr 172.21.15.47:0/391482985 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:31:44.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.262+0000 7f5608af5700 1 --2- 172.21.15.47:0/391482985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56040fcef0 0x7f560410d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:44.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.262+0000 7f5603fff700 1 -- 172.21.15.47:0/391482985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56040fcef0 msgr2=0x7f560410d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:44.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.262+0000 7f5603fff700 1 --2- 172.21.15.47:0/391482985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56040fcef0 0x7f560410d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:44.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.262+0000 7f5603fff700 1 -- 172.21.15.47:0/391482985 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8005040 con 0x7f56040fe0e0 2024-02-07T12:31:44.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.262+0000 7f5603fff700 1 --2- 172.21.15.47:0/391482985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56040fe0e0 0x7f560410ded0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f55f80093b0 tx=0x7f55f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:44.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.262+0000 7f56017fa700 1 -- 172.21.15.47:0/391482985 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f800e040 con 0x7f56040fe0e0 2024-02-07T12:31:44.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.262+0000 7f56017fa700 1 -- 172.21.15.47:0/391482985 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55f800bcc0 con 0x7f56040fe0e0 2024-02-07T12:31:44.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.262+0000 7f560ad59700 1 -- 172.21.15.47:0/391482985 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560410f020 con 0x7f56040fe0e0 2024-02-07T12:31:44.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.262+0000 7f56017fa700 1 -- 172.21.15.47:0/391482985 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f801c630 con 0x7f56040fe0e0 2024-02-07T12:31:44.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.262+0000 7f560ad59700 1 -- 172.21.15.47:0/391482985 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560410f560 con 0x7f56040fe0e0 2024-02-07T12:31:44.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.263+0000 7f560ad59700 1 -- 172.21.15.47:0/391482985 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560404bed0 con 0x7f56040fe0e0 2024-02-07T12:31:44.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.264+0000 7f56017fa700 1 -- 172.21.15.47:0/391482985 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f55f80139f0 con 0x7f56040fe0e0 2024-02-07T12:31:44.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.264+0000 7f56017fa700 1 --2- 172.21.15.47:0/391482985 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f55ec06d7e0 0x7f55ec06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:31:44.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.264+0000 7f56017fa700 1 -- 172.21.15.47:0/391482985 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f55f808e210 con 0x7f56040fe0e0 2024-02-07T12:31:44.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.264+0000 7f5608af5700 1 --2- 172.21.15.47:0/391482985 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f55ec06d7e0 0x7f55ec06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:31:44.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.265+0000 7f5608af5700 1 --2- 172.21.15.47:0/391482985 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f55ec06d7e0 0x7f55ec06fc90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f55f4006fd0 tx=0x7f55f4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:31:44.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.269+0000 7f56017fa700 1 -- 172.21.15.47:0/391482985 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f55f805b6b0 con 0x7f56040fe0e0 2024-02-07T12:31:44.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.556+0000 7f560ad59700 1 -- 172.21.15.47:0/391482985 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5604105ad0 con 0x7f56040fe0e0 2024-02-07T12:31:44.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.556+0000 7f56017fa700 1 -- 172.21.15.47:0/391482985 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1126 (secure 0 0 0) 0x7f55f805b240 con 0x7f56040fe0e0 2024-02-07T12:31:44.559 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_WARN Degraded data redundancy: 64/354 objects degraded (18.079%), 17 pgs degraded 2024-02-07T12:31:44.559 INFO:teuthology.orchestra.run.smithi047.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 64/354 objects degraded (18.079%), 17 pgs degraded 2024-02-07T12:31:44.559 INFO:teuthology.orchestra.run.smithi047.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-02-07T12:31:44.559 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-02-07T12:31:44.559 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-02-07T12:31:44.559 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-02-07T12:31:44.559 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-02-07T12:31:44.559 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-02-07T12:31:44.559 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-02-07T12:31:44.559 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-02-07T12:31:44.559 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-02-07T12:31:44.559 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-02-07T12:31:44.559 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-02-07T12:31:44.560 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-02-07T12:31:44.560 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-02-07T12:31:44.560 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-02-07T12:31:44.560 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-02-07T12:31:44.560 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-02-07T12:31:44.560 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-02-07T12:31:44.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.559+0000 7f560ad59700 1 -- 172.21.15.47:0/391482985 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f55ec06d7e0 msgr2=0x7f55ec06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:44.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.559+0000 7f560ad59700 1 --2- 172.21.15.47:0/391482985 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f55ec06d7e0 0x7f55ec06fc90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f55f4006fd0 tx=0x7f55f4008040 comp rx=0 tx=0).stop 2024-02-07T12:31:44.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.559+0000 7f560ad59700 1 -- 172.21.15.47:0/391482985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56040fe0e0 msgr2=0x7f560410ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:31:44.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.559+0000 7f560ad59700 1 --2- 172.21.15.47:0/391482985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56040fe0e0 0x7f560410ded0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f55f80093b0 tx=0x7f55f8009e30 comp rx=0 tx=0).stop 2024-02-07T12:31:44.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.559+0000 7f560ad59700 1 -- 172.21.15.47:0/391482985 shutdown_connections 2024-02-07T12:31:44.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.559+0000 7f560ad59700 1 --2- 172.21.15.47:0/391482985 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f55ec06d7e0 0x7f55ec06fc90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:44.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.559+0000 7f560ad59700 1 --2- 172.21.15.47:0/391482985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56040fcef0 0x7f560410d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:44.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.559+0000 7f560ad59700 1 --2- 172.21.15.47:0/391482985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56040fe0e0 0x7f560410ded0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:31:44.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.559+0000 7f560ad59700 1 -- 172.21.15.47:0/391482985 >> 172.21.15.47:0/391482985 conn(0x7f56040f8620 msgr2=0x7f56041013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:31:44.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.559+0000 7f560ad59700 1 -- 172.21.15.47:0/391482985 shutdown_connections 2024-02-07T12:31:44.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:31:44.559+0000 7f560ad59700 1 -- 172.21.15.47:0/391482985 wait complete. 2024-02-07T12:31:44.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:44 smithi047 ceph-mon[93224]: pgmap v120: 65 pgs: 8 peering, 17 active+undersized+degraded, 13 active+undersized, 27 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 64/354 objects degraded (18.079%) 2024-02-07T12:31:44.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:44 smithi047 ceph-mon[93224]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:44.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:44 smithi047 ceph-mon[93224]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:44.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:44 smithi047 ceph-mon[93224]: failed to encode map e70 with expected crc 2024-02-07T12:31:44.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:44 smithi047 ceph-mon[93224]: failed to encode map e70 with expected crc 2024-02-07T12:31:44.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:44 smithi047 ceph-mon[93224]: Health check update: Degraded data redundancy: 64/354 objects degraded (18.079%), 17 pgs degraded (PG_DEGRADED) 2024-02-07T12:31:44.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:44 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1647550886' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:31:44.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:44 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/391482985' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:31:45.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:44 smithi138 ceph-mon[82055]: pgmap v120: 65 pgs: 8 peering, 17 active+undersized+degraded, 13 active+undersized, 27 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 64/354 objects degraded (18.079%) 2024-02-07T12:31:45.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:44 smithi138 ceph-mon[82055]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:45.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:44 smithi138 ceph-mon[82055]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:45.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:44 smithi138 ceph-mon[82055]: failed to encode map e70 with expected crc 2024-02-07T12:31:45.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:44 smithi138 ceph-mon[82055]: failed to encode map e70 with expected crc 2024-02-07T12:31:45.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:44 smithi138 ceph-mon[82055]: Health check update: Degraded data redundancy: 64/354 objects degraded (18.079%), 17 pgs degraded (PG_DEGRADED) 2024-02-07T12:31:45.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:44 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1647550886' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:31:45.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:44 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/391482985' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:31:45.936 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:45 smithi138 ceph-mon[82055]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:46.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:45 smithi047 ceph-mon[93224]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:31:47.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:46 smithi138 ceph-mon[82055]: pgmap v122: 65 pgs: 8 peering, 11 active+undersized+degraded, 9 active+undersized, 37 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 48/354 objects degraded (13.559%) 2024-02-07T12:31:47.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:46 smithi047 ceph-mon[93224]: pgmap v122: 65 pgs: 8 peering, 11 active+undersized+degraded, 9 active+undersized, 37 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 48/354 objects degraded (13.559%) 2024-02-07T12:31:49.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:48 smithi138 ceph-mon[82055]: pgmap v123: 65 pgs: 8 peering, 1 active+undersized+degraded, 3 active+undersized, 53 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 4/354 objects degraded (1.130%) 2024-02-07T12:31:49.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:48 smithi047 ceph-mon[93224]: pgmap v123: 65 pgs: 8 peering, 1 active+undersized+degraded, 3 active+undersized, 53 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 4/354 objects degraded (1.130%) 2024-02-07T12:31:50.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:49 smithi138 ceph-mon[82055]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/354 objects degraded (1.130%), 1 pg degraded) 2024-02-07T12:31:50.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:49 smithi138 ceph-mon[82055]: Cluster is now healthy 2024-02-07T12:31:50.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:49 smithi047 ceph-mon[93224]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/354 objects degraded (1.130%), 1 pg degraded) 2024-02-07T12:31:50.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:49 smithi047 ceph-mon[93224]: Cluster is now healthy 2024-02-07T12:31:51.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:50 smithi138 ceph-mon[82055]: pgmap v124: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 2 op/s 2024-02-07T12:31:51.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:50 smithi047 ceph-mon[93224]: pgmap v124: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 2 op/s 2024-02-07T12:31:53.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:52 smithi138 ceph-mon[82055]: pgmap v125: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 4 op/s 2024-02-07T12:31:53.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:52 smithi047 ceph-mon[93224]: pgmap v125: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 4 op/s 2024-02-07T12:31:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:54 smithi138 ceph-mon[82055]: pgmap v126: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:31:55.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:54 smithi047 ceph-mon[93224]: pgmap v126: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:31:56.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:55 smithi138 ceph-mon[82055]: pgmap v127: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-07T12:31:56.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:55 smithi047 ceph-mon[93224]: pgmap v127: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-07T12:31:58.031 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:57 smithi138 ceph-mon[82055]: pgmap v128: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-07T12:31:58.031 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:58.031 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:31:58.031 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:58.031 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-07T12:31:58.031 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:57 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-07T12:31:58.031 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:57 smithi138 ceph-mon[82055]: Upgrade: osd.4 is safe to restart 2024-02-07T12:31:58.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:57 smithi047 ceph-mon[93224]: pgmap v128: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-07T12:31:58.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:58.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:31:58.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:31:58.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-07T12:31:58.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:57 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-07T12:31:58.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:57 smithi047 ceph-mon[93224]: Upgrade: osd.4 is safe to restart 2024-02-07T12:32:00.057 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:59 smithi138 ceph-mon[82055]: pgmap v129: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:32:00.057 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:59 smithi138 ceph-mon[82055]: Upgrade: Updating osd.4 2024-02-07T12:32:00.057 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:59 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:00.058 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:59 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-07T12:32:00.058 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:59 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:32:00.058 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:31:59 smithi138 ceph-mon[82055]: Deploying daemon osd.4 on smithi138 2024-02-07T12:32:00.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:59 smithi047 ceph-mon[93224]: pgmap v129: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:32:00.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:59 smithi047 ceph-mon[93224]: Upgrade: Updating osd.4 2024-02-07T12:32:00.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:59 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:00.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:59 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-07T12:32:00.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:59 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:32:00.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:31:59 smithi047 ceph-mon[93224]: Deploying daemon osd.4 on smithi138 2024-02-07T12:32:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:01 smithi138 ceph-mon[82055]: pgmap v130: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:32:02.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:01 smithi047 ceph-mon[93224]: pgmap v130: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:32:02.354 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:02 smithi138 systemd[1]: Stopping Ceph osd.4 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:32:02.784 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:02 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[47510]: 2024-02-07T12:32:02.351+0000 7ff227b05700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:32:02.785 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:02 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[47510]: 2024-02-07T12:32:02.351+0000 7ff227b05700 -1 osd.4 70 *** Got signal Terminated *** 2024-02-07T12:32:02.785 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:02 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[47510]: 2024-02-07T12:32:02.351+0000 7ff227b05700 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-07T12:32:03.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:02 smithi138 ceph-mon[82055]: osd.4 marked itself down and dead 2024-02-07T12:32:03.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:02 smithi047 ceph-mon[93224]: osd.4 marked itself down and dead 2024-02-07T12:32:03.537 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:03 smithi138 podman[96181]: 2024-02-07 12:32:03.283239755 +0000 UTC m=+1.038513787 container died 1e36c61a9e3999ed7b2594d5ffdf32a471631ed1fd1e3501d4fcdba7c16b12c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=quincy-f246262, GIT_CLEAN=True, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-07T12:32:03.813 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:03 smithi138 podman[96181]: 2024-02-07 12:32:03.609499799 +0000 UTC m=+1.364773830 container cleanup 1e36c61a9e3999ed7b2594d5ffdf32a471631ed1fd1e3501d4fcdba7c16b12c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=quincy-f246262, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:32:03.813 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:03 smithi138 bash[96181]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4 2024-02-07T12:32:04.233 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:03 smithi138 podman[96201]: 2024-02-07 12:32:03.810698657 +0000 UTC m=+0.525327235 container remove 1e36c61a9e3999ed7b2594d5ffdf32a471631ed1fd1e3501d4fcdba7c16b12c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, RELEASE=quincy-f246262, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2) 2024-02-07T12:32:04.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:03 smithi138 ceph-mon[82055]: pgmap v131: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:32:04.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:03 smithi138 ceph-mon[82055]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-07T12:32:04.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:03 smithi138 ceph-mon[82055]: failed to encode map e71 with expected crc 2024-02-07T12:32:04.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:03 smithi138 ceph-mon[82055]: osdmap e71: 6 total, 5 up, 6 in 2024-02-07T12:32:04.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:03 smithi047 ceph-mon[93224]: pgmap v131: 65 pgs: 65 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:32:04.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:03 smithi047 ceph-mon[93224]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-07T12:32:04.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:03 smithi047 ceph-mon[93224]: failed to encode map e71 with expected crc 2024-02-07T12:32:04.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:03 smithi047 ceph-mon[93224]: osdmap e71: 6 total, 5 up, 6 in 2024-02-07T12:32:04.534 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:04 smithi138 podman[96293]: 2024-02-07 12:32:04.134414899 +0000 UTC m=+0.017783749 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:32:04.535 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:04 smithi138 podman[96293]: 2024-02-07 12:32:04.236771168 +0000 UTC m=+0.120140018 container create dd732eb2d7ce49efc75bbff60524fae102b2e355c3746689bb0fddbce703c546 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-deactivate, ceph=True, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:32:04.535 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:04 smithi138 podman[96293]: 2024-02-07 12:32:04.464340771 +0000 UTC m=+0.347709622 container init dd732eb2d7ce49efc75bbff60524fae102b2e355c3746689bb0fddbce703c546 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, GIT_CLEAN=True, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-02-07T12:32:04.535 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:04 smithi138 podman[96293]: 2024-02-07 12:32:04.46752774 +0000 UTC m=+0.350896596 container start dd732eb2d7ce49efc75bbff60524fae102b2e355c3746689bb0fddbce703c546 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:32:04.943 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:04 smithi138 podman[96293]: 2024-02-07 12:32:04.539287163 +0000 UTC m=+0.422656028 container attach dd732eb2d7ce49efc75bbff60524fae102b2e355c3746689bb0fddbce703c546 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_BRANCH=HEAD) 2024-02-07T12:32:04.943 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:04 smithi138 podman[96293]: 2024-02-07 12:32:04.751059254 +0000 UTC m=+0.634428115 container died dd732eb2d7ce49efc75bbff60524fae102b2e355c3746689bb0fddbce703c546 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:32:05.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:04 smithi138 ceph-mon[82055]: osdmap e72: 6 total, 5 up, 6 in 2024-02-07T12:32:05.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:04 smithi138 ceph-mon[82055]: failed to encode map e72 with expected crc 2024-02-07T12:32:05.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:04 smithi138 ceph-mon[82055]: failed to encode map e72 with expected crc 2024-02-07T12:32:05.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:04 smithi138 ceph-mon[82055]: failed to encode map e72 with expected crc 2024-02-07T12:32:05.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:04 smithi047 ceph-mon[93224]: osdmap e72: 6 total, 5 up, 6 in 2024-02-07T12:32:05.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:04 smithi047 ceph-mon[93224]: failed to encode map e72 with expected crc 2024-02-07T12:32:05.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:04 smithi047 ceph-mon[93224]: failed to encode map e72 with expected crc 2024-02-07T12:32:05.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:04 smithi047 ceph-mon[93224]: failed to encode map e72 with expected crc 2024-02-07T12:32:05.771 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:05 smithi138 podman[96320]: 2024-02-07 12:32:05.326412536 +0000 UTC m=+0.566017944 container remove dd732eb2d7ce49efc75bbff60524fae102b2e355c3746689bb0fddbce703c546 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True) 2024-02-07T12:32:05.771 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:05 smithi138 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.4.service: Deactivated successfully. 2024-02-07T12:32:05.772 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:05 smithi138 systemd[1]: Stopped Ceph osd.4 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:32:05.772 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:05 smithi138 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.4.service: Consumed 58.132s CPU time. 2024-02-07T12:32:05.772 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:05 smithi138 systemd[1]: Starting Ceph osd.4 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:32:06.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:05 smithi138 ceph-mon[82055]: pgmap v134: 65 pgs: 4 active+undersized+degraded, 4 stale+active+clean, 6 active+undersized, 51 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 12/354 objects degraded (3.390%) 2024-02-07T12:32:06.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:05 smithi138 ceph-mon[82055]: Health check failed: Degraded data redundancy: 12/354 objects degraded (3.390%), 4 pgs degraded (PG_DEGRADED) 2024-02-07T12:32:06.035 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:05 smithi138 podman[96423]: 2024-02-07 12:32:05.672189058 +0000 UTC m=+0.017693871 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:32:06.035 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:05 smithi138 podman[96423]: 2024-02-07 12:32:05.785529956 +0000 UTC m=+0.131034768 container create 801b95bb315d63c22f095002248a90c96f2ea822bb88a78c0b932a5f788646ac (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:32:06.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:05 smithi047 ceph-mon[93224]: pgmap v134: 65 pgs: 4 active+undersized+degraded, 4 stale+active+clean, 6 active+undersized, 51 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 12/354 objects degraded (3.390%) 2024-02-07T12:32:06.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:05 smithi047 ceph-mon[93224]: Health check failed: Degraded data redundancy: 12/354 objects degraded (3.390%), 4 pgs degraded (PG_DEGRADED) 2024-02-07T12:32:06.484 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 podman[96423]: 2024-02-07 12:32:06.038537161 +0000 UTC m=+0.384041987 container init 801b95bb315d63c22f095002248a90c96f2ea822bb88a78c0b932a5f788646ac (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-activate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2) 2024-02-07T12:32:06.485 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 podman[96423]: 2024-02-07 12:32:06.041776953 +0000 UTC m=+0.387281775 container start 801b95bb315d63c22f095002248a90c96f2ea822bb88a78c0b932a5f788646ac (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-02-07T12:32:06.485 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 podman[96423]: 2024-02-07 12:32:06.14785215 +0000 UTC m=+0.493356973 container attach 801b95bb315d63c22f095002248a90c96f2ea822bb88a78c0b932a5f788646ac (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-activate, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-07T12:32:06.785 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-activate[96438]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-07T12:32:06.785 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-activate[96438]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-07T12:32:06.786 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 bash[96423]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-07T12:32:06.786 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 bash[96423]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-07T12:32:06.786 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 bash[96423]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-07T12:32:06.786 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 bash[96423]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-07T12:32:06.786 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 bash[96423]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-07T12:32:06.786 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 bash[96423]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-07T12:32:06.786 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 bash[96423]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-07T12:32:06.786 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-activate[96438]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-07T12:32:06.786 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-activate[96438]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-07T12:32:06.786 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-activate[96438]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-07T12:32:06.786 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-activate[96438]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-07T12:32:06.786 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-activate[96438]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-07T12:32:06.786 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:06 smithi138 podman[96423]: 2024-02-07 12:32:06.50742157 +0000 UTC m=+0.852926387 container died 801b95bb315d63c22f095002248a90c96f2ea822bb88a78c0b932a5f788646ac (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-activate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-07T12:32:07.501 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:07 smithi138 podman[96558]: 2024-02-07 12:32:07.150811762 +0000 UTC m=+0.638292783 container remove 801b95bb315d63c22f095002248a90c96f2ea822bb88a78c0b932a5f788646ac (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2) 2024-02-07T12:32:07.501 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:07 smithi138 podman[96619]: 2024-02-07 12:32:07.264878719 +0000 UTC m=+0.017688319 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:32:07.501 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:07 smithi138 podman[96619]: 2024-02-07 12:32:07.385087698 +0000 UTC m=+0.137897288 container create 3161c1dfe6f59e92e2568ec0d4c3daba2a30a18f917e24c56767418a0266b961 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-07T12:32:07.964 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:07 smithi138 podman[96619]: 2024-02-07 12:32:07.604503428 +0000 UTC m=+0.357313033 container init 3161c1dfe6f59e92e2568ec0d4c3daba2a30a18f917e24c56767418a0266b961 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc) 2024-02-07T12:32:07.964 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:07 smithi138 podman[96619]: 2024-02-07 12:32:07.607565147 +0000 UTC m=+0.360374741 container start 3161c1dfe6f59e92e2568ec0d4c3daba2a30a18f917e24c56767418a0266b961 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, GIT_CLEAN=True, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:32:07.964 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:07 smithi138 ceph-osd[96639]: -- 172.21.15.138:0/2586147597 <== mon.1 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5648088d96c0 con 0x5648088aac00 2024-02-07T12:32:07.964 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:07 smithi138 bash[96619]: 3161c1dfe6f59e92e2568ec0d4c3daba2a30a18f917e24c56767418a0266b961 2024-02-07T12:32:07.964 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:07 smithi138 systemd[1]: Started Ceph osd.4 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:32:08.284 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:08 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:32:08.144+0000 7ff8775e87c0 -1 Falling back to public interface 2024-02-07T12:32:08.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:07 smithi138 ceph-mon[82055]: pgmap v135: 65 pgs: 10 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 41 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 39/354 objects degraded (11.017%) 2024-02-07T12:32:08.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:07 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:08.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:07 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:08.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:07 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:08.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:07 smithi047 ceph-mon[93224]: pgmap v135: 65 pgs: 10 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 41 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 39/354 objects degraded (11.017%) 2024-02-07T12:32:08.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:07 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:08.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:07 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:08.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:07 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:10.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:10 smithi138 ceph-mon[82055]: pgmap v136: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-02-07T12:32:10.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:10 smithi047 ceph-mon[93224]: pgmap v136: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-02-07T12:32:12.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:12.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:12.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:12.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:13.035 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:12 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:32:12.685+0000 7ff8775e87c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-02-07T12:32:13.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:12 smithi138 ceph-mon[82055]: pgmap v137: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-02-07T12:32:13.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:13.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:32:13.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:13.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:13.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:12 smithi047 ceph-mon[93224]: pgmap v137: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-02-07T12:32:13.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:13.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:32:13.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:13.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:13.494 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:13 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:32:13.172+0000 7ff8775e87c0 -1 osd.4 70 log_to_monitors true 2024-02-07T12:32:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:13 smithi138 ceph-mon[82055]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-02-07T12:32:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:13 smithi138 ceph-mon[82055]: Health check update: Degraded data redundancy: 59/354 objects degraded (16.667%), 16 pgs degraded (PG_DEGRADED) 2024-02-07T12:32:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:13 smithi138 ceph-mon[82055]: from='osd.4 [v2:172.21.15.138:6808/3739765492,v1:172.21.15.138:6809/3739765492]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-07T12:32:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:13 smithi138 ceph-mon[82055]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-07T12:32:14.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:13 smithi047 ceph-mon[93224]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-02-07T12:32:14.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:13 smithi047 ceph-mon[93224]: Health check update: Degraded data redundancy: 59/354 objects degraded (16.667%), 16 pgs degraded (PG_DEGRADED) 2024-02-07T12:32:14.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:13 smithi047 ceph-mon[93224]: from='osd.4 [v2:172.21.15.138:6808/3739765492,v1:172.21.15.138:6809/3739765492]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-07T12:32:14.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:13 smithi047 ceph-mon[93224]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-07T12:32:14.457 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:32:14 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:32:14.190+0000 7ff868a47700 -1 osd.4 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-07T12:32:14.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.677+0000 7eff1a60c700 1 -- 172.21.15.47:0/3214965711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff140fcfb0 msgr2=0x7eff140fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.677+0000 7eff1a60c700 1 --2- 172.21.15.47:0/3214965711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff140fcfb0 0x7eff140fd420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff08004940 tx=0x7eff08009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.677+0000 7eff1a60c700 1 -- 172.21.15.47:0/3214965711 shutdown_connections 2024-02-07T12:32:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.677+0000 7eff1a60c700 1 --2- 172.21.15.47:0/3214965711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff140fcfb0 0x7eff140fd420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.677+0000 7eff1a60c700 1 --2- 172.21.15.47:0/3214965711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff140fbe40 0x7eff140fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.677+0000 7eff1a60c700 1 -- 172.21.15.47:0/3214965711 >> 172.21.15.47:0/3214965711 conn(0x7eff140f7520 msgr2=0x7eff140f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.677+0000 7eff1a60c700 1 -- 172.21.15.47:0/3214965711 shutdown_connections 2024-02-07T12:32:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.677+0000 7eff1a60c700 1 -- 172.21.15.47:0/3214965711 wait complete. 2024-02-07T12:32:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.677+0000 7eff1a60c700 1 Processor -- start 2024-02-07T12:32:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.678+0000 7eff1a60c700 1 -- start start 2024-02-07T12:32:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.678+0000 7eff1a60c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff140fbe40 0x7eff1410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.678+0000 7eff1a60c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff140fcfb0 0x7eff1410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.678+0000 7eff1a60c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1410e470 con 0x7eff140fbe40 2024-02-07T12:32:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.678+0000 7eff1a60c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1410ed10 con 0x7eff140fcfb0 2024-02-07T12:32:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.678+0000 7eff13fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff140fbe40 0x7eff1410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.678+0000 7eff13fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff140fbe40 0x7eff1410d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58278/0 (socket says 172.21.15.47:58278) 2024-02-07T12:32:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.678+0000 7eff13fff700 1 -- 172.21.15.47:0/2995586007 learned_addr learned my addr 172.21.15.47:0/2995586007 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.678+0000 7eff137fe700 1 --2- 172.21.15.47:0/2995586007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff140fcfb0 0x7eff1410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.678+0000 7eff13fff700 1 -- 172.21.15.47:0/2995586007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff140fcfb0 msgr2=0x7eff1410de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:14.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.678+0000 7eff13fff700 1 --2- 172.21.15.47:0/2995586007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff140fcfb0 0x7eff1410de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:14.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.678+0000 7eff13fff700 1 -- 172.21.15.47:0/2995586007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08005040 con 0x7eff140fbe40 2024-02-07T12:32:14.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.678+0000 7eff137fe700 1 --2- 172.21.15.47:0/2995586007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff140fcfb0 0x7eff1410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:32:14.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.679+0000 7eff13fff700 1 --2- 172.21.15.47:0/2995586007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff140fbe40 0x7eff1410d930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7eff0400c830 tx=0x7eff04004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:14.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.679+0000 7eff10ff9700 1 -- 172.21.15.47:0/2995586007 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff0400a760 con 0x7eff140fbe40 2024-02-07T12:32:14.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.679+0000 7eff10ff9700 1 -- 172.21.15.47:0/2995586007 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff0400ad90 con 0x7eff140fbe40 2024-02-07T12:32:14.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.679+0000 7eff1a60c700 1 -- 172.21.15.47:0/2995586007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1410eff0 con 0x7eff140fbe40 2024-02-07T12:32:14.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.679+0000 7eff10ff9700 1 -- 172.21.15.47:0/2995586007 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff040113a0 con 0x7eff140fbe40 2024-02-07T12:32:14.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.679+0000 7eff1a60c700 1 -- 172.21.15.47:0/2995586007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1410f530 con 0x7eff140fbe40 2024-02-07T12:32:14.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.680+0000 7eff1a60c700 1 -- 172.21.15.47:0/2995586007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1404bed0 con 0x7eff140fbe40 2024-02-07T12:32:14.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.680+0000 7eff10ff9700 1 -- 172.21.15.47:0/2995586007 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7eff04012400 con 0x7eff140fbe40 2024-02-07T12:32:14.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.681+0000 7eff10ff9700 1 --2- 172.21.15.47:0/2995586007 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efefc06d7e0 0x7efefc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:14.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.681+0000 7eff10ff9700 1 -- 172.21.15.47:0/2995586007 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7eff0408ce10 con 0x7eff140fbe40 2024-02-07T12:32:14.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.681+0000 7eff137fe700 1 --2- 172.21.15.47:0/2995586007 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efefc06d7e0 0x7efefc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:14.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.681+0000 7eff137fe700 1 --2- 172.21.15.47:0/2995586007 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efefc06d7e0 0x7efefc06fc90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff08000c00 tx=0x7eff08009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:14.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.686+0000 7eff10ff9700 1 -- 172.21.15.47:0/2995586007 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7eff0405a2b0 con 0x7eff140fbe40 2024-02-07T12:32:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.908+0000 7eff1a60c700 1 -- 172.21.15.47:0/2995586007 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff14066660 con 0x7efefc06d7e0 2024-02-07T12:32:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.910+0000 7eff10ff9700 1 -- 172.21.15.47:0/2995586007 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7eff14066660 con 0x7efefc06d7e0 2024-02-07T12:32:14.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.912+0000 7eff1a60c700 1 -- 172.21.15.47:0/2995586007 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efefc06d7e0 msgr2=0x7efefc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:14.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.912+0000 7eff1a60c700 1 --2- 172.21.15.47:0/2995586007 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efefc06d7e0 0x7efefc06fc90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff08000c00 tx=0x7eff08009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:14.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.912+0000 7eff1a60c700 1 -- 172.21.15.47:0/2995586007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff140fbe40 msgr2=0x7eff1410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:14.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.912+0000 7eff1a60c700 1 --2- 172.21.15.47:0/2995586007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff140fbe40 0x7eff1410d930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7eff0400c830 tx=0x7eff04004470 comp rx=0 tx=0).stop 2024-02-07T12:32:14.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.912+0000 7eff1a60c700 1 -- 172.21.15.47:0/2995586007 shutdown_connections 2024-02-07T12:32:14.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.912+0000 7eff1a60c700 1 --2- 172.21.15.47:0/2995586007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff140fbe40 0x7eff1410d930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:14.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.912+0000 7eff1a60c700 1 --2- 172.21.15.47:0/2995586007 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efefc06d7e0 0x7efefc06fc90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:14.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.912+0000 7eff1a60c700 1 --2- 172.21.15.47:0/2995586007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff140fcfb0 0x7eff1410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:14.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.912+0000 7eff1a60c700 1 -- 172.21.15.47:0/2995586007 >> 172.21.15.47:0/2995586007 conn(0x7eff140f7520 msgr2=0x7eff14065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:14.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.912+0000 7eff1a60c700 1 -- 172.21.15.47:0/2995586007 shutdown_connections 2024-02-07T12:32:14.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:14.912+0000 7eff1a60c700 1 -- 172.21.15.47:0/2995586007 wait complete. 2024-02-07T12:32:14.926 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:32:15.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.015+0000 7fe4e340c700 1 -- 172.21.15.47:0/1789712335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4dc1003a0 msgr2=0x7fe4dc102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:15.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.015+0000 7fe4e340c700 1 --2- 172.21.15.47:0/1789712335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4dc1003a0 0x7fe4dc102780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0004940 tx=0x7fe4d0009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:15.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.015+0000 7fe4e340c700 1 -- 172.21.15.47:0/1789712335 shutdown_connections 2024-02-07T12:32:15.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.015+0000 7fe4e340c700 1 --2- 172.21.15.47:0/1789712335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4dc1003a0 0x7fe4dc102780 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.015+0000 7fe4e340c700 1 --2- 172.21.15.47:0/1789712335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4dc0fda80 0x7fe4dc0ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.015+0000 7fe4e340c700 1 -- 172.21.15.47:0/1789712335 >> 172.21.15.47:0/1789712335 conn(0x7fe4dc0f7520 msgr2=0x7fe4dc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:15.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.015+0000 7fe4e340c700 1 -- 172.21.15.47:0/1789712335 shutdown_connections 2024-02-07T12:32:15.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.015+0000 7fe4e340c700 1 -- 172.21.15.47:0/1789712335 wait complete. 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e340c700 1 Processor -- start 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e340c700 1 -- start start 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e340c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4dc0fda80 0x7fe4dc0fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e340c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4dc1003a0 0x7fe4dc0fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e340c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0fbf90 con 0x7fe4dc1003a0 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e340c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0fc100 con 0x7fe4dc0fda80 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e09a7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4dc1003a0 0x7fe4dc0fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e09a7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4dc1003a0 0x7fe4dc0fb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58290/0 (socket says 172.21.15.47:58290) 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e09a7700 1 -- 172.21.15.47:0/408065735 learned_addr learned my addr 172.21.15.47:0/408065735 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e11a8700 1 --2- 172.21.15.47:0/408065735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4dc0fda80 0x7fe4dc0fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e09a7700 1 -- 172.21.15.47:0/408065735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4dc0fda80 msgr2=0x7fe4dc0fd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e09a7700 1 --2- 172.21.15.47:0/408065735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4dc0fda80 0x7fe4dc0fd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e09a7700 1 -- 172.21.15.47:0/408065735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0005040 con 0x7fe4dc1003a0 2024-02-07T12:32:15.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4e09a7700 1 --2- 172.21.15.47:0/408065735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4dc1003a0 0x7fe4dc0fb990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009fd0 tx=0x7fe4d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:15.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.016+0000 7fe4d9ffb700 1 -- 172.21.15.47:0/408065735 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d000e040 con 0x7fe4dc1003a0 2024-02-07T12:32:15.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.017+0000 7fe4d9ffb700 1 -- 172.21.15.47:0/408065735 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4d000bcc0 con 0x7fe4dc1003a0 2024-02-07T12:32:15.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.017+0000 7fe4d9ffb700 1 -- 172.21.15.47:0/408065735 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d001c630 con 0x7fe4dc1003a0 2024-02-07T12:32:15.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.017+0000 7fe4e340c700 1 -- 172.21.15.47:0/408065735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc0fc380 con 0x7fe4dc1003a0 2024-02-07T12:32:15.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.017+0000 7fe4e340c700 1 -- 172.21.15.47:0/408065735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc115950 con 0x7fe4dc1003a0 2024-02-07T12:32:15.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.018+0000 7fe4e340c700 1 -- 172.21.15.47:0/408065735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc04bed0 con 0x7fe4dc1003a0 2024-02-07T12:32:15.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.018+0000 7fe4d9ffb700 1 -- 172.21.15.47:0/408065735 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe4d0013420 con 0x7fe4dc1003a0 2024-02-07T12:32:15.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.019+0000 7fe4d9ffb700 1 --2- 172.21.15.47:0/408065735 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe4c406d7f0 0x7fe4c406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:15.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.019+0000 7fe4d9ffb700 1 -- 172.21.15.47:0/408065735 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe4d008e2f0 con 0x7fe4dc1003a0 2024-02-07T12:32:15.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.019+0000 7fe4e11a8700 1 --2- 172.21.15.47:0/408065735 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe4c406d7f0 0x7fe4c406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:15.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.019+0000 7fe4e11a8700 1 --2- 172.21.15.47:0/408065735 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe4c406d7f0 0x7fe4c406fca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0fd2a0 tx=0x7fe4d400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:15.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.023+0000 7fe4d9ffb700 1 -- 172.21.15.47:0/408065735 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe4d005b6f0 con 0x7fe4dc1003a0 2024-02-07T12:32:15.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.265+0000 7fe4e340c700 1 -- 172.21.15.47:0/408065735 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4dc101000 con 0x7fe4c406d7f0 2024-02-07T12:32:15.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.266+0000 7fe4d9ffb700 1 -- 172.21.15.47:0/408065735 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe4dc101000 con 0x7fe4c406d7f0 2024-02-07T12:32:15.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:15 smithi047 ceph-mon[93224]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-07T12:32:15.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:15 smithi047 ceph-mon[93224]: failed to encode map e73 with expected crc 2024-02-07T12:32:15.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:15 smithi047 ceph-mon[93224]: osdmap e73: 6 total, 5 up, 6 in 2024-02-07T12:32:15.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:15 smithi047 ceph-mon[93224]: from='osd.4 [v2:172.21.15.138:6808/3739765492,v1:172.21.15.138:6809/3739765492]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:32:15.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:15 smithi047 ceph-mon[93224]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:32:15.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:15 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:15.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:15 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:15.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:15 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:32:15.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:15 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:32:15.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:15 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:15.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.268+0000 7fe4e340c700 1 -- 172.21.15.47:0/408065735 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe4c406d7f0 msgr2=0x7fe4c406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:15.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.268+0000 7fe4e340c700 1 --2- 172.21.15.47:0/408065735 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe4c406d7f0 0x7fe4c406fca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0fd2a0 tx=0x7fe4d400b040 comp rx=0 tx=0).stop 2024-02-07T12:32:15.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.268+0000 7fe4e340c700 1 -- 172.21.15.47:0/408065735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4dc1003a0 msgr2=0x7fe4dc0fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:15.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.268+0000 7fe4e340c700 1 --2- 172.21.15.47:0/408065735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4dc1003a0 0x7fe4dc0fb990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009fd0 tx=0x7fe4d0009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:15.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.268+0000 7fe4e340c700 1 -- 172.21.15.47:0/408065735 shutdown_connections 2024-02-07T12:32:15.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.268+0000 7fe4e340c700 1 --2- 172.21.15.47:0/408065735 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe4c406d7f0 0x7fe4c406fca0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.268+0000 7fe4e340c700 1 --2- 172.21.15.47:0/408065735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4dc0fda80 0x7fe4dc0fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.268+0000 7fe4e340c700 1 --2- 172.21.15.47:0/408065735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4dc1003a0 0x7fe4dc0fb990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.268+0000 7fe4e340c700 1 -- 172.21.15.47:0/408065735 >> 172.21.15.47:0/408065735 conn(0x7fe4dc0f7520 msgr2=0x7fe4dc0f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:15.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.268+0000 7fe4e340c700 1 -- 172.21.15.47:0/408065735 shutdown_connections 2024-02-07T12:32:15.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.268+0000 7fe4e340c700 1 -- 172.21.15.47:0/408065735 wait complete. 2024-02-07T12:32:15.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.370+0000 7f7be6668700 1 -- 172.21.15.47:0/637592037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00fe580 msgr2=0x7f7be00fe990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:15.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.370+0000 7f7be6668700 1 --2- 172.21.15.47:0/637592037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00fe580 0x7f7be00fe990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0004940 tx=0x7f7bd0009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:15.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.371+0000 7f7be6668700 1 -- 172.21.15.47:0/637592037 shutdown_connections 2024-02-07T12:32:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.371+0000 7f7be6668700 1 --2- 172.21.15.47:0/637592037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be00feed0 0x7f7be00fb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.371+0000 7f7be6668700 1 --2- 172.21.15.47:0/637592037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00fe580 0x7f7be00fe990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.371+0000 7f7be6668700 1 -- 172.21.15.47:0/637592037 >> 172.21.15.47:0/637592037 conn(0x7f7be00f6d20 msgr2=0x7f7be00f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.371+0000 7f7be6668700 1 -- 172.21.15.47:0/637592037 shutdown_connections 2024-02-07T12:32:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.371+0000 7f7be6668700 1 -- 172.21.15.47:0/637592037 wait complete. 2024-02-07T12:32:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.371+0000 7f7be6668700 1 Processor -- start 2024-02-07T12:32:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.371+0000 7f7be6668700 1 -- start start 2024-02-07T12:32:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.371+0000 7f7be6668700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be00fe580 0x7f7be00fddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.371+0000 7f7be6668700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00feed0 0x7f7be00fc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.371+0000 7f7be6668700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00fc840 con 0x7f7be00feed0 2024-02-07T12:32:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.371+0000 7f7be6668700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00fc9b0 con 0x7f7be00fe580 2024-02-07T12:32:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.372+0000 7f7bdf7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00feed0 0x7f7be00fc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.372+0000 7f7bdf7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00feed0 0x7f7be00fc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58318/0 (socket says 172.21.15.47:58318) 2024-02-07T12:32:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.372+0000 7f7bdf7fe700 1 -- 172.21.15.47:0/3628702473 learned_addr learned my addr 172.21.15.47:0/3628702473 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.372+0000 7f7bdffff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be00fe580 0x7f7be00fddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.372+0000 7f7bdf7fe700 1 -- 172.21.15.47:0/3628702473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be00fe580 msgr2=0x7f7be00fddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.372+0000 7f7bdf7fe700 1 --2- 172.21.15.47:0/3628702473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be00fe580 0x7f7be00fddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.372+0000 7f7bdf7fe700 1 -- 172.21.15.47:0/3628702473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd0005040 con 0x7f7be00feed0 2024-02-07T12:32:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.372+0000 7f7bdf7fe700 1 --2- 172.21.15.47:0/3628702473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00feed0 0x7f7be00fc240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8002a50 tx=0x7f7bc80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.372+0000 7f7bdcff9700 1 -- 172.21.15.47:0/3628702473 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc8007cc0 con 0x7f7be00feed0 2024-02-07T12:32:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.372+0000 7f7bdcff9700 1 -- 172.21.15.47:0/3628702473 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bc800f040 con 0x7f7be00feed0 2024-02-07T12:32:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.372+0000 7f7be6668700 1 -- 172.21.15.47:0/3628702473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be00fcc90 con 0x7f7be00feed0 2024-02-07T12:32:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.372+0000 7f7bdcff9700 1 -- 172.21.15.47:0/3628702473 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc800da30 con 0x7f7be00feed0 2024-02-07T12:32:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.372+0000 7f7be6668700 1 -- 172.21.15.47:0/3628702473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be0115cb0 con 0x7f7be00feed0 2024-02-07T12:32:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.373+0000 7f7be6668700 1 -- 172.21.15.47:0/3628702473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be0107a70 con 0x7f7be00feed0 2024-02-07T12:32:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.374+0000 7f7bdcff9700 1 -- 172.21.15.47:0/3628702473 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f7bc800db90 con 0x7f7be00feed0 2024-02-07T12:32:15.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.374+0000 7f7bdcff9700 1 --2- 172.21.15.47:0/3628702473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7bcc06d7e0 0x7f7bcc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:15.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.374+0000 7f7bdcff9700 1 -- 172.21.15.47:0/3628702473 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7bc808cc70 con 0x7f7be00feed0 2024-02-07T12:32:15.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.374+0000 7f7bdffff700 1 --2- 172.21.15.47:0/3628702473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7bcc06d7e0 0x7f7bcc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:15.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.374+0000 7f7bdffff700 1 --2- 172.21.15.47:0/3628702473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7bcc06d7e0 0x7f7bcc06fc90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0004890 tx=0x7f7bd0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:15.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.379+0000 7f7bdcff9700 1 -- 172.21.15.47:0/3628702473 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7bc8059ff0 con 0x7f7be00feed0 2024-02-07T12:32:15.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:15 smithi138 ceph-mon[82055]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-07T12:32:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:15 smithi138 ceph-mon[82055]: failed to encode map e73 with expected crc 2024-02-07T12:32:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:15 smithi138 ceph-mon[82055]: osdmap e73: 6 total, 5 up, 6 in 2024-02-07T12:32:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:15 smithi138 ceph-mon[82055]: from='osd.4 [v2:172.21.15.138:6808/3739765492,v1:172.21.15.138:6809/3739765492]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:32:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:15 smithi138 ceph-mon[82055]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:32:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:15 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:15 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:15 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:32:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:15 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:32:15.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:15 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:15.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.594+0000 7f7be6668700 1 -- 172.21.15.47:0/3628702473 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7be0105aa0 con 0x7f7bcc06d7e0 2024-02-07T12:32:15.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.604+0000 7f7bdcff9700 1 -- 172.21.15.47:0/3628702473 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7be0105aa0 con 0x7f7bcc06d7e0 2024-02-07T12:32:15.608 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:32:15.608 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (5m) 71s ago 14m 26.6M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:32:15.608 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (2m) 71s ago 14m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:32:15.608 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (2m) 4s ago 13m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:32:15.608 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (5m) 71s ago 14m 78.4M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:32:15.608 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (9m) 71s ago 9m 111M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:32:15.608 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (9m) 71s ago 9m 129M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:32:15.608 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (9m) 4s ago 9m 68.4M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:32:15.608 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (9m) 4s ago 9m 69.7M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:32:15.608 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (4m) 71s ago 16m 503M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:32:15.609 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (4m) 4s ago 13m 452M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:32:15.609 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (3m) 71s ago 16m 47.4M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:32:15.609 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (3m) 4s ago 13m 36.5M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:32:15.609 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (6m) 71s ago 14m 15.1M - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:32:15.609 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (4m) 4s ago 13m 14.8M - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:32:15.609 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (2m) 71s ago 13m 87.4M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:32:15.609 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (113s) 71s ago 12m 98.5M 1559M 19.0.0-1252-g44458cce 79957b372307 0f2b0eea74d7 2024-02-07T12:32:15.609 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (77s) 71s ago 12m 12.6M 1559M 19.0.0-1252-g44458cce 79957b372307 0b8c78346346 2024-02-07T12:32:15.609 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (41s) 4s ago 11m 111M 2581M 19.0.0-1252-g44458cce 79957b372307 dea45db021db 2024-02-07T12:32:15.610 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (8s) 4s ago 11m 11.9M 2581M 19.0.0-1252-g44458cce 79957b372307 3161c1dfe6f5 2024-02-07T12:32:15.610 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (10m) 4s ago 10m 219M 2581M 17.2.7-491-gf2462625 4ad3622d1b31 7bde26610b26 2024-02-07T12:32:15.610 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (4m) 71s ago 14m 51.5M - 2.43.0 a07b618ecd1d 32840d82c54b 2024-02-07T12:32:15.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.606+0000 7f7be6668700 1 -- 172.21.15.47:0/3628702473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7bcc06d7e0 msgr2=0x7f7bcc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:15.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.606+0000 7f7be6668700 1 --2- 172.21.15.47:0/3628702473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7bcc06d7e0 0x7f7bcc06fc90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0004890 tx=0x7f7bd0009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:15.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.606+0000 7f7be6668700 1 -- 172.21.15.47:0/3628702473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00feed0 msgr2=0x7f7be00fc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:15.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.606+0000 7f7be6668700 1 --2- 172.21.15.47:0/3628702473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00feed0 0x7f7be00fc240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8002a50 tx=0x7f7bc80046b0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.606+0000 7f7be6668700 1 -- 172.21.15.47:0/3628702473 shutdown_connections 2024-02-07T12:32:15.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.606+0000 7f7be6668700 1 --2- 172.21.15.47:0/3628702473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7bcc06d7e0 0x7f7bcc06fc90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.606+0000 7f7be6668700 1 --2- 172.21.15.47:0/3628702473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be00fe580 0x7f7be00fddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.606+0000 7f7be6668700 1 --2- 172.21.15.47:0/3628702473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00feed0 0x7f7be00fc240 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.606+0000 7f7be6668700 1 -- 172.21.15.47:0/3628702473 >> 172.21.15.47:0/3628702473 conn(0x7f7be00f6d20 msgr2=0x7f7be0101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:15.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.606+0000 7f7be6668700 1 -- 172.21.15.47:0/3628702473 shutdown_connections 2024-02-07T12:32:15.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.606+0000 7f7be6668700 1 -- 172.21.15.47:0/3628702473 wait complete. 2024-02-07T12:32:15.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.707+0000 7f9753a6f700 1 -- 172.21.15.47:0/2219225466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f974c0fcfb0 msgr2=0x7f974c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:15.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.707+0000 7f9753a6f700 1 --2- 172.21.15.47:0/2219225466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f974c0fcfb0 0x7f974c0fd420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9740004940 tx=0x7f9740009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:15.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.707+0000 7f9753a6f700 1 -- 172.21.15.47:0/2219225466 shutdown_connections 2024-02-07T12:32:15.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.707+0000 7f9753a6f700 1 --2- 172.21.15.47:0/2219225466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f974c0fcfb0 0x7f974c0fd420 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.707+0000 7f9753a6f700 1 --2- 172.21.15.47:0/2219225466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f974c0fbe40 0x7f974c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.707+0000 7f9753a6f700 1 -- 172.21.15.47:0/2219225466 >> 172.21.15.47:0/2219225466 conn(0x7f974c0f74e0 msgr2=0x7f974c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:15.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.707+0000 7f9753a6f700 1 -- 172.21.15.47:0/2219225466 shutdown_connections 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.707+0000 7f9753a6f700 1 -- 172.21.15.47:0/2219225466 wait complete. 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f9753a6f700 1 Processor -- start 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f9753a6f700 1 -- start start 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f9753a6f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f974c0fbe40 0x7f974c110630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f9753a6f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f974c0fcfb0 0x7f974c112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f9753a6f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974c0664c0 con 0x7f974c0fbe40 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f9753a6f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974c066600 con 0x7f974c0fcfb0 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f975180b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f974c0fbe40 0x7f974c110630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f975180b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f974c0fbe40 0x7f974c110630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58336/0 (socket says 172.21.15.47:58336) 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f975180b700 1 -- 172.21.15.47:0/1560621099 learned_addr learned my addr 172.21.15.47:0/1560621099 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f975100a700 1 --2- 172.21.15.47:0/1560621099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f974c0fcfb0 0x7f974c112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f975180b700 1 -- 172.21.15.47:0/1560621099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f974c0fcfb0 msgr2=0x7f974c112b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f975180b700 1 --2- 172.21.15.47:0/1560621099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f974c0fcfb0 0x7f974c112b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f975180b700 1 -- 172.21.15.47:0/1560621099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9740005040 con 0x7f974c0fbe40 2024-02-07T12:32:15.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.708+0000 7f975100a700 1 --2- 172.21.15.47:0/1560621099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f974c0fcfb0 0x7f974c112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:32:15.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.709+0000 7f975180b700 1 --2- 172.21.15.47:0/1560621099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f974c0fbe40 0x7f974c110630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f973c001db0 tx=0x7f973c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:15.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.709+0000 7f974a7fc700 1 -- 172.21.15.47:0/1560621099 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f973c007d10 con 0x7f974c0fbe40 2024-02-07T12:32:15.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.709+0000 7f9753a6f700 1 -- 172.21.15.47:0/1560621099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974c1131e0 con 0x7f974c0fbe40 2024-02-07T12:32:15.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.709+0000 7f974a7fc700 1 -- 172.21.15.47:0/1560621099 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f973c007e70 con 0x7f974c0fbe40 2024-02-07T12:32:15.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.709+0000 7f974a7fc700 1 -- 172.21.15.47:0/1560621099 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f973c014640 con 0x7f974c0fbe40 2024-02-07T12:32:15.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.709+0000 7f9753a6f700 1 -- 172.21.15.47:0/1560621099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974c113720 con 0x7f974c0fbe40 2024-02-07T12:32:15.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.710+0000 7f9753a6f700 1 -- 172.21.15.47:0/1560621099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974c04bed0 con 0x7f974c0fbe40 2024-02-07T12:32:15.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.710+0000 7f974a7fc700 1 -- 172.21.15.47:0/1560621099 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f973c0092f0 con 0x7f974c0fbe40 2024-02-07T12:32:15.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.711+0000 7f974a7fc700 1 --2- 172.21.15.47:0/1560621099 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f973406d7e0 0x7f973406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:15.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.711+0000 7f974a7fc700 1 -- 172.21.15.47:0/1560621099 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f973c08ccd0 con 0x7f974c0fbe40 2024-02-07T12:32:15.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.711+0000 7f975100a700 1 --2- 172.21.15.47:0/1560621099 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f973406d7e0 0x7f973406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:15.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.711+0000 7f975100a700 1 --2- 172.21.15.47:0/1560621099 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f973406d7e0 0x7f973406fc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9740004560 tx=0x7f9740009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:15.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:15.715+0000 7f974a7fc700 1 -- 172.21.15.47:0/1560621099 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f973c0565d0 con 0x7f974c0fbe40 2024-02-07T12:32:16.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.008+0000 7f9753a6f700 1 -- 172.21.15.47:0/1560621099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f974c1139a0 con 0x7f974c0fbe40 2024-02-07T12:32:16.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.008+0000 7f974a7fc700 1 -- 172.21.15.47:0/1560621099 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f974c1139a0 con 0x7f974c0fbe40 2024-02-07T12:32:16.011 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:32:16.012 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:32:16.012 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:32:16.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:32:16.012 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:32:16.012 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:32:16.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:32:16.012 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:32:16.012 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 1, 2024-02-07T12:32:16.012 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 5 2024-02-07T12:32:16.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:32:16.012 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:32:16.012 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:32:16.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:32:16.013 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:32:16.013 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 5, 2024-02-07T12:32:16.013 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 9 2024-02-07T12:32:16.013 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:32:16.013 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:32:16.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.010+0000 7f9753a6f700 1 -- 172.21.15.47:0/1560621099 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f973406d7e0 msgr2=0x7f973406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:16.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.010+0000 7f9753a6f700 1 --2- 172.21.15.47:0/1560621099 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f973406d7e0 0x7f973406fc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9740004560 tx=0x7f9740009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:16.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.010+0000 7f9753a6f700 1 -- 172.21.15.47:0/1560621099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f974c0fbe40 msgr2=0x7f974c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:16.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.010+0000 7f9753a6f700 1 --2- 172.21.15.47:0/1560621099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f974c0fbe40 0x7f974c110630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f973c001db0 tx=0x7f973c009ec0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.010+0000 7f9753a6f700 1 -- 172.21.15.47:0/1560621099 shutdown_connections 2024-02-07T12:32:16.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.010+0000 7f9753a6f700 1 --2- 172.21.15.47:0/1560621099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f974c0fbe40 0x7f974c110630 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.010+0000 7f9753a6f700 1 --2- 172.21.15.47:0/1560621099 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f973406d7e0 0x7f973406fc90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.010+0000 7f9753a6f700 1 --2- 172.21.15.47:0/1560621099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f974c0fcfb0 0x7f974c112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.010+0000 7f9753a6f700 1 -- 172.21.15.47:0/1560621099 >> 172.21.15.47:0/1560621099 conn(0x7f974c0f74e0 msgr2=0x7f974c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:16.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.010+0000 7f9753a6f700 1 -- 172.21.15.47:0/1560621099 shutdown_connections 2024-02-07T12:32:16.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.010+0000 7f9753a6f700 1 -- 172.21.15.47:0/1560621099 wait complete. 2024-02-07T12:32:16.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.113+0000 7efc1e0cc700 1 -- 172.21.15.47:0/1226805736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc180fb300 msgr2=0x7efc180fb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:16.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.113+0000 7efc1e0cc700 1 --2- 172.21.15.47:0/1226805736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc180fb300 0x7efc180fb710 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efc08004940 tx=0x7efc08009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:16.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.113+0000 7efc1e0cc700 1 -- 172.21.15.47:0/1226805736 shutdown_connections 2024-02-07T12:32:16.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.113+0000 7efc1e0cc700 1 --2- 172.21.15.47:0/1226805736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc180fbce0 0x7efc18102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.113+0000 7efc1e0cc700 1 --2- 172.21.15.47:0/1226805736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc180fb300 0x7efc180fb710 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.113+0000 7efc1e0cc700 1 -- 172.21.15.47:0/1226805736 >> 172.21.15.47:0/1226805736 conn(0x7efc180f6ca0 msgr2=0x7efc180f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:16.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.113+0000 7efc1e0cc700 1 -- 172.21.15.47:0/1226805736 shutdown_connections 2024-02-07T12:32:16.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.113+0000 7efc1e0cc700 1 -- 172.21.15.47:0/1226805736 wait complete. 2024-02-07T12:32:16.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.113+0000 7efc1e0cc700 1 Processor -- start 2024-02-07T12:32:16.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.113+0000 7efc1e0cc700 1 -- start start 2024-02-07T12:32:16.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efc1e0cc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc180fb300 0x7efc1810da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:16.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efc1e0cc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc1810df90 0x7efc1810ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:16.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efc1e0cc700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1810e4e0 con 0x7efc1810df90 2024-02-07T12:32:16.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efc1e0cc700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1810e620 con 0x7efc180fb300 2024-02-07T12:32:16.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efc16ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc1810df90 0x7efc1810ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:16.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efc16ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc1810df90 0x7efc1810ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58362/0 (socket says 172.21.15.47:58362) 2024-02-07T12:32:16.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efc16ffd700 1 -- 172.21.15.47:0/331096692 learned_addr learned my addr 172.21.15.47:0/331096692 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:16.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efc177fe700 1 --2- 172.21.15.47:0/331096692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc180fb300 0x7efc1810da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:16.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efc16ffd700 1 -- 172.21.15.47:0/331096692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc180fb300 msgr2=0x7efc1810da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:16.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efc16ffd700 1 --2- 172.21.15.47:0/331096692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc180fb300 0x7efc1810da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efc16ffd700 1 -- 172.21.15.47:0/331096692 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08005040 con 0x7efc1810df90 2024-02-07T12:32:16.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efc16ffd700 1 --2- 172.21.15.47:0/331096692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc1810df90 0x7efc1810ee30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00b790 tx=0x7efc0c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:16.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efbfffff700 1 -- 172.21.15.47:0/331096692 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc0c00f6f0 con 0x7efc1810df90 2024-02-07T12:32:16.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.114+0000 7efc1e0cc700 1 -- 172.21.15.47:0/331096692 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1810f510 con 0x7efc1810df90 2024-02-07T12:32:16.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.115+0000 7efbfffff700 1 -- 172.21.15.47:0/331096692 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc0c00fd20 con 0x7efc1810df90 2024-02-07T12:32:16.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.115+0000 7efbfffff700 1 -- 172.21.15.47:0/331096692 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc0c0103a0 con 0x7efc1810df90 2024-02-07T12:32:16.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.115+0000 7efc1e0cc700 1 -- 172.21.15.47:0/331096692 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1810fa50 con 0x7efc1810df90 2024-02-07T12:32:16.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.115+0000 7efc1e0cc700 1 -- 172.21.15.47:0/331096692 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1804bed0 con 0x7efc1810df90 2024-02-07T12:32:16.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.116+0000 7efbfffff700 1 -- 172.21.15.47:0/331096692 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7efc0c011400 con 0x7efc1810df90 2024-02-07T12:32:16.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.116+0000 7efbfffff700 1 --2- 172.21.15.47:0/331096692 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efc0006d7f0 0x7efc0006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:16.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.116+0000 7efbfffff700 1 -- 172.21.15.47:0/331096692 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7efc0c08cc50 con 0x7efc1810df90 2024-02-07T12:32:16.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.117+0000 7efc177fe700 1 --2- 172.21.15.47:0/331096692 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efc0006d7f0 0x7efc0006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:16.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.117+0000 7efc177fe700 1 --2- 172.21.15.47:0/331096692 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efc0006d7f0 0x7efc0006fca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efc080043d0 tx=0x7efc08009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:16.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.121+0000 7efbfffff700 1 -- 172.21.15.47:0/331096692 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efc0c05a050 con 0x7efc1810df90 2024-02-07T12:32:16.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: pgmap v140: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-02-07T12:32:16.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:16.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-07T12:32:16.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: failed to encode map e74 with expected crc 2024-02-07T12:32:16.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: osd.4 [v2:172.21.15.138:6808/3739765492,v1:172.21.15.138:6809/3739765492] boot 2024-02-07T12:32:16.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: osdmap e74: 6 total, 6 up, 6 in 2024-02-07T12:32:16.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:32:16.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:16.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:16.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:16.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:16.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-07T12:32:16.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-07T12:32:16.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-07T12:32:16.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:16.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:16.326 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:16 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1560621099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:16.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.388+0000 7efc1e0cc700 1 -- 172.21.15.47:0/331096692 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efc180fbd10 con 0x7efc1810df90 2024-02-07T12:32:16.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.388+0000 7efbfffff700 1 -- 172.21.15.47:0/331096692 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1872 (secure 0 0 0) 0x7efc0c059be0 con 0x7efc1810df90 2024-02-07T12:32:16.391 INFO:teuthology.orchestra.run.smithi047.stdout:e22 2024-02-07T12:32:16.391 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:32:16.391 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 22 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:29:33.611202+0000 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:32:16.392 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:32:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:32:16.394 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:32:16.394 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:32:16.394 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:32:16.394 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:32:16.394 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:32:16.394 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:32:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.390+0000 7efc1e0cc700 1 -- 172.21.15.47:0/331096692 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efc0006d7f0 msgr2=0x7efc0006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.390+0000 7efc1e0cc700 1 --2- 172.21.15.47:0/331096692 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efc0006d7f0 0x7efc0006fca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efc080043d0 tx=0x7efc08009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.390+0000 7efc1e0cc700 1 -- 172.21.15.47:0/331096692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc1810df90 msgr2=0x7efc1810ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.390+0000 7efc1e0cc700 1 --2- 172.21.15.47:0/331096692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc1810df90 0x7efc1810ee30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00b790 tx=0x7efc0c009220 comp rx=0 tx=0).stop 2024-02-07T12:32:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.390+0000 7efc1e0cc700 1 -- 172.21.15.47:0/331096692 shutdown_connections 2024-02-07T12:32:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.390+0000 7efc1e0cc700 1 --2- 172.21.15.47:0/331096692 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efc0006d7f0 0x7efc0006fca0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.390+0000 7efc1e0cc700 1 --2- 172.21.15.47:0/331096692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc180fb300 0x7efc1810da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.390+0000 7efc1e0cc700 1 --2- 172.21.15.47:0/331096692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc1810df90 0x7efc1810ee30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.390+0000 7efc1e0cc700 1 -- 172.21.15.47:0/331096692 >> 172.21.15.47:0/331096692 conn(0x7efc180f6ca0 msgr2=0x7efc180f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.390+0000 7efc1e0cc700 1 -- 172.21.15.47:0/331096692 shutdown_connections 2024-02-07T12:32:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.390+0000 7efc1e0cc700 1 -- 172.21.15.47:0/331096692 wait complete. 2024-02-07T12:32:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 22 2024-02-07T12:32:16.474 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: pgmap v140: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-02-07T12:32:16.474 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:16.474 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-07T12:32:16.474 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: failed to encode map e74 with expected crc 2024-02-07T12:32:16.474 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: osd.4 [v2:172.21.15.138:6808/3739765492,v1:172.21.15.138:6809/3739765492] boot 2024-02-07T12:32:16.474 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: osdmap e74: 6 total, 6 up, 6 in 2024-02-07T12:32:16.474 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-07T12:32:16.474 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:16.474 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:16.474 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:16.475 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:16.475 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-07T12:32:16.475 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-07T12:32:16.475 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-07T12:32:16.475 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:16.475 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:16.475 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:16 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1560621099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.493+0000 7fe2fcb00700 1 -- 172.21.15.47:0/2903778812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80fcef0 msgr2=0x7fe2f80fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.493+0000 7fe2fcb00700 1 --2- 172.21.15.47:0/2903778812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80fcef0 0x7fe2f80fd320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8004940 tx=0x7fe2e8009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.493+0000 7fe2fcb00700 1 -- 172.21.15.47:0/2903778812 shutdown_connections 2024-02-07T12:32:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.493+0000 7fe2fcb00700 1 --2- 172.21.15.47:0/2903778812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2f80fe0e0 0x7fe2f80fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.493+0000 7fe2fcb00700 1 --2- 172.21.15.47:0/2903778812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80fcef0 0x7fe2f80fd320 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.493+0000 7fe2fcb00700 1 -- 172.21.15.47:0/2903778812 >> 172.21.15.47:0/2903778812 conn(0x7fe2f80f8620 msgr2=0x7fe2f80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.493+0000 7fe2fcb00700 1 -- 172.21.15.47:0/2903778812 shutdown_connections 2024-02-07T12:32:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.493+0000 7fe2fcb00700 1 -- 172.21.15.47:0/2903778812 wait complete. 2024-02-07T12:32:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.494+0000 7fe2fcb00700 1 Processor -- start 2024-02-07T12:32:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.494+0000 7fe2fcb00700 1 -- start start 2024-02-07T12:32:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.494+0000 7fe2fcb00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80fcef0 0x7fe2f810d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.494+0000 7fe2fcb00700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2f80fe0e0 0x7fe2f810de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.494+0000 7fe2fcb00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f810e420 con 0x7fe2f80fcef0 2024-02-07T12:32:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.494+0000 7fe2fcb00700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f810ecc0 con 0x7fe2f80fe0e0 2024-02-07T12:32:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.494+0000 7fe2f659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80fcef0 0x7fe2f810d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.494+0000 7fe2f659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80fcef0 0x7fe2f810d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58378/0 (socket says 172.21.15.47:58378) 2024-02-07T12:32:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.494+0000 7fe2f659c700 1 -- 172.21.15.47:0/3200375524 learned_addr learned my addr 172.21.15.47:0/3200375524 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.494+0000 7fe2f5d9b700 1 --2- 172.21.15.47:0/3200375524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2f80fe0e0 0x7fe2f810de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.494+0000 7fe2f659c700 1 -- 172.21.15.47:0/3200375524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2f80fe0e0 msgr2=0x7fe2f810de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.494+0000 7fe2f659c700 1 --2- 172.21.15.47:0/3200375524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2f80fe0e0 0x7fe2f810de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.494+0000 7fe2f659c700 1 -- 172.21.15.47:0/3200375524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e8005040 con 0x7fe2f80fcef0 2024-02-07T12:32:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.495+0000 7fe2f659c700 1 --2- 172.21.15.47:0/3200375524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80fcef0 0x7fe2f810d8e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8000c00 tx=0x7fe2e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.495+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/3200375524 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2e800e040 con 0x7fe2f80fcef0 2024-02-07T12:32:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.495+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/3200375524 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe2e800bbf0 con 0x7fe2f80fcef0 2024-02-07T12:32:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.495+0000 7fe2fcb00700 1 -- 172.21.15.47:0/3200375524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f810ef40 con 0x7fe2f80fcef0 2024-02-07T12:32:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.495+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/3200375524 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2e801c630 con 0x7fe2f80fcef0 2024-02-07T12:32:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.495+0000 7fe2fcb00700 1 -- 172.21.15.47:0/3200375524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f810f480 con 0x7fe2f80fcef0 2024-02-07T12:32:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.496+0000 7fe2fcb00700 1 -- 172.21.15.47:0/3200375524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f804bed0 con 0x7fe2f80fcef0 2024-02-07T12:32:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.496+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/3200375524 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe2e800bd60 con 0x7fe2f80fcef0 2024-02-07T12:32:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.497+0000 7fe2e6ffd700 1 --2- 172.21.15.47:0/3200375524 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe2e006d7e0 0x7fe2e006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.497+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/3200375524 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe2e808e240 con 0x7fe2f80fcef0 2024-02-07T12:32:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.497+0000 7fe2f5d9b700 1 --2- 172.21.15.47:0/3200375524 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe2e006d7e0 0x7fe2e006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.497+0000 7fe2f5d9b700 1 --2- 172.21.15.47:0/3200375524 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe2e006d7e0 0x7fe2e006fc90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009fd0 tx=0x7fe2ec00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:16.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.501+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/3200375524 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe2e805b640 con 0x7fe2f80fcef0 2024-02-07T12:32:16.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.731+0000 7fe2fcb00700 1 -- 172.21.15.47:0/3200375524 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2f810faf0 con 0x7fe2e006d7e0 2024-02-07T12:32:16.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.733+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/3200375524 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe2f810faf0 con 0x7fe2e006d7e0 2024-02-07T12:32:16.736 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:32:16.736 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:32:16.736 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:32:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:32:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:32:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-02-07T12:32:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "mon", 2024-02-07T12:32:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr" 2024-02-07T12:32:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:32:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "11/21 daemons upgraded", 2024-02-07T12:32:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading osd daemons", 2024-02-07T12:32:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:32:16.737 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:32:16.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.735+0000 7fe2fcb00700 1 -- 172.21.15.47:0/3200375524 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe2e006d7e0 msgr2=0x7fe2e006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:16.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.735+0000 7fe2fcb00700 1 --2- 172.21.15.47:0/3200375524 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe2e006d7e0 0x7fe2e006fc90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009fd0 tx=0x7fe2ec00b040 comp rx=0 tx=0).stop 2024-02-07T12:32:16.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.735+0000 7fe2fcb00700 1 -- 172.21.15.47:0/3200375524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80fcef0 msgr2=0x7fe2f810d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:16.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.735+0000 7fe2fcb00700 1 --2- 172.21.15.47:0/3200375524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80fcef0 0x7fe2f810d8e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8000c00 tx=0x7fe2e8009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:16.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.735+0000 7fe2fcb00700 1 -- 172.21.15.47:0/3200375524 shutdown_connections 2024-02-07T12:32:16.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.735+0000 7fe2fcb00700 1 --2- 172.21.15.47:0/3200375524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80fcef0 0x7fe2f810d8e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.735+0000 7fe2fcb00700 1 --2- 172.21.15.47:0/3200375524 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe2e006d7e0 0x7fe2e006fc90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.735+0000 7fe2fcb00700 1 --2- 172.21.15.47:0/3200375524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2f80fe0e0 0x7fe2f810de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.735+0000 7fe2fcb00700 1 -- 172.21.15.47:0/3200375524 >> 172.21.15.47:0/3200375524 conn(0x7fe2f80f8620 msgr2=0x7fe2f81013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:16.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.735+0000 7fe2fcb00700 1 -- 172.21.15.47:0/3200375524 shutdown_connections 2024-02-07T12:32:16.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.735+0000 7fe2fcb00700 1 -- 172.21.15.47:0/3200375524 wait complete. 2024-02-07T12:32:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.837+0000 7f8379981700 1 -- 172.21.15.47:0/2208030788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83740fe1f0 msgr2=0x7f83740fe660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.837+0000 7f8379981700 1 --2- 172.21.15.47:0/2208030788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83740fe1f0 0x7f83740fe660 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8364004940 tx=0x7f8364009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.837+0000 7f8379981700 1 -- 172.21.15.47:0/2208030788 shutdown_connections 2024-02-07T12:32:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.837+0000 7f8379981700 1 --2- 172.21.15.47:0/2208030788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83740fe1f0 0x7f83740fe660 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.837+0000 7f8379981700 1 --2- 172.21.15.47:0/2208030788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83740fcf40 0x7f83740fd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.837+0000 7f8379981700 1 -- 172.21.15.47:0/2208030788 >> 172.21.15.47:0/2208030788 conn(0x7f83740f8680 msgr2=0x7f83740faad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.837+0000 7f8379981700 1 -- 172.21.15.47:0/2208030788 shutdown_connections 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.837+0000 7f8379981700 1 -- 172.21.15.47:0/2208030788 wait complete. 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.838+0000 7f8379981700 1 Processor -- start 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.838+0000 7f8379981700 1 -- start start 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.838+0000 7f8379981700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83740fcf40 0x7f8374071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.838+0000 7f8379981700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83740fe1f0 0x7f83740702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.838+0000 7f8379981700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8374070970 con 0x7f83740fcf40 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.838+0000 7f8379981700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8374070ae0 con 0x7f83740fe1f0 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.838+0000 7f8372ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83740fcf40 0x7f8374071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.838+0000 7f8372ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83740fcf40 0x7f8374071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58402/0 (socket says 172.21.15.47:58402) 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.838+0000 7f8372ffd700 1 -- 172.21.15.47:0/1256350438 learned_addr learned my addr 172.21.15.47:0/1256350438 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.838+0000 7f83727fc700 1 --2- 172.21.15.47:0/1256350438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83740fe1f0 0x7f83740702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.839+0000 7f8372ffd700 1 -- 172.21.15.47:0/1256350438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83740fe1f0 msgr2=0x7f83740702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.839+0000 7f8372ffd700 1 --2- 172.21.15.47:0/1256350438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83740fe1f0 0x7f83740702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.839+0000 7f8372ffd700 1 -- 172.21.15.47:0/1256350438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8364005040 con 0x7f83740fcf40 2024-02-07T12:32:16.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.839+0000 7f8372ffd700 1 --2- 172.21.15.47:0/1256350438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83740fcf40 0x7f8374071e60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f836800b790 tx=0x7f8368009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:16.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.839+0000 7f835b7fe700 1 -- 172.21.15.47:0/1256350438 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f836800f6f0 con 0x7f83740fcf40 2024-02-07T12:32:16.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.839+0000 7f8379981700 1 -- 172.21.15.47:0/1256350438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8374070dc0 con 0x7f83740fcf40 2024-02-07T12:32:16.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.839+0000 7f835b7fe700 1 -- 172.21.15.47:0/1256350438 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f836800fd20 con 0x7f83740fcf40 2024-02-07T12:32:16.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.839+0000 7f8379981700 1 -- 172.21.15.47:0/1256350438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8374071140 con 0x7f83740fcf40 2024-02-07T12:32:16.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.839+0000 7f835b7fe700 1 -- 172.21.15.47:0/1256350438 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83680103a0 con 0x7f83740fcf40 2024-02-07T12:32:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.840+0000 7f8379981700 1 -- 172.21.15.47:0/1256350438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837404bed0 con 0x7f83740fcf40 2024-02-07T12:32:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.841+0000 7f835b7fe700 1 -- 172.21.15.47:0/1256350438 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8368011400 con 0x7f83740fcf40 2024-02-07T12:32:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.841+0000 7f835b7fe700 1 --2- 172.21.15.47:0/1256350438 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f835c06d7e0 0x7f835c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.841+0000 7f835b7fe700 1 -- 172.21.15.47:0/1256350438 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f836808ccd0 con 0x7f83740fcf40 2024-02-07T12:32:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.841+0000 7f83727fc700 1 --2- 172.21.15.47:0/1256350438 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f835c06d7e0 0x7f835c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.842+0000 7f83727fc700 1 --2- 172.21.15.47:0/1256350438 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f835c06d7e0 0x7f835c06fc90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f836400b3b0 tx=0x7f8364009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:16.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:16.846+0000 7f835b7fe700 1 -- 172.21.15.47:0/1256350438 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f836805a0d0 con 0x7f83740fcf40 2024-02-07T12:32:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:17.134+0000 7f8379981700 1 -- 172.21.15.47:0/1256350438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8374115d10 con 0x7f83740fcf40 2024-02-07T12:32:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:17.134+0000 7f835b7fe700 1 -- 172.21.15.47:0/1256350438 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1073 (secure 0 0 0) 0x7f8368059c60 con 0x7f83740fcf40 2024-02-07T12:32:17.138 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_WARN Degraded data redundancy: 59/354 objects degraded (16.667%), 16 pgs degraded 2024-02-07T12:32:17.138 INFO:teuthology.orchestra.run.smithi047.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 59/354 objects degraded (16.667%), 16 pgs degraded 2024-02-07T12:32:17.138 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-02-07T12:32:17.138 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-02-07T12:32:17.138 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-02-07T12:32:17.138 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-02-07T12:32:17.138 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-02-07T12:32:17.138 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-02-07T12:32:17.138 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-02-07T12:32:17.138 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-02-07T12:32:17.138 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-02-07T12:32:17.138 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-02-07T12:32:17.138 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-02-07T12:32:17.139 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-02-07T12:32:17.139 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-02-07T12:32:17.139 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-02-07T12:32:17.139 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-02-07T12:32:17.139 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-02-07T12:32:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:17.137+0000 7f8379981700 1 -- 172.21.15.47:0/1256350438 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f835c06d7e0 msgr2=0x7f835c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:17.137+0000 7f8379981700 1 --2- 172.21.15.47:0/1256350438 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f835c06d7e0 0x7f835c06fc90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f836400b3b0 tx=0x7f8364009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:17.137+0000 7f8379981700 1 -- 172.21.15.47:0/1256350438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83740fcf40 msgr2=0x7f8374071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:17.137+0000 7f8379981700 1 --2- 172.21.15.47:0/1256350438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83740fcf40 0x7f8374071e60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f836800b790 tx=0x7f8368009250 comp rx=0 tx=0).stop 2024-02-07T12:32:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:17.137+0000 7f8379981700 1 -- 172.21.15.47:0/1256350438 shutdown_connections 2024-02-07T12:32:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:17.137+0000 7f8379981700 1 --2- 172.21.15.47:0/1256350438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83740fcf40 0x7f8374071e60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:17.137+0000 7f8379981700 1 --2- 172.21.15.47:0/1256350438 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f835c06d7e0 0x7f835c06fc90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:17.137+0000 7f8379981700 1 --2- 172.21.15.47:0/1256350438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83740fe1f0 0x7f83740702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:17.137+0000 7f8379981700 1 -- 172.21.15.47:0/1256350438 >> 172.21.15.47:0/1256350438 conn(0x7f83740f8680 msgr2=0x7f8374101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:17.137+0000 7f8379981700 1 -- 172.21.15.47:0/1256350438 shutdown_connections 2024-02-07T12:32:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:17.137+0000 7f8379981700 1 -- 172.21.15.47:0/1256350438 wait complete. 2024-02-07T12:32:17.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:17 smithi138 ceph-mon[82055]: osdmap e75: 6 total, 6 up, 6 in 2024-02-07T12:32:17.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:17 smithi138 ceph-mon[82055]: failed to encode map e75 with expected crc 2024-02-07T12:32:17.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:17 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/331096692' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:32:17.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:17 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1256350438' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:32:17.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:17 smithi047 ceph-mon[93224]: osdmap e75: 6 total, 6 up, 6 in 2024-02-07T12:32:17.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:17 smithi047 ceph-mon[93224]: failed to encode map e75 with expected crc 2024-02-07T12:32:17.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:17 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/331096692' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:32:17.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:17 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1256350438' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:32:18.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:18 smithi138 ceph-mon[82055]: pgmap v143: 65 pgs: 10 peering, 11 active+undersized+degraded, 13 active+undersized, 31 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 34/354 objects degraded (9.605%) 2024-02-07T12:32:18.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:18 smithi138 ceph-mon[82055]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:18.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:18 smithi138 ceph-mon[82055]: Health check update: Degraded data redundancy: 34/354 objects degraded (9.605%), 11 pgs degraded (PG_DEGRADED) 2024-02-07T12:32:18.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:18 smithi047 ceph-mon[93224]: pgmap v143: 65 pgs: 10 peering, 11 active+undersized+degraded, 13 active+undersized, 31 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 34/354 objects degraded (9.605%) 2024-02-07T12:32:18.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:18 smithi047 ceph-mon[93224]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:18.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:18 smithi047 ceph-mon[93224]: Health check update: Degraded data redundancy: 34/354 objects degraded (9.605%), 11 pgs degraded (PG_DEGRADED) 2024-02-07T12:32:20.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:20 smithi138 ceph-mon[82055]: pgmap v144: 65 pgs: 10 peering, 7 active+undersized+degraded, 7 active+undersized, 41 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 18/354 objects degraded (5.085%) 2024-02-07T12:32:20.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:20 smithi047 ceph-mon[93224]: pgmap v144: 65 pgs: 10 peering, 7 active+undersized+degraded, 7 active+undersized, 41 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 18/354 objects degraded (5.085%) 2024-02-07T12:32:21.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:21 smithi138 ceph-mon[82055]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/354 objects degraded (5.085%), 7 pgs degraded) 2024-02-07T12:32:21.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:21 smithi138 ceph-mon[82055]: Cluster is now healthy 2024-02-07T12:32:21.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:21 smithi047 ceph-mon[93224]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/354 objects degraded (5.085%), 7 pgs degraded) 2024-02-07T12:32:21.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:21 smithi047 ceph-mon[93224]: Cluster is now healthy 2024-02-07T12:32:22.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:22 smithi138 ceph-mon[82055]: pgmap v145: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-07T12:32:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:22 smithi047 ceph-mon[93224]: pgmap v145: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-07T12:32:24.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:24 smithi138 ceph-mon[82055]: pgmap v146: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 3 op/s 2024-02-07T12:32:24.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:24 smithi047 ceph-mon[93224]: pgmap v146: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 3 op/s 2024-02-07T12:32:26.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:26 smithi138 ceph-mon[82055]: pgmap v147: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:32:26.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:26 smithi047 ceph-mon[93224]: pgmap v147: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:32:27.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:27 smithi138 ceph-mon[82055]: pgmap v148: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-07T12:32:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:32:27.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:28.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:27 smithi047 ceph-mon[93224]: pgmap v148: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-07T12:32:28.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:28.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:32:28.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:30.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:30 smithi138 ceph-mon[82055]: pgmap v149: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:32:30.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:30 smithi047 ceph-mon[93224]: pgmap v149: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:32:31.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:31 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-07T12:32:31.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:31 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-07T12:32:31.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:31 smithi138 ceph-mon[82055]: Upgrade: osd.5 is safe to restart 2024-02-07T12:32:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:31 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-07T12:32:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:31 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-07T12:32:31.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:31 smithi047 ceph-mon[93224]: Upgrade: osd.5 is safe to restart 2024-02-07T12:32:32.504 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:32 smithi138 ceph-mon[82055]: pgmap v150: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:32:32.504 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:32 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:32.504 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:32 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-07T12:32:32.504 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:32 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:32:32.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:32 smithi047 ceph-mon[93224]: pgmap v150: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:32:32.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:32 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:32.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:32 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-07T12:32:32.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:32 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:32:33.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:33 smithi138 ceph-mon[82055]: Upgrade: Updating osd.5 2024-02-07T12:32:33.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:33 smithi138 ceph-mon[82055]: Deploying daemon osd.5 on smithi138 2024-02-07T12:32:33.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:33 smithi047 ceph-mon[93224]: Upgrade: Updating osd.5 2024-02-07T12:32:33.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:33 smithi047 ceph-mon[93224]: Deploying daemon osd.5 on smithi138 2024-02-07T12:32:34.304 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:34 smithi138 ceph-mon[82055]: pgmap v151: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:32:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:34 smithi047 ceph-mon[93224]: pgmap v151: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:32:35.341 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:35 smithi138 systemd[1]: Stopping Ceph osd.5 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:32:35.784 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:35 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[53997]: 2024-02-07T12:32:35.338+0000 7f29f9033700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:32:35.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:35 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[53997]: 2024-02-07T12:32:35.338+0000 7f29f9033700 -1 osd.5 75 *** Got signal Terminated *** 2024-02-07T12:32:35.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:35 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[53997]: 2024-02-07T12:32:35.338+0000 7f29f9033700 -1 osd.5 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-07T12:32:36.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:36 smithi138 ceph-mon[82055]: pgmap v152: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:32:36.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:36 smithi138 ceph-mon[82055]: osd.5 marked itself down and dead 2024-02-07T12:32:36.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:36 smithi047 ceph-mon[93224]: pgmap v152: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:32:36.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:36 smithi047 ceph-mon[93224]: osd.5 marked itself down and dead 2024-02-07T12:32:36.925 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:36 smithi138 podman[101468]: 2024-02-07 12:32:36.649390194 +0000 UTC m=+1.434665229 container died 7bde26610b26751e8931124b6a4ff0ec8b57d283e9135b589b1f21b1feefcb67 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5, io.buildah.version=1.33.2, RELEASE=quincy-f246262, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131) 2024-02-07T12:32:37.188 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:37 smithi138 podman[101468]: 2024-02-07 12:32:37.013911664 +0000 UTC m=+1.799186705 container cleanup 7bde26610b26751e8931124b6a4ff0ec8b57d283e9135b589b1f21b1feefcb67 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=quincy-f246262, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-02-07T12:32:37.188 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:37 smithi138 bash[101468]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5 2024-02-07T12:32:37.534 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:37 smithi138 podman[101486]: 2024-02-07 12:32:37.281937097 +0000 UTC m=+0.625580565 container remove 7bde26610b26751e8931124b6a4ff0ec8b57d283e9135b589b1f21b1feefcb67 (image=quay.ceph.io/ceph-ci/ceph@sha256:dce3e7b7e9694cc8e6dd0062b67f9d48f3d9d935ae81c147860464f227538255, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=quincy-f246262, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:32:37.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:37 smithi138 ceph-mon[82055]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-07T12:32:37.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:37 smithi138 ceph-mon[82055]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-07T12:32:37.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:37 smithi138 ceph-mon[82055]: osdmap e76: 6 total, 5 up, 6 in 2024-02-07T12:32:37.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:37 smithi047 ceph-mon[93224]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-07T12:32:37.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:37 smithi047 ceph-mon[93224]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-07T12:32:37.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:37 smithi047 ceph-mon[93224]: osdmap e76: 6 total, 5 up, 6 in 2024-02-07T12:32:37.962 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:37 smithi138 podman[101581]: 2024-02-07 12:32:37.624584526 +0000 UTC m=+0.110411750 container create 20ebc9f000435ba0826d80cdd37b848e55da58873f32c39823e138866dfe14f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-02-07T12:32:37.962 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:37 smithi138 podman[101581]: 2024-02-07 12:32:37.532174445 +0000 UTC m=+0.018001673 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:32:37.962 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:37 smithi138 podman[101581]: 2024-02-07 12:32:37.860702267 +0000 UTC m=+0.346529490 container init 20ebc9f000435ba0826d80cdd37b848e55da58873f32c39823e138866dfe14f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-02-07T12:32:37.962 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:37 smithi138 podman[101581]: 2024-02-07 12:32:37.863765769 +0000 UTC m=+0.349592993 container start 20ebc9f000435ba0826d80cdd37b848e55da58873f32c39823e138866dfe14f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-02-07T12:32:37.963 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:37 smithi138 podman[101581]: 2024-02-07 12:32:37.960648318 +0000 UTC m=+0.446475563 container attach 20ebc9f000435ba0826d80cdd37b848e55da58873f32c39823e138866dfe14f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:32:38.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:38 smithi138 ceph-mon[82055]: pgmap v154: 65 pgs: 13 stale+active+clean, 52 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:32:38.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:38 smithi138 ceph-mon[82055]: osdmap e77: 6 total, 5 up, 6 in 2024-02-07T12:32:38.285 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:38 smithi138 podman[101581]: 2024-02-07 12:32:38.156180912 +0000 UTC m=+0.642008131 container died 20ebc9f000435ba0826d80cdd37b848e55da58873f32c39823e138866dfe14f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, ceph=True, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=) 2024-02-07T12:32:38.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:38 smithi047 ceph-mon[93224]: pgmap v154: 65 pgs: 13 stale+active+clean, 52 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:32:38.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:38 smithi047 ceph-mon[93224]: osdmap e77: 6 total, 5 up, 6 in 2024-02-07T12:32:39.249 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:38 smithi138 podman[101607]: 2024-02-07 12:32:38.931277285 +0000 UTC m=+0.766394379 container remove 20ebc9f000435ba0826d80cdd37b848e55da58873f32c39823e138866dfe14f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:32:39.249 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:38 smithi138 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.5.service: Deactivated successfully. 2024-02-07T12:32:39.249 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:38 smithi138 systemd[1]: Stopped Ceph osd.5 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:32:39.249 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:38 smithi138 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.5.service: Consumed 59.063s CPU time. 2024-02-07T12:32:39.249 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:39 smithi138 systemd[1]: Starting Ceph osd.5 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:32:39.504 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:39 smithi138 ceph-mon[82055]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-07T12:32:39.504 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:39 smithi138 podman[101713]: 2024-02-07 12:32:39.285751738 +0000 UTC m=+0.018885508 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:32:39.504 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:39 smithi138 podman[101713]: 2024-02-07 12:32:39.399074993 +0000 UTC m=+0.132208763 container create 26605d84809ae13dd63bef8874425a9f3b011a574acc93b3e88c49f09c733bf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True) 2024-02-07T12:32:39.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:39 smithi047 ceph-mon[93224]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-07T12:32:39.784 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:39 smithi138 podman[101713]: 2024-02-07 12:32:39.610159548 +0000 UTC m=+0.343293318 container init 26605d84809ae13dd63bef8874425a9f3b011a574acc93b3e88c49f09c733bf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.build-date=20240131, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc) 2024-02-07T12:32:39.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:39 smithi138 podman[101713]: 2024-02-07 12:32:39.613193387 +0000 UTC m=+0.346327165 container start 26605d84809ae13dd63bef8874425a9f3b011a574acc93b3e88c49f09c733bf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-activate, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True) 2024-02-07T12:32:39.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:39 smithi138 podman[101713]: 2024-02-07 12:32:39.685025512 +0000 UTC m=+0.418159300 container attach 26605d84809ae13dd63bef8874425a9f3b011a574acc93b3e88c49f09c733bf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.build-date=20240131) 2024-02-07T12:32:40.403 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:40 smithi138 ceph-mon[82055]: pgmap v156: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-07T12:32:40.404 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-activate[101728]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-07T12:32:40.404 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-activate[101728]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-07T12:32:40.404 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 bash[101713]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-07T12:32:40.404 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 bash[101713]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-07T12:32:40.404 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 bash[101713]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-07T12:32:40.404 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 bash[101713]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-07T12:32:40.404 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 bash[101713]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-07T12:32:40.404 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 bash[101713]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-07T12:32:40.404 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 bash[101713]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-07T12:32:40.404 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-activate[101728]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-07T12:32:40.404 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-activate[101728]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-07T12:32:40.404 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-activate[101728]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-07T12:32:40.405 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-activate[101728]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-07T12:32:40.405 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-activate[101728]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-07T12:32:40.405 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 podman[101713]: 2024-02-07 12:32:40.080358725 +0000 UTC m=+0.813492486 container died 26605d84809ae13dd63bef8874425a9f3b011a574acc93b3e88c49f09c733bf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131) 2024-02-07T12:32:40.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:40 smithi047 ceph-mon[93224]: pgmap v156: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-07T12:32:41.032 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 podman[101863]: 2024-02-07 12:32:40.672254525 +0000 UTC m=+0.586480602 container remove 26605d84809ae13dd63bef8874425a9f3b011a574acc93b3e88c49f09c733bf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-activate, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0) 2024-02-07T12:32:41.032 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 podman[101925]: 2024-02-07 12:32:40.881614186 +0000 UTC m=+0.113510452 container create c9504c7cfe7c8123281c5f07392029e944819c44987c4f249ce19d5ddc035891 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, GIT_BRANCH=HEAD) 2024-02-07T12:32:41.032 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:40 smithi138 podman[101925]: 2024-02-07 12:32:40.786901249 +0000 UTC m=+0.018797516 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:32:41.284 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:41 smithi138 podman[101925]: 2024-02-07 12:32:41.13415149 +0000 UTC m=+0.366047756 container init c9504c7cfe7c8123281c5f07392029e944819c44987c4f249ce19d5ddc035891 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-07T12:32:41.284 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:41 smithi138 podman[101925]: 2024-02-07 12:32:41.137224414 +0000 UTC m=+0.369120681 container start c9504c7cfe7c8123281c5f07392029e944819c44987c4f249ce19d5ddc035891 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.license=GPLv2) 2024-02-07T12:32:41.285 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:41 smithi138 ceph-osd[101944]: -- 172.21.15.138:0/1804969438 <== mon.1 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558f8955d6c0 con 0x558f8952ec00 2024-02-07T12:32:41.285 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:41 smithi138 bash[101925]: c9504c7cfe7c8123281c5f07392029e944819c44987c4f249ce19d5ddc035891 2024-02-07T12:32:41.285 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:41 smithi138 systemd[1]: Started Ceph osd.5 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:32:41.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:41 smithi047 ceph-mon[93224]: Health check failed: Degraded data redundancy: 54/354 objects degraded (15.254%), 14 pgs degraded (PG_DEGRADED) 2024-02-07T12:32:41.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:41.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:41.678 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:41 smithi138 ceph-mon[82055]: Health check failed: Degraded data redundancy: 54/354 objects degraded (15.254%), 14 pgs degraded (PG_DEGRADED) 2024-02-07T12:32:41.678 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:41.678 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:42.034 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:41 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:32:41.674+0000 7f20a664a7c0 -1 Falling back to public interface 2024-02-07T12:32:42.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:42 smithi138 ceph-mon[82055]: pgmap v157: 65 pgs: 14 active+undersized+degraded, 3 peering, 11 active+undersized, 37 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:32:42.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:42.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:42.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:32:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:42 smithi047 ceph-mon[93224]: pgmap v157: 65 pgs: 14 active+undersized+degraded, 3 peering, 11 active+undersized, 37 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:32:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:32:44.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:44 smithi138 ceph-mon[82055]: pgmap v158: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:32:44.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:44 smithi138 ceph-mon[82055]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-07T12:32:44.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:44 smithi047 ceph-mon[93224]: pgmap v158: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:32:44.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:44 smithi047 ceph-mon[93224]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-07T12:32:45.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:45 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:45.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:45 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:45.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:45 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:45.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:45 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:46.284 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:45 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:32:45.869+0000 7f20a664a7c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-02-07T12:32:46.542 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:46 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:32:46.374+0000 7f20a664a7c0 -1 osd.5 75 log_to_monitors true 2024-02-07T12:32:47.034 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:32:46 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:32:46.681+0000 7f2097aa9700 -1 osd.5 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-07T12:32:47.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:46 smithi138 ceph-mon[82055]: pgmap v159: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:32:47.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:46 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:47.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:46 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:47.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:46 smithi138 ceph-mon[82055]: from='osd.5 [v2:172.21.15.138:6816/2664957218,v1:172.21.15.138:6817/2664957218]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-07T12:32:47.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:46 smithi138 ceph-mon[82055]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-07T12:32:47.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:46 smithi047 ceph-mon[93224]: pgmap v159: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:32:47.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:46 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:47.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:46 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:47.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:46 smithi047 ceph-mon[93224]: from='osd.5 [v2:172.21.15.138:6816/2664957218,v1:172.21.15.138:6817/2664957218]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-07T12:32:47.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:46 smithi047 ceph-mon[93224]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-07T12:32:47.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.255+0000 7fc21969b700 1 -- 172.21.15.47:0/349938903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2140fe2b0 msgr2=0x7fc2140fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:47.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.255+0000 7fc21969b700 1 --2- 172.21.15.47:0/349938903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2140fe2b0 0x7fc2140fe700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc208004940 tx=0x7fc208009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:47.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.255+0000 7fc21969b700 1 -- 172.21.15.47:0/349938903 shutdown_connections 2024-02-07T12:32:47.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.255+0000 7fc21969b700 1 --2- 172.21.15.47:0/349938903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2140fe2b0 0x7fc2140fe700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.255+0000 7fc21969b700 1 --2- 172.21.15.47:0/349938903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2140fb220 0x7fc2140fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.255+0000 7fc21969b700 1 -- 172.21.15.47:0/349938903 >> 172.21.15.47:0/349938903 conn(0x7fc2140f6ca0 msgr2=0x7fc2140f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:47.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.256+0000 7fc21969b700 1 -- 172.21.15.47:0/349938903 shutdown_connections 2024-02-07T12:32:47.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.256+0000 7fc21969b700 1 -- 172.21.15.47:0/349938903 wait complete. 2024-02-07T12:32:47.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.256+0000 7fc21969b700 1 Processor -- start 2024-02-07T12:32:47.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.256+0000 7fc21969b700 1 -- start start 2024-02-07T12:32:47.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.257+0000 7fc21969b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2140fb220 0x7fc21410d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:47.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.257+0000 7fc21969b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2140fe2b0 0x7fc21410dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:47.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.257+0000 7fc21969b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21410e4c0 con 0x7fc2140fb220 2024-02-07T12:32:47.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.257+0000 7fc21969b700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21410ed60 con 0x7fc2140fe2b0 2024-02-07T12:32:47.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.257+0000 7fc212ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2140fb220 0x7fc21410d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:47.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.257+0000 7fc212ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2140fb220 0x7fc21410d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56694/0 (socket says 172.21.15.47:56694) 2024-02-07T12:32:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.257+0000 7fc212ffd700 1 -- 172.21.15.47:0/3756901487 learned_addr learned my addr 172.21.15.47:0/3756901487 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.257+0000 7fc2127fc700 1 --2- 172.21.15.47:0/3756901487 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2140fe2b0 0x7fc21410dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.257+0000 7fc212ffd700 1 -- 172.21.15.47:0/3756901487 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2140fe2b0 msgr2=0x7fc21410dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.257+0000 7fc212ffd700 1 --2- 172.21.15.47:0/3756901487 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2140fe2b0 0x7fc21410dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.257+0000 7fc212ffd700 1 -- 172.21.15.47:0/3756901487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208005040 con 0x7fc2140fb220 2024-02-07T12:32:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.257+0000 7fc212ffd700 1 --2- 172.21.15.47:0/3756901487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2140fb220 0x7fc21410d980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc20400eb70 tx=0x7fc20400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.257+0000 7fc1fb7fe700 1 -- 172.21.15.47:0/3756901487 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc204007cc0 con 0x7fc2140fb220 2024-02-07T12:32:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.258+0000 7fc1fb7fe700 1 -- 172.21.15.47:0/3756901487 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc20400f040 con 0x7fc2140fb220 2024-02-07T12:32:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.258+0000 7fc21969b700 1 -- 172.21.15.47:0/3756901487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21410efe0 con 0x7fc2140fb220 2024-02-07T12:32:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.258+0000 7fc1fb7fe700 1 -- 172.21.15.47:0/3756901487 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc20400cb20 con 0x7fc2140fb220 2024-02-07T12:32:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.258+0000 7fc21969b700 1 -- 172.21.15.47:0/3756901487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21410f520 con 0x7fc2140fb220 2024-02-07T12:32:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.258+0000 7fc21969b700 1 -- 172.21.15.47:0/3756901487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21404bed0 con 0x7fc2140fb220 2024-02-07T12:32:47.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.259+0000 7fc1fb7fe700 1 -- 172.21.15.47:0/3756901487 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc20400cc80 con 0x7fc2140fb220 2024-02-07T12:32:47.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.259+0000 7fc1fb7fe700 1 --2- 172.21.15.47:0/3756901487 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc1fc06d7e0 0x7fc1fc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:47.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.260+0000 7fc1fb7fe700 1 -- 172.21.15.47:0/3756901487 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc20408c810 con 0x7fc2140fb220 2024-02-07T12:32:47.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.260+0000 7fc2127fc700 1 --2- 172.21.15.47:0/3756901487 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc1fc06d7e0 0x7fc1fc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:47.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.260+0000 7fc2127fc700 1 --2- 172.21.15.47:0/3756901487 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc1fc06d7e0 0x7fc1fc06fc90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc20800b0d0 tx=0x7fc208009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:47.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.264+0000 7fc1fb7fe700 1 -- 172.21.15.47:0/3756901487 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc204059cc0 con 0x7fc2140fb220 2024-02-07T12:32:47.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.489+0000 7fc21969b700 1 -- 172.21.15.47:0/3756901487 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc21410fbc0 con 0x7fc1fc06d7e0 2024-02-07T12:32:47.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.491+0000 7fc1fb7fe700 1 -- 172.21.15.47:0/3756901487 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc21410fbc0 con 0x7fc1fc06d7e0 2024-02-07T12:32:47.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.493+0000 7fc21969b700 1 -- 172.21.15.47:0/3756901487 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc1fc06d7e0 msgr2=0x7fc1fc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:47.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.493+0000 7fc21969b700 1 --2- 172.21.15.47:0/3756901487 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc1fc06d7e0 0x7fc1fc06fc90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc20800b0d0 tx=0x7fc208009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:47.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.493+0000 7fc21969b700 1 -- 172.21.15.47:0/3756901487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2140fb220 msgr2=0x7fc21410d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.493+0000 7fc21969b700 1 --2- 172.21.15.47:0/3756901487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2140fb220 0x7fc21410d980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc20400eb70 tx=0x7fc20400b040 comp rx=0 tx=0).stop 2024-02-07T12:32:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.493+0000 7fc21969b700 1 -- 172.21.15.47:0/3756901487 shutdown_connections 2024-02-07T12:32:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.493+0000 7fc21969b700 1 --2- 172.21.15.47:0/3756901487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2140fb220 0x7fc21410d980 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.493+0000 7fc21969b700 1 --2- 172.21.15.47:0/3756901487 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc1fc06d7e0 0x7fc1fc06fc90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.493+0000 7fc21969b700 1 --2- 172.21.15.47:0/3756901487 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2140fe2b0 0x7fc21410dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.493+0000 7fc21969b700 1 -- 172.21.15.47:0/3756901487 >> 172.21.15.47:0/3756901487 conn(0x7fc2140f6ca0 msgr2=0x7fc2141014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.493+0000 7fc21969b700 1 -- 172.21.15.47:0/3756901487 shutdown_connections 2024-02-07T12:32:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.493+0000 7fc21969b700 1 -- 172.21.15.47:0/3756901487 wait complete. 2024-02-07T12:32:47.505 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:32:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.597+0000 7fedceab7700 1 -- 172.21.15.47:0/3773873650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc80fc430 msgr2=0x7fedc80fc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.597+0000 7fedceab7700 1 --2- 172.21.15.47:0/3773873650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc80fc430 0x7fedc80fc840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fedbc004940 tx=0x7fedbc009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.598+0000 7fedceab7700 1 -- 172.21.15.47:0/3773873650 shutdown_connections 2024-02-07T12:32:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.598+0000 7fedceab7700 1 --2- 172.21.15.47:0/3773873650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc80fcd80 0x7fedc80fd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.598+0000 7fedceab7700 1 --2- 172.21.15.47:0/3773873650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc80fc430 0x7fedc80fc840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.598+0000 7fedceab7700 1 -- 172.21.15.47:0/3773873650 >> 172.21.15.47:0/3773873650 conn(0x7fedc80f6d20 msgr2=0x7fedc80f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.598+0000 7fedceab7700 1 -- 172.21.15.47:0/3773873650 shutdown_connections 2024-02-07T12:32:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.598+0000 7fedceab7700 1 -- 172.21.15.47:0/3773873650 wait complete. 2024-02-07T12:32:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.598+0000 7fedceab7700 1 Processor -- start 2024-02-07T12:32:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.598+0000 7fedceab7700 1 -- start start 2024-02-07T12:32:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedceab7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc80fc430 0x7fedc810cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedceab7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc80fcd80 0x7fedc810d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedceab7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc810d820 con 0x7fedc80fcd80 2024-02-07T12:32:47.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedceab7700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc810dfb0 con 0x7fedc80fc430 2024-02-07T12:32:47.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedc7fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc80fcd80 0x7fedc810d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:47.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedc7fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc80fcd80 0x7fedc810d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56716/0 (socket says 172.21.15.47:56716) 2024-02-07T12:32:47.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedc7fff700 1 -- 172.21.15.47:0/1927401424 learned_addr learned my addr 172.21.15.47:0/1927401424 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:47.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedcc853700 1 --2- 172.21.15.47:0/1927401424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc80fc430 0x7fedc810cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:47.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedc7fff700 1 -- 172.21.15.47:0/1927401424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc80fc430 msgr2=0x7fedc810cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:47.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedc7fff700 1 --2- 172.21.15.47:0/1927401424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc80fc430 0x7fedc810cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedc7fff700 1 -- 172.21.15.47:0/1927401424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedbc005040 con 0x7fedc80fcd80 2024-02-07T12:32:47.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedc7fff700 1 --2- 172.21.15.47:0/1927401424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc80fcd80 0x7fedc810d220 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fedb4002a50 tx=0x7fedb40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:47.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedc57fa700 1 -- 172.21.15.47:0/1927401424 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedb4007cc0 con 0x7fedc80fcd80 2024-02-07T12:32:47.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedceab7700 1 -- 172.21.15.47:0/1927401424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc810e290 con 0x7fedc80fcd80 2024-02-07T12:32:47.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedc57fa700 1 -- 172.21.15.47:0/1927401424 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fedb400f040 con 0x7fedc80fcd80 2024-02-07T12:32:47.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedc57fa700 1 -- 172.21.15.47:0/1927401424 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedb400da30 con 0x7fedc80fcd80 2024-02-07T12:32:47.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.599+0000 7fedceab7700 1 -- 172.21.15.47:0/1927401424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc810e7d0 con 0x7fedc80fcd80 2024-02-07T12:32:47.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.600+0000 7fedceab7700 1 -- 172.21.15.47:0/1927401424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc8106960 con 0x7fedc80fcd80 2024-02-07T12:32:47.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.601+0000 7fedc57fa700 1 -- 172.21.15.47:0/1927401424 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fedb400db90 con 0x7fedc80fcd80 2024-02-07T12:32:47.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.601+0000 7fedc57fa700 1 --2- 172.21.15.47:0/1927401424 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fedb806d7e0 0x7fedb806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:47.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.601+0000 7fedc57fa700 1 -- 172.21.15.47:0/1927401424 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fedb408cc70 con 0x7fedc80fcd80 2024-02-07T12:32:47.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.601+0000 7fedcc853700 1 --2- 172.21.15.47:0/1927401424 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fedb806d7e0 0x7fedb806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:47.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.602+0000 7fedcc853700 1 --2- 172.21.15.47:0/1927401424 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fedb806d7e0 0x7fedb806fc90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fedbc004890 tx=0x7fedbc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:47.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.606+0000 7fedc57fa700 1 -- 172.21.15.47:0/1927401424 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fedb4059ff0 con 0x7fedc80fcd80 2024-02-07T12:32:47.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.842+0000 7fedceab7700 1 -- 172.21.15.47:0/1927401424 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fedc80008d0 con 0x7fedb806d7e0 2024-02-07T12:32:47.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.843+0000 7fedc57fa700 1 -- 172.21.15.47:0/1927401424 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fedc80008d0 con 0x7fedb806d7e0 2024-02-07T12:32:47.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.845+0000 7fedceab7700 1 -- 172.21.15.47:0/1927401424 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fedb806d7e0 msgr2=0x7fedb806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:47.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.845+0000 7fedceab7700 1 --2- 172.21.15.47:0/1927401424 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fedb806d7e0 0x7fedb806fc90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fedbc004890 tx=0x7fedbc009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:47.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.845+0000 7fedceab7700 1 -- 172.21.15.47:0/1927401424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc80fcd80 msgr2=0x7fedc810d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:47.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.845+0000 7fedceab7700 1 --2- 172.21.15.47:0/1927401424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc80fcd80 0x7fedc810d220 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fedb4002a50 tx=0x7fedb40046b0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.845+0000 7fedceab7700 1 -- 172.21.15.47:0/1927401424 shutdown_connections 2024-02-07T12:32:47.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.845+0000 7fedceab7700 1 --2- 172.21.15.47:0/1927401424 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fedb806d7e0 0x7fedb806fc90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.845+0000 7fedceab7700 1 --2- 172.21.15.47:0/1927401424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc80fc430 0x7fedc810cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.845+0000 7fedceab7700 1 --2- 172.21.15.47:0/1927401424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc80fcd80 0x7fedc810d220 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.845+0000 7fedceab7700 1 -- 172.21.15.47:0/1927401424 >> 172.21.15.47:0/1927401424 conn(0x7fedc80f6d20 msgr2=0x7fedc81006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:47.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.845+0000 7fedceab7700 1 -- 172.21.15.47:0/1927401424 shutdown_connections 2024-02-07T12:32:47.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.845+0000 7fedceab7700 1 -- 172.21.15.47:0/1927401424 wait complete. 2024-02-07T12:32:47.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.948+0000 7f8aa5d77700 1 -- 172.21.15.47:0/23904455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa00fda80 msgr2=0x7f8aa00ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:47.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.948+0000 7f8aa5d77700 1 --2- 172.21.15.47:0/23904455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa00fda80 0x7f8aa00ffe60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8a90004940 tx=0x7f8a90009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:47.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.948+0000 7f8aa5d77700 1 -- 172.21.15.47:0/23904455 shutdown_connections 2024-02-07T12:32:47.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.948+0000 7f8aa5d77700 1 --2- 172.21.15.47:0/23904455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aa01003a0 0x7f8aa0102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.948+0000 7f8aa5d77700 1 --2- 172.21.15.47:0/23904455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa00fda80 0x7f8aa00ffe60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.948+0000 7f8aa5d77700 1 -- 172.21.15.47:0/23904455 >> 172.21.15.47:0/23904455 conn(0x7f8aa00f7520 msgr2=0x7f8aa00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:47.951 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:47 smithi047 ceph-mon[93224]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-07T12:32:47.951 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:47 smithi047 ceph-mon[93224]: osdmap e78: 6 total, 5 up, 6 in 2024-02-07T12:32:47.951 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:47 smithi047 ceph-mon[93224]: from='osd.5 [v2:172.21.15.138:6816/2664957218,v1:172.21.15.138:6817/2664957218]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:32:47.951 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:47 smithi047 ceph-mon[93224]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:32:47.951 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:47 smithi047 ceph-mon[93224]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:32:47.951 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:47 smithi047 ceph-mon[93224]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:47.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.948+0000 7f8aa5d77700 1 -- 172.21.15.47:0/23904455 shutdown_connections 2024-02-07T12:32:47.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.948+0000 7f8aa5d77700 1 -- 172.21.15.47:0/23904455 wait complete. 2024-02-07T12:32:47.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.948+0000 7f8aa5d77700 1 Processor -- start 2024-02-07T12:32:47.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.949+0000 7f8aa5d77700 1 -- start start 2024-02-07T12:32:47.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.949+0000 7f8aa5d77700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa00fda80 0x7f8aa010d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:47.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.949+0000 7f8aa5d77700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aa01003a0 0x7f8aa010de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:47.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.949+0000 7f8aa5d77700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa010e500 con 0x7f8aa00fda80 2024-02-07T12:32:47.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.949+0000 7f8aa5d77700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa010ed40 con 0x7f8aa01003a0 2024-02-07T12:32:47.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.949+0000 7f8a9f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa00fda80 0x7f8aa010d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:47.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.949+0000 7f8a9f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa00fda80 0x7f8aa010d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56730/0 (socket says 172.21.15.47:56730) 2024-02-07T12:32:47.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.949+0000 7f8a9f7fe700 1 -- 172.21.15.47:0/1286992299 learned_addr learned my addr 172.21.15.47:0/1286992299 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:47.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.949+0000 7f8a9effd700 1 --2- 172.21.15.47:0/1286992299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aa01003a0 0x7f8aa010de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:47.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.949+0000 7f8a9f7fe700 1 -- 172.21.15.47:0/1286992299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aa01003a0 msgr2=0x7f8aa010de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.949+0000 7f8a9f7fe700 1 --2- 172.21.15.47:0/1286992299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aa01003a0 0x7f8aa010de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.949+0000 7f8a9f7fe700 1 -- 172.21.15.47:0/1286992299 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a90005040 con 0x7f8aa00fda80 2024-02-07T12:32:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.949+0000 7f8a9effd700 1 --2- 172.21.15.47:0/1286992299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aa01003a0 0x7f8aa010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:32:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.950+0000 7f8a9f7fe700 1 --2- 172.21.15.47:0/1286992299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa00fda80 0x7f8aa010d930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8a900093b0 tx=0x7f8a90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.950+0000 7f8a87fff700 1 -- 172.21.15.47:0/1286992299 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a9000e040 con 0x7f8aa00fda80 2024-02-07T12:32:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.950+0000 7f8a87fff700 1 -- 172.21.15.47:0/1286992299 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a9000bcc0 con 0x7f8aa00fda80 2024-02-07T12:32:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.950+0000 7f8aa5d77700 1 -- 172.21.15.47:0/1286992299 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa010efc0 con 0x7f8aa00fda80 2024-02-07T12:32:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.950+0000 7f8a87fff700 1 -- 172.21.15.47:0/1286992299 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a9001c630 con 0x7f8aa00fda80 2024-02-07T12:32:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.950+0000 7f8aa5d77700 1 -- 172.21.15.47:0/1286992299 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa010f500 con 0x7f8aa00fda80 2024-02-07T12:32:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.951+0000 7f8aa5d77700 1 -- 172.21.15.47:0/1286992299 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa0107ad0 con 0x7f8aa00fda80 2024-02-07T12:32:47.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.951+0000 7f8a87fff700 1 -- 172.21.15.47:0/1286992299 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8a900139f0 con 0x7f8aa00fda80 2024-02-07T12:32:47.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.952+0000 7f8a87fff700 1 --2- 172.21.15.47:0/1286992299 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8a8806d7e0 0x7f8a8806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:47.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.952+0000 7f8a87fff700 1 -- 172.21.15.47:0/1286992299 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8a9008e330 con 0x7f8aa00fda80 2024-02-07T12:32:47.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.952+0000 7f8a9effd700 1 --2- 172.21.15.47:0/1286992299 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8a8806d7e0 0x7f8a8806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:47.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.952+0000 7f8a9effd700 1 --2- 172.21.15.47:0/1286992299 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8a8806d7e0 0x7f8a8806fc90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009b10 tx=0x7f8a94008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:47.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:47.957+0000 7f8a87fff700 1 -- 172.21.15.47:0/1286992299 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8a9005b730 con 0x7f8aa00fda80 2024-02-07T12:32:48.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:47 smithi138 ceph-mon[82055]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-07T12:32:48.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:47 smithi138 ceph-mon[82055]: osdmap e78: 6 total, 5 up, 6 in 2024-02-07T12:32:48.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:47 smithi138 ceph-mon[82055]: from='osd.5 [v2:172.21.15.138:6816/2664957218,v1:172.21.15.138:6817/2664957218]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:32:48.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:47 smithi138 ceph-mon[82055]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-07T12:32:48.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:47 smithi138 ceph-mon[82055]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-02-07T12:32:48.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:47 smithi138 ceph-mon[82055]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:48.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.173+0000 7f8aa5d77700 1 -- 172.21.15.47:0/1286992299 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8aa010f8f0 con 0x7f8a8806d7e0 2024-02-07T12:32:48.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.184+0000 7f8a87fff700 1 -- 172.21.15.47:0/1286992299 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8aa010f8f0 con 0x7f8a8806d7e0 2024-02-07T12:32:48.187 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:32:48.187 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (6m) 103s ago 15m 26.6M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:32:48.187 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (3m) 103s ago 15m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:32:48.187 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (3m) 3s ago 14m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:32:48.187 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (5m) 103s ago 14m 78.4M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:32:48.188 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (9m) 103s ago 9m 111M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:32:48.188 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (9m) 103s ago 9m 129M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:32:48.188 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (9m) 3s ago 9m 68.4M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:32:48.188 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (9m) 3s ago 9m 69.7M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:32:48.188 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (5m) 103s ago 16m 503M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:32:48.188 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (4m) 3s ago 14m 452M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:32:48.189 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (4m) 103s ago 16m 47.4M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:32:48.189 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (4m) 3s ago 14m 37.7M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:32:48.189 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (6m) 103s ago 15m 15.1M - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:32:48.189 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (5m) 3s ago 14m 14.9M - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:32:48.189 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (3m) 103s ago 13m 87.4M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:32:48.189 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (2m) 103s ago 13m 98.5M 1559M 19.0.0-1252-g44458cce 79957b372307 0f2b0eea74d7 2024-02-07T12:32:48.189 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (109s) 103s ago 12m 12.6M 1559M 19.0.0-1252-g44458cce 79957b372307 0b8c78346346 2024-02-07T12:32:48.189 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (74s) 3s ago 12m 113M 2581M 19.0.0-1252-g44458cce 79957b372307 dea45db021db 2024-02-07T12:32:48.190 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (40s) 3s ago 11m 93.6M 2581M 19.0.0-1252-g44458cce 79957b372307 3161c1dfe6f5 2024-02-07T12:32:48.190 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (7s) 3s ago 11m 12.6M 2581M 19.0.0-1252-g44458cce 79957b372307 c9504c7cfe7c 2024-02-07T12:32:48.190 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (4m) 103s ago 14m 51.5M - 2.43.0 a07b618ecd1d 32840d82c54b 2024-02-07T12:32:48.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.186+0000 7f8aa5d77700 1 -- 172.21.15.47:0/1286992299 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8a8806d7e0 msgr2=0x7f8a8806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:48.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.186+0000 7f8aa5d77700 1 --2- 172.21.15.47:0/1286992299 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8a8806d7e0 0x7f8a8806fc90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009b10 tx=0x7f8a94008040 comp rx=0 tx=0).stop 2024-02-07T12:32:48.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.186+0000 7f8aa5d77700 1 -- 172.21.15.47:0/1286992299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa00fda80 msgr2=0x7f8aa010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:48.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.186+0000 7f8aa5d77700 1 --2- 172.21.15.47:0/1286992299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa00fda80 0x7f8aa010d930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8a900093b0 tx=0x7f8a90009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:48.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.186+0000 7f8aa5d77700 1 -- 172.21.15.47:0/1286992299 shutdown_connections 2024-02-07T12:32:48.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.186+0000 7f8aa5d77700 1 --2- 172.21.15.47:0/1286992299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa00fda80 0x7f8aa010d930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.186+0000 7f8aa5d77700 1 --2- 172.21.15.47:0/1286992299 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8a8806d7e0 0x7f8a8806fc90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.186+0000 7f8aa5d77700 1 --2- 172.21.15.47:0/1286992299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aa01003a0 0x7f8aa010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.186+0000 7f8aa5d77700 1 -- 172.21.15.47:0/1286992299 >> 172.21.15.47:0/1286992299 conn(0x7f8aa00f7520 msgr2=0x7f8aa00f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:48.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.186+0000 7f8aa5d77700 1 -- 172.21.15.47:0/1286992299 shutdown_connections 2024-02-07T12:32:48.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.186+0000 7f8aa5d77700 1 -- 172.21.15.47:0/1286992299 wait complete. 2024-02-07T12:32:48.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.289+0000 7f1a60374700 1 -- 172.21.15.47:0/3164398905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a580fcfb0 msgr2=0x7f1a580fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:48.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.289+0000 7f1a60374700 1 --2- 172.21.15.47:0/3164398905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a580fcfb0 0x7f1a580fd420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c004940 tx=0x7f1a4c009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:48.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.289+0000 7f1a60374700 1 -- 172.21.15.47:0/3164398905 shutdown_connections 2024-02-07T12:32:48.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.289+0000 7f1a60374700 1 --2- 172.21.15.47:0/3164398905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a580fcfb0 0x7f1a580fd420 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.289+0000 7f1a60374700 1 --2- 172.21.15.47:0/3164398905 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a580fbe40 0x7f1a580fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.289+0000 7f1a60374700 1 -- 172.21.15.47:0/3164398905 >> 172.21.15.47:0/3164398905 conn(0x7f1a580f74e0 msgr2=0x7f1a580f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:48.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.289+0000 7f1a60374700 1 -- 172.21.15.47:0/3164398905 shutdown_connections 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.289+0000 7f1a60374700 1 -- 172.21.15.47:0/3164398905 wait complete. 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.290+0000 7f1a60374700 1 Processor -- start 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.290+0000 7f1a60374700 1 -- start start 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.290+0000 7f1a60374700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a580fbe40 0x7f1a5810d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.290+0000 7f1a60374700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a580fcfb0 0x7f1a5810de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.290+0000 7f1a60374700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5810e450 con 0x7f1a580fcfb0 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.290+0000 7f1a60374700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5810ecf0 con 0x7f1a580fbe40 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.290+0000 7f1a5d90f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a580fcfb0 0x7f1a5810de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.290+0000 7f1a5d90f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a580fcfb0 0x7f1a5810de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56754/0 (socket says 172.21.15.47:56754) 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.290+0000 7f1a5d90f700 1 -- 172.21.15.47:0/3505774381 learned_addr learned my addr 172.21.15.47:0/3505774381 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.290+0000 7f1a5e110700 1 --2- 172.21.15.47:0/3505774381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a580fbe40 0x7f1a5810d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.290+0000 7f1a5d90f700 1 -- 172.21.15.47:0/3505774381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a580fbe40 msgr2=0x7f1a5810d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.290+0000 7f1a5d90f700 1 --2- 172.21.15.47:0/3505774381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a580fbe40 0x7f1a5810d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.290+0000 7f1a5d90f700 1 -- 172.21.15.47:0/3505774381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c005040 con 0x7f1a580fcfb0 2024-02-07T12:32:48.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.291+0000 7f1a5d90f700 1 --2- 172.21.15.47:0/3505774381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a580fcfb0 0x7f1a5810de50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c000c00 tx=0x7f1a4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:48.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.291+0000 7f1a56ffd700 1 -- 172.21.15.47:0/3505774381 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a4c021070 con 0x7f1a580fcfb0 2024-02-07T12:32:48.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.291+0000 7f1a56ffd700 1 -- 172.21.15.47:0/3505774381 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a4c01c400 con 0x7f1a580fcfb0 2024-02-07T12:32:48.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.291+0000 7f1a60374700 1 -- 172.21.15.47:0/3505774381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5810ef70 con 0x7f1a580fcfb0 2024-02-07T12:32:48.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.291+0000 7f1a56ffd700 1 -- 172.21.15.47:0/3505774381 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a4c00e070 con 0x7f1a580fcfb0 2024-02-07T12:32:48.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.291+0000 7f1a60374700 1 -- 172.21.15.47:0/3505774381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5810f450 con 0x7f1a580fcfb0 2024-02-07T12:32:48.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.292+0000 7f1a60374700 1 -- 172.21.15.47:0/3505774381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5804bed0 con 0x7f1a580fcfb0 2024-02-07T12:32:48.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.293+0000 7f1a56ffd700 1 -- 172.21.15.47:0/3505774381 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f1a4c01ca20 con 0x7f1a580fcfb0 2024-02-07T12:32:48.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.293+0000 7f1a56ffd700 1 --2- 172.21.15.47:0/3505774381 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1a4006d7f0 0x7f1a4006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:48.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.293+0000 7f1a56ffd700 1 -- 172.21.15.47:0/3505774381 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1a4c08df50 con 0x7f1a580fcfb0 2024-02-07T12:32:48.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.293+0000 7f1a5e110700 1 --2- 172.21.15.47:0/3505774381 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1a4006d7f0 0x7f1a4006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:48.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.294+0000 7f1a5e110700 1 --2- 172.21.15.47:0/3505774381 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1a4006d7f0 0x7f1a4006fca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1a48001490 tx=0x7f1a4800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:48.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.298+0000 7f1a56ffd700 1 -- 172.21.15.47:0/3505774381 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1a4c0c1d20 con 0x7f1a580fcfb0 2024-02-07T12:32:48.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.593+0000 7f1a60374700 1 -- 172.21.15.47:0/3505774381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1a58104950 con 0x7f1a580fcfb0 2024-02-07T12:32:48.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.593+0000 7f1a56ffd700 1 -- 172.21.15.47:0/3505774381 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f1a4c05b4b0 con 0x7f1a580fcfb0 2024-02-07T12:32:48.596 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:32:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:32:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:32:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:32:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:32:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:32:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:32:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:32:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 6 2024-02-07T12:32:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:32:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:32:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:32:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:32:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:32:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4, 2024-02-07T12:32:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 10 2024-02-07T12:32:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:32:48.598 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:32:48.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.595+0000 7f1a60374700 1 -- 172.21.15.47:0/3505774381 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1a4006d7f0 msgr2=0x7f1a4006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:48.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.595+0000 7f1a60374700 1 --2- 172.21.15.47:0/3505774381 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1a4006d7f0 0x7f1a4006fca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1a48001490 tx=0x7f1a4800b040 comp rx=0 tx=0).stop 2024-02-07T12:32:48.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.595+0000 7f1a60374700 1 -- 172.21.15.47:0/3505774381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a580fcfb0 msgr2=0x7f1a5810de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:48.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.595+0000 7f1a60374700 1 --2- 172.21.15.47:0/3505774381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a580fcfb0 0x7f1a5810de50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c000c00 tx=0x7f1a4c009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:48.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.596+0000 7f1a60374700 1 -- 172.21.15.47:0/3505774381 shutdown_connections 2024-02-07T12:32:48.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.596+0000 7f1a60374700 1 --2- 172.21.15.47:0/3505774381 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1a4006d7f0 0x7f1a4006fca0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.596+0000 7f1a60374700 1 --2- 172.21.15.47:0/3505774381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a580fbe40 0x7f1a5810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.596+0000 7f1a60374700 1 --2- 172.21.15.47:0/3505774381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a580fcfb0 0x7f1a5810de50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.596+0000 7f1a60374700 1 -- 172.21.15.47:0/3505774381 >> 172.21.15.47:0/3505774381 conn(0x7f1a580f74e0 msgr2=0x7f1a580656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:48.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.596+0000 7f1a60374700 1 -- 172.21.15.47:0/3505774381 shutdown_connections 2024-02-07T12:32:48.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.596+0000 7f1a60374700 1 -- 172.21.15.47:0/3505774381 wait complete. 2024-02-07T12:32:48.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.710+0000 7f1f74848700 1 -- 172.21.15.47:0/542319117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f700fbe40 msgr2=0x7f1f700fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:48.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.710+0000 7f1f74848700 1 --2- 172.21.15.47:0/542319117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f700fbe40 0x7f1f700fc250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1f60004940 tx=0x7f1f60009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:48.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.710+0000 7f1f74848700 1 -- 172.21.15.47:0/542319117 shutdown_connections 2024-02-07T12:32:48.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.710+0000 7f1f74848700 1 --2- 172.21.15.47:0/542319117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f700fcfb0 0x7f1f700fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.710+0000 7f1f74848700 1 --2- 172.21.15.47:0/542319117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f700fbe40 0x7f1f700fc250 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.710+0000 7f1f74848700 1 -- 172.21.15.47:0/542319117 >> 172.21.15.47:0/542319117 conn(0x7f1f700f7500 msgr2=0x7f1f700f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:48.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.710+0000 7f1f74848700 1 -- 172.21.15.47:0/542319117 shutdown_connections 2024-02-07T12:32:48.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.711+0000 7f1f74848700 1 -- 172.21.15.47:0/542319117 wait complete. 2024-02-07T12:32:48.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.711+0000 7f1f74848700 1 Processor -- start 2024-02-07T12:32:48.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.711+0000 7f1f74848700 1 -- start start 2024-02-07T12:32:48.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.711+0000 7f1f74848700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f700fbe40 0x7f1f7010d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:48.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.711+0000 7f1f74848700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f700fcfb0 0x7f1f7010dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:48.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.711+0000 7f1f74848700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7010e3e0 con 0x7f1f700fbe40 2024-02-07T12:32:48.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.711+0000 7f1f74848700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7010ec80 con 0x7f1f700fcfb0 2024-02-07T12:32:48.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.711+0000 7f1f6e59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f700fbe40 0x7f1f7010d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:48.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.711+0000 7f1f6e59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f700fbe40 0x7f1f7010d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56768/0 (socket says 172.21.15.47:56768) 2024-02-07T12:32:48.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.711+0000 7f1f6e59c700 1 -- 172.21.15.47:0/2814152208 learned_addr learned my addr 172.21.15.47:0/2814152208 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:48.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.711+0000 7f1f6dd9b700 1 --2- 172.21.15.47:0/2814152208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f700fcfb0 0x7f1f7010dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:48.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.712+0000 7f1f6e59c700 1 -- 172.21.15.47:0/2814152208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f700fcfb0 msgr2=0x7f1f7010dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:48.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.712+0000 7f1f6e59c700 1 --2- 172.21.15.47:0/2814152208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f700fcfb0 0x7f1f7010dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.712+0000 7f1f6e59c700 1 -- 172.21.15.47:0/2814152208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f60005040 con 0x7f1f700fbe40 2024-02-07T12:32:48.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.712+0000 7f1f6e59c700 1 --2- 172.21.15.47:0/2814152208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f700fbe40 0x7f1f7010d8a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1f60000c00 tx=0x7f1f60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:48.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.712+0000 7f1f5effd700 1 -- 172.21.15.47:0/2814152208 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f60021070 con 0x7f1f700fbe40 2024-02-07T12:32:48.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.712+0000 7f1f5effd700 1 -- 172.21.15.47:0/2814152208 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f6001c400 con 0x7f1f700fbe40 2024-02-07T12:32:48.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.712+0000 7f1f74848700 1 -- 172.21.15.47:0/2814152208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7010ef00 con 0x7f1f700fbe40 2024-02-07T12:32:48.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.712+0000 7f1f5effd700 1 -- 172.21.15.47:0/2814152208 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f6000e070 con 0x7f1f700fbe40 2024-02-07T12:32:48.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.712+0000 7f1f74848700 1 -- 172.21.15.47:0/2814152208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7010f3e0 con 0x7f1f700fbe40 2024-02-07T12:32:48.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.713+0000 7f1f74848700 1 -- 172.21.15.47:0/2814152208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7004bed0 con 0x7f1f700fbe40 2024-02-07T12:32:48.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.714+0000 7f1f5effd700 1 -- 172.21.15.47:0/2814152208 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f1f6001ca50 con 0x7f1f700fbe40 2024-02-07T12:32:48.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.714+0000 7f1f5effd700 1 --2- 172.21.15.47:0/2814152208 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1f5806d7f0 0x7f1f5806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:48.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.714+0000 7f1f5effd700 1 -- 172.21.15.47:0/2814152208 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1f6008e060 con 0x7f1f700fbe40 2024-02-07T12:32:48.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.714+0000 7f1f6dd9b700 1 --2- 172.21.15.47:0/2814152208 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1f5806d7f0 0x7f1f5806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:48.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.715+0000 7f1f6dd9b700 1 --2- 172.21.15.47:0/2814152208 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1f5806d7f0 0x7f1f5806fca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009b80 tx=0x7f1f6400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:48.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.719+0000 7f1f5effd700 1 -- 172.21.15.47:0/2814152208 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1f6005b460 con 0x7f1f700fbe40 2024-02-07T12:32:48.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.963+0000 7f1f74848700 1 -- 172.21.15.47:0/2814152208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1f7010f7c0 con 0x7f1f700fbe40 2024-02-07T12:32:48.966 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:48 smithi047 ceph-mon[93224]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-07T12:32:48.967 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:48 smithi047 ceph-mon[93224]: osd.5 [v2:172.21.15.138:6816/2664957218,v1:172.21.15.138:6817/2664957218] boot 2024-02-07T12:32:48.967 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:48 smithi047 ceph-mon[93224]: osdmap e79: 6 total, 6 up, 6 in 2024-02-07T12:32:48.967 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:48 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:32:48.967 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:48 smithi047 ceph-mon[93224]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:48.967 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:48 smithi047 ceph-mon[93224]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:48.967 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:48 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3505774381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:48.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.964+0000 7f1f5effd700 1 -- 172.21.15.47:0/2814152208 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1872 (secure 0 0 0) 0x7f1f6005aff0 con 0x7f1f700fbe40 2024-02-07T12:32:48.969 INFO:teuthology.orchestra.run.smithi047.stdout:e22 2024-02-07T12:32:48.969 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:32:48.969 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:32:48.969 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:32:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:32:48.969 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:32:48.970 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:32:48.970 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 22 2024-02-07T12:32:48.970 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:32:48.970 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:32:48.970 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:29:33.611202+0000 2024-02-07T12:32:48.970 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:32:48.971 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:32:48.971 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:32:48.971 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:32:48.971 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:32:48.971 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:32:48.971 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:32:48.971 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:32:48.972 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 47 2024-02-07T12:32:48.972 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:32:48.972 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:32:48.972 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:32:48.972 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:32:48.972 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:32:48.973 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:32:48.973 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:32:48.973 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:32:48.973 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:32:48.973 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:32:48.973 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:32:48.974 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:32:48.974 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:32:48.974 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:32:48.974 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{0:24259} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.138:6826/3408663554,v1:172.21.15.138:6827/3408663554] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:32:48.974 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:32:48.974 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{1:24263} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2163008835,v1:172.21.15.138:6825/2163008835] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:32:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:32:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:32:48.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.966+0000 7f1f74848700 1 -- 172.21.15.47:0/2814152208 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1f5806d7f0 msgr2=0x7f1f5806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:48.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.966+0000 7f1f74848700 1 --2- 172.21.15.47:0/2814152208 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1f5806d7f0 0x7f1f5806fca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009b80 tx=0x7f1f6400b040 comp rx=0 tx=0).stop 2024-02-07T12:32:48.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.966+0000 7f1f74848700 1 -- 172.21.15.47:0/2814152208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f700fbe40 msgr2=0x7f1f7010d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:48.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.966+0000 7f1f74848700 1 --2- 172.21.15.47:0/2814152208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f700fbe40 0x7f1f7010d8a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1f60000c00 tx=0x7f1f60009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:48.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.966+0000 7f1f74848700 1 -- 172.21.15.47:0/2814152208 shutdown_connections 2024-02-07T12:32:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.966+0000 7f1f74848700 1 --2- 172.21.15.47:0/2814152208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f700fbe40 0x7f1f7010d8a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.966+0000 7f1f74848700 1 --2- 172.21.15.47:0/2814152208 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f1f5806d7f0 0x7f1f5806fca0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.966+0000 7f1f74848700 1 --2- 172.21.15.47:0/2814152208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f700fcfb0 0x7f1f7010dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.966+0000 7f1f74848700 1 -- 172.21.15.47:0/2814152208 >> 172.21.15.47:0/2814152208 conn(0x7f1f700f7500 msgr2=0x7f1f70065f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.966+0000 7f1f74848700 1 -- 172.21.15.47:0/2814152208 shutdown_connections 2024-02-07T12:32:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:48.966+0000 7f1f74848700 1 -- 172.21.15.47:0/2814152208 wait complete. 2024-02-07T12:32:48.978 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 22 2024-02-07T12:32:49.012 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:48 smithi138 ceph-mon[82055]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-07T12:32:49.013 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:48 smithi138 ceph-mon[82055]: osd.5 [v2:172.21.15.138:6816/2664957218,v1:172.21.15.138:6817/2664957218] boot 2024-02-07T12:32:49.013 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:48 smithi138 ceph-mon[82055]: osdmap e79: 6 total, 6 up, 6 in 2024-02-07T12:32:49.013 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:48 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-07T12:32:49.013 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:48 smithi138 ceph-mon[82055]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:49.013 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:48 smithi138 ceph-mon[82055]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:49.013 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:48 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3505774381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:49.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.070+0000 7f5ee4632700 1 -- 172.21.15.47:0/1345980151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5edc0fe0e0 msgr2=0x7f5edc0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:49.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.070+0000 7f5ee4632700 1 --2- 172.21.15.47:0/1345980151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5edc0fe0e0 0x7f5edc0fe550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0004940 tx=0x7f5ed0009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:49.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.070+0000 7f5ee4632700 1 -- 172.21.15.47:0/1345980151 shutdown_connections 2024-02-07T12:32:49.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.070+0000 7f5ee4632700 1 --2- 172.21.15.47:0/1345980151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5edc0fe0e0 0x7f5edc0fe550 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:49.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.070+0000 7f5ee4632700 1 --2- 172.21.15.47:0/1345980151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5edc0fcef0 0x7f5edc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:49.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.070+0000 7f5ee4632700 1 -- 172.21.15.47:0/1345980151 >> 172.21.15.47:0/1345980151 conn(0x7f5edc0f8620 msgr2=0x7f5edc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:49.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.070+0000 7f5ee4632700 1 -- 172.21.15.47:0/1345980151 shutdown_connections 2024-02-07T12:32:49.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.070+0000 7f5ee4632700 1 -- 172.21.15.47:0/1345980151 wait complete. 2024-02-07T12:32:49.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.070+0000 7f5ee4632700 1 Processor -- start 2024-02-07T12:32:49.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.070+0000 7f5ee4632700 1 -- start start 2024-02-07T12:32:49.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.071+0000 7f5ee4632700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5edc0fcef0 0x7f5edc10d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:49.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.071+0000 7f5ee4632700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5edc0fe0e0 0x7f5edc10dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:49.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.071+0000 7f5ee4632700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc10e4a0 con 0x7f5edc0fe0e0 2024-02-07T12:32:49.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.071+0000 7f5ee4632700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc10ed40 con 0x7f5edc0fcef0 2024-02-07T12:32:49.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.071+0000 7f5ee1bcd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5edc0fe0e0 0x7f5edc10dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:49.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.071+0000 7f5ee1bcd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5edc0fe0e0 0x7f5edc10dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56788/0 (socket says 172.21.15.47:56788) 2024-02-07T12:32:49.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.071+0000 7f5ee1bcd700 1 -- 172.21.15.47:0/2380316520 learned_addr learned my addr 172.21.15.47:0/2380316520 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:49.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.071+0000 7f5ee23ce700 1 --2- 172.21.15.47:0/2380316520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5edc0fcef0 0x7f5edc10d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:49.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.071+0000 7f5ee1bcd700 1 -- 172.21.15.47:0/2380316520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5edc0fcef0 msgr2=0x7f5edc10d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:49.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.071+0000 7f5ee1bcd700 1 --2- 172.21.15.47:0/2380316520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5edc0fcef0 0x7f5edc10d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:49.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.071+0000 7f5ee1bcd700 1 -- 172.21.15.47:0/2380316520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0005040 con 0x7f5edc0fe0e0 2024-02-07T12:32:49.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.071+0000 7f5ee1bcd700 1 --2- 172.21.15.47:0/2380316520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5edc0fe0e0 0x7f5edc10dea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009fd0 tx=0x7f5ed0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:49.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.071+0000 7f5edaffd700 1 -- 172.21.15.47:0/2380316520 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ed000e040 con 0x7f5edc0fe0e0 2024-02-07T12:32:49.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.072+0000 7f5edaffd700 1 -- 172.21.15.47:0/2380316520 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ed000bcc0 con 0x7f5edc0fe0e0 2024-02-07T12:32:49.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.072+0000 7f5ee4632700 1 -- 172.21.15.47:0/2380316520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc10efc0 con 0x7f5edc0fe0e0 2024-02-07T12:32:49.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.072+0000 7f5edaffd700 1 -- 172.21.15.47:0/2380316520 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ed001c630 con 0x7f5edc0fe0e0 2024-02-07T12:32:49.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.072+0000 7f5ee4632700 1 -- 172.21.15.47:0/2380316520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc10f500 con 0x7f5edc0fe0e0 2024-02-07T12:32:49.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.072+0000 7f5ee4632700 1 -- 172.21.15.47:0/2380316520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc04bed0 con 0x7f5edc0fe0e0 2024-02-07T12:32:49.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.073+0000 7f5edaffd700 1 -- 172.21.15.47:0/2380316520 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f5ed0013420 con 0x7f5edc0fe0e0 2024-02-07T12:32:49.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.073+0000 7f5edaffd700 1 --2- 172.21.15.47:0/2380316520 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5ec406d7f0 0x7f5ec406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:49.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.074+0000 7f5edaffd700 1 -- 172.21.15.47:0/2380316520 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5ed008e330 con 0x7f5edc0fe0e0 2024-02-07T12:32:49.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.074+0000 7f5ee23ce700 1 --2- 172.21.15.47:0/2380316520 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5ec406d7f0 0x7f5ec406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:49.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.074+0000 7f5ee23ce700 1 --2- 172.21.15.47:0/2380316520 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5ec406d7f0 0x7f5ec406fca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0fcc30 tx=0x7f5ecc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:49.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.078+0000 7f5edaffd700 1 -- 172.21.15.47:0/2380316520 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5ed005b730 con 0x7f5edc0fe0e0 2024-02-07T12:32:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.317+0000 7f5ee4632700 1 -- 172.21.15.47:0/2380316520 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5edc10f950 con 0x7f5ec406d7f0 2024-02-07T12:32:49.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.318+0000 7f5edaffd700 1 -- 172.21.15.47:0/2380316520 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5edc10f950 con 0x7f5ec406d7f0 2024-02-07T12:32:49.320 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:32:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:32:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:32:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:32:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:32:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-02-07T12:32:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "osd", 2024-02-07T12:32:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "mon", 2024-02-07T12:32:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr" 2024-02-07T12:32:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:32:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "12/21 daemons upgraded", 2024-02-07T12:32:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading osd daemons", 2024-02-07T12:32:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:32:49.321 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:32:49.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.320+0000 7f5ee4632700 1 -- 172.21.15.47:0/2380316520 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5ec406d7f0 msgr2=0x7f5ec406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:49.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.320+0000 7f5ee4632700 1 --2- 172.21.15.47:0/2380316520 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5ec406d7f0 0x7f5ec406fca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0fcc30 tx=0x7f5ecc00b040 comp rx=0 tx=0).stop 2024-02-07T12:32:49.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.320+0000 7f5ee4632700 1 -- 172.21.15.47:0/2380316520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5edc0fe0e0 msgr2=0x7f5edc10dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:49.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.320+0000 7f5ee4632700 1 --2- 172.21.15.47:0/2380316520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5edc0fe0e0 0x7f5edc10dea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009fd0 tx=0x7f5ed0009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:49.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.320+0000 7f5ee4632700 1 -- 172.21.15.47:0/2380316520 shutdown_connections 2024-02-07T12:32:49.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.320+0000 7f5ee4632700 1 --2- 172.21.15.47:0/2380316520 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5ec406d7f0 0x7f5ec406fca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:49.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.320+0000 7f5ee4632700 1 --2- 172.21.15.47:0/2380316520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5edc0fcef0 0x7f5edc10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:49.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.320+0000 7f5ee4632700 1 --2- 172.21.15.47:0/2380316520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5edc0fe0e0 0x7f5edc10dea0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.320+0000 7f5ee4632700 1 -- 172.21.15.47:0/2380316520 >> 172.21.15.47:0/2380316520 conn(0x7f5edc0f8620 msgr2=0x7f5edc1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.320+0000 7f5ee4632700 1 -- 172.21.15.47:0/2380316520 shutdown_connections 2024-02-07T12:32:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.320+0000 7f5ee4632700 1 -- 172.21.15.47:0/2380316520 wait complete. 2024-02-07T12:32:49.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.422+0000 7fa411813700 1 -- 172.21.15.47:0/2751742342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa40c0fbe40 msgr2=0x7fa40c0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:49.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.422+0000 7fa411813700 1 --2- 172.21.15.47:0/2751742342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa40c0fbe40 0x7fa40c0fc250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa404004940 tx=0x7fa404009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:49.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.422+0000 7fa411813700 1 -- 172.21.15.47:0/2751742342 shutdown_connections 2024-02-07T12:32:49.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.422+0000 7fa411813700 1 --2- 172.21.15.47:0/2751742342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa40c0fcfb0 0x7fa40c0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:49.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.422+0000 7fa411813700 1 --2- 172.21.15.47:0/2751742342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa40c0fbe40 0x7fa40c0fc250 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:49.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.422+0000 7fa411813700 1 -- 172.21.15.47:0/2751742342 >> 172.21.15.47:0/2751742342 conn(0x7fa40c0f74e0 msgr2=0x7fa40c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:49.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.422+0000 7fa411813700 1 -- 172.21.15.47:0/2751742342 shutdown_connections 2024-02-07T12:32:49.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.422+0000 7fa411813700 1 -- 172.21.15.47:0/2751742342 wait complete. 2024-02-07T12:32:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.422+0000 7fa411813700 1 Processor -- start 2024-02-07T12:32:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.422+0000 7fa411813700 1 -- start start 2024-02-07T12:32:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa411813700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa40c0fbe40 0x7fa40c10d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa411813700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa40c0fcfb0 0x7fa40c10de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa411813700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c10e480 con 0x7fa40c0fcfb0 2024-02-07T12:32:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa411813700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c10ed20 con 0x7fa40c0fbe40 2024-02-07T12:32:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa40a7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa40c0fcfb0 0x7fa40c10de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa40a7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa40c0fcfb0 0x7fa40c10de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56812/0 (socket says 172.21.15.47:56812) 2024-02-07T12:32:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa40a7fc700 1 -- 172.21.15.47:0/1793020343 learned_addr learned my addr 172.21.15.47:0/1793020343 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:32:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa40affd700 1 --2- 172.21.15.47:0/1793020343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa40c0fbe40 0x7fa40c10d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa40a7fc700 1 -- 172.21.15.47:0/1793020343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa40c0fbe40 msgr2=0x7fa40c10d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa40a7fc700 1 --2- 172.21.15.47:0/1793020343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa40c0fbe40 0x7fa40c10d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:49.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa40a7fc700 1 -- 172.21.15.47:0/1793020343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404005040 con 0x7fa40c0fcfb0 2024-02-07T12:32:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa40a7fc700 1 --2- 172.21.15.47:0/1793020343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa40c0fcfb0 0x7fa40c10de80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4002a50 tx=0x7fa3f40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa4037fe700 1 -- 172.21.15.47:0/1793020343 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3f4007cc0 con 0x7fa40c0fcfb0 2024-02-07T12:32:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa411813700 1 -- 172.21.15.47:0/1793020343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c10f000 con 0x7fa40c0fcfb0 2024-02-07T12:32:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa4037fe700 1 -- 172.21.15.47:0/1793020343 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3f400f040 con 0x7fa40c0fcfb0 2024-02-07T12:32:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa4037fe700 1 -- 172.21.15.47:0/1793020343 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3f400da30 con 0x7fa40c0fcfb0 2024-02-07T12:32:49.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.423+0000 7fa411813700 1 -- 172.21.15.47:0/1793020343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c10f540 con 0x7fa40c0fcfb0 2024-02-07T12:32:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.424+0000 7fa411813700 1 -- 172.21.15.47:0/1793020343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c04bed0 con 0x7fa40c0fcfb0 2024-02-07T12:32:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.425+0000 7fa4037fe700 1 -- 172.21.15.47:0/1793020343 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa3f400db90 con 0x7fa40c0fcfb0 2024-02-07T12:32:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.425+0000 7fa4037fe700 1 --2- 172.21.15.47:0/1793020343 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa3f806d7e0 0x7fa3f806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:32:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.425+0000 7fa4037fe700 1 -- 172.21.15.47:0/1793020343 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa3f408cd10 con 0x7fa40c0fcfb0 2024-02-07T12:32:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.425+0000 7fa40affd700 1 --2- 172.21.15.47:0/1793020343 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa3f806d7e0 0x7fa3f806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:32:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.426+0000 7fa40affd700 1 --2- 172.21.15.47:0/1793020343 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa3f806d7e0 0x7fa3f806fc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa40400b3b0 tx=0x7fa404009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:32:49.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.430+0000 7fa4037fe700 1 -- 172.21.15.47:0/1793020343 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa3f4059ff0 con 0x7fa40c0fcfb0 2024-02-07T12:32:49.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.719+0000 7fa411813700 1 -- 172.21.15.47:0/1793020343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa40c104930 con 0x7fa40c0fcfb0 2024-02-07T12:32:49.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.719+0000 7fa4037fe700 1 -- 172.21.15.47:0/1793020343 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1201 (secure 0 0 0) 0x7fa3f4059b80 con 0x7fa40c0fcfb0 2024-02-07T12:32:49.722 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_WARN all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 54/354 objects degraded (15.254%), 14 pgs degraded 2024-02-07T12:32:49.722 INFO:teuthology.orchestra.run.smithi047.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-02-07T12:32:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-02-07T12:32:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 54/354 objects degraded (15.254%), 14 pgs degraded 2024-02-07T12:32:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-02-07T12:32:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-02-07T12:32:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-02-07T12:32:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-02-07T12:32:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-02-07T12:32:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-02-07T12:32:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-02-07T12:32:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-02-07T12:32:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-02-07T12:32:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-02-07T12:32:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-02-07T12:32:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-02-07T12:32:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-02-07T12:32:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-02-07T12:32:49.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.721+0000 7fa411813700 1 -- 172.21.15.47:0/1793020343 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa3f806d7e0 msgr2=0x7fa3f806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:49.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.721+0000 7fa411813700 1 --2- 172.21.15.47:0/1793020343 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa3f806d7e0 0x7fa3f806fc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa40400b3b0 tx=0x7fa404009e30 comp rx=0 tx=0).stop 2024-02-07T12:32:49.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.721+0000 7fa411813700 1 -- 172.21.15.47:0/1793020343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa40c0fcfb0 msgr2=0x7fa40c10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:32:49.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.721+0000 7fa411813700 1 --2- 172.21.15.47:0/1793020343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa40c0fcfb0 0x7fa40c10de80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4002a50 tx=0x7fa3f40046b0 comp rx=0 tx=0).stop 2024-02-07T12:32:49.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.722+0000 7fa411813700 1 -- 172.21.15.47:0/1793020343 shutdown_connections 2024-02-07T12:32:49.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.722+0000 7fa411813700 1 --2- 172.21.15.47:0/1793020343 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa3f806d7e0 0x7fa3f806fc90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:49.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.722+0000 7fa411813700 1 --2- 172.21.15.47:0/1793020343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa40c0fbe40 0x7fa40c10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:49.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.722+0000 7fa411813700 1 --2- 172.21.15.47:0/1793020343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa40c0fcfb0 0x7fa40c10de80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:32:49.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.722+0000 7fa411813700 1 -- 172.21.15.47:0/1793020343 >> 172.21.15.47:0/1793020343 conn(0x7fa40c0f74e0 msgr2=0x7fa40c0656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:32:49.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.722+0000 7fa411813700 1 -- 172.21.15.47:0/1793020343 shutdown_connections 2024-02-07T12:32:49.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:32:49.722+0000 7fa411813700 1 -- 172.21.15.47:0/1793020343 wait complete. 2024-02-07T12:32:50.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: pgmap v163: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 54/354 objects degraded (15.254%) 2024-02-07T12:32:50.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: osdmap e80: 6 total, 6 up, 6 in 2024-02-07T12:32:50.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2814152208' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:32:50.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:50.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:50.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: Upgrade: Setting container_image for all osd 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-07T12:32:50.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-07T12:32:50.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-07T12:32:50.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-07T12:32:50.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-07T12:32:50.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-07T12:32:50.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-07T12:32:50.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-07T12:32:50.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-07T12:32:50.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: Upgrade: Setting require_osd_release to 19 squid 2024-02-07T12:32:50.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-07T12:32:50.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:49 smithi138 ceph-mon[82055]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:50.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: pgmap v163: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 54/354 objects degraded (15.254%) 2024-02-07T12:32:50.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: osdmap e80: 6 total, 6 up, 6 in 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2814152208' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: Upgrade: Setting container_image for all osd 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:50.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-07T12:32:50.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-07T12:32:50.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-07T12:32:50.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-07T12:32:50.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-07T12:32:50.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-07T12:32:50.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-07T12:32:50.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-07T12:32:50.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-07T12:32:50.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-07T12:32:50.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-07T12:32:50.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-07T12:32:50.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: Upgrade: Setting require_osd_release to 19 squid 2024-02-07T12:32:50.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-07T12:32:50.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:49 smithi047 ceph-mon[93224]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:32:51.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:50 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1793020343' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:32:51.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:50 smithi138 ceph-mon[82055]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-07T12:32:51.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:50 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-07T12:32:51.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:50 smithi138 ceph-mon[82055]: osdmap e81: 6 total, 6 up, 6 in 2024-02-07T12:32:51.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:50 smithi138 ceph-mon[82055]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-02-07T12:32:51.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:50 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:51.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:50 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-02-07T12:32:51.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:50 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1793020343' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:32:51.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:50 smithi047 ceph-mon[93224]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-07T12:32:51.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:50 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-07T12:32:51.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:50 smithi047 ceph-mon[93224]: osdmap e81: 6 total, 6 up, 6 in 2024-02-07T12:32:51.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:50 smithi047 ceph-mon[93224]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-02-07T12:32:51.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:50 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:51.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:50 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-02-07T12:32:52.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: pgmap v166: 65 pgs: 5 active+undersized+degraded, 9 active+undersized, 51 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 766 B/s rd, 2 op/s; 17/354 objects degraded (4.802%) 2024-02-07T12:32:52.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: osdmap e82: 6 total, 6 up, 6 in 2024-02-07T12:32:52.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: Health check update: Degraded data redundancy: 17/354 objects degraded (4.802%), 5 pgs degraded (PG_DEGRADED) 2024-02-07T12:32:52.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-07T12:32:52.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-02-07T12:32:52.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2024-02-07T12:32:52.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:52.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:32:52.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:32:52.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:52.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:52.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:52.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:52.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:52.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:52.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: Upgrade: Scaling down filesystem cephfs 2024-02-07T12:32:52.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:52.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-07T12:32:52.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: pgmap v166: 65 pgs: 5 active+undersized+degraded, 9 active+undersized, 51 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 766 B/s rd, 2 op/s; 17/354 objects degraded (4.802%) 2024-02-07T12:32:52.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: osdmap e82: 6 total, 6 up, 6 in 2024-02-07T12:32:52.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: Health check update: Degraded data redundancy: 17/354 objects degraded (4.802%), 5 pgs degraded (PG_DEGRADED) 2024-02-07T12:32:52.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-07T12:32:52.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-02-07T12:32:52.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2024-02-07T12:32:52.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:52.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:32:52.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:32:52.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:52.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:52.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:52.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:52.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:52.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:52.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: Upgrade: Scaling down filesystem cephfs 2024-02-07T12:32:52.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:52.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-07T12:32:53.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-07T12:32:53.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-07T12:32:53.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.138:6825/2036333358,v1:172.21.15.138:6826/2036333358] up:boot 2024-02-07T12:32:53.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.138:6824/1793209176,v1:172.21.15.138:6827/1793209176] up:boot 2024-02-07T12:32:53.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: stopping daemon mds.cephfs.smithi047.jsgfge 2024-02-07T12:32:53.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby 2024-02-07T12:32:53.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:32:53.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:32:53.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:53.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:stopping} 2 up:standby 2024-02-07T12:32:53.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:32:53.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:32:53.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:53.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:53.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:53.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:53.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:53.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:53.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:52 smithi138 ceph-mon[82055]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-07T12:32:53.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-07T12:32:53.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-07T12:32:53.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.138:6825/2036333358,v1:172.21.15.138:6826/2036333358] up:boot 2024-02-07T12:32:53.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.138:6824/1793209176,v1:172.21.15.138:6827/1793209176] up:boot 2024-02-07T12:32:53.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: stopping daemon mds.cephfs.smithi047.jsgfge 2024-02-07T12:32:53.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby 2024-02-07T12:32:53.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:32:53.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:32:53.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:53.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:stopping} 2 up:standby 2024-02-07T12:32:53.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:32:53.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:32:53.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:53.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:32:53.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:53.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:53.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:53.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:32:53.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:52 smithi047 ceph-mon[93224]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-07T12:32:54.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:54 smithi138 ceph-mon[82055]: pgmap v168: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-02-07T12:32:54.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:54 smithi138 ceph-mon[82055]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/354 objects degraded (4.802%), 5 pgs degraded) 2024-02-07T12:32:54.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:54 smithi138 ceph-mon[82055]: Cluster is now healthy 2024-02-07T12:32:54.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:54 smithi047 ceph-mon[93224]: pgmap v168: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-02-07T12:32:54.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:54 smithi047 ceph-mon[93224]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/354 objects degraded (4.802%), 5 pgs degraded) 2024-02-07T12:32:54.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:54 smithi047 ceph-mon[93224]: Cluster is now healthy 2024-02-07T12:32:56.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:56 smithi138 ceph-mon[82055]: pgmap v169: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 1 op/s 2024-02-07T12:32:56.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:56 smithi047 ceph-mon[93224]: pgmap v169: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 1 op/s 2024-02-07T12:32:58.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:57 smithi138 ceph-mon[82055]: pgmap v170: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-02-07T12:32:58.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:58.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:32:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:32:58.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:57 smithi047 ceph-mon[93224]: pgmap v170: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-02-07T12:32:58.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:32:58.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:32:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:33:00.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:00 smithi138 ceph-mon[82055]: pgmap v171: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.3 KiB/s wr, 1 op/s 2024-02-07T12:33:00.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:00 smithi138 ceph-mon[82055]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:stopping} 2 up:standby 2024-02-07T12:33:00.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:00 smithi047 ceph-mon[93224]: pgmap v171: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.3 KiB/s wr, 1 op/s 2024-02-07T12:33:00.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:00 smithi047 ceph-mon[93224]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:stopping} 2 up:standby 2024-02-07T12:33:02.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:02 smithi138 ceph-mon[82055]: pgmap v172: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 0 op/s 2024-02-07T12:33:02.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:02 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:02.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:02 smithi047 ceph-mon[93224]: pgmap v172: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 0 op/s 2024-02-07T12:33:02.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:02 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:03.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:03 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:03.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:03 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:33:03.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:03 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:33:03.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:03 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:03.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:03 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:03.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:03 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:03.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:03 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:03.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:03 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:03.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:03 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:03.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:03 smithi138 ceph-mon[82055]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-07T12:33:03.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:03 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:03.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:03 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:33:03.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:03 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:33:03.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:03 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:03.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:03 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:03.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:03 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:03.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:03 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:03.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:03 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:03.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:03 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:03.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:03 smithi047 ceph-mon[93224]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-07T12:33:04.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:04 smithi138 ceph-mon[82055]: pgmap v173: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 0 op/s 2024-02-07T12:33:04.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:04 smithi047 ceph-mon[93224]: pgmap v173: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 0 op/s 2024-02-07T12:33:06.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:06 smithi138 ceph-mon[82055]: pgmap v174: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 1 op/s 2024-02-07T12:33:06.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:06 smithi047 ceph-mon[93224]: pgmap v174: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 1 op/s 2024-02-07T12:33:08.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:08 smithi138 ceph-mon[82055]: pgmap v175: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 1.4 KiB/s wr, 1 op/s 2024-02-07T12:33:08.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:08 smithi047 ceph-mon[93224]: pgmap v175: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 1.4 KiB/s wr, 1 op/s 2024-02-07T12:33:10.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:10 smithi138 ceph-mon[82055]: pgmap v176: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.1 KiB/s wr, 0 op/s 2024-02-07T12:33:10.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:10 smithi047 ceph-mon[93224]: pgmap v176: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.1 KiB/s wr, 0 op/s 2024-02-07T12:33:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:12 smithi138 ceph-mon[82055]: pgmap v177: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-07T12:33:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:33:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:12 smithi047 ceph-mon[93224]: pgmap v177: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-07T12:33:12.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:33:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:13 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:13 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:33:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:13 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:33:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:13 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:13 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:13 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:13 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:13 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:13 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:13.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:13 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:13.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:13 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:33:13.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:13 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:33:13.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:13 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:13.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:13 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:13.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:13 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:13.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:13 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:13.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:13 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:13.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:13 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:14.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:14 smithi138 ceph-mon[82055]: pgmap v178: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-02-07T12:33:14.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:14 smithi138 ceph-mon[82055]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-07T12:33:14.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:14 smithi047 ceph-mon[93224]: pgmap v178: 65 pgs: 65 active+clean; 298 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-02-07T12:33:14.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:14 smithi047 ceph-mon[93224]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-07T12:33:16.744 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:16 smithi047 ceph-mon[93224]: pgmap v179: 65 pgs: 65 active+clean; 246 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.2 KiB/s wr, 6 op/s 2024-02-07T12:33:16.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:16 smithi138 ceph-mon[82055]: pgmap v179: 65 pgs: 65 active+clean; 246 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.2 KiB/s wr, 6 op/s 2024-02-07T12:33:18.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:18 smithi138 ceph-mon[82055]: pgmap v180: 65 pgs: 65 active+clean; 202 MiB data, 958 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-02-07T12:33:18.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:18 smithi047 ceph-mon[93224]: pgmap v180: 65 pgs: 65 active+clean; 202 MiB data, 958 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-02-07T12:33:19.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.839+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/4084017334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f00fcef0 msgr2=0x7fa7f00fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:19.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.839+0000 7fa7f4e0c700 1 --2- 172.21.15.47:0/4084017334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f00fcef0 0x7fa7f00fd320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0004940 tx=0x7fa7e0009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:19.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.839+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/4084017334 shutdown_connections 2024-02-07T12:33:19.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.839+0000 7fa7f4e0c700 1 --2- 172.21.15.47:0/4084017334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7f00fe0e0 0x7fa7f00fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.839+0000 7fa7f4e0c700 1 --2- 172.21.15.47:0/4084017334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f00fcef0 0x7fa7f00fd320 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.839+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/4084017334 >> 172.21.15.47:0/4084017334 conn(0x7fa7f00f8620 msgr2=0x7fa7f00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.839+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/4084017334 shutdown_connections 2024-02-07T12:33:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.839+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/4084017334 wait complete. 2024-02-07T12:33:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.839+0000 7fa7f4e0c700 1 Processor -- start 2024-02-07T12:33:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.839+0000 7fa7f4e0c700 1 -- start start 2024-02-07T12:33:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7f4e0c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f00fcef0 0x7fa7f010d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7f4e0c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7f00fe0e0 0x7fa7f010deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7f4e0c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f010e4b0 con 0x7fa7f00fcef0 2024-02-07T12:33:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7f4e0c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f010ed50 con 0x7fa7f00fe0e0 2024-02-07T12:33:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7ee59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f00fcef0 0x7fa7f010d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7ee59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f00fcef0 0x7fa7f010d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35606/0 (socket says 172.21.15.47:35606) 2024-02-07T12:33:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7ee59c700 1 -- 172.21.15.47:0/516157720 learned_addr learned my addr 172.21.15.47:0/516157720 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:19.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7edd9b700 1 --2- 172.21.15.47:0/516157720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7f00fe0e0 0x7fa7f010deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:19.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7ee59c700 1 -- 172.21.15.47:0/516157720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7f00fe0e0 msgr2=0x7fa7f010deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:19.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7ee59c700 1 --2- 172.21.15.47:0/516157720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7f00fe0e0 0x7fa7f010deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:19.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7ee59c700 1 -- 172.21.15.47:0/516157720 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0005040 con 0x7fa7f00fcef0 2024-02-07T12:33:19.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7edd9b700 1 --2- 172.21.15.47:0/516157720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7f00fe0e0 0x7fa7f010deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:33:19.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7ee59c700 1 --2- 172.21.15.47:0/516157720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f00fcef0 0x7fa7f010d970 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009360 tx=0x7fa7e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:19.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7deffd700 1 -- 172.21.15.47:0/516157720 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e000e040 con 0x7fa7f00fcef0 2024-02-07T12:33:19.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7deffd700 1 -- 172.21.15.47:0/516157720 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7e0004290 con 0x7fa7f00fcef0 2024-02-07T12:33:19.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.840+0000 7fa7deffd700 1 -- 172.21.15.47:0/516157720 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e001c630 con 0x7fa7f00fcef0 2024-02-07T12:33:19.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.841+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/516157720 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f010efd0 con 0x7fa7f00fcef0 2024-02-07T12:33:19.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.841+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/516157720 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f010f510 con 0x7fa7f00fcef0 2024-02-07T12:33:19.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.841+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/516157720 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f004bed0 con 0x7fa7f00fcef0 2024-02-07T12:33:19.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.842+0000 7fa7deffd700 1 -- 172.21.15.47:0/516157720 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa7e000bcc0 con 0x7fa7f00fcef0 2024-02-07T12:33:19.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.843+0000 7fa7deffd700 1 --2- 172.21.15.47:0/516157720 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa7d806d7f0 0x7fa7d806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:19.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.843+0000 7fa7deffd700 1 -- 172.21.15.47:0/516157720 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa7e008e2a0 con 0x7fa7f00fcef0 2024-02-07T12:33:19.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.843+0000 7fa7edd9b700 1 --2- 172.21.15.47:0/516157720 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa7d806d7f0 0x7fa7d806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:19.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.843+0000 7fa7edd9b700 1 --2- 172.21.15.47:0/516157720 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa7d806d7f0 0x7fa7d806fca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009fd0 tx=0x7fa7e4009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:19.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:19.847+0000 7fa7deffd700 1 -- 172.21.15.47:0/516157720 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa7e005b680 con 0x7fa7f00fcef0 2024-02-07T12:33:20.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.068+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/516157720 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7f0102ac0 con 0x7fa7d806d7f0 2024-02-07T12:33:20.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.070+0000 7fa7deffd700 1 -- 172.21.15.47:0/516157720 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa7f0102ac0 con 0x7fa7d806d7f0 2024-02-07T12:33:20.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.072+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/516157720 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa7d806d7f0 msgr2=0x7fa7d806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:20.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.072+0000 7fa7f4e0c700 1 --2- 172.21.15.47:0/516157720 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa7d806d7f0 0x7fa7d806fca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009fd0 tx=0x7fa7e4009ee0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.072+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/516157720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f00fcef0 msgr2=0x7fa7f010d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:20.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.072+0000 7fa7f4e0c700 1 --2- 172.21.15.47:0/516157720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f00fcef0 0x7fa7f010d970 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009360 tx=0x7fa7e0009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:20.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.072+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/516157720 shutdown_connections 2024-02-07T12:33:20.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.072+0000 7fa7f4e0c700 1 --2- 172.21.15.47:0/516157720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7f00fcef0 0x7fa7f010d970 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.072+0000 7fa7f4e0c700 1 --2- 172.21.15.47:0/516157720 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa7d806d7f0 0x7fa7d806fca0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.072+0000 7fa7f4e0c700 1 --2- 172.21.15.47:0/516157720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7f00fe0e0 0x7fa7f010deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.072+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/516157720 >> 172.21.15.47:0/516157720 conn(0x7fa7f00f8620 msgr2=0x7fa7f01013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:20.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.072+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/516157720 shutdown_connections 2024-02-07T12:33:20.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.072+0000 7fa7f4e0c700 1 -- 172.21.15.47:0/516157720 wait complete. 2024-02-07T12:33:20.084 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:33:20.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.174+0000 7f7d462d0700 1 -- 172.21.15.47:0/4282601176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d400fbce0 msgr2=0x7f7d40102560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:20.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.174+0000 7f7d462d0700 1 --2- 172.21.15.47:0/4282601176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d400fbce0 0x7f7d40102560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7d28004940 tx=0x7f7d28009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:20.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.174+0000 7f7d462d0700 1 -- 172.21.15.47:0/4282601176 shutdown_connections 2024-02-07T12:33:20.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.174+0000 7f7d462d0700 1 --2- 172.21.15.47:0/4282601176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d400fbce0 0x7f7d40102560 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.174+0000 7f7d462d0700 1 --2- 172.21.15.47:0/4282601176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d400fb300 0x7f7d400fb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.174+0000 7f7d462d0700 1 -- 172.21.15.47:0/4282601176 >> 172.21.15.47:0/4282601176 conn(0x7f7d400f6ca0 msgr2=0x7f7d400f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:20.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.175+0000 7f7d462d0700 1 -- 172.21.15.47:0/4282601176 shutdown_connections 2024-02-07T12:33:20.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.175+0000 7f7d462d0700 1 -- 172.21.15.47:0/4282601176 wait complete. 2024-02-07T12:33:20.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.175+0000 7f7d462d0700 1 Processor -- start 2024-02-07T12:33:20.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.175+0000 7f7d462d0700 1 -- start start 2024-02-07T12:33:20.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.175+0000 7f7d462d0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d400fb300 0x7f7d400fde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:20.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.175+0000 7f7d462d0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d400fc2e0 0x7f7d400fc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:20.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.175+0000 7f7d462d0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400fcce0 con 0x7f7d400fc2e0 2024-02-07T12:33:20.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.175+0000 7f7d462d0700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400fce20 con 0x7f7d400fb300 2024-02-07T12:33:20.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.176+0000 7f7d3f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d400fc2e0 0x7f7d400fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:20.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.176+0000 7f7d3f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d400fc2e0 0x7f7d400fc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35628/0 (socket says 172.21.15.47:35628) 2024-02-07T12:33:20.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.176+0000 7f7d3f7fe700 1 -- 172.21.15.47:0/290062654 learned_addr learned my addr 172.21.15.47:0/290062654 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:20.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.176+0000 7f7d3ffff700 1 --2- 172.21.15.47:0/290062654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d400fb300 0x7f7d400fde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:20.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.176+0000 7f7d3f7fe700 1 -- 172.21.15.47:0/290062654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d400fb300 msgr2=0x7f7d400fde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:20.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.176+0000 7f7d3f7fe700 1 --2- 172.21.15.47:0/290062654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d400fb300 0x7f7d400fde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.176+0000 7f7d3f7fe700 1 -- 172.21.15.47:0/290062654 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28005040 con 0x7f7d400fc2e0 2024-02-07T12:33:20.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.176+0000 7f7d3f7fe700 1 --2- 172.21.15.47:0/290062654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d400fc2e0 0x7f7d400fc750 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009150 tx=0x7f7d28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:20.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.176+0000 7f7d3cff9700 1 -- 172.21.15.47:0/290062654 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d2800e040 con 0x7f7d400fc2e0 2024-02-07T12:33:20.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.176+0000 7f7d3cff9700 1 -- 172.21.15.47:0/290062654 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d2800bbf0 con 0x7f7d400fc2e0 2024-02-07T12:33:20.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.176+0000 7f7d462d0700 1 -- 172.21.15.47:0/290062654 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d400fd0a0 con 0x7f7d400fc2e0 2024-02-07T12:33:20.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.176+0000 7f7d3cff9700 1 -- 172.21.15.47:0/290062654 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d2801c630 con 0x7f7d400fc2e0 2024-02-07T12:33:20.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.176+0000 7f7d462d0700 1 -- 172.21.15.47:0/290062654 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d40115d40 con 0x7f7d400fc2e0 2024-02-07T12:33:20.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.177+0000 7f7d462d0700 1 -- 172.21.15.47:0/290062654 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d40107a90 con 0x7f7d400fc2e0 2024-02-07T12:33:20.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.178+0000 7f7d3cff9700 1 -- 172.21.15.47:0/290062654 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f7d2800bd60 con 0x7f7d400fc2e0 2024-02-07T12:33:20.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.179+0000 7f7d3cff9700 1 --2- 172.21.15.47:0/290062654 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7d2c06d7e0 0x7f7d2c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:20.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.179+0000 7f7d3cff9700 1 -- 172.21.15.47:0/290062654 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7d2808e210 con 0x7f7d400fc2e0 2024-02-07T12:33:20.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.179+0000 7f7d3ffff700 1 --2- 172.21.15.47:0/290062654 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7d2c06d7e0 0x7f7d2c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:20.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.179+0000 7f7d3ffff700 1 --2- 172.21.15.47:0/290062654 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7d2c06d7e0 0x7f7d2c06fc90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d30007fd0 tx=0x7f7d30009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:20.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.183+0000 7f7d3cff9700 1 -- 172.21.15.47:0/290062654 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7d2805b610 con 0x7f7d400fc2e0 2024-02-07T12:33:20.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.409+0000 7f7d462d0700 1 -- 172.21.15.47:0/290062654 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d400fbdf0 con 0x7f7d2c06d7e0 2024-02-07T12:33:20.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.410+0000 7f7d3cff9700 1 -- 172.21.15.47:0/290062654 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7d400fbdf0 con 0x7f7d2c06d7e0 2024-02-07T12:33:20.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.412+0000 7f7d462d0700 1 -- 172.21.15.47:0/290062654 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7d2c06d7e0 msgr2=0x7f7d2c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:20.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.412+0000 7f7d462d0700 1 --2- 172.21.15.47:0/290062654 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7d2c06d7e0 0x7f7d2c06fc90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d30007fd0 tx=0x7f7d30009040 comp rx=0 tx=0).stop 2024-02-07T12:33:20.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.412+0000 7f7d462d0700 1 -- 172.21.15.47:0/290062654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d400fc2e0 msgr2=0x7f7d400fc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:20.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.412+0000 7f7d462d0700 1 --2- 172.21.15.47:0/290062654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d400fc2e0 0x7f7d400fc750 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009150 tx=0x7f7d28009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:20.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.412+0000 7f7d462d0700 1 -- 172.21.15.47:0/290062654 shutdown_connections 2024-02-07T12:33:20.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.412+0000 7f7d462d0700 1 --2- 172.21.15.47:0/290062654 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7d2c06d7e0 0x7f7d2c06fc90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.412+0000 7f7d462d0700 1 --2- 172.21.15.47:0/290062654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d400fb300 0x7f7d400fde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.412+0000 7f7d462d0700 1 --2- 172.21.15.47:0/290062654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d400fc2e0 0x7f7d400fc750 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.412+0000 7f7d462d0700 1 -- 172.21.15.47:0/290062654 >> 172.21.15.47:0/290062654 conn(0x7f7d400f6ca0 msgr2=0x7f7d40100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:20.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.412+0000 7f7d462d0700 1 -- 172.21.15.47:0/290062654 shutdown_connections 2024-02-07T12:33:20.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.412+0000 7f7d462d0700 1 -- 172.21.15.47:0/290062654 wait complete. 2024-02-07T12:33:20.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.515+0000 7fb0ad94a700 1 -- 172.21.15.47:0/3732203285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a80fcef0 msgr2=0x7fb0a80fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:20.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.515+0000 7fb0ad94a700 1 --2- 172.21.15.47:0/3732203285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a80fcef0 0x7fb0a80fd320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb090004940 tx=0x7fb090009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:20.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.515+0000 7fb0ad94a700 1 -- 172.21.15.47:0/3732203285 shutdown_connections 2024-02-07T12:33:20.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.515+0000 7fb0ad94a700 1 --2- 172.21.15.47:0/3732203285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0a80fe0e0 0x7fb0a80fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.515+0000 7fb0ad94a700 1 --2- 172.21.15.47:0/3732203285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a80fcef0 0x7fb0a80fd320 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.515+0000 7fb0ad94a700 1 -- 172.21.15.47:0/3732203285 >> 172.21.15.47:0/3732203285 conn(0x7fb0a80f8620 msgr2=0x7fb0a80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:20.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.515+0000 7fb0ad94a700 1 -- 172.21.15.47:0/3732203285 shutdown_connections 2024-02-07T12:33:20.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.515+0000 7fb0ad94a700 1 -- 172.21.15.47:0/3732203285 wait complete. 2024-02-07T12:33:20.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0ad94a700 1 Processor -- start 2024-02-07T12:33:20.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0ad94a700 1 -- start start 2024-02-07T12:33:20.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0ad94a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0a80fcef0 0x7fb0a810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:20.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0ad94a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a80fe0e0 0x7fb0a810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:20.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0ad94a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a810e4b0 con 0x7fb0a80fe0e0 2024-02-07T12:33:20.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0ad94a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a810ed50 con 0x7fb0a80fcef0 2024-02-07T12:33:20.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0a67fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a80fe0e0 0x7fb0a810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:20.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0a67fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a80fe0e0 0x7fb0a810deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35650/0 (socket says 172.21.15.47:35650) 2024-02-07T12:33:20.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0a67fc700 1 -- 172.21.15.47:0/1891293580 learned_addr learned my addr 172.21.15.47:0/1891293580 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0a6ffd700 1 --2- 172.21.15.47:0/1891293580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0a80fcef0 0x7fb0a810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0a67fc700 1 -- 172.21.15.47:0/1891293580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0a80fcef0 msgr2=0x7fb0a810d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0a67fc700 1 --2- 172.21.15.47:0/1891293580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0a80fcef0 0x7fb0a810d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0a67fc700 1 -- 172.21.15.47:0/1891293580 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb090005040 con 0x7fb0a80fe0e0 2024-02-07T12:33:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.516+0000 7fb0a67fc700 1 --2- 172.21.15.47:0/1891293580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a80fe0e0 0x7fb0a810deb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb098002a50 tx=0x7fb0980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.517+0000 7fb09f7fe700 1 -- 172.21.15.47:0/1891293580 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb098007cc0 con 0x7fb0a80fe0e0 2024-02-07T12:33:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.517+0000 7fb09f7fe700 1 -- 172.21.15.47:0/1891293580 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb09800f040 con 0x7fb0a80fe0e0 2024-02-07T12:33:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.517+0000 7fb0ad94a700 1 -- 172.21.15.47:0/1891293580 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a810f030 con 0x7fb0a80fe0e0 2024-02-07T12:33:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.517+0000 7fb09f7fe700 1 -- 172.21.15.47:0/1891293580 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb09800da30 con 0x7fb0a80fe0e0 2024-02-07T12:33:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.517+0000 7fb0ad94a700 1 -- 172.21.15.47:0/1891293580 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a810f570 con 0x7fb0a80fe0e0 2024-02-07T12:33:20.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.518+0000 7fb0ad94a700 1 -- 172.21.15.47:0/1891293580 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a804bed0 con 0x7fb0a80fe0e0 2024-02-07T12:33:20.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.518+0000 7fb09f7fe700 1 -- 172.21.15.47:0/1891293580 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb09800db90 con 0x7fb0a80fe0e0 2024-02-07T12:33:20.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.519+0000 7fb09f7fe700 1 --2- 172.21.15.47:0/1891293580 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb09406d7e0 0x7fb09406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:20.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.519+0000 7fb09f7fe700 1 -- 172.21.15.47:0/1891293580 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb09808cb60 con 0x7fb0a80fe0e0 2024-02-07T12:33:20.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.519+0000 7fb0a6ffd700 1 --2- 172.21.15.47:0/1891293580 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb09406d7e0 0x7fb09406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:20.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.519+0000 7fb0a6ffd700 1 --2- 172.21.15.47:0/1891293580 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb09406d7e0 0x7fb09406fc90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb090004890 tx=0x7fb090009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:20.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.523+0000 7fb09f7fe700 1 -- 172.21.15.47:0/1891293580 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb098059f60 con 0x7fb0a80fe0e0 2024-02-07T12:33:20.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.736+0000 7fb0ad94a700 1 -- 172.21.15.47:0/1891293580 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0a810fa10 con 0x7fb09406d7e0 2024-02-07T12:33:20.739 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:20 smithi047 ceph-mon[93224]: pgmap v181: 65 pgs: 65 active+clean; 178 MiB data, 834 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-02-07T12:33:20.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.746+0000 7fb09f7fe700 1 -- 172.21.15.47:0/1891293580 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fb0a810fa10 con 0x7fb09406d7e0 2024-02-07T12:33:20.749 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:33:20.749 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (7m) 2m ago 15m 26.6M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:33:20.749 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (4m) 2m ago 16m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:33:20.749 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (3m) 36s ago 15m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:33:20.749 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (6m) 2m ago 15m 78.4M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:33:20.749 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (10m) 2m ago 10m 111M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:33:20.749 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (10m) 2m ago 10m 129M - 17.2.7-491-gf2462625 4ad3622d1b31 5c7178c85fae 2024-02-07T12:33:20.749 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (10m) 36s ago 10m 68.4M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:33:20.749 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (10m) 36s ago 10m 69.7M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:33:20.750 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (5m) 2m ago 17m 503M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:33:20.750 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (5m) 36s ago 14m 452M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:33:20.750 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (5m) 2m ago 17m 47.4M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:33:20.750 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (4m) 36s ago 14m 37.7M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:33:20.750 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (7m) 2m ago 15m 15.1M - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:33:20.750 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (5m) 36s ago 14m 14.9M - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:33:20.750 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (3m) 2m ago 14m 87.4M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:33:20.750 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (2m) 2m ago 13m 98.5M 1559M 19.0.0-1252-g44458cce 79957b372307 0f2b0eea74d7 2024-02-07T12:33:20.750 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (2m) 2m ago 13m 12.6M 1559M 19.0.0-1252-g44458cce 79957b372307 0b8c78346346 2024-02-07T12:33:20.750 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (106s) 36s ago 12m 113M 2581M 19.0.0-1252-g44458cce 79957b372307 dea45db021db 2024-02-07T12:33:20.750 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (73s) 36s ago 12m 93.6M 2581M 19.0.0-1252-g44458cce 79957b372307 3161c1dfe6f5 2024-02-07T12:33:20.750 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (39s) 36s ago 11m 12.6M 2581M 19.0.0-1252-g44458cce 79957b372307 c9504c7cfe7c 2024-02-07T12:33:20.750 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (5m) 2m ago 15m 51.5M - 2.43.0 a07b618ecd1d 32840d82c54b 2024-02-07T12:33:20.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.749+0000 7fb0ad94a700 1 -- 172.21.15.47:0/1891293580 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb09406d7e0 msgr2=0x7fb09406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:20.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.749+0000 7fb0ad94a700 1 --2- 172.21.15.47:0/1891293580 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb09406d7e0 0x7fb09406fc90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb090004890 tx=0x7fb090009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:20.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.749+0000 7fb0ad94a700 1 -- 172.21.15.47:0/1891293580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a80fe0e0 msgr2=0x7fb0a810deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:20.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.749+0000 7fb0ad94a700 1 --2- 172.21.15.47:0/1891293580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a80fe0e0 0x7fb0a810deb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb098002a50 tx=0x7fb0980046b0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.749+0000 7fb0ad94a700 1 -- 172.21.15.47:0/1891293580 shutdown_connections 2024-02-07T12:33:20.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.749+0000 7fb0ad94a700 1 --2- 172.21.15.47:0/1891293580 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb09406d7e0 0x7fb09406fc90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.749+0000 7fb0ad94a700 1 --2- 172.21.15.47:0/1891293580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0a80fcef0 0x7fb0a810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.749+0000 7fb0ad94a700 1 --2- 172.21.15.47:0/1891293580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a80fe0e0 0x7fb0a810deb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.749+0000 7fb0ad94a700 1 -- 172.21.15.47:0/1891293580 >> 172.21.15.47:0/1891293580 conn(0x7fb0a80f8620 msgr2=0x7fb0a81013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:20.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.749+0000 7fb0ad94a700 1 -- 172.21.15.47:0/1891293580 shutdown_connections 2024-02-07T12:33:20.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.749+0000 7fb0ad94a700 1 -- 172.21.15.47:0/1891293580 wait complete. 2024-02-07T12:33:20.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:20 smithi138 ceph-mon[82055]: pgmap v181: 65 pgs: 65 active+clean; 178 MiB data, 834 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-02-07T12:33:20.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.849+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2307122965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c441000e0 msgr2=0x7f8c44102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:20.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.849+0000 7f8c4ae12700 1 --2- 172.21.15.47:0/2307122965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c441000e0 0x7f8c44102520 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8c30004940 tx=0x7f8c30009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:20.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.849+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2307122965 shutdown_connections 2024-02-07T12:33:20.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.850+0000 7f8c4ae12700 1 --2- 172.21.15.47:0/2307122965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c441000e0 0x7f8c44102520 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.850+0000 7f8c4ae12700 1 --2- 172.21.15.47:0/2307122965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c44066c50 0x7f8c440ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.850+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2307122965 >> 172.21.15.47:0/2307122965 conn(0x7f8c440f7520 msgr2=0x7f8c440f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:20.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.850+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2307122965 shutdown_connections 2024-02-07T12:33:20.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.850+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2307122965 wait complete. 2024-02-07T12:33:20.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.850+0000 7f8c4ae12700 1 Processor -- start 2024-02-07T12:33:20.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.850+0000 7f8c4ae12700 1 -- start start 2024-02-07T12:33:20.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.850+0000 7f8c4ae12700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c44066c50 0x7f8c4410d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:20.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.850+0000 7f8c4ae12700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c441000e0 0x7f8c4410dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.850+0000 7f8c4ae12700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4410e4a0 con 0x7f8c441000e0 2024-02-07T12:33:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.850+0000 7f8c4ae12700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4410ed40 con 0x7f8c44066c50 2024-02-07T12:33:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.851+0000 7f8c43fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c441000e0 0x7f8c4410dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.851+0000 7f8c43fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c441000e0 0x7f8c4410dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35662/0 (socket says 172.21.15.47:35662) 2024-02-07T12:33:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.851+0000 7f8c43fff700 1 -- 172.21.15.47:0/2092682996 learned_addr learned my addr 172.21.15.47:0/2092682996 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.851+0000 7f8c48bae700 1 --2- 172.21.15.47:0/2092682996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c44066c50 0x7f8c4410d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.851+0000 7f8c43fff700 1 -- 172.21.15.47:0/2092682996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c44066c50 msgr2=0x7f8c4410d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.851+0000 7f8c43fff700 1 --2- 172.21.15.47:0/2092682996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c44066c50 0x7f8c4410d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.851+0000 7f8c43fff700 1 -- 172.21.15.47:0/2092682996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c30005040 con 0x7f8c441000e0 2024-02-07T12:33:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.851+0000 7f8c43fff700 1 --2- 172.21.15.47:0/2092682996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c441000e0 0x7f8c4410dea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000b3b0 tx=0x7f8c30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:20.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.851+0000 7f8c417fa700 1 -- 172.21.15.47:0/2092682996 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c3000e040 con 0x7f8c441000e0 2024-02-07T12:33:20.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.851+0000 7f8c417fa700 1 -- 172.21.15.47:0/2092682996 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c3000bcc0 con 0x7f8c441000e0 2024-02-07T12:33:20.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.851+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2092682996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4410efc0 con 0x7f8c441000e0 2024-02-07T12:33:20.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.851+0000 7f8c417fa700 1 -- 172.21.15.47:0/2092682996 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c3001c630 con 0x7f8c441000e0 2024-02-07T12:33:20.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.851+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2092682996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4410f500 con 0x7f8c441000e0 2024-02-07T12:33:20.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.852+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2092682996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c44107a50 con 0x7f8c441000e0 2024-02-07T12:33:20.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.853+0000 7f8c417fa700 1 -- 172.21.15.47:0/2092682996 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8c30013980 con 0x7f8c441000e0 2024-02-07T12:33:20.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.853+0000 7f8c417fa700 1 --2- 172.21.15.47:0/2092682996 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8c3406d7e0 0x7f8c3406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:20.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.853+0000 7f8c417fa700 1 -- 172.21.15.47:0/2092682996 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8c3008e290 con 0x7f8c441000e0 2024-02-07T12:33:20.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.853+0000 7f8c48bae700 1 --2- 172.21.15.47:0/2092682996 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8c3406d7e0 0x7f8c3406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:20.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.854+0000 7f8c48bae700 1 --2- 172.21.15.47:0/2092682996 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8c3406d7e0 0x7f8c3406fc90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8c38004f40 tx=0x7f8c3800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:20.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:20.858+0000 7f8c417fa700 1 -- 172.21.15.47:0/2092682996 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8c3005b730 con 0x7f8c441000e0 2024-02-07T12:33:21.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.145+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2092682996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8c4404bed0 con 0x7f8c441000e0 2024-02-07T12:33:21.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.145+0000 7f8c417fa700 1 -- 172.21.15.47:0/2092682996 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f8c3005b2c0 con 0x7f8c441000e0 2024-02-07T12:33:21.147 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:33:21.147 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 6 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 4, 2024-02-07T12:33:21.148 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 10 2024-02-07T12:33:21.149 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:33:21.149 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:33:21.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.147+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2092682996 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8c3406d7e0 msgr2=0x7f8c3406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:21.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.147+0000 7f8c4ae12700 1 --2- 172.21.15.47:0/2092682996 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8c3406d7e0 0x7f8c3406fc90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8c38004f40 tx=0x7f8c3800b040 comp rx=0 tx=0).stop 2024-02-07T12:33:21.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.147+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2092682996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c441000e0 msgr2=0x7f8c4410dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:21.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.147+0000 7f8c4ae12700 1 --2- 172.21.15.47:0/2092682996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c441000e0 0x7f8c4410dea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000b3b0 tx=0x7f8c30009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:21.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.147+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2092682996 shutdown_connections 2024-02-07T12:33:21.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.147+0000 7f8c4ae12700 1 --2- 172.21.15.47:0/2092682996 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8c3406d7e0 0x7f8c3406fc90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.147+0000 7f8c4ae12700 1 --2- 172.21.15.47:0/2092682996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c44066c50 0x7f8c4410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.147+0000 7f8c4ae12700 1 --2- 172.21.15.47:0/2092682996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c441000e0 0x7f8c4410dea0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.147+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2092682996 >> 172.21.15.47:0/2092682996 conn(0x7f8c440f7520 msgr2=0x7f8c440f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:21.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.147+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2092682996 shutdown_connections 2024-02-07T12:33:21.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.147+0000 7f8c4ae12700 1 -- 172.21.15.47:0/2092682996 wait complete. 2024-02-07T12:33:21.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.249+0000 7f7e68816700 1 -- 172.21.15.47:0/1526241940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e640fe1e0 msgr2=0x7f7e640fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:21.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.249+0000 7f7e68816700 1 --2- 172.21.15.47:0/1526241940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e640fe1e0 0x7f7e640fe650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c004940 tx=0x7f7e4c009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:21.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.249+0000 7f7e68816700 1 -- 172.21.15.47:0/1526241940 shutdown_connections 2024-02-07T12:33:21.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.249+0000 7f7e68816700 1 --2- 172.21.15.47:0/1526241940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e640fe1e0 0x7f7e640fe650 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.249+0000 7f7e68816700 1 --2- 172.21.15.47:0/1526241940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e640fcf30 0x7f7e640fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.249+0000 7f7e68816700 1 -- 172.21.15.47:0/1526241940 >> 172.21.15.47:0/1526241940 conn(0x7f7e640f86b0 msgr2=0x7f7e640faac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:21.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.249+0000 7f7e68816700 1 -- 172.21.15.47:0/1526241940 shutdown_connections 2024-02-07T12:33:21.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.249+0000 7f7e68816700 1 -- 172.21.15.47:0/1526241940 wait complete. 2024-02-07T12:33:21.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.250+0000 7f7e68816700 1 Processor -- start 2024-02-07T12:33:21.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.250+0000 7f7e68816700 1 -- start start 2024-02-07T12:33:21.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.250+0000 7f7e68816700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e640fcf30 0x7f7e64071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:21.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.250+0000 7f7e68816700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e640fe1e0 0x7f7e640702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:21.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.250+0000 7f7e68816700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640708e0 con 0x7f7e640fe1e0 2024-02-07T12:33:21.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.250+0000 7f7e68816700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e64070a50 con 0x7f7e640fcf30 2024-02-07T12:33:21.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.250+0000 7f7e61d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e640fe1e0 0x7f7e640702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.250+0000 7f7e61d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e640fe1e0 0x7f7e640702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35678/0 (socket says 172.21.15.47:35678) 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.250+0000 7f7e61d9b700 1 -- 172.21.15.47:0/2720902737 learned_addr learned my addr 172.21.15.47:0/2720902737 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.250+0000 7f7e6259c700 1 --2- 172.21.15.47:0/2720902737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e640fcf30 0x7f7e64071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.251+0000 7f7e61d9b700 1 -- 172.21.15.47:0/2720902737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e640fcf30 msgr2=0x7f7e64071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.251+0000 7f7e61d9b700 1 --2- 172.21.15.47:0/2720902737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e640fcf30 0x7f7e64071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.251+0000 7f7e61d9b700 1 -- 172.21.15.47:0/2720902737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c005040 con 0x7f7e640fe1e0 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.251+0000 7f7e6259c700 1 --2- 172.21.15.47:0/2720902737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e640fcf30 0x7f7e64071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.251+0000 7f7e61d9b700 1 --2- 172.21.15.47:0/2720902737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e640fe1e0 0x7f7e640702e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009fd0 tx=0x7f7e4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.251+0000 7f7e5affd700 1 -- 172.21.15.47:0/2720902737 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e4c00e040 con 0x7f7e640fe1e0 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.251+0000 7f7e5affd700 1 -- 172.21.15.47:0/2720902737 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e4c00bcc0 con 0x7f7e640fe1e0 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.251+0000 7f7e5affd700 1 -- 172.21.15.47:0/2720902737 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e4c01c630 con 0x7f7e640fe1e0 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.251+0000 7f7e68816700 1 -- 172.21.15.47:0/2720902737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e64070cd0 con 0x7f7e640fe1e0 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.251+0000 7f7e68816700 1 -- 172.21.15.47:0/2720902737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e64115930 con 0x7f7e640fe1e0 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.252+0000 7f7e68816700 1 -- 172.21.15.47:0/2720902737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6404bed0 con 0x7f7e640fe1e0 2024-02-07T12:33:21.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.252+0000 7f7e5affd700 1 -- 172.21.15.47:0/2720902737 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f7e4c013980 con 0x7f7e640fe1e0 2024-02-07T12:33:21.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.253+0000 7f7e5affd700 1 --2- 172.21.15.47:0/2720902737 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7e5006d7f0 0x7f7e5006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:21.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.253+0000 7f7e5affd700 1 -- 172.21.15.47:0/2720902737 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7e4c08e270 con 0x7f7e640fe1e0 2024-02-07T12:33:21.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.253+0000 7f7e6259c700 1 --2- 172.21.15.47:0/2720902737 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7e5006d7f0 0x7f7e5006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:21.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.253+0000 7f7e6259c700 1 --2- 172.21.15.47:0/2720902737 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7e5006d7f0 0x7f7e5006fca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7e54007fd0 tx=0x7f7e54009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:21.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.258+0000 7f7e5affd700 1 -- 172.21.15.47:0/2720902737 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7e4c05b710 con 0x7f7e640fe1e0 2024-02-07T12:33:21.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.504+0000 7f7e68816700 1 -- 172.21.15.47:0/2720902737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7e64105a20 con 0x7f7e640fe1e0 2024-02-07T12:33:21.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.504+0000 7f7e5affd700 1 -- 172.21.15.47:0/2720902737 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f7e4c05b2a0 con 0x7f7e640fe1e0 2024-02-07T12:33:21.507 INFO:teuthology.orchestra.run.smithi047.stdout:e26 2024-02-07T12:33:21.507 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:33:21.507 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:33:21.507 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:33:21.507 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:33:21.507 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:33:21.507 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:33:21.507 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 26 2024-02-07T12:33:21.507 INFO:teuthology.orchestra.run.smithi047.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-07T12:33:21.507 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:33:21.507 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:32:58.615367+0000 2024-02-07T12:33:21.507 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:33:21.507 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:33:21.508 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:33:21.508 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:33:21.508 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:33:21.508 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:33:21.508 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:33:21.508 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:33:21.508 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 0 2024-02-07T12:33:21.508 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:33:21.508 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 1 2024-02-07T12:33:21.508 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:33:21.508 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=14460,1=14472} 2024-02-07T12:33:21.508 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:33:21.508 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:14460} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.47:6826/3633114050,v1:172.21.15.47:6827/3633114050] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:14472} state up:stopping seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout:Standby daemons: 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{-1:44283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.138:6825/2036333358,v1:172.21.15.138:6826/2036333358] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:33:21.509 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/1793209176,v1:172.21.15.138:6827/1793209176] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:33:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.506+0000 7f7e68816700 1 -- 172.21.15.47:0/2720902737 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7e5006d7f0 msgr2=0x7f7e5006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.506+0000 7f7e68816700 1 --2- 172.21.15.47:0/2720902737 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7e5006d7f0 0x7f7e5006fca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7e54007fd0 tx=0x7f7e54009040 comp rx=0 tx=0).stop 2024-02-07T12:33:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.506+0000 7f7e68816700 1 -- 172.21.15.47:0/2720902737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e640fe1e0 msgr2=0x7f7e640702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.506+0000 7f7e68816700 1 --2- 172.21.15.47:0/2720902737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e640fe1e0 0x7f7e640702e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009fd0 tx=0x7f7e4c009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:21.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.506+0000 7f7e68816700 1 -- 172.21.15.47:0/2720902737 shutdown_connections 2024-02-07T12:33:21.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.506+0000 7f7e68816700 1 --2- 172.21.15.47:0/2720902737 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f7e5006d7f0 0x7f7e5006fca0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.506+0000 7f7e68816700 1 --2- 172.21.15.47:0/2720902737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e640fcf30 0x7f7e64071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.506+0000 7f7e68816700 1 --2- 172.21.15.47:0/2720902737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e640fe1e0 0x7f7e640702e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.506+0000 7f7e68816700 1 -- 172.21.15.47:0/2720902737 >> 172.21.15.47:0/2720902737 conn(0x7f7e640f86b0 msgr2=0x7f7e64101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:21.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.507+0000 7f7e68816700 1 -- 172.21.15.47:0/2720902737 shutdown_connections 2024-02-07T12:33:21.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.507+0000 7f7e68816700 1 -- 172.21.15.47:0/2720902737 wait complete. 2024-02-07T12:33:21.511 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 26 2024-02-07T12:33:21.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.609+0000 7fe0d7744700 1 -- 172.21.15.47:0/449418210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d00fb2c0 msgr2=0x7fe0d00fb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:21.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.609+0000 7fe0d7744700 1 --2- 172.21.15.47:0/449418210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d00fb2c0 0x7fe0d00fb6d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc004940 tx=0x7fe0cc009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:21.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d7744700 1 -- 172.21.15.47:0/449418210 shutdown_connections 2024-02-07T12:33:21.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d7744700 1 --2- 172.21.15.47:0/449418210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0d00fbca0 0x7fe0d00fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d7744700 1 --2- 172.21.15.47:0/449418210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d00fb2c0 0x7fe0d00fb6d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d7744700 1 -- 172.21.15.47:0/449418210 >> 172.21.15.47:0/449418210 conn(0x7fe0d00f6ca0 msgr2=0x7fe0d00f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:21.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d7744700 1 -- 172.21.15.47:0/449418210 shutdown_connections 2024-02-07T12:33:21.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d7744700 1 -- 172.21.15.47:0/449418210 wait complete. 2024-02-07T12:33:21.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d7744700 1 Processor -- start 2024-02-07T12:33:21.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d7744700 1 -- start start 2024-02-07T12:33:21.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d7744700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0d00fb2c0 0x7fe0d010feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:21.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d7744700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d01103f0 0x7fe0d0111290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:21.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d7744700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d01108b0 con 0x7fe0d01103f0 2024-02-07T12:33:21.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d7744700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d01109f0 con 0x7fe0d00fb2c0 2024-02-07T12:33:21.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d4cdf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d01103f0 0x7fe0d0111290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:21.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d4cdf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d01103f0 0x7fe0d0111290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35704/0 (socket says 172.21.15.47:35704) 2024-02-07T12:33:21.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.610+0000 7fe0d4cdf700 1 -- 172.21.15.47:0/3937912001 learned_addr learned my addr 172.21.15.47:0/3937912001 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:21.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.611+0000 7fe0d54e0700 1 --2- 172.21.15.47:0/3937912001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0d00fb2c0 0x7fe0d010feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:21.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.611+0000 7fe0d4cdf700 1 -- 172.21.15.47:0/3937912001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0d00fb2c0 msgr2=0x7fe0d010feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:21.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.611+0000 7fe0d4cdf700 1 --2- 172.21.15.47:0/3937912001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0d00fb2c0 0x7fe0d010feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.611+0000 7fe0d4cdf700 1 -- 172.21.15.47:0/3937912001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc005040 con 0x7fe0d01103f0 2024-02-07T12:33:21.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.611+0000 7fe0d4cdf700 1 --2- 172.21.15.47:0/3937912001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d01103f0 0x7fe0d0111290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0002a50 tx=0x7fe0c00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:21.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.611+0000 7fe0c5ffb700 1 -- 172.21.15.47:0/3937912001 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0c0007cc0 con 0x7fe0d01103f0 2024-02-07T12:33:21.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.611+0000 7fe0c5ffb700 1 -- 172.21.15.47:0/3937912001 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0c000f040 con 0x7fe0d01103f0 2024-02-07T12:33:21.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.611+0000 7fe0d7744700 1 -- 172.21.15.47:0/3937912001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d01118f0 con 0x7fe0d01103f0 2024-02-07T12:33:21.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.611+0000 7fe0c5ffb700 1 -- 172.21.15.47:0/3937912001 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0c000db70 con 0x7fe0d01103f0 2024-02-07T12:33:21.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.611+0000 7fe0d7744700 1 -- 172.21.15.47:0/3937912001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d0111e00 con 0x7fe0d01103f0 2024-02-07T12:33:21.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.612+0000 7fe0d7744700 1 -- 172.21.15.47:0/3937912001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d01025b0 con 0x7fe0d01103f0 2024-02-07T12:33:21.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.613+0000 7fe0c5ffb700 1 -- 172.21.15.47:0/3937912001 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe0c000dd10 con 0x7fe0d01103f0 2024-02-07T12:33:21.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.613+0000 7fe0c5ffb700 1 --2- 172.21.15.47:0/3937912001 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe0bc06d7e0 0x7fe0bc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:21.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.613+0000 7fe0c5ffb700 1 -- 172.21.15.47:0/3937912001 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe0c008c5e0 con 0x7fe0d01103f0 2024-02-07T12:33:21.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.613+0000 7fe0d54e0700 1 --2- 172.21.15.47:0/3937912001 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe0bc06d7e0 0x7fe0bc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:21.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.613+0000 7fe0d54e0700 1 --2- 172.21.15.47:0/3937912001 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe0bc06d7e0 0x7fe0bc06fc90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc004f90 tx=0x7fe0cc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:21.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.618+0000 7fe0c5ffb700 1 -- 172.21.15.47:0/3937912001 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe0c0059960 con 0x7fe0d01103f0 2024-02-07T12:33:21.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:21 smithi138 ceph-mon[82055]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:21 smithi138 ceph-mon[82055]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:21.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:21 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2092682996' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:21.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:21 smithi047 ceph-mon[93224]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:21.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:21 smithi047 ceph-mon[93224]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:21.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:21 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2092682996' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:21.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.845+0000 7fe0d7744700 1 -- 172.21.15.47:0/3937912001 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0d0105c90 con 0x7fe0bc06d7e0 2024-02-07T12:33:21.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.846+0000 7fe0c5ffb700 1 -- 172.21.15.47:0/3937912001 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe0d0105c90 con 0x7fe0bc06d7e0 2024-02-07T12:33:21.848 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:33:21.848 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:33:21.848 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:33:21.848 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:33:21.848 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:33:21.848 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-02-07T12:33:21.848 INFO:teuthology.orchestra.run.smithi047.stdout: "osd", 2024-02-07T12:33:21.848 INFO:teuthology.orchestra.run.smithi047.stdout: "mon", 2024-02-07T12:33:21.848 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr" 2024-02-07T12:33:21.848 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:33:21.848 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "12/21 daemons upgraded", 2024-02-07T12:33:21.849 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading osd daemons", 2024-02-07T12:33:21.849 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:33:21.849 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:33:21.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.848+0000 7fe0d7744700 1 -- 172.21.15.47:0/3937912001 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe0bc06d7e0 msgr2=0x7fe0bc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:21.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.848+0000 7fe0d7744700 1 --2- 172.21.15.47:0/3937912001 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe0bc06d7e0 0x7fe0bc06fc90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc004f90 tx=0x7fe0cc009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:21.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.848+0000 7fe0d7744700 1 -- 172.21.15.47:0/3937912001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d01103f0 msgr2=0x7fe0d0111290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:21.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.848+0000 7fe0d7744700 1 --2- 172.21.15.47:0/3937912001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d01103f0 0x7fe0d0111290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0002a50 tx=0x7fe0c00046b0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.848+0000 7fe0d7744700 1 -- 172.21.15.47:0/3937912001 shutdown_connections 2024-02-07T12:33:21.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.848+0000 7fe0d7744700 1 --2- 172.21.15.47:0/3937912001 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe0bc06d7e0 0x7fe0bc06fc90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.848+0000 7fe0d7744700 1 --2- 172.21.15.47:0/3937912001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0d00fb2c0 0x7fe0d010feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.848+0000 7fe0d7744700 1 --2- 172.21.15.47:0/3937912001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d01103f0 0x7fe0d0111290 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.848+0000 7fe0d7744700 1 -- 172.21.15.47:0/3937912001 >> 172.21.15.47:0/3937912001 conn(0x7fe0d00f6ca0 msgr2=0x7fe0d00ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:21.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.848+0000 7fe0d7744700 1 -- 172.21.15.47:0/3937912001 shutdown_connections 2024-02-07T12:33:21.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.848+0000 7fe0d7744700 1 -- 172.21.15.47:0/3937912001 wait complete. 2024-02-07T12:33:21.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.950+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3748571534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9440fcef0 msgr2=0x7fb9440fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:21.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.950+0000 7fb94b4b2700 1 --2- 172.21.15.47:0/3748571534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9440fcef0 0x7fb9440fd320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb934004940 tx=0x7fb934009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:21.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.950+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3748571534 shutdown_connections 2024-02-07T12:33:21.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.950+0000 7fb94b4b2700 1 --2- 172.21.15.47:0/3748571534 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9440fe0e0 0x7fb9440fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.950+0000 7fb94b4b2700 1 --2- 172.21.15.47:0/3748571534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9440fcef0 0x7fb9440fd320 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.950+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3748571534 >> 172.21.15.47:0/3748571534 conn(0x7fb9440f8620 msgr2=0x7fb9440faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:21.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.950+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3748571534 shutdown_connections 2024-02-07T12:33:21.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.950+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3748571534 wait complete. 2024-02-07T12:33:21.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb94b4b2700 1 Processor -- start 2024-02-07T12:33:21.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb94b4b2700 1 -- start start 2024-02-07T12:33:21.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb94b4b2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9440fcef0 0x7fb944071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:21.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb94b4b2700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9440fe0e0 0x7fb9440702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:21.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb94b4b2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9440708e0 con 0x7fb9440fcef0 2024-02-07T12:33:21.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb94b4b2700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb944070a50 con 0x7fb9440fe0e0 2024-02-07T12:33:21.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb94924e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9440fcef0 0x7fb944071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:21.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb94924e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9440fcef0 0x7fb944071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35710/0 (socket says 172.21.15.47:35710) 2024-02-07T12:33:21.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb94924e700 1 -- 172.21.15.47:0/3070821521 learned_addr learned my addr 172.21.15.47:0/3070821521 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:21.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb948a4d700 1 --2- 172.21.15.47:0/3070821521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9440fe0e0 0x7fb9440702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:21.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb94924e700 1 -- 172.21.15.47:0/3070821521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9440fe0e0 msgr2=0x7fb9440702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:21.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb94924e700 1 --2- 172.21.15.47:0/3070821521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9440fe0e0 0x7fb9440702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:21.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb94924e700 1 -- 172.21.15.47:0/3070821521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb934005040 con 0x7fb9440fcef0 2024-02-07T12:33:21.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.951+0000 7fb948a4d700 1 --2- 172.21.15.47:0/3070821521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9440fe0e0 0x7fb9440702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:33:21.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.952+0000 7fb94924e700 1 --2- 172.21.15.47:0/3070821521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9440fcef0 0x7fb944071e60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb93400b3b0 tx=0x7fb934009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:21.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.952+0000 7fb939ffb700 1 -- 172.21.15.47:0/3070821521 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93400e040 con 0x7fb9440fcef0 2024-02-07T12:33:21.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.952+0000 7fb939ffb700 1 -- 172.21.15.47:0/3070821521 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb93400bcc0 con 0x7fb9440fcef0 2024-02-07T12:33:21.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.952+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3070821521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb944070cd0 con 0x7fb9440fcef0 2024-02-07T12:33:21.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.952+0000 7fb939ffb700 1 -- 172.21.15.47:0/3070821521 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93401c630 con 0x7fb9440fcef0 2024-02-07T12:33:21.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.952+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3070821521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9441159a0 con 0x7fb9440fcef0 2024-02-07T12:33:21.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.953+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3070821521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94404bed0 con 0x7fb9440fcef0 2024-02-07T12:33:21.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.953+0000 7fb939ffb700 1 -- 172.21.15.47:0/3070821521 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb9340139f0 con 0x7fb9440fcef0 2024-02-07T12:33:21.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.954+0000 7fb939ffb700 1 --2- 172.21.15.47:0/3070821521 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb93006d7e0 0x7fb93006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:21.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.954+0000 7fb939ffb700 1 -- 172.21.15.47:0/3070821521 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb93408e340 con 0x7fb9440fcef0 2024-02-07T12:33:21.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.954+0000 7fb948a4d700 1 --2- 172.21.15.47:0/3070821521 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb93006d7e0 0x7fb93006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:21.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.954+0000 7fb948a4d700 1 --2- 172.21.15.47:0/3070821521 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb93006d7e0 0x7fb93006fc90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb940009fd0 tx=0x7fb940009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:21.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:21.958+0000 7fb939ffb700 1 -- 172.21.15.47:0/3070821521 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb93405b740 con 0x7fb9440fcef0 2024-02-07T12:33:22.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:22.245+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3070821521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb944115d10 con 0x7fb9440fcef0 2024-02-07T12:33:22.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:22.245+0000 7fb939ffb700 1 -- 172.21.15.47:0/3070821521 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb93405b2d0 con 0x7fb9440fcef0 2024-02-07T12:33:22.248 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:33:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:22.247+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3070821521 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb93006d7e0 msgr2=0x7fb93006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:22.247+0000 7fb94b4b2700 1 --2- 172.21.15.47:0/3070821521 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb93006d7e0 0x7fb93006fc90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb940009fd0 tx=0x7fb940009ee0 comp rx=0 tx=0).stop 2024-02-07T12:33:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:22.247+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3070821521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9440fcef0 msgr2=0x7fb944071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:22.247+0000 7fb94b4b2700 1 --2- 172.21.15.47:0/3070821521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9440fcef0 0x7fb944071e60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb93400b3b0 tx=0x7fb934009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:22.248+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3070821521 shutdown_connections 2024-02-07T12:33:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:22.248+0000 7fb94b4b2700 1 --2- 172.21.15.47:0/3070821521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9440fcef0 0x7fb944071e60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:22.248+0000 7fb94b4b2700 1 --2- 172.21.15.47:0/3070821521 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb93006d7e0 0x7fb93006fc90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:22.248+0000 7fb94b4b2700 1 --2- 172.21.15.47:0/3070821521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9440fe0e0 0x7fb9440702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:22.248+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3070821521 >> 172.21.15.47:0/3070821521 conn(0x7fb9440f8620 msgr2=0x7fb9441013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:22.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:22.248+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3070821521 shutdown_connections 2024-02-07T12:33:22.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:22.248+0000 7fb94b4b2700 1 -- 172.21.15.47:0/3070821521 wait complete. 2024-02-07T12:33:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:22 smithi047 ceph-mon[93224]: pgmap v182: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-02-07T12:33:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:22 smithi047 ceph-mon[93224]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:22 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2720902737' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:33:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:22 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3070821521' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:33:22.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:22 smithi138 ceph-mon[82055]: pgmap v182: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-02-07T12:33:22.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:22 smithi138 ceph-mon[82055]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:22.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:22 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2720902737' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:33:22.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:22 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3070821521' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:33:23.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:23 smithi138 ceph-mon[82055]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:23.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:23 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:23.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:23 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:33:23.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:23 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:33:23.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:23 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:23 smithi047 ceph-mon[93224]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:23 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:23 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:33:23.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:23 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:33:23.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:23 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:24.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:24 smithi138 ceph-mon[82055]: pgmap v183: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 4 op/s 2024-02-07T12:33:24.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:24 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:24.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:24 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:24.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:24 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:24.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:24 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:24.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:24 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:24.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:24 smithi138 ceph-mon[82055]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-07T12:33:24.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:24 smithi138 ceph-mon[82055]: daemon mds.cephfs.smithi047.jsgfge finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-02-07T12:33:24.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:24 smithi047 ceph-mon[93224]: pgmap v183: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 4 op/s 2024-02-07T12:33:24.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:24 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:24.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:24 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:24.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:24 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:24.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:24 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:24.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:24 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:24.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:24 smithi047 ceph-mon[93224]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-07T12:33:24.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:24 smithi047 ceph-mon[93224]: daemon mds.cephfs.smithi047.jsgfge finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-02-07T12:33:25.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:25 smithi138 ceph-mon[82055]: mds.1 [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] down:stopped 2024-02-07T12:33:25.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:25 smithi138 ceph-mon[82055]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 2 up:standby 2024-02-07T12:33:25.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:25 smithi047 ceph-mon[93224]: mds.1 [v2:172.21.15.47:6828/1833631011,v1:172.21.15.47:6829/1833631011] down:stopped 2024-02-07T12:33:25.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:25 smithi047 ceph-mon[93224]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 2 up:standby 2024-02-07T12:33:26.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:26 smithi138 ceph-mon[82055]: pgmap v184: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-02-07T12:33:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:26 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.47:6828/3387805936,v1:172.21.15.47:6829/3387805936] up:boot 2024-02-07T12:33:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:26 smithi138 ceph-mon[82055]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 3 up:standby 2024-02-07T12:33:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:33:26.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:26 smithi047 ceph-mon[93224]: pgmap v184: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-02-07T12:33:26.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:26 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.47:6828/3387805936,v1:172.21.15.47:6829/3387805936] up:boot 2024-02-07T12:33:26.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:26 smithi047 ceph-mon[93224]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 3 up:standby 2024-02-07T12:33:26.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:33:27.765 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:33:27.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:33:28.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:28 smithi138 ceph-mon[82055]: pgmap v185: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-02-07T12:33:28.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:28 smithi047 ceph-mon[93224]: pgmap v185: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-02-07T12:33:30.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:30 smithi138 ceph-mon[82055]: pgmap v186: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-07T12:33:30.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:30 smithi047 ceph-mon[93224]: pgmap v186: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-07T12:33:32.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:32 smithi138 ceph-mon[82055]: pgmap v187: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-07T12:33:32.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:32 smithi047 ceph-mon[93224]: pgmap v187: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-07T12:33:34.513 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:34 smithi047 ceph-mon[93224]: pgmap v188: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-07T12:33:34.513 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:34 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:34.513 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:34 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:33:34.513 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:34 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:33:34.513 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:34 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:34.513 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:34 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:34.513 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:34 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:34.513 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:34 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:34.513 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:34 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:34.514 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:34 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:34.514 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:34 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi047.lagmef"]}]: dispatch 2024-02-07T12:33:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:34 smithi138 ceph-mon[82055]: pgmap v188: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-07T12:33:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:34 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:34 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:33:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:34 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:33:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:34 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:34 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:34 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:34 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:34.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:34 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:34.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:34 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:34.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:34 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi047.lagmef"]}]: dispatch 2024-02-07T12:33:35.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:35 smithi047 ceph-mon[93224]: Upgrade: It appears safe to stop mds.cephfs.smithi047.lagmef 2024-02-07T12:33:35.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:35 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:35.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:35 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.lagmef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:33:35.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:35 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:33:35.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:35 smithi138 ceph-mon[82055]: Upgrade: It appears safe to stop mds.cephfs.smithi047.lagmef 2024-02-07T12:33:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:35 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:35 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.lagmef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:33:35.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:35 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:33:36.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:36 smithi138 ceph-mon[82055]: pgmap v189: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:33:36.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:36 smithi138 ceph-mon[82055]: Upgrade: Updating mds.cephfs.smithi047.lagmef 2024-02-07T12:33:36.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:36 smithi138 ceph-mon[82055]: Deploying daemon mds.cephfs.smithi047.lagmef on smithi047 2024-02-07T12:33:36.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:36 smithi047 ceph-mon[93224]: pgmap v189: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:33:36.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:36 smithi047 ceph-mon[93224]: Upgrade: Updating mds.cephfs.smithi047.lagmef 2024-02-07T12:33:36.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:36 smithi047 ceph-mon[93224]: Deploying daemon mds.cephfs.smithi047.lagmef on smithi047 2024-02-07T12:33:37.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:37 smithi138 ceph-mon[82055]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-07T12:33:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:37 smithi138 ceph-mon[82055]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-07T12:33:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:37 smithi138 ceph-mon[82055]: osdmap e83: 6 total, 6 up, 6 in 2024-02-07T12:33:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:37 smithi138 ceph-mon[82055]: Standby daemon mds.cephfs.smithi047.jsgfge assigned to filesystem cephfs as rank 0 2024-02-07T12:33:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:37 smithi138 ceph-mon[82055]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-07T12:33:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:37 smithi138 ceph-mon[82055]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-07T12:33:37.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:37 smithi138 ceph-mon[82055]: fsmap cephfs:1/1 {0=cephfs.smithi047.jsgfge=up:replay} 2 up:standby 2024-02-07T12:33:37.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:37 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047[93220]: 2024-02-07T12:33:37.430+0000 7fb487509700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-07T12:33:37.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:37 smithi047 ceph-mon[93224]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-07T12:33:37.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:37 smithi047 ceph-mon[93224]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-07T12:33:37.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:37 smithi047 ceph-mon[93224]: osdmap e83: 6 total, 6 up, 6 in 2024-02-07T12:33:37.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:37 smithi047 ceph-mon[93224]: Standby daemon mds.cephfs.smithi047.jsgfge assigned to filesystem cephfs as rank 0 2024-02-07T12:33:37.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:37 smithi047 ceph-mon[93224]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-07T12:33:37.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:37 smithi047 ceph-mon[93224]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-07T12:33:37.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:37 smithi047 ceph-mon[93224]: fsmap cephfs:1/1 {0=cephfs.smithi047.jsgfge=up:replay} 2 up:standby 2024-02-07T12:33:38.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:38 smithi138 ceph-mon[82055]: pgmap v190: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:33:38.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:38 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:33:38.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:38 smithi047 ceph-mon[93224]: pgmap v190: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:33:38.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:38 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:33:40.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:40 smithi138 ceph-mon[82055]: pgmap v192: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:33:40.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:40 smithi047 ceph-mon[93224]: pgmap v192: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:33:42.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:42 smithi138 ceph-mon[82055]: pgmap v193: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 7.6 MiB/s rd, 2 op/s 2024-02-07T12:33:42.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:42.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:33:42.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:42 smithi047 ceph-mon[93224]: pgmap v193: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 7.6 MiB/s rd, 2 op/s 2024-02-07T12:33:42.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:42.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:33:44.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:44 smithi138 ceph-mon[82055]: pgmap v194: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-02-07T12:33:44.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:44 smithi047 ceph-mon[93224]: pgmap v194: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-02-07T12:33:46.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:46 smithi047 ceph-mon[93224]: pgmap v195: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-02-07T12:33:46.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:46 smithi047 ceph-mon[93224]: reconnect by client.14524 v1:192.168.0.1:0/1195374876 after 0 2024-02-07T12:33:46.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:46 smithi047 ceph-mon[93224]: reconnect by client.24291 v1:192.168.0.1:0/1103379993 after 0.000999979 2024-02-07T12:33:46.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:46 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.47:6828/3387805936,v1:172.21.15.47:6829/3387805936] up:reconnect 2024-02-07T12:33:46.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:46 smithi047 ceph-mon[93224]: fsmap cephfs:1/1 {0=cephfs.smithi047.jsgfge=up:reconnect} 2 up:standby 2024-02-07T12:33:47.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:46 smithi138 ceph-mon[82055]: pgmap v195: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-02-07T12:33:47.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:46 smithi138 ceph-mon[82055]: reconnect by client.14524 v1:192.168.0.1:0/1195374876 after 0 2024-02-07T12:33:47.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:46 smithi138 ceph-mon[82055]: reconnect by client.24291 v1:192.168.0.1:0/1103379993 after 0.000999979 2024-02-07T12:33:47.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:46 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.47:6828/3387805936,v1:172.21.15.47:6829/3387805936] up:reconnect 2024-02-07T12:33:47.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:46 smithi138 ceph-mon[82055]: fsmap cephfs:1/1 {0=cephfs.smithi047.jsgfge=up:reconnect} 2 up:standby 2024-02-07T12:33:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:47 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.47:6828/3387805936,v1:172.21.15.47:6829/3387805936] up:rejoin 2024-02-07T12:33:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:47 smithi047 ceph-mon[93224]: fsmap cephfs:1/1 {0=cephfs.smithi047.jsgfge=up:rejoin} 2 up:standby 2024-02-07T12:33:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:47 smithi047 ceph-mon[93224]: daemon mds.cephfs.smithi047.jsgfge is now active in filesystem cephfs as rank 0 2024-02-07T12:33:48.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:47 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.47:6828/3387805936,v1:172.21.15.47:6829/3387805936] up:rejoin 2024-02-07T12:33:48.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:47 smithi138 ceph-mon[82055]: fsmap cephfs:1/1 {0=cephfs.smithi047.jsgfge=up:rejoin} 2 up:standby 2024-02-07T12:33:48.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:47 smithi138 ceph-mon[82055]: daemon mds.cephfs.smithi047.jsgfge is now active in filesystem cephfs as rank 0 2024-02-07T12:33:48.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:48 smithi047 ceph-mon[93224]: pgmap v196: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-07T12:33:48.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:48 smithi047 ceph-mon[93224]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-07T12:33:48.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:48 smithi047 ceph-mon[93224]: Cluster is now healthy 2024-02-07T12:33:48.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:48 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.47:6828/3387805936,v1:172.21.15.47:6829/3387805936] up:active 2024-02-07T12:33:48.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:48 smithi047 ceph-mon[93224]: fsmap cephfs:1 {0=cephfs.smithi047.jsgfge=up:active} 2 up:standby 2024-02-07T12:33:49.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:48 smithi138 ceph-mon[82055]: pgmap v196: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-07T12:33:49.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:48 smithi138 ceph-mon[82055]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-07T12:33:49.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:48 smithi138 ceph-mon[82055]: Cluster is now healthy 2024-02-07T12:33:49.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:48 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.47:6828/3387805936,v1:172.21.15.47:6829/3387805936] up:active 2024-02-07T12:33:49.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:48 smithi138 ceph-mon[82055]: fsmap cephfs:1 {0=cephfs.smithi047.jsgfge=up:active} 2 up:standby 2024-02-07T12:33:50.502 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:50 smithi047 ceph-mon[93224]: pgmap v197: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-02-07T12:33:50.502 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:50 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:50.502 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:50 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:50.502 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:50 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:50.502 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:50 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] up:boot 2024-02-07T12:33:50.502 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:50 smithi047 ceph-mon[93224]: fsmap cephfs:1 {0=cephfs.smithi047.jsgfge=up:active} 3 up:standby 2024-02-07T12:33:50.502 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:50 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:33:50.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:50 smithi138 ceph-mon[82055]: pgmap v197: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-02-07T12:33:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:50 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:50 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:50 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:33:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:50 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] up:boot 2024-02-07T12:33:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:50 smithi138 ceph-mon[82055]: fsmap cephfs:1 {0=cephfs.smithi047.jsgfge=up:active} 3 up:standby 2024-02-07T12:33:50.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:50 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:33:52.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.351+0000 7f3f43b38700 1 -- 172.21.15.47:0/458269252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f3c0fcfb0 msgr2=0x7f3f3c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:52.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.351+0000 7f3f43b38700 1 --2- 172.21.15.47:0/458269252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f3c0fcfb0 0x7f3f3c0fd420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f30004940 tx=0x7f3f30009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:52.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.351+0000 7f3f43b38700 1 -- 172.21.15.47:0/458269252 shutdown_connections 2024-02-07T12:33:52.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.351+0000 7f3f43b38700 1 --2- 172.21.15.47:0/458269252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f3c0fcfb0 0x7f3f3c0fd420 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:52.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.351+0000 7f3f43b38700 1 --2- 172.21.15.47:0/458269252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f3c0fbe40 0x7f3f3c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:52.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.351+0000 7f3f43b38700 1 -- 172.21.15.47:0/458269252 >> 172.21.15.47:0/458269252 conn(0x7f3f3c0f7520 msgr2=0x7f3f3c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:52.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.351+0000 7f3f43b38700 1 -- 172.21.15.47:0/458269252 shutdown_connections 2024-02-07T12:33:52.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.352+0000 7f3f43b38700 1 -- 172.21.15.47:0/458269252 wait complete. 2024-02-07T12:33:52.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.352+0000 7f3f43b38700 1 Processor -- start 2024-02-07T12:33:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.352+0000 7f3f43b38700 1 -- start start 2024-02-07T12:33:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.352+0000 7f3f43b38700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f3c0fbe40 0x7f3f3c10d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.352+0000 7f3f43b38700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f3c0fcfb0 0x7f3f3c10de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.352+0000 7f3f43b38700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c10e490 con 0x7f3f3c0fbe40 2024-02-07T12:33:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.352+0000 7f3f43b38700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c10ed30 con 0x7f3f3c0fcfb0 2024-02-07T12:33:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.352+0000 7f3f418d4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f3c0fbe40 0x7f3f3c10d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.352+0000 7f3f418d4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f3c0fbe40 0x7f3f3c10d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56220/0 (socket says 172.21.15.47:56220) 2024-02-07T12:33:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.352+0000 7f3f418d4700 1 -- 172.21.15.47:0/1113559604 learned_addr learned my addr 172.21.15.47:0/1113559604 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.352+0000 7f3f410d3700 1 --2- 172.21.15.47:0/1113559604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f3c0fcfb0 0x7f3f3c10de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.353+0000 7f3f418d4700 1 -- 172.21.15.47:0/1113559604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f3c0fcfb0 msgr2=0x7f3f3c10de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.353+0000 7f3f418d4700 1 --2- 172.21.15.47:0/1113559604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f3c0fcfb0 0x7f3f3c10de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.353+0000 7f3f418d4700 1 -- 172.21.15.47:0/1113559604 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f30005040 con 0x7f3f3c0fbe40 2024-02-07T12:33:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.353+0000 7f3f418d4700 1 --2- 172.21.15.47:0/1113559604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f3c0fbe40 0x7f3f3c10d950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400c830 tx=0x7f3f34004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.353+0000 7f3f3a7fc700 1 -- 172.21.15.47:0/1113559604 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f340106f0 con 0x7f3f3c0fbe40 2024-02-07T12:33:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.353+0000 7f3f3a7fc700 1 -- 172.21.15.47:0/1113559604 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f34010d20 con 0x7f3f3c0fbe40 2024-02-07T12:33:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.353+0000 7f3f43b38700 1 -- 172.21.15.47:0/1113559604 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3c10f010 con 0x7f3f3c0fbe40 2024-02-07T12:33:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.353+0000 7f3f3a7fc700 1 -- 172.21.15.47:0/1113559604 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f340113a0 con 0x7f3f3c0fbe40 2024-02-07T12:33:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.353+0000 7f3f43b38700 1 -- 172.21.15.47:0/1113559604 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3c10f550 con 0x7f3f3c0fbe40 2024-02-07T12:33:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.354+0000 7f3f43b38700 1 -- 172.21.15.47:0/1113559604 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3c04bed0 con 0x7f3f3c0fbe40 2024-02-07T12:33:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.354+0000 7f3f3a7fc700 1 -- 172.21.15.47:0/1113559604 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f3f34012400 con 0x7f3f3c0fbe40 2024-02-07T12:33:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.355+0000 7f3f3a7fc700 1 --2- 172.21.15.47:0/1113559604 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3f2406d7e0 0x7f3f2406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.355+0000 7f3f3a7fc700 1 -- 172.21.15.47:0/1113559604 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3f3408ce00 con 0x7f3f3c0fbe40 2024-02-07T12:33:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.355+0000 7f3f410d3700 1 --2- 172.21.15.47:0/1113559604 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3f2406d7e0 0x7f3f2406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.355+0000 7f3f410d3700 1 --2- 172.21.15.47:0/1113559604 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3f2406d7e0 0x7f3f2406fc90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000b3b0 tx=0x7f3f30009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.360+0000 7f3f3a7fc700 1 -- 172.21.15.47:0/1113559604 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3f3405a240 con 0x7f3f3c0fbe40 2024-02-07T12:33:52.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.606+0000 7f3f43b38700 1 -- 172.21.15.47:0/1113559604 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f3c10fa20 con 0x7f3f2406d7e0 2024-02-07T12:33:52.610 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:52 smithi047 ceph-mon[93224]: pgmap v198: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-02-07T12:33:52.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.607+0000 7f3f3a7fc700 1 -- 172.21.15.47:0/1113559604 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3f3c10fa20 con 0x7f3f2406d7e0 2024-02-07T12:33:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.609+0000 7f3f43b38700 1 -- 172.21.15.47:0/1113559604 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3f2406d7e0 msgr2=0x7f3f2406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.609+0000 7f3f43b38700 1 --2- 172.21.15.47:0/1113559604 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3f2406d7e0 0x7f3f2406fc90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000b3b0 tx=0x7f3f30009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.609+0000 7f3f43b38700 1 -- 172.21.15.47:0/1113559604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f3c0fbe40 msgr2=0x7f3f3c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.609+0000 7f3f43b38700 1 --2- 172.21.15.47:0/1113559604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f3c0fbe40 0x7f3f3c10d950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400c830 tx=0x7f3f34004470 comp rx=0 tx=0).stop 2024-02-07T12:33:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.610+0000 7f3f43b38700 1 -- 172.21.15.47:0/1113559604 shutdown_connections 2024-02-07T12:33:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.610+0000 7f3f43b38700 1 --2- 172.21.15.47:0/1113559604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f3c0fbe40 0x7f3f3c10d950 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.610+0000 7f3f43b38700 1 --2- 172.21.15.47:0/1113559604 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3f2406d7e0 0x7f3f2406fc90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.610+0000 7f3f43b38700 1 --2- 172.21.15.47:0/1113559604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f3c0fcfb0 0x7f3f3c10de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.610+0000 7f3f43b38700 1 -- 172.21.15.47:0/1113559604 >> 172.21.15.47:0/1113559604 conn(0x7f3f3c0f7520 msgr2=0x7f3f3c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:52.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.610+0000 7f3f43b38700 1 -- 172.21.15.47:0/1113559604 shutdown_connections 2024-02-07T12:33:52.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.610+0000 7f3f43b38700 1 -- 172.21.15.47:0/1113559604 wait complete. 2024-02-07T12:33:52.623 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:33:52.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.715+0000 7f5135aef700 1 -- 172.21.15.47:0/644478485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51300fcef0 msgr2=0x7f51300fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:52.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.715+0000 7f5135aef700 1 --2- 172.21.15.47:0/644478485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51300fcef0 0x7f51300fd320 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5120004940 tx=0x7f5120009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:52.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.715+0000 7f5135aef700 1 -- 172.21.15.47:0/644478485 shutdown_connections 2024-02-07T12:33:52.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.715+0000 7f5135aef700 1 --2- 172.21.15.47:0/644478485 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51300fe0e0 0x7f51300fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:52.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.715+0000 7f5135aef700 1 --2- 172.21.15.47:0/644478485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51300fcef0 0x7f51300fd320 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:52.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.715+0000 7f5135aef700 1 -- 172.21.15.47:0/644478485 >> 172.21.15.47:0/644478485 conn(0x7f51300f8620 msgr2=0x7f51300faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:52.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.715+0000 7f5135aef700 1 -- 172.21.15.47:0/644478485 shutdown_connections 2024-02-07T12:33:52.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.715+0000 7f5135aef700 1 -- 172.21.15.47:0/644478485 wait complete. 2024-02-07T12:33:52.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.715+0000 7f5135aef700 1 Processor -- start 2024-02-07T12:33:52.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.715+0000 7f5135aef700 1 -- start start 2024-02-07T12:33:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f5135aef700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51300fcef0 0x7f513010d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f5135aef700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51300fe0e0 0x7f513010deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f5135aef700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513010e4b0 con 0x7f51300fe0e0 2024-02-07T12:33:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f5135aef700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513010ed50 con 0x7f51300fcef0 2024-02-07T12:33:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f512effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51300fe0e0 0x7f513010deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f512effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51300fe0e0 0x7f513010deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56236/0 (socket says 172.21.15.47:56236) 2024-02-07T12:33:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f512effd700 1 -- 172.21.15.47:0/1610910529 learned_addr learned my addr 172.21.15.47:0/1610910529 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f512f7fe700 1 --2- 172.21.15.47:0/1610910529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51300fcef0 0x7f513010d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f512effd700 1 -- 172.21.15.47:0/1610910529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51300fcef0 msgr2=0x7f513010d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f512effd700 1 --2- 172.21.15.47:0/1610910529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51300fcef0 0x7f513010d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f512effd700 1 -- 172.21.15.47:0/1610910529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5120005040 con 0x7f51300fe0e0 2024-02-07T12:33:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f512effd700 1 --2- 172.21.15.47:0/1610910529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51300fe0e0 0x7f513010deb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5124002a50 tx=0x7f51240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f5117fff700 1 -- 172.21.15.47:0/1610910529 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5124007cc0 con 0x7f51300fe0e0 2024-02-07T12:33:52.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f5117fff700 1 -- 172.21.15.47:0/1610910529 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f512400f040 con 0x7f51300fe0e0 2024-02-07T12:33:52.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f5135aef700 1 -- 172.21.15.47:0/1610910529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513010f030 con 0x7f51300fe0e0 2024-02-07T12:33:52.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f5117fff700 1 -- 172.21.15.47:0/1610910529 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512400da30 con 0x7f51300fe0e0 2024-02-07T12:33:52.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.716+0000 7f5135aef700 1 -- 172.21.15.47:0/1610910529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513010f570 con 0x7f51300fe0e0 2024-02-07T12:33:52.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.717+0000 7f5135aef700 1 -- 172.21.15.47:0/1610910529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513004bed0 con 0x7f51300fe0e0 2024-02-07T12:33:52.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.718+0000 7f5117fff700 1 -- 172.21.15.47:0/1610910529 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f512400db90 con 0x7f51300fe0e0 2024-02-07T12:33:52.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.718+0000 7f5117fff700 1 --2- 172.21.15.47:0/1610910529 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f511806d7e0 0x7f511806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:52.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.719+0000 7f512f7fe700 1 --2- 172.21.15.47:0/1610910529 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f511806d7e0 0x7f511806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:52.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.719+0000 7f5117fff700 1 -- 172.21.15.47:0/1610910529 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f512408ccd0 con 0x7f51300fe0e0 2024-02-07T12:33:52.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.719+0000 7f512f7fe700 1 --2- 172.21.15.47:0/1610910529 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f511806d7e0 0x7f511806fc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5120004890 tx=0x7f5120009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:52.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.723+0000 7f5117fff700 1 -- 172.21.15.47:0/1610910529 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5124059ff0 con 0x7f51300fe0e0 2024-02-07T12:33:52.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:52 smithi138 ceph-mon[82055]: pgmap v198: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-02-07T12:33:52.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.969+0000 7f5135aef700 1 -- 172.21.15.47:0/1610910529 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f513010f9c0 con 0x7f511806d7e0 2024-02-07T12:33:52.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.971+0000 7f5117fff700 1 -- 172.21.15.47:0/1610910529 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f513010f9c0 con 0x7f511806d7e0 2024-02-07T12:33:52.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.973+0000 7f5135aef700 1 -- 172.21.15.47:0/1610910529 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f511806d7e0 msgr2=0x7f511806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:52.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.974+0000 7f5135aef700 1 --2- 172.21.15.47:0/1610910529 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f511806d7e0 0x7f511806fc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5120004890 tx=0x7f5120009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:52.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.974+0000 7f5135aef700 1 -- 172.21.15.47:0/1610910529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51300fe0e0 msgr2=0x7f513010deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:52.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.974+0000 7f5135aef700 1 --2- 172.21.15.47:0/1610910529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51300fe0e0 0x7f513010deb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5124002a50 tx=0x7f51240046b0 comp rx=0 tx=0).stop 2024-02-07T12:33:52.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.974+0000 7f5135aef700 1 -- 172.21.15.47:0/1610910529 shutdown_connections 2024-02-07T12:33:52.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.974+0000 7f5135aef700 1 --2- 172.21.15.47:0/1610910529 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f511806d7e0 0x7f511806fc90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:52.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.974+0000 7f5135aef700 1 --2- 172.21.15.47:0/1610910529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51300fcef0 0x7f513010d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:52.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.974+0000 7f5135aef700 1 --2- 172.21.15.47:0/1610910529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51300fe0e0 0x7f513010deb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:52.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.974+0000 7f5135aef700 1 -- 172.21.15.47:0/1610910529 >> 172.21.15.47:0/1610910529 conn(0x7f51300f8620 msgr2=0x7f51301013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:52.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.974+0000 7f5135aef700 1 -- 172.21.15.47:0/1610910529 shutdown_connections 2024-02-07T12:33:52.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:52.974+0000 7f5135aef700 1 -- 172.21.15.47:0/1610910529 wait complete. 2024-02-07T12:33:53.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.076+0000 7fe399a19700 1 -- 172.21.15.47:0/1821628957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940fcfb0 msgr2=0x7fe3940fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:53.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.076+0000 7fe399a19700 1 --2- 172.21.15.47:0/1821628957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940fcfb0 0x7fe3940fd420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe37c004940 tx=0x7fe37c009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:53.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.076+0000 7fe399a19700 1 -- 172.21.15.47:0/1821628957 shutdown_connections 2024-02-07T12:33:53.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.076+0000 7fe399a19700 1 --2- 172.21.15.47:0/1821628957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940fcfb0 0x7fe3940fd420 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.076+0000 7fe399a19700 1 --2- 172.21.15.47:0/1821628957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3940fbe40 0x7fe3940fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.076+0000 7fe399a19700 1 -- 172.21.15.47:0/1821628957 >> 172.21.15.47:0/1821628957 conn(0x7fe3940f7500 msgr2=0x7fe3940f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:53.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.076+0000 7fe399a19700 1 -- 172.21.15.47:0/1821628957 shutdown_connections 2024-02-07T12:33:53.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.076+0000 7fe399a19700 1 -- 172.21.15.47:0/1821628957 wait complete. 2024-02-07T12:33:53.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.076+0000 7fe399a19700 1 Processor -- start 2024-02-07T12:33:53.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.076+0000 7fe399a19700 1 -- start start 2024-02-07T12:33:53.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.077+0000 7fe399a19700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3940fbe40 0x7fe3941105a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:53.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.077+0000 7fe399a19700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940fcfb0 0x7fe394112af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:53.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.077+0000 7fe399a19700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe394066d10 con 0x7fe3940fcfb0 2024-02-07T12:33:53.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.077+0000 7fe399a19700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe394066e50 con 0x7fe3940fbe40 2024-02-07T12:33:53.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.077+0000 7fe3927fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940fcfb0 0x7fe394112af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:53.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.077+0000 7fe3927fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940fcfb0 0x7fe394112af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56254/0 (socket says 172.21.15.47:56254) 2024-02-07T12:33:53.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.077+0000 7fe3927fc700 1 -- 172.21.15.47:0/2519727246 learned_addr learned my addr 172.21.15.47:0/2519727246 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.077+0000 7fe392ffd700 1 --2- 172.21.15.47:0/2519727246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3940fbe40 0x7fe3941105a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.077+0000 7fe3927fc700 1 -- 172.21.15.47:0/2519727246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3940fbe40 msgr2=0x7fe3941105a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.077+0000 7fe3927fc700 1 --2- 172.21.15.47:0/2519727246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3940fbe40 0x7fe3941105a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.077+0000 7fe3927fc700 1 -- 172.21.15.47:0/2519727246 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c005040 con 0x7fe3940fcfb0 2024-02-07T12:33:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.077+0000 7fe3927fc700 1 --2- 172.21.15.47:0/2519727246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940fcfb0 0x7fe394112af0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00b3b0 tx=0x7fe37c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.077+0000 7fe38b7fe700 1 -- 172.21.15.47:0/2519727246 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe37c00e040 con 0x7fe3940fcfb0 2024-02-07T12:33:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.078+0000 7fe38b7fe700 1 -- 172.21.15.47:0/2519727246 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe37c00bd90 con 0x7fe3940fcfb0 2024-02-07T12:33:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.078+0000 7fe399a19700 1 -- 172.21.15.47:0/2519727246 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3941130f0 con 0x7fe3940fcfb0 2024-02-07T12:33:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.078+0000 7fe38b7fe700 1 -- 172.21.15.47:0/2519727246 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe37c01c630 con 0x7fe3940fcfb0 2024-02-07T12:33:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.078+0000 7fe399a19700 1 -- 172.21.15.47:0/2519727246 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3941135e0 con 0x7fe3940fcfb0 2024-02-07T12:33:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.078+0000 7fe399a19700 1 -- 172.21.15.47:0/2519727246 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39404bed0 con 0x7fe3940fcfb0 2024-02-07T12:33:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.079+0000 7fe38b7fe700 1 -- 172.21.15.47:0/2519727246 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe37c0139f0 con 0x7fe3940fcfb0 2024-02-07T12:33:53.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.079+0000 7fe38b7fe700 1 --2- 172.21.15.47:0/2519727246 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe38006d7f0 0x7fe38006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:53.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.080+0000 7fe38b7fe700 1 -- 172.21.15.47:0/2519727246 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe37c08e4c0 con 0x7fe3940fcfb0 2024-02-07T12:33:53.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.080+0000 7fe392ffd700 1 --2- 172.21.15.47:0/2519727246 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe38006d7f0 0x7fe38006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:53.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.080+0000 7fe392ffd700 1 --2- 172.21.15.47:0/2519727246 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe38006d7f0 0x7fe38006fca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe394066990 tx=0x7fe38c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:53.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.084+0000 7fe38b7fe700 1 -- 172.21.15.47:0/2519727246 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe37c057c90 con 0x7fe3940fcfb0 2024-02-07T12:33:53.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.303+0000 7fe399a19700 1 -- 172.21.15.47:0/2519727246 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe394101990 con 0x7fe38006d7f0 2024-02-07T12:33:53.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.313+0000 7fe38b7fe700 1 -- 172.21.15.47:0/2519727246 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe394101990 con 0x7fe38006d7f0 2024-02-07T12:33:53.316 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:33:53.316 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (7m) 2m ago 16m 26.6M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:33:53.316 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (4m) 2m ago 16m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:33:53.316 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (4m) 68s ago 15m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (6m) 2m ago 16m 78.4M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (10m) 2m ago 10m 111M - 17.2.7-491-gf2462625 4ad3622d1b31 0ce2675f6d41 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 starting - - - - 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (10m) 68s ago 10m 68.4M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (10m) 68s ago 10m 69.7M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (6m) 2m ago 17m 503M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (5m) 68s ago 15m 452M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (5m) 2m ago 17m 47.4M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (5m) 68s ago 15m 37.7M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (7m) 2m ago 16m 15.1M - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (6m) 68s ago 15m 14.9M - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (4m) 2m ago 14m 87.4M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (3m) 2m ago 14m 98.5M 1559M 19.0.0-1252-g44458cce 79957b372307 0f2b0eea74d7 2024-02-07T12:33:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (2m) 2m ago 13m 12.6M 1559M 19.0.0-1252-g44458cce 79957b372307 0b8c78346346 2024-02-07T12:33:53.318 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (2m) 68s ago 13m 113M 2581M 19.0.0-1252-g44458cce 79957b372307 dea45db021db 2024-02-07T12:33:53.318 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (106s) 68s ago 12m 93.6M 2581M 19.0.0-1252-g44458cce 79957b372307 3161c1dfe6f5 2024-02-07T12:33:53.318 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (72s) 68s ago 12m 12.6M 2581M 19.0.0-1252-g44458cce 79957b372307 c9504c7cfe7c 2024-02-07T12:33:53.318 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (5m) 2m ago 15m 51.5M - 2.43.0 a07b618ecd1d 32840d82c54b 2024-02-07T12:33:53.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.315+0000 7fe399a19700 1 -- 172.21.15.47:0/2519727246 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe38006d7f0 msgr2=0x7fe38006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:53.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.315+0000 7fe399a19700 1 --2- 172.21.15.47:0/2519727246 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe38006d7f0 0x7fe38006fca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe394066990 tx=0x7fe38c00b040 comp rx=0 tx=0).stop 2024-02-07T12:33:53.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.315+0000 7fe399a19700 1 -- 172.21.15.47:0/2519727246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940fcfb0 msgr2=0x7fe394112af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:53.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.315+0000 7fe399a19700 1 --2- 172.21.15.47:0/2519727246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940fcfb0 0x7fe394112af0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00b3b0 tx=0x7fe37c009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:53.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.315+0000 7fe399a19700 1 -- 172.21.15.47:0/2519727246 shutdown_connections 2024-02-07T12:33:53.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.315+0000 7fe399a19700 1 --2- 172.21.15.47:0/2519727246 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe38006d7f0 0x7fe38006fca0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.315+0000 7fe399a19700 1 --2- 172.21.15.47:0/2519727246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3940fbe40 0x7fe3941105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.315+0000 7fe399a19700 1 --2- 172.21.15.47:0/2519727246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940fcfb0 0x7fe394112af0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.315+0000 7fe399a19700 1 -- 172.21.15.47:0/2519727246 >> 172.21.15.47:0/2519727246 conn(0x7fe3940f7500 msgr2=0x7fe394100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:53.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.315+0000 7fe399a19700 1 -- 172.21.15.47:0/2519727246 shutdown_connections 2024-02-07T12:33:53.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.315+0000 7fe399a19700 1 -- 172.21.15.47:0/2519727246 wait complete. 2024-02-07T12:33:53.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.417+0000 7ff2e19bc700 1 -- 172.21.15.47:0/1633525010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2dc0663c0 msgr2=0x7ff2dc0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:53.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.417+0000 7ff2e19bc700 1 --2- 172.21.15.47:0/1633525010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2dc0663c0 0x7ff2dc0ffb10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009ce0 tx=0x7ff2cc004d10 comp rx=0 tx=0).stop 2024-02-07T12:33:53.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.417+0000 7ff2e19bc700 1 -- 172.21.15.47:0/1633525010 shutdown_connections 2024-02-07T12:33:53.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.417+0000 7ff2e19bc700 1 --2- 172.21.15.47:0/1633525010 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2dc1000e0 0x7ff2dc102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.417+0000 7ff2e19bc700 1 --2- 172.21.15.47:0/1633525010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2dc0663c0 0x7ff2dc0ffb10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.417+0000 7ff2e19bc700 1 -- 172.21.15.47:0/1633525010 >> 172.21.15.47:0/1633525010 conn(0x7ff2dc0f74e0 msgr2=0x7ff2dc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:53.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.417+0000 7ff2e19bc700 1 -- 172.21.15.47:0/1633525010 shutdown_connections 2024-02-07T12:33:53.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.417+0000 7ff2e19bc700 1 -- 172.21.15.47:0/1633525010 wait complete. 2024-02-07T12:33:53.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.417+0000 7ff2e19bc700 1 Processor -- start 2024-02-07T12:33:53.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.417+0000 7ff2e19bc700 1 -- start start 2024-02-07T12:33:53.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2e19bc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2dc0663c0 0x7ff2dc10dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:53.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2e19bc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2dc1000e0 0x7ff2dc10e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:53.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2e19bc700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc10e600 con 0x7ff2dc1000e0 2024-02-07T12:33:53.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2e19bc700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc10eea0 con 0x7ff2dc0663c0 2024-02-07T12:33:53.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2da7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2dc1000e0 0x7ff2dc10e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:53.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2da7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2dc1000e0 0x7ff2dc10e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56258/0 (socket says 172.21.15.47:56258) 2024-02-07T12:33:53.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2da7fc700 1 -- 172.21.15.47:0/4211350612 learned_addr learned my addr 172.21.15.47:0/4211350612 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2daffd700 1 --2- 172.21.15.47:0/4211350612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2dc0663c0 0x7ff2dc10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2da7fc700 1 -- 172.21.15.47:0/4211350612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2dc0663c0 msgr2=0x7ff2dc10dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2da7fc700 1 --2- 172.21.15.47:0/4211350612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2dc0663c0 0x7ff2dc10dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2da7fc700 1 -- 172.21.15.47:0/4211350612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc009940 con 0x7ff2dc1000e0 2024-02-07T12:33:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2da7fc700 1 --2- 172.21.15.47:0/4211350612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2dc1000e0 0x7ff2dc10e000 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4002a50 tx=0x7ff2c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2d37fe700 1 -- 172.21.15.47:0/4211350612 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c4007cc0 con 0x7ff2dc1000e0 2024-02-07T12:33:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2e19bc700 1 -- 172.21.15.47:0/4211350612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc10f180 con 0x7ff2dc1000e0 2024-02-07T12:33:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2d37fe700 1 -- 172.21.15.47:0/4211350612 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2c400f040 con 0x7ff2dc1000e0 2024-02-07T12:33:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2d37fe700 1 -- 172.21.15.47:0/4211350612 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c400d9c0 con 0x7ff2dc1000e0 2024-02-07T12:33:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.418+0000 7ff2e19bc700 1 -- 172.21.15.47:0/4211350612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2dc10f6c0 con 0x7ff2dc1000e0 2024-02-07T12:33:53.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.419+0000 7ff2e19bc700 1 -- 172.21.15.47:0/4211350612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2dc107a70 con 0x7ff2dc1000e0 2024-02-07T12:33:53.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.420+0000 7ff2d37fe700 1 -- 172.21.15.47:0/4211350612 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff2c4009730 con 0x7ff2dc1000e0 2024-02-07T12:33:53.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.420+0000 7ff2d37fe700 1 --2- 172.21.15.47:0/4211350612 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff2c806d7e0 0x7ff2c806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:53.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.420+0000 7ff2d37fe700 1 -- 172.21.15.47:0/4211350612 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff2c408ca60 con 0x7ff2dc1000e0 2024-02-07T12:33:53.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.421+0000 7ff2daffd700 1 --2- 172.21.15.47:0/4211350612 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff2c806d7e0 0x7ff2c806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:53.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.421+0000 7ff2daffd700 1 --2- 172.21.15.47:0/4211350612 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff2c806d7e0 0x7ff2c806fc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc003400 tx=0x7ff2cc004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:53.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.425+0000 7ff2d37fe700 1 -- 172.21.15.47:0/4211350612 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff2c4059d80 con 0x7ff2dc1000e0 2024-02-07T12:33:53.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:53 smithi047 ceph-mon[93224]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:53.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.717+0000 7ff2e19bc700 1 -- 172.21.15.47:0/4211350612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff2dc105a30 con 0x7ff2dc1000e0 2024-02-07T12:33:53.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.718+0000 7ff2d37fe700 1 -- 172.21.15.47:0/4211350612 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7ff2c4059910 con 0x7ff2dc1000e0 2024-02-07T12:33:53.721 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:33:53.721 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:33:53.721 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:33:53.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:33:53.721 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:33:53.721 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:33:53.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:33:53.721 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:33:53.722 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 6 2024-02-07T12:33:53.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:33:53.722 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:33:53.722 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 3, 2024-02-07T12:33:53.722 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 1 2024-02-07T12:33:53.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:33:53.722 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:33:53.722 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 3, 2024-02-07T12:33:53.722 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 11 2024-02-07T12:33:53.722 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:33:53.722 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:33:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.720+0000 7ff2e19bc700 1 -- 172.21.15.47:0/4211350612 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff2c806d7e0 msgr2=0x7ff2c806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.720+0000 7ff2e19bc700 1 --2- 172.21.15.47:0/4211350612 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff2c806d7e0 0x7ff2c806fc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc003400 tx=0x7ff2cc004d10 comp rx=0 tx=0).stop 2024-02-07T12:33:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.720+0000 7ff2e19bc700 1 -- 172.21.15.47:0/4211350612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2dc1000e0 msgr2=0x7ff2dc10e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.720+0000 7ff2e19bc700 1 --2- 172.21.15.47:0/4211350612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2dc1000e0 0x7ff2dc10e000 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4002a50 tx=0x7ff2c4004600 comp rx=0 tx=0).stop 2024-02-07T12:33:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.720+0000 7ff2e19bc700 1 -- 172.21.15.47:0/4211350612 shutdown_connections 2024-02-07T12:33:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.720+0000 7ff2e19bc700 1 --2- 172.21.15.47:0/4211350612 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff2c806d7e0 0x7ff2c806fc90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.720+0000 7ff2e19bc700 1 --2- 172.21.15.47:0/4211350612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2dc0663c0 0x7ff2dc10dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.720+0000 7ff2e19bc700 1 --2- 172.21.15.47:0/4211350612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2dc1000e0 0x7ff2dc10e000 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.720+0000 7ff2e19bc700 1 -- 172.21.15.47:0/4211350612 >> 172.21.15.47:0/4211350612 conn(0x7ff2dc0f74e0 msgr2=0x7ff2dc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:53.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.720+0000 7ff2e19bc700 1 -- 172.21.15.47:0/4211350612 shutdown_connections 2024-02-07T12:33:53.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.720+0000 7ff2e19bc700 1 -- 172.21.15.47:0/4211350612 wait complete. 2024-02-07T12:33:53.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:53 smithi138 ceph-mon[82055]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:53.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.821+0000 7f70714c7700 1 -- 172.21.15.47:0/1305911070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f706c0fcef0 msgr2=0x7f706c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:53.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.821+0000 7f70714c7700 1 --2- 172.21.15.47:0/1305911070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f706c0fcef0 0x7f706c0fd320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7060004940 tx=0x7f7060009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:53.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.821+0000 7f70714c7700 1 -- 172.21.15.47:0/1305911070 shutdown_connections 2024-02-07T12:33:53.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.821+0000 7f70714c7700 1 --2- 172.21.15.47:0/1305911070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f706c0fe0e0 0x7f706c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.821+0000 7f70714c7700 1 --2- 172.21.15.47:0/1305911070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f706c0fcef0 0x7f706c0fd320 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.821+0000 7f70714c7700 1 -- 172.21.15.47:0/1305911070 >> 172.21.15.47:0/1305911070 conn(0x7f706c0f8620 msgr2=0x7f706c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:53.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.822+0000 7f70714c7700 1 -- 172.21.15.47:0/1305911070 shutdown_connections 2024-02-07T12:33:53.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.822+0000 7f70714c7700 1 -- 172.21.15.47:0/1305911070 wait complete. 2024-02-07T12:33:53.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.822+0000 7f70714c7700 1 Processor -- start 2024-02-07T12:33:53.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.822+0000 7f70714c7700 1 -- start start 2024-02-07T12:33:53.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.823+0000 7f70714c7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f706c0fcef0 0x7f706c10d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:53.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.823+0000 7f70714c7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f706c0fe0e0 0x7f706c10deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:53.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.823+0000 7f70714c7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c10e4b0 con 0x7f706c0fe0e0 2024-02-07T12:33:53.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.823+0000 7f70714c7700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c10ed50 con 0x7f706c0fcef0 2024-02-07T12:33:53.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.823+0000 7f706a7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f706c0fe0e0 0x7f706c10deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:53.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.823+0000 7f706a7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f706c0fe0e0 0x7f706c10deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56274/0 (socket says 172.21.15.47:56274) 2024-02-07T12:33:53.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.823+0000 7f706a7fc700 1 -- 172.21.15.47:0/2206290301 learned_addr learned my addr 172.21.15.47:0/2206290301 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:53.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.823+0000 7f706affd700 1 --2- 172.21.15.47:0/2206290301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f706c0fcef0 0x7f706c10d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:53.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.823+0000 7f706a7fc700 1 -- 172.21.15.47:0/2206290301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f706c0fcef0 msgr2=0x7f706c10d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:53.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.823+0000 7f706a7fc700 1 --2- 172.21.15.47:0/2206290301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f706c0fcef0 0x7f706c10d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:53.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.823+0000 7f706a7fc700 1 -- 172.21.15.47:0/2206290301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7060005040 con 0x7f706c0fe0e0 2024-02-07T12:33:53.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.823+0000 7f706affd700 1 --2- 172.21.15.47:0/2206290301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f706c0fcef0 0x7f706c10d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:33:53.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.823+0000 7f706a7fc700 1 --2- 172.21.15.47:0/2206290301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f706c0fe0e0 0x7f706c10deb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f705c00c8c0 tx=0x7f705c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:53.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.824+0000 7f70537fe700 1 -- 172.21.15.47:0/2206290301 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705c00a980 con 0x7f706c0fe0e0 2024-02-07T12:33:53.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.824+0000 7f70537fe700 1 -- 172.21.15.47:0/2206290301 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f705c00ce60 con 0x7f706c0fe0e0 2024-02-07T12:33:53.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.824+0000 7f70714c7700 1 -- 172.21.15.47:0/2206290301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706c10f030 con 0x7f706c0fe0e0 2024-02-07T12:33:53.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.824+0000 7f70537fe700 1 -- 172.21.15.47:0/2206290301 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705c0115e0 con 0x7f706c0fe0e0 2024-02-07T12:33:53.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.824+0000 7f70714c7700 1 -- 172.21.15.47:0/2206290301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c10f570 con 0x7f706c0fe0e0 2024-02-07T12:33:53.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.825+0000 7f70714c7700 1 -- 172.21.15.47:0/2206290301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c04bed0 con 0x7f706c0fe0e0 2024-02-07T12:33:53.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.825+0000 7f70537fe700 1 -- 172.21.15.47:0/2206290301 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f705c012400 con 0x7f706c0fe0e0 2024-02-07T12:33:53.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.826+0000 7f70537fe700 1 --2- 172.21.15.47:0/2206290301 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f705406d7e0 0x7f705406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:53.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.826+0000 7f70537fe700 1 -- 172.21.15.47:0/2206290301 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f705c08d010 con 0x7f706c0fe0e0 2024-02-07T12:33:53.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.826+0000 7f706affd700 1 --2- 172.21.15.47:0/2206290301 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f705406d7e0 0x7f705406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:53.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.826+0000 7f706affd700 1 --2- 172.21.15.47:0/2206290301 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f705406d7e0 0x7f705406fc90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f706000b3b0 tx=0x7f7060009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:53.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:53.830+0000 7f70537fe700 1 -- 172.21.15.47:0/2206290301 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f705c05a3b0 con 0x7f706c0fe0e0 2024-02-07T12:33:54.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.096+0000 7f70714c7700 1 -- 172.21.15.47:0/2206290301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f706c105a30 con 0x7f706c0fe0e0 2024-02-07T12:33:54.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.096+0000 7f70537fe700 1 -- 172.21.15.47:0/2206290301 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 34 v34) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f705c0126b0 con 0x7f706c0fe0e0 2024-02-07T12:33:54.099 INFO:teuthology.orchestra.run.smithi047.stdout:e34 2024-02-07T12:33:54.100 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:33:54.100 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:33:54.100 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:33:54.100 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:33:54.100 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:33:54.100 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:33:54.100 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 33 2024-02-07T12:33:54.100 INFO:teuthology.orchestra.run.smithi047.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-07T12:33:54.100 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:33:54.100 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:33:46.559126+0000 2024-02-07T12:33:54.100 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:33:54.100 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:33:54.100 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 83 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 1 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:in 0 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=34424} 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 1 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:33:54.101 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:33:54.102 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:33:54.102 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:33:54.102 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:33:54.102 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{0:34424} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.47:6828/3387805936,v1:172.21.15.47:6829/3387805936] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:33:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:33:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:33:54.102 INFO:teuthology.orchestra.run.smithi047.stdout:Standby daemons: 2024-02-07T12:33:54.102 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:33:54.102 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{-1:34428} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:33:54.102 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{-1:44283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.138:6825/2036333358,v1:172.21.15.138:6826/2036333358] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:33:54.102 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/1793209176,v1:172.21.15.138:6827/1793209176] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:33:54.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.099+0000 7f70714c7700 1 -- 172.21.15.47:0/2206290301 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f705406d7e0 msgr2=0x7f705406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:54.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.099+0000 7f70714c7700 1 --2- 172.21.15.47:0/2206290301 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f705406d7e0 0x7f705406fc90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f706000b3b0 tx=0x7f7060009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:54.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.099+0000 7f70714c7700 1 -- 172.21.15.47:0/2206290301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f706c0fe0e0 msgr2=0x7f706c10deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:54.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.099+0000 7f70714c7700 1 --2- 172.21.15.47:0/2206290301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f706c0fe0e0 0x7f706c10deb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f705c00c8c0 tx=0x7f705c0044c0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.099+0000 7f70714c7700 1 -- 172.21.15.47:0/2206290301 shutdown_connections 2024-02-07T12:33:54.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.099+0000 7f70714c7700 1 --2- 172.21.15.47:0/2206290301 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f705406d7e0 0x7f705406fc90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.099+0000 7f70714c7700 1 --2- 172.21.15.47:0/2206290301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f706c0fcef0 0x7f706c10d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.099+0000 7f70714c7700 1 --2- 172.21.15.47:0/2206290301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f706c0fe0e0 0x7f706c10deb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.099+0000 7f70714c7700 1 -- 172.21.15.47:0/2206290301 >> 172.21.15.47:0/2206290301 conn(0x7f706c0f8620 msgr2=0x7f706c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:54.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.099+0000 7f70714c7700 1 -- 172.21.15.47:0/2206290301 shutdown_connections 2024-02-07T12:33:54.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.099+0000 7f70714c7700 1 -- 172.21.15.47:0/2206290301 wait complete. 2024-02-07T12:33:54.104 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 34 2024-02-07T12:33:54.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.203+0000 7f3ef9e30700 1 -- 172.21.15.47:0/2480888333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ef40fcf30 msgr2=0x7f3ef40fd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:54.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.203+0000 7f3ef9e30700 1 --2- 172.21.15.47:0/2480888333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ef40fcf30 0x7f3ef40fd340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4004940 tx=0x7f3ee4009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:54.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.203+0000 7f3ef9e30700 1 -- 172.21.15.47:0/2480888333 shutdown_connections 2024-02-07T12:33:54.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.203+0000 7f3ef9e30700 1 --2- 172.21.15.47:0/2480888333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ef40fe1e0 0x7f3ef40fe650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.203+0000 7f3ef9e30700 1 --2- 172.21.15.47:0/2480888333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ef40fcf30 0x7f3ef40fd340 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.203+0000 7f3ef9e30700 1 -- 172.21.15.47:0/2480888333 >> 172.21.15.47:0/2480888333 conn(0x7f3ef40f86b0 msgr2=0x7f3ef40faac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:54.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.203+0000 7f3ef9e30700 1 -- 172.21.15.47:0/2480888333 shutdown_connections 2024-02-07T12:33:54.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.203+0000 7f3ef9e30700 1 -- 172.21.15.47:0/2480888333 wait complete. 2024-02-07T12:33:54.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.204+0000 7f3ef9e30700 1 Processor -- start 2024-02-07T12:33:54.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.204+0000 7f3ef9e30700 1 -- start start 2024-02-07T12:33:54.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.204+0000 7f3ef9e30700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ef40fcf30 0x7f3ef410d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:54.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.204+0000 7f3ef9e30700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ef40fe1e0 0x7f3ef410dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:54.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.204+0000 7f3ef9e30700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef410e530 con 0x7f3ef40fe1e0 2024-02-07T12:33:54.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.204+0000 7f3ef9e30700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef410ed70 con 0x7f3ef40fcf30 2024-02-07T12:33:54.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.204+0000 7f3ef2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ef40fe1e0 0x7f3ef410dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:54.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.204+0000 7f3ef2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ef40fe1e0 0x7f3ef410dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56300/0 (socket says 172.21.15.47:56300) 2024-02-07T12:33:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.204+0000 7f3ef2ffd700 1 -- 172.21.15.47:0/1830266071 learned_addr learned my addr 172.21.15.47:0/1830266071 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.204+0000 7f3ef37fe700 1 --2- 172.21.15.47:0/1830266071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ef40fcf30 0x7f3ef410d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.205+0000 7f3ef2ffd700 1 -- 172.21.15.47:0/1830266071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ef40fcf30 msgr2=0x7f3ef410d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.205+0000 7f3ef2ffd700 1 --2- 172.21.15.47:0/1830266071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ef40fcf30 0x7f3ef410d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.205+0000 7f3ef2ffd700 1 -- 172.21.15.47:0/1830266071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4005040 con 0x7f3ef40fe1e0 2024-02-07T12:33:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.205+0000 7f3ef2ffd700 1 --2- 172.21.15.47:0/1830266071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ef40fe1e0 0x7f3ef410dea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800b790 tx=0x7f3ee8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.205+0000 7f3edbfff700 1 -- 172.21.15.47:0/1830266071 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ee800f6f0 con 0x7f3ef40fe1e0 2024-02-07T12:33:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.205+0000 7f3edbfff700 1 -- 172.21.15.47:0/1830266071 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ee800fd20 con 0x7f3ef40fe1e0 2024-02-07T12:33:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.205+0000 7f3ef9e30700 1 -- 172.21.15.47:0/1830266071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef410f050 con 0x7f3ef40fe1e0 2024-02-07T12:33:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.205+0000 7f3edbfff700 1 -- 172.21.15.47:0/1830266071 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ee80103a0 con 0x7f3ef40fe1e0 2024-02-07T12:33:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.205+0000 7f3ef9e30700 1 -- 172.21.15.47:0/1830266071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef410f590 con 0x7f3ef40fe1e0 2024-02-07T12:33:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.206+0000 7f3ef9e30700 1 -- 172.21.15.47:0/1830266071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef404bed0 con 0x7f3ef40fe1e0 2024-02-07T12:33:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.207+0000 7f3edbfff700 1 -- 172.21.15.47:0/1830266071 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f3ee8011400 con 0x7f3ef40fe1e0 2024-02-07T12:33:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.207+0000 7f3edbfff700 1 --2- 172.21.15.47:0/1830266071 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3edc06d7f0 0x7f3edc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.207+0000 7f3ef37fe700 1 --2- 172.21.15.47:0/1830266071 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3edc06d7f0 0x7f3edc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.207+0000 7f3edbfff700 1 -- 172.21.15.47:0/1830266071 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3ee808cbe0 con 0x7f3ef40fe1e0 2024-02-07T12:33:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.207+0000 7f3ef37fe700 1 --2- 172.21.15.47:0/1830266071 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3edc06d7f0 0x7f3edc06fca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40043d0 tx=0x7f3ee4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:54.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.212+0000 7f3edbfff700 1 -- 172.21.15.47:0/1830266071 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3ee805a020 con 0x7f3ef40fe1e0 2024-02-07T12:33:54.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.437+0000 7f3ef9e30700 1 -- 172.21.15.47:0/1830266071 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ef410fb80 con 0x7f3edc06d7f0 2024-02-07T12:33:54.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.439+0000 7f3edbfff700 1 -- 172.21.15.47:0/1830266071 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3ef410fb80 con 0x7f3edc06d7f0 2024-02-07T12:33:54.442 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:33:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:33:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:33:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:33:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:33:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-02-07T12:33:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: "osd", 2024-02-07T12:33:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: "mon", 2024-02-07T12:33:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr" 2024-02-07T12:33:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:33:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "12/21 daemons upgraded", 2024-02-07T12:33:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading mds daemons", 2024-02-07T12:33:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:33:54.443 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:33:54.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.441+0000 7f3ef9e30700 1 -- 172.21.15.47:0/1830266071 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3edc06d7f0 msgr2=0x7f3edc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:54.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.441+0000 7f3ef9e30700 1 --2- 172.21.15.47:0/1830266071 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3edc06d7f0 0x7f3edc06fca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40043d0 tx=0x7f3ee4009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:54.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.441+0000 7f3ef9e30700 1 -- 172.21.15.47:0/1830266071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ef40fe1e0 msgr2=0x7f3ef410dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:54.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.441+0000 7f3ef9e30700 1 --2- 172.21.15.47:0/1830266071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ef40fe1e0 0x7f3ef410dea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800b790 tx=0x7f3ee8009250 comp rx=0 tx=0).stop 2024-02-07T12:33:54.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.441+0000 7f3ef9e30700 1 -- 172.21.15.47:0/1830266071 shutdown_connections 2024-02-07T12:33:54.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.441+0000 7f3ef9e30700 1 --2- 172.21.15.47:0/1830266071 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3edc06d7f0 0x7f3edc06fca0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.441+0000 7f3ef9e30700 1 --2- 172.21.15.47:0/1830266071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ef40fcf30 0x7f3ef410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.441+0000 7f3ef9e30700 1 --2- 172.21.15.47:0/1830266071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ef40fe1e0 0x7f3ef410dea0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.441+0000 7f3ef9e30700 1 -- 172.21.15.47:0/1830266071 >> 172.21.15.47:0/1830266071 conn(0x7f3ef40f86b0 msgr2=0x7f3ef4101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:54.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.441+0000 7f3ef9e30700 1 -- 172.21.15.47:0/1830266071 shutdown_connections 2024-02-07T12:33:54.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.441+0000 7f3ef9e30700 1 -- 172.21.15.47:0/1830266071 wait complete. 2024-02-07T12:33:54.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.543+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1372258247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b68070860 msgr2=0x7f5b68070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:54.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.543+0000 7f5b6e91a700 1 --2- 172.21.15.47:0/1372258247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b68070860 0x7f5b68070cd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c004940 tx=0x7f5b5c009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:54.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.544+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1372258247 shutdown_connections 2024-02-07T12:33:54.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.544+0000 7f5b6e91a700 1 --2- 172.21.15.47:0/1372258247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b68070860 0x7f5b68070cd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.544+0000 7f5b6e91a700 1 --2- 172.21.15.47:0/1372258247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b68071eb0 0x7f5b68070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.544+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1372258247 >> 172.21.15.47:0/1372258247 conn(0x7f5b680f8620 msgr2=0x7f5b680faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:54.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.544+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1372258247 shutdown_connections 2024-02-07T12:33:54.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.544+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1372258247 wait complete. 2024-02-07T12:33:54.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.544+0000 7f5b6e91a700 1 Processor -- start 2024-02-07T12:33:54.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.544+0000 7f5b6e91a700 1 -- start start 2024-02-07T12:33:54.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.544+0000 7f5b6e91a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b68070860 0x7f5b6810fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:54.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.544+0000 7f5b6e91a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b68071eb0 0x7f5b68110020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:54.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.544+0000 7f5b6e91a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b68110620 con 0x7f5b68070860 2024-02-07T12:33:54.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.544+0000 7f5b6e91a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b68110ec0 con 0x7f5b68071eb0 2024-02-07T12:33:54.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.545+0000 7f5b67fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b68070860 0x7f5b6810fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:54.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.545+0000 7f5b67fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b68070860 0x7f5b6810fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56310/0 (socket says 172.21.15.47:56310) 2024-02-07T12:33:54.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.545+0000 7f5b67fff700 1 -- 172.21.15.47:0/1161542754 learned_addr learned my addr 172.21.15.47:0/1161542754 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:33:54.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.545+0000 7f5b677fe700 1 --2- 172.21.15.47:0/1161542754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b68071eb0 0x7f5b68110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:54.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.545+0000 7f5b67fff700 1 -- 172.21.15.47:0/1161542754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b68071eb0 msgr2=0x7f5b68110020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:54.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.545+0000 7f5b67fff700 1 --2- 172.21.15.47:0/1161542754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b68071eb0 0x7f5b68110020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.545+0000 7f5b67fff700 1 -- 172.21.15.47:0/1161542754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c005040 con 0x7f5b68070860 2024-02-07T12:33:54.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.545+0000 7f5b67fff700 1 --2- 172.21.15.47:0/1161542754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b68070860 0x7f5b6810fae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5b58002a80 tx=0x7f5b580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:54.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.545+0000 7f5b64ff9700 1 -- 172.21.15.47:0/1161542754 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b58007cc0 con 0x7f5b68070860 2024-02-07T12:33:54.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.545+0000 7f5b64ff9700 1 -- 172.21.15.47:0/1161542754 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b5800f040 con 0x7f5b68070860 2024-02-07T12:33:54.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.545+0000 7f5b64ff9700 1 -- 172.21.15.47:0/1161542754 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b580096f0 con 0x7f5b68070860 2024-02-07T12:33:54.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.545+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1161542754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b681111a0 con 0x7f5b68070860 2024-02-07T12:33:54.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.545+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1161542754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b681116e0 con 0x7f5b68070860 2024-02-07T12:33:54.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.546+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1161542754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6804bed0 con 0x7f5b68070860 2024-02-07T12:33:54.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.547+0000 7f5b64ff9700 1 -- 172.21.15.47:0/1161542754 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f5b5800d690 con 0x7f5b68070860 2024-02-07T12:33:54.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.547+0000 7f5b64ff9700 1 --2- 172.21.15.47:0/1161542754 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5b5006d7f0 0x7f5b5006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:33:54.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.547+0000 7f5b64ff9700 1 -- 172.21.15.47:0/1161542754 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f5b5808c5e0 con 0x7f5b68070860 2024-02-07T12:33:54.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.547+0000 7f5b677fe700 1 --2- 172.21.15.47:0/1161542754 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5b5006d7f0 0x7f5b5006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:33:54.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.548+0000 7f5b677fe700 1 --2- 172.21.15.47:0/1161542754 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5b5006d7f0 0x7f5b5006fca0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00b020 tx=0x7f5b5c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:33:54.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.552+0000 7f5b64ff9700 1 -- 172.21.15.47:0/1161542754 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5b58059980 con 0x7f5b68070860 2024-02-07T12:33:54.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:54 smithi138 ceph-mon[82055]: pgmap v199: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 8.2 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-02-07T12:33:54.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:54 smithi138 ceph-mon[82055]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:54.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:54 smithi138 ceph-mon[82055]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:54.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:54 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/4211350612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:54.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:54 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2206290301' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:33:54.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:54 smithi047 ceph-mon[93224]: pgmap v199: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 8.2 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-02-07T12:33:54.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:54 smithi047 ceph-mon[93224]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:54.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:54 smithi047 ceph-mon[93224]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:54.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:54 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/4211350612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:33:54.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:54 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2206290301' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:33:54.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.843+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1161542754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5b68107c00 con 0x7f5b68070860 2024-02-07T12:33:54.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.843+0000 7f5b64ff9700 1 -- 172.21.15.47:0/1161542754 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5b58059510 con 0x7f5b68070860 2024-02-07T12:33:54.846 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:33:54.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.845+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1161542754 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5b5006d7f0 msgr2=0x7f5b5006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:54.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.845+0000 7f5b6e91a700 1 --2- 172.21.15.47:0/1161542754 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5b5006d7f0 0x7f5b5006fca0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00b020 tx=0x7f5b5c009e30 comp rx=0 tx=0).stop 2024-02-07T12:33:54.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.845+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1161542754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b68070860 msgr2=0x7f5b6810fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:33:54.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.845+0000 7f5b6e91a700 1 --2- 172.21.15.47:0/1161542754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b68070860 0x7f5b6810fae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5b58002a80 tx=0x7f5b580046b0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.845+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1161542754 shutdown_connections 2024-02-07T12:33:54.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.845+0000 7f5b6e91a700 1 --2- 172.21.15.47:0/1161542754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b68070860 0x7f5b6810fae0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.845+0000 7f5b6e91a700 1 --2- 172.21.15.47:0/1161542754 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5b5006d7f0 0x7f5b5006fca0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.845+0000 7f5b6e91a700 1 --2- 172.21.15.47:0/1161542754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b68071eb0 0x7f5b68110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:33:54.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.845+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1161542754 >> 172.21.15.47:0/1161542754 conn(0x7f5b680f8620 msgr2=0x7f5b68102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:33:54.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.845+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1161542754 shutdown_connections 2024-02-07T12:33:54.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:33:54.845+0000 7f5b6e91a700 1 -- 172.21.15.47:0/1161542754 wait complete. 2024-02-07T12:33:55.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:55 smithi138 ceph-mon[82055]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:55.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:55 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:55.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:55 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:55.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:55 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1161542754' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:33:55.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:55 smithi047 ceph-mon[93224]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:33:55.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:55 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:55.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:55 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:55.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:55 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1161542754' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:33:56.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:56 smithi047 ceph-mon[93224]: pgmap v200: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-02-07T12:33:56.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:56.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:56.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:56 smithi138 ceph-mon[82055]: pgmap v200: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-02-07T12:33:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:57.774 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:57 smithi047 ceph-mon[93224]: pgmap v201: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-02-07T12:33:57.774 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:57.774 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:33:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:33:58.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:57 smithi138 ceph-mon[82055]: pgmap v201: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-02-07T12:33:58.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:33:58.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:33:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:34:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: pgmap v202: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-02-07T12:34:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: Detected new or changed devices on smithi047 2024-02-07T12:34:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:34:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:00.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:00.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi047.jsgfge"]}]: dispatch 2024-02-07T12:34:00.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:00 smithi138 ceph-mon[82055]: Upgrade: It appears safe to stop mds.cephfs.smithi047.jsgfge 2024-02-07T12:34:00.819 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: pgmap v202: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-02-07T12:34:00.819 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: Detected new or changed devices on smithi047 2024-02-07T12:34:00.819 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:00.819 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:00.819 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:00.819 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:34:00.819 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:00.819 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:00.819 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:00.819 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:00.819 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:00.819 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:00.819 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi047.jsgfge"]}]: dispatch 2024-02-07T12:34:00.820 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:00 smithi047 ceph-mon[93224]: Upgrade: It appears safe to stop mds.cephfs.smithi047.jsgfge 2024-02-07T12:34:02.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:02 smithi138 ceph-mon[82055]: pgmap v203: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-02-07T12:34:02.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:02 smithi138 ceph-mon[82055]: Upgrade: Updating mds.cephfs.smithi047.jsgfge 2024-02-07T12:34:02.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:02 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:02.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:02 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.jsgfge", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:34:02.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:02 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:02.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:02 smithi138 ceph-mon[82055]: Deploying daemon mds.cephfs.smithi047.jsgfge on smithi047 2024-02-07T12:34:02.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:02 smithi047 ceph-mon[93224]: pgmap v203: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-02-07T12:34:02.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:02 smithi047 ceph-mon[93224]: Upgrade: Updating mds.cephfs.smithi047.jsgfge 2024-02-07T12:34:02.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:02 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:02.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:02 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.jsgfge", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:34:02.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:02 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:02.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:02 smithi047 ceph-mon[93224]: Deploying daemon mds.cephfs.smithi047.jsgfge on smithi047 2024-02-07T12:34:03.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:03 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047[93220]: 2024-02-07T12:34:03.468+0000 7fb487509700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-07T12:34:04.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:04 smithi138 ceph-mon[82055]: pgmap v204: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-02-07T12:34:04.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:04 smithi138 ceph-mon[82055]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-07T12:34:04.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:04 smithi138 ceph-mon[82055]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-07T12:34:04.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:04 smithi138 ceph-mon[82055]: osdmap e84: 6 total, 6 up, 6 in 2024-02-07T12:34:04.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:04 smithi138 ceph-mon[82055]: Standby daemon mds.cephfs.smithi047.lagmef assigned to filesystem cephfs as rank 0 2024-02-07T12:34:04.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:04 smithi138 ceph-mon[82055]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-07T12:34:04.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:04 smithi138 ceph-mon[82055]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-07T12:34:04.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:04 smithi138 ceph-mon[82055]: fsmap cephfs:1/1 {0=cephfs.smithi047.lagmef=up:replay} 2 up:standby 2024-02-07T12:34:04.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:04 smithi047 ceph-mon[93224]: pgmap v204: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-02-07T12:34:04.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:04 smithi047 ceph-mon[93224]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-07T12:34:04.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:04 smithi047 ceph-mon[93224]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-07T12:34:04.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:04 smithi047 ceph-mon[93224]: osdmap e84: 6 total, 6 up, 6 in 2024-02-07T12:34:04.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:04 smithi047 ceph-mon[93224]: Standby daemon mds.cephfs.smithi047.lagmef assigned to filesystem cephfs as rank 0 2024-02-07T12:34:04.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:04 smithi047 ceph-mon[93224]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-07T12:34:04.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:04 smithi047 ceph-mon[93224]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-07T12:34:04.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:04 smithi047 ceph-mon[93224]: fsmap cephfs:1/1 {0=cephfs.smithi047.lagmef=up:replay} 2 up:standby 2024-02-07T12:34:06.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:06 smithi138 ceph-mon[82055]: pgmap v206: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 820 KiB/s rd, 0 op/s 2024-02-07T12:34:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:06 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:34:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:06 smithi047 ceph-mon[93224]: pgmap v206: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 820 KiB/s rd, 0 op/s 2024-02-07T12:34:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:06 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:34:08.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:08 smithi138 ceph-mon[82055]: pgmap v207: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 2 op/s 2024-02-07T12:34:08.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:08 smithi047 ceph-mon[93224]: pgmap v207: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 2 op/s 2024-02-07T12:34:10.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:10 smithi138 ceph-mon[82055]: pgmap v208: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-02-07T12:34:10.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:10 smithi047 ceph-mon[93224]: pgmap v208: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-02-07T12:34:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:12 smithi047 ceph-mon[93224]: pgmap v209: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-02-07T12:34:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:12 smithi047 ceph-mon[93224]: reconnect by client.14524 v1:192.168.0.1:0/1195374876 after 0 2024-02-07T12:34:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:12 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] up:reconnect 2024-02-07T12:34:12.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:12 smithi047 ceph-mon[93224]: fsmap cephfs:1/1 {0=cephfs.smithi047.lagmef=up:reconnect} 2 up:standby 2024-02-07T12:34:12.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:12 smithi047 ceph-mon[93224]: reconnect by client.24291 v1:192.168.0.1:0/1103379993 after 0.00899981 2024-02-07T12:34:12.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:12.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:34:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:12 smithi138 ceph-mon[82055]: pgmap v209: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-02-07T12:34:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:12 smithi138 ceph-mon[82055]: reconnect by client.14524 v1:192.168.0.1:0/1195374876 after 0 2024-02-07T12:34:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:12 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] up:reconnect 2024-02-07T12:34:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:12 smithi138 ceph-mon[82055]: fsmap cephfs:1/1 {0=cephfs.smithi047.lagmef=up:reconnect} 2 up:standby 2024-02-07T12:34:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:12 smithi138 ceph-mon[82055]: reconnect by client.24291 v1:192.168.0.1:0/1103379993 after 0.00899981 2024-02-07T12:34:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:34:13.574 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:13 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] up:rejoin 2024-02-07T12:34:13.574 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:13 smithi047 ceph-mon[93224]: fsmap cephfs:1/1 {0=cephfs.smithi047.lagmef=up:rejoin} 2 up:standby 2024-02-07T12:34:13.574 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:13 smithi047 ceph-mon[93224]: daemon mds.cephfs.smithi047.lagmef is now active in filesystem cephfs as rank 0 2024-02-07T12:34:13.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:13 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] up:rejoin 2024-02-07T12:34:13.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:13 smithi138 ceph-mon[82055]: fsmap cephfs:1/1 {0=cephfs.smithi047.lagmef=up:rejoin} 2 up:standby 2024-02-07T12:34:13.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:13 smithi138 ceph-mon[82055]: daemon mds.cephfs.smithi047.lagmef is now active in filesystem cephfs as rank 0 2024-02-07T12:34:14.496 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:14 smithi047 ceph-mon[93224]: pgmap v210: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-07T12:34:14.496 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:14 smithi047 ceph-mon[93224]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-07T12:34:14.496 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:14 smithi047 ceph-mon[93224]: Cluster is now healthy 2024-02-07T12:34:14.496 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:14 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] up:active 2024-02-07T12:34:14.496 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:14 smithi047 ceph-mon[93224]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 2 up:standby 2024-02-07T12:34:14.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:14 smithi138 ceph-mon[82055]: pgmap v210: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-07T12:34:14.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:14 smithi138 ceph-mon[82055]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-07T12:34:14.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:14 smithi138 ceph-mon[82055]: Cluster is now healthy 2024-02-07T12:34:14.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:14 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] up:active 2024-02-07T12:34:14.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:14 smithi138 ceph-mon[82055]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 2 up:standby 2024-02-07T12:34:15.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:15 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:15.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:15 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:15.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:15 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:15.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:15 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.47:6828/3723006072,v1:172.21.15.47:6829/3723006072] up:boot 2024-02-07T12:34:15.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:15 smithi047 ceph-mon[93224]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 3 up:standby 2024-02-07T12:34:15.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:15 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:34:16.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:15 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:16.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:15 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:16.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:15 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:16.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:15 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.47:6828/3723006072,v1:172.21.15.47:6829/3723006072] up:boot 2024-02-07T12:34:16.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:15 smithi138 ceph-mon[82055]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 3 up:standby 2024-02-07T12:34:16.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:15 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:34:16.793 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:16 smithi047 ceph-mon[93224]: pgmap v211: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 0 B/s wr, 7 op/s 2024-02-07T12:34:16.935 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:16 smithi138 ceph-mon[82055]: pgmap v211: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 0 B/s wr, 7 op/s 2024-02-07T12:34:18.729 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:18 smithi047 ceph-mon[93224]: pgmap v212: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-02-07T12:34:19.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:18 smithi138 ceph-mon[82055]: pgmap v212: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-02-07T12:34:20.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:20 smithi138 ceph-mon[82055]: pgmap v213: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-02-07T12:34:20.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:20.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:20.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:20 smithi047 ceph-mon[93224]: pgmap v213: 65 pgs: 65 active+clean; 178 MiB data, 746 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-02-07T12:34:20.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:20.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:21.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:21 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:21.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:21 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:21.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:21 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:21.828 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:21 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:22.605 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:22 smithi047 ceph-mon[93224]: pgmap v214: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-02-07T12:34:22.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:22 smithi138 ceph-mon[82055]: pgmap v214: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-02-07T12:34:24.732 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:24 smithi047 ceph-mon[93224]: pgmap v215: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-07T12:34:24.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:24 smithi138 ceph-mon[82055]: pgmap v215: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-07T12:34:24.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.952+0000 7ff56e0ac700 1 -- 172.21.15.47:0/2975022306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5680fcef0 msgr2=0x7ff5680fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:24.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.952+0000 7ff56e0ac700 1 --2- 172.21.15.47:0/2975022306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5680fcef0 0x7ff5680fd320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff558004940 tx=0x7ff558009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:24.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.952+0000 7ff56e0ac700 1 -- 172.21.15.47:0/2975022306 shutdown_connections 2024-02-07T12:34:24.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.952+0000 7ff56e0ac700 1 --2- 172.21.15.47:0/2975022306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5680fe0e0 0x7ff5680fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:24.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.952+0000 7ff56e0ac700 1 --2- 172.21.15.47:0/2975022306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5680fcef0 0x7ff5680fd320 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:24.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.952+0000 7ff56e0ac700 1 -- 172.21.15.47:0/2975022306 >> 172.21.15.47:0/2975022306 conn(0x7ff5680f8620 msgr2=0x7ff5680faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:24.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.952+0000 7ff56e0ac700 1 -- 172.21.15.47:0/2975022306 shutdown_connections 2024-02-07T12:34:24.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.952+0000 7ff56e0ac700 1 -- 172.21.15.47:0/2975022306 wait complete. 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.952+0000 7ff56e0ac700 1 Processor -- start 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff56e0ac700 1 -- start start 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff56e0ac700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5680fcef0 0x7ff56810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff56e0ac700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5680fe0e0 0x7ff56810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff56e0ac700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56810e4b0 con 0x7ff5680fe0e0 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff56e0ac700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56810ed50 con 0x7ff5680fcef0 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff566ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5680fe0e0 0x7ff56810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff566ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5680fe0e0 0x7ff56810deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47216/0 (socket says 172.21.15.47:47216) 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff566ffd700 1 -- 172.21.15.47:0/1183972353 learned_addr learned my addr 172.21.15.47:0/1183972353 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff5677fe700 1 --2- 172.21.15.47:0/1183972353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5680fcef0 0x7ff56810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff566ffd700 1 -- 172.21.15.47:0/1183972353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5680fcef0 msgr2=0x7ff56810d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff566ffd700 1 --2- 172.21.15.47:0/1183972353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5680fcef0 0x7ff56810d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff566ffd700 1 -- 172.21.15.47:0/1183972353 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff558005040 con 0x7ff5680fe0e0 2024-02-07T12:34:24.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff566ffd700 1 --2- 172.21.15.47:0/1183972353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5680fe0e0 0x7ff56810deb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff55c002a50 tx=0x7ff55c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:24.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.953+0000 7ff54ffff700 1 -- 172.21.15.47:0/1183972353 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff55c007cc0 con 0x7ff5680fe0e0 2024-02-07T12:34:24.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.954+0000 7ff56e0ac700 1 -- 172.21.15.47:0/1183972353 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56810f030 con 0x7ff5680fe0e0 2024-02-07T12:34:24.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.954+0000 7ff54ffff700 1 -- 172.21.15.47:0/1183972353 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff55c00f040 con 0x7ff5680fe0e0 2024-02-07T12:34:24.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.954+0000 7ff54ffff700 1 -- 172.21.15.47:0/1183972353 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff55c00da30 con 0x7ff5680fe0e0 2024-02-07T12:34:24.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.954+0000 7ff56e0ac700 1 -- 172.21.15.47:0/1183972353 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56810f570 con 0x7ff5680fe0e0 2024-02-07T12:34:24.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.955+0000 7ff56e0ac700 1 -- 172.21.15.47:0/1183972353 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56804bed0 con 0x7ff5680fe0e0 2024-02-07T12:34:24.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.955+0000 7ff54ffff700 1 -- 172.21.15.47:0/1183972353 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff55c00db90 con 0x7ff5680fe0e0 2024-02-07T12:34:24.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.955+0000 7ff54ffff700 1 --2- 172.21.15.47:0/1183972353 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff55006d7e0 0x7ff55006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:24.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.956+0000 7ff54ffff700 1 -- 172.21.15.47:0/1183972353 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff55c08cd20 con 0x7ff5680fe0e0 2024-02-07T12:34:24.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.956+0000 7ff5677fe700 1 --2- 172.21.15.47:0/1183972353 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff55006d7e0 0x7ff55006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:24.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.956+0000 7ff5677fe700 1 --2- 172.21.15.47:0/1183972353 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff55006d7e0 0x7ff55006fc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff558004890 tx=0x7ff558009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:24.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:24.960+0000 7ff54ffff700 1 -- 172.21.15.47:0/1183972353 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff55c059ff0 con 0x7ff5680fe0e0 2024-02-07T12:34:25.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.194+0000 7ff56e0ac700 1 -- 172.21.15.47:0/1183972353 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff56810f9c0 con 0x7ff55006d7e0 2024-02-07T12:34:25.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.195+0000 7ff54ffff700 1 -- 172.21.15.47:0/1183972353 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff56810f9c0 con 0x7ff55006d7e0 2024-02-07T12:34:25.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.197+0000 7ff56e0ac700 1 -- 172.21.15.47:0/1183972353 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff55006d7e0 msgr2=0x7ff55006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:25.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.197+0000 7ff56e0ac700 1 --2- 172.21.15.47:0/1183972353 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff55006d7e0 0x7ff55006fc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff558004890 tx=0x7ff558009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:25.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.197+0000 7ff56e0ac700 1 -- 172.21.15.47:0/1183972353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5680fe0e0 msgr2=0x7ff56810deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:25.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.197+0000 7ff56e0ac700 1 --2- 172.21.15.47:0/1183972353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5680fe0e0 0x7ff56810deb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff55c002a50 tx=0x7ff55c0046b0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.197+0000 7ff56e0ac700 1 -- 172.21.15.47:0/1183972353 shutdown_connections 2024-02-07T12:34:25.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.197+0000 7ff56e0ac700 1 --2- 172.21.15.47:0/1183972353 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff55006d7e0 0x7ff55006fc90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.197+0000 7ff56e0ac700 1 --2- 172.21.15.47:0/1183972353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5680fcef0 0x7ff56810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.197+0000 7ff56e0ac700 1 --2- 172.21.15.47:0/1183972353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5680fe0e0 0x7ff56810deb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.197+0000 7ff56e0ac700 1 -- 172.21.15.47:0/1183972353 >> 172.21.15.47:0/1183972353 conn(0x7ff5680f8620 msgr2=0x7ff5681013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:25.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.197+0000 7ff56e0ac700 1 -- 172.21.15.47:0/1183972353 shutdown_connections 2024-02-07T12:34:25.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.197+0000 7ff56e0ac700 1 -- 172.21.15.47:0/1183972353 wait complete. 2024-02-07T12:34:25.209 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:34:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.300+0000 7f9660880700 1 -- 172.21.15.47:0/1058529180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0fbe90 msgr2=0x7f965c0fc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.300+0000 7f9660880700 1 --2- 172.21.15.47:0/1058529180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0fbe90 0x7f965c0fc2a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f964c004940 tx=0x7f964c009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.300+0000 7f9660880700 1 -- 172.21.15.47:0/1058529180 shutdown_connections 2024-02-07T12:34:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.300+0000 7f9660880700 1 --2- 172.21.15.47:0/1058529180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f965c0fd090 0x7f965c0fd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.300+0000 7f9660880700 1 --2- 172.21.15.47:0/1058529180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0fbe90 0x7f965c0fc2a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.300+0000 7f9660880700 1 -- 172.21.15.47:0/1058529180 >> 172.21.15.47:0/1058529180 conn(0x7f965c0f75c0 msgr2=0x7f965c0f99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.300+0000 7f9660880700 1 -- 172.21.15.47:0/1058529180 shutdown_connections 2024-02-07T12:34:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.300+0000 7f9660880700 1 -- 172.21.15.47:0/1058529180 wait complete. 2024-02-07T12:34:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.301+0000 7f9660880700 1 Processor -- start 2024-02-07T12:34:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.301+0000 7f9660880700 1 -- start start 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.301+0000 7f9660880700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f965c0fbe90 0x7f965c0fff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.301+0000 7f9660880700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0fd090 0x7f965c0fe3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.301+0000 7f9660880700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0fe9d0 con 0x7f965c0fd090 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.301+0000 7f9660880700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0feb40 con 0x7f965c0fbe90 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.301+0000 7f9659d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0fd090 0x7f965c0fe3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.301+0000 7f9659d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0fd090 0x7f965c0fe3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47238/0 (socket says 172.21.15.47:47238) 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.301+0000 7f9659d9b700 1 -- 172.21.15.47:0/1803732414 learned_addr learned my addr 172.21.15.47:0/1803732414 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.301+0000 7f9659d9b700 1 -- 172.21.15.47:0/1803732414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f965c0fbe90 msgr2=0x7f965c0fff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.301+0000 7f965a59c700 1 --2- 172.21.15.47:0/1803732414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f965c0fbe90 0x7f965c0fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.301+0000 7f9659d9b700 1 --2- 172.21.15.47:0/1803732414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f965c0fbe90 0x7f965c0fff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.301+0000 7f9659d9b700 1 -- 172.21.15.47:0/1803732414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c005040 con 0x7f965c0fd090 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.302+0000 7f9659d9b700 1 --2- 172.21.15.47:0/1803732414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0fd090 0x7f965c0fe3d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f965000c8c0 tx=0x7f96500044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.302+0000 7f964affd700 1 -- 172.21.15.47:0/1803732414 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f965000a980 con 0x7f965c0fd090 2024-02-07T12:34:25.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.302+0000 7f9660880700 1 -- 172.21.15.47:0/1803732414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965c0fee20 con 0x7f965c0fd090 2024-02-07T12:34:25.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.302+0000 7f964affd700 1 -- 172.21.15.47:0/1803732414 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f965000ce60 con 0x7f965c0fd090 2024-02-07T12:34:25.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.302+0000 7f964affd700 1 -- 172.21.15.47:0/1803732414 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96500115e0 con 0x7f965c0fd090 2024-02-07T12:34:25.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.302+0000 7f9660880700 1 -- 172.21.15.47:0/1803732414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965c1159b0 con 0x7f965c0fd090 2024-02-07T12:34:25.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.303+0000 7f9660880700 1 -- 172.21.15.47:0/1803732414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965c04bed0 con 0x7f965c0fd090 2024-02-07T12:34:25.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.303+0000 7f964affd700 1 -- 172.21.15.47:0/1803732414 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9650012400 con 0x7f965c0fd090 2024-02-07T12:34:25.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.304+0000 7f964affd700 1 --2- 172.21.15.47:0/1803732414 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f964406d7e0 0x7f964406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:25.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.304+0000 7f964affd700 1 -- 172.21.15.47:0/1803732414 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f965008d060 con 0x7f965c0fd090 2024-02-07T12:34:25.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.304+0000 7f965a59c700 1 --2- 172.21.15.47:0/1803732414 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f964406d7e0 0x7f964406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:25.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.304+0000 7f965a59c700 1 --2- 172.21.15.47:0/1803732414 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f964406d7e0 0x7f964406fc90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f964c009fd0 tx=0x7f964c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:25.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.308+0000 7f964affd700 1 -- 172.21.15.47:0/1803732414 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f965005a3b0 con 0x7f965c0fd090 2024-02-07T12:34:25.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.550+0000 7f9660880700 1 -- 172.21.15.47:0/1803732414 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f965c0666a0 con 0x7f964406d7e0 2024-02-07T12:34:25.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.551+0000 7f964affd700 1 -- 172.21.15.47:0/1803732414 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f965c0666a0 con 0x7f964406d7e0 2024-02-07T12:34:25.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.553+0000 7f9660880700 1 -- 172.21.15.47:0/1803732414 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f964406d7e0 msgr2=0x7f964406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:25.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.553+0000 7f9660880700 1 --2- 172.21.15.47:0/1803732414 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f964406d7e0 0x7f964406fc90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f964c009fd0 tx=0x7f964c009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:25.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.553+0000 7f9660880700 1 -- 172.21.15.47:0/1803732414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0fd090 msgr2=0x7f965c0fe3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:25.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.553+0000 7f9660880700 1 --2- 172.21.15.47:0/1803732414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0fd090 0x7f965c0fe3d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f965000c8c0 tx=0x7f96500044c0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.553+0000 7f9660880700 1 -- 172.21.15.47:0/1803732414 shutdown_connections 2024-02-07T12:34:25.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.553+0000 7f9660880700 1 --2- 172.21.15.47:0/1803732414 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f964406d7e0 0x7f964406fc90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.553+0000 7f9660880700 1 --2- 172.21.15.47:0/1803732414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f965c0fbe90 0x7f965c0fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.553+0000 7f9660880700 1 --2- 172.21.15.47:0/1803732414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0fd090 0x7f965c0fe3d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.553+0000 7f9660880700 1 -- 172.21.15.47:0/1803732414 >> 172.21.15.47:0/1803732414 conn(0x7f965c0f75c0 msgr2=0x7f965c065f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:25.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.553+0000 7f9660880700 1 -- 172.21.15.47:0/1803732414 shutdown_connections 2024-02-07T12:34:25.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.553+0000 7f9660880700 1 -- 172.21.15.47:0/1803732414 wait complete. 2024-02-07T12:34:25.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.656+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/3592385140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ccc1003a0 msgr2=0x7f0ccc102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:25.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.656+0000 7f0cd3e2c700 1 --2- 172.21.15.47:0/3592385140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ccc1003a0 0x7f0ccc102780 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0004940 tx=0x7f0cc0009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:25.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.656+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/3592385140 shutdown_connections 2024-02-07T12:34:25.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.656+0000 7f0cd3e2c700 1 --2- 172.21.15.47:0/3592385140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ccc1003a0 0x7f0ccc102780 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.656+0000 7f0cd3e2c700 1 --2- 172.21.15.47:0/3592385140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ccc0fda80 0x7f0ccc0ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.656+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/3592385140 >> 172.21.15.47:0/3592385140 conn(0x7f0ccc0f74e0 msgr2=0x7f0ccc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:25.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.656+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/3592385140 shutdown_connections 2024-02-07T12:34:25.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.656+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/3592385140 wait complete. 2024-02-07T12:34:25.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.657+0000 7f0cd3e2c700 1 Processor -- start 2024-02-07T12:34:25.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.657+0000 7f0cd3e2c700 1 -- start start 2024-02-07T12:34:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.657+0000 7f0cd3e2c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ccc0fda80 0x7f0ccc0fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.657+0000 7f0cd3e2c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ccc1003a0 0x7f0ccc0fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.657+0000 7f0cd3e2c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc0fbf90 con 0x7f0ccc0fda80 2024-02-07T12:34:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.657+0000 7f0cd3e2c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc0fc100 con 0x7f0ccc1003a0 2024-02-07T12:34:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.657+0000 7f0cd1bc8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ccc0fda80 0x7f0ccc0fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.657+0000 7f0cd1bc8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ccc0fda80 0x7f0ccc0fd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47256/0 (socket says 172.21.15.47:47256) 2024-02-07T12:34:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.657+0000 7f0cd1bc8700 1 -- 172.21.15.47:0/4013888093 learned_addr learned my addr 172.21.15.47:0/4013888093 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.658+0000 7f0cd13c7700 1 --2- 172.21.15.47:0/4013888093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ccc1003a0 0x7f0ccc0fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.658+0000 7f0cd1bc8700 1 -- 172.21.15.47:0/4013888093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ccc1003a0 msgr2=0x7f0ccc0fb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.658+0000 7f0cd1bc8700 1 --2- 172.21.15.47:0/4013888093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ccc1003a0 0x7f0ccc0fb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.658+0000 7f0cd1bc8700 1 -- 172.21.15.47:0/4013888093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc0005040 con 0x7f0ccc0fda80 2024-02-07T12:34:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.658+0000 7f0cd1bc8700 1 --2- 172.21.15.47:0/4013888093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ccc0fda80 0x7f0ccc0fd510 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00ec90 tx=0x7f0cbc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.658+0000 7f0cca7fc700 1 -- 172.21.15.47:0/4013888093 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cbc00eea0 con 0x7f0ccc0fda80 2024-02-07T12:34:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.658+0000 7f0cca7fc700 1 -- 172.21.15.47:0/4013888093 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0cbc00f040 con 0x7f0ccc0fda80 2024-02-07T12:34:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.658+0000 7f0cca7fc700 1 -- 172.21.15.47:0/4013888093 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cbc009640 con 0x7f0ccc0fda80 2024-02-07T12:34:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.658+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/4013888093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ccc0fc3e0 con 0x7f0ccc0fda80 2024-02-07T12:34:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.658+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/4013888093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ccc115910 con 0x7f0ccc0fda80 2024-02-07T12:34:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.659+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/4013888093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ccc107a50 con 0x7f0ccc0fda80 2024-02-07T12:34:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.660+0000 7f0cca7fc700 1 -- 172.21.15.47:0/4013888093 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0cbc00c940 con 0x7f0ccc0fda80 2024-02-07T12:34:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.660+0000 7f0cca7fc700 1 --2- 172.21.15.47:0/4013888093 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0cb406d7e0 0x7f0cb406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.660+0000 7f0cca7fc700 1 -- 172.21.15.47:0/4013888093 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0cbc08d500 con 0x7f0ccc0fda80 2024-02-07T12:34:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.660+0000 7f0cd13c7700 1 --2- 172.21.15.47:0/4013888093 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0cb406d7e0 0x7f0cb406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.661+0000 7f0cd13c7700 1 --2- 172.21.15.47:0/4013888093 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0cb406d7e0 0x7f0cb406fc90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009b30 tx=0x7f0cc0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:25.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.665+0000 7f0cca7fc700 1 -- 172.21.15.47:0/4013888093 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0cbc05a7d0 con 0x7f0ccc0fda80 2024-02-07T12:34:25.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.879+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/4013888093 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ccc05e3d0 con 0x7f0cb406d7e0 2024-02-07T12:34:25.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.889+0000 7f0cca7fc700 1 -- 172.21.15.47:0/4013888093 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f0ccc05e3d0 con 0x7f0cb406d7e0 2024-02-07T12:34:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:34:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (8m) 6s ago 16m 26.2M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:34:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (5m) 6s ago 17m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (5m) 101s ago 16m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (7m) 6s ago 16m 85.2M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (12s) 6s ago 11m 11.1M - 19.0.0-1252-g44458cce 79957b372307 fbda6b9f9953 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (37s) 6s ago 11m 67.3M - 19.0.0-1252-g44458cce 79957b372307 055df3be8762 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (11m) 101s ago 11m 68.4M - 17.2.7-491-gf2462625 4ad3622d1b31 8d61f009e33c 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (11m) 101s ago 11m 69.7M - 17.2.7-491-gf2462625 4ad3622d1b31 85f7efe210c1 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (6m) 6s ago 18m 508M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (6m) 101s ago 16m 452M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (6m) 6s ago 18m 56.4M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (5m) 101s ago 15m 37.7M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (8m) 6s ago 17m 15.1M - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (7m) 101s ago 16m 14.9M - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (4m) 6s ago 15m 101M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (4m) 6s ago 14m 113M 1559M 19.0.0-1252-g44458cce 79957b372307 0f2b0eea74d7 2024-02-07T12:34:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (3m) 6s ago 14m 90.1M 1559M 19.0.0-1252-g44458cce 79957b372307 0b8c78346346 2024-02-07T12:34:25.893 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (2m) 101s ago 13m 113M 2581M 19.0.0-1252-g44458cce 79957b372307 dea45db021db 2024-02-07T12:34:25.893 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (2m) 101s ago 13m 93.6M 2581M 19.0.0-1252-g44458cce 79957b372307 3161c1dfe6f5 2024-02-07T12:34:25.893 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (105s) 101s ago 12m 12.6M 2581M 19.0.0-1252-g44458cce 79957b372307 c9504c7cfe7c 2024-02-07T12:34:25.893 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (6m) 6s ago 16m 63.8M - 2.43.0 a07b618ecd1d 32840d82c54b 2024-02-07T12:34:25.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.891+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/4013888093 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0cb406d7e0 msgr2=0x7f0cb406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:25.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.891+0000 7f0cd3e2c700 1 --2- 172.21.15.47:0/4013888093 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0cb406d7e0 0x7f0cb406fc90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009b30 tx=0x7f0cc0009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:25.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.891+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/4013888093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ccc0fda80 msgr2=0x7f0ccc0fd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:25.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.891+0000 7f0cd3e2c700 1 --2- 172.21.15.47:0/4013888093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ccc0fda80 0x7f0ccc0fd510 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00ec90 tx=0x7f0cbc00b040 comp rx=0 tx=0).stop 2024-02-07T12:34:25.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.891+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/4013888093 shutdown_connections 2024-02-07T12:34:25.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.892+0000 7f0cd3e2c700 1 --2- 172.21.15.47:0/4013888093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ccc0fda80 0x7f0ccc0fd510 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.892+0000 7f0cd3e2c700 1 --2- 172.21.15.47:0/4013888093 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0cb406d7e0 0x7f0cb406fc90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.892+0000 7f0cd3e2c700 1 --2- 172.21.15.47:0/4013888093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ccc1003a0 0x7f0ccc0fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.892+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/4013888093 >> 172.21.15.47:0/4013888093 conn(0x7f0ccc0f74e0 msgr2=0x7f0ccc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:25.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.892+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/4013888093 shutdown_connections 2024-02-07T12:34:25.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.892+0000 7f0cd3e2c700 1 -- 172.21.15.47:0/4013888093 wait complete. 2024-02-07T12:34:25.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.993+0000 7f2c62f83700 1 -- 172.21.15.47:0/1555864789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5c0fbe80 msgr2=0x7f2c5c0fc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:25.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.993+0000 7f2c62f83700 1 --2- 172.21.15.47:0/1555864789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5c0fbe80 0x7f2c5c0fc290 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009ce0 tx=0x7f2c54004d10 comp rx=0 tx=0).stop 2024-02-07T12:34:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.993+0000 7f2c62f83700 1 -- 172.21.15.47:0/1555864789 shutdown_connections 2024-02-07T12:34:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.993+0000 7f2c62f83700 1 --2- 172.21.15.47:0/1555864789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c5c0fd080 0x7f2c5c0fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.993+0000 7f2c62f83700 1 --2- 172.21.15.47:0/1555864789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5c0fbe80 0x7f2c5c0fc290 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.993+0000 7f2c62f83700 1 -- 172.21.15.47:0/1555864789 >> 172.21.15.47:0/1555864789 conn(0x7f2c5c0f7590 msgr2=0x7f2c5c0f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.993+0000 7f2c62f83700 1 -- 172.21.15.47:0/1555864789 shutdown_connections 2024-02-07T12:34:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.993+0000 7f2c62f83700 1 -- 172.21.15.47:0/1555864789 wait complete. 2024-02-07T12:34:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.993+0000 7f2c62f83700 1 Processor -- start 2024-02-07T12:34:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.993+0000 7f2c62f83700 1 -- start start 2024-02-07T12:34:25.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c62f83700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c5c0fbe80 0x7f2c5c1107a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:25.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c62f83700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5c0fd080 0x7f2c5c112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c62f83700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c066d10 con 0x7f2c5c0fd080 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c62f83700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c066e50 con 0x7f2c5c0fbe80 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c5bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5c0fd080 0x7f2c5c112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c5bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5c0fd080 0x7f2c5c112cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47262/0 (socket says 172.21.15.47:47262) 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c5bfff700 1 -- 172.21.15.47:0/1445346146 learned_addr learned my addr 172.21.15.47:0/1445346146 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c60d1f700 1 --2- 172.21.15.47:0/1445346146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c5c0fbe80 0x7f2c5c1107a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c5bfff700 1 -- 172.21.15.47:0/1445346146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c5c0fbe80 msgr2=0x7f2c5c1107a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c5bfff700 1 --2- 172.21.15.47:0/1445346146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c5c0fbe80 0x7f2c5c1107a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c5bfff700 1 -- 172.21.15.47:0/1445346146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c54009940 con 0x7f2c5c0fd080 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c60d1f700 1 --2- 172.21.15.47:0/1445346146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c5c0fbe80 0x7f2c5c1107a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c5bfff700 1 --2- 172.21.15.47:0/1445346146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5c0fd080 0x7f2c5c112cf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2c50002a80 tx=0x7f2c500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.994+0000 7f2c597fa700 1 -- 172.21.15.47:0/1445346146 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c50007cc0 con 0x7f2c5c0fd080 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.995+0000 7f2c597fa700 1 -- 172.21.15.47:0/1445346146 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c5000f040 con 0x7f2c5c0fd080 2024-02-07T12:34:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.995+0000 7f2c62f83700 1 -- 172.21.15.47:0/1445346146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c5c1132f0 con 0x7f2c5c0fd080 2024-02-07T12:34:25.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.995+0000 7f2c62f83700 1 -- 172.21.15.47:0/1445346146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c5c113830 con 0x7f2c5c0fd080 2024-02-07T12:34:25.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.995+0000 7f2c597fa700 1 -- 172.21.15.47:0/1445346146 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c5000dac0 con 0x7f2c5c0fd080 2024-02-07T12:34:25.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.996+0000 7f2c62f83700 1 -- 172.21.15.47:0/1445346146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c480052e0 con 0x7f2c5c0fd080 2024-02-07T12:34:25.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.996+0000 7f2c597fa700 1 -- 172.21.15.47:0/1445346146 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f2c5000dd20 con 0x7f2c5c0fd080 2024-02-07T12:34:26.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.997+0000 7f2c597fa700 1 --2- 172.21.15.47:0/1445346146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2c4406d7e0 0x7f2c4406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:26.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.997+0000 7f2c60d1f700 1 --2- 172.21.15.47:0/1445346146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2c4406d7e0 0x7f2c4406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:26.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.997+0000 7f2c597fa700 1 -- 172.21.15.47:0/1445346146 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2c5008cab0 con 0x7f2c5c0fd080 2024-02-07T12:34:26.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:25.997+0000 7f2c60d1f700 1 --2- 172.21.15.47:0/1445346146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2c4406d7e0 0x7f2c4406fc90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009cb0 tx=0x7f2c54004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:26.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.001+0000 7f2c597fa700 1 -- 172.21.15.47:0/1445346146 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2c50056420 con 0x7f2c5c0fd080 2024-02-07T12:34:26.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.289+0000 7f2c62f83700 1 -- 172.21.15.47:0/1445346146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2c48005da0 con 0x7f2c5c0fd080 2024-02-07T12:34:26.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.289+0000 7f2c597fa700 1 -- 172.21.15.47:0/1445346146 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f2c50059ae0 con 0x7f2c5c0fd080 2024-02-07T12:34:26.292 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:34:26.292 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:34:26.292 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:34:26.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:34:26.292 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:34:26.292 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:34:26.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:34:26.292 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:34:26.292 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 6 2024-02-07T12:34:26.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:34:26.293 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:34:26.293 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2, 2024-02-07T12:34:26.293 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:34:26.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:34:26.293 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:34:26.293 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 17.2.7-491-gf2462625 (f246262574ca5be9ad8a5df4a03f9915c136ce44) quincy (stable)": 2, 2024-02-07T12:34:26.293 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 12 2024-02-07T12:34:26.293 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:34:26.293 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:34:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.292+0000 7f2c62f83700 1 -- 172.21.15.47:0/1445346146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2c4406d7e0 msgr2=0x7f2c4406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.292+0000 7f2c62f83700 1 --2- 172.21.15.47:0/1445346146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2c4406d7e0 0x7f2c4406fc90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009cb0 tx=0x7f2c54004d10 comp rx=0 tx=0).stop 2024-02-07T12:34:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.292+0000 7f2c62f83700 1 -- 172.21.15.47:0/1445346146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5c0fd080 msgr2=0x7f2c5c112cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.292+0000 7f2c62f83700 1 --2- 172.21.15.47:0/1445346146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5c0fd080 0x7f2c5c112cf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2c50002a80 tx=0x7f2c500046b0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.292+0000 7f2c62f83700 1 -- 172.21.15.47:0/1445346146 shutdown_connections 2024-02-07T12:34:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.292+0000 7f2c62f83700 1 --2- 172.21.15.47:0/1445346146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2c4406d7e0 0x7f2c4406fc90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.292+0000 7f2c62f83700 1 --2- 172.21.15.47:0/1445346146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c5c0fbe80 0x7f2c5c1107a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.292+0000 7f2c62f83700 1 --2- 172.21.15.47:0/1445346146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5c0fd080 0x7f2c5c112cf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.292+0000 7f2c62f83700 1 -- 172.21.15.47:0/1445346146 >> 172.21.15.47:0/1445346146 conn(0x7f2c5c0f7590 msgr2=0x7f2c5c1002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.292+0000 7f2c62f83700 1 -- 172.21.15.47:0/1445346146 shutdown_connections 2024-02-07T12:34:26.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.292+0000 7f2c62f83700 1 -- 172.21.15.47:0/1445346146 wait complete. 2024-02-07T12:34:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.394+0000 7f8860900700 1 -- 172.21.15.47:0/505719338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c0fb220 msgr2=0x7f885c0fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.394+0000 7f8860900700 1 --2- 172.21.15.47:0/505719338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c0fb220 0x7f885c0fb630 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f884c004940 tx=0x7f884c009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.394+0000 7f8860900700 1 -- 172.21.15.47:0/505719338 shutdown_connections 2024-02-07T12:34:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.394+0000 7f8860900700 1 --2- 172.21.15.47:0/505719338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f885c0fe2b0 0x7f885c0fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.394+0000 7f8860900700 1 --2- 172.21.15.47:0/505719338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c0fb220 0x7f885c0fb630 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.395+0000 7f8860900700 1 -- 172.21.15.47:0/505719338 >> 172.21.15.47:0/505719338 conn(0x7f885c0f6ca0 msgr2=0x7f885c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.395+0000 7f8860900700 1 -- 172.21.15.47:0/505719338 shutdown_connections 2024-02-07T12:34:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.395+0000 7f8860900700 1 -- 172.21.15.47:0/505719338 wait complete. 2024-02-07T12:34:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.395+0000 7f8860900700 1 Processor -- start 2024-02-07T12:34:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.395+0000 7f8860900700 1 -- start start 2024-02-07T12:34:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.395+0000 7f8860900700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f885c0fb220 0x7f885c0fdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.395+0000 7f8860900700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c0fe2b0 0x7f885c0fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.395+0000 7f8860900700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0fc7c0 con 0x7f885c0fe2b0 2024-02-07T12:34:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.395+0000 7f8860900700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0fc930 con 0x7f885c0fb220 2024-02-07T12:34:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.395+0000 7f8859d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c0fe2b0 0x7f885c0fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.395+0000 7f8859d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c0fe2b0 0x7f885c0fc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47274/0 (socket says 172.21.15.47:47274) 2024-02-07T12:34:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.395+0000 7f8859d9b700 1 -- 172.21.15.47:0/1136665279 learned_addr learned my addr 172.21.15.47:0/1136665279 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.395+0000 7f885a59c700 1 --2- 172.21.15.47:0/1136665279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f885c0fb220 0x7f885c0fdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.396+0000 7f8859d9b700 1 -- 172.21.15.47:0/1136665279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f885c0fb220 msgr2=0x7f885c0fdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.396+0000 7f8859d9b700 1 --2- 172.21.15.47:0/1136665279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f885c0fb220 0x7f885c0fdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.396+0000 7f8859d9b700 1 -- 172.21.15.47:0/1136665279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c005040 con 0x7f885c0fe2b0 2024-02-07T12:34:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.396+0000 7f8859d9b700 1 --2- 172.21.15.47:0/1136665279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c0fe2b0 0x7f885c0fc1c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f885000eb40 tx=0x7f885000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.396+0000 7f884affd700 1 -- 172.21.15.47:0/1136665279 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8850007cc0 con 0x7f885c0fe2b0 2024-02-07T12:34:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.396+0000 7f884affd700 1 -- 172.21.15.47:0/1136665279 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f885000f040 con 0x7f885c0fe2b0 2024-02-07T12:34:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.396+0000 7f8860900700 1 -- 172.21.15.47:0/1136665279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c0fcbb0 con 0x7f885c0fe2b0 2024-02-07T12:34:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.396+0000 7f884affd700 1 -- 172.21.15.47:0/1136665279 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f885000ca10 con 0x7f885c0fe2b0 2024-02-07T12:34:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.396+0000 7f8860900700 1 -- 172.21.15.47:0/1136665279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c1159b0 con 0x7f885c0fe2b0 2024-02-07T12:34:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.397+0000 7f8860900700 1 -- 172.21.15.47:0/1136665279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c04bed0 con 0x7f885c0fe2b0 2024-02-07T12:34:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.397+0000 7f884affd700 1 -- 172.21.15.47:0/1136665279 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f885000cb70 con 0x7f885c0fe2b0 2024-02-07T12:34:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.398+0000 7f884affd700 1 --2- 172.21.15.47:0/1136665279 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f884406d7e0 0x7f884406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.398+0000 7f884affd700 1 -- 172.21.15.47:0/1136665279 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f885008ca70 con 0x7f885c0fe2b0 2024-02-07T12:34:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.398+0000 7f885a59c700 1 --2- 172.21.15.47:0/1136665279 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f884406d7e0 0x7f884406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.398+0000 7f885a59c700 1 --2- 172.21.15.47:0/1136665279 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f884406d7e0 0x7f884406fc90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f884c000c00 tx=0x7f884c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:26.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.402+0000 7f884affd700 1 -- 172.21.15.47:0/1136665279 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8850059e70 con 0x7f885c0fe2b0 2024-02-07T12:34:26.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: pgmap v216: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-07T12:34:26.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:34:26.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:26.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:26.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:34:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:34:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi138.jhsygn"]}]: dispatch 2024-02-07T12:34:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: Upgrade: It appears safe to stop mds.cephfs.smithi138.jhsygn 2024-02-07T12:34:26.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:26 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1445346146' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:26.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.648+0000 7f8860900700 1 -- 172.21.15.47:0/1136665279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f885c115dd0 con 0x7f885c0fe2b0 2024-02-07T12:34:26.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.648+0000 7f884affd700 1 -- 172.21.15.47:0/1136665279 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 40 v40) v1 ==== 76+0+1873 (secure 0 0 0) 0x7f8850059a00 con 0x7f885c0fe2b0 2024-02-07T12:34:26.651 INFO:teuthology.orchestra.run.smithi047.stdout:e40 2024-02-07T12:34:26.651 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:34:26.651 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:34:26.651 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:34:26.651 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:34:26.651 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:34:26.651 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:34:26.651 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 39 2024-02-07T12:34:26.651 INFO:teuthology.orchestra.run.smithi047.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-07T12:34:26.651 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:34:26.651 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:34:12.310515+0000 2024-02-07T12:34:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:34:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:34:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:34:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:34:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:34:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:34:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:34:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:34:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 84 2024-02-07T12:34:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-07T12:34:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 1 2024-02-07T12:34:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:in 0 2024-02-07T12:34:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=34428} 2024-02-07T12:34:26.653 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:34:26.653 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:34:26.653 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 1 2024-02-07T12:34:26.653 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:34:26.653 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:34:26.653 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:34:26.653 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:34:26.653 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:34:26.653 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:34:26.653 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:34428} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:34:26.653 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:34:26.653 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:34:26.653 INFO:teuthology.orchestra.run.smithi047.stdout:Standby daemons: 2024-02-07T12:34:26.654 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:34:26.654 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{-1:34460} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.47:6828/3723006072,v1:172.21.15.47:6829/3723006072] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:34:26.654 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{-1:44283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.138:6825/2036333358,v1:172.21.15.138:6826/2036333358] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:34:26.654 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/1793209176,v1:172.21.15.138:6827/1793209176] compat {c=[1],r=[1],i=[7ff]}] 2024-02-07T12:34:26.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.650+0000 7f8860900700 1 -- 172.21.15.47:0/1136665279 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f884406d7e0 msgr2=0x7f884406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:26.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.650+0000 7f8860900700 1 --2- 172.21.15.47:0/1136665279 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f884406d7e0 0x7f884406fc90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f884c000c00 tx=0x7f884c009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:26.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.650+0000 7f8860900700 1 -- 172.21.15.47:0/1136665279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c0fe2b0 msgr2=0x7f885c0fc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:26.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.650+0000 7f8860900700 1 --2- 172.21.15.47:0/1136665279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c0fe2b0 0x7f885c0fc1c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f885000eb40 tx=0x7f885000b040 comp rx=0 tx=0).stop 2024-02-07T12:34:26.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.651+0000 7f8860900700 1 -- 172.21.15.47:0/1136665279 shutdown_connections 2024-02-07T12:34:26.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.651+0000 7f8860900700 1 --2- 172.21.15.47:0/1136665279 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f884406d7e0 0x7f884406fc90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.651+0000 7f8860900700 1 --2- 172.21.15.47:0/1136665279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f885c0fb220 0x7f885c0fdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.651+0000 7f8860900700 1 --2- 172.21.15.47:0/1136665279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c0fe2b0 0x7f885c0fc1c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.651+0000 7f8860900700 1 -- 172.21.15.47:0/1136665279 >> 172.21.15.47:0/1136665279 conn(0x7f885c0f6ca0 msgr2=0x7f885c1014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:26.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.651+0000 7f8860900700 1 -- 172.21.15.47:0/1136665279 shutdown_connections 2024-02-07T12:34:26.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.651+0000 7f8860900700 1 -- 172.21.15.47:0/1136665279 wait complete. 2024-02-07T12:34:26.655 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 40 2024-02-07T12:34:26.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.756+0000 7f13c30c9700 1 -- 172.21.15.47:0/1905281734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13bc1003a0 msgr2=0x7f13bc102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:26.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.756+0000 7f13c30c9700 1 --2- 172.21.15.47:0/1905281734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13bc1003a0 0x7f13bc102780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f13b0004940 tx=0x7f13b0009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:26.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.756+0000 7f13c30c9700 1 -- 172.21.15.47:0/1905281734 shutdown_connections 2024-02-07T12:34:26.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.756+0000 7f13c30c9700 1 --2- 172.21.15.47:0/1905281734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13bc1003a0 0x7f13bc102780 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.756+0000 7f13c30c9700 1 --2- 172.21.15.47:0/1905281734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13bc0fda80 0x7f13bc0ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.756+0000 7f13c30c9700 1 -- 172.21.15.47:0/1905281734 >> 172.21.15.47:0/1905281734 conn(0x7f13bc0f74e0 msgr2=0x7f13bc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:26.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.756+0000 7f13c30c9700 1 -- 172.21.15.47:0/1905281734 shutdown_connections 2024-02-07T12:34:26.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.756+0000 7f13c30c9700 1 -- 172.21.15.47:0/1905281734 wait complete. 2024-02-07T12:34:26.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.756+0000 7f13c30c9700 1 Processor -- start 2024-02-07T12:34:26.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.756+0000 7f13c30c9700 1 -- start start 2024-02-07T12:34:26.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13c30c9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13bc0fda80 0x7f13bc0fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13c30c9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13bc1003a0 0x7f13bc0fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13c30c9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0fbf90 con 0x7f13bc0fda80 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13c30c9700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0fc100 con 0x7f13bc1003a0 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13c0e65700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13bc0fda80 0x7f13bc0fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13c0e65700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13bc0fda80 0x7f13bc0fd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47292/0 (socket says 172.21.15.47:47292) 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13c0e65700 1 -- 172.21.15.47:0/2485286607 learned_addr learned my addr 172.21.15.47:0/2485286607 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13bbfff700 1 --2- 172.21.15.47:0/2485286607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13bc1003a0 0x7f13bc0fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13c0e65700 1 -- 172.21.15.47:0/2485286607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13bc1003a0 msgr2=0x7f13bc0fb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13c0e65700 1 --2- 172.21.15.47:0/2485286607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13bc1003a0 0x7f13bc0fb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13c0e65700 1 -- 172.21.15.47:0/2485286607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b0005040 con 0x7f13bc0fda80 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13bbfff700 1 --2- 172.21.15.47:0/2485286607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13bc1003a0 0x7f13bc0fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13c0e65700 1 --2- 172.21.15.47:0/2485286607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13bc0fda80 0x7f13bc0fd510 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f13ac002a50 tx=0x7f13ac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13b97fa700 1 -- 172.21.15.47:0/2485286607 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13ac007cc0 con 0x7f13bc0fda80 2024-02-07T12:34:26.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13b97fa700 1 -- 172.21.15.47:0/2485286607 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13ac00f040 con 0x7f13bc0fda80 2024-02-07T12:34:26.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13c30c9700 1 -- 172.21.15.47:0/2485286607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc0fc3e0 con 0x7f13bc0fda80 2024-02-07T12:34:26.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.757+0000 7f13b97fa700 1 -- 172.21.15.47:0/2485286607 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13ac00da30 con 0x7f13bc0fda80 2024-02-07T12:34:26.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.758+0000 7f13c30c9700 1 -- 172.21.15.47:0/2485286607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13bc115970 con 0x7f13bc0fda80 2024-02-07T12:34:26.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.758+0000 7f13c30c9700 1 -- 172.21.15.47:0/2485286607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13bc04bed0 con 0x7f13bc0fda80 2024-02-07T12:34:26.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.759+0000 7f13b97fa700 1 -- 172.21.15.47:0/2485286607 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f13ac00db90 con 0x7f13bc0fda80 2024-02-07T12:34:26.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.759+0000 7f13b97fa700 1 --2- 172.21.15.47:0/2485286607 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f13a406d7f0 0x7f13a406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:26.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.759+0000 7f13b97fa700 1 -- 172.21.15.47:0/2485286607 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f13ac08cd20 con 0x7f13bc0fda80 2024-02-07T12:34:26.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.759+0000 7f13bbfff700 1 --2- 172.21.15.47:0/2485286607 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f13a406d7f0 0x7f13a406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:26.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.760+0000 7f13bbfff700 1 --2- 172.21.15.47:0/2485286607 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f13a406d7f0 0x7f13a406fca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f13b000b3b0 tx=0x7f13b0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:26.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.764+0000 7f13b97fa700 1 -- 172.21.15.47:0/2485286607 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f13ac059ff0 con 0x7f13bc0fda80 2024-02-07T12:34:26.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: pgmap v216: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi138.jhsygn"]}]: dispatch 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: Upgrade: It appears safe to stop mds.cephfs.smithi138.jhsygn 2024-02-07T12:34:26.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:26 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1445346146' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:26.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.988+0000 7f13c30c9700 1 -- 172.21.15.47:0/2485286607 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13bc101000 con 0x7f13a406d7f0 2024-02-07T12:34:26.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.989+0000 7f13b97fa700 1 -- 172.21.15.47:0/2485286607 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f13bc101000 con 0x7f13a406d7f0 2024-02-07T12:34:26.992 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:34:26.992 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:34:26.992 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:34:26.992 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:34:26.992 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:34:26.992 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-02-07T12:34:26.992 INFO:teuthology.orchestra.run.smithi047.stdout: "osd", 2024-02-07T12:34:26.992 INFO:teuthology.orchestra.run.smithi047.stdout: "mon", 2024-02-07T12:34:26.993 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr" 2024-02-07T12:34:26.993 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:34:26.993 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "14/21 daemons upgraded", 2024-02-07T12:34:26.993 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading mds daemons", 2024-02-07T12:34:26.993 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:34:26.993 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:34:26.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.991+0000 7f13c30c9700 1 -- 172.21.15.47:0/2485286607 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f13a406d7f0 msgr2=0x7f13a406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:26.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.991+0000 7f13c30c9700 1 --2- 172.21.15.47:0/2485286607 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f13a406d7f0 0x7f13a406fca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f13b000b3b0 tx=0x7f13b0009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:26.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.991+0000 7f13c30c9700 1 -- 172.21.15.47:0/2485286607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13bc0fda80 msgr2=0x7f13bc0fd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:26.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.991+0000 7f13c30c9700 1 --2- 172.21.15.47:0/2485286607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13bc0fda80 0x7f13bc0fd510 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f13ac002a50 tx=0x7f13ac0046b0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.992+0000 7f13c30c9700 1 -- 172.21.15.47:0/2485286607 shutdown_connections 2024-02-07T12:34:26.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.992+0000 7f13c30c9700 1 --2- 172.21.15.47:0/2485286607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13bc0fda80 0x7f13bc0fd510 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.992+0000 7f13c30c9700 1 --2- 172.21.15.47:0/2485286607 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f13a406d7f0 0x7f13a406fca0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.992+0000 7f13c30c9700 1 --2- 172.21.15.47:0/2485286607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13bc1003a0 0x7f13bc0fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:26.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.992+0000 7f13c30c9700 1 -- 172.21.15.47:0/2485286607 >> 172.21.15.47:0/2485286607 conn(0x7f13bc0f74e0 msgr2=0x7f13bc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:26.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.992+0000 7f13c30c9700 1 -- 172.21.15.47:0/2485286607 shutdown_connections 2024-02-07T12:34:26.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:26.992+0000 7f13c30c9700 1 -- 172.21.15.47:0/2485286607 wait complete. 2024-02-07T12:34:27.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.095+0000 7f0f09609700 1 -- 172.21.15.47:0/4220482581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f04066c30 msgr2=0x7f0f040ffb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:27.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.095+0000 7f0f09609700 1 --2- 172.21.15.47:0/4220482581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f04066c30 0x7f0f040ffb40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009ce0 tx=0x7f0ef4004d10 comp rx=0 tx=0).stop 2024-02-07T12:34:27.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.095+0000 7f0f09609700 1 -- 172.21.15.47:0/4220482581 shutdown_connections 2024-02-07T12:34:27.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.095+0000 7f0f09609700 1 --2- 172.21.15.47:0/4220482581 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f04100110 0x7f0f04102530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:27.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.095+0000 7f0f09609700 1 --2- 172.21.15.47:0/4220482581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f04066c30 0x7f0f040ffb40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:27.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.095+0000 7f0f09609700 1 -- 172.21.15.47:0/4220482581 >> 172.21.15.47:0/4220482581 conn(0x7f0f040f7510 msgr2=0x7f0f040f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:27.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.095+0000 7f0f09609700 1 -- 172.21.15.47:0/4220482581 shutdown_connections 2024-02-07T12:34:27.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.095+0000 7f0f09609700 1 -- 172.21.15.47:0/4220482581 wait complete. 2024-02-07T12:34:27.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.095+0000 7f0f09609700 1 Processor -- start 2024-02-07T12:34:27.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0f09609700 1 -- start start 2024-02-07T12:34:27.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0f09609700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f04066c30 0x7f0f040fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:27.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0f09609700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f04100110 0x7f0f040fba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:27.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0f09609700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040fc040 con 0x7f0f04100110 2024-02-07T12:34:27.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0f09609700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040fc1b0 con 0x7f0f04066c30 2024-02-07T12:34:27.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0f027fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f04100110 0x7f0f040fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:27.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0f027fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f04100110 0x7f0f040fba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47314/0 (socket says 172.21.15.47:47314) 2024-02-07T12:34:27.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0f027fc700 1 -- 172.21.15.47:0/2937256314 learned_addr learned my addr 172.21.15.47:0/2937256314 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:27.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0f02ffd700 1 --2- 172.21.15.47:0/2937256314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f04066c30 0x7f0f040fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:27.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0f027fc700 1 -- 172.21.15.47:0/2937256314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f04066c30 msgr2=0x7f0f040fd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:27.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0f027fc700 1 --2- 172.21.15.47:0/2937256314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f04066c30 0x7f0f040fd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:27.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0f027fc700 1 -- 172.21.15.47:0/2937256314 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef4009940 con 0x7f0f04100110 2024-02-07T12:34:27.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0f027fc700 1 --2- 172.21.15.47:0/2937256314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f04100110 0x7f0f040fba40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0eec002a50 tx=0x7f0eec004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:27.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.096+0000 7f0efb7fe700 1 -- 172.21.15.47:0/2937256314 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eec007cc0 con 0x7f0f04100110 2024-02-07T12:34:27.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.097+0000 7f0f09609700 1 -- 172.21.15.47:0/2937256314 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f040fc490 con 0x7f0f04100110 2024-02-07T12:34:27.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.097+0000 7f0efb7fe700 1 -- 172.21.15.47:0/2937256314 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0eec00f040 con 0x7f0f04100110 2024-02-07T12:34:27.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.097+0000 7f0efb7fe700 1 -- 172.21.15.47:0/2937256314 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eec00d9c0 con 0x7f0f04100110 2024-02-07T12:34:27.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.097+0000 7f0f09609700 1 -- 172.21.15.47:0/2937256314 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f04115b20 con 0x7f0f04100110 2024-02-07T12:34:27.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.098+0000 7f0f09609700 1 -- 172.21.15.47:0/2937256314 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0404bed0 con 0x7f0f04100110 2024-02-07T12:34:27.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.098+0000 7f0efb7fe700 1 -- 172.21.15.47:0/2937256314 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0eec009730 con 0x7f0f04100110 2024-02-07T12:34:27.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.098+0000 7f0efb7fe700 1 --2- 172.21.15.47:0/2937256314 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0ef006d7e0 0x7f0ef006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:27.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.099+0000 7f0efb7fe700 1 -- 172.21.15.47:0/2937256314 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0eec08ccf0 con 0x7f0f04100110 2024-02-07T12:34:27.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.099+0000 7f0f02ffd700 1 --2- 172.21.15.47:0/2937256314 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0ef006d7e0 0x7f0ef006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:27.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.099+0000 7f0f02ffd700 1 --2- 172.21.15.47:0/2937256314 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0ef006d7e0 0x7f0ef006fc90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009470 tx=0x7f0ef4004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:27.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.103+0000 7f0efb7fe700 1 -- 172.21.15.47:0/2937256314 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0eec059fc0 con 0x7f0f04100110 2024-02-07T12:34:27.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.390+0000 7f0f09609700 1 -- 172.21.15.47:0/2937256314 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0f04115f00 con 0x7f0f04100110 2024-02-07T12:34:27.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.391+0000 7f0efb7fe700 1 -- 172.21.15.47:0/2937256314 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0eec059b50 con 0x7f0f04100110 2024-02-07T12:34:27.393 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:34:27.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.393+0000 7f0f09609700 1 -- 172.21.15.47:0/2937256314 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0ef006d7e0 msgr2=0x7f0ef006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:27.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.393+0000 7f0f09609700 1 --2- 172.21.15.47:0/2937256314 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0ef006d7e0 0x7f0ef006fc90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009470 tx=0x7f0ef4004d10 comp rx=0 tx=0).stop 2024-02-07T12:34:27.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.393+0000 7f0f09609700 1 -- 172.21.15.47:0/2937256314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f04100110 msgr2=0x7f0f040fba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:27.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.393+0000 7f0f09609700 1 --2- 172.21.15.47:0/2937256314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f04100110 0x7f0f040fba40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0eec002a50 tx=0x7f0eec004600 comp rx=0 tx=0).stop 2024-02-07T12:34:27.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.393+0000 7f0f09609700 1 -- 172.21.15.47:0/2937256314 shutdown_connections 2024-02-07T12:34:27.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.393+0000 7f0f09609700 1 --2- 172.21.15.47:0/2937256314 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0ef006d7e0 0x7f0ef006fc90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:27.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.393+0000 7f0f09609700 1 --2- 172.21.15.47:0/2937256314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f04066c30 0x7f0f040fd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:27.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.393+0000 7f0f09609700 1 --2- 172.21.15.47:0/2937256314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f04100110 0x7f0f040fba40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:27.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.393+0000 7f0f09609700 1 -- 172.21.15.47:0/2937256314 >> 172.21.15.47:0/2937256314 conn(0x7f0f040f7510 msgr2=0x7f0f040f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:27.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.393+0000 7f0f09609700 1 -- 172.21.15.47:0/2937256314 shutdown_connections 2024-02-07T12:34:27.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:27.393+0000 7f0f09609700 1 -- 172.21.15.47:0/2937256314 wait complete. 2024-02-07T12:34:27.760 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:27 smithi138 ceph-mon[82055]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:34:27.760 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:27 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1136665279' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:34:27.760 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:27.760 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:34:27.760 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:27.760 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.jhsygn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:34:27.761 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:27.761 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:27 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2937256314' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:34:27.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:27 smithi047 ceph-mon[93224]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:34:27.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:27 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1136665279' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:34:27.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:27.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:34:27.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:27.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.jhsygn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:34:27.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:27.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:27 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2937256314' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:34:28.726 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:28 smithi138 ceph-mon[82055]: pgmap v217: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.3 KiB/s wr, 3 op/s 2024-02-07T12:34:28.726 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:28 smithi138 ceph-mon[82055]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:34:28.726 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:28 smithi138 ceph-mon[82055]: Upgrade: Updating mds.cephfs.smithi138.jhsygn 2024-02-07T12:34:28.726 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:28 smithi138 ceph-mon[82055]: Deploying daemon mds.cephfs.smithi138.jhsygn on smithi138 2024-02-07T12:34:28.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:28 smithi047 ceph-mon[93224]: pgmap v217: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.3 KiB/s wr, 3 op/s 2024-02-07T12:34:28.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:28 smithi047 ceph-mon[93224]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:34:28.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:28 smithi047 ceph-mon[93224]: Upgrade: Updating mds.cephfs.smithi138.jhsygn 2024-02-07T12:34:28.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:28 smithi047 ceph-mon[93224]: Deploying daemon mds.cephfs.smithi138.jhsygn on smithi138 2024-02-07T12:34:30.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:30 smithi138 ceph-mon[82055]: pgmap v218: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-02-07T12:34:30.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:30 smithi138 ceph-mon[82055]: osdmap e85: 6 total, 6 up, 6 in 2024-02-07T12:34:30.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:30 smithi138 ceph-mon[82055]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 2 up:standby 2024-02-07T12:34:30.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:30 smithi047 ceph-mon[93224]: pgmap v218: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-02-07T12:34:30.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:30 smithi047 ceph-mon[93224]: osdmap e85: 6 total, 6 up, 6 in 2024-02-07T12:34:30.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:30 smithi047 ceph-mon[93224]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 2 up:standby 2024-02-07T12:34:32.680 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:32 smithi138 ceph-mon[82055]: pgmap v220: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:32.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:32 smithi047 ceph-mon[93224]: pgmap v220: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:34.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:33 smithi138 ceph-mon[82055]: pgmap v221: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:34.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:34.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:34.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:34.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:33 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.138:6825/3547121337,v1:172.21.15.138:6826/3547121337] up:boot 2024-02-07T12:34:34.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:33 smithi138 ceph-mon[82055]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 3 up:standby 2024-02-07T12:34:34.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:34:34.327 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:33 smithi047 ceph-mon[93224]: pgmap v221: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:34.328 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:34.328 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:34.328 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:34.328 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:33 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.138:6825/3547121337,v1:172.21.15.138:6826/3547121337] up:boot 2024-02-07T12:34:34.328 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:33 smithi047 ceph-mon[93224]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 3 up:standby 2024-02-07T12:34:34.328 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:34:36.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:35 smithi138 ceph-mon[82055]: pgmap v222: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:36.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:35 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:36.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:35 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:36.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:35 smithi047 ceph-mon[93224]: pgmap v222: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:36.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:35 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:36.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:35 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:38.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:37 smithi138 ceph-mon[82055]: pgmap v223: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:38.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:38.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:38.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:37 smithi047 ceph-mon[93224]: pgmap v223: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:38.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:38.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:40.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:40 smithi138 ceph-mon[82055]: pgmap v224: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:40.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:40 smithi047 ceph-mon[93224]: pgmap v224: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:41.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:41 smithi138 ceph-mon[82055]: Detected new or changed devices on smithi138 2024-02-07T12:34:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:34:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi138.axpdsx"]}]: dispatch 2024-02-07T12:34:41.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:41 smithi138 ceph-mon[82055]: Upgrade: It appears safe to stop mds.cephfs.smithi138.axpdsx 2024-02-07T12:34:41.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:41 smithi047 ceph-mon[93224]: Detected new or changed devices on smithi138 2024-02-07T12:34:41.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:41.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:34:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi138.axpdsx"]}]: dispatch 2024-02-07T12:34:41.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:41 smithi047 ceph-mon[93224]: Upgrade: It appears safe to stop mds.cephfs.smithi138.axpdsx 2024-02-07T12:34:42.719 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:42 smithi138 ceph-mon[82055]: pgmap v225: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:42.719 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:34:42.719 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:42.719 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.axpdsx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:34:42.720 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:42.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:42 smithi047 ceph-mon[93224]: pgmap v225: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:42.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:34:42.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:42.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.axpdsx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-07T12:34:42.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:43.719 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:43 smithi138 ceph-mon[82055]: Upgrade: Updating mds.cephfs.smithi138.axpdsx 2024-02-07T12:34:43.719 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:43 smithi138 ceph-mon[82055]: Deploying daemon mds.cephfs.smithi138.axpdsx on smithi138 2024-02-07T12:34:43.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:43 smithi047 ceph-mon[93224]: Upgrade: Updating mds.cephfs.smithi138.axpdsx 2024-02-07T12:34:43.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:43 smithi047 ceph-mon[93224]: Deploying daemon mds.cephfs.smithi138.axpdsx on smithi138 2024-02-07T12:34:44.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:44 smithi138 ceph-mon[82055]: pgmap v226: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:44.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:44 smithi047 ceph-mon[93224]: pgmap v226: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:45.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:45 smithi138 ceph-mon[82055]: osdmap e86: 6 total, 6 up, 6 in 2024-02-07T12:34:45.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:45 smithi138 ceph-mon[82055]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 2 up:standby 2024-02-07T12:34:45.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:45 smithi047 ceph-mon[93224]: osdmap e86: 6 total, 6 up, 6 in 2024-02-07T12:34:45.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:45 smithi047 ceph-mon[93224]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 2 up:standby 2024-02-07T12:34:46.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:46 smithi138 ceph-mon[82055]: pgmap v228: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:46.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:46 smithi047 ceph-mon[93224]: pgmap v228: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:47.616 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:47 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:34:47.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:47 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:34:48.690 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:48 smithi138 ceph-mon[82055]: pgmap v229: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:48.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:48 smithi047 ceph-mon[93224]: pgmap v229: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:50.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:49 smithi138 ceph-mon[82055]: pgmap v230: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:50.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:50.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:50.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:50.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:49 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.138:6824/2689114398,v1:172.21.15.138:6827/2689114398] up:boot 2024-02-07T12:34:50.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:49 smithi138 ceph-mon[82055]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 3 up:standby 2024-02-07T12:34:50.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:34:50.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:49 smithi047 ceph-mon[93224]: pgmap v230: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:50.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:50.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:50.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:50.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:49 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.138:6824/2689114398,v1:172.21.15.138:6827/2689114398] up:boot 2024-02-07T12:34:50.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:49 smithi047 ceph-mon[93224]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 3 up:standby 2024-02-07T12:34:50.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:34:52.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:52 smithi047 ceph-mon[93224]: pgmap v231: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:52.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:52.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:52 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:52.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:52 smithi138 ceph-mon[82055]: pgmap v231: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:52.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:52.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:52 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:53.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:53 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:53.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:53 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:53 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:53.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:53 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:54.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:54 smithi138 ceph-mon[82055]: pgmap v232: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:54.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:54 smithi047 ceph-mon[93224]: pgmap v232: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:56.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: pgmap v233: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:34:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: Upgrade: Setting container_image for all mds 2024-02-07T12:34:56.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:56.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:34:56.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.jsgfge"}]': finished 2024-02-07T12:34:56.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:34:56.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.lagmef"}]': finished 2024-02-07T12:34:56.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:34:56.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.axpdsx"}]': finished 2024-02-07T12:34:56.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:34:56.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.jhsygn"}]': finished 2024-02-07T12:34:56.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-02-07T12:34:56.786 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:56 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-07T12:34:56.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: pgmap v233: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail 2024-02-07T12:34:56.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:56.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:56.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:34:56.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:34:56.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:56.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:34:56.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:56.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:56.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:56.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:56.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:56.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: Upgrade: Setting container_image for all mds 2024-02-07T12:34:56.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:56.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.jsgfge"}]: dispatch 2024-02-07T12:34:56.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.jsgfge"}]': finished 2024-02-07T12:34:56.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.lagmef"}]: dispatch 2024-02-07T12:34:56.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.lagmef"}]': finished 2024-02-07T12:34:56.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.axpdsx"}]: dispatch 2024-02-07T12:34:56.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.axpdsx"}]': finished 2024-02-07T12:34:56.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.jhsygn"}]: dispatch 2024-02-07T12:34:56.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.jhsygn"}]': finished 2024-02-07T12:34:56.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-02-07T12:34:56.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:56 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-07T12:34:57.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.511+0000 7f83e5a40700 1 -- 172.21.15.47:0/2030616401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83e00fe0e0 msgr2=0x7f83e00fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:57.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.511+0000 7f83e5a40700 1 --2- 172.21.15.47:0/2030616401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83e00fe0e0 0x7f83e00fe550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f83d0004940 tx=0x7f83d0009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:57.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.511+0000 7f83e5a40700 1 -- 172.21.15.47:0/2030616401 shutdown_connections 2024-02-07T12:34:57.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.511+0000 7f83e5a40700 1 --2- 172.21.15.47:0/2030616401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83e00fe0e0 0x7f83e00fe550 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:57.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.511+0000 7f83e5a40700 1 --2- 172.21.15.47:0/2030616401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83e00fcef0 0x7f83e00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:57.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.511+0000 7f83e5a40700 1 -- 172.21.15.47:0/2030616401 >> 172.21.15.47:0/2030616401 conn(0x7f83e00f8620 msgr2=0x7f83e00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:57.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.511+0000 7f83e5a40700 1 -- 172.21.15.47:0/2030616401 shutdown_connections 2024-02-07T12:34:57.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.511+0000 7f83e5a40700 1 -- 172.21.15.47:0/2030616401 wait complete. 2024-02-07T12:34:57.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.512+0000 7f83e5a40700 1 Processor -- start 2024-02-07T12:34:57.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.512+0000 7f83e5a40700 1 -- start start 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.512+0000 7f83e5a40700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83e00fcef0 0x7f83e010d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.512+0000 7f83e5a40700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83e00fe0e0 0x7f83e010ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.512+0000 7f83e5a40700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e010e560 con 0x7f83e00fe0e0 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.512+0000 7f83e5a40700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e010eda0 con 0x7f83e00fcef0 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.512+0000 7f83de7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83e00fe0e0 0x7f83e010ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.512+0000 7f83de7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83e00fe0e0 0x7f83e010ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59606/0 (socket says 172.21.15.47:59606) 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.512+0000 7f83de7fc700 1 -- 172.21.15.47:0/2906939702 learned_addr learned my addr 172.21.15.47:0/2906939702 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.513+0000 7f83deffd700 1 --2- 172.21.15.47:0/2906939702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83e00fcef0 0x7f83e010d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.513+0000 7f83de7fc700 1 -- 172.21.15.47:0/2906939702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83e00fcef0 msgr2=0x7f83e010d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.513+0000 7f83de7fc700 1 --2- 172.21.15.47:0/2906939702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83e00fcef0 0x7f83e010d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.513+0000 7f83de7fc700 1 -- 172.21.15.47:0/2906939702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d0005040 con 0x7f83e00fe0e0 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.513+0000 7f83deffd700 1 --2- 172.21.15.47:0/2906939702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83e00fcef0 0x7f83e010d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.513+0000 7f83de7fc700 1 --2- 172.21.15.47:0/2906939702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83e00fe0e0 0x7f83e010ded0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f83d00093b0 tx=0x7f83d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.513+0000 7f83c77fe700 1 -- 172.21.15.47:0/2906939702 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83d000e040 con 0x7f83e00fe0e0 2024-02-07T12:34:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.513+0000 7f83c77fe700 1 -- 172.21.15.47:0/2906939702 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83d000bcc0 con 0x7f83e00fe0e0 2024-02-07T12:34:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.513+0000 7f83c77fe700 1 -- 172.21.15.47:0/2906939702 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83d001c630 con 0x7f83e00fe0e0 2024-02-07T12:34:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.513+0000 7f83e5a40700 1 -- 172.21.15.47:0/2906939702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e010f020 con 0x7f83e00fe0e0 2024-02-07T12:34:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.513+0000 7f83e5a40700 1 -- 172.21.15.47:0/2906939702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e010f510 con 0x7f83e00fe0e0 2024-02-07T12:34:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.514+0000 7f83e5a40700 1 -- 172.21.15.47:0/2906939702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e004bed0 con 0x7f83e00fe0e0 2024-02-07T12:34:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.515+0000 7f83c77fe700 1 -- 172.21.15.47:0/2906939702 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f83d00139f0 con 0x7f83e00fe0e0 2024-02-07T12:34:57.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.515+0000 7f83c77fe700 1 --2- 172.21.15.47:0/2906939702 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f83c806d7e0 0x7f83c806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:57.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.515+0000 7f83c77fe700 1 -- 172.21.15.47:0/2906939702 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f83d008e3e0 con 0x7f83e00fe0e0 2024-02-07T12:34:57.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.515+0000 7f83deffd700 1 --2- 172.21.15.47:0/2906939702 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f83c806d7e0 0x7f83c806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:57.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.516+0000 7f83deffd700 1 --2- 172.21.15.47:0/2906939702 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f83c806d7e0 0x7f83c806fc90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f83d4006fd0 tx=0x7f83d4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:57.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.520+0000 7f83c77fe700 1 -- 172.21.15.47:0/2906939702 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f83d005b730 con 0x7f83e00fe0e0 2024-02-07T12:34:57.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.760+0000 7f83e5a40700 1 -- 172.21.15.47:0/2906939702 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83e010fa40 con 0x7f83c806d7e0 2024-02-07T12:34:57.762 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:57 smithi047 ceph-mon[93224]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-07T12:34:57.762 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-07T12:34:57.763 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:57 smithi047 ceph-mon[93224]: daemon mds.cephfs.smithi047.jsgfge assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-07T12:34:57.763 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:57 smithi047 ceph-mon[93224]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-07T12:34:57.763 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:57 smithi047 ceph-mon[93224]: Cluster is now healthy 2024-02-07T12:34:57.763 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:57 smithi047 ceph-mon[93224]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 3 up:standby 2024-02-07T12:34:57.763 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:57 smithi047 ceph-mon[93224]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:starting} 2 up:standby 2024-02-07T12:34:57.763 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:57.763 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:57 smithi047 ceph-mon[93224]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-02-07T12:34:57.763 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-02-07T12:34:57.763 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:57 smithi047 ceph-mon[93224]: daemon mds.cephfs.smithi047.jsgfge is now active in filesystem cephfs as rank 1 2024-02-07T12:34:57.763 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:34:57.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.761+0000 7f83c77fe700 1 -- 172.21.15.47:0/2906939702 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f83e010fa40 con 0x7f83c806d7e0 2024-02-07T12:34:57.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.763+0000 7f83e5a40700 1 -- 172.21.15.47:0/2906939702 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f83c806d7e0 msgr2=0x7f83c806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:57.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.763+0000 7f83e5a40700 1 --2- 172.21.15.47:0/2906939702 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f83c806d7e0 0x7f83c806fc90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f83d4006fd0 tx=0x7f83d4008040 comp rx=0 tx=0).stop 2024-02-07T12:34:57.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.763+0000 7f83e5a40700 1 -- 172.21.15.47:0/2906939702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83e00fe0e0 msgr2=0x7f83e010ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:57.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.763+0000 7f83e5a40700 1 --2- 172.21.15.47:0/2906939702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83e00fe0e0 0x7f83e010ded0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f83d00093b0 tx=0x7f83d0009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:57.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.763+0000 7f83e5a40700 1 -- 172.21.15.47:0/2906939702 shutdown_connections 2024-02-07T12:34:57.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.763+0000 7f83e5a40700 1 --2- 172.21.15.47:0/2906939702 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f83c806d7e0 0x7f83c806fc90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:57.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.763+0000 7f83e5a40700 1 --2- 172.21.15.47:0/2906939702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83e00fcef0 0x7f83e010d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:57.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.763+0000 7f83e5a40700 1 --2- 172.21.15.47:0/2906939702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83e00fe0e0 0x7f83e010ded0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:57.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.763+0000 7f83e5a40700 1 -- 172.21.15.47:0/2906939702 >> 172.21.15.47:0/2906939702 conn(0x7f83e00f8620 msgr2=0x7f83e01013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:57.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.763+0000 7f83e5a40700 1 -- 172.21.15.47:0/2906939702 shutdown_connections 2024-02-07T12:34:57.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.763+0000 7f83e5a40700 1 -- 172.21.15.47:0/2906939702 wait complete. 2024-02-07T12:34:57.776 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:34:57.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:57 smithi138 ceph-mon[82055]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-07T12:34:57.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-07T12:34:57.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:57 smithi138 ceph-mon[82055]: daemon mds.cephfs.smithi047.jsgfge assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-07T12:34:57.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:57 smithi138 ceph-mon[82055]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-07T12:34:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:57 smithi138 ceph-mon[82055]: Cluster is now healthy 2024-02-07T12:34:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:57 smithi138 ceph-mon[82055]: fsmap cephfs:1 {0=cephfs.smithi047.lagmef=up:active} 3 up:standby 2024-02-07T12:34:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:57 smithi138 ceph-mon[82055]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:starting} 2 up:standby 2024-02-07T12:34:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:57 smithi138 ceph-mon[82055]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-02-07T12:34:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-02-07T12:34:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:57 smithi138 ceph-mon[82055]: daemon mds.cephfs.smithi047.jsgfge is now active in filesystem cephfs as rank 1 2024-02-07T12:34:57.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:34:57.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.869+0000 7f0219f64700 1 -- 172.21.15.47:0/577461204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02140fcfb0 msgr2=0x7f02140fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:57.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.869+0000 7f0219f64700 1 --2- 172.21.15.47:0/577461204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02140fcfb0 0x7f02140fd420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0208004940 tx=0x7f0208009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:57.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.869+0000 7f0219f64700 1 -- 172.21.15.47:0/577461204 shutdown_connections 2024-02-07T12:34:57.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.869+0000 7f0219f64700 1 --2- 172.21.15.47:0/577461204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02140fcfb0 0x7f02140fd420 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:57.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.869+0000 7f0219f64700 1 --2- 172.21.15.47:0/577461204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02140fbe40 0x7f02140fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:57.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.869+0000 7f0219f64700 1 -- 172.21.15.47:0/577461204 >> 172.21.15.47:0/577461204 conn(0x7f02140f74e0 msgr2=0x7f02140f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:57.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.870+0000 7f0219f64700 1 -- 172.21.15.47:0/577461204 shutdown_connections 2024-02-07T12:34:57.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.870+0000 7f0219f64700 1 -- 172.21.15.47:0/577461204 wait complete. 2024-02-07T12:34:57.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.870+0000 7f0219f64700 1 Processor -- start 2024-02-07T12:34:57.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.870+0000 7f0219f64700 1 -- start start 2024-02-07T12:34:57.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.870+0000 7f0219f64700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02140fbe40 0x7f021410d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:57.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.870+0000 7f0219f64700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02140fcfb0 0x7f021410ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:57.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.870+0000 7f0219f64700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021410e3f0 con 0x7f02140fcfb0 2024-02-07T12:34:57.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.870+0000 7f0219f64700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021410ec90 con 0x7f02140fbe40 2024-02-07T12:34:57.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f0212ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02140fcfb0 0x7f021410ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:57.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f0212ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02140fcfb0 0x7f021410ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59626/0 (socket says 172.21.15.47:59626) 2024-02-07T12:34:57.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f0212ffd700 1 -- 172.21.15.47:0/3236999760 learned_addr learned my addr 172.21.15.47:0/3236999760 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:57.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f02137fe700 1 --2- 172.21.15.47:0/3236999760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02140fbe40 0x7f021410d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:57.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f0212ffd700 1 -- 172.21.15.47:0/3236999760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02140fbe40 msgr2=0x7f021410d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:57.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f0212ffd700 1 --2- 172.21.15.47:0/3236999760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02140fbe40 0x7f021410d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:57.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f0212ffd700 1 -- 172.21.15.47:0/3236999760 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208005040 con 0x7f02140fcfb0 2024-02-07T12:34:57.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f02137fe700 1 --2- 172.21.15.47:0/3236999760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02140fbe40 0x7f021410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-07T12:34:57.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f0212ffd700 1 --2- 172.21.15.47:0/3236999760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02140fcfb0 0x7f021410ddf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0208000c00 tx=0x7f0208009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:57.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f01fbfff700 1 -- 172.21.15.47:0/3236999760 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0208021070 con 0x7f02140fcfb0 2024-02-07T12:34:57.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f01fbfff700 1 -- 172.21.15.47:0/3236999760 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f020801c400 con 0x7f02140fcfb0 2024-02-07T12:34:57.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f0219f64700 1 -- 172.21.15.47:0/3236999760 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021410ef10 con 0x7f02140fcfb0 2024-02-07T12:34:57.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f01fbfff700 1 -- 172.21.15.47:0/3236999760 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f020800e070 con 0x7f02140fcfb0 2024-02-07T12:34:57.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.871+0000 7f0219f64700 1 -- 172.21.15.47:0/3236999760 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021410f3f0 con 0x7f02140fcfb0 2024-02-07T12:34:57.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.872+0000 7f0219f64700 1 -- 172.21.15.47:0/3236999760 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021404bed0 con 0x7f02140fcfb0 2024-02-07T12:34:57.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.873+0000 7f01fbfff700 1 -- 172.21.15.47:0/3236999760 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f020801ca50 con 0x7f02140fcfb0 2024-02-07T12:34:57.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.873+0000 7f01fbfff700 1 --2- 172.21.15.47:0/3236999760 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f01fc06d7f0 0x7f01fc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:57.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.873+0000 7f01fbfff700 1 -- 172.21.15.47:0/3236999760 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f020808e110 con 0x7f02140fcfb0 2024-02-07T12:34:57.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.873+0000 7f02137fe700 1 --2- 172.21.15.47:0/3236999760 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f01fc06d7f0 0x7f01fc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:57.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.874+0000 7f02137fe700 1 --2- 172.21.15.47:0/3236999760 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f01fc06d7f0 0x7f01fc06fca0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0204009b80 tx=0x7f020400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:57.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:57.878+0000 7f01fbfff700 1 -- 172.21.15.47:0/3236999760 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f020805b460 con 0x7f02140fcfb0 2024-02-07T12:34:58.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.103+0000 7f0219f64700 1 -- 172.21.15.47:0/3236999760 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f021410f840 con 0x7f01fc06d7f0 2024-02-07T12:34:58.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.105+0000 7f01fbfff700 1 -- 172.21.15.47:0/3236999760 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f021410f840 con 0x7f01fc06d7f0 2024-02-07T12:34:58.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.107+0000 7f0219f64700 1 -- 172.21.15.47:0/3236999760 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f01fc06d7f0 msgr2=0x7f01fc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:58.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.107+0000 7f0219f64700 1 --2- 172.21.15.47:0/3236999760 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f01fc06d7f0 0x7f01fc06fca0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0204009b80 tx=0x7f020400b040 comp rx=0 tx=0).stop 2024-02-07T12:34:58.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.107+0000 7f0219f64700 1 -- 172.21.15.47:0/3236999760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02140fcfb0 msgr2=0x7f021410ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:58.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.107+0000 7f0219f64700 1 --2- 172.21.15.47:0/3236999760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02140fcfb0 0x7f021410ddf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0208000c00 tx=0x7f0208009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.107+0000 7f0219f64700 1 -- 172.21.15.47:0/3236999760 shutdown_connections 2024-02-07T12:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.107+0000 7f0219f64700 1 --2- 172.21.15.47:0/3236999760 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f01fc06d7f0 0x7f01fc06fca0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.107+0000 7f0219f64700 1 --2- 172.21.15.47:0/3236999760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02140fbe40 0x7f021410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.107+0000 7f0219f64700 1 --2- 172.21.15.47:0/3236999760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02140fcfb0 0x7f021410ddf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.107+0000 7f0219f64700 1 -- 172.21.15.47:0/3236999760 >> 172.21.15.47:0/3236999760 conn(0x7f02140f74e0 msgr2=0x7f02140656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.107+0000 7f0219f64700 1 -- 172.21.15.47:0/3236999760 shutdown_connections 2024-02-07T12:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.107+0000 7f0219f64700 1 -- 172.21.15.47:0/3236999760 wait complete. 2024-02-07T12:34:58.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.224+0000 7f65a1571700 1 -- 172.21.15.47:0/1768530099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f659c0fcfb0 msgr2=0x7f659c0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:58.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.224+0000 7f65a1571700 1 --2- 172.21.15.47:0/1768530099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f659c0fcfb0 0x7f659c0fd420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f658c004940 tx=0x7f658c009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:58.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.224+0000 7f65a1571700 1 -- 172.21.15.47:0/1768530099 shutdown_connections 2024-02-07T12:34:58.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.225+0000 7f65a1571700 1 --2- 172.21.15.47:0/1768530099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f659c0fcfb0 0x7f659c0fd420 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.225+0000 7f65a1571700 1 --2- 172.21.15.47:0/1768530099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f659c0fbe40 0x7f659c0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.225+0000 7f65a1571700 1 -- 172.21.15.47:0/1768530099 >> 172.21.15.47:0/1768530099 conn(0x7f659c0f74e0 msgr2=0x7f659c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:58.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.225+0000 7f65a1571700 1 -- 172.21.15.47:0/1768530099 shutdown_connections 2024-02-07T12:34:58.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.225+0000 7f65a1571700 1 -- 172.21.15.47:0/1768530099 wait complete. 2024-02-07T12:34:58.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.225+0000 7f65a1571700 1 Processor -- start 2024-02-07T12:34:58.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.225+0000 7f65a1571700 1 -- start start 2024-02-07T12:34:58.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.225+0000 7f65a1571700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f659c0fbe40 0x7f659c10c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:58.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.225+0000 7f65a1571700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f659c0fcfb0 0x7f659c10cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:58.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.225+0000 7f65a1571700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c10d310 con 0x7f659c0fcfb0 2024-02-07T12:34:58.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.225+0000 7f65a1571700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c10dbb0 con 0x7f659c0fbe40 2024-02-07T12:34:58.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f659a7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f659c0fcfb0 0x7f659c10cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:58.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f659affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f659c0fbe40 0x7f659c10c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:58.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f659a7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f659c0fcfb0 0x7f659c10cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59652/0 (socket says 172.21.15.47:59652) 2024-02-07T12:34:58.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f659a7fc700 1 -- 172.21.15.47:0/952709266 learned_addr learned my addr 172.21.15.47:0/952709266 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:58.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f659affd700 1 --2- 172.21.15.47:0/952709266 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f659c0fbe40 0x7f659c10c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.47:51414/0 (socket says 172.21.15.47:51414) 2024-02-07T12:34:58.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f659affd700 1 -- 172.21.15.47:0/952709266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f659c0fcfb0 msgr2=0x7f659c10cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:58.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f659affd700 1 --2- 172.21.15.47:0/952709266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f659c0fcfb0 0x7f659c10cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f659affd700 1 -- 172.21.15.47:0/952709266 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c005040 con 0x7f659c0fbe40 2024-02-07T12:34:58.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f659affd700 1 --2- 172.21.15.47:0/952709266 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f659c0fbe40 0x7f659c10c7d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6590009fd0 tx=0x7f659000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:58.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f65837fe700 1 -- 172.21.15.47:0/952709266 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6590004e90 con 0x7f659c0fbe40 2024-02-07T12:34:58.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f65837fe700 1 -- 172.21.15.47:0/952709266 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f659000f040 con 0x7f659c0fbe40 2024-02-07T12:34:58.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f65837fe700 1 -- 172.21.15.47:0/952709266 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f659000ca50 con 0x7f659c0fbe40 2024-02-07T12:34:58.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f65a1571700 1 -- 172.21.15.47:0/952709266 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659c10de30 con 0x7f659c0fbe40 2024-02-07T12:34:58.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.226+0000 7f65a1571700 1 -- 172.21.15.47:0/952709266 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659c10e320 con 0x7f659c0fbe40 2024-02-07T12:34:58.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.227+0000 7f65a1571700 1 -- 172.21.15.47:0/952709266 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659c04bed0 con 0x7f659c0fbe40 2024-02-07T12:34:58.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.228+0000 7f65837fe700 1 -- 172.21.15.47:0/952709266 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6590007cc0 con 0x7f659c0fbe40 2024-02-07T12:34:58.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.228+0000 7f65837fe700 1 --2- 172.21.15.47:0/952709266 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f658406d7e0 0x7f658406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:58.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.228+0000 7f65837fe700 1 -- 172.21.15.47:0/952709266 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f659008c980 con 0x7f659c0fbe40 2024-02-07T12:34:58.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.228+0000 7f659a7fc700 1 --2- 172.21.15.47:0/952709266 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f658406d7e0 0x7f658406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:58.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.229+0000 7f659a7fc700 1 --2- 172.21.15.47:0/952709266 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f658406d7e0 0x7f658406fc90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f658c00b0d0 tx=0x7f658c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:58.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.233+0000 7f65837fe700 1 -- 172.21.15.47:0/952709266 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6590059d00 con 0x7f659c0fbe40 2024-02-07T12:34:58.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.451+0000 7f65a1571700 1 -- 172.21.15.47:0/952709266 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f659c10e790 con 0x7f658406d7e0 2024-02-07T12:34:58.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.462+0000 7f65837fe700 1 -- 172.21.15.47:0/952709266 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f659c10e790 con 0x7f658406d7e0 2024-02-07T12:34:58.464 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:34:58.464 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (8m) 39s ago 17m 26.2M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:34:58.464 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (5m) 39s ago 17m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:34:58.464 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (5m) 7s ago 16m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:34:58.464 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (7m) 39s ago 17m 85.2M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:34:58.464 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (44s) 39s ago 11m 11.1M - 19.0.0-1252-g44458cce 79957b372307 fbda6b9f9953 2024-02-07T12:34:58.464 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (69s) 39s ago 12m 67.3M - 19.0.0-1252-g44458cce 79957b372307 055df3be8762 2024-02-07T12:34:58.464 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (9s) 7s ago 11m 11.2M - 19.0.0-1252-g44458cce 79957b372307 742dc60bfa13 2024-02-07T12:34:58.464 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (26s) 7s ago 11m 12.4M - 19.0.0-1252-g44458cce 79957b372307 502afeac2e7d 2024-02-07T12:34:58.464 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (7m) 39s ago 18m 508M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:34:58.465 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (6m) 7s ago 16m 453M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:34:58.465 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (6m) 39s ago 18m 56.4M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:34:58.465 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (6m) 7s ago 16m 40.8M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:34:58.465 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (8m) 39s ago 17m 15.1M - 1.5.0 0da6a335fe13 79777416dbc4 2024-02-07T12:34:58.465 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (7m) 7s ago 16m 15.3M - 1.5.0 0da6a335fe13 abe21bda35ab 2024-02-07T12:34:58.465 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (5m) 39s ago 15m 101M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:34:58.465 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (4m) 39s ago 15m 113M 1559M 19.0.0-1252-g44458cce 79957b372307 0f2b0eea74d7 2024-02-07T12:34:58.465 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (4m) 39s ago 14m 90.1M 1559M 19.0.0-1252-g44458cce 79957b372307 0b8c78346346 2024-02-07T12:34:58.465 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (3m) 7s ago 14m 127M 2581M 19.0.0-1252-g44458cce 79957b372307 dea45db021db 2024-02-07T12:34:58.465 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (2m) 7s ago 13m 99.5M 2581M 19.0.0-1252-g44458cce 79957b372307 3161c1dfe6f5 2024-02-07T12:34:58.465 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (2m) 7s ago 13m 93.8M 2581M 19.0.0-1252-g44458cce 79957b372307 c9504c7cfe7c 2024-02-07T12:34:58.465 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (7m) 39s ago 16m 63.8M - 2.43.0 a07b618ecd1d 32840d82c54b 2024-02-07T12:34:58.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.463+0000 7f65a1571700 1 -- 172.21.15.47:0/952709266 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f658406d7e0 msgr2=0x7f658406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:58.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.463+0000 7f65a1571700 1 --2- 172.21.15.47:0/952709266 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f658406d7e0 0x7f658406fc90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f658c00b0d0 tx=0x7f658c009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:58.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.463+0000 7f65a1571700 1 -- 172.21.15.47:0/952709266 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f659c0fbe40 msgr2=0x7f659c10c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:58.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.463+0000 7f65a1571700 1 --2- 172.21.15.47:0/952709266 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f659c0fbe40 0x7f659c10c7d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6590009fd0 tx=0x7f659000b040 comp rx=0 tx=0).stop 2024-02-07T12:34:58.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.464+0000 7f65a1571700 1 -- 172.21.15.47:0/952709266 shutdown_connections 2024-02-07T12:34:58.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.464+0000 7f65a1571700 1 --2- 172.21.15.47:0/952709266 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f658406d7e0 0x7f658406fc90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.464+0000 7f65a1571700 1 --2- 172.21.15.47:0/952709266 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f659c0fbe40 0x7f659c10c7d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.464+0000 7f65a1571700 1 --2- 172.21.15.47:0/952709266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f659c0fcfb0 0x7f659c10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.464+0000 7f65a1571700 1 -- 172.21.15.47:0/952709266 >> 172.21.15.47:0/952709266 conn(0x7f659c0f74e0 msgr2=0x7f659c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:58.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.464+0000 7f65a1571700 1 -- 172.21.15.47:0/952709266 shutdown_connections 2024-02-07T12:34:58.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.464+0000 7f65a1571700 1 -- 172.21.15.47:0/952709266 wait complete. 2024-02-07T12:34:58.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.567+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/726476834 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c640fe290 msgr2=0x7f6c640fe6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:58.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.567+0000 7f6c6bc1f700 1 --2- 172.21.15.47:0/726476834 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c640fe290 0x7f6c640fe6e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6c54004940 tx=0x7f6c54009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:58.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.567+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/726476834 shutdown_connections 2024-02-07T12:34:58.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.567+0000 7f6c6bc1f700 1 --2- 172.21.15.47:0/726476834 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c640fe290 0x7f6c640fe6e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.567+0000 7f6c6bc1f700 1 --2- 172.21.15.47:0/726476834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640fb200 0x7f6c640fb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.567+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/726476834 >> 172.21.15.47:0/726476834 conn(0x7f6c640f6c80 msgr2=0x7f6c640f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:58.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.567+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/726476834 shutdown_connections 2024-02-07T12:34:58.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.567+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/726476834 wait complete. 2024-02-07T12:34:58.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.568+0000 7f6c6bc1f700 1 Processor -- start 2024-02-07T12:34:58.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.568+0000 7f6c6bc1f700 1 -- start start 2024-02-07T12:34:58.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.568+0000 7f6c6bc1f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640fb200 0x7f6c640fdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:58.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.568+0000 7f6c6bc1f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c640fe290 0x7f6c640fc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:58.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.568+0000 7f6c6bc1f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640fc7a0 con 0x7f6c640fb200 2024-02-07T12:34:58.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.568+0000 7f6c6bc1f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640fc910 con 0x7f6c640fe290 2024-02-07T12:34:58.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.568+0000 7f6c699bb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640fb200 0x7f6c640fdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:58.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.568+0000 7f6c699bb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640fb200 0x7f6c640fdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59684/0 (socket says 172.21.15.47:59684) 2024-02-07T12:34:58.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.568+0000 7f6c699bb700 1 -- 172.21.15.47:0/3148624100 learned_addr learned my addr 172.21.15.47:0/3148624100 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:58.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.569+0000 7f6c691ba700 1 --2- 172.21.15.47:0/3148624100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c640fe290 0x7f6c640fc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:58.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.569+0000 7f6c699bb700 1 -- 172.21.15.47:0/3148624100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c640fe290 msgr2=0x7f6c640fc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:58.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.569+0000 7f6c699bb700 1 --2- 172.21.15.47:0/3148624100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c640fe290 0x7f6c640fc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.569+0000 7f6c699bb700 1 -- 172.21.15.47:0/3148624100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c54005040 con 0x7f6c640fb200 2024-02-07T12:34:58.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.569+0000 7f6c699bb700 1 --2- 172.21.15.47:0/3148624100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640fb200 0x7f6c640fdd20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000eb70 tx=0x7f6c6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:58.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.569+0000 7f6c5a7fc700 1 -- 172.21.15.47:0/3148624100 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c60007cc0 con 0x7f6c640fb200 2024-02-07T12:34:58.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.569+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/3148624100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c640fcb90 con 0x7f6c640fb200 2024-02-07T12:34:58.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.569+0000 7f6c5a7fc700 1 -- 172.21.15.47:0/3148624100 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c6000f040 con 0x7f6c640fb200 2024-02-07T12:34:58.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.569+0000 7f6c5a7fc700 1 -- 172.21.15.47:0/3148624100 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c6000cb20 con 0x7f6c640fb200 2024-02-07T12:34:58.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.569+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/3148624100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c64115930 con 0x7f6c640fb200 2024-02-07T12:34:58.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.570+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/3148624100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6404bed0 con 0x7f6c640fb200 2024-02-07T12:34:58.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.571+0000 7f6c5a7fc700 1 -- 172.21.15.47:0/3148624100 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6c6000cc80 con 0x7f6c640fb200 2024-02-07T12:34:58.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.571+0000 7f6c5a7fc700 1 --2- 172.21.15.47:0/3148624100 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6c5006d7e0 0x7f6c5006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:58.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.571+0000 7f6c5a7fc700 1 -- 172.21.15.47:0/3148624100 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6c6008ca30 con 0x7f6c640fb200 2024-02-07T12:34:58.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.571+0000 7f6c691ba700 1 --2- 172.21.15.47:0/3148624100 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6c5006d7e0 0x7f6c5006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:58.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.572+0000 7f6c691ba700 1 --2- 172.21.15.47:0/3148624100 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6c5006d7e0 0x7f6c5006fc90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009b30 tx=0x7f6c54009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:58.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.576+0000 7f6c5a7fc700 1 -- 172.21.15.47:0/3148624100 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6c60059d10 con 0x7f6c640fb200 2024-02-07T12:34:58.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: pgmap v234: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 0 op/s 2024-02-07T12:34:58.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-02-07T12:34:58.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: mds.? [v2:172.21.15.47:6828/3723006072,v1:172.21.15.47:6829/3723006072] up:active 2024-02-07T12:34:58.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: Upgrade: Setting container_image for all rgw 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: Upgrade: Setting container_image for all rbd-mirror 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: Upgrade: Setting container_image for all ceph-exporter 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:58.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:58.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:58.827 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:58 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:58.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.872+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/3148624100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6c64115b80 con 0x7f6c640fb200 2024-02-07T12:34:58.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.872+0000 7f6c5a7fc700 1 -- 172.21.15.47:0/3148624100 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f6c600598a0 con 0x7f6c640fb200 2024-02-07T12:34:58.874 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 6 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 4 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 14 2024-02-07T12:34:58.875 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:34:58.876 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:34:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.874+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/3148624100 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6c5006d7e0 msgr2=0x7f6c5006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.874+0000 7f6c6bc1f700 1 --2- 172.21.15.47:0/3148624100 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6c5006d7e0 0x7f6c5006fc90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009b30 tx=0x7f6c54009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.874+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/3148624100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640fb200 msgr2=0x7f6c640fdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.874+0000 7f6c6bc1f700 1 --2- 172.21.15.47:0/3148624100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640fb200 0x7f6c640fdd20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000eb70 tx=0x7f6c6000b040 comp rx=0 tx=0).stop 2024-02-07T12:34:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.874+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/3148624100 shutdown_connections 2024-02-07T12:34:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.875+0000 7f6c6bc1f700 1 --2- 172.21.15.47:0/3148624100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640fb200 0x7f6c640fdd20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.875+0000 7f6c6bc1f700 1 --2- 172.21.15.47:0/3148624100 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6c5006d7e0 0x7f6c5006fc90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.875+0000 7f6c6bc1f700 1 --2- 172.21.15.47:0/3148624100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c640fe290 0x7f6c640fc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.875+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/3148624100 >> 172.21.15.47:0/3148624100 conn(0x7f6c640f6c80 msgr2=0x7f6c641014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.875+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/3148624100 shutdown_connections 2024-02-07T12:34:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.875+0000 7f6c6bc1f700 1 -- 172.21.15.47:0/3148624100 wait complete. 2024-02-07T12:34:58.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.979+0000 7fc246045700 1 -- 172.21.15.47:0/3901007408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2400fe1f0 msgr2=0x7fc2400fe660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:58.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.979+0000 7fc246045700 1 --2- 172.21.15.47:0/3901007408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2400fe1f0 0x7fc2400fe660 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc228004940 tx=0x7fc228009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:58.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.979+0000 7fc246045700 1 -- 172.21.15.47:0/3901007408 shutdown_connections 2024-02-07T12:34:58.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.979+0000 7fc246045700 1 --2- 172.21.15.47:0/3901007408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2400fe1f0 0x7fc2400fe660 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.979+0000 7fc246045700 1 --2- 172.21.15.47:0/3901007408 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2400fcf40 0x7fc2400fd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.979+0000 7fc246045700 1 -- 172.21.15.47:0/3901007408 >> 172.21.15.47:0/3901007408 conn(0x7fc2400f8680 msgr2=0x7fc2400faad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:58.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.979+0000 7fc246045700 1 -- 172.21.15.47:0/3901007408 shutdown_connections 2024-02-07T12:34:58.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.979+0000 7fc246045700 1 -- 172.21.15.47:0/3901007408 wait complete. 2024-02-07T12:34:58.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.979+0000 7fc246045700 1 Processor -- start 2024-02-07T12:34:58.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.979+0000 7fc246045700 1 -- start start 2024-02-07T12:34:58.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc246045700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2400fcf40 0x7fc24010fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:58.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc246045700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2400fe1f0 0x7fc24010fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:58.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc246045700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2401105f0 con 0x7fc2400fe1f0 2024-02-07T12:34:58.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc246045700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc240110e90 con 0x7fc2400fcf40 2024-02-07T12:34:58.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc23effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2400fe1f0 0x7fc24010fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:58.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc23effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2400fe1f0 0x7fc24010fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59698/0 (socket says 172.21.15.47:59698) 2024-02-07T12:34:58.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc23effd700 1 -- 172.21.15.47:0/2448637044 learned_addr learned my addr 172.21.15.47:0/2448637044 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:58.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc23f7fe700 1 --2- 172.21.15.47:0/2448637044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2400fcf40 0x7fc24010fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:58.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc23effd700 1 -- 172.21.15.47:0/2448637044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2400fcf40 msgr2=0x7fc24010fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:58.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc23effd700 1 --2- 172.21.15.47:0/2448637044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2400fcf40 0x7fc24010fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:58.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc23effd700 1 -- 172.21.15.47:0/2448637044 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc228005040 con 0x7fc2400fe1f0 2024-02-07T12:34:58.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc23effd700 1 --2- 172.21.15.47:0/2448637044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2400fe1f0 0x7fc24010fff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc2280093b0 tx=0x7fc228009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:58.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc237fff700 1 -- 172.21.15.47:0/2448637044 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc22800e040 con 0x7fc2400fe1f0 2024-02-07T12:34:58.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc237fff700 1 -- 172.21.15.47:0/2448637044 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc22800bcc0 con 0x7fc2400fe1f0 2024-02-07T12:34:58.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc246045700 1 -- 172.21.15.47:0/2448637044 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc240111110 con 0x7fc2400fe1f0 2024-02-07T12:34:58.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.980+0000 7fc237fff700 1 -- 172.21.15.47:0/2448637044 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc22801c630 con 0x7fc2400fe1f0 2024-02-07T12:34:58.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.981+0000 7fc246045700 1 -- 172.21.15.47:0/2448637044 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc240111650 con 0x7fc2400fe1f0 2024-02-07T12:34:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.981+0000 7fc246045700 1 -- 172.21.15.47:0/2448637044 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24004bed0 con 0x7fc2400fe1f0 2024-02-07T12:34:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.982+0000 7fc237fff700 1 -- 172.21.15.47:0/2448637044 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc228013980 con 0x7fc2400fe1f0 2024-02-07T12:34:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.982+0000 7fc237fff700 1 --2- 172.21.15.47:0/2448637044 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc22c06d7e0 0x7fc22c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.982+0000 7fc237fff700 1 -- 172.21.15.47:0/2448637044 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc22808e340 con 0x7fc2400fe1f0 2024-02-07T12:34:58.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.983+0000 7fc23f7fe700 1 --2- 172.21.15.47:0/2448637044 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc22c06d7e0 0x7fc22c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:58.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.983+0000 7fc23f7fe700 1 --2- 172.21.15.47:0/2448637044 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc22c06d7e0 0x7fc22c06fc90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc230007b20 tx=0x7fc230009e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:58.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:58.987+0000 7fc237fff700 1 -- 172.21.15.47:0/2448637044 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc22805b690 con 0x7fc2400fe1f0 2024-02-07T12:34:59.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: pgmap v234: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 0 op/s 2024-02-07T12:34:59.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-02-07T12:34:59.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: mds.? [v2:172.21.15.47:6828/3723006072,v1:172.21.15.47:6829/3723006072] up:active 2024-02-07T12:34:59.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby 2024-02-07T12:34:59.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: fsmap cephfs:2 {0=cephfs.smithi047.lagmef=up:active,1=cephfs.smithi047.jsgfge=up:active} 2 up:standby-replay 2024-02-07T12:34:59.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:59.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:59.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: Upgrade: Setting container_image for all rgw 2024-02-07T12:34:59.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:59.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:59.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: Upgrade: Setting container_image for all rbd-mirror 2024-02-07T12:34:59.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:59.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:59.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:59.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: Upgrade: Setting container_image for all ceph-exporter 2024-02-07T12:34:59.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:59.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:59.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:59.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:59.038 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:59.038 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:34:59.038 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:58 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:34:59.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.236+0000 7fc246045700 1 -- 172.21.15.47:0/2448637044 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc240070f50 con 0x7fc2400fe1f0 2024-02-07T12:34:59.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.236+0000 7fc237fff700 1 -- 172.21.15.47:0/2448637044 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 48 v48) v1 ==== 76+0+1895 (secure 0 0 0) 0x7fc22805b220 con 0x7fc2400fe1f0 2024-02-07T12:34:59.238 INFO:teuthology.orchestra.run.smithi047.stdout:e48 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 48 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:34:57.641208+0000 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:34:59.239 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 84 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=34428,1=34460} 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:34:59.240 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:34:59.241 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:34:59.241 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:34428} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:34:59.241 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{0:44365} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6825/3547121337,v1:172.21.15.138:6826/3547121337] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:34:59.241 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:34460} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.47:6828/3723006072,v1:172.21.15.47:6829/3723006072] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:34:59.241 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{1:44369} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2689114398,v1:172.21.15.138:6827/2689114398] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:34:59.241 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:34:59.241 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:34:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.239+0000 7fc246045700 1 -- 172.21.15.47:0/2448637044 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc22c06d7e0 msgr2=0x7fc22c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.239+0000 7fc246045700 1 --2- 172.21.15.47:0/2448637044 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc22c06d7e0 0x7fc22c06fc90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc230007b20 tx=0x7fc230009e20 comp rx=0 tx=0).stop 2024-02-07T12:34:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.239+0000 7fc246045700 1 -- 172.21.15.47:0/2448637044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2400fe1f0 msgr2=0x7fc24010fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.239+0000 7fc246045700 1 --2- 172.21.15.47:0/2448637044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2400fe1f0 0x7fc24010fff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc2280093b0 tx=0x7fc228009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.239+0000 7fc246045700 1 -- 172.21.15.47:0/2448637044 shutdown_connections 2024-02-07T12:34:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.239+0000 7fc246045700 1 --2- 172.21.15.47:0/2448637044 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc22c06d7e0 0x7fc22c06fc90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.239+0000 7fc246045700 1 --2- 172.21.15.47:0/2448637044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2400fcf40 0x7fc24010fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.239+0000 7fc246045700 1 --2- 172.21.15.47:0/2448637044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2400fe1f0 0x7fc24010fff0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.239+0000 7fc246045700 1 -- 172.21.15.47:0/2448637044 >> 172.21.15.47:0/2448637044 conn(0x7fc2400f8680 msgr2=0x7fc2400fa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.239+0000 7fc246045700 1 -- 172.21.15.47:0/2448637044 shutdown_connections 2024-02-07T12:34:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.239+0000 7fc246045700 1 -- 172.21.15.47:0/2448637044 wait complete. 2024-02-07T12:34:59.243 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 48 2024-02-07T12:34:59.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.344+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/1223595788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc4070860 msgr2=0x7fdfc4070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:59.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.344+0000 7fdfcb7ae700 1 --2- 172.21.15.47:0/1223595788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc4070860 0x7fdfc4070cd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8004940 tx=0x7fdfb8009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.344+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/1223595788 shutdown_connections 2024-02-07T12:34:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.344+0000 7fdfcb7ae700 1 --2- 172.21.15.47:0/1223595788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc4070860 0x7fdfc4070cd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.344+0000 7fdfcb7ae700 1 --2- 172.21.15.47:0/1223595788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc4071eb0 0x7fdfc4070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.344+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/1223595788 >> 172.21.15.47:0/1223595788 conn(0x7fdfc40f8620 msgr2=0x7fdfc40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.344+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/1223595788 shutdown_connections 2024-02-07T12:34:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.344+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/1223595788 wait complete. 2024-02-07T12:34:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.344+0000 7fdfcb7ae700 1 Processor -- start 2024-02-07T12:34:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.344+0000 7fdfcb7ae700 1 -- start start 2024-02-07T12:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.345+0000 7fdfcb7ae700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc4070860 0x7fdfc410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.345+0000 7fdfcb7ae700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc4071eb0 0x7fdfc4110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.345+0000 7fdfcb7ae700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4110680 con 0x7fdfc4070860 2024-02-07T12:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.345+0000 7fdfcb7ae700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4110f20 con 0x7fdfc4071eb0 2024-02-07T12:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.345+0000 7fdfc954a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc4070860 0x7fdfc410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.345+0000 7fdfc954a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc4070860 0x7fdfc410fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59718/0 (socket says 172.21.15.47:59718) 2024-02-07T12:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.345+0000 7fdfc954a700 1 -- 172.21.15.47:0/679822525 learned_addr learned my addr 172.21.15.47:0/679822525 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.345+0000 7fdfc8d49700 1 --2- 172.21.15.47:0/679822525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc4071eb0 0x7fdfc4110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.345+0000 7fdfc954a700 1 -- 172.21.15.47:0/679822525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc4071eb0 msgr2=0x7fdfc4110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.345+0000 7fdfc954a700 1 --2- 172.21.15.47:0/679822525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc4071eb0 0x7fdfc4110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.345+0000 7fdfc954a700 1 -- 172.21.15.47:0/679822525 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb8005040 con 0x7fdfc4070860 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.345+0000 7fdfc954a700 1 --2- 172.21.15.47:0/679822525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc4070860 0x7fdfc410fb40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc002a50 tx=0x7fdfbc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.345+0000 7fdfc1ffb700 1 -- 172.21.15.47:0/679822525 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfbc007cc0 con 0x7fdfc4070860 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.346+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/679822525 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc4111200 con 0x7fdfc4070860 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.346+0000 7fdfc1ffb700 1 -- 172.21.15.47:0/679822525 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdfbc00f040 con 0x7fdfc4070860 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.346+0000 7fdfc1ffb700 1 -- 172.21.15.47:0/679822525 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfbc00da30 con 0x7fdfc4070860 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.346+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/679822525 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc4111740 con 0x7fdfc4070860 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.347+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/679822525 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc404bed0 con 0x7fdfc4070860 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.347+0000 7fdfc1ffb700 1 -- 172.21.15.47:0/679822525 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fdfbc00db90 con 0x7fdfc4070860 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.347+0000 7fdfc1ffb700 1 --2- 172.21.15.47:0/679822525 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fdfac06d7f0 0x7fdfac06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.347+0000 7fdfc1ffb700 1 -- 172.21.15.47:0/679822525 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fdfbc08cd20 con 0x7fdfc4070860 2024-02-07T12:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.348+0000 7fdfc8d49700 1 --2- 172.21.15.47:0/679822525 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fdfac06d7f0 0x7fdfac06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.348+0000 7fdfc8d49700 1 --2- 172.21.15.47:0/679822525 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fdfac06d7f0 0x7fdfac06fca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800b7a0 tx=0x7fdfb8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:59.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.352+0000 7fdfc1ffb700 1 -- 172.21.15.47:0/679822525 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdfbc059ff0 con 0x7fdfc4070860 2024-02-07T12:34:59.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.595+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/679822525 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfc4111b60 con 0x7fdfac06d7f0 2024-02-07T12:34:59.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.596+0000 7fdfc1ffb700 1 -- 172.21.15.47:0/679822525 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fdfc4111b60 con 0x7fdfac06d7f0 2024-02-07T12:34:59.599 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:34:59.599 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:34:59.599 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:34:59.599 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:34:59.600 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:34:59.600 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr", 2024-02-07T12:34:59.600 INFO:teuthology.orchestra.run.smithi047.stdout: "mds", 2024-02-07T12:34:59.600 INFO:teuthology.orchestra.run.smithi047.stdout: "osd", 2024-02-07T12:34:59.600 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-02-07T12:34:59.600 INFO:teuthology.orchestra.run.smithi047.stdout: "mon" 2024-02-07T12:34:59.600 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:34:59.600 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "16/21 daemons upgraded", 2024-02-07T12:34:59.600 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-07T12:34:59.600 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:34:59.600 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:34:59.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.599+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/679822525 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fdfac06d7f0 msgr2=0x7fdfac06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:59.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.599+0000 7fdfcb7ae700 1 --2- 172.21.15.47:0/679822525 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fdfac06d7f0 0x7fdfac06fca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800b7a0 tx=0x7fdfb8009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:59.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.599+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/679822525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc4070860 msgr2=0x7fdfc410fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:59.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.599+0000 7fdfcb7ae700 1 --2- 172.21.15.47:0/679822525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc4070860 0x7fdfc410fb40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc002a50 tx=0x7fdfbc0046b0 comp rx=0 tx=0).stop 2024-02-07T12:34:59.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.599+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/679822525 shutdown_connections 2024-02-07T12:34:59.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.599+0000 7fdfcb7ae700 1 --2- 172.21.15.47:0/679822525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc4070860 0x7fdfc410fb40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:59.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.599+0000 7fdfcb7ae700 1 --2- 172.21.15.47:0/679822525 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fdfac06d7f0 0x7fdfac06fca0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:59.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.599+0000 7fdfcb7ae700 1 --2- 172.21.15.47:0/679822525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc4071eb0 0x7fdfc4110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.599+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/679822525 >> 172.21.15.47:0/679822525 conn(0x7fdfc40f8620 msgr2=0x7fdfc4102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.599+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/679822525 shutdown_connections 2024-02-07T12:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.599+0000 7fdfcb7ae700 1 -- 172.21.15.47:0/679822525 wait complete. 2024-02-07T12:34:59.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.705+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/148464270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a040fcfb0 msgr2=0x7f3a040fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:59.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.705+0000 7f3a0a0f0700 1 --2- 172.21.15.47:0/148464270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a040fcfb0 0x7f3a040fd420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f39f8004940 tx=0x7f39f8009e30 comp rx=0 tx=0).stop 2024-02-07T12:34:59.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.705+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/148464270 shutdown_connections 2024-02-07T12:34:59.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.705+0000 7f3a0a0f0700 1 --2- 172.21.15.47:0/148464270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a040fcfb0 0x7f3a040fd420 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:59.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.705+0000 7f3a0a0f0700 1 --2- 172.21.15.47:0/148464270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a040fbe40 0x7f3a040fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:59.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.705+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/148464270 >> 172.21.15.47:0/148464270 conn(0x7f3a040f7520 msgr2=0x7f3a040f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:34:59.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.705+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/148464270 shutdown_connections 2024-02-07T12:34:59.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.705+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/148464270 wait complete. 2024-02-07T12:34:59.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.706+0000 7f3a0a0f0700 1 Processor -- start 2024-02-07T12:34:59.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.706+0000 7f3a0a0f0700 1 -- start start 2024-02-07T12:34:59.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.706+0000 7f3a0a0f0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a040fbe40 0x7f3a041105c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:59.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.706+0000 7f3a0a0f0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a040fcfb0 0x7f3a04112b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:59.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.706+0000 7f3a0a0f0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04066cf0 con 0x7f3a040fcfb0 2024-02-07T12:34:59.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.706+0000 7f3a0a0f0700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04066e30 con 0x7f3a040fbe40 2024-02-07T12:34:59.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.706+0000 7f3a02ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a040fcfb0 0x7f3a04112b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:59.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.706+0000 7f3a02ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a040fcfb0 0x7f3a04112b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46620/0 (socket says 172.21.15.47:46620) 2024-02-07T12:34:59.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.706+0000 7f3a037fe700 1 --2- 172.21.15.47:0/1124364618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a040fbe40 0x7f3a041105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:59.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.706+0000 7f3a02ffd700 1 -- 172.21.15.47:0/1124364618 learned_addr learned my addr 172.21.15.47:0/1124364618 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:34:59.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.706+0000 7f3a02ffd700 1 -- 172.21.15.47:0/1124364618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a040fbe40 msgr2=0x7f3a041105c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:34:59.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.706+0000 7f3a02ffd700 1 --2- 172.21.15.47:0/1124364618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a040fbe40 0x7f3a041105c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:34:59.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.706+0000 7f3a02ffd700 1 -- 172.21.15.47:0/1124364618 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f8005040 con 0x7f3a040fcfb0 2024-02-07T12:34:59.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.707+0000 7f3a02ffd700 1 --2- 172.21.15.47:0/1124364618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a040fcfb0 0x7f3a04112b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f39f80093b0 tx=0x7f39f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:59.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.707+0000 7f39ebfff700 1 -- 172.21.15.47:0/1124364618 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f800e040 con 0x7f3a040fcfb0 2024-02-07T12:34:59.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.707+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/1124364618 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a04113110 con 0x7f3a040fcfb0 2024-02-07T12:34:59.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.707+0000 7f39ebfff700 1 -- 172.21.15.47:0/1124364618 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39f800bcc0 con 0x7f3a040fcfb0 2024-02-07T12:34:59.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.707+0000 7f39ebfff700 1 -- 172.21.15.47:0/1124364618 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f801c630 con 0x7f3a040fcfb0 2024-02-07T12:34:59.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.707+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/1124364618 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a04113650 con 0x7f3a040fcfb0 2024-02-07T12:34:59.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.708+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/1124364618 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0404bed0 con 0x7f3a040fcfb0 2024-02-07T12:34:59.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.709+0000 7f39ebfff700 1 -- 172.21.15.47:0/1124364618 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f39f8013980 con 0x7f3a040fcfb0 2024-02-07T12:34:59.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.709+0000 7f39ebfff700 1 --2- 172.21.15.47:0/1124364618 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f39ec06d7e0 0x7f39ec06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:34:59.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.709+0000 7f39ebfff700 1 -- 172.21.15.47:0/1124364618 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f39f808e340 con 0x7f3a040fcfb0 2024-02-07T12:34:59.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.709+0000 7f3a037fe700 1 --2- 172.21.15.47:0/1124364618 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f39ec06d7e0 0x7f39ec06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:34:59.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.710+0000 7f3a037fe700 1 --2- 172.21.15.47:0/1124364618 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f39ec06d7e0 0x7f39ec06fc90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3a04066970 tx=0x7f39f400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:34:59.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:34:59.714+0000 7f39ebfff700 1 -- 172.21.15.47:0/1124364618 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f39f8057b60 con 0x7f3a040fcfb0 2024-02-07T12:35:00.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:00.008+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/1124364618 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3a04104930 con 0x7f3a040fcfb0 2024-02-07T12:35:00.011 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:59 smithi047 ceph-mon[93224]: Upgrade: Setting container_image for all iscsi 2024-02-07T12:35:00.011 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:59 smithi047 ceph-mon[93224]: Upgrade: Setting container_image for all nfs 2024-02-07T12:35:00.011 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:59 smithi047 ceph-mon[93224]: Upgrade: Setting container_image for all nvmeof 2024-02-07T12:35:00.011 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:59 smithi047 ceph-mon[93224]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:00.011 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:59 smithi047 ceph-mon[93224]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:00.011 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:59 smithi047 ceph-mon[93224]: from='client.44377 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:00.011 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:59 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3148624100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:00.011 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:34:59 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2448637044' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:35:00.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:00.008+0000 7f39ebfff700 1 -- 172.21.15.47:0/1124364618 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f39f805b220 con 0x7f3a040fcfb0 2024-02-07T12:35:00.012 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:35:00.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:00.011+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/1124364618 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f39ec06d7e0 msgr2=0x7f39ec06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:00.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:00.011+0000 7f3a0a0f0700 1 --2- 172.21.15.47:0/1124364618 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f39ec06d7e0 0x7f39ec06fc90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3a04066970 tx=0x7f39f400b040 comp rx=0 tx=0).stop 2024-02-07T12:35:00.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:00.011+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/1124364618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a040fcfb0 msgr2=0x7f3a04112b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:00.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:00.011+0000 7f3a0a0f0700 1 --2- 172.21.15.47:0/1124364618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a040fcfb0 0x7f3a04112b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f39f80093b0 tx=0x7f39f8009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:00.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:00.011+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/1124364618 shutdown_connections 2024-02-07T12:35:00.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:00.011+0000 7f3a0a0f0700 1 --2- 172.21.15.47:0/1124364618 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f39ec06d7e0 0x7f39ec06fc90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:00.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:00.011+0000 7f3a0a0f0700 1 --2- 172.21.15.47:0/1124364618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a040fbe40 0x7f3a041105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:00.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:00.011+0000 7f3a0a0f0700 1 --2- 172.21.15.47:0/1124364618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a040fcfb0 0x7f3a04112b10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:00.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:00.011+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/1124364618 >> 172.21.15.47:0/1124364618 conn(0x7f3a040f7520 msgr2=0x7f3a04100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:00.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:00.011+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/1124364618 shutdown_connections 2024-02-07T12:35:00.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:00.011+0000 7f3a0a0f0700 1 -- 172.21.15.47:0/1124364618 wait complete. 2024-02-07T12:35:00.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:59 smithi138 ceph-mon[82055]: Upgrade: Setting container_image for all iscsi 2024-02-07T12:35:00.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:59 smithi138 ceph-mon[82055]: Upgrade: Setting container_image for all nfs 2024-02-07T12:35:00.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:59 smithi138 ceph-mon[82055]: Upgrade: Setting container_image for all nvmeof 2024-02-07T12:35:00.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:59 smithi138 ceph-mon[82055]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:00.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:59 smithi138 ceph-mon[82055]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:00.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:59 smithi138 ceph-mon[82055]: from='client.44377 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:00.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:59 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3148624100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:00.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:34:59 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2448637044' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:35:00.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:00 smithi047 ceph-mon[93224]: pgmap v235: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 0 op/s 2024-02-07T12:35:00.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:00 smithi047 ceph-mon[93224]: Upgrade: Updating node-exporter.smithi047 (1/2) 2024-02-07T12:35:00.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:00 smithi047 ceph-mon[93224]: Deploying daemon node-exporter.smithi047 on smithi047 2024-02-07T12:35:00.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:00 smithi047 ceph-mon[93224]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:00.826 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:00 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1124364618' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:35:01.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:00 smithi138 ceph-mon[82055]: pgmap v235: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 0 op/s 2024-02-07T12:35:01.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:00 smithi138 ceph-mon[82055]: Upgrade: Updating node-exporter.smithi047 (1/2) 2024-02-07T12:35:01.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:00 smithi138 ceph-mon[82055]: Deploying daemon node-exporter.smithi047 on smithi047 2024-02-07T12:35:01.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:00 smithi138 ceph-mon[82055]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:01.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:00 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1124364618' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:35:03.026 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:02 smithi138 ceph-mon[82055]: pgmap v236: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 0 B/s wr, 7 op/s 2024-02-07T12:35:03.026 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:02 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:03.026 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:02 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:03.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:02 smithi047 ceph-mon[93224]: pgmap v236: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 0 B/s wr, 7 op/s 2024-02-07T12:35:03.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:02 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:03.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:02 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:05.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:04 smithi138 ceph-mon[82055]: pgmap v237: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s rd, 85 B/s wr, 10 op/s 2024-02-07T12:35:05.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:04 smithi047 ceph-mon[93224]: pgmap v237: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s rd, 85 B/s wr, 10 op/s 2024-02-07T12:35:06.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:05 smithi138 ceph-mon[82055]: Upgrade: Updating node-exporter.smithi138 (2/2) 2024-02-07T12:35:06.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:05 smithi138 ceph-mon[82055]: Deploying daemon node-exporter.smithi138 on smithi138 2024-02-07T12:35:06.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:05 smithi047 ceph-mon[93224]: Upgrade: Updating node-exporter.smithi138 (2/2) 2024-02-07T12:35:06.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:05 smithi047 ceph-mon[93224]: Deploying daemon node-exporter.smithi138 on smithi138 2024-02-07T12:35:07.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:06 smithi138 ceph-mon[82055]: pgmap v238: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 11 op/s 2024-02-07T12:35:07.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:06 smithi047 ceph-mon[93224]: pgmap v238: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 11 op/s 2024-02-07T12:35:08.958 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:08 smithi138 ceph-mon[82055]: pgmap v239: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 12 op/s 2024-02-07T12:35:09.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:08 smithi047 ceph-mon[93224]: pgmap v239: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 12 op/s 2024-02-07T12:35:10.994 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:10 smithi138 ceph-mon[82055]: pgmap v240: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 12 op/s 2024-02-07T12:35:10.994 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:10.994 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:10.994 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:35:11.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:10 smithi047 ceph-mon[93224]: pgmap v240: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 12 op/s 2024-02-07T12:35:11.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:11.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:11.028 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:35:12.809 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:12 smithi047 ceph-mon[93224]: pgmap v241: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 13 op/s 2024-02-07T12:35:12.809 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:35:12.809 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:12.809 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:13.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:12 smithi138 ceph-mon[82055]: pgmap v241: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 13 op/s 2024-02-07T12:35:13.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:35:13.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:13.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:14.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:14 smithi138 ceph-mon[82055]: pgmap v242: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 8.5 MiB/s rd, 170 B/s wr, 7 op/s 2024-02-07T12:35:14.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:14 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:14.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:14 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:14.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:14 smithi047 ceph-mon[93224]: pgmap v242: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 8.5 MiB/s rd, 170 B/s wr, 7 op/s 2024-02-07T12:35:14.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:14 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:14.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:14 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:16.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:15 smithi138 ceph-mon[82055]: pgmap v243: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s rd, 85 B/s wr, 4 op/s 2024-02-07T12:35:16.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:15 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:16.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:15 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:16.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:15 smithi047 ceph-mon[93224]: pgmap v243: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s rd, 85 B/s wr, 4 op/s 2024-02-07T12:35:16.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:15 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:16.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:15 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:17.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:17.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:17.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:17.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:16 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:17.062 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:17.063 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:17.063 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:17.063 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:16 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:18.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:17 smithi047 ceph-mon[93224]: pgmap v244: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4 op/s 2024-02-07T12:35:18.284 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:17 smithi138 ceph-mon[82055]: pgmap v244: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4 op/s 2024-02-07T12:35:20.479 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: pgmap v245: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:35:20.480 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:20.480 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:20.480 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:35:20.480 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:35:20.480 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:20.480 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:35:20.480 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.480 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.480 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.480 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.481 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.481 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.481 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.481 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.481 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.481 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.481 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.481 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.481 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:20 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: pgmap v245: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:35:20.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:20.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:20.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:35:20.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:35:20.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:20.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:35:20.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:20.536 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:20 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:22.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:22 smithi138 ceph-mon[82055]: pgmap v246: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-07T12:35:22.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:22 smithi138 ceph-mon[82055]: Upgrade: Updating prometheus.smithi047 2024-02-07T12:35:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:22 smithi047 ceph-mon[93224]: pgmap v246: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-07T12:35:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:22 smithi047 ceph-mon[93224]: Upgrade: Updating prometheus.smithi047 2024-02-07T12:35:23.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:23 smithi138 ceph-mon[82055]: Deploying daemon prometheus.smithi047 on smithi047 2024-02-07T12:35:23.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:23 smithi047 ceph-mon[93224]: Deploying daemon prometheus.smithi047 on smithi047 2024-02-07T12:35:24.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:24 smithi138 ceph-mon[82055]: pgmap v247: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:35:24.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:24 smithi047 ceph-mon[93224]: pgmap v247: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:35:26.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:26 smithi047 ceph-mon[93224]: pgmap v248: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-07T12:35:26.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:26 smithi138 ceph-mon[82055]: pgmap v248: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-07T12:35:27.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:35:27.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:35:28.473 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:28 smithi047 ceph-mon[93224]: pgmap v249: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-02-07T12:35:28.473 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:28 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:28.473 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:28 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:28.473 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:28 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:35:28.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:28 smithi138 ceph-mon[82055]: pgmap v249: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-02-07T12:35:28.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:28 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:28.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:28 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:28.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:28 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:35:30.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.119+0000 7fe5ccd45700 1 -- 172.21.15.47:0/3057817213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5c80fbe40 msgr2=0x7fe5c80fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:30.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.119+0000 7fe5ccd45700 1 --2- 172.21.15.47:0/3057817213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5c80fbe40 0x7fe5c80fc250 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8004940 tx=0x7fe5b8009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:30.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.119+0000 7fe5ccd45700 1 -- 172.21.15.47:0/3057817213 shutdown_connections 2024-02-07T12:35:30.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.119+0000 7fe5ccd45700 1 --2- 172.21.15.47:0/3057817213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5c80fcfb0 0x7fe5c80fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.119+0000 7fe5ccd45700 1 --2- 172.21.15.47:0/3057817213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5c80fbe40 0x7fe5c80fc250 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.119+0000 7fe5ccd45700 1 -- 172.21.15.47:0/3057817213 >> 172.21.15.47:0/3057817213 conn(0x7fe5c80f74e0 msgr2=0x7fe5c80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:30.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.119+0000 7fe5ccd45700 1 -- 172.21.15.47:0/3057817213 shutdown_connections 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.119+0000 7fe5ccd45700 1 -- 172.21.15.47:0/3057817213 wait complete. 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5ccd45700 1 Processor -- start 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5ccd45700 1 -- start start 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5ccd45700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5c80fbe40 0x7fe5c8110660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5ccd45700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5c80fcfb0 0x7fe5c8112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5ccd45700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c8066460 con 0x7fe5c80fbe40 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5ccd45700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c80665a0 con 0x7fe5c80fcfb0 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5c659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5c80fbe40 0x7fe5c8110660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5c659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5c80fbe40 0x7fe5c8110660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35460/0 (socket says 172.21.15.47:35460) 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5c659c700 1 -- 172.21.15.47:0/377028513 learned_addr learned my addr 172.21.15.47:0/377028513 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5c659c700 1 -- 172.21.15.47:0/377028513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5c80fcfb0 msgr2=0x7fe5c8112bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5c5d9b700 1 --2- 172.21.15.47:0/377028513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5c80fcfb0 0x7fe5c8112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5c659c700 1 --2- 172.21.15.47:0/377028513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5c80fcfb0 0x7fe5c8112bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5c659c700 1 -- 172.21.15.47:0/377028513 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b8005040 con 0x7fe5c80fbe40 2024-02-07T12:35:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5c5d9b700 1 --2- 172.21.15.47:0/377028513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5c80fcfb0 0x7fe5c8112bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:35:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.120+0000 7fe5c659c700 1 --2- 172.21.15.47:0/377028513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5c80fbe40 0x7fe5c8110660 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80093b0 tx=0x7fe5b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.121+0000 7fe5beffd700 1 -- 172.21.15.47:0/377028513 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5b800e040 con 0x7fe5c80fbe40 2024-02-07T12:35:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.121+0000 7fe5beffd700 1 -- 172.21.15.47:0/377028513 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5b800bcc0 con 0x7fe5c80fbe40 2024-02-07T12:35:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.121+0000 7fe5ccd45700 1 -- 172.21.15.47:0/377028513 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c81131b0 con 0x7fe5c80fbe40 2024-02-07T12:35:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.121+0000 7fe5beffd700 1 -- 172.21.15.47:0/377028513 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5b801c630 con 0x7fe5c80fbe40 2024-02-07T12:35:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.121+0000 7fe5ccd45700 1 -- 172.21.15.47:0/377028513 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c81136f0 con 0x7fe5c80fbe40 2024-02-07T12:35:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.122+0000 7fe5ccd45700 1 -- 172.21.15.47:0/377028513 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c804bed0 con 0x7fe5c80fbe40 2024-02-07T12:35:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.122+0000 7fe5beffd700 1 -- 172.21.15.47:0/377028513 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe5b80139f0 con 0x7fe5c80fbe40 2024-02-07T12:35:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.123+0000 7fe5beffd700 1 --2- 172.21.15.47:0/377028513 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe5b406d7e0 0x7fe5b406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.123+0000 7fe5c5d9b700 1 --2- 172.21.15.47:0/377028513 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe5b406d7e0 0x7fe5b406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.123+0000 7fe5beffd700 1 -- 172.21.15.47:0/377028513 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe5b808e2c0 con 0x7fe5c80fbe40 2024-02-07T12:35:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.123+0000 7fe5c5d9b700 1 --2- 172.21.15.47:0/377028513 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe5b406d7e0 0x7fe5b406fc90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0007fd0 tx=0x7fe5b0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.127+0000 7fe5beffd700 1 -- 172.21.15.47:0/377028513 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe5b8057b80 con 0x7fe5c80fbe40 2024-02-07T12:35:30.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.361+0000 7fe5ccd45700 1 -- 172.21.15.47:0/377028513 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5c8101990 con 0x7fe5b406d7e0 2024-02-07T12:35:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.362+0000 7fe5beffd700 1 -- 172.21.15.47:0/377028513 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7fe5c8101990 con 0x7fe5b406d7e0 2024-02-07T12:35:30.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.364+0000 7fe5ccd45700 1 -- 172.21.15.47:0/377028513 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe5b406d7e0 msgr2=0x7fe5b406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:30.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.364+0000 7fe5ccd45700 1 --2- 172.21.15.47:0/377028513 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe5b406d7e0 0x7fe5b406fc90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0007fd0 tx=0x7fe5b0009040 comp rx=0 tx=0).stop 2024-02-07T12:35:30.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.364+0000 7fe5ccd45700 1 -- 172.21.15.47:0/377028513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5c80fbe40 msgr2=0x7fe5c8110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:30.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.364+0000 7fe5ccd45700 1 --2- 172.21.15.47:0/377028513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5c80fbe40 0x7fe5c8110660 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80093b0 tx=0x7fe5b8009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:30.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.364+0000 7fe5ccd45700 1 -- 172.21.15.47:0/377028513 shutdown_connections 2024-02-07T12:35:30.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.364+0000 7fe5ccd45700 1 --2- 172.21.15.47:0/377028513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5c80fbe40 0x7fe5c8110660 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.364+0000 7fe5ccd45700 1 --2- 172.21.15.47:0/377028513 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe5b406d7e0 0x7fe5b406fc90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.364+0000 7fe5ccd45700 1 --2- 172.21.15.47:0/377028513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5c80fcfb0 0x7fe5c8112bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.364+0000 7fe5ccd45700 1 -- 172.21.15.47:0/377028513 >> 172.21.15.47:0/377028513 conn(0x7fe5c80f74e0 msgr2=0x7fe5c8100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:30.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.364+0000 7fe5ccd45700 1 -- 172.21.15.47:0/377028513 shutdown_connections 2024-02-07T12:35:30.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.364+0000 7fe5ccd45700 1 -- 172.21.15.47:0/377028513 wait complete. 2024-02-07T12:35:30.378 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:35:30.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.470+0000 7f3c42833700 1 -- 172.21.15.47:0/2265954925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c0fbe40 msgr2=0x7f3c3c0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:30.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.470+0000 7f3c42833700 1 --2- 172.21.15.47:0/2265954925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c0fbe40 0x7f3c3c0fc250 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c004940 tx=0x7f3c2c009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:30.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.470+0000 7f3c42833700 1 -- 172.21.15.47:0/2265954925 shutdown_connections 2024-02-07T12:35:30.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.470+0000 7f3c42833700 1 --2- 172.21.15.47:0/2265954925 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c3c0fcfb0 0x7f3c3c0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.470+0000 7f3c42833700 1 --2- 172.21.15.47:0/2265954925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c0fbe40 0x7f3c3c0fc250 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.470+0000 7f3c42833700 1 -- 172.21.15.47:0/2265954925 >> 172.21.15.47:0/2265954925 conn(0x7f3c3c0f74e0 msgr2=0x7f3c3c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:30.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.470+0000 7f3c42833700 1 -- 172.21.15.47:0/2265954925 shutdown_connections 2024-02-07T12:35:30.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.470+0000 7f3c42833700 1 -- 172.21.15.47:0/2265954925 wait complete. 2024-02-07T12:35:30.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.470+0000 7f3c42833700 1 Processor -- start 2024-02-07T12:35:30.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.471+0000 7f3c42833700 1 -- start start 2024-02-07T12:35:30.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.471+0000 7f3c42833700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c3c0fbe40 0x7f3c3c110660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:30.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.471+0000 7f3c42833700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c0fcfb0 0x7f3c3c112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:30.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.471+0000 7f3c42833700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c066460 con 0x7f3c3c0fcfb0 2024-02-07T12:35:30.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.471+0000 7f3c42833700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0665a0 con 0x7f3c3c0fbe40 2024-02-07T12:35:30.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.471+0000 7f3c3b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c0fcfb0 0x7f3c3c112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:30.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.471+0000 7f3c3b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c0fcfb0 0x7f3c3c112bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35482/0 (socket says 172.21.15.47:35482) 2024-02-07T12:35:30.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.471+0000 7f3c3b7fe700 1 -- 172.21.15.47:0/1921590052 learned_addr learned my addr 172.21.15.47:0/1921590052 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:35:30.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.471+0000 7f3c3bfff700 1 --2- 172.21.15.47:0/1921590052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c3c0fbe40 0x7f3c3c110660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:30.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.472+0000 7f3c3b7fe700 1 -- 172.21.15.47:0/1921590052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c3c0fbe40 msgr2=0x7f3c3c110660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:30.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.472+0000 7f3c3b7fe700 1 --2- 172.21.15.47:0/1921590052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c3c0fbe40 0x7f3c3c110660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.472+0000 7f3c3b7fe700 1 -- 172.21.15.47:0/1921590052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c005040 con 0x7f3c3c0fcfb0 2024-02-07T12:35:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.472+0000 7f3c3b7fe700 1 --2- 172.21.15.47:0/1921590052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c0fcfb0 0x7f3c3c112bb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000c830 tx=0x7f3c30004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.472+0000 7f3c38ff9700 1 -- 172.21.15.47:0/1921590052 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c300106f0 con 0x7f3c3c0fcfb0 2024-02-07T12:35:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.472+0000 7f3c38ff9700 1 -- 172.21.15.47:0/1921590052 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c30010d20 con 0x7f3c3c0fcfb0 2024-02-07T12:35:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.472+0000 7f3c42833700 1 -- 172.21.15.47:0/1921590052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3c1131b0 con 0x7f3c3c0fcfb0 2024-02-07T12:35:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.472+0000 7f3c38ff9700 1 -- 172.21.15.47:0/1921590052 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c300113a0 con 0x7f3c3c0fcfb0 2024-02-07T12:35:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.472+0000 7f3c42833700 1 -- 172.21.15.47:0/1921590052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3c1136f0 con 0x7f3c3c0fcfb0 2024-02-07T12:35:30.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.473+0000 7f3c42833700 1 -- 172.21.15.47:0/1921590052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3c04bed0 con 0x7f3c3c0fcfb0 2024-02-07T12:35:30.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.473+0000 7f3c38ff9700 1 -- 172.21.15.47:0/1921590052 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f3c30012400 con 0x7f3c3c0fcfb0 2024-02-07T12:35:30.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.474+0000 7f3c38ff9700 1 --2- 172.21.15.47:0/1921590052 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3c2406d7e0 0x7f3c2406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:30.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.474+0000 7f3c38ff9700 1 -- 172.21.15.47:0/1921590052 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3c3008cf20 con 0x7f3c3c0fcfb0 2024-02-07T12:35:30.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.474+0000 7f3c3bfff700 1 --2- 172.21.15.47:0/1921590052 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3c2406d7e0 0x7f3c2406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:30.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.474+0000 7f3c3bfff700 1 --2- 172.21.15.47:0/1921590052 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3c2406d7e0 0x7f3c2406fc90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c004890 tx=0x7f3c2c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:30.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.479+0000 7f3c38ff9700 1 -- 172.21.15.47:0/1921590052 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3c300c0d20 con 0x7f3c3c0fcfb0 2024-02-07T12:35:30.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:30 smithi047 ceph-mon[93224]: pgmap v250: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-02-07T12:35:30.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.733+0000 7f3c42833700 1 -- 172.21.15.47:0/1921590052 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c3c101990 con 0x7f3c2406d7e0 2024-02-07T12:35:30.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.735+0000 7f3c38ff9700 1 -- 172.21.15.47:0/1921590052 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f3c3c101990 con 0x7f3c2406d7e0 2024-02-07T12:35:30.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.737+0000 7f3c42833700 1 -- 172.21.15.47:0/1921590052 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3c2406d7e0 msgr2=0x7f3c2406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:30.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.737+0000 7f3c42833700 1 --2- 172.21.15.47:0/1921590052 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3c2406d7e0 0x7f3c2406fc90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c004890 tx=0x7f3c2c009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:30.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.737+0000 7f3c42833700 1 -- 172.21.15.47:0/1921590052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c0fcfb0 msgr2=0x7f3c3c112bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:30.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.737+0000 7f3c42833700 1 --2- 172.21.15.47:0/1921590052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c0fcfb0 0x7f3c3c112bb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000c830 tx=0x7f3c30004470 comp rx=0 tx=0).stop 2024-02-07T12:35:30.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.737+0000 7f3c42833700 1 -- 172.21.15.47:0/1921590052 shutdown_connections 2024-02-07T12:35:30.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.737+0000 7f3c42833700 1 --2- 172.21.15.47:0/1921590052 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f3c2406d7e0 0x7f3c2406fc90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.737+0000 7f3c42833700 1 --2- 172.21.15.47:0/1921590052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c3c0fbe40 0x7f3c3c110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.737+0000 7f3c42833700 1 --2- 172.21.15.47:0/1921590052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c0fcfb0 0x7f3c3c112bb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.737+0000 7f3c42833700 1 -- 172.21.15.47:0/1921590052 >> 172.21.15.47:0/1921590052 conn(0x7f3c3c0f74e0 msgr2=0x7f3c3c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:30.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.737+0000 7f3c42833700 1 -- 172.21.15.47:0/1921590052 shutdown_connections 2024-02-07T12:35:30.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.737+0000 7f3c42833700 1 -- 172.21.15.47:0/1921590052 wait complete. 2024-02-07T12:35:30.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:30 smithi138 ceph-mon[82055]: pgmap v250: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-02-07T12:35:30.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.839+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/2284138067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfe40fbc90 msgr2=0x7fbfe40fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:30.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.839+0000 7fbfeb3a1700 1 --2- 172.21.15.47:0/2284138067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfe40fbc90 0x7fbfe40fe4f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8004940 tx=0x7fbfd8009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:30.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.839+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/2284138067 shutdown_connections 2024-02-07T12:35:30.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.839+0000 7fbfeb3a1700 1 --2- 172.21.15.47:0/2284138067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfe40fbc90 0x7fbfe40fe4f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.839+0000 7fbfeb3a1700 1 --2- 172.21.15.47:0/2284138067 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfe40fb340 0x7fbfe40fb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.839+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/2284138067 >> 172.21.15.47:0/2284138067 conn(0x7fbfe40f6d20 msgr2=0x7fbfe40f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:30.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.839+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/2284138067 shutdown_connections 2024-02-07T12:35:30.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.839+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/2284138067 wait complete. 2024-02-07T12:35:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.840+0000 7fbfeb3a1700 1 Processor -- start 2024-02-07T12:35:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.840+0000 7fbfeb3a1700 1 -- start start 2024-02-07T12:35:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.840+0000 7fbfeb3a1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfe40fb340 0x7fbfe410de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.840+0000 7fbfeb3a1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfe40fbc90 0x7fbfe410e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.840+0000 7fbfeb3a1700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe410ea50 con 0x7fbfe40fbc90 2024-02-07T12:35:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.840+0000 7fbfeb3a1700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe410f290 con 0x7fbfe40fb340 2024-02-07T12:35:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.840+0000 7fbfe893c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfe40fbc90 0x7fbfe410e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.840+0000 7fbfe893c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfe40fbc90 0x7fbfe410e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35510/0 (socket says 172.21.15.47:35510) 2024-02-07T12:35:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.840+0000 7fbfe893c700 1 -- 172.21.15.47:0/1068205991 learned_addr learned my addr 172.21.15.47:0/1068205991 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:35:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.840+0000 7fbfe913d700 1 --2- 172.21.15.47:0/1068205991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfe40fb340 0x7fbfe410de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.841+0000 7fbfe893c700 1 -- 172.21.15.47:0/1068205991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfe40fb340 msgr2=0x7fbfe410de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:30.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.841+0000 7fbfe893c700 1 --2- 172.21.15.47:0/1068205991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfe40fb340 0x7fbfe410de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:30.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.841+0000 7fbfe893c700 1 -- 172.21.15.47:0/1068205991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8005040 con 0x7fbfe40fbc90 2024-02-07T12:35:30.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.841+0000 7fbfe893c700 1 --2- 172.21.15.47:0/1068205991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfe40fbc90 0x7fbfe410e3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80093b0 tx=0x7fbfd8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:30.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.841+0000 7fbfe1ffb700 1 -- 172.21.15.47:0/1068205991 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfd800e040 con 0x7fbfe40fbc90 2024-02-07T12:35:30.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.841+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/1068205991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe410f510 con 0x7fbfe40fbc90 2024-02-07T12:35:30.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.841+0000 7fbfe1ffb700 1 -- 172.21.15.47:0/1068205991 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbfd800bcc0 con 0x7fbfe40fbc90 2024-02-07T12:35:30.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.841+0000 7fbfe1ffb700 1 -- 172.21.15.47:0/1068205991 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfd801c630 con 0x7fbfe40fbc90 2024-02-07T12:35:30.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.841+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/1068205991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe410fa50 con 0x7fbfe40fbc90 2024-02-07T12:35:30.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.842+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/1068205991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe4107d10 con 0x7fbfe40fbc90 2024-02-07T12:35:30.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.843+0000 7fbfe1ffb700 1 -- 172.21.15.47:0/1068205991 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fbfd80139f0 con 0x7fbfe40fbc90 2024-02-07T12:35:30.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.843+0000 7fbfe1ffb700 1 --2- 172.21.15.47:0/1068205991 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fbfcc06d7e0 0x7fbfcc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:30.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.843+0000 7fbfe1ffb700 1 -- 172.21.15.47:0/1068205991 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fbfd808e470 con 0x7fbfe40fbc90 2024-02-07T12:35:30.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.843+0000 7fbfe913d700 1 --2- 172.21.15.47:0/1068205991 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fbfcc06d7e0 0x7fbfcc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:30.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.844+0000 7fbfe913d700 1 --2- 172.21.15.47:0/1068205991 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fbfcc06d7e0 0x7fbfcc06fc90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4001250 tx=0x7fbfd4009620 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:30.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:30.848+0000 7fbfe1ffb700 1 -- 172.21.15.47:0/1068205991 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbfd805b720 con 0x7fbfe40fbc90 2024-02-07T12:35:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.060+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/1068205991 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfe40677a0 con 0x7fbfcc06d7e0 2024-02-07T12:35:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.073+0000 7fbfe1ffb700 1 -- 172.21.15.47:0/1068205991 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fbfe40677a0 con 0x7fbfcc06d7e0 2024-02-07T12:35:31.076 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:35:31.076 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (9m) 16s ago 17m 26.2M - 0.25.0 c8568f914cd2 ed15ee667317 2024-02-07T12:35:31.076 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (6m) 16s ago 18m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:35:31.077 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (6m) 18s ago 17m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:35:31.077 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (8m) 16s ago 17m 85.5M - 9.4.7 954c08fa6188 bfdb686715b4 2024-02-07T12:35:31.077 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (77s) 16s ago 12m 14.9M - 19.0.0-1252-g44458cce 79957b372307 fbda6b9f9953 2024-02-07T12:35:31.077 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (102s) 16s ago 12m 67.2M - 19.0.0-1252-g44458cce 79957b372307 055df3be8762 2024-02-07T12:35:31.077 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (42s) 18s ago 12m 14.0M - 19.0.0-1252-g44458cce 79957b372307 742dc60bfa13 2024-02-07T12:35:31.077 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (58s) 18s ago 12m 67.1M - 19.0.0-1252-g44458cce 79957b372307 502afeac2e7d 2024-02-07T12:35:31.077 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (8m) 16s ago 19m 510M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:35:31.077 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (7m) 18s ago 17m 453M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:35:31.077 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (7m) 16s ago 19m 56.8M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:35:31.077 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (6m) 18s ago 16m 43.4M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:35:31.078 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (29s) 16s ago 18m 7436k - 1.5.0 0da6a335fe13 199e0ea3a587 2024-02-07T12:35:31.078 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (21s) 18s ago 17m 3623k - 1.5.0 0da6a335fe13 f9f13e3bf225 2024-02-07T12:35:31.078 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (5m) 16s ago 16m 102M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:35:31.078 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (5m) 16s ago 15m 113M 1559M 19.0.0-1252-g44458cce 79957b372307 0f2b0eea74d7 2024-02-07T12:35:31.078 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (4m) 16s ago 15m 91.2M 1559M 19.0.0-1252-g44458cce 79957b372307 0b8c78346346 2024-02-07T12:35:31.078 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (3m) 18s ago 14m 129M 2581M 19.0.0-1252-g44458cce 79957b372307 dea45db021db 2024-02-07T12:35:31.078 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (3m) 18s ago 14m 100M 2581M 19.0.0-1252-g44458cce 79957b372307 3161c1dfe6f5 2024-02-07T12:35:31.078 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (2m) 18s ago 14m 93.9M 2581M 19.0.0-1252-g44458cce 79957b372307 c9504c7cfe7c 2024-02-07T12:35:31.078 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 starting - - - - 2024-02-07T12:35:31.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.075+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/1068205991 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fbfcc06d7e0 msgr2=0x7fbfcc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:31.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.075+0000 7fbfeb3a1700 1 --2- 172.21.15.47:0/1068205991 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fbfcc06d7e0 0x7fbfcc06fc90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4001250 tx=0x7fbfd4009620 comp rx=0 tx=0).stop 2024-02-07T12:35:31.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.075+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/1068205991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfe40fbc90 msgr2=0x7fbfe410e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:31.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.075+0000 7fbfeb3a1700 1 --2- 172.21.15.47:0/1068205991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfe40fbc90 0x7fbfe410e3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80093b0 tx=0x7fbfd8009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:31.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.075+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/1068205991 shutdown_connections 2024-02-07T12:35:31.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.075+0000 7fbfeb3a1700 1 --2- 172.21.15.47:0/1068205991 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fbfcc06d7e0 0x7fbfcc06fc90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.075+0000 7fbfeb3a1700 1 --2- 172.21.15.47:0/1068205991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfe40fb340 0x7fbfe410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.075+0000 7fbfeb3a1700 1 --2- 172.21.15.47:0/1068205991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfe40fbc90 0x7fbfe410e3c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.075+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/1068205991 >> 172.21.15.47:0/1068205991 conn(0x7fbfe40f6d20 msgr2=0x7fbfe4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:31.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.075+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/1068205991 shutdown_connections 2024-02-07T12:35:31.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.076+0000 7fbfeb3a1700 1 -- 172.21.15.47:0/1068205991 wait complete. 2024-02-07T12:35:31.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.181+0000 7fd1b057e700 1 -- 172.21.15.47:0/493544656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a80fcef0 msgr2=0x7fd1a80fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.181+0000 7fd1b057e700 1 --2- 172.21.15.47:0/493544656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a80fcef0 0x7fd1a80fd320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4004940 tx=0x7fd1a4009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.181+0000 7fd1b057e700 1 -- 172.21.15.47:0/493544656 shutdown_connections 2024-02-07T12:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.181+0000 7fd1b057e700 1 --2- 172.21.15.47:0/493544656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1a80fe0e0 0x7fd1a80fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.181+0000 7fd1b057e700 1 --2- 172.21.15.47:0/493544656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a80fcef0 0x7fd1a80fd320 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.181+0000 7fd1b057e700 1 -- 172.21.15.47:0/493544656 >> 172.21.15.47:0/493544656 conn(0x7fd1a80f8620 msgr2=0x7fd1a80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.181+0000 7fd1b057e700 1 -- 172.21.15.47:0/493544656 shutdown_connections 2024-02-07T12:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.181+0000 7fd1b057e700 1 -- 172.21.15.47:0/493544656 wait complete. 2024-02-07T12:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.182+0000 7fd1b057e700 1 Processor -- start 2024-02-07T12:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.182+0000 7fd1b057e700 1 -- start start 2024-02-07T12:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.182+0000 7fd1b057e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a80fcef0 0x7fd1a8071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.182+0000 7fd1b057e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1a80fe0e0 0x7fd1a80702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.182+0000 7fd1b057e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8070970 con 0x7fd1a80fcef0 2024-02-07T12:35:31.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.182+0000 7fd1b057e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8070ae0 con 0x7fd1a80fe0e0 2024-02-07T12:35:31.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.182+0000 7fd1ae31a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a80fcef0 0x7fd1a8071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:31.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.182+0000 7fd1ae31a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a80fcef0 0x7fd1a8071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35522/0 (socket says 172.21.15.47:35522) 2024-02-07T12:35:31.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.182+0000 7fd1ae31a700 1 -- 172.21.15.47:0/1128029331 learned_addr learned my addr 172.21.15.47:0/1128029331 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:35:31.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.182+0000 7fd1ae31a700 1 -- 172.21.15.47:0/1128029331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1a80fe0e0 msgr2=0x7fd1a80702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:31.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.182+0000 7fd1ae31a700 1 --2- 172.21.15.47:0/1128029331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1a80fe0e0 0x7fd1a80702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.182+0000 7fd1ae31a700 1 -- 172.21.15.47:0/1128029331 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4005040 con 0x7fd1a80fcef0 2024-02-07T12:35:31.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.182+0000 7fd1ae31a700 1 --2- 172.21.15.47:0/1128029331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a80fcef0 0x7fd1a8071e60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400b3b0 tx=0x7fd1a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:31.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.183+0000 7fd19effd700 1 -- 172.21.15.47:0/1128029331 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1a400e040 con 0x7fd1a80fcef0 2024-02-07T12:35:31.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.183+0000 7fd19effd700 1 -- 172.21.15.47:0/1128029331 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1a400bcc0 con 0x7fd1a80fcef0 2024-02-07T12:35:31.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.183+0000 7fd1b057e700 1 -- 172.21.15.47:0/1128029331 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a8070d60 con 0x7fd1a80fcef0 2024-02-07T12:35:31.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.183+0000 7fd19effd700 1 -- 172.21.15.47:0/1128029331 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1a401c630 con 0x7fd1a80fcef0 2024-02-07T12:35:31.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.183+0000 7fd1b057e700 1 -- 172.21.15.47:0/1128029331 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a81159e0 con 0x7fd1a80fcef0 2024-02-07T12:35:31.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.184+0000 7fd1b057e700 1 -- 172.21.15.47:0/1128029331 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a804bed0 con 0x7fd1a80fcef0 2024-02-07T12:35:31.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.184+0000 7fd19effd700 1 -- 172.21.15.47:0/1128029331 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd1a40139f0 con 0x7fd1a80fcef0 2024-02-07T12:35:31.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.185+0000 7fd19effd700 1 --2- 172.21.15.47:0/1128029331 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd19406d7e0 0x7fd19406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:31.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.185+0000 7fd19effd700 1 -- 172.21.15.47:0/1128029331 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd1a408e3d0 con 0x7fd1a80fcef0 2024-02-07T12:35:31.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.185+0000 7fd1adb19700 1 --2- 172.21.15.47:0/1128029331 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd19406d7e0 0x7fd19406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:31.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.185+0000 7fd1adb19700 1 --2- 172.21.15.47:0/1128029331 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd19406d7e0 0x7fd19406fc90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd198006fd0 tx=0x7fd198006db0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:31.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.189+0000 7fd19effd700 1 -- 172.21.15.47:0/1128029331 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd1a405b720 con 0x7fd1a80fcef0 2024-02-07T12:35:31.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.486+0000 7fd1b057e700 1 -- 172.21.15.47:0/1128029331 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd1a8115e90 con 0x7fd1a80fcef0 2024-02-07T12:35:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.486+0000 7fd19effd700 1 -- 172.21.15.47:0/1128029331 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fd1a405b2b0 con 0x7fd1a80fcef0 2024-02-07T12:35:31.490 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:35:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:35:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:35:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:35:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:35:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:35:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:35:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:35:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 6 2024-02-07T12:35:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:35:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:35:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 4 2024-02-07T12:35:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:35:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:35:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 14 2024-02-07T12:35:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:35:31.491 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:35:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.489+0000 7fd1b057e700 1 -- 172.21.15.47:0/1128029331 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd19406d7e0 msgr2=0x7fd19406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.489+0000 7fd1b057e700 1 --2- 172.21.15.47:0/1128029331 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd19406d7e0 0x7fd19406fc90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd198006fd0 tx=0x7fd198006db0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.489+0000 7fd1b057e700 1 -- 172.21.15.47:0/1128029331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a80fcef0 msgr2=0x7fd1a8071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.489+0000 7fd1b057e700 1 --2- 172.21.15.47:0/1128029331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a80fcef0 0x7fd1a8071e60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400b3b0 tx=0x7fd1a4009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.489+0000 7fd1b057e700 1 -- 172.21.15.47:0/1128029331 shutdown_connections 2024-02-07T12:35:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.489+0000 7fd1b057e700 1 --2- 172.21.15.47:0/1128029331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a80fcef0 0x7fd1a8071e60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.489+0000 7fd1b057e700 1 --2- 172.21.15.47:0/1128029331 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd19406d7e0 0x7fd19406fc90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.489+0000 7fd1b057e700 1 --2- 172.21.15.47:0/1128029331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1a80fe0e0 0x7fd1a80702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.489+0000 7fd1b057e700 1 -- 172.21.15.47:0/1128029331 >> 172.21.15.47:0/1128029331 conn(0x7fd1a80f8620 msgr2=0x7fd1a81013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:31.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.489+0000 7fd1b057e700 1 -- 172.21.15.47:0/1128029331 shutdown_connections 2024-02-07T12:35:31.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.489+0000 7fd1b057e700 1 -- 172.21.15.47:0/1128029331 wait complete. 2024-02-07T12:35:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.591+0000 7fd96ee42700 1 -- 172.21.15.47:0/2767881027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9680fcef0 msgr2=0x7fd9680fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.591+0000 7fd96ee42700 1 --2- 172.21.15.47:0/2767881027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9680fcef0 0x7fd9680fd320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd95c004940 tx=0x7fd95c009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.591+0000 7fd96ee42700 1 -- 172.21.15.47:0/2767881027 shutdown_connections 2024-02-07T12:35:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.591+0000 7fd96ee42700 1 --2- 172.21.15.47:0/2767881027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9680fe0e0 0x7fd9680fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.591+0000 7fd96ee42700 1 --2- 172.21.15.47:0/2767881027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9680fcef0 0x7fd9680fd320 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.591+0000 7fd96ee42700 1 -- 172.21.15.47:0/2767881027 >> 172.21.15.47:0/2767881027 conn(0x7fd9680f8620 msgr2=0x7fd9680faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.591+0000 7fd96ee42700 1 -- 172.21.15.47:0/2767881027 shutdown_connections 2024-02-07T12:35:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.591+0000 7fd96ee42700 1 -- 172.21.15.47:0/2767881027 wait complete. 2024-02-07T12:35:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.592+0000 7fd96ee42700 1 Processor -- start 2024-02-07T12:35:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.592+0000 7fd96ee42700 1 -- start start 2024-02-07T12:35:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.592+0000 7fd96ee42700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9680fcef0 0x7fd96810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.592+0000 7fd96ee42700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9680fe0e0 0x7fd96810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.592+0000 7fd96ee42700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96810e4b0 con 0x7fd9680fcef0 2024-02-07T12:35:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.592+0000 7fd96ee42700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96810ed50 con 0x7fd9680fe0e0 2024-02-07T12:35:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.592+0000 7fd96cbde700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9680fcef0 0x7fd96810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.592+0000 7fd96cbde700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9680fcef0 0x7fd96810d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35550/0 (socket says 172.21.15.47:35550) 2024-02-07T12:35:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.592+0000 7fd96cbde700 1 -- 172.21.15.47:0/1487441275 learned_addr learned my addr 172.21.15.47:0/1487441275 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:35:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.593+0000 7fd967fff700 1 --2- 172.21.15.47:0/1487441275 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9680fe0e0 0x7fd96810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.593+0000 7fd96cbde700 1 -- 172.21.15.47:0/1487441275 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9680fe0e0 msgr2=0x7fd96810deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.593+0000 7fd96cbde700 1 --2- 172.21.15.47:0/1487441275 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9680fe0e0 0x7fd96810deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.593+0000 7fd96cbde700 1 -- 172.21.15.47:0/1487441275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c005040 con 0x7fd9680fcef0 2024-02-07T12:35:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.593+0000 7fd96cbde700 1 --2- 172.21.15.47:0/1487441275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9680fcef0 0x7fd96810d970 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009360 tx=0x7fd95c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.593+0000 7fd9657fa700 1 -- 172.21.15.47:0/1487441275 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd95c00e040 con 0x7fd9680fcef0 2024-02-07T12:35:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.593+0000 7fd9657fa700 1 -- 172.21.15.47:0/1487441275 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd95c004290 con 0x7fd9680fcef0 2024-02-07T12:35:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.593+0000 7fd96ee42700 1 -- 172.21.15.47:0/1487441275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96810efd0 con 0x7fd9680fcef0 2024-02-07T12:35:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.593+0000 7fd9657fa700 1 -- 172.21.15.47:0/1487441275 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd95c01c630 con 0x7fd9680fcef0 2024-02-07T12:35:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.593+0000 7fd96ee42700 1 -- 172.21.15.47:0/1487441275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96810f510 con 0x7fd9680fcef0 2024-02-07T12:35:31.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.594+0000 7fd96ee42700 1 -- 172.21.15.47:0/1487441275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96804bed0 con 0x7fd9680fcef0 2024-02-07T12:35:31.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.594+0000 7fd9657fa700 1 -- 172.21.15.47:0/1487441275 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd95c00bcc0 con 0x7fd9680fcef0 2024-02-07T12:35:31.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.595+0000 7fd9657fa700 1 --2- 172.21.15.47:0/1487441275 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd95806d7f0 0x7fd95806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:31.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.595+0000 7fd9657fa700 1 -- 172.21.15.47:0/1487441275 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd95c08e3a0 con 0x7fd9680fcef0 2024-02-07T12:35:31.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.595+0000 7fd967fff700 1 --2- 172.21.15.47:0/1487441275 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd95806d7f0 0x7fd95806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:31.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.595+0000 7fd967fff700 1 --2- 172.21.15.47:0/1487441275 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd95806d7f0 0x7fd95806fca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd954007fd0 tx=0x7fd954009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:31.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.600+0000 7fd9657fa700 1 -- 172.21.15.47:0/1487441275 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd95c05b6f0 con 0x7fd9680fcef0 2024-02-07T12:35:31.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:31 smithi138 ceph-mon[82055]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:31.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:31 smithi047 ceph-mon[93224]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:31.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.849+0000 7fd96ee42700 1 -- 172.21.15.47:0/1487441275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd96810f160 con 0x7fd9680fcef0 2024-02-07T12:35:31.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.850+0000 7fd9657fa700 1 -- 172.21.15.47:0/1487441275 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 48 v48) v1 ==== 76+0+1895 (secure 0 0 0) 0x7fd96810f160 con 0x7fd9680fcef0 2024-02-07T12:35:31.853 INFO:teuthology.orchestra.run.smithi047.stdout:e48 2024-02-07T12:35:31.853 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:35:31.853 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:35:31.854 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:35:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:35:31.854 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:35:31.854 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:35:31.854 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 48 2024-02-07T12:35:31.854 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:35:31.855 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:35:31.855 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:34:57.641208+0000 2024-02-07T12:35:31.855 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:35:31.855 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:35:31.855 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:35:31.855 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:35:31.856 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:35:31.856 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:35:31.856 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:35:31.856 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:35:31.856 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 84 2024-02-07T12:35:31.856 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-07T12:35:31.857 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:35:31.857 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:35:31.857 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=34428,1=34460} 2024-02-07T12:35:31.857 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:35:31.857 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:35:31.857 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:35:31.857 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:35:31.857 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:35:31.857 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:35:31.857 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:35:31.857 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:35:31.857 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:35:31.858 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:34428} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:35:31.858 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{0:44365} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6825/3547121337,v1:172.21.15.138:6826/3547121337] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:35:31.858 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:34460} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.47:6828/3723006072,v1:172.21.15.47:6829/3723006072] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:35:31.858 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{1:44369} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2689114398,v1:172.21.15.138:6827/2689114398] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:35:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:35:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:35:31.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.852+0000 7fd96ee42700 1 -- 172.21.15.47:0/1487441275 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd95806d7f0 msgr2=0x7fd95806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:31.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.852+0000 7fd96ee42700 1 --2- 172.21.15.47:0/1487441275 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd95806d7f0 0x7fd95806fca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd954007fd0 tx=0x7fd954009040 comp rx=0 tx=0).stop 2024-02-07T12:35:31.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.852+0000 7fd96ee42700 1 -- 172.21.15.47:0/1487441275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9680fcef0 msgr2=0x7fd96810d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:31.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.852+0000 7fd96ee42700 1 --2- 172.21.15.47:0/1487441275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9680fcef0 0x7fd96810d970 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009360 tx=0x7fd95c009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:31.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.852+0000 7fd96ee42700 1 -- 172.21.15.47:0/1487441275 shutdown_connections 2024-02-07T12:35:31.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.852+0000 7fd96ee42700 1 --2- 172.21.15.47:0/1487441275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9680fcef0 0x7fd96810d970 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.852+0000 7fd96ee42700 1 --2- 172.21.15.47:0/1487441275 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd95806d7f0 0x7fd95806fca0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.852+0000 7fd96ee42700 1 --2- 172.21.15.47:0/1487441275 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9680fe0e0 0x7fd96810deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.852+0000 7fd96ee42700 1 -- 172.21.15.47:0/1487441275 >> 172.21.15.47:0/1487441275 conn(0x7fd9680f8620 msgr2=0x7fd9681013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:31.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.852+0000 7fd96ee42700 1 -- 172.21.15.47:0/1487441275 shutdown_connections 2024-02-07T12:35:31.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.852+0000 7fd96ee42700 1 -- 172.21.15.47:0/1487441275 wait complete. 2024-02-07T12:35:31.860 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 48 2024-02-07T12:35:31.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.967+0000 7fef89c7c700 1 -- 172.21.15.47:0/4125473560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef840fe0e0 msgr2=0x7fef840fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:31.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.967+0000 7fef89c7c700 1 --2- 172.21.15.47:0/4125473560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef840fe0e0 0x7fef840fe550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fef78004940 tx=0x7fef78009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:31.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.967+0000 7fef89c7c700 1 -- 172.21.15.47:0/4125473560 shutdown_connections 2024-02-07T12:35:31.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.967+0000 7fef89c7c700 1 --2- 172.21.15.47:0/4125473560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef840fe0e0 0x7fef840fe550 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.967+0000 7fef89c7c700 1 --2- 172.21.15.47:0/4125473560 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef840fcef0 0x7fef840fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.967+0000 7fef89c7c700 1 -- 172.21.15.47:0/4125473560 >> 172.21.15.47:0/4125473560 conn(0x7fef840f8620 msgr2=0x7fef840faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:31.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.967+0000 7fef89c7c700 1 -- 172.21.15.47:0/4125473560 shutdown_connections 2024-02-07T12:35:31.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.967+0000 7fef89c7c700 1 -- 172.21.15.47:0/4125473560 wait complete. 2024-02-07T12:35:31.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.968+0000 7fef89c7c700 1 Processor -- start 2024-02-07T12:35:31.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.968+0000 7fef89c7c700 1 -- start start 2024-02-07T12:35:31.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.968+0000 7fef89c7c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef840fcef0 0x7fef8410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:31.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.968+0000 7fef89c7c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef840fe0e0 0x7fef8410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.968+0000 7fef89c7c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8410e4b0 con 0x7fef840fe0e0 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.968+0000 7fef89c7c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8410ed50 con 0x7fef840fcef0 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.969+0000 7fef82ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef840fe0e0 0x7fef8410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.969+0000 7fef82ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef840fe0e0 0x7fef8410deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35568/0 (socket says 172.21.15.47:35568) 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.969+0000 7fef82ffd700 1 -- 172.21.15.47:0/2623480895 learned_addr learned my addr 172.21.15.47:0/2623480895 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.969+0000 7fef837fe700 1 --2- 172.21.15.47:0/2623480895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef840fcef0 0x7fef8410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.969+0000 7fef82ffd700 1 -- 172.21.15.47:0/2623480895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef840fcef0 msgr2=0x7fef8410d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.969+0000 7fef82ffd700 1 --2- 172.21.15.47:0/2623480895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef840fcef0 0x7fef8410d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.969+0000 7fef82ffd700 1 -- 172.21.15.47:0/2623480895 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef78005040 con 0x7fef840fe0e0 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.969+0000 7fef82ffd700 1 --2- 172.21.15.47:0/2623480895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef840fe0e0 0x7fef8410deb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fef780093b0 tx=0x7fef78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.969+0000 7fef6bfff700 1 -- 172.21.15.47:0/2623480895 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef7800e040 con 0x7fef840fe0e0 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.969+0000 7fef89c7c700 1 -- 172.21.15.47:0/2623480895 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8410efd0 con 0x7fef840fe0e0 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.969+0000 7fef6bfff700 1 -- 172.21.15.47:0/2623480895 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef7800bcc0 con 0x7fef840fe0e0 2024-02-07T12:35:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.969+0000 7fef6bfff700 1 -- 172.21.15.47:0/2623480895 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef7801c630 con 0x7fef840fe0e0 2024-02-07T12:35:31.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.969+0000 7fef89c7c700 1 -- 172.21.15.47:0/2623480895 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8410f510 con 0x7fef840fe0e0 2024-02-07T12:35:31.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.971+0000 7fef89c7c700 1 -- 172.21.15.47:0/2623480895 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8404bed0 con 0x7fef840fe0e0 2024-02-07T12:35:31.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.971+0000 7fef6bfff700 1 -- 172.21.15.47:0/2623480895 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fef78013980 con 0x7fef840fe0e0 2024-02-07T12:35:31.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.972+0000 7fef6bfff700 1 --2- 172.21.15.47:0/2623480895 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fef6c06d7e0 0x7fef6c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:31.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.972+0000 7fef837fe700 1 --2- 172.21.15.47:0/2623480895 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fef6c06d7e0 0x7fef6c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:31.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.972+0000 7fef6bfff700 1 -- 172.21.15.47:0/2623480895 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fef7808e320 con 0x7fef840fe0e0 2024-02-07T12:35:31.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.972+0000 7fef837fe700 1 --2- 172.21.15.47:0/2623480895 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fef6c06d7e0 0x7fef6c06fc90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fef840fcc30 tx=0x7fef7400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:31.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:31.976+0000 7fef6bfff700 1 -- 172.21.15.47:0/2623480895 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fef7805b670 con 0x7fef840fe0e0 2024-02-07T12:35:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.228+0000 7fef89c7c700 1 -- 172.21.15.47:0/2623480895 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef8410f960 con 0x7fef6c06d7e0 2024-02-07T12:35:32.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.230+0000 7fef6bfff700 1 -- 172.21.15.47:0/2623480895 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7fef8410f960 con 0x7fef6c06d7e0 2024-02-07T12:35:32.233 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:35:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:35:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:35:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:35:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:35:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr", 2024-02-07T12:35:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "mds", 2024-02-07T12:35:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "osd", 2024-02-07T12:35:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-02-07T12:35:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "mon" 2024-02-07T12:35:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:35:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "16/21 daemons upgraded", 2024-02-07T12:35:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading prometheus daemons", 2024-02-07T12:35:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:35:32.234 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:35:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.233+0000 7fef89c7c700 1 -- 172.21.15.47:0/2623480895 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fef6c06d7e0 msgr2=0x7fef6c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.233+0000 7fef89c7c700 1 --2- 172.21.15.47:0/2623480895 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fef6c06d7e0 0x7fef6c06fc90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fef840fcc30 tx=0x7fef7400b040 comp rx=0 tx=0).stop 2024-02-07T12:35:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.233+0000 7fef89c7c700 1 -- 172.21.15.47:0/2623480895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef840fe0e0 msgr2=0x7fef8410deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.233+0000 7fef89c7c700 1 --2- 172.21.15.47:0/2623480895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef840fe0e0 0x7fef8410deb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fef780093b0 tx=0x7fef78009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.233+0000 7fef89c7c700 1 -- 172.21.15.47:0/2623480895 shutdown_connections 2024-02-07T12:35:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.234+0000 7fef89c7c700 1 --2- 172.21.15.47:0/2623480895 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fef6c06d7e0 0x7fef6c06fc90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.234+0000 7fef89c7c700 1 --2- 172.21.15.47:0/2623480895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef840fcef0 0x7fef8410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.234+0000 7fef89c7c700 1 --2- 172.21.15.47:0/2623480895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef840fe0e0 0x7fef8410deb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.234+0000 7fef89c7c700 1 -- 172.21.15.47:0/2623480895 >> 172.21.15.47:0/2623480895 conn(0x7fef840f8620 msgr2=0x7fef841013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.234+0000 7fef89c7c700 1 -- 172.21.15.47:0/2623480895 shutdown_connections 2024-02-07T12:35:32.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.234+0000 7fef89c7c700 1 -- 172.21.15.47:0/2623480895 wait complete. 2024-02-07T12:35:32.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.342+0000 7f2ec27e0700 1 -- 172.21.15.47:0/549817711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ebc0fbe50 msgr2=0x7f2ebc0fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:32.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.342+0000 7f2ec27e0700 1 --2- 172.21.15.47:0/549817711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ebc0fbe50 0x7f2ebc0fc260 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2eac004940 tx=0x7f2eac009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:32.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.342+0000 7f2ec27e0700 1 -- 172.21.15.47:0/549817711 shutdown_connections 2024-02-07T12:35:32.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.342+0000 7f2ec27e0700 1 --2- 172.21.15.47:0/549817711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ebc0fcfc0 0x7f2ebc0fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:32.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.342+0000 7f2ec27e0700 1 --2- 172.21.15.47:0/549817711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ebc0fbe50 0x7f2ebc0fc260 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:32.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.342+0000 7f2ec27e0700 1 -- 172.21.15.47:0/549817711 >> 172.21.15.47:0/549817711 conn(0x7f2ebc0f7510 msgr2=0x7f2ebc0f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:32.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.342+0000 7f2ec27e0700 1 -- 172.21.15.47:0/549817711 shutdown_connections 2024-02-07T12:35:32.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.342+0000 7f2ec27e0700 1 -- 172.21.15.47:0/549817711 wait complete. 2024-02-07T12:35:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.343+0000 7f2ec27e0700 1 Processor -- start 2024-02-07T12:35:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.343+0000 7f2ec27e0700 1 -- start start 2024-02-07T12:35:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.343+0000 7f2ec27e0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ebc0fbe50 0x7f2ebc0fff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.343+0000 7f2ec27e0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ebc0fcfc0 0x7f2ebc0fe390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.343+0000 7f2ec27e0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0fe990 con 0x7f2ebc0fcfc0 2024-02-07T12:35:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.343+0000 7f2ec27e0700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0feb00 con 0x7f2ebc0fbe50 2024-02-07T12:35:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.344+0000 7f2ebb7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ebc0fcfc0 0x7f2ebc0fe390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.344+0000 7f2ebb7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ebc0fcfc0 0x7f2ebc0fe390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35584/0 (socket says 172.21.15.47:35584) 2024-02-07T12:35:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.344+0000 7f2ebb7fe700 1 -- 172.21.15.47:0/1960835851 learned_addr learned my addr 172.21.15.47:0/1960835851 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:35:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.344+0000 7f2ebbfff700 1 --2- 172.21.15.47:0/1960835851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ebc0fbe50 0x7f2ebc0fff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.344+0000 7f2ebb7fe700 1 -- 172.21.15.47:0/1960835851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ebc0fbe50 msgr2=0x7f2ebc0fff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:32.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.344+0000 7f2ebb7fe700 1 --2- 172.21.15.47:0/1960835851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ebc0fbe50 0x7f2ebc0fff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:32.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.344+0000 7f2ebb7fe700 1 -- 172.21.15.47:0/1960835851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac005040 con 0x7f2ebc0fcfc0 2024-02-07T12:35:32.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.344+0000 7f2ebb7fe700 1 --2- 172.21.15.47:0/1960835851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ebc0fcfc0 0x7f2ebc0fe390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000c8c0 tx=0x7f2eb00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:32.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.344+0000 7f2eb8ff9700 1 -- 172.21.15.47:0/1960835851 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb000a980 con 0x7f2ebc0fcfc0 2024-02-07T12:35:32.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.344+0000 7f2ec27e0700 1 -- 172.21.15.47:0/1960835851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc0fede0 con 0x7f2ebc0fcfc0 2024-02-07T12:35:32.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.344+0000 7f2eb8ff9700 1 -- 172.21.15.47:0/1960835851 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2eb000ce60 con 0x7f2ebc0fcfc0 2024-02-07T12:35:32.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.344+0000 7f2eb8ff9700 1 -- 172.21.15.47:0/1960835851 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb00115e0 con 0x7f2ebc0fcfc0 2024-02-07T12:35:32.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.344+0000 7f2ec27e0700 1 -- 172.21.15.47:0/1960835851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc115980 con 0x7f2ebc0fcfc0 2024-02-07T12:35:32.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.345+0000 7f2ec27e0700 1 -- 172.21.15.47:0/1960835851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc04bed0 con 0x7f2ebc0fcfc0 2024-02-07T12:35:32.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.346+0000 7f2eb8ff9700 1 -- 172.21.15.47:0/1960835851 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f2eb0012400 con 0x7f2ebc0fcfc0 2024-02-07T12:35:32.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.346+0000 7f2eb8ff9700 1 --2- 172.21.15.47:0/1960835851 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2ea406d7f0 0x7f2ea406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:35:32.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.346+0000 7f2eb8ff9700 1 -- 172.21.15.47:0/1960835851 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2eb008d060 con 0x7f2ebc0fcfc0 2024-02-07T12:35:32.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.346+0000 7f2ebbfff700 1 --2- 172.21.15.47:0/1960835851 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2ea406d7f0 0x7f2ea406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:35:32.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.347+0000 7f2ebbfff700 1 --2- 172.21.15.47:0/1960835851 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2ea406d7f0 0x7f2ea406fca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00b020 tx=0x7f2eac009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:35:32.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.351+0000 7f2eb8ff9700 1 -- 172.21.15.47:0/1960835851 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2eb005a3b0 con 0x7f2ebc0fcfc0 2024-02-07T12:35:32.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:32 smithi047 ceph-mon[93224]: pgmap v251: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s 2024-02-07T12:35:32.615 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:32 smithi047 ceph-mon[93224]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:32.615 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:32 smithi047 ceph-mon[93224]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:32.615 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:32 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1128029331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:32.615 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:32 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1487441275' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:35:32.615 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:32 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:32.615 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:32 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:32.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.648+0000 7f2ec27e0700 1 -- 172.21.15.47:0/1960835851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2ebc115c30 con 0x7f2ebc0fcfc0 2024-02-07T12:35:32.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.648+0000 7f2eb8ff9700 1 -- 172.21.15.47:0/1960835851 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f2eb00126b0 con 0x7f2ebc0fcfc0 2024-02-07T12:35:32.651 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:35:32.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.652+0000 7f2ec27e0700 1 -- 172.21.15.47:0/1960835851 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2ea406d7f0 msgr2=0x7f2ea406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:32.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.652+0000 7f2ec27e0700 1 --2- 172.21.15.47:0/1960835851 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2ea406d7f0 0x7f2ea406fca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00b020 tx=0x7f2eac009e30 comp rx=0 tx=0).stop 2024-02-07T12:35:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.652+0000 7f2ec27e0700 1 -- 172.21.15.47:0/1960835851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ebc0fcfc0 msgr2=0x7f2ebc0fe390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:35:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.652+0000 7f2ec27e0700 1 --2- 172.21.15.47:0/1960835851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ebc0fcfc0 0x7f2ebc0fe390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000c8c0 tx=0x7f2eb00044c0 comp rx=0 tx=0).stop 2024-02-07T12:35:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.652+0000 7f2ec27e0700 1 -- 172.21.15.47:0/1960835851 shutdown_connections 2024-02-07T12:35:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.652+0000 7f2ec27e0700 1 --2- 172.21.15.47:0/1960835851 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2ea406d7f0 0x7f2ea406fca0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.652+0000 7f2ec27e0700 1 --2- 172.21.15.47:0/1960835851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ebc0fbe50 0x7f2ebc0fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.652+0000 7f2ec27e0700 1 --2- 172.21.15.47:0/1960835851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ebc0fcfc0 0x7f2ebc0fe390 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:35:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.652+0000 7f2ec27e0700 1 -- 172.21.15.47:0/1960835851 >> 172.21.15.47:0/1960835851 conn(0x7f2ebc0f7510 msgr2=0x7f2ebc065f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:35:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.652+0000 7f2ec27e0700 1 -- 172.21.15.47:0/1960835851 shutdown_connections 2024-02-07T12:35:32.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:35:32.652+0000 7f2ec27e0700 1 -- 172.21.15.47:0/1960835851 wait complete. 2024-02-07T12:35:32.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:32 smithi138 ceph-mon[82055]: pgmap v251: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s 2024-02-07T12:35:32.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:32 smithi138 ceph-mon[82055]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:32.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:32 smithi138 ceph-mon[82055]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:32.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:32 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1128029331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:32.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:32 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1487441275' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:35:32.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:32 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:32.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:32 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:33.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:33 smithi138 ceph-mon[82055]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:33.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:33 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1960835851' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:35:33.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:33.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:33 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:33.795 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:33 smithi047 ceph-mon[93224]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:35:33.795 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:33 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1960835851' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:35:33.795 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:33.795 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:33 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:34.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:34 smithi138 ceph-mon[82055]: pgmap v252: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:35:34.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:34 smithi047 ceph-mon[93224]: pgmap v252: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:35:36.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:36 smithi047 ceph-mon[93224]: pgmap v253: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-07T12:35:36.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:36 smithi138 ceph-mon[82055]: pgmap v253: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-07T12:35:38.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:35:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:35:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: pgmap v254: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-07T12:35:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:35:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:35:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:35:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.038 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:37 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:38.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:38.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: pgmap v254: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:38.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:37 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:39.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:39 smithi047 ceph-mon[93224]: Upgrade: Updating alertmanager.smithi047 2024-02-07T12:35:39.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:39 smithi047 ceph-mon[93224]: Deploying daemon alertmanager.smithi047 on smithi047 2024-02-07T12:35:39.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:39 smithi138 ceph-mon[82055]: Upgrade: Updating alertmanager.smithi047 2024-02-07T12:35:39.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:39 smithi138 ceph-mon[82055]: Deploying daemon alertmanager.smithi047 on smithi047 2024-02-07T12:35:40.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:40 smithi138 ceph-mon[82055]: pgmap v255: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:35:40.565 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:40 smithi047 ceph-mon[93224]: pgmap v255: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:35:42.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:42 smithi138 ceph-mon[82055]: pgmap v256: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:35:42.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:35:42.546 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:42 smithi047 ceph-mon[93224]: pgmap v256: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:35:42.546 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:35:44.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:44 smithi138 ceph-mon[82055]: pgmap v257: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:35:44.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:44 smithi047 ceph-mon[93224]: pgmap v257: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:35:45.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:45 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:45.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:45 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:45.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:45 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:35:45.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:45 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:45.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:45 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:45.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:45 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:35:46.749 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:46 smithi047 ceph-mon[93224]: pgmap v258: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:35:46.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:46 smithi138 ceph-mon[82055]: pgmap v258: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:35:48.505 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:48 smithi047 ceph-mon[93224]: pgmap v259: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:35:48.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:48 smithi138 ceph-mon[82055]: pgmap v259: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:35:50.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:49 smithi138 ceph-mon[82055]: pgmap v260: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:35:50.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:50.285 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:49 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:50.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:49 smithi047 ceph-mon[93224]: pgmap v260: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:35:50.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:50.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:49 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:51.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:51.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:51 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:51.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:51.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:51 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:52.293 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:52 smithi047 ceph-mon[93224]: pgmap v261: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:35:52.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:52 smithi138 ceph-mon[82055]: pgmap v261: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:35:55.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: pgmap v262: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:35:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:35:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:35:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-07T12:35:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:35:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:54 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: pgmap v262: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:35:55.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:55.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:55.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:35:55.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:35:55.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:35:55.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-07T12:35:55.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:35:55.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:54 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:35:55.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:55 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-07T12:35:56.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:55 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-07T12:35:56.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:56 smithi047 ceph-mon[93224]: pgmap v263: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:35:56.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:56 smithi047 ceph-mon[93224]: Upgrade: Updating grafana.smithi047 2024-02-07T12:35:56.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:56 smithi047 ceph-mon[93224]: Deploying daemon grafana.smithi047 on smithi047 2024-02-07T12:35:57.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:56 smithi138 ceph-mon[82055]: pgmap v263: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:35:57.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:56 smithi138 ceph-mon[82055]: Upgrade: Updating grafana.smithi047 2024-02-07T12:35:57.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:56 smithi138 ceph-mon[82055]: Deploying daemon grafana.smithi047 on smithi047 2024-02-07T12:35:58.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:35:58.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:35:58.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:35:58 smithi047 ceph-mon[93224]: pgmap v264: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:35:59.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:35:58 smithi138 ceph-mon[82055]: pgmap v264: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:36:00.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:00 smithi047 ceph-mon[93224]: pgmap v265: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:01.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:00 smithi138 ceph-mon[82055]: pgmap v265: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:01.884 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:01 smithi047 ceph-mon[93224]: pgmap v266: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:36:01.884 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:01 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:01.884 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:01 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:01.884 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:01 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:36:02.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:01 smithi138 ceph-mon[82055]: pgmap v266: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:36:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:01 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:01 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:02.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:01 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:36:02.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.761+0000 7f2b74677700 1 -- 172.21.15.47:0/3368036868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6c1000e0 msgr2=0x7f2b6c102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:02.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.761+0000 7f2b74677700 1 --2- 172.21.15.47:0/3368036868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6c1000e0 0x7f2b6c102520 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2b60004940 tx=0x7f2b60009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:02.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.762+0000 7f2b74677700 1 -- 172.21.15.47:0/3368036868 shutdown_connections 2024-02-07T12:36:02.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.762+0000 7f2b74677700 1 --2- 172.21.15.47:0/3368036868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6c1000e0 0x7f2b6c102520 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:02.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.762+0000 7f2b74677700 1 --2- 172.21.15.47:0/3368036868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b6c066c50 0x7f2b6c0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:02.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.762+0000 7f2b74677700 1 -- 172.21.15.47:0/3368036868 >> 172.21.15.47:0/3368036868 conn(0x7f2b6c0f7520 msgr2=0x7f2b6c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:02.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.762+0000 7f2b74677700 1 -- 172.21.15.47:0/3368036868 shutdown_connections 2024-02-07T12:36:02.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.762+0000 7f2b74677700 1 -- 172.21.15.47:0/3368036868 wait complete. 2024-02-07T12:36:02.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.762+0000 7f2b74677700 1 Processor -- start 2024-02-07T12:36:02.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.762+0000 7f2b74677700 1 -- start start 2024-02-07T12:36:02.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.762+0000 7f2b74677700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6c066c50 0x7f2b6c10fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:02.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.762+0000 7f2b74677700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b6c1000e0 0x7f2b6c1100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:02.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.762+0000 7f2b74677700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c110750 con 0x7f2b6c066c50 2024-02-07T12:36:02.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.762+0000 7f2b74677700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c110f90 con 0x7f2b6c1000e0 2024-02-07T12:36:02.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.762+0000 7f2b72413700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6c066c50 0x7f2b6c10fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:02.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.763+0000 7f2b72413700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6c066c50 0x7f2b6c10fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52884/0 (socket says 172.21.15.47:52884) 2024-02-07T12:36:02.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.763+0000 7f2b72413700 1 -- 172.21.15.47:0/545111624 learned_addr learned my addr 172.21.15.47:0/545111624 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:36:02.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.763+0000 7f2b71c12700 1 --2- 172.21.15.47:0/545111624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b6c1000e0 0x7f2b6c1100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:02.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.763+0000 7f2b72413700 1 -- 172.21.15.47:0/545111624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b6c1000e0 msgr2=0x7f2b6c1100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:02.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.763+0000 7f2b72413700 1 --2- 172.21.15.47:0/545111624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b6c1000e0 0x7f2b6c1100c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:02.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.763+0000 7f2b72413700 1 -- 172.21.15.47:0/545111624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b60005040 con 0x7f2b6c066c50 2024-02-07T12:36:02.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.763+0000 7f2b72413700 1 --2- 172.21.15.47:0/545111624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6c066c50 0x7f2b6c10fb80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00bbb0 tx=0x7f2b5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:02.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.763+0000 7f2b6affd700 1 -- 172.21.15.47:0/545111624 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b5c0092e0 con 0x7f2b6c066c50 2024-02-07T12:36:02.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.763+0000 7f2b74677700 1 -- 172.21.15.47:0/545111624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c111270 con 0x7f2b6c066c50 2024-02-07T12:36:02.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.763+0000 7f2b6affd700 1 -- 172.21.15.47:0/545111624 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b5c00cbd0 con 0x7f2b6c066c50 2024-02-07T12:36:02.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.763+0000 7f2b6affd700 1 -- 172.21.15.47:0/545111624 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b5c007400 con 0x7f2b6c066c50 2024-02-07T12:36:02.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.763+0000 7f2b74677700 1 -- 172.21.15.47:0/545111624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c1117b0 con 0x7f2b6c066c50 2024-02-07T12:36:02.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.764+0000 7f2b74677700 1 -- 172.21.15.47:0/545111624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c04bed0 con 0x7f2b6c066c50 2024-02-07T12:36:02.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.765+0000 7f2b6affd700 1 -- 172.21.15.47:0/545111624 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f2b5c012070 con 0x7f2b6c066c50 2024-02-07T12:36:02.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.765+0000 7f2b6affd700 1 --2- 172.21.15.47:0/545111624 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2b5406d7e0 0x7f2b5406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:02.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.765+0000 7f2b6affd700 1 -- 172.21.15.47:0/545111624 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2b5c08cc20 con 0x7f2b6c066c50 2024-02-07T12:36:02.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.765+0000 7f2b71c12700 1 --2- 172.21.15.47:0/545111624 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2b5406d7e0 0x7f2b5406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:02.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.766+0000 7f2b71c12700 1 --2- 172.21.15.47:0/545111624 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2b5406d7e0 0x7f2b5406fc90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000b3b0 tx=0x7f2b60009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:02.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:02.770+0000 7f2b6affd700 1 -- 172.21.15.47:0/545111624 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2b5c059ef0 con 0x7f2b6c066c50 2024-02-07T12:36:03.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.002+0000 7f2b74677700 1 -- 172.21.15.47:0/545111624 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b6c0fc000 con 0x7f2b5406d7e0 2024-02-07T12:36:03.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.003+0000 7f2b6affd700 1 -- 172.21.15.47:0/545111624 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f2b6c0fc000 con 0x7f2b5406d7e0 2024-02-07T12:36:03.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.006+0000 7f2b74677700 1 -- 172.21.15.47:0/545111624 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2b5406d7e0 msgr2=0x7f2b5406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:03.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.006+0000 7f2b74677700 1 --2- 172.21.15.47:0/545111624 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2b5406d7e0 0x7f2b5406fc90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000b3b0 tx=0x7f2b60009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:03.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.006+0000 7f2b74677700 1 -- 172.21.15.47:0/545111624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6c066c50 msgr2=0x7f2b6c10fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:03.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.006+0000 7f2b74677700 1 --2- 172.21.15.47:0/545111624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6c066c50 0x7f2b6c10fb80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00bbb0 tx=0x7f2b5c009840 comp rx=0 tx=0).stop 2024-02-07T12:36:03.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.006+0000 7f2b74677700 1 -- 172.21.15.47:0/545111624 shutdown_connections 2024-02-07T12:36:03.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.006+0000 7f2b74677700 1 --2- 172.21.15.47:0/545111624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6c066c50 0x7f2b6c10fb80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.006+0000 7f2b74677700 1 --2- 172.21.15.47:0/545111624 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2b5406d7e0 0x7f2b5406fc90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.006+0000 7f2b74677700 1 --2- 172.21.15.47:0/545111624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b6c1000e0 0x7f2b6c1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.006+0000 7f2b74677700 1 -- 172.21.15.47:0/545111624 >> 172.21.15.47:0/545111624 conn(0x7f2b6c0f7520 msgr2=0x7f2b6c0fb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:03.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.006+0000 7f2b74677700 1 -- 172.21.15.47:0/545111624 shutdown_connections 2024-02-07T12:36:03.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.006+0000 7f2b74677700 1 -- 172.21.15.47:0/545111624 wait complete. 2024-02-07T12:36:03.018 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:36:03.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.109+0000 7f6717732700 1 -- 172.21.15.47:0/1318362533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67100fe0e0 msgr2=0x7f67100fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:03.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.109+0000 7f6717732700 1 --2- 172.21.15.47:0/1318362533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67100fe0e0 0x7f67100fe550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6700004940 tx=0x7f6700009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:03.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.109+0000 7f6717732700 1 -- 172.21.15.47:0/1318362533 shutdown_connections 2024-02-07T12:36:03.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.109+0000 7f6717732700 1 --2- 172.21.15.47:0/1318362533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67100fe0e0 0x7f67100fe550 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.109+0000 7f6717732700 1 --2- 172.21.15.47:0/1318362533 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67100fcef0 0x7f67100fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.109+0000 7f6717732700 1 -- 172.21.15.47:0/1318362533 >> 172.21.15.47:0/1318362533 conn(0x7f67100f8620 msgr2=0x7f67100faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.109+0000 7f6717732700 1 -- 172.21.15.47:0/1318362533 shutdown_connections 2024-02-07T12:36:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.109+0000 7f6717732700 1 -- 172.21.15.47:0/1318362533 wait complete. 2024-02-07T12:36:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.110+0000 7f6717732700 1 Processor -- start 2024-02-07T12:36:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.110+0000 7f6717732700 1 -- start start 2024-02-07T12:36:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.110+0000 7f6717732700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67100fcef0 0x7f671010d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.110+0000 7f6717732700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67100fe0e0 0x7f671010deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.110+0000 7f6717732700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671010e540 con 0x7f67100fe0e0 2024-02-07T12:36:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.110+0000 7f6717732700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671010ed80 con 0x7f67100fcef0 2024-02-07T12:36:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.110+0000 7f6714ccd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67100fe0e0 0x7f671010deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.110+0000 7f6714ccd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67100fe0e0 0x7f671010deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52888/0 (socket says 172.21.15.47:52888) 2024-02-07T12:36:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.110+0000 7f6714ccd700 1 -- 172.21.15.47:0/4163649996 learned_addr learned my addr 172.21.15.47:0/4163649996 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:36:03.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.110+0000 7f67154ce700 1 --2- 172.21.15.47:0/4163649996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67100fcef0 0x7f671010d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:03.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.111+0000 7f6714ccd700 1 -- 172.21.15.47:0/4163649996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67100fcef0 msgr2=0x7f671010d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:03.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.111+0000 7f6714ccd700 1 --2- 172.21.15.47:0/4163649996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67100fcef0 0x7f671010d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.111+0000 7f6714ccd700 1 -- 172.21.15.47:0/4163649996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6700005040 con 0x7f67100fe0e0 2024-02-07T12:36:03.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.111+0000 7f67154ce700 1 --2- 172.21.15.47:0/4163649996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67100fcef0 0x7f671010d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:36:03.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.111+0000 7f6714ccd700 1 --2- 172.21.15.47:0/4163649996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67100fe0e0 0x7f671010deb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6700009fd0 tx=0x7f6700009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:03.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.111+0000 7f6705ffb700 1 -- 172.21.15.47:0/4163649996 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f670000e040 con 0x7f67100fe0e0 2024-02-07T12:36:03.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.111+0000 7f6705ffb700 1 -- 172.21.15.47:0/4163649996 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f670000bcc0 con 0x7f67100fe0e0 2024-02-07T12:36:03.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.111+0000 7f6705ffb700 1 -- 172.21.15.47:0/4163649996 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f670001c630 con 0x7f67100fe0e0 2024-02-07T12:36:03.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.111+0000 7f6717732700 1 -- 172.21.15.47:0/4163649996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671010f000 con 0x7f67100fe0e0 2024-02-07T12:36:03.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.111+0000 7f6717732700 1 -- 172.21.15.47:0/4163649996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671010f540 con 0x7f67100fe0e0 2024-02-07T12:36:03.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.112+0000 7f6717732700 1 -- 172.21.15.47:0/4163649996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671004bed0 con 0x7f67100fe0e0 2024-02-07T12:36:03.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.113+0000 7f6705ffb700 1 -- 172.21.15.47:0/4163649996 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6700013980 con 0x7f67100fe0e0 2024-02-07T12:36:03.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.113+0000 7f6705ffb700 1 --2- 172.21.15.47:0/4163649996 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f66fc06d7f0 0x7f66fc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:03.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.113+0000 7f6705ffb700 1 -- 172.21.15.47:0/4163649996 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f670008e430 con 0x7f67100fe0e0 2024-02-07T12:36:03.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.113+0000 7f67154ce700 1 --2- 172.21.15.47:0/4163649996 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f66fc06d7f0 0x7f66fc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:03.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.113+0000 7f67154ce700 1 --2- 172.21.15.47:0/4163649996 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f66fc06d7f0 0x7f66fc06fca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f670c006fd0 tx=0x7f670c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:03.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.118+0000 7f6705ffb700 1 -- 172.21.15.47:0/4163649996 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f670005b780 con 0x7f67100fe0e0 2024-02-07T12:36:03.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.342+0000 7f6717732700 1 -- 172.21.15.47:0/4163649996 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f671010fa70 con 0x7f66fc06d7f0 2024-02-07T12:36:03.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.343+0000 7f6705ffb700 1 -- 172.21.15.47:0/4163649996 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f671010fa70 con 0x7f66fc06d7f0 2024-02-07T12:36:03.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.345+0000 7f6717732700 1 -- 172.21.15.47:0/4163649996 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f66fc06d7f0 msgr2=0x7f66fc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:03.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.345+0000 7f6717732700 1 --2- 172.21.15.47:0/4163649996 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f66fc06d7f0 0x7f66fc06fca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f670c006fd0 tx=0x7f670c008040 comp rx=0 tx=0).stop 2024-02-07T12:36:03.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.345+0000 7f6717732700 1 -- 172.21.15.47:0/4163649996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67100fe0e0 msgr2=0x7f671010deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:03.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.345+0000 7f6717732700 1 --2- 172.21.15.47:0/4163649996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67100fe0e0 0x7f671010deb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6700009fd0 tx=0x7f6700009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:03.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.345+0000 7f6717732700 1 -- 172.21.15.47:0/4163649996 shutdown_connections 2024-02-07T12:36:03.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.345+0000 7f6717732700 1 --2- 172.21.15.47:0/4163649996 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f66fc06d7f0 0x7f66fc06fca0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.345+0000 7f6717732700 1 --2- 172.21.15.47:0/4163649996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67100fcef0 0x7f671010d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.345+0000 7f6717732700 1 --2- 172.21.15.47:0/4163649996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67100fe0e0 0x7f671010deb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.345+0000 7f6717732700 1 -- 172.21.15.47:0/4163649996 >> 172.21.15.47:0/4163649996 conn(0x7f67100f8620 msgr2=0x7f67101013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:03.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.345+0000 7f6717732700 1 -- 172.21.15.47:0/4163649996 shutdown_connections 2024-02-07T12:36:03.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.345+0000 7f6717732700 1 -- 172.21.15.47:0/4163649996 wait complete. 2024-02-07T12:36:03.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.448+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3431356479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf580fe0e0 msgr2=0x7fcf580fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:03.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.448+0000 7fcf5ff5a700 1 --2- 172.21.15.47:0/3431356479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf580fe0e0 0x7fcf580fe550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcf48004940 tx=0x7fcf48009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:03.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.448+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3431356479 shutdown_connections 2024-02-07T12:36:03.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.448+0000 7fcf5ff5a700 1 --2- 172.21.15.47:0/3431356479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf580fe0e0 0x7fcf580fe550 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.448+0000 7fcf5ff5a700 1 --2- 172.21.15.47:0/3431356479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf580fcef0 0x7fcf580fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.448+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3431356479 >> 172.21.15.47:0/3431356479 conn(0x7fcf580f8620 msgr2=0x7fcf580faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:03.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.448+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3431356479 shutdown_connections 2024-02-07T12:36:03.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.448+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3431356479 wait complete. 2024-02-07T12:36:03.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5ff5a700 1 Processor -- start 2024-02-07T12:36:03.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5ff5a700 1 -- start start 2024-02-07T12:36:03.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5ff5a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf580fcef0 0x7fcf58071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:03.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5ff5a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf580fe0e0 0x7fcf580702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5ff5a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580708e0 con 0x7fcf580fcef0 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5ff5a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf58070a50 con 0x7fcf580fe0e0 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5dcf6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf580fcef0 0x7fcf58071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5dcf6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf580fcef0 0x7fcf58071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52904/0 (socket says 172.21.15.47:52904) 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5dcf6700 1 -- 172.21.15.47:0/3846410822 learned_addr learned my addr 172.21.15.47:0/3846410822 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5dcf6700 1 -- 172.21.15.47:0/3846410822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf580fe0e0 msgr2=0x7fcf580702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5d4f5700 1 --2- 172.21.15.47:0/3846410822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf580fe0e0 0x7fcf580702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5dcf6700 1 --2- 172.21.15.47:0/3846410822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf580fe0e0 0x7fcf580702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5dcf6700 1 -- 172.21.15.47:0/3846410822 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf48005040 con 0x7fcf580fcef0 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.449+0000 7fcf5d4f5700 1 --2- 172.21.15.47:0/3846410822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf580fe0e0 0x7fcf580702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.450+0000 7fcf5dcf6700 1 --2- 172.21.15.47:0/3846410822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf580fcef0 0x7fcf58071e60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcf54002a80 tx=0x7fcf54004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.450+0000 7fcf4e7fc700 1 -- 172.21.15.47:0/3846410822 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf54007cc0 con 0x7fcf580fcef0 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.450+0000 7fcf4e7fc700 1 -- 172.21.15.47:0/3846410822 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf5400f040 con 0x7fcf580fcef0 2024-02-07T12:36:03.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.450+0000 7fcf4e7fc700 1 -- 172.21.15.47:0/3846410822 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf5400dad0 con 0x7fcf580fcef0 2024-02-07T12:36:03.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.450+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3846410822 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf58070d30 con 0x7fcf580fcef0 2024-02-07T12:36:03.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.450+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3846410822 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf58115990 con 0x7fcf580fcef0 2024-02-07T12:36:03.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.451+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3846410822 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5804bed0 con 0x7fcf580fcef0 2024-02-07T12:36:03.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.451+0000 7fcf4e7fc700 1 -- 172.21.15.47:0/3846410822 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fcf5400dc30 con 0x7fcf580fcef0 2024-02-07T12:36:03.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.452+0000 7fcf4e7fc700 1 --2- 172.21.15.47:0/3846410822 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fcf4406d7f0 0x7fcf4406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:03.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.452+0000 7fcf4e7fc700 1 -- 172.21.15.47:0/3846410822 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fcf5408ccc0 con 0x7fcf580fcef0 2024-02-07T12:36:03.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.452+0000 7fcf5d4f5700 1 --2- 172.21.15.47:0/3846410822 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fcf4406d7f0 0x7fcf4406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:03.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.452+0000 7fcf5d4f5700 1 --2- 172.21.15.47:0/3846410822 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fcf4406d7f0 0x7fcf4406fca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800b7a0 tx=0x7fcf48009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:03.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.456+0000 7fcf4e7fc700 1 -- 172.21.15.47:0/3846410822 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcf54092020 con 0x7fcf580fcef0 2024-02-07T12:36:03.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.671+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3846410822 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf58102ac0 con 0x7fcf4406d7f0 2024-02-07T12:36:03.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.682+0000 7fcf4e7fc700 1 -- 172.21.15.47:0/3846410822 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fcf58102ac0 con 0x7fcf4406d7f0 2024-02-07T12:36:03.684 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (19s) 14s ago 18m 15.2M - 0.25.0 c8568f914cd2 df2841092eff 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (6m) 14s ago 18m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (6m) 51s ago 17m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 starting - - - - 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (109s) 14s ago 13m 16.0M - 19.0.0-1252-g44458cce 79957b372307 fbda6b9f9953 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (2m) 14s ago 13m 67.3M - 19.0.0-1252-g44458cce 79957b372307 055df3be8762 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (75s) 51s ago 12m 14.0M - 19.0.0-1252-g44458cce 79957b372307 742dc60bfa13 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (91s) 51s ago 13m 67.1M - 19.0.0-1252-g44458cce 79957b372307 502afeac2e7d 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (8m) 14s ago 19m 512M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (7m) 51s ago 17m 453M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (7m) 14s ago 19m 58.6M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (7m) 51s ago 17m 43.4M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (61s) 14s ago 18m 7587k - 1.5.0 0da6a335fe13 199e0ea3a587 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (53s) 51s ago 17m 3623k - 1.5.0 0da6a335fe13 f9f13e3bf225 2024-02-07T12:36:03.685 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (6m) 14s ago 16m 102M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:36:03.686 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (5m) 14s ago 16m 113M 1559M 19.0.0-1252-g44458cce 79957b372307 0f2b0eea74d7 2024-02-07T12:36:03.686 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (5m) 14s ago 15m 91.2M 1559M 19.0.0-1252-g44458cce 79957b372307 0b8c78346346 2024-02-07T12:36:03.686 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (4m) 51s ago 15m 129M 2581M 19.0.0-1252-g44458cce 79957b372307 dea45db021db 2024-02-07T12:36:03.686 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (3m) 51s ago 15m 100M 2581M 19.0.0-1252-g44458cce 79957b372307 3161c1dfe6f5 2024-02-07T12:36:03.686 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (3m) 51s ago 14m 93.9M 2581M 19.0.0-1252-g44458cce 79957b372307 c9504c7cfe7c 2024-02-07T12:36:03.686 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (36s) 14s ago 18m 46.2M - 2.43.0 a07b618ecd1d be4740743bdd 2024-02-07T12:36:03.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.684+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3846410822 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fcf4406d7f0 msgr2=0x7fcf4406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:03.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.684+0000 7fcf5ff5a700 1 --2- 172.21.15.47:0/3846410822 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fcf4406d7f0 0x7fcf4406fca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800b7a0 tx=0x7fcf48009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:03.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.684+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3846410822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf580fcef0 msgr2=0x7fcf58071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:03.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.684+0000 7fcf5ff5a700 1 --2- 172.21.15.47:0/3846410822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf580fcef0 0x7fcf58071e60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcf54002a80 tx=0x7fcf54004600 comp rx=0 tx=0).stop 2024-02-07T12:36:03.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.685+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3846410822 shutdown_connections 2024-02-07T12:36:03.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.685+0000 7fcf5ff5a700 1 --2- 172.21.15.47:0/3846410822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf580fcef0 0x7fcf58071e60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.685+0000 7fcf5ff5a700 1 --2- 172.21.15.47:0/3846410822 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fcf4406d7f0 0x7fcf4406fca0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.685+0000 7fcf5ff5a700 1 --2- 172.21.15.47:0/3846410822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf580fe0e0 0x7fcf580702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.685+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3846410822 >> 172.21.15.47:0/3846410822 conn(0x7fcf580f8620 msgr2=0x7fcf581013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:03.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.685+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3846410822 shutdown_connections 2024-02-07T12:36:03.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.685+0000 7fcf5ff5a700 1 -- 172.21.15.47:0/3846410822 wait complete. 2024-02-07T12:36:03.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.791+0000 7f2e1d29d700 1 -- 172.21.15.47:0/3169049418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e181000c0 msgr2=0x7f2e18102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:03.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.791+0000 7f2e1d29d700 1 --2- 172.21.15.47:0/3169049418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e181000c0 0x7f2e18102520 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c004940 tx=0x7f2e0c009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:03.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.791+0000 7f2e1d29d700 1 -- 172.21.15.47:0/3169049418 shutdown_connections 2024-02-07T12:36:03.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.791+0000 7f2e1d29d700 1 --2- 172.21.15.47:0/3169049418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e181000c0 0x7f2e18102520 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.791+0000 7f2e1d29d700 1 --2- 172.21.15.47:0/3169049418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e18066c70 0x7f2e180ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.791+0000 7f2e1d29d700 1 -- 172.21.15.47:0/3169049418 >> 172.21.15.47:0/3169049418 conn(0x7f2e180f7520 msgr2=0x7f2e180f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:03.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.791+0000 7f2e1d29d700 1 -- 172.21.15.47:0/3169049418 shutdown_connections 2024-02-07T12:36:03.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.791+0000 7f2e1d29d700 1 -- 172.21.15.47:0/3169049418 wait complete. 2024-02-07T12:36:03.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e1d29d700 1 Processor -- start 2024-02-07T12:36:03.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e1d29d700 1 -- start start 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e1d29d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e18066c70 0x7f2e1810d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e1d29d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e181000c0 0x7f2e1810de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e1d29d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1810e410 con 0x7f2e181000c0 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e1d29d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1810ecb0 con 0x7f2e18066c70 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e167fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e181000c0 0x7f2e1810de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e167fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e181000c0 0x7f2e1810de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52930/0 (socket says 172.21.15.47:52930) 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e167fc700 1 -- 172.21.15.47:0/441936460 learned_addr learned my addr 172.21.15.47:0/441936460 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e16ffd700 1 --2- 172.21.15.47:0/441936460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e18066c70 0x7f2e1810d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e167fc700 1 -- 172.21.15.47:0/441936460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e18066c70 msgr2=0x7f2e1810d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e167fc700 1 --2- 172.21.15.47:0/441936460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e18066c70 0x7f2e1810d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e167fc700 1 -- 172.21.15.47:0/441936460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c005040 con 0x7f2e181000c0 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.792+0000 7f2e16ffd700 1 --2- 172.21.15.47:0/441936460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e18066c70 0x7f2e1810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.793+0000 7f2e167fc700 1 --2- 172.21.15.47:0/441936460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e181000c0 0x7f2e1810de10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009040 tx=0x7f2e0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:03.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.793+0000 7f2dff7fe700 1 -- 172.21.15.47:0/441936460 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e0c021070 con 0x7f2e181000c0 2024-02-07T12:36:03.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.793+0000 7f2dff7fe700 1 -- 172.21.15.47:0/441936460 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e0c01c400 con 0x7f2e181000c0 2024-02-07T12:36:03.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.793+0000 7f2e1d29d700 1 -- 172.21.15.47:0/441936460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1810ef30 con 0x7f2e181000c0 2024-02-07T12:36:03.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.793+0000 7f2dff7fe700 1 -- 172.21.15.47:0/441936460 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e0c00e070 con 0x7f2e181000c0 2024-02-07T12:36:03.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.793+0000 7f2e1d29d700 1 -- 172.21.15.47:0/441936460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1810f410 con 0x7f2e181000c0 2024-02-07T12:36:03.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.794+0000 7f2e1d29d700 1 -- 172.21.15.47:0/441936460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1804bed0 con 0x7f2e181000c0 2024-02-07T12:36:03.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.794+0000 7f2dff7fe700 1 -- 172.21.15.47:0/441936460 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f2e0c01c9e0 con 0x7f2e181000c0 2024-02-07T12:36:03.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.795+0000 7f2dff7fe700 1 --2- 172.21.15.47:0/441936460 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2e0006d7f0 0x7f2e0006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:03.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.795+0000 7f2dff7fe700 1 -- 172.21.15.47:0/441936460 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2e0c08e1b0 con 0x7f2e181000c0 2024-02-07T12:36:03.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.795+0000 7f2e16ffd700 1 --2- 172.21.15.47:0/441936460 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2e0006d7f0 0x7f2e0006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:03.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.795+0000 7f2e16ffd700 1 --2- 172.21.15.47:0/441936460 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2e0006d7f0 0x7f2e0006fca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e08004600 tx=0x7f2e0800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:03.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:03.799+0000 7f2dff7fe700 1 -- 172.21.15.47:0/441936460 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2e0c05b500 con 0x7f2e181000c0 2024-02-07T12:36:04.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.099+0000 7f2e1d29d700 1 -- 172.21.15.47:0/441936460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2e1810f870 con 0x7f2e181000c0 2024-02-07T12:36:04.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.100+0000 7f2dff7fe700 1 -- 172.21.15.47:0/441936460 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f2e0c004490 con 0x7f2e181000c0 2024-02-07T12:36:04.102 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:36:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:36:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 6 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 4 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 14 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:36:04.103 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:36:04.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.103+0000 7f2e1d29d700 1 -- 172.21.15.47:0/441936460 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2e0006d7f0 msgr2=0x7f2e0006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:04.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.103+0000 7f2e1d29d700 1 --2- 172.21.15.47:0/441936460 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2e0006d7f0 0x7f2e0006fca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e08004600 tx=0x7f2e0800b040 comp rx=0 tx=0).stop 2024-02-07T12:36:04.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.103+0000 7f2e1d29d700 1 -- 172.21.15.47:0/441936460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e181000c0 msgr2=0x7f2e1810de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:04.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.103+0000 7f2e1d29d700 1 --2- 172.21.15.47:0/441936460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e181000c0 0x7f2e1810de10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009040 tx=0x7f2e0c009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:04.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.103+0000 7f2e1d29d700 1 -- 172.21.15.47:0/441936460 shutdown_connections 2024-02-07T12:36:04.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.103+0000 7f2e1d29d700 1 --2- 172.21.15.47:0/441936460 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f2e0006d7f0 0x7f2e0006fca0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.103+0000 7f2e1d29d700 1 --2- 172.21.15.47:0/441936460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e18066c70 0x7f2e1810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.103+0000 7f2e1d29d700 1 --2- 172.21.15.47:0/441936460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e181000c0 0x7f2e1810de10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.103+0000 7f2e1d29d700 1 -- 172.21.15.47:0/441936460 >> 172.21.15.47:0/441936460 conn(0x7f2e180f7520 msgr2=0x7f2e180f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:04.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.103+0000 7f2e1d29d700 1 -- 172.21.15.47:0/441936460 shutdown_connections 2024-02-07T12:36:04.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.103+0000 7f2e1d29d700 1 -- 172.21.15.47:0/441936460 wait complete. 2024-02-07T12:36:04.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.208+0000 7f9191359700 1 -- 172.21.15.47:0/3283553835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f918c0fe2b0 msgr2=0x7f918c0fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:04.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.208+0000 7f9191359700 1 --2- 172.21.15.47:0/3283553835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f918c0fe2b0 0x7f918c0fe700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9174004940 tx=0x7f9174009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:04.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.208+0000 7f9191359700 1 -- 172.21.15.47:0/3283553835 shutdown_connections 2024-02-07T12:36:04.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.208+0000 7f9191359700 1 --2- 172.21.15.47:0/3283553835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f918c0fe2b0 0x7f918c0fe700 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.208+0000 7f9191359700 1 --2- 172.21.15.47:0/3283553835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f918c0fb220 0x7f918c0fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.208+0000 7f9191359700 1 -- 172.21.15.47:0/3283553835 >> 172.21.15.47:0/3283553835 conn(0x7f918c0f6ca0 msgr2=0x7f918c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:04.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.208+0000 7f9191359700 1 -- 172.21.15.47:0/3283553835 shutdown_connections 2024-02-07T12:36:04.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.208+0000 7f9191359700 1 -- 172.21.15.47:0/3283553835 wait complete. 2024-02-07T12:36:04.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.209+0000 7f9191359700 1 Processor -- start 2024-02-07T12:36:04.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.209+0000 7f9191359700 1 -- start start 2024-02-07T12:36:04.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.209+0000 7f9191359700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f918c0fb220 0x7f918c10da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:04.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.209+0000 7f9191359700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f918c0fe2b0 0x7f918c10df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:04.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.209+0000 7f9191359700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918c10e560 con 0x7f918c0fb220 2024-02-07T12:36:04.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.209+0000 7f9191359700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918c10ee00 con 0x7f918c0fe2b0 2024-02-07T12:36:04.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.209+0000 7f918affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f918c0fb220 0x7f918c10da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:04.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.209+0000 7f918affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f918c0fb220 0x7f918c10da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52956/0 (socket says 172.21.15.47:52956) 2024-02-07T12:36:04.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.209+0000 7f918affd700 1 -- 172.21.15.47:0/2471055138 learned_addr learned my addr 172.21.15.47:0/2471055138 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:36:04.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.210+0000 7f918a7fc700 1 --2- 172.21.15.47:0/2471055138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f918c0fe2b0 0x7f918c10df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:04.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.210+0000 7f918affd700 1 -- 172.21.15.47:0/2471055138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f918c0fe2b0 msgr2=0x7f918c10df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:04.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.210+0000 7f918affd700 1 --2- 172.21.15.47:0/2471055138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f918c0fe2b0 0x7f918c10df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.210+0000 7f918affd700 1 -- 172.21.15.47:0/2471055138 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9174005040 con 0x7f918c0fb220 2024-02-07T12:36:04.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.210+0000 7f918affd700 1 --2- 172.21.15.47:0/2471055138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f918c0fb220 0x7f918c10da20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f917c00cb10 tx=0x7f917c00ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:04.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.210+0000 7f91837fe700 1 -- 172.21.15.47:0/2471055138 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f917c00a980 con 0x7f918c0fb220 2024-02-07T12:36:04.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.210+0000 7f9191359700 1 -- 172.21.15.47:0/2471055138 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918c10f0e0 con 0x7f918c0fb220 2024-02-07T12:36:04.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.210+0000 7f91837fe700 1 -- 172.21.15.47:0/2471055138 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f917c012420 con 0x7f918c0fb220 2024-02-07T12:36:04.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.210+0000 7f91837fe700 1 -- 172.21.15.47:0/2471055138 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f917c0115c0 con 0x7f918c0fb220 2024-02-07T12:36:04.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.210+0000 7f9191359700 1 -- 172.21.15.47:0/2471055138 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918c10f620 con 0x7f918c0fb220 2024-02-07T12:36:04.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.211+0000 7f9191359700 1 -- 172.21.15.47:0/2471055138 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f918c04bed0 con 0x7f918c0fb220 2024-02-07T12:36:04.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.212+0000 7f91837fe700 1 -- 172.21.15.47:0/2471055138 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f917c003020 con 0x7f918c0fb220 2024-02-07T12:36:04.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.212+0000 7f91837fe700 1 --2- 172.21.15.47:0/2471055138 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f917806d7e0 0x7f917806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:04.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.213+0000 7f91837fe700 1 -- 172.21.15.47:0/2471055138 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f917c08d2d0 con 0x7f918c0fb220 2024-02-07T12:36:04.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.213+0000 7f918a7fc700 1 --2- 172.21.15.47:0/2471055138 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f917806d7e0 0x7f917806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:04.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.213+0000 7f918a7fc700 1 --2- 172.21.15.47:0/2471055138 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f917806d7e0 0x7f917806fc90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9174004f90 tx=0x7f9174009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:04.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.217+0000 7f91837fe700 1 -- 172.21.15.47:0/2471055138 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f917c05a5a0 con 0x7f918c0fb220 2024-02-07T12:36:04.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.471+0000 7f9191359700 1 -- 172.21.15.47:0/2471055138 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f918c10fc60 con 0x7f918c0fb220 2024-02-07T12:36:04.473 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:04 smithi047 ceph-mon[93224]: pgmap v267: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:36:04.473 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:04 smithi047 ceph-mon[93224]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:04.473 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:04 smithi047 ceph-mon[93224]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:04.474 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:04 smithi047 ceph-mon[93224]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:04.474 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:04 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/441936460' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:04.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.471+0000 7f91837fe700 1 -- 172.21.15.47:0/2471055138 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 48 v48) v1 ==== 76+0+1895 (secure 0 0 0) 0x7f917c012590 con 0x7f918c0fb220 2024-02-07T12:36:04.474 INFO:teuthology.orchestra.run.smithi047.stdout:e48 2024-02-07T12:36:04.474 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:36:04.474 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:36:04.474 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:36:04.474 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:36:04.474 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 48 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:34:57.641208+0000 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:36:04.475 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 84 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=34428,1=34460} 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:36:04.476 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:34428} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:36:04.477 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{0:44365} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6825/3547121337,v1:172.21.15.138:6826/3547121337] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:36:04.477 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:34460} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.47:6828/3723006072,v1:172.21.15.47:6829/3723006072] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:36:04.477 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{1:44369} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2689114398,v1:172.21.15.138:6827/2689114398] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:36:04.477 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:36:04.477 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:36:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.474+0000 7f9191359700 1 -- 172.21.15.47:0/2471055138 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f917806d7e0 msgr2=0x7f917806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.474+0000 7f9191359700 1 --2- 172.21.15.47:0/2471055138 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f917806d7e0 0x7f917806fc90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9174004f90 tx=0x7f9174009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.474+0000 7f9191359700 1 -- 172.21.15.47:0/2471055138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f918c0fb220 msgr2=0x7f918c10da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.474+0000 7f9191359700 1 --2- 172.21.15.47:0/2471055138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f918c0fb220 0x7f918c10da20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f917c00cb10 tx=0x7f917c00ce20 comp rx=0 tx=0).stop 2024-02-07T12:36:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.474+0000 7f9191359700 1 -- 172.21.15.47:0/2471055138 shutdown_connections 2024-02-07T12:36:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.474+0000 7f9191359700 1 --2- 172.21.15.47:0/2471055138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f918c0fb220 0x7f918c10da20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.474+0000 7f9191359700 1 --2- 172.21.15.47:0/2471055138 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f917806d7e0 0x7f917806fc90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.474+0000 7f9191359700 1 --2- 172.21.15.47:0/2471055138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f918c0fe2b0 0x7f918c10df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.474+0000 7f9191359700 1 -- 172.21.15.47:0/2471055138 >> 172.21.15.47:0/2471055138 conn(0x7f918c0f6ca0 msgr2=0x7f918c1014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.474+0000 7f9191359700 1 -- 172.21.15.47:0/2471055138 shutdown_connections 2024-02-07T12:36:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.474+0000 7f9191359700 1 -- 172.21.15.47:0/2471055138 wait complete. 2024-02-07T12:36:04.478 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 48 2024-02-07T12:36:04.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:04 smithi138 ceph-mon[82055]: pgmap v267: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:36:04.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:04 smithi138 ceph-mon[82055]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:04.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:04 smithi138 ceph-mon[82055]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:04.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:04 smithi138 ceph-mon[82055]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:04.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:04 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/441936460' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:04.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.582+0000 7ff482668700 1 -- 172.21.15.47:0/1882331935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff47c1003a0 msgr2=0x7ff47c102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:04.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.582+0000 7ff482668700 1 --2- 172.21.15.47:0/1882331935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff47c1003a0 0x7ff47c102780 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff470004940 tx=0x7ff470009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:04.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.582+0000 7ff482668700 1 -- 172.21.15.47:0/1882331935 shutdown_connections 2024-02-07T12:36:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.582+0000 7ff482668700 1 --2- 172.21.15.47:0/1882331935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff47c1003a0 0x7ff47c102780 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.582+0000 7ff482668700 1 --2- 172.21.15.47:0/1882331935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff47c0fda80 0x7ff47c0ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.582+0000 7ff482668700 1 -- 172.21.15.47:0/1882331935 >> 172.21.15.47:0/1882331935 conn(0x7ff47c0f7520 msgr2=0x7ff47c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.582+0000 7ff482668700 1 -- 172.21.15.47:0/1882331935 shutdown_connections 2024-02-07T12:36:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.582+0000 7ff482668700 1 -- 172.21.15.47:0/1882331935 wait complete. 2024-02-07T12:36:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.582+0000 7ff482668700 1 Processor -- start 2024-02-07T12:36:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.583+0000 7ff482668700 1 -- start start 2024-02-07T12:36:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.583+0000 7ff482668700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff47c0fda80 0x7ff47c10d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.583+0000 7ff482668700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff47c1003a0 0x7ff47c10de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.583+0000 7ff482668700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c10e410 con 0x7ff47c1003a0 2024-02-07T12:36:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.583+0000 7ff482668700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c10ecb0 con 0x7ff47c0fda80 2024-02-07T12:36:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.583+0000 7ff47b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff47c1003a0 0x7ff47c10de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:04.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.583+0000 7ff47b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff47c1003a0 0x7ff47c10de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52974/0 (socket says 172.21.15.47:52974) 2024-02-07T12:36:04.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.583+0000 7ff47b7fe700 1 -- 172.21.15.47:0/4202323515 learned_addr learned my addr 172.21.15.47:0/4202323515 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:36:04.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.583+0000 7ff47bfff700 1 --2- 172.21.15.47:0/4202323515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff47c0fda80 0x7ff47c10d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:04.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.583+0000 7ff47b7fe700 1 -- 172.21.15.47:0/4202323515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff47c0fda80 msgr2=0x7ff47c10d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:04.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.583+0000 7ff47b7fe700 1 --2- 172.21.15.47:0/4202323515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff47c0fda80 0x7ff47c10d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.583+0000 7ff47b7fe700 1 -- 172.21.15.47:0/4202323515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff470005040 con 0x7ff47c1003a0 2024-02-07T12:36:04.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.583+0000 7ff47b7fe700 1 --2- 172.21.15.47:0/4202323515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff47c1003a0 0x7ff47c10de10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff470000c00 tx=0x7ff470009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:04.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.584+0000 7ff478ff9700 1 -- 172.21.15.47:0/4202323515 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff470021070 con 0x7ff47c1003a0 2024-02-07T12:36:04.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.584+0000 7ff478ff9700 1 -- 172.21.15.47:0/4202323515 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff47001c400 con 0x7ff47c1003a0 2024-02-07T12:36:04.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.584+0000 7ff482668700 1 -- 172.21.15.47:0/4202323515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c10ef30 con 0x7ff47c1003a0 2024-02-07T12:36:04.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.584+0000 7ff478ff9700 1 -- 172.21.15.47:0/4202323515 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff47000e070 con 0x7ff47c1003a0 2024-02-07T12:36:04.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.584+0000 7ff482668700 1 -- 172.21.15.47:0/4202323515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c10f410 con 0x7ff47c1003a0 2024-02-07T12:36:04.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.585+0000 7ff482668700 1 -- 172.21.15.47:0/4202323515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c04bed0 con 0x7ff47c1003a0 2024-02-07T12:36:04.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.585+0000 7ff478ff9700 1 -- 172.21.15.47:0/4202323515 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff47001ca50 con 0x7ff47c1003a0 2024-02-07T12:36:04.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.585+0000 7ff478ff9700 1 --2- 172.21.15.47:0/4202323515 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff46406d7e0 0x7ff46406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:04.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.585+0000 7ff478ff9700 1 -- 172.21.15.47:0/4202323515 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff47008e140 con 0x7ff47c1003a0 2024-02-07T12:36:04.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.586+0000 7ff47bfff700 1 --2- 172.21.15.47:0/4202323515 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff46406d7e0 0x7ff46406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:04.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.586+0000 7ff47bfff700 1 --2- 172.21.15.47:0/4202323515 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff46406d7e0 0x7ff46406fc90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff46c009b80 tx=0x7ff46c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:04.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.590+0000 7ff478ff9700 1 -- 172.21.15.47:0/4202323515 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff47005b490 con 0x7ff47c1003a0 2024-02-07T12:36:04.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.822+0000 7ff482668700 1 -- 172.21.15.47:0/4202323515 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff47c10f840 con 0x7ff46406d7e0 2024-02-07T12:36:04.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.823+0000 7ff478ff9700 1 -- 172.21.15.47:0/4202323515 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7ff47c10f840 con 0x7ff46406d7e0 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe", 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": true, 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [ 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr", 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout: "mds", 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout: "osd", 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout: "mon" 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": "16/21 daemons upgraded", 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "Currently upgrading grafana daemons", 2024-02-07T12:36:04.826 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:36:04.827 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:36:04.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.825+0000 7ff482668700 1 -- 172.21.15.47:0/4202323515 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff46406d7e0 msgr2=0x7ff46406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:04.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.825+0000 7ff482668700 1 --2- 172.21.15.47:0/4202323515 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff46406d7e0 0x7ff46406fc90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff46c009b80 tx=0x7ff46c00b040 comp rx=0 tx=0).stop 2024-02-07T12:36:04.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.825+0000 7ff482668700 1 -- 172.21.15.47:0/4202323515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff47c1003a0 msgr2=0x7ff47c10de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:04.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.825+0000 7ff482668700 1 --2- 172.21.15.47:0/4202323515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff47c1003a0 0x7ff47c10de10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff470000c00 tx=0x7ff470009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:04.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.825+0000 7ff482668700 1 -- 172.21.15.47:0/4202323515 shutdown_connections 2024-02-07T12:36:04.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.825+0000 7ff482668700 1 --2- 172.21.15.47:0/4202323515 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff46406d7e0 0x7ff46406fc90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.825+0000 7ff482668700 1 --2- 172.21.15.47:0/4202323515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff47c0fda80 0x7ff47c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.825+0000 7ff482668700 1 --2- 172.21.15.47:0/4202323515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff47c1003a0 0x7ff47c10de10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.825+0000 7ff482668700 1 -- 172.21.15.47:0/4202323515 >> 172.21.15.47:0/4202323515 conn(0x7ff47c0f7520 msgr2=0x7ff47c0f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:04.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.826+0000 7ff482668700 1 -- 172.21.15.47:0/4202323515 shutdown_connections 2024-02-07T12:36:04.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.826+0000 7ff482668700 1 -- 172.21.15.47:0/4202323515 wait complete. 2024-02-07T12:36:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.928+0000 7fcda42b7700 1 -- 172.21.15.47:0/956131044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd9c0fbe40 msgr2=0x7fcd9c0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.928+0000 7fcda42b7700 1 --2- 172.21.15.47:0/956131044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd9c0fbe40 0x7fcd9c0fc250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009ce0 tx=0x7fcd8c004d10 comp rx=0 tx=0).stop 2024-02-07T12:36:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.928+0000 7fcda42b7700 1 -- 172.21.15.47:0/956131044 shutdown_connections 2024-02-07T12:36:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.928+0000 7fcda42b7700 1 --2- 172.21.15.47:0/956131044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9c0fcfb0 0x7fcd9c0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.928+0000 7fcda42b7700 1 --2- 172.21.15.47:0/956131044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd9c0fbe40 0x7fcd9c0fc250 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.928+0000 7fcda42b7700 1 -- 172.21.15.47:0/956131044 >> 172.21.15.47:0/956131044 conn(0x7fcd9c0f7520 msgr2=0x7fcd9c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:04.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.928+0000 7fcda42b7700 1 -- 172.21.15.47:0/956131044 shutdown_connections 2024-02-07T12:36:04.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.928+0000 7fcda42b7700 1 -- 172.21.15.47:0/956131044 wait complete. 2024-02-07T12:36:04.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.929+0000 7fcda42b7700 1 Processor -- start 2024-02-07T12:36:04.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.929+0000 7fcda42b7700 1 -- start start 2024-02-07T12:36:04.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.929+0000 7fcda42b7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd9c0fbe40 0x7fcd9c1107e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:04.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.929+0000 7fcda42b7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9c0fcfb0 0x7fcd9c112d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:04.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.929+0000 7fcda42b7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c066d80 con 0x7fcd9c0fbe40 2024-02-07T12:36:04.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.929+0000 7fcda42b7700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c066ec0 con 0x7fcd9c0fcfb0 2024-02-07T12:36:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.929+0000 7fcda2053700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd9c0fbe40 0x7fcd9c1107e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.929+0000 7fcda2053700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd9c0fbe40 0x7fcd9c1107e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52986/0 (socket says 172.21.15.47:52986) 2024-02-07T12:36:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.929+0000 7fcda2053700 1 -- 172.21.15.47:0/4227732443 learned_addr learned my addr 172.21.15.47:0/4227732443 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:36:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.929+0000 7fcda2053700 1 -- 172.21.15.47:0/4227732443 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9c0fcfb0 msgr2=0x7fcd9c112d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.929+0000 7fcda1852700 1 --2- 172.21.15.47:0/4227732443 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9c0fcfb0 0x7fcd9c112d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.929+0000 7fcda2053700 1 --2- 172.21.15.47:0/4227732443 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9c0fcfb0 0x7fcd9c112d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.929+0000 7fcda2053700 1 -- 172.21.15.47:0/4227732443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c009940 con 0x7fcd9c0fbe40 2024-02-07T12:36:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.930+0000 7fcda2053700 1 --2- 172.21.15.47:0/4227732443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd9c0fbe40 0x7fcd9c1107e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c015040 tx=0x7fcd8c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.930+0000 7fcd9affd700 1 -- 172.21.15.47:0/4227732443 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd8c00e040 con 0x7fcd9c0fbe40 2024-02-07T12:36:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.930+0000 7fcda42b7700 1 -- 172.21.15.47:0/4227732443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9c113360 con 0x7fcd9c0fbe40 2024-02-07T12:36:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.930+0000 7fcd9affd700 1 -- 172.21.15.47:0/4227732443 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd8c0128e0 con 0x7fcd9c0fbe40 2024-02-07T12:36:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.930+0000 7fcd9affd700 1 -- 172.21.15.47:0/4227732443 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd8c01c990 con 0x7fcd9c0fbe40 2024-02-07T12:36:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.930+0000 7fcda42b7700 1 -- 172.21.15.47:0/4227732443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c113840 con 0x7fcd9c0fbe40 2024-02-07T12:36:04.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.931+0000 7fcda42b7700 1 -- 172.21.15.47:0/4227732443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9c04bed0 con 0x7fcd9c0fbe40 2024-02-07T12:36:04.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.931+0000 7fcd9affd700 1 -- 172.21.15.47:0/4227732443 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fcd8c012410 con 0x7fcd9c0fbe40 2024-02-07T12:36:04.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.932+0000 7fcd9affd700 1 --2- 172.21.15.47:0/4227732443 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fcd8406d7e0 0x7fcd8406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:04.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.932+0000 7fcd9affd700 1 -- 172.21.15.47:0/4227732443 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fcd8c08ee60 con 0x7fcd9c0fbe40 2024-02-07T12:36:04.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.932+0000 7fcda1852700 1 --2- 172.21.15.47:0/4227732443 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fcd8406d7e0 0x7fcd8406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:04.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.932+0000 7fcda1852700 1 --2- 172.21.15.47:0/4227732443 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fcd8406d7e0 0x7fcd8406fc90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcd90006fd0 tx=0x7fcd90008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:04.936+0000 7fcd9affd700 1 -- 172.21.15.47:0/4227732443 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcd8c058560 con 0x7fcd9c0fbe40 2024-02-07T12:36:05.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:05.227+0000 7fcda42b7700 1 -- 172.21.15.47:0/4227732443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcd9c113d00 con 0x7fcd9c0fbe40 2024-02-07T12:36:05.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:05.227+0000 7fcd9affd700 1 -- 172.21.15.47:0/4227732443 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fcd8c05bc20 con 0x7fcd9c0fbe40 2024-02-07T12:36:05.230 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:36:05.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:05.229+0000 7fcda42b7700 1 -- 172.21.15.47:0/4227732443 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fcd8406d7e0 msgr2=0x7fcd8406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:05.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:05.229+0000 7fcda42b7700 1 --2- 172.21.15.47:0/4227732443 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fcd8406d7e0 0x7fcd8406fc90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcd90006fd0 tx=0x7fcd90008040 comp rx=0 tx=0).stop 2024-02-07T12:36:05.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:05.229+0000 7fcda42b7700 1 -- 172.21.15.47:0/4227732443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd9c0fbe40 msgr2=0x7fcd9c1107e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:05.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:05.229+0000 7fcda42b7700 1 --2- 172.21.15.47:0/4227732443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd9c0fbe40 0x7fcd9c1107e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c015040 tx=0x7fcd8c004d10 comp rx=0 tx=0).stop 2024-02-07T12:36:05.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:05.229+0000 7fcda42b7700 1 -- 172.21.15.47:0/4227732443 shutdown_connections 2024-02-07T12:36:05.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:05.229+0000 7fcda42b7700 1 --2- 172.21.15.47:0/4227732443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd9c0fbe40 0x7fcd9c1107e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:05.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:05.229+0000 7fcda42b7700 1 --2- 172.21.15.47:0/4227732443 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fcd8406d7e0 0x7fcd8406fc90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:05.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:05.229+0000 7fcda42b7700 1 --2- 172.21.15.47:0/4227732443 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9c0fcfb0 0x7fcd9c112d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:05.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:05.229+0000 7fcda42b7700 1 -- 172.21.15.47:0/4227732443 >> 172.21.15.47:0/4227732443 conn(0x7fcd9c0f7520 msgr2=0x7fcd9c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:05.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:05.229+0000 7fcda42b7700 1 -- 172.21.15.47:0/4227732443 shutdown_connections 2024-02-07T12:36:05.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:05.229+0000 7fcda42b7700 1 -- 172.21.15.47:0/4227732443 wait complete. 2024-02-07T12:36:05.325 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:05 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2471055138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:36:05.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:05 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2471055138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:36:06.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:06 smithi138 ceph-mon[82055]: pgmap v268: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:06.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:06 smithi138 ceph-mon[82055]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:06 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/4227732443' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:36:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:06 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:06.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:06 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:06 smithi047 ceph-mon[93224]: pgmap v268: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:06 smithi047 ceph-mon[93224]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:06 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/4227732443' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:36:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:06 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:06 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:07.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:07 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:07.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:07 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:08.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:07 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:08.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:07 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:08.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:08 smithi047 ceph-mon[93224]: pgmap v269: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:36:09.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:08 smithi138 ceph-mon[82055]: pgmap v269: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:36:10.720 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: pgmap v270: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:10.720 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:10.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:10.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:36:10.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:36:10.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:10.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-07T12:36:10.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:36:10.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.721 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.722 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.722 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.722 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.722 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.722 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.722 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.722 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.722 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.722 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.722 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:10.722 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:10 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: pgmap v270: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:36:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:36:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-07T12:36:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:36:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:11.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:10 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:12.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-07T12:36:12.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: Upgrade: Finalizing container_image settings 2024-02-07T12:36:12.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:12.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-07T12:36:12.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-07T12:36:12.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-07T12:36:12.036 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: Upgrade: Complete! 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-07T12:36:12.037 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-07T12:36:12.038 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:36:12.038 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:36:12.038 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:36:12.038 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:12.038 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:36:12.038 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:36:12.038 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:36:12.038 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:12.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: Upgrade: Finalizing container_image settings 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-07T12:36:12.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.077 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-07T12:36:12.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: Upgrade: Complete! 2024-02-07T12:36:12.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-07T12:36:12.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-07T12:36:12.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:36:12.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:36:12.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:36:12.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:12.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:36:12.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:36:12.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:36:12.078 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:13.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:12 smithi138 ceph-mon[82055]: pgmap v271: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:36:13.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:36:13.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:13.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:12 smithi047 ceph-mon[93224]: pgmap v271: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:36:13.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:36:13.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:36:15.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:14 smithi138 ceph-mon[82055]: pgmap v272: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:36:15.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:14 smithi047 ceph-mon[93224]: pgmap v272: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:36:17.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:16 smithi138 ceph-mon[82055]: pgmap v273: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:17.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:16 smithi047 ceph-mon[93224]: pgmap v273: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:19.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:18 smithi138 ceph-mon[82055]: pgmap v274: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:36:19.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:18 smithi047 ceph-mon[93224]: pgmap v274: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:36:21.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:20 smithi138 ceph-mon[82055]: pgmap v275: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:21.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:20 smithi047 ceph-mon[93224]: pgmap v275: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:23.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:22 smithi138 ceph-mon[82055]: pgmap v276: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:36:23.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:22 smithi047 ceph-mon[93224]: pgmap v276: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:36:25.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:24 smithi138 ceph-mon[82055]: pgmap v277: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:36:25.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:24 smithi047 ceph-mon[93224]: pgmap v277: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:36:27.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:26 smithi138 ceph-mon[82055]: pgmap v278: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:27.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:26 smithi047 ceph-mon[93224]: pgmap v278: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:28.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:36:28.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:36:29.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:28 smithi138 ceph-mon[82055]: pgmap v279: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:36:29.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:28 smithi047 ceph-mon[93224]: pgmap v279: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:36:31.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:30 smithi138 ceph-mon[82055]: pgmap v280: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:31.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:30 smithi047 ceph-mon[93224]: pgmap v280: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:33.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:32 smithi138 ceph-mon[82055]: pgmap v281: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:36:33.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:32 smithi047 ceph-mon[93224]: pgmap v281: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:36:35.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:34 smithi138 ceph-mon[82055]: pgmap v282: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:36:35.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:34 smithi047 ceph-mon[93224]: pgmap v282: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:36:35.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.347+0000 7f33ca119700 1 -- 172.21.15.47:0/2594014155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c4100120 msgr2=0x7f33c4102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:35.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.347+0000 7f33ca119700 1 --2- 172.21.15.47:0/2594014155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c4100120 0x7f33c4102500 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f33b8004940 tx=0x7f33b8009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:35.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.347+0000 7f33ca119700 1 -- 172.21.15.47:0/2594014155 shutdown_connections 2024-02-07T12:36:35.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.347+0000 7f33ca119700 1 --2- 172.21.15.47:0/2594014155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c4100120 0x7f33c4102500 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:35.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.347+0000 7f33ca119700 1 --2- 172.21.15.47:0/2594014155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33c4066b90 0x7f33c40ffbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:35.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.347+0000 7f33ca119700 1 -- 172.21.15.47:0/2594014155 >> 172.21.15.47:0/2594014155 conn(0x7f33c40f7590 msgr2=0x7f33c40f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:35.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.347+0000 7f33ca119700 1 -- 172.21.15.47:0/2594014155 shutdown_connections 2024-02-07T12:36:35.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.347+0000 7f33ca119700 1 -- 172.21.15.47:0/2594014155 wait complete. 2024-02-07T12:36:35.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.348+0000 7f33ca119700 1 Processor -- start 2024-02-07T12:36:35.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.348+0000 7f33ca119700 1 -- start start 2024-02-07T12:36:35.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.348+0000 7f33ca119700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33c4066b90 0x7f33c40fd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:35.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.348+0000 7f33ca119700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c4100120 0x7f33c40fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:35.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.348+0000 7f33ca119700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40fc0e0 con 0x7f33c4100120 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.348+0000 7f33ca119700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40fc250 con 0x7f33c4066b90 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.348+0000 7f33c2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c4100120 0x7f33c40fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.348+0000 7f33c2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c4100120 0x7f33c40fbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50822/0 (socket says 172.21.15.47:50822) 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.348+0000 7f33c2ffd700 1 -- 172.21.15.47:0/940687750 learned_addr learned my addr 172.21.15.47:0/940687750 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.348+0000 7f33c37fe700 1 --2- 172.21.15.47:0/940687750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33c4066b90 0x7f33c40fd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.349+0000 7f33c2ffd700 1 -- 172.21.15.47:0/940687750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33c4066b90 msgr2=0x7f33c40fd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.349+0000 7f33c2ffd700 1 --2- 172.21.15.47:0/940687750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33c4066b90 0x7f33c40fd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.349+0000 7f33c2ffd700 1 -- 172.21.15.47:0/940687750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b8005040 con 0x7f33c4100120 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.349+0000 7f33c2ffd700 1 --2- 172.21.15.47:0/940687750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c4100120 0x7f33c40fbae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f33b800b3b0 tx=0x7f33b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.349+0000 7f33abfff700 1 -- 172.21.15.47:0/940687750 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33b800e040 con 0x7f33c4100120 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.349+0000 7f33ca119700 1 -- 172.21.15.47:0/940687750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c40fc4d0 con 0x7f33c4100120 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.349+0000 7f33abfff700 1 -- 172.21.15.47:0/940687750 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33b800bcc0 con 0x7f33c4100120 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.349+0000 7f33abfff700 1 -- 172.21.15.47:0/940687750 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33b801c630 con 0x7f33c4100120 2024-02-07T12:36:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.349+0000 7f33ca119700 1 -- 172.21.15.47:0/940687750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c41159b0 con 0x7f33c4100120 2024-02-07T12:36:35.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.350+0000 7f33ca119700 1 -- 172.21.15.47:0/940687750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c4107a60 con 0x7f33c4100120 2024-02-07T12:36:35.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.351+0000 7f33abfff700 1 -- 172.21.15.47:0/940687750 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f33b8013980 con 0x7f33c4100120 2024-02-07T12:36:35.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.351+0000 7f33abfff700 1 --2- 172.21.15.47:0/940687750 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f33ac06d7e0 0x7f33ac06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:35.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.351+0000 7f33abfff700 1 -- 172.21.15.47:0/940687750 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f33b808e430 con 0x7f33c4100120 2024-02-07T12:36:35.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.351+0000 7f33c37fe700 1 --2- 172.21.15.47:0/940687750 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f33ac06d7e0 0x7f33ac06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:35.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.352+0000 7f33c37fe700 1 --2- 172.21.15.47:0/940687750 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f33ac06d7e0 0x7f33ac06fc90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f33c40fd3f0 tx=0x7f33b4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:35.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.356+0000 7f33abfff700 1 -- 172.21.15.47:0/940687750 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f33b805b780 con 0x7f33c4100120 2024-02-07T12:36:35.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.581+0000 7f33ca119700 1 -- 172.21.15.47:0/940687750 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33c402b340 con 0x7f33ac06d7e0 2024-02-07T12:36:35.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.582+0000 7f33abfff700 1 -- 172.21.15.47:0/940687750 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f33c402b340 con 0x7f33ac06d7e0 2024-02-07T12:36:35.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.584+0000 7f33ca119700 1 -- 172.21.15.47:0/940687750 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f33ac06d7e0 msgr2=0x7f33ac06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:35.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.584+0000 7f33ca119700 1 --2- 172.21.15.47:0/940687750 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f33ac06d7e0 0x7f33ac06fc90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f33c40fd3f0 tx=0x7f33b4009040 comp rx=0 tx=0).stop 2024-02-07T12:36:35.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.584+0000 7f33ca119700 1 -- 172.21.15.47:0/940687750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c4100120 msgr2=0x7f33c40fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:35.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.584+0000 7f33ca119700 1 --2- 172.21.15.47:0/940687750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c4100120 0x7f33c40fbae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f33b800b3b0 tx=0x7f33b8009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:35.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.584+0000 7f33ca119700 1 -- 172.21.15.47:0/940687750 shutdown_connections 2024-02-07T12:36:35.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.584+0000 7f33ca119700 1 --2- 172.21.15.47:0/940687750 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f33ac06d7e0 0x7f33ac06fc90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:35.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.584+0000 7f33ca119700 1 --2- 172.21.15.47:0/940687750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33c4066b90 0x7f33c40fd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:35.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.584+0000 7f33ca119700 1 --2- 172.21.15.47:0/940687750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c4100120 0x7f33c40fbae0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:35.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.584+0000 7f33ca119700 1 -- 172.21.15.47:0/940687750 >> 172.21.15.47:0/940687750 conn(0x7f33c40f7590 msgr2=0x7f33c40f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:35.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.585+0000 7f33ca119700 1 -- 172.21.15.47:0/940687750 shutdown_connections 2024-02-07T12:36:35.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:35.585+0000 7f33ca119700 1 -- 172.21.15.47:0/940687750 wait complete. 2024-02-07T12:36:36.252 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'ceph orch ps' 2024-02-07T12:36:36.558 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:36:36.933 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:36 smithi047 ceph-mon[93224]: pgmap v283: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:36.933 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:36 smithi047 ceph-mon[93224]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:37.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:36 smithi138 ceph-mon[82055]: pgmap v283: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:37.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:36 smithi138 ceph-mon[82055]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:38.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.213+0000 7fe7fbabf700 1 -- 172.21.15.47:0/298715825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f41038f0 msgr2=0x7fe7f40fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:38.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.213+0000 7fe7fbabf700 1 --2- 172.21.15.47:0/298715825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f41038f0 0x7fe7f40fcf60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0004940 tx=0x7fe7f0009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:38.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.213+0000 7fe7fbabf700 1 -- 172.21.15.47:0/298715825 shutdown_connections 2024-02-07T12:36:38.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.213+0000 7fe7fbabf700 1 --2- 172.21.15.47:0/298715825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f41038f0 0x7fe7f40fcf60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:38.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.213+0000 7fe7fbabf700 1 --2- 172.21.15.47:0/298715825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7f4102f50 0x7fe7f4103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.213+0000 7fe7fbabf700 1 -- 172.21.15.47:0/298715825 >> 172.21.15.47:0/298715825 conn(0x7fe7f40f8ae0 msgr2=0x7fe7f40faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.213+0000 7fe7fbabf700 1 -- 172.21.15.47:0/298715825 shutdown_connections 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.213+0000 7fe7fbabf700 1 -- 172.21.15.47:0/298715825 wait complete. 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.214+0000 7fe7fbabf700 1 Processor -- start 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.214+0000 7fe7fbabf700 1 -- start start 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.214+0000 7fe7fbabf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f4102f50 0x7fe7f4113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.214+0000 7fe7fbabf700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7f41038f0 0x7fe7f4114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.214+0000 7fe7fbabf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f41146e0 con 0x7fe7f4102f50 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.214+0000 7fe7fbabf700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f410d980 con 0x7fe7f41038f0 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.214+0000 7fe7f985b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f4102f50 0x7fe7f4113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.214+0000 7fe7f985b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f4102f50 0x7fe7f4113ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50836/0 (socket says 172.21.15.47:50836) 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.214+0000 7fe7f985b700 1 -- 172.21.15.47:0/3088671711 learned_addr learned my addr 172.21.15.47:0/3088671711 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.214+0000 7fe7f905a700 1 --2- 172.21.15.47:0/3088671711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7f41038f0 0x7fe7f4114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.215+0000 7fe7f985b700 1 -- 172.21.15.47:0/3088671711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7f41038f0 msgr2=0x7fe7f4114000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.215+0000 7fe7f985b700 1 --2- 172.21.15.47:0/3088671711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7f41038f0 0x7fe7f4114000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.215+0000 7fe7f985b700 1 -- 172.21.15.47:0/3088671711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f0005040 con 0x7fe7f4102f50 2024-02-07T12:36:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.215+0000 7fe7f985b700 1 --2- 172.21.15.47:0/3088671711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f4102f50 0x7fe7f4113ac0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400b790 tx=0x7fe7e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.215+0000 7fe7ea7fc700 1 -- 172.21.15.47:0/3088671711 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e400f770 con 0x7fe7f4102f50 2024-02-07T12:36:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.215+0000 7fe7ea7fc700 1 -- 172.21.15.47:0/3088671711 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7e400fda0 con 0x7fe7f4102f50 2024-02-07T12:36:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.215+0000 7fe7ea7fc700 1 -- 172.21.15.47:0/3088671711 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e400d310 con 0x7fe7f4102f50 2024-02-07T12:36:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.215+0000 7fe7fbabf700 1 -- 172.21.15.47:0/3088671711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f410dc60 con 0x7fe7f4102f50 2024-02-07T12:36:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.215+0000 7fe7fbabf700 1 -- 172.21.15.47:0/3088671711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f410e1a0 con 0x7fe7f4102f50 2024-02-07T12:36:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.216+0000 7fe7fbabf700 1 -- 172.21.15.47:0/3088671711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f40fc6e0 con 0x7fe7f4102f50 2024-02-07T12:36:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.217+0000 7fe7ea7fc700 1 -- 172.21.15.47:0/3088671711 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe7e4010420 con 0x7fe7f4102f50 2024-02-07T12:36:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.217+0000 7fe7ea7fc700 1 --2- 172.21.15.47:0/3088671711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe7e006d7f0 0x7fe7e006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.217+0000 7fe7ea7fc700 1 -- 172.21.15.47:0/3088671711 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe7e408cef0 con 0x7fe7f4102f50 2024-02-07T12:36:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.217+0000 7fe7f905a700 1 --2- 172.21.15.47:0/3088671711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe7e006d7f0 0x7fe7e006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.217+0000 7fe7f905a700 1 --2- 172.21.15.47:0/3088671711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe7e006d7f0 0x7fe7e006fca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe7f410f2f0 tx=0x7fe7f0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.222+0000 7fe7ea7fc700 1 -- 172.21.15.47:0/3088671711 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe7e405a2e0 con 0x7fe7f4102f50 2024-02-07T12:36:38.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.437+0000 7fe7fbabf700 1 -- 172.21.15.47:0/3088671711 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7f410f110 con 0x7fe7e006d7f0 2024-02-07T12:36:38.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.458+0000 7fe7ea7fc700 1 -- 172.21.15.47:0/3088671711 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe7f410f110 con 0x7fe7e006d7f0 2024-02-07T12:36:38.460 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:36:38.460 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (54s) 33s ago 19m 15.2M - 0.25.0 c8568f914cd2 df2841092eff 2024-02-07T12:36:38.460 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (7m) 33s ago 19m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:36:38.460 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (7m) 86s ago 18m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:36:38.460 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (38s) 33s ago 18m 55.4M - 9.4.12 a0ea5e3c46d9 cbcf3b4acf93 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (2m) 33s ago 13m 16.5M - 19.0.0-1252-g44458cce 79957b372307 fbda6b9f9953 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (2m) 33s ago 13m 67.3M - 19.0.0-1252-g44458cce 79957b372307 055df3be8762 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (109s) 86s ago 13m 14.0M - 19.0.0-1252-g44458cce 79957b372307 742dc60bfa13 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (2m) 86s ago 13m 67.1M - 19.0.0-1252-g44458cce 79957b372307 502afeac2e7d 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (9m) 33s ago 20m 512M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (8m) 86s ago 18m 453M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (8m) 33s ago 20m 59.2M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (7m) 86s ago 18m 43.4M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (96s) 33s ago 19m 9663k - 1.5.0 0da6a335fe13 199e0ea3a587 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (88s) 86s ago 18m 3623k - 1.5.0 0da6a335fe13 f9f13e3bf225 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (6m) 33s ago 17m 102M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (6m) 33s ago 16m 113M 1559M 19.0.0-1252-g44458cce 79957b372307 0f2b0eea74d7 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (5m) 33s ago 16m 91.3M 1559M 19.0.0-1252-g44458cce 79957b372307 0b8c78346346 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (5m) 86s ago 16m 129M 2581M 19.0.0-1252-g44458cce 79957b372307 dea45db021db 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (4m) 86s ago 15m 100M 2581M 19.0.0-1252-g44458cce 79957b372307 3161c1dfe6f5 2024-02-07T12:36:38.461 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (3m) 86s ago 15m 93.9M 2581M 19.0.0-1252-g44458cce 79957b372307 c9504c7cfe7c 2024-02-07T12:36:38.462 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (71s) 33s ago 18m 46.3M - 2.43.0 a07b618ecd1d be4740743bdd 2024-02-07T12:36:38.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.460+0000 7fe7fbabf700 1 -- 172.21.15.47:0/3088671711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe7e006d7f0 msgr2=0x7fe7e006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:38.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.460+0000 7fe7fbabf700 1 --2- 172.21.15.47:0/3088671711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe7e006d7f0 0x7fe7e006fca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe7f410f2f0 tx=0x7fe7f0009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.460+0000 7fe7fbabf700 1 -- 172.21.15.47:0/3088671711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f4102f50 msgr2=0x7fe7f4113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.460+0000 7fe7fbabf700 1 --2- 172.21.15.47:0/3088671711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f4102f50 0x7fe7f4113ac0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400b790 tx=0x7fe7e4009250 comp rx=0 tx=0).stop 2024-02-07T12:36:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.460+0000 7fe7fbabf700 1 -- 172.21.15.47:0/3088671711 shutdown_connections 2024-02-07T12:36:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.460+0000 7fe7fbabf700 1 --2- 172.21.15.47:0/3088671711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f4102f50 0x7fe7f4113ac0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.460+0000 7fe7fbabf700 1 --2- 172.21.15.47:0/3088671711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fe7e006d7f0 0x7fe7e006fca0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.460+0000 7fe7fbabf700 1 --2- 172.21.15.47:0/3088671711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7f41038f0 0x7fe7f4114000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.460+0000 7fe7fbabf700 1 -- 172.21.15.47:0/3088671711 >> 172.21.15.47:0/3088671711 conn(0x7fe7f40f8ae0 msgr2=0x7fe7f40fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.460+0000 7fe7fbabf700 1 -- 172.21.15.47:0/3088671711 shutdown_connections 2024-02-07T12:36:38.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:38.460+0000 7fe7fbabf700 1 -- 172.21.15.47:0/3088671711 wait complete. 2024-02-07T12:36:39.009 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:38 smithi047 ceph-mon[93224]: pgmap v284: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:36:39.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:38 smithi138 ceph-mon[82055]: pgmap v284: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:36:39.108 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'ceph orch upgrade status' 2024-02-07T12:36:39.377 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:36:39.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:39 smithi047 ceph-mon[93224]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:40.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:39 smithi138 ceph-mon[82055]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:40.962 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:40 smithi047 ceph-mon[93224]: pgmap v285: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.986+0000 7f22894c9700 1 -- 172.21.15.47:0/1072435692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22841038f0 msgr2=0x7f22840fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.986+0000 7f22894c9700 1 --2- 172.21.15.47:0/1072435692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22841038f0 0x7f22840fcf60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f226c004940 tx=0x7f226c009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.986+0000 7f22894c9700 1 -- 172.21.15.47:0/1072435692 shutdown_connections 2024-02-07T12:36:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.986+0000 7f22894c9700 1 --2- 172.21.15.47:0/1072435692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22841038f0 0x7f22840fcf60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.986+0000 7f22894c9700 1 --2- 172.21.15.47:0/1072435692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2284102f50 0x7f2284103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.986+0000 7f22894c9700 1 -- 172.21.15.47:0/1072435692 >> 172.21.15.47:0/1072435692 conn(0x7f22840f8ae0 msgr2=0x7f22840faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.986+0000 7f22894c9700 1 -- 172.21.15.47:0/1072435692 shutdown_connections 2024-02-07T12:36:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.986+0000 7f22894c9700 1 -- 172.21.15.47:0/1072435692 wait complete. 2024-02-07T12:36:40.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.987+0000 7f22894c9700 1 Processor -- start 2024-02-07T12:36:40.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.987+0000 7f22894c9700 1 -- start start 2024-02-07T12:36:40.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.987+0000 7f22894c9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2284102f50 0x7f2284070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:40.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.987+0000 7f22894c9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22841038f0 0x7f22840707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:40.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.987+0000 7f22894c9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2284070dd0 con 0x7f2284102f50 2024-02-07T12:36:40.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.987+0000 7f22894c9700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2284070f40 con 0x7f22841038f0 2024-02-07T12:36:40.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.987+0000 7f2282ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2284102f50 0x7f2284070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.987+0000 7f2282ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2284102f50 0x7f2284070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40976/0 (socket says 172.21.15.47:40976) 2024-02-07T12:36:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.987+0000 7f2282ffd700 1 -- 172.21.15.47:0/3836834987 learned_addr learned my addr 172.21.15.47:0/3836834987 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:36:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.987+0000 7f22827fc700 1 --2- 172.21.15.47:0/3836834987 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22841038f0 0x7f22840707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.988+0000 7f2282ffd700 1 -- 172.21.15.47:0/3836834987 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22841038f0 msgr2=0x7f22840707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.988+0000 7f2282ffd700 1 --2- 172.21.15.47:0/3836834987 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22841038f0 0x7f22840707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.988+0000 7f2282ffd700 1 -- 172.21.15.47:0/3836834987 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c005040 con 0x7f2284102f50 2024-02-07T12:36:40.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.988+0000 7f2282ffd700 1 --2- 172.21.15.47:0/3836834987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2284102f50 0x7f2284070290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f227400c830 tx=0x7f2274004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:40.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.988+0000 7f227b7fe700 1 -- 172.21.15.47:0/3836834987 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22740106f0 con 0x7f2284102f50 2024-02-07T12:36:40.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.988+0000 7f227b7fe700 1 -- 172.21.15.47:0/3836834987 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2274010d20 con 0x7f2284102f50 2024-02-07T12:36:40.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.988+0000 7f22894c9700 1 -- 172.21.15.47:0/3836834987 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2284119cd0 con 0x7f2284102f50 2024-02-07T12:36:40.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.988+0000 7f227b7fe700 1 -- 172.21.15.47:0/3836834987 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22740113a0 con 0x7f2284102f50 2024-02-07T12:36:40.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.988+0000 7f22894c9700 1 -- 172.21.15.47:0/3836834987 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228411a180 con 0x7f2284102f50 2024-02-07T12:36:40.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.989+0000 7f22894c9700 1 -- 172.21.15.47:0/3836834987 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2284105420 con 0x7f2284102f50 2024-02-07T12:36:40.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.989+0000 7f227b7fe700 1 -- 172.21.15.47:0/3836834987 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f2274012400 con 0x7f2284102f50 2024-02-07T12:36:40.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.990+0000 7f227b7fe700 1 --2- 172.21.15.47:0/3836834987 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f227006d7e0 0x7f227006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:40.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.990+0000 7f227b7fe700 1 -- 172.21.15.47:0/3836834987 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f227408cee0 con 0x7f2284102f50 2024-02-07T12:36:40.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.990+0000 7f22827fc700 1 --2- 172.21.15.47:0/3836834987 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f227006d7e0 0x7f227006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:40.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.990+0000 7f22827fc700 1 --2- 172.21.15.47:0/3836834987 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f227006d7e0 0x7f227006fc90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f226c00b3b0 tx=0x7f226c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:40.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:40.995+0000 7f227b7fe700 1 -- 172.21.15.47:0/3836834987 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2274056700 con 0x7f2284102f50 2024-02-07T12:36:41.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:40 smithi138 ceph-mon[82055]: pgmap v285: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:41.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:41.221+0000 7f22894c9700 1 -- 172.21.15.47:0/3836834987 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22840719d0 con 0x7f227006d7e0 2024-02-07T12:36:41.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:41.222+0000 7f227b7fe700 1 -- 172.21.15.47:0/3836834987 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f22840719d0 con 0x7f227006d7e0 2024-02-07T12:36:41.224 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:36:41.224 INFO:teuthology.orchestra.run.smithi047.stdout: "target_image": null, 2024-02-07T12:36:41.224 INFO:teuthology.orchestra.run.smithi047.stdout: "in_progress": false, 2024-02-07T12:36:41.224 INFO:teuthology.orchestra.run.smithi047.stdout: "which": "", 2024-02-07T12:36:41.225 INFO:teuthology.orchestra.run.smithi047.stdout: "services_complete": [], 2024-02-07T12:36:41.225 INFO:teuthology.orchestra.run.smithi047.stdout: "progress": null, 2024-02-07T12:36:41.225 INFO:teuthology.orchestra.run.smithi047.stdout: "message": "", 2024-02-07T12:36:41.225 INFO:teuthology.orchestra.run.smithi047.stdout: "is_paused": false 2024-02-07T12:36:41.225 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:36:41.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:41.225+0000 7f22894c9700 1 -- 172.21.15.47:0/3836834987 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f227006d7e0 msgr2=0x7f227006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:41.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:41.225+0000 7f22894c9700 1 --2- 172.21.15.47:0/3836834987 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f227006d7e0 0x7f227006fc90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f226c00b3b0 tx=0x7f226c009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:41.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:41.225+0000 7f22894c9700 1 -- 172.21.15.47:0/3836834987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2284102f50 msgr2=0x7f2284070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:41.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:41.225+0000 7f22894c9700 1 --2- 172.21.15.47:0/3836834987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2284102f50 0x7f2284070290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f227400c830 tx=0x7f2274004470 comp rx=0 tx=0).stop 2024-02-07T12:36:41.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:41.225+0000 7f22894c9700 1 -- 172.21.15.47:0/3836834987 shutdown_connections 2024-02-07T12:36:41.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:41.225+0000 7f22894c9700 1 --2- 172.21.15.47:0/3836834987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2284102f50 0x7f2284070290 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:41.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:41.225+0000 7f22894c9700 1 --2- 172.21.15.47:0/3836834987 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f227006d7e0 0x7f227006fc90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:41.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:41.225+0000 7f22894c9700 1 --2- 172.21.15.47:0/3836834987 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22841038f0 0x7f22840707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:41.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:41.225+0000 7f22894c9700 1 -- 172.21.15.47:0/3836834987 >> 172.21.15.47:0/3836834987 conn(0x7f22840f8ae0 msgr2=0x7f22840fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:41.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:41.225+0000 7f22894c9700 1 -- 172.21.15.47:0/3836834987 shutdown_connections 2024-02-07T12:36:41.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:41.225+0000 7f22894c9700 1 -- 172.21.15.47:0/3836834987 wait complete. 2024-02-07T12:36:41.925 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:41 smithi047 ceph-mon[93224]: pgmap v286: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:36:41.925 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:41 smithi047 ceph-mon[93224]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:41.925 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:41 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:36:41.949 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'ceph health detail' 2024-02-07T12:36:42.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:41 smithi138 ceph-mon[82055]: pgmap v286: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:36:42.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:41 smithi138 ceph-mon[82055]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:36:42.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:41 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:36:42.211 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:36:43.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.867+0000 7fc61fffc700 1 -- 172.21.15.47:0/3909615155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc618101e40 msgr2=0x7fc618102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:43.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.867+0000 7fc61fffc700 1 --2- 172.21.15.47:0/3909615155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc618101e40 0x7fc618102210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc610004940 tx=0x7fc610009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:43.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.867+0000 7fc61fffc700 1 -- 172.21.15.47:0/3909615155 shutdown_connections 2024-02-07T12:36:43.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.867+0000 7fc61fffc700 1 --2- 172.21.15.47:0/3909615155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6181027e0 0x7fc6180fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:43.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.867+0000 7fc61fffc700 1 --2- 172.21.15.47:0/3909615155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc618101e40 0x7fc618102210 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:43.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.867+0000 7fc61fffc700 1 -- 172.21.15.47:0/3909615155 >> 172.21.15.47:0/3909615155 conn(0x7fc618071d90 msgr2=0x7fc618072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:43.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.867+0000 7fc61fffc700 1 -- 172.21.15.47:0/3909615155 shutdown_connections 2024-02-07T12:36:43.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.867+0000 7fc61fffc700 1 -- 172.21.15.47:0/3909615155 wait complete. 2024-02-07T12:36:43.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61fffc700 1 Processor -- start 2024-02-07T12:36:43.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61fffc700 1 -- start start 2024-02-07T12:36:43.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61fffc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc618101e40 0x7fc618102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:43.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61fffc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6181027e0 0x7fc6181031e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:43.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61fffc700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6181037e0 con 0x7fc6181027e0 2024-02-07T12:36:43.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61fffc700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc618103950 con 0x7fc618101e40 2024-02-07T12:36:43.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61d597700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6181027e0 0x7fc6181031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:43.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61d597700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6181027e0 0x7fc6181031e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41004/0 (socket says 172.21.15.47:41004) 2024-02-07T12:36:43.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61d597700 1 -- 172.21.15.47:0/3881613626 learned_addr learned my addr 172.21.15.47:0/3881613626 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:36:43.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61dd98700 1 --2- 172.21.15.47:0/3881613626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc618101e40 0x7fc618102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61d597700 1 -- 172.21.15.47:0/3881613626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc618101e40 msgr2=0x7fc618102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61d597700 1 --2- 172.21.15.47:0/3881613626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc618101e40 0x7fc618102ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61d597700 1 -- 172.21.15.47:0/3881613626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc610005040 con 0x7fc6181027e0 2024-02-07T12:36:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.868+0000 7fc61dd98700 1 --2- 172.21.15.47:0/3881613626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc618101e40 0x7fc618102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:36:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.869+0000 7fc61d597700 1 --2- 172.21.15.47:0/3881613626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6181027e0 0x7fc6181031e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc60c002a50 tx=0x7fc60c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.869+0000 7fc6167fc700 1 -- 172.21.15.47:0/3881613626 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc60c007cc0 con 0x7fc6181027e0 2024-02-07T12:36:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.869+0000 7fc6167fc700 1 -- 172.21.15.47:0/3881613626 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc60c00f040 con 0x7fc6181027e0 2024-02-07T12:36:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.869+0000 7fc61fffc700 1 -- 172.21.15.47:0/3881613626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc618119cc0 con 0x7fc6181027e0 2024-02-07T12:36:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.869+0000 7fc6167fc700 1 -- 172.21.15.47:0/3881613626 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc60c00daf0 con 0x7fc6181027e0 2024-02-07T12:36:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.869+0000 7fc61fffc700 1 -- 172.21.15.47:0/3881613626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61811a1a0 con 0x7fc6181027e0 2024-02-07T12:36:43.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.870+0000 7fc61fffc700 1 -- 172.21.15.47:0/3881613626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6180738b0 con 0x7fc6181027e0 2024-02-07T12:36:43.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.870+0000 7fc6167fc700 1 -- 172.21.15.47:0/3881613626 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc60c009810 con 0x7fc6181027e0 2024-02-07T12:36:43.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.871+0000 7fc6167fc700 1 --2- 172.21.15.47:0/3881613626 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc60006d7e0 0x7fc60006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:43.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.871+0000 7fc6167fc700 1 -- 172.21.15.47:0/3881613626 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc60c08ccf0 con 0x7fc6181027e0 2024-02-07T12:36:43.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.871+0000 7fc61dd98700 1 --2- 172.21.15.47:0/3881613626 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc60006d7e0 0x7fc60006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:43.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.871+0000 7fc61dd98700 1 --2- 172.21.15.47:0/3881613626 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc60006d7e0 0x7fc60006fc90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc610004f90 tx=0x7fc610009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:43.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:43.876+0000 7fc6167fc700 1 -- 172.21.15.47:0/3881613626 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc60c056490 con 0x7fc6181027e0 2024-02-07T12:36:44.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:44.163+0000 7fc61fffc700 1 -- 172.21.15.47:0/3881613626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc61811a390 con 0x7fc6181027e0 2024-02-07T12:36:44.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:44.164+0000 7fc6167fc700 1 -- 172.21.15.47:0/3881613626 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc60c059b50 con 0x7fc6181027e0 2024-02-07T12:36:44.166 INFO:teuthology.orchestra.run.smithi047.stdout:HEALTH_OK 2024-02-07T12:36:44.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:44.166+0000 7fc61fffc700 1 -- 172.21.15.47:0/3881613626 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc60006d7e0 msgr2=0x7fc60006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:44.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:44.166+0000 7fc61fffc700 1 --2- 172.21.15.47:0/3881613626 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc60006d7e0 0x7fc60006fc90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc610004f90 tx=0x7fc610009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:44.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:44.166+0000 7fc61fffc700 1 -- 172.21.15.47:0/3881613626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6181027e0 msgr2=0x7fc6181031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:44.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:44.166+0000 7fc61fffc700 1 --2- 172.21.15.47:0/3881613626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6181027e0 0x7fc6181031e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc60c002a50 tx=0x7fc60c004600 comp rx=0 tx=0).stop 2024-02-07T12:36:44.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:44.166+0000 7fc61fffc700 1 -- 172.21.15.47:0/3881613626 shutdown_connections 2024-02-07T12:36:44.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:44.166+0000 7fc61fffc700 1 --2- 172.21.15.47:0/3881613626 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc60006d7e0 0x7fc60006fc90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:44.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:44.166+0000 7fc61fffc700 1 --2- 172.21.15.47:0/3881613626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc618101e40 0x7fc618102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:44.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:44.166+0000 7fc61fffc700 1 --2- 172.21.15.47:0/3881613626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6181027e0 0x7fc6181031e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:44.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:44.166+0000 7fc61fffc700 1 -- 172.21.15.47:0/3881613626 >> 172.21.15.47:0/3881613626 conn(0x7fc618071d90 msgr2=0x7fc6180656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:44.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:44.166+0000 7fc61fffc700 1 -- 172.21.15.47:0/3881613626 shutdown_connections 2024-02-07T12:36:44.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:44.166+0000 7fc61fffc700 1 -- 172.21.15.47:0/3881613626 wait complete. 2024-02-07T12:36:44.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:44 smithi138 ceph-mon[82055]: pgmap v287: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:36:44.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:44 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3881613626' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:36:44.539 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:44 smithi047 ceph-mon[93224]: pgmap v287: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:36:44.539 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:44 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3881613626' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-07T12:36:44.930 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'ceph versions' 2024-02-07T12:36:45.198 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:36:46.344 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:46 smithi047 ceph-mon[93224]: pgmap v288: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:46.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:46 smithi138 ceph-mon[82055]: pgmap v288: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.942+0000 7fb1435a7700 1 -- 172.21.15.47:0/2317217608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13c0fb560 msgr2=0x7fb13c0fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.942+0000 7fb1435a7700 1 --2- 172.21.15.47:0/2317217608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13c0fb560 0x7fb13c0fb9d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb138004940 tx=0x7fb138009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.942+0000 7fb1435a7700 1 -- 172.21.15.47:0/2317217608 shutdown_connections 2024-02-07T12:36:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.942+0000 7fb1435a7700 1 --2- 172.21.15.47:0/2317217608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13c0fb560 0x7fb13c0fb9d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.942+0000 7fb1435a7700 1 --2- 172.21.15.47:0/2317217608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb13c102fe0 0x7fb13c1033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.942+0000 7fb1435a7700 1 -- 172.21.15.47:0/2317217608 >> 172.21.15.47:0/2317217608 conn(0x7fb13c071500 msgr2=0x7fb13c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.942+0000 7fb1435a7700 1 -- 172.21.15.47:0/2317217608 shutdown_connections 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.942+0000 7fb1435a7700 1 -- 172.21.15.47:0/2317217608 wait complete. 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.943+0000 7fb1435a7700 1 Processor -- start 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.943+0000 7fb1435a7700 1 -- start start 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.943+0000 7fb1435a7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb13c0fb560 0x7fb13c113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.943+0000 7fb1435a7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13c102fe0 0x7fb13c113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.943+0000 7fb1435a7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c114630 con 0x7fb13c102fe0 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.943+0000 7fb1435a7700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c10d960 con 0x7fb13c0fb560 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.943+0000 7fb140b42700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13c102fe0 0x7fb13c113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.943+0000 7fb140b42700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13c102fe0 0x7fb13c113fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41026/0 (socket says 172.21.15.47:41026) 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.943+0000 7fb140b42700 1 -- 172.21.15.47:0/1621806004 learned_addr learned my addr 172.21.15.47:0/1621806004 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.944+0000 7fb140b42700 1 -- 172.21.15.47:0/1621806004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb13c0fb560 msgr2=0x7fb13c113aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.944+0000 7fb141343700 1 --2- 172.21.15.47:0/1621806004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb13c0fb560 0x7fb13c113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.944+0000 7fb140b42700 1 --2- 172.21.15.47:0/1621806004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb13c0fb560 0x7fb13c113aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.944+0000 7fb140b42700 1 -- 172.21.15.47:0/1621806004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138005040 con 0x7fb13c102fe0 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.944+0000 7fb140b42700 1 --2- 172.21.15.47:0/1621806004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13c102fe0 0x7fb13c113fe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb138009100 tx=0x7fb138009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.944+0000 7fb131ffb700 1 -- 172.21.15.47:0/1621806004 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb13800e040 con 0x7fb13c102fe0 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.944+0000 7fb131ffb700 1 -- 172.21.15.47:0/1621806004 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb138004290 con 0x7fb13c102fe0 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.944+0000 7fb131ffb700 1 -- 172.21.15.47:0/1621806004 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb13801c630 con 0x7fb13c102fe0 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.944+0000 7fb1435a7700 1 -- 172.21.15.47:0/1621806004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c10dbe0 con 0x7fb13c102fe0 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.944+0000 7fb1435a7700 1 -- 172.21.15.47:0/1621806004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c10e120 con 0x7fb13c102fe0 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.945+0000 7fb1435a7700 1 -- 172.21.15.47:0/1621806004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13c1053c0 con 0x7fb13c102fe0 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.946+0000 7fb131ffb700 1 -- 172.21.15.47:0/1621806004 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb13800bbf0 con 0x7fb13c102fe0 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.946+0000 7fb131ffb700 1 --2- 172.21.15.47:0/1621806004 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb12806d7e0 0x7fb12806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.946+0000 7fb131ffb700 1 -- 172.21.15.47:0/1621806004 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb13808e1e0 con 0x7fb13c102fe0 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.946+0000 7fb141343700 1 --2- 172.21.15.47:0/1621806004 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb12806d7e0 0x7fb12806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.947+0000 7fb141343700 1 --2- 172.21.15.47:0/1621806004 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb12806d7e0 0x7fb12806fc90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0658f0 tx=0x7fb12c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:36:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:46.951+0000 7fb131ffb700 1 -- 172.21.15.47:0/1621806004 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb13805b5d0 con 0x7fb13c102fe0 2024-02-07T12:36:47.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:47.242+0000 7fb1435a7700 1 -- 172.21.15.47:0/1621806004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb13c10a130 con 0x7fb13c102fe0 2024-02-07T12:36:47.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:47.242+0000 7fb131ffb700 1 -- 172.21.15.47:0/1621806004 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fb13805b160 con 0x7fb13c102fe0 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 6 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 4 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:36:47.245 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 14 2024-02-07T12:36:47.246 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:36:47.246 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:36:47.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:47.245+0000 7fb1435a7700 1 -- 172.21.15.47:0/1621806004 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb12806d7e0 msgr2=0x7fb12806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:47.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:47.245+0000 7fb1435a7700 1 --2- 172.21.15.47:0/1621806004 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb12806d7e0 0x7fb12806fc90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0658f0 tx=0x7fb12c00b040 comp rx=0 tx=0).stop 2024-02-07T12:36:47.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:47.245+0000 7fb1435a7700 1 -- 172.21.15.47:0/1621806004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13c102fe0 msgr2=0x7fb13c113fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:36:47.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:47.245+0000 7fb1435a7700 1 --2- 172.21.15.47:0/1621806004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13c102fe0 0x7fb13c113fe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb138009100 tx=0x7fb138009e30 comp rx=0 tx=0).stop 2024-02-07T12:36:47.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:47.245+0000 7fb1435a7700 1 -- 172.21.15.47:0/1621806004 shutdown_connections 2024-02-07T12:36:47.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:47.245+0000 7fb1435a7700 1 --2- 172.21.15.47:0/1621806004 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fb12806d7e0 0x7fb12806fc90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:47.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:47.245+0000 7fb1435a7700 1 --2- 172.21.15.47:0/1621806004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb13c0fb560 0x7fb13c113aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:47.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:47.245+0000 7fb1435a7700 1 --2- 172.21.15.47:0/1621806004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13c102fe0 0x7fb13c113fe0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:36:47.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:47.245+0000 7fb1435a7700 1 -- 172.21.15.47:0/1621806004 >> 172.21.15.47:0/1621806004 conn(0x7fb13c071500 msgr2=0x7fb13c0fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:36:47.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:47.245+0000 7fb1435a7700 1 -- 172.21.15.47:0/1621806004 shutdown_connections 2024-02-07T12:36:47.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:36:47.245+0000 7fb1435a7700 1 -- 172.21.15.47:0/1621806004 wait complete. 2024-02-07T12:36:47.843 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-07T12:36:48.107 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:36:48.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:48 smithi138 ceph-mon[82055]: pgmap v289: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:36:48.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:48 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1621806004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:48.552 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:48 smithi047 ceph-mon[93224]: pgmap v289: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:36:48.552 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:48 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1621806004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:36:49.735 INFO:teuthology.orchestra.run.smithi047.stdout:wait for servicemap items w/ changing names to refresh 2024-02-07T12:36:50.452 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'sleep 60' 2024-02-07T12:36:50.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:50 smithi138 ceph-mon[82055]: pgmap v290: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:50.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:50 smithi047 ceph-mon[93224]: pgmap v290: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:36:52.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:52 smithi047 ceph-mon[93224]: pgmap v291: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:36:52.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:52 smithi138 ceph-mon[82055]: pgmap v291: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:36:54.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:54 smithi138 ceph-mon[82055]: pgmap v292: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:36:54.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:54 smithi047 ceph-mon[93224]: pgmap v292: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:36:56.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:56 smithi138 ceph-mon[82055]: pgmap v293: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:56.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:56 smithi047 ceph-mon[93224]: pgmap v293: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:36:57.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:36:57.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:36:58.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:36:58 smithi138 ceph-mon[82055]: pgmap v294: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:36:58.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:36:58 smithi047 ceph-mon[93224]: pgmap v294: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:37:00.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:00 smithi138 ceph-mon[82055]: pgmap v295: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:00.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:00 smithi047 ceph-mon[93224]: pgmap v295: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:02.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:02 smithi138 ceph-mon[82055]: pgmap v296: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:37:02.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:02 smithi047 ceph-mon[93224]: pgmap v296: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:37:04.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:04 smithi138 ceph-mon[82055]: pgmap v297: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:37:04.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:04 smithi047 ceph-mon[93224]: pgmap v297: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:37:06.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:06 smithi138 ceph-mon[82055]: pgmap v298: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:06 smithi047 ceph-mon[93224]: pgmap v298: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:08.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:08 smithi138 ceph-mon[82055]: pgmap v299: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:37:08.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:08 smithi047 ceph-mon[93224]: pgmap v299: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:37:10.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:10 smithi138 ceph-mon[82055]: pgmap v300: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:10.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:10 smithi047 ceph-mon[93224]: pgmap v300: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:11.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:11 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:37:11.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:11 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:37:12.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:12 smithi138 ceph-mon[82055]: pgmap v301: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:37:12.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:37:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:37:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:37:12.535 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:37:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:12 smithi047 ceph-mon[93224]: pgmap v301: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:37:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:37:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:37:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:37:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:37:14.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:14 smithi138 ceph-mon[82055]: pgmap v302: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:37:14.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:14 smithi047 ceph-mon[93224]: pgmap v302: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:37:16.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:16 smithi138 ceph-mon[82055]: pgmap v303: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:16.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:16 smithi047 ceph-mon[93224]: pgmap v303: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:18.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:18 smithi138 ceph-mon[82055]: pgmap v304: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:37:18.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:18 smithi047 ceph-mon[93224]: pgmap v304: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:37:20.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:20 smithi047 ceph-mon[93224]: pgmap v305: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:20.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:20 smithi138 ceph-mon[82055]: pgmap v305: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:22.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:22 smithi047 ceph-mon[93224]: pgmap v306: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:37:22.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:22 smithi138 ceph-mon[82055]: pgmap v306: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:37:24.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:24 smithi047 ceph-mon[93224]: pgmap v307: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:37:24.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:24 smithi138 ceph-mon[82055]: pgmap v307: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:37:26.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:26 smithi047 ceph-mon[93224]: pgmap v308: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:26.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:26 smithi138 ceph-mon[82055]: pgmap v308: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:27.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:27 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:37:27.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:27 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:37:28.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:28 smithi047 ceph-mon[93224]: pgmap v309: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:37:28.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:28 smithi138 ceph-mon[82055]: pgmap v309: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:37:30.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:30 smithi047 ceph-mon[93224]: pgmap v310: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-07T12:37:30.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:30 smithi138 ceph-mon[82055]: pgmap v310: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-07T12:37:32.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:32 smithi047 ceph-mon[93224]: pgmap v311: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-07T12:37:32.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:32 smithi138 ceph-mon[82055]: pgmap v311: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-07T12:37:34.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:34 smithi047 ceph-mon[93224]: pgmap v312: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:37:34.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:34 smithi138 ceph-mon[82055]: pgmap v312: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-07T12:37:36.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:36 smithi047 ceph-mon[93224]: pgmap v313: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-07T12:37:36.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:36 smithi138 ceph-mon[82055]: pgmap v313: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-07T12:37:38.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:38 smithi047 ceph-mon[93224]: pgmap v314: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:37:38.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:38 smithi138 ceph-mon[82055]: pgmap v314: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:37:40.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:40 smithi047 ceph-mon[93224]: pgmap v315: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:40.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:40 smithi138 ceph-mon[82055]: pgmap v315: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:42 smithi047 ceph-mon[93224]: pgmap v316: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:37:42.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:42 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:37:42.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:42 smithi138 ceph-mon[82055]: pgmap v316: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:37:42.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:42 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:37:44.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:44 smithi047 ceph-mon[93224]: pgmap v317: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:37:44.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:44 smithi138 ceph-mon[82055]: pgmap v317: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:37:46.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:46 smithi047 ceph-mon[93224]: pgmap v318: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:46.586 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:46 smithi138 ceph-mon[82055]: pgmap v318: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:48.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:48 smithi138 ceph-mon[82055]: pgmap v319: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:37:48.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:48 smithi047 ceph-mon[93224]: pgmap v319: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:37:50.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:50 smithi138 ceph-mon[82055]: pgmap v320: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:50.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:50 smithi047 ceph-mon[93224]: pgmap v320: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:52.754 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:52 smithi047 ceph-mon[93224]: pgmap v321: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:37:52.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:52 smithi138 ceph-mon[82055]: pgmap v321: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:37:53.069 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'ceph orch ps' 2024-02-07T12:37:53.341 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:37:54.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:54 smithi047 ceph-mon[93224]: pgmap v322: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:37:54.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:54 smithi138 ceph-mon[82055]: pgmap v322: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:37:54.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.988+0000 7f8f31430700 1 -- 172.21.15.47:0/1988904618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f2c1038f0 msgr2=0x7f8f2c0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.988+0000 7f8f31430700 1 --2- 172.21.15.47:0/1988904618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f2c1038f0 0x7f8f2c0fcf60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8f20004940 tx=0x7f8f20009e30 comp rx=0 tx=0).stop 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.989+0000 7f8f31430700 1 -- 172.21.15.47:0/1988904618 shutdown_connections 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.989+0000 7f8f31430700 1 --2- 172.21.15.47:0/1988904618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f2c1038f0 0x7f8f2c0fcf60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.989+0000 7f8f31430700 1 --2- 172.21.15.47:0/1988904618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f2c102f50 0x7f8f2c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.989+0000 7f8f31430700 1 -- 172.21.15.47:0/1988904618 >> 172.21.15.47:0/1988904618 conn(0x7f8f2c0f8ae0 msgr2=0x7f8f2c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.989+0000 7f8f31430700 1 -- 172.21.15.47:0/1988904618 shutdown_connections 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.989+0000 7f8f31430700 1 -- 172.21.15.47:0/1988904618 wait complete. 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.989+0000 7f8f31430700 1 Processor -- start 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.989+0000 7f8f31430700 1 -- start start 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.990+0000 7f8f31430700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f2c102f50 0x7f8f2c113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.990+0000 7f8f31430700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f2c1038f0 0x7f8f2c114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.990+0000 7f8f31430700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c1146e0 con 0x7f8f2c102f50 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.990+0000 7f8f31430700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c10d980 con 0x7f8f2c1038f0 2024-02-07T12:37:54.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.990+0000 7f8f2affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f2c102f50 0x7f8f2c113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.990+0000 7f8f2affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f2c102f50 0x7f8f2c113ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53010/0 (socket says 172.21.15.47:53010) 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.990+0000 7f8f2affd700 1 -- 172.21.15.47:0/2979463778 learned_addr learned my addr 172.21.15.47:0/2979463778 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.990+0000 7f8f2a7fc700 1 --2- 172.21.15.47:0/2979463778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f2c1038f0 0x7f8f2c114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.990+0000 7f8f2affd700 1 -- 172.21.15.47:0/2979463778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f2c1038f0 msgr2=0x7f8f2c114000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.990+0000 7f8f2affd700 1 --2- 172.21.15.47:0/2979463778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f2c1038f0 0x7f8f2c114000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.990+0000 7f8f2affd700 1 -- 172.21.15.47:0/2979463778 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20005040 con 0x7f8f2c102f50 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.990+0000 7f8f2affd700 1 --2- 172.21.15.47:0/2979463778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f2c102f50 0x7f8f2c113ac0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00b790 tx=0x7f8f1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.991+0000 7f8f137fe700 1 -- 172.21.15.47:0/2979463778 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f1c00f6f0 con 0x7f8f2c102f50 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.991+0000 7f8f31430700 1 -- 172.21.15.47:0/2979463778 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c10dc60 con 0x7f8f2c102f50 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.991+0000 7f8f137fe700 1 -- 172.21.15.47:0/2979463778 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f1c00fd20 con 0x7f8f2c102f50 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.991+0000 7f8f137fe700 1 -- 172.21.15.47:0/2979463778 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f1c0103a0 con 0x7f8f2c102f50 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.991+0000 7f8f31430700 1 -- 172.21.15.47:0/2979463778 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c10e170 con 0x7f8f2c102f50 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.991+0000 7f8f31430700 1 -- 172.21.15.47:0/2979463778 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c0fc6e0 con 0x7f8f2c102f50 2024-02-07T12:37:55.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.992+0000 7f8f137fe700 1 -- 172.21.15.47:0/2979463778 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8f1c011400 con 0x7f8f2c102f50 2024-02-07T12:37:55.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.992+0000 7f8f137fe700 1 --2- 172.21.15.47:0/2979463778 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8f1406d7e0 0x7f8f1406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:37:55.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.993+0000 7f8f137fe700 1 -- 172.21.15.47:0/2979463778 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8f1c08cd80 con 0x7f8f2c102f50 2024-02-07T12:37:55.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.993+0000 7f8f2a7fc700 1 --2- 172.21.15.47:0/2979463778 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8f1406d7e0 0x7f8f1406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:37:55.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.993+0000 7f8f2a7fc700 1 --2- 172.21.15.47:0/2979463778 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8f1406d7e0 0x7f8f1406fc90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c10ecb0 tx=0x7f8f20009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:37:55.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:54.998+0000 7f8f137fe700 1 -- 172.21.15.47:0/2979463778 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8f1c05a0d0 con 0x7f8f2c102f50 2024-02-07T12:37:55.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:55.210+0000 7f8f31430700 1 -- 172.21.15.47:0/2979463778 --> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f2c10f110 con 0x7f8f1406d7e0 2024-02-07T12:37:55.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:55.220+0000 7f8f137fe700 1 -- 172.21.15.47:0/2979463778 <== mgr.34104 v2:172.21.15.47:6800/4013730885 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8f2c10f110 con 0x7f8f1406d7e0 2024-02-07T12:37:55.223 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-07T12:37:55.223 INFO:teuthology.orchestra.run.smithi047.stdout:alertmanager.smithi047 smithi047 *:9093,9094 running (2m) 109s ago 20m 15.2M - 0.25.0 c8568f914cd2 df2841092eff 2024-02-07T12:37:55.223 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi047 smithi047 running (8m) 109s ago 20m 6660k - 19.0.0-1252-g44458cce 79957b372307 677c05118c1e 2024-02-07T12:37:55.224 INFO:teuthology.orchestra.run.smithi047.stdout:crash.smithi138 smithi138 running (8m) 2m ago 19m 6665k - 19.0.0-1252-g44458cce 79957b372307 3a182fc3ffe0 2024-02-07T12:37:55.224 INFO:teuthology.orchestra.run.smithi047.stdout:grafana.smithi047 smithi047 *:3000 running (115s) 109s ago 20m 55.4M - 9.4.12 a0ea5e3c46d9 cbcf3b4acf93 2024-02-07T12:37:55.224 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.jsgfge smithi047 running (3m) 109s ago 14m 16.5M - 19.0.0-1252-g44458cce 79957b372307 fbda6b9f9953 2024-02-07T12:37:55.224 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi047.lagmef smithi047 running (4m) 109s ago 14m 67.3M - 19.0.0-1252-g44458cce 79957b372307 055df3be8762 2024-02-07T12:37:55.224 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.axpdsx smithi138 running (3m) 2m ago 14m 14.0M - 19.0.0-1252-g44458cce 79957b372307 742dc60bfa13 2024-02-07T12:37:55.224 INFO:teuthology.orchestra.run.smithi047.stdout:mds.cephfs.smithi138.jhsygn smithi138 running (3m) 2m ago 14m 67.1M - 19.0.0-1252-g44458cce 79957b372307 502afeac2e7d 2024-02-07T12:37:55.224 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi047.zhgnrm smithi047 *:8443,9283,8765 running (10m) 109s ago 21m 512M - 19.0.0-1252-g44458cce 79957b372307 0a006b038d87 2024-02-07T12:37:55.224 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.smithi138.fiugmj smithi138 *:8443,9283,8765 running (9m) 2m ago 19m 453M - 19.0.0-1252-g44458cce 79957b372307 ddc0a28a5359 2024-02-07T12:37:55.224 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi047 smithi047 running (9m) 109s ago 21m 59.2M 2048M 19.0.0-1252-g44458cce 79957b372307 70d584f39f5c 2024-02-07T12:37:55.224 INFO:teuthology.orchestra.run.smithi047.stdout:mon.smithi138 smithi138 running (9m) 2m ago 19m 43.4M 2048M 19.0.0-1252-g44458cce 79957b372307 14527280e47e 2024-02-07T12:37:55.224 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi047 smithi047 *:9100 running (2m) 109s ago 20m 9663k - 1.5.0 0da6a335fe13 199e0ea3a587 2024-02-07T12:37:55.224 INFO:teuthology.orchestra.run.smithi047.stdout:node-exporter.smithi138 smithi138 *:9100 running (2m) 2m ago 19m 3623k - 1.5.0 0da6a335fe13 f9f13e3bf225 2024-02-07T12:37:55.224 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (8m) 109s ago 18m 102M 1559M 19.0.0-1252-g44458cce 79957b372307 e26f04059460 2024-02-07T12:37:55.225 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi047 running (7m) 109s ago 18m 113M 1559M 19.0.0-1252-g44458cce 79957b372307 0f2b0eea74d7 2024-02-07T12:37:55.225 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi047 running (6m) 109s ago 17m 91.3M 1559M 19.0.0-1252-g44458cce 79957b372307 0b8c78346346 2024-02-07T12:37:55.225 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi138 running (6m) 2m ago 17m 129M 2581M 19.0.0-1252-g44458cce 79957b372307 dea45db021db 2024-02-07T12:37:55.225 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi138 running (5m) 2m ago 16m 100M 2581M 19.0.0-1252-g44458cce 79957b372307 3161c1dfe6f5 2024-02-07T12:37:55.225 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi138 running (5m) 2m ago 16m 93.9M 2581M 19.0.0-1252-g44458cce 79957b372307 c9504c7cfe7c 2024-02-07T12:37:55.225 INFO:teuthology.orchestra.run.smithi047.stdout:prometheus.smithi047 smithi047 *:9095 running (2m) 109s ago 19m 46.3M - 2.43.0 a07b618ecd1d be4740743bdd 2024-02-07T12:37:55.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:55.222+0000 7f8f31430700 1 -- 172.21.15.47:0/2979463778 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8f1406d7e0 msgr2=0x7f8f1406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:37:55.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:55.222+0000 7f8f31430700 1 --2- 172.21.15.47:0/2979463778 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8f1406d7e0 0x7f8f1406fc90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c10ecb0 tx=0x7f8f20009e30 comp rx=0 tx=0).stop 2024-02-07T12:37:55.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:55.222+0000 7f8f31430700 1 -- 172.21.15.47:0/2979463778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f2c102f50 msgr2=0x7f8f2c113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:37:55.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:55.222+0000 7f8f31430700 1 --2- 172.21.15.47:0/2979463778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f2c102f50 0x7f8f2c113ac0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00b790 tx=0x7f8f1c009250 comp rx=0 tx=0).stop 2024-02-07T12:37:55.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:55.222+0000 7f8f31430700 1 -- 172.21.15.47:0/2979463778 shutdown_connections 2024-02-07T12:37:55.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:55.222+0000 7f8f31430700 1 --2- 172.21.15.47:0/2979463778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f2c102f50 0x7f8f2c113ac0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:37:55.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:55.222+0000 7f8f31430700 1 --2- 172.21.15.47:0/2979463778 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8f1406d7e0 0x7f8f1406fc90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:37:55.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:55.222+0000 7f8f31430700 1 --2- 172.21.15.47:0/2979463778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f2c1038f0 0x7f8f2c114000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:37:55.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:55.222+0000 7f8f31430700 1 -- 172.21.15.47:0/2979463778 >> 172.21.15.47:0/2979463778 conn(0x7f8f2c0f8ae0 msgr2=0x7f8f2c0fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:37:55.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:55.222+0000 7f8f31430700 1 -- 172.21.15.47:0/2979463778 shutdown_connections 2024-02-07T12:37:55.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:55.222+0000 7f8f31430700 1 -- 172.21.15.47:0/2979463778 wait complete. 2024-02-07T12:37:55.872 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'ceph versions' 2024-02-07T12:37:56.138 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:37:56.523 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:56 smithi047 ceph-mon[93224]: pgmap v323: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:56.523 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:56 smithi047 ceph-mon[93224]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:37:56.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:56 smithi138 ceph-mon[82055]: pgmap v323: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:37:56.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:56 smithi138 ceph-mon[82055]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-07T12:37:57.517 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:57 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:37:57.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.737+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3627189512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10d8102f50 msgr2=0x7f10d8103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:37:57.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.737+0000 7f10dcd1c700 1 --2- 172.21.15.47:0/3627189512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10d8102f50 0x7f10d8103320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f10c8004940 tx=0x7f10c8009e30 comp rx=0 tx=0).stop 2024-02-07T12:37:57.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.737+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3627189512 shutdown_connections 2024-02-07T12:37:57.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.737+0000 7f10dcd1c700 1 --2- 172.21.15.47:0/3627189512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10d81038f0 0x7f10d80fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:37:57.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.737+0000 7f10dcd1c700 1 --2- 172.21.15.47:0/3627189512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10d8102f50 0x7f10d8103320 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:37:57.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.737+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3627189512 >> 172.21.15.47:0/3627189512 conn(0x7f10d80f8ae0 msgr2=0x7f10d80faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.737+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3627189512 shutdown_connections 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.737+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3627189512 wait complete. 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.737+0000 7f10dcd1c700 1 Processor -- start 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10dcd1c700 1 -- start start 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10dcd1c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10d8102f50 0x7f10d8070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10dcd1c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10d81038f0 0x7f10d80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10dcd1c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8070dd0 con 0x7f10d8102f50 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10dcd1c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8070f40 con 0x7f10d81038f0 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10d659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10d8102f50 0x7f10d8070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10d659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10d8102f50 0x7f10d8070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53026/0 (socket says 172.21.15.47:53026) 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10d659c700 1 -- 172.21.15.47:0/3458284860 learned_addr learned my addr 172.21.15.47:0/3458284860 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10d5d9b700 1 --2- 172.21.15.47:0/3458284860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10d81038f0 0x7f10d80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10d659c700 1 -- 172.21.15.47:0/3458284860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10d81038f0 msgr2=0x7f10d80707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:37:57.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10d659c700 1 --2- 172.21.15.47:0/3458284860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10d81038f0 0x7f10d80707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:37:57.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10d659c700 1 -- 172.21.15.47:0/3458284860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8005040 con 0x7f10d8102f50 2024-02-07T12:37:57.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10d659c700 1 --2- 172.21.15.47:0/3458284860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10d8102f50 0x7f10d8070290 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f10c8000c00 tx=0x7f10c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:37:57.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.738+0000 7f10c6ffd700 1 -- 172.21.15.47:0/3458284860 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c8021070 con 0x7f10d8102f50 2024-02-07T12:37:57.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.739+0000 7f10c6ffd700 1 -- 172.21.15.47:0/3458284860 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10c8013d00 con 0x7f10d8102f50 2024-02-07T12:37:57.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.739+0000 7f10c6ffd700 1 -- 172.21.15.47:0/3458284860 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c800e070 con 0x7f10d8102f50 2024-02-07T12:37:57.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.739+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3458284860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d8119c30 con 0x7f10d8102f50 2024-02-07T12:37:57.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.739+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3458284860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d811a030 con 0x7f10d8102f50 2024-02-07T12:37:57.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.739+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3458284860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d80fc6e0 con 0x7f10d8102f50 2024-02-07T12:37:57.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.740+0000 7f10c6ffd700 1 -- 172.21.15.47:0/3458284860 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f10c801caf0 con 0x7f10d8102f50 2024-02-07T12:37:57.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.740+0000 7f10c6ffd700 1 --2- 172.21.15.47:0/3458284860 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f10c006d7f0 0x7f10c006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:37:57.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.740+0000 7f10c6ffd700 1 -- 172.21.15.47:0/3458284860 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f10c808e2f0 con 0x7f10d8102f50 2024-02-07T12:37:57.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.741+0000 7f10d5d9b700 1 --2- 172.21.15.47:0/3458284860 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f10c006d7f0 0x7f10c006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:37:57.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.741+0000 7f10d5d9b700 1 --2- 172.21.15.47:0/3458284860 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f10c006d7f0 0x7f10c006fca0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f10d8071c90 tx=0x7f10cc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:37:57.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:57.746+0000 7f10c6ffd700 1 -- 172.21.15.47:0/3458284860 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f10c8057bb0 con 0x7f10d8102f50 2024-02-07T12:37:57.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:57 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:37:58.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:58.035+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3458284860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f10d811a270 con 0x7f10d8102f50 2024-02-07T12:37:58.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:58.035+0000 7f10c6ffd700 1 -- 172.21.15.47:0/3458284860 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f10c805b270 con 0x7f10d8102f50 2024-02-07T12:37:58.038 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-02-07T12:37:58.038 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": { 2024-02-07T12:37:58.038 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:37:58.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:37:58.038 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": { 2024-02-07T12:37:58.038 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 2 2024-02-07T12:37:58.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:37:58.038 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": { 2024-02-07T12:37:58.038 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 6 2024-02-07T12:37:58.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:37:58.038 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-02-07T12:37:58.038 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 4 2024-02-07T12:37:58.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-02-07T12:37:58.039 INFO:teuthology.orchestra.run.smithi047.stdout: "overall": { 2024-02-07T12:37:58.039 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)": 14 2024-02-07T12:37:58.039 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-02-07T12:37:58.039 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-02-07T12:37:58.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:58.037+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3458284860 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f10c006d7f0 msgr2=0x7f10c006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:37:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:58.037+0000 7f10dcd1c700 1 --2- 172.21.15.47:0/3458284860 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f10c006d7f0 0x7f10c006fca0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f10d8071c90 tx=0x7f10cc00b040 comp rx=0 tx=0).stop 2024-02-07T12:37:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:58.037+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3458284860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10d8102f50 msgr2=0x7f10d8070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:37:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:58.037+0000 7f10dcd1c700 1 --2- 172.21.15.47:0/3458284860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10d8102f50 0x7f10d8070290 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f10c8000c00 tx=0x7f10c8009e30 comp rx=0 tx=0).stop 2024-02-07T12:37:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:58.037+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3458284860 shutdown_connections 2024-02-07T12:37:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:58.037+0000 7f10dcd1c700 1 --2- 172.21.15.47:0/3458284860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10d8102f50 0x7f10d8070290 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:37:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:58.037+0000 7f10dcd1c700 1 --2- 172.21.15.47:0/3458284860 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f10c006d7f0 0x7f10c006fca0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:37:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:58.037+0000 7f10dcd1c700 1 --2- 172.21.15.47:0/3458284860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10d81038f0 0x7f10d80707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:37:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:58.037+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3458284860 >> 172.21.15.47:0/3458284860 conn(0x7f10d80f8ae0 msgr2=0x7f10d80fa400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:37:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:58.037+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3458284860 shutdown_connections 2024-02-07T12:37:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:37:58.037+0000 7f10dcd1c700 1 -- 172.21.15.47:0/3458284860 wait complete. 2024-02-07T12:37:58.618 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:58 smithi047 ceph-mon[93224]: pgmap v324: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:37:58.618 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:37:58 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3458284860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:37:58.647 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-07T12:37:58.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:58 smithi138 ceph-mon[82055]: pgmap v324: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:37:58.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:37:58 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3458284860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:37:58.909 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:38:00.459 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:00 smithi047 ceph-mon[93224]: pgmap v325: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:38:00.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.743+0000 7faa4a055700 1 -- 172.21.15.47:0/4078464423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa441038f0 msgr2=0x7faa440fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:00.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.744+0000 7faa4a055700 1 --2- 172.21.15.47:0/4078464423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa441038f0 0x7faa440fcf60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa38004940 tx=0x7faa38009e30 comp rx=0 tx=0).stop 2024-02-07T12:38:00.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.744+0000 7faa4a055700 1 -- 172.21.15.47:0/4078464423 shutdown_connections 2024-02-07T12:38:00.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.744+0000 7faa4a055700 1 --2- 172.21.15.47:0/4078464423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa441038f0 0x7faa440fcf60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:00.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.744+0000 7faa4a055700 1 --2- 172.21.15.47:0/4078464423 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa44102f50 0x7faa44103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:00.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.744+0000 7faa4a055700 1 -- 172.21.15.47:0/4078464423 >> 172.21.15.47:0/4078464423 conn(0x7faa440f8ae0 msgr2=0x7faa440faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:00.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.744+0000 7faa4a055700 1 -- 172.21.15.47:0/4078464423 shutdown_connections 2024-02-07T12:38:00.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.744+0000 7faa4a055700 1 -- 172.21.15.47:0/4078464423 wait complete. 2024-02-07T12:38:00.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.744+0000 7faa4a055700 1 Processor -- start 2024-02-07T12:38:00.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.744+0000 7faa4a055700 1 -- start start 2024-02-07T12:38:00.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa4a055700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa44102f50 0x7faa44070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:00.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa4a055700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa441038f0 0x7faa440707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:00.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa4a055700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa44070dd0 con 0x7faa44102f50 2024-02-07T12:38:00.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa4a055700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa44070f40 con 0x7faa441038f0 2024-02-07T12:38:00.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa44102f50 0x7faa44070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:00.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa44102f50 0x7faa44070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56162/0 (socket says 172.21.15.47:56162) 2024-02-07T12:38:00.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa437fe700 1 -- 172.21.15.47:0/145632587 learned_addr learned my addr 172.21.15.47:0/145632587 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:00.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa42ffd700 1 --2- 172.21.15.47:0/145632587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa441038f0 0x7faa440707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:00.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa437fe700 1 -- 172.21.15.47:0/145632587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa441038f0 msgr2=0x7faa440707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:00.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa437fe700 1 --2- 172.21.15.47:0/145632587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa441038f0 0x7faa440707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:00.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa437fe700 1 -- 172.21.15.47:0/145632587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38005040 con 0x7faa44102f50 2024-02-07T12:38:00.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa437fe700 1 --2- 172.21.15.47:0/145632587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa44102f50 0x7faa44070290 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa34002a50 tx=0x7faa340046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:00.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa2bfff700 1 -- 172.21.15.47:0/145632587 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa34007cc0 con 0x7faa44102f50 2024-02-07T12:38:00.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa4a055700 1 -- 172.21.15.47:0/145632587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa44119cf0 con 0x7faa44102f50 2024-02-07T12:38:00.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa2bfff700 1 -- 172.21.15.47:0/145632587 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa3400f040 con 0x7faa44102f50 2024-02-07T12:38:00.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa2bfff700 1 -- 172.21.15.47:0/145632587 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa3400db70 con 0x7faa44102f50 2024-02-07T12:38:00.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.745+0000 7faa4a055700 1 -- 172.21.15.47:0/145632587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4411a1d0 con 0x7faa44102f50 2024-02-07T12:38:00.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.747+0000 7faa4a055700 1 -- 172.21.15.47:0/145632587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa44105420 con 0x7faa44102f50 2024-02-07T12:38:00.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.747+0000 7faa2bfff700 1 -- 172.21.15.47:0/145632587 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7faa3400dd10 con 0x7faa44102f50 2024-02-07T12:38:00.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.747+0000 7faa2bfff700 1 --2- 172.21.15.47:0/145632587 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7faa2c06d7e0 0x7faa2c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:00.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.747+0000 7faa2bfff700 1 -- 172.21.15.47:0/145632587 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7faa3408c6b0 con 0x7faa44102f50 2024-02-07T12:38:00.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.747+0000 7faa42ffd700 1 --2- 172.21.15.47:0/145632587 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7faa2c06d7e0 0x7faa2c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:00.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.748+0000 7faa42ffd700 1 --2- 172.21.15.47:0/145632587 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7faa2c06d7e0 0x7faa2c06fc90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faa44071c90 tx=0x7faa38009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:00.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:00.752+0000 7faa2bfff700 1 -- 172.21.15.47:0/145632587 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faa34055e50 con 0x7faa44102f50 2024-02-07T12:38:00.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:00 smithi138 ceph-mon[82055]: pgmap v325: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:38:01.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:01.039+0000 7faa4a055700 1 -- 172.21.15.47:0/145632587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faa440719d0 con 0x7faa44102f50 2024-02-07T12:38:01.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:01.039+0000 7faa2bfff700 1 -- 172.21.15.47:0/145632587 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7faa34059510 con 0x7faa44102f50 2024-02-07T12:38:01.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:01.041+0000 7faa4a055700 1 -- 172.21.15.47:0/145632587 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7faa2c06d7e0 msgr2=0x7faa2c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:01.041+0000 7faa4a055700 1 --2- 172.21.15.47:0/145632587 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7faa2c06d7e0 0x7faa2c06fc90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faa44071c90 tx=0x7faa38009e30 comp rx=0 tx=0).stop 2024-02-07T12:38:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:01.041+0000 7faa4a055700 1 -- 172.21.15.47:0/145632587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa44102f50 msgr2=0x7faa44070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:01.041+0000 7faa4a055700 1 --2- 172.21.15.47:0/145632587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa44102f50 0x7faa44070290 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa34002a50 tx=0x7faa340046b0 comp rx=0 tx=0).stop 2024-02-07T12:38:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:01.041+0000 7faa4a055700 1 -- 172.21.15.47:0/145632587 shutdown_connections 2024-02-07T12:38:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:01.041+0000 7faa4a055700 1 --2- 172.21.15.47:0/145632587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa44102f50 0x7faa44070290 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:01.041+0000 7faa4a055700 1 --2- 172.21.15.47:0/145632587 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7faa2c06d7e0 0x7faa2c06fc90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:01.041+0000 7faa4a055700 1 --2- 172.21.15.47:0/145632587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa441038f0 0x7faa440707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:01.041+0000 7faa4a055700 1 -- 172.21.15.47:0/145632587 >> 172.21.15.47:0/145632587 conn(0x7faa440f8ae0 msgr2=0x7faa440fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:01.042+0000 7faa4a055700 1 -- 172.21.15.47:0/145632587 shutdown_connections 2024-02-07T12:38:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:01.042+0000 7faa4a055700 1 -- 172.21.15.47:0/145632587 wait complete. 2024-02-07T12:38:01.053 INFO:teuthology.orchestra.run.smithi047.stdout:true 2024-02-07T12:38:01.625 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:01 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/145632587' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:38:01.650 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -e sha1=44458ccedb18241cc2e17f10cdab3d1385399261 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-07T12:38:01.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:01 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/145632587' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:38:01.914 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:38:02.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:02 smithi047 ceph-mon[93224]: pgmap v326: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:38:02.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:02 smithi138 ceph-mon[82055]: pgmap v326: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:38:03.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.576+0000 7fd649f13700 1 -- 172.21.15.47:0/2736692774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6441038f0 msgr2=0x7fd6440fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:03.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.576+0000 7fd649f13700 1 --2- 172.21.15.47:0/2736692774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6441038f0 0x7fd6440fcf60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd638004940 tx=0x7fd638009e30 comp rx=0 tx=0).stop 2024-02-07T12:38:03.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.576+0000 7fd649f13700 1 -- 172.21.15.47:0/2736692774 shutdown_connections 2024-02-07T12:38:03.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.576+0000 7fd649f13700 1 --2- 172.21.15.47:0/2736692774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6441038f0 0x7fd6440fcf60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:03.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.576+0000 7fd649f13700 1 --2- 172.21.15.47:0/2736692774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd644102f50 0x7fd644103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:03.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.576+0000 7fd649f13700 1 -- 172.21.15.47:0/2736692774 >> 172.21.15.47:0/2736692774 conn(0x7fd6440f8ae0 msgr2=0x7fd6440faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:03.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.576+0000 7fd649f13700 1 -- 172.21.15.47:0/2736692774 shutdown_connections 2024-02-07T12:38:03.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.577+0000 7fd649f13700 1 -- 172.21.15.47:0/2736692774 wait complete. 2024-02-07T12:38:03.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.577+0000 7fd649f13700 1 Processor -- start 2024-02-07T12:38:03.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.577+0000 7fd649f13700 1 -- start start 2024-02-07T12:38:03.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.577+0000 7fd649f13700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd644102f50 0x7fd644113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:03.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.577+0000 7fd649f13700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6441038f0 0x7fd644114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:03.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.577+0000 7fd649f13700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6441146e0 con 0x7fd644102f50 2024-02-07T12:38:03.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.577+0000 7fd649f13700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64410d980 con 0x7fd6441038f0 2024-02-07T12:38:03.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.577+0000 7fd6437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd644102f50 0x7fd644113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:03.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.578+0000 7fd6437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd644102f50 0x7fd644113ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56176/0 (socket says 172.21.15.47:56176) 2024-02-07T12:38:03.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.578+0000 7fd6437fe700 1 -- 172.21.15.47:0/4108156449 learned_addr learned my addr 172.21.15.47:0/4108156449 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:03.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.578+0000 7fd642ffd700 1 --2- 172.21.15.47:0/4108156449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6441038f0 0x7fd644114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:03.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.578+0000 7fd6437fe700 1 -- 172.21.15.47:0/4108156449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6441038f0 msgr2=0x7fd644114000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:03.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.578+0000 7fd6437fe700 1 --2- 172.21.15.47:0/4108156449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6441038f0 0x7fd644114000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:03.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.578+0000 7fd6437fe700 1 -- 172.21.15.47:0/4108156449 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd638005040 con 0x7fd644102f50 2024-02-07T12:38:03.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.578+0000 7fd6437fe700 1 --2- 172.21.15.47:0/4108156449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd644102f50 0x7fd644113ac0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd63400b790 tx=0x7fd634009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:03.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.578+0000 7fd62bfff700 1 -- 172.21.15.47:0/4108156449 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd63400f770 con 0x7fd644102f50 2024-02-07T12:38:03.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.578+0000 7fd62bfff700 1 -- 172.21.15.47:0/4108156449 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd63400fda0 con 0x7fd644102f50 2024-02-07T12:38:03.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.578+0000 7fd649f13700 1 -- 172.21.15.47:0/4108156449 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64410dc60 con 0x7fd644102f50 2024-02-07T12:38:03.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.578+0000 7fd62bfff700 1 -- 172.21.15.47:0/4108156449 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd63400d310 con 0x7fd644102f50 2024-02-07T12:38:03.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.578+0000 7fd649f13700 1 -- 172.21.15.47:0/4108156449 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64410e1a0 con 0x7fd644102f50 2024-02-07T12:38:03.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.579+0000 7fd649f13700 1 -- 172.21.15.47:0/4108156449 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6440fc6e0 con 0x7fd644102f50 2024-02-07T12:38:03.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.580+0000 7fd62bfff700 1 -- 172.21.15.47:0/4108156449 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd634010420 con 0x7fd644102f50 2024-02-07T12:38:03.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.580+0000 7fd62bfff700 1 --2- 172.21.15.47:0/4108156449 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd62c06d7e0 0x7fd62c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:03.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.580+0000 7fd62bfff700 1 -- 172.21.15.47:0/4108156449 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd63408cfd0 con 0x7fd644102f50 2024-02-07T12:38:03.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.580+0000 7fd642ffd700 1 --2- 172.21.15.47:0/4108156449 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd62c06d7e0 0x7fd62c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:03.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.581+0000 7fd642ffd700 1 --2- 172.21.15.47:0/4108156449 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd62c06d7e0 0x7fd62c06fc90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd64410f2f0 tx=0x7fd638009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:03.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.585+0000 7fd62bfff700 1 -- 172.21.15.47:0/4108156449 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd63405a320 con 0x7fd644102f50 2024-02-07T12:38:03.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.872+0000 7fd649f13700 1 -- 172.21.15.47:0/4108156449 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd64410f0a0 con 0x7fd644102f50 2024-02-07T12:38:03.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.872+0000 7fd62bfff700 1 -- 172.21.15.47:0/4108156449 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fd634059eb0 con 0x7fd644102f50 2024-02-07T12:38:03.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.874+0000 7fd649f13700 1 -- 172.21.15.47:0/4108156449 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd62c06d7e0 msgr2=0x7fd62c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:03.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.874+0000 7fd649f13700 1 --2- 172.21.15.47:0/4108156449 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd62c06d7e0 0x7fd62c06fc90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd64410f2f0 tx=0x7fd638009e30 comp rx=0 tx=0).stop 2024-02-07T12:38:03.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.874+0000 7fd649f13700 1 -- 172.21.15.47:0/4108156449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd644102f50 msgr2=0x7fd644113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:03.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.874+0000 7fd649f13700 1 --2- 172.21.15.47:0/4108156449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd644102f50 0x7fd644113ac0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd63400b790 tx=0x7fd634009250 comp rx=0 tx=0).stop 2024-02-07T12:38:03.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.874+0000 7fd649f13700 1 -- 172.21.15.47:0/4108156449 shutdown_connections 2024-02-07T12:38:03.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.874+0000 7fd649f13700 1 --2- 172.21.15.47:0/4108156449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd644102f50 0x7fd644113ac0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:03.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.874+0000 7fd649f13700 1 --2- 172.21.15.47:0/4108156449 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fd62c06d7e0 0x7fd62c06fc90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:03.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.874+0000 7fd649f13700 1 --2- 172.21.15.47:0/4108156449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6441038f0 0x7fd644114000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:03.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.874+0000 7fd649f13700 1 -- 172.21.15.47:0/4108156449 >> 172.21.15.47:0/4108156449 conn(0x7fd6440f8ae0 msgr2=0x7fd6440fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:03.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.875+0000 7fd649f13700 1 -- 172.21.15.47:0/4108156449 shutdown_connections 2024-02-07T12:38:03.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:03.875+0000 7fd649f13700 1 -- 172.21.15.47:0/4108156449 wait complete. 2024-02-07T12:38:03.887 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph version 19.0.0-1252-g44458cce (44458ccedb18241cc2e17f10cdab3d1385399261) squid (dev)" 2024-02-07T12:38:04.524 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:04 smithi047 ceph-mon[93224]: pgmap v327: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:38:04.524 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:04 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/4108156449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:38:04.551 DEBUG:teuthology.parallel:result is None 2024-02-07T12:38:04.551 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-07T12:38:04.563 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:38:04.563 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-07T12:38:04.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:04 smithi138 ceph-mon[82055]: pgmap v327: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:38:04.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:04 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/4108156449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-07T12:38:04.827 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/mon.smithi047/config 2024-02-07T12:38:06.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.395+0000 7f6961361700 1 -- 172.21.15.47:0/188993530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f695c1038f0 msgr2=0x7f695c0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:06.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.395+0000 7f6961361700 1 --2- 172.21.15.47:0/188993530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f695c1038f0 0x7f695c0fcf60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6950004940 tx=0x7f6950009e30 comp rx=0 tx=0).stop 2024-02-07T12:38:06.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.395+0000 7f6961361700 1 -- 172.21.15.47:0/188993530 shutdown_connections 2024-02-07T12:38:06.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.395+0000 7f6961361700 1 --2- 172.21.15.47:0/188993530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f695c1038f0 0x7f695c0fcf60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:06.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.395+0000 7f6961361700 1 --2- 172.21.15.47:0/188993530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f695c102f50 0x7f695c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:06.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.395+0000 7f6961361700 1 -- 172.21.15.47:0/188993530 >> 172.21.15.47:0/188993530 conn(0x7f695c0f8ae0 msgr2=0x7f695c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:06.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.395+0000 7f6961361700 1 -- 172.21.15.47:0/188993530 shutdown_connections 2024-02-07T12:38:06.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.395+0000 7f6961361700 1 -- 172.21.15.47:0/188993530 wait complete. 2024-02-07T12:38:06.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.396+0000 7f6961361700 1 Processor -- start 2024-02-07T12:38:06.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.396+0000 7f6961361700 1 -- start start 2024-02-07T12:38:06.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.396+0000 7f6961361700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f695c102f50 0x7f695c113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.396+0000 7f6961361700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f695c1038f0 0x7f695c113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.396+0000 7f6961361700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c114590 con 0x7f695c102f50 2024-02-07T12:38:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.396+0000 7f6961361700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c10d8c0 con 0x7f695c1038f0 2024-02-07T12:38:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.396+0000 7f695affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f695c102f50 0x7f695c113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.396+0000 7f695affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f695c102f50 0x7f695c113a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56180/0 (socket says 172.21.15.47:56180) 2024-02-07T12:38:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.396+0000 7f695affd700 1 -- 172.21.15.47:0/3328496940 learned_addr learned my addr 172.21.15.47:0/3328496940 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.396+0000 7f695a7fc700 1 --2- 172.21.15.47:0/3328496940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f695c1038f0 0x7f695c113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.397+0000 7f695affd700 1 -- 172.21.15.47:0/3328496940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f695c1038f0 msgr2=0x7f695c113f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.397+0000 7f695affd700 1 --2- 172.21.15.47:0/3328496940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f695c1038f0 0x7f695c113f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.397+0000 7f695affd700 1 -- 172.21.15.47:0/3328496940 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950005040 con 0x7f695c102f50 2024-02-07T12:38:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.397+0000 7f695a7fc700 1 --2- 172.21.15.47:0/3328496940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f695c1038f0 0x7f695c113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:38:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.397+0000 7f695affd700 1 --2- 172.21.15.47:0/3328496940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f695c102f50 0x7f695c113a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f694c00eb40 tx=0x7f694c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.397+0000 7f69437fe700 1 -- 172.21.15.47:0/3328496940 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f694c007cc0 con 0x7f695c102f50 2024-02-07T12:38:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.397+0000 7f6961361700 1 -- 172.21.15.47:0/3328496940 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c10db40 con 0x7f695c102f50 2024-02-07T12:38:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.397+0000 7f69437fe700 1 -- 172.21.15.47:0/3328496940 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f694c00f040 con 0x7f695c102f50 2024-02-07T12:38:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.397+0000 7f69437fe700 1 -- 172.21.15.47:0/3328496940 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f694c009620 con 0x7f695c102f50 2024-02-07T12:38:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.397+0000 7f6961361700 1 -- 172.21.15.47:0/3328496940 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c10e050 con 0x7f695c102f50 2024-02-07T12:38:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.398+0000 7f6961361700 1 -- 172.21.15.47:0/3328496940 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c105420 con 0x7f695c102f50 2024-02-07T12:38:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.398+0000 7f69437fe700 1 -- 172.21.15.47:0/3328496940 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f694c009780 con 0x7f695c102f50 2024-02-07T12:38:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.399+0000 7f69437fe700 1 --2- 172.21.15.47:0/3328496940 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f694406d7e0 0x7f694406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.399+0000 7f69437fe700 1 -- 172.21.15.47:0/3328496940 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f694c08cc20 con 0x7f695c102f50 2024-02-07T12:38:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.399+0000 7f695a7fc700 1 --2- 172.21.15.47:0/3328496940 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f694406d7e0 0x7f694406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.399+0000 7f695a7fc700 1 --2- 172.21.15.47:0/3328496940 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f694406d7e0 0x7f694406fc90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6950009b30 tx=0x7f6950009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:06.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.404+0000 7f69437fe700 1 -- 172.21.15.47:0/3328496940 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f694c059fa0 con 0x7f695c102f50 2024-02-07T12:38:06.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:06 smithi047 ceph-mon[93224]: pgmap v328: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:38:06.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.665+0000 7f6961361700 1 -- 172.21.15.47:0/3328496940 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f695c04bed0 con 0x7f695c102f50 2024-02-07T12:38:06.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.666+0000 7f69437fe700 1 -- 172.21.15.47:0/3328496940 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 48 v48) v1 ==== 76+0+1895 (secure 0 0 0) 0x7f694c059b30 con 0x7f695c102f50 2024-02-07T12:38:06.669 INFO:teuthology.orchestra.run.smithi047.stdout:e48 2024-02-07T12:38:06.669 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-07T12:38:06.669 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-07T12:38:06.669 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-02-07T12:38:06.669 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:06.669 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-02-07T12:38:06.670 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-02-07T12:38:06.670 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 48 2024-02-07T12:38:06.670 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-07T12:38:06.670 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-02-07T12:22:54.002022+0000 2024-02-07T12:38:06.670 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-02-07T12:34:57.641208+0000 2024-02-07T12:38:06.670 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-02-07T12:38:06.670 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-02-07T12:38:06.670 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 60 2024-02-07T12:38:06.671 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-02-07T12:38:06.671 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-02-07T12:38:06.671 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-02-07T12:38:06.671 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-02-07T12:38:06.671 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-02-07T12:38:06.671 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 84 2024-02-07T12:38:06.671 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-07T12:38:06.671 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 2 2024-02-07T12:38:06.671 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1 2024-02-07T12:38:06.671 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=34428,1=34460} 2024-02-07T12:38:06.672 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-02-07T12:38:06.672 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-02-07T12:38:06.672 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-02-07T12:38:06.672 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-02-07T12:38:06.672 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-02-07T12:38:06.672 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-02-07T12:38:06.672 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-02-07T12:38:06.672 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-02-07T12:38:06.672 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 1 2024-02-07T12:38:06.673 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.lagmef{0:34428} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.47:6826/2142859688,v1:172.21.15.47:6827/2142859688] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:38:06.673 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.jhsygn{0:44365} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6825/3547121337,v1:172.21.15.138:6826/3547121337] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:38:06.673 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi047.jsgfge{1:34460} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.47:6828/3723006072,v1:172.21.15.47:6829/3723006072] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:38:06.673 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.cephfs.smithi138.axpdsx{1:44369} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6824/2689114398,v1:172.21.15.138:6827/2689114398] compat {c=[1],r=[1],i=[fff]}] 2024-02-07T12:38:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:06.673 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:06.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.669+0000 7f6961361700 1 -- 172.21.15.47:0/3328496940 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f694406d7e0 msgr2=0x7f694406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:06.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.669+0000 7f6961361700 1 --2- 172.21.15.47:0/3328496940 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f694406d7e0 0x7f694406fc90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6950009b30 tx=0x7f6950009e30 comp rx=0 tx=0).stop 2024-02-07T12:38:06.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.669+0000 7f6961361700 1 -- 172.21.15.47:0/3328496940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f695c102f50 msgr2=0x7f695c113a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:06.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.669+0000 7f6961361700 1 --2- 172.21.15.47:0/3328496940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f695c102f50 0x7f695c113a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f694c00eb40 tx=0x7f694c00b040 comp rx=0 tx=0).stop 2024-02-07T12:38:06.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.669+0000 7f6961361700 1 -- 172.21.15.47:0/3328496940 shutdown_connections 2024-02-07T12:38:06.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.669+0000 7f6961361700 1 --2- 172.21.15.47:0/3328496940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f695c102f50 0x7f695c113a00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:06.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.669+0000 7f6961361700 1 --2- 172.21.15.47:0/3328496940 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f694406d7e0 0x7f694406fc90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:06.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.669+0000 7f6961361700 1 --2- 172.21.15.47:0/3328496940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f695c1038f0 0x7f695c113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:06.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.669+0000 7f6961361700 1 -- 172.21.15.47:0/3328496940 >> 172.21.15.47:0/3328496940 conn(0x7f695c0f8ae0 msgr2=0x7f695c0fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:06.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.669+0000 7f6961361700 1 -- 172.21.15.47:0/3328496940 shutdown_connections 2024-02-07T12:38:06.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:06.669+0000 7f6961361700 1 -- 172.21.15.47:0/3328496940 wait complete. 2024-02-07T12:38:06.676 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 48 2024-02-07T12:38:06.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:06 smithi138 ceph-mon[82055]: pgmap v328: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:38:07.316 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-02-07T12:38:07.327 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-07T12:38:07.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.430+0000 7f55e246e640 1 -- 172.21.15.47:0/3436915127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55dc0fb460 msgr2=0x7f55dc0fb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.430+0000 7f55e246e640 1 --2- 172.21.15.47:0/3436915127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55dc0fb460 0x7f55dc0fb8d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0048d0 tx=0x7f55cc009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.430+0000 7f55e246e640 1 -- 172.21.15.47:0/3436915127 shutdown_connections 2024-02-07T12:38:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.430+0000 7f55e246e640 1 --2- 172.21.15.47:0/3436915127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55dc0fb460 0x7f55dc0fb8d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.430+0000 7f55e246e640 1 --2- 172.21.15.47:0/3436915127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55dc1014a0 0x7f55dc101870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.430+0000 7f55e246e640 1 -- 172.21.15.47:0/3436915127 >> 172.21.15.47:0/3436915127 conn(0x7f55dc0f6fe0 msgr2=0x7f55dc0f93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.430+0000 7f55e246e640 1 -- 172.21.15.47:0/3436915127 shutdown_connections 2024-02-07T12:38:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.430+0000 7f55e246e640 1 -- 172.21.15.47:0/3436915127 wait complete. 2024-02-07T12:38:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.431+0000 7f55e246e640 1 Processor -- start 2024-02-07T12:38:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.431+0000 7f55e246e640 1 -- start start 2024-02-07T12:38:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.431+0000 7f55e246e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55dc0fb460 0x7f55dc112df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.431+0000 7f55e246e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55dc1014a0 0x7f55dc113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.431+0000 7f55e246e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc113930 con 0x7f55dc0fb460 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.431+0000 7f55e246e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc10cec0 con 0x7f55dc1014a0 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.431+0000 7f55dbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55dc0fb460 0x7f55dc112df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.431+0000 7f55dbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55dc0fb460 0x7f55dc112df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56196/0 (socket says 172.21.15.47:56196) 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.431+0000 7f55dbfff640 1 -- 172.21.15.47:0/1871311368 learned_addr learned my addr 172.21.15.47:0/1871311368 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.432+0000 7f55db7fe640 1 --2- 172.21.15.47:0/1871311368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55dc1014a0 0x7f55dc113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.432+0000 7f55dbfff640 1 -- 172.21.15.47:0/1871311368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55dc1014a0 msgr2=0x7f55dc113330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.432+0000 7f55dbfff640 1 --2- 172.21.15.47:0/1871311368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55dc1014a0 0x7f55dc113330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.432+0000 7f55dbfff640 1 -- 172.21.15.47:0/1871311368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc005040 con 0x7f55dc0fb460 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.432+0000 7f55db7fe640 1 --2- 172.21.15.47:0/1871311368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55dc1014a0 0x7f55dc113330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.432+0000 7f55dbfff640 1 --2- 172.21.15.47:0/1871311368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55dc0fb460 0x7f55dc112df0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f55c4002a50 tx=0x7f55c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.432+0000 7f55d8ff9640 1 -- 172.21.15.47:0/1871311368 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c4007c30 con 0x7f55dc0fb460 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.432+0000 7f55d8ff9640 1 -- 172.21.15.47:0/1871311368 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55c400f040 con 0x7f55dc0fb460 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.432+0000 7f55e246e640 1 -- 172.21.15.47:0/1871311368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55dc10d1a0 con 0x7f55dc0fb460 2024-02-07T12:38:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.432+0000 7f55d8ff9640 1 -- 172.21.15.47:0/1871311368 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c400db50 con 0x7f55dc0fb460 2024-02-07T12:38:07.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.432+0000 7f55e246e640 1 -- 172.21.15.47:0/1871311368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55dc10d690 con 0x7f55dc0fb460 2024-02-07T12:38:07.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.433+0000 7f55e246e640 1 -- 172.21.15.47:0/1871311368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55dc064480 con 0x7f55dc0fb460 2024-02-07T12:38:07.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.433+0000 7f55d8ff9640 1 -- 172.21.15.47:0/1871311368 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f55c401c400 con 0x7f55dc0fb460 2024-02-07T12:38:07.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.434+0000 7f55d8ff9640 1 --2- 172.21.15.47:0/1871311368 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f55c806d750 0x7f55c806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:07.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.434+0000 7f55db7fe640 1 --2- 172.21.15.47:0/1871311368 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f55c806d750 0x7f55c806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:07.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.434+0000 7f55d8ff9640 1 -- 172.21.15.47:0/1871311368 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f55c408c860 con 0x7f55dc0fb460 2024-02-07T12:38:07.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.434+0000 7f55db7fe640 1 --2- 172.21.15.47:0/1871311368 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f55c806d750 0x7f55c806fc00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f55dc10e000 tx=0x7f55cc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:07.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.439+0000 7f55d8ff9640 1 -- 172.21.15.47:0/1871311368 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f55c4056000 con 0x7f55dc0fb460 2024-02-07T12:38:07.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:07 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3328496940' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:38:07.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.622+0000 7f55e246e640 1 -- 172.21.15.47:0/1871311368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55dc1048c0 con 0x7f55dc0fb460 2024-02-07T12:38:07.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.623+0000 7f55d8ff9640 1 -- 172.21.15.47:0/1871311368 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16793 (secure 0 0 0) 0x7f55c40596c0 con 0x7f55dc0fb460 2024-02-07T12:38:07.626 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:07.626 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":86,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","created":"2024-02-07T12:16:03.682077+0000","modified":"2024-02-07T12:34:43.948607+0000","last_up_change":"2024-02-07T12:32:47.656919+0000","last_in_change":"2024-02-07T12:21:14.657544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-07T12:20:21.191001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-07T12:22:52.656534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-07T12:22:53.237906+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b37bbc00-7240-422a-977b-c7a9687ce87f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1557469797},{"type":"v1","addr":"172.21.15.47:6803","nonce":1557469797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1557469797},{"type":"v1","addr":"172.21.15.47:6805","nonce":1557469797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1557469797},{"type":"v1","addr":"172.21.15.47:6809","nonce":1557469797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1557469797},{"type":"v1","addr":"172.21.15.47:6807","nonce":1557469797}]},"public_addr":"172.21.15.47:6803/1557469797","cluster_addr":"172.21.15.47:6805/1557469797","heartbeat_back_addr":"172.21.15.47:6809/1557469797","heartbeat_front_addr":"172.21.15.47:6807/1557469797","state":["exists","up"]},{"osd":1,"uuid":"e6a42328-96ea-40de-987d-4edec38a4b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3632128293},{"type":"v1","addr":"172.21.15.47:6811","nonce":3632128293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3632128293},{"type":"v1","addr":"172.21.15.47:6813","nonce":3632128293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3632128293},{"type":"v1","addr":"172.21.15.47:6817","nonce":3632128293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3632128293},{"type":"v1","addr":"172.21.15.47:6815","nonce":3632128293}]},"public_addr":"172.21.15.47:6811/3632128293","cluster_addr":"172.21.15.47:6813/3632128293","heartbeat_back_addr":"172.21.15.47:6817/3632128293","heartbeat_front_addr":"172.21.15.47:6815/3632128293","state":["exists","up"]},{"osd":2,"uuid":"c8925cb3-0da0-4f01-90c3-1b6fb6e15331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4120407081},{"type":"v1","addr":"172.21.15.47:6819","nonce":4120407081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4120407081},{"type":"v1","addr":"172.21.15.47:6821","nonce":4120407081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4120407081},{"type":"v1","addr":"172.21.15.47:6825","nonce":4120407081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4120407081},{"type":"v1","addr":"172.21.15.47:6823","nonce":4120407081}]},"public_addr":"172.21.15.47:6819/4120407081","cluster_addr":"172.21.15.47:6821/4120407081","heartbeat_back_addr":"172.21.15.47:6825/4120407081","heartbeat_front_addr":"172.21.15.47:6823/4120407081","state":["exists","up"]},{"osd":3,"uuid":"47130a0a-e27f-4129-abbb-4bef9b460ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1616507148},{"type":"v1","addr":"172.21.15.138:6801","nonce":1616507148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1616507148},{"type":"v1","addr":"172.21.15.138:6803","nonce":1616507148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1616507148},{"type":"v1","addr":"172.21.15.138:6807","nonce":1616507148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1616507148},{"type":"v1","addr":"172.21.15.138:6805","nonce":1616507148}]},"public_addr":"172.21.15.138:6801/1616507148","cluster_addr":"172.21.15.138:6803/1616507148","heartbeat_back_addr":"172.21.15.138:6807/1616507148","heartbeat_front_addr":"172.21.15.138:6805/1616507148","state":["exists","up"]},{"osd":4,"uuid":"103459b7-4883-4248-a64d-21c396324237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3739765492},{"type":"v1","addr":"172.21.15.138:6809","nonce":3739765492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3739765492},{"type":"v1","addr":"172.21.15.138:6811","nonce":3739765492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3739765492},{"type":"v1","addr":"172.21.15.138:6815","nonce":3739765492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3739765492},{"type":"v1","addr":"172.21.15.138:6813","nonce":3739765492}]},"public_addr":"172.21.15.138:6809/3739765492","cluster_addr":"172.21.15.138:6811/3739765492","heartbeat_back_addr":"172.21.15.138:6815/3739765492","heartbeat_front_addr":"172.21.15.138:6813/3739765492","state":["exists","up"]},{"osd":5,"uuid":"e8acb2ff-d0f5-4daf-82ee-6c4fddf1580d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2664957218},{"type":"v1","addr":"172.21.15.138:6817","nonce":2664957218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2664957218},{"type":"v1","addr":"172.21.15.138:6819","nonce":2664957218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2664957218},{"type":"v1","addr":"172.21.15.138:6823","nonce":2664957218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2664957218},{"type":"v1","addr":"172.21.15.138:6821","nonce":2664957218}]},"public_addr":"172.21.15.138:6817/2664957218","cluster_addr":"172.21.15.138:6819/2664957218","heartbeat_back_addr":"172.21.15.138:6823/2664957218","heartbeat_front_addr":"172.21.15.138:6821/2664957218","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:19.518708+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:48.503474+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:17.112205+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:41.349671+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:06.347737+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:31.635560+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6829/3387805936":"2024-02-08T12:34:03.468583+0000","172.21.15.47:6828/3387805936":"2024-02-08T12:34:03.468583+0000","172.21.15.47:6826/3633114050":"2024-02-08T12:33:37.430656+0000","172.21.15.138:6828/764872550":"2024-02-08T12:27:38.822990+0000","172.21.15.138:0/2878954883":"2024-02-08T12:27:38.822990+0000","172.21.15.47:6801/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.138:6829/764872550":"2024-02-08T12:27:38.822990+0000","172.21.15.47:6827/3633114050":"2024-02-08T12:33:37.430656+0000","172.21.15.47:6800/3304641630":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/926338889":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/1918664197":"2024-02-08T12:17:02.806879+0000","172.21.15.138:6825/2917636817":"2024-02-08T12:23:08.319154+0000","172.21.15.47:0/179765176":"2024-02-08T12:25:32.261341+0000","172.21.15.47:6801/1750591204":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/454079597":"2024-02-08T12:18:06.849658+0000","172.21.15.47:6801/3304641630":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/3361862950":"2024-02-08T12:17:02.806879+0000","172.21.15.47:0/15111993":"2024-02-08T12:28:26.591613+0000","172.21.15.47:6800/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.138:0/476867914":"2024-02-08T12:27:38.822990+0000","172.21.15.138:0/2680943285":"2024-02-08T12:27:38.822990+0000","172.21.15.47:6801/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/2651788466":"2024-02-08T12:25:32.261341+0000","172.21.15.47:0/3354208208":"2024-02-08T12:16:30.972957+0000","172.21.15.138:0/722341446":"2024-02-08T12:27:38.822990+0000","172.21.15.47:0/3586302931":"2024-02-08T12:17:02.806879+0000","172.21.15.138:6824/2917636817":"2024-02-08T12:23:08.319154+0000","172.21.15.47:0/3413297119":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/2768201708":"2024-02-08T12:16:30.972957+0000","172.21.15.47:6801/3356603129":"2024-02-08T12:25:32.261341+0000","172.21.15.47:6800/3356603129":"2024-02-08T12:25:32.261341+0000","172.21.15.47:0/1415322117":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/2757370866":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/3785090733":"2024-02-08T12:25:32.261341+0000","172.21.15.47:0/1926405874":"2024-02-08T12:25:32.261341+0000","172.21.15.47:0/2678703901":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/831612230":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/2545215659":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/520417272":"2024-02-08T12:28:26.591613+0000","172.21.15.47:6800/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6800/1750591204":"2024-02-08T12:28:26.591613+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-07T12:38:07.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.625+0000 7f55e246e640 1 -- 172.21.15.47:0/1871311368 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f55c806d750 msgr2=0x7f55c806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.625+0000 7f55e246e640 1 --2- 172.21.15.47:0/1871311368 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f55c806d750 0x7f55c806fc00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f55dc10e000 tx=0x7f55cc009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.625+0000 7f55e246e640 1 -- 172.21.15.47:0/1871311368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55dc0fb460 msgr2=0x7f55dc112df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.625+0000 7f55e246e640 1 --2- 172.21.15.47:0/1871311368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55dc0fb460 0x7f55dc112df0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f55c4002a50 tx=0x7f55c4004600 comp rx=0 tx=0).stop 2024-02-07T12:38:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.625+0000 7f55e246e640 1 -- 172.21.15.47:0/1871311368 shutdown_connections 2024-02-07T12:38:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.625+0000 7f55e246e640 1 --2- 172.21.15.47:0/1871311368 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f55c806d750 0x7f55c806fc00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.625+0000 7f55e246e640 1 --2- 172.21.15.47:0/1871311368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55dc1014a0 0x7f55dc113330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.625+0000 7f55e246e640 1 --2- 172.21.15.47:0/1871311368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55dc0fb460 0x7f55dc112df0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.625+0000 7f55e246e640 1 -- 172.21.15.47:0/1871311368 >> 172.21.15.47:0/1871311368 conn(0x7f55dc0f6fe0 msgr2=0x7f55dc065990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.625+0000 7f55e246e640 1 -- 172.21.15.47:0/1871311368 shutdown_connections 2024-02-07T12:38:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.625+0000 7f55e246e640 1 -- 172.21.15.47:0/1871311368 wait complete. 2024-02-07T12:38:07.639 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-07T12:20:21.191001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-07T12:22:52.656534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-07T12:22:53.237906+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-07T12:38:07.639 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-07T12:38:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.738+0000 7fccce59d640 1 -- 172.21.15.47:0/3481941289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc8101270 msgr2=0x7fccc8101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.738+0000 7fccce59d640 1 --2- 172.21.15.47:0/3481941289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc8101270 0x7fccc8101640 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fccb80048d0 tx=0x7fccb8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.738+0000 7fccce59d640 1 -- 172.21.15.47:0/3481941289 shutdown_connections 2024-02-07T12:38:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.738+0000 7fccce59d640 1 --2- 172.21.15.47:0/3481941289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccc8101c10 0x7fccc80fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.738+0000 7fccce59d640 1 --2- 172.21.15.47:0/3481941289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc8101270 0x7fccc8101640 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.738+0000 7fccce59d640 1 -- 172.21.15.47:0/3481941289 >> 172.21.15.47:0/3481941289 conn(0x7fccc80f6de0 msgr2=0x7fccc80f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.738+0000 7fccce59d640 1 -- 172.21.15.47:0/3481941289 shutdown_connections 2024-02-07T12:38:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.738+0000 7fccce59d640 1 -- 172.21.15.47:0/3481941289 wait complete. 2024-02-07T12:38:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.738+0000 7fccce59d640 1 Processor -- start 2024-02-07T12:38:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.738+0000 7fccce59d640 1 -- start start 2024-02-07T12:38:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccce59d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccc8101270 0x7fccc810dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccce59d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc8101c10 0x7fccc810e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccce59d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc810e7b0 con 0x7fccc8101c10 2024-02-07T12:38:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccce59d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc810e920 con 0x7fccc8101270 2024-02-07T12:38:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccc77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc8101c10 0x7fccc810e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccc77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc8101c10 0x7fccc810e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56206/0 (socket says 172.21.15.47:56206) 2024-02-07T12:38:07.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccc77fe640 1 -- 172.21.15.47:0/3256901665 learned_addr learned my addr 172.21.15.47:0/3256901665 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:07.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccc7fff640 1 --2- 172.21.15.47:0/3256901665 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccc8101270 0x7fccc810dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:07.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccc77fe640 1 -- 172.21.15.47:0/3256901665 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccc8101270 msgr2=0x7fccc810dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:07.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccc77fe640 1 --2- 172.21.15.47:0/3256901665 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccc8101270 0x7fccc810dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccc77fe640 1 -- 172.21.15.47:0/3256901665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb8005040 con 0x7fccc8101c10 2024-02-07T12:38:07.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccc77fe640 1 --2- 172.21.15.47:0/3256901665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc8101c10 0x7fccc810e270 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00eb70 tx=0x7fccbc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:07.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccc4ff9640 1 -- 172.21.15.47:0/3256901665 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccbc007c30 con 0x7fccc8101c10 2024-02-07T12:38:07.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccce59d640 1 -- 172.21.15.47:0/3256901665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc810eba0 con 0x7fccc8101c10 2024-02-07T12:38:07.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccc4ff9640 1 -- 172.21.15.47:0/3256901665 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fccbc00f040 con 0x7fccc8101c10 2024-02-07T12:38:07.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.739+0000 7fccc4ff9640 1 -- 172.21.15.47:0/3256901665 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccbc0095b0 con 0x7fccc8101c10 2024-02-07T12:38:07.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.740+0000 7fccce59d640 1 -- 172.21.15.47:0/3256901665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc8117080 con 0x7fccc8101c10 2024-02-07T12:38:07.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.741+0000 7fccce59d640 1 -- 172.21.15.47:0/3256901665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc8064480 con 0x7fccc8101c10 2024-02-07T12:38:07.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.741+0000 7fccc4ff9640 1 -- 172.21.15.47:0/3256901665 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fccbc009730 con 0x7fccc8101c10 2024-02-07T12:38:07.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.741+0000 7fccc4ff9640 1 --2- 172.21.15.47:0/3256901665 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fccb006d750 0x7fccb006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:07.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.742+0000 7fccc4ff9640 1 -- 172.21.15.47:0/3256901665 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fccbc08cac0 con 0x7fccc8101c10 2024-02-07T12:38:07.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.742+0000 7fccc7fff640 1 --2- 172.21.15.47:0/3256901665 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fccb006d750 0x7fccb006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:07.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.742+0000 7fccc7fff640 1 --2- 172.21.15.47:0/3256901665 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fccb006d750 0x7fccb006fc00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fccb8000c00 tx=0x7fccb8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:07.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.746+0000 7fccc4ff9640 1 -- 172.21.15.47:0/3256901665 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fccbc056310 con 0x7fccc8101c10 2024-02-07T12:38:07.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:07 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3328496940' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-07T12:38:07.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.928+0000 7fccce59d640 1 -- 172.21.15.47:0/3256901665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fccc8065c80 con 0x7fccc8101c10 2024-02-07T12:38:07.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.929+0000 7fccc4ff9640 1 -- 172.21.15.47:0/3256901665 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fccbc0599d0 con 0x7fccc8101c10 2024-02-07T12:38:07.931 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-02-07T12:38:07.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.931+0000 7fccce59d640 1 -- 172.21.15.47:0/3256901665 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fccb006d750 msgr2=0x7fccb006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:07.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.931+0000 7fccce59d640 1 --2- 172.21.15.47:0/3256901665 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fccb006d750 0x7fccb006fc00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fccb8000c00 tx=0x7fccb8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.931+0000 7fccce59d640 1 -- 172.21.15.47:0/3256901665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc8101c10 msgr2=0x7fccc810e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:07.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.931+0000 7fccce59d640 1 --2- 172.21.15.47:0/3256901665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc8101c10 0x7fccc810e270 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00eb70 tx=0x7fccbc00b040 comp rx=0 tx=0).stop 2024-02-07T12:38:07.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.931+0000 7fccce59d640 1 -- 172.21.15.47:0/3256901665 shutdown_connections 2024-02-07T12:38:07.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.931+0000 7fccce59d640 1 --2- 172.21.15.47:0/3256901665 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fccb006d750 0x7fccb006fc00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.931+0000 7fccce59d640 1 --2- 172.21.15.47:0/3256901665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc8101c10 0x7fccc810e270 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.931+0000 7fccce59d640 1 --2- 172.21.15.47:0/3256901665 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccc8101270 0x7fccc810dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:07.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.931+0000 7fccce59d640 1 -- 172.21.15.47:0/3256901665 >> 172.21.15.47:0/3256901665 conn(0x7fccc80f6de0 msgr2=0x7fccc80f8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:07.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.931+0000 7fccce59d640 1 -- 172.21.15.47:0/3256901665 shutdown_connections 2024-02-07T12:38:07.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:07.931+0000 7fccce59d640 1 -- 172.21.15.47:0/3256901665 wait complete. 2024-02-07T12:38:07.944 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-07T12:38:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.042+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/4121544564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14101290 msgr2=0x7f9f14101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.042+0000 7f9f1aa2e640 1 --2- 172.21.15.47:0/4121544564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14101290 0x7f9f14101660 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9f040048d0 tx=0x7f9f04009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.042+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/4121544564 shutdown_connections 2024-02-07T12:38:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.042+0000 7f9f1aa2e640 1 --2- 172.21.15.47:0/4121544564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f14101c30 0x7f9f140fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.042+0000 7f9f1aa2e640 1 --2- 172.21.15.47:0/4121544564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14101290 0x7f9f14101660 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.042+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/4121544564 >> 172.21.15.47:0/4121544564 conn(0x7f9f140f6e80 msgr2=0x7f9f140f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.042+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/4121544564 shutdown_connections 2024-02-07T12:38:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.042+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/4121544564 wait complete. 2024-02-07T12:38:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.043+0000 7f9f1aa2e640 1 Processor -- start 2024-02-07T12:38:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.043+0000 7f9f1aa2e640 1 -- start start 2024-02-07T12:38:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.043+0000 7f9f1aa2e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14101290 0x7f9f14111b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.043+0000 7f9f1aa2e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f14101c30 0x7f9f141120c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.043+0000 7f9f1aa2e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f14112750 con 0x7f9f14101290 2024-02-07T12:38:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.043+0000 7f9f1aa2e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1410bc90 con 0x7f9f14101c30 2024-02-07T12:38:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.044+0000 7f9f13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14101290 0x7f9f14111b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.044+0000 7f9f13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14101290 0x7f9f14111b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56228/0 (socket says 172.21.15.47:56228) 2024-02-07T12:38:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.044+0000 7f9f13fff640 1 -- 172.21.15.47:0/1907669676 learned_addr learned my addr 172.21.15.47:0/1907669676 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.044+0000 7f9f137fe640 1 --2- 172.21.15.47:0/1907669676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f14101c30 0x7f9f141120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.044+0000 7f9f13fff640 1 -- 172.21.15.47:0/1907669676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f14101c30 msgr2=0x7f9f141120c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.044+0000 7f9f13fff640 1 --2- 172.21.15.47:0/1907669676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f14101c30 0x7f9f141120c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.044+0000 7f9f13fff640 1 -- 172.21.15.47:0/1907669676 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f04005040 con 0x7f9f14101290 2024-02-07T12:38:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.044+0000 7f9f13fff640 1 --2- 172.21.15.47:0/1907669676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14101290 0x7f9f14111b80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9f04031720 tx=0x7f9f04009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.044+0000 7f9f10ff9640 1 -- 172.21.15.47:0/1907669676 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f040094c0 con 0x7f9f14101290 2024-02-07T12:38:08.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.044+0000 7f9f10ff9640 1 -- 172.21.15.47:0/1907669676 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f04009620 con 0x7f9f14101290 2024-02-07T12:38:08.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.044+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/1907669676 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1410bf10 con 0x7f9f14101290 2024-02-07T12:38:08.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.044+0000 7f9f10ff9640 1 -- 172.21.15.47:0/1907669676 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f0403b640 con 0x7f9f14101290 2024-02-07T12:38:08.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.044+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/1907669676 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1410c430 con 0x7f9f14101290 2024-02-07T12:38:08.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.045+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/1907669676 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f140637a0 con 0x7f9f14101290 2024-02-07T12:38:08.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.046+0000 7f9f10ff9640 1 -- 172.21.15.47:0/1907669676 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9f0402f070 con 0x7f9f14101290 2024-02-07T12:38:08.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.046+0000 7f9f10ff9640 1 --2- 172.21.15.47:0/1907669676 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9efc06d750 0x7f9efc06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:08.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.046+0000 7f9f137fe640 1 --2- 172.21.15.47:0/1907669676 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9efc06d750 0x7f9efc06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:08.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.046+0000 7f9f10ff9640 1 -- 172.21.15.47:0/1907669676 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9f040af3e0 con 0x7f9f14101290 2024-02-07T12:38:08.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.047+0000 7f9f137fe640 1 --2- 172.21.15.47:0/1907669676 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9efc06d750 0x7f9efc06fc00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9f1410d480 tx=0x7f9f08009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:08.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.051+0000 7f9f10ff9640 1 -- 172.21.15.47:0/1907669676 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9f04078b80 con 0x7f9f14101290 2024-02-07T12:38:08.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.231+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/1907669676 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f9f14108450 con 0x7f9f14101290 2024-02-07T12:38:08.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.232+0000 7f9f10ff9640 1 -- 172.21.15.47:0/1907669676 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v86) v1 ==== 107+0+11 (secure 0 0 0) 0x7f9f0407c240 con 0x7f9f14101290 2024-02-07T12:38:08.234 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-02-07T12:38:08.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.233+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/1907669676 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9efc06d750 msgr2=0x7f9efc06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.233+0000 7f9f1aa2e640 1 --2- 172.21.15.47:0/1907669676 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9efc06d750 0x7f9efc06fc00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9f1410d480 tx=0x7f9f08009120 comp rx=0 tx=0).stop 2024-02-07T12:38:08.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.233+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/1907669676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14101290 msgr2=0x7f9f14111b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.233+0000 7f9f1aa2e640 1 --2- 172.21.15.47:0/1907669676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14101290 0x7f9f14111b80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9f04031720 tx=0x7f9f04009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.234+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/1907669676 shutdown_connections 2024-02-07T12:38:08.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.234+0000 7f9f1aa2e640 1 --2- 172.21.15.47:0/1907669676 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9efc06d750 0x7f9efc06fc00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.234+0000 7f9f1aa2e640 1 --2- 172.21.15.47:0/1907669676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f14101c30 0x7f9f141120c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.234+0000 7f9f1aa2e640 1 --2- 172.21.15.47:0/1907669676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14101290 0x7f9f14111b80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.234+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/1907669676 >> 172.21.15.47:0/1907669676 conn(0x7f9f140f6e80 msgr2=0x7f9f140f8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:08.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.234+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/1907669676 shutdown_connections 2024-02-07T12:38:08.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.234+0000 7f9f1aa2e640 1 -- 172.21.15.47:0/1907669676 wait complete. 2024-02-07T12:38:08.247 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-07T12:38:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.346+0000 7f5c0acae640 1 -- 172.21.15.47:0/705923946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c04101be0 msgr2=0x7f5c040fb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.346+0000 7f5c0acae640 1 --2- 172.21.15.47:0/705923946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c04101be0 0x7f5c040fb270 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00048d0 tx=0x7f5bf0009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.346+0000 7f5c0acae640 1 -- 172.21.15.47:0/705923946 shutdown_connections 2024-02-07T12:38:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.346+0000 7f5c0acae640 1 --2- 172.21.15.47:0/705923946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c04101be0 0x7f5c040fb270 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.346+0000 7f5c0acae640 1 --2- 172.21.15.47:0/705923946 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c04101240 0x7f5c04101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.346+0000 7f5c0acae640 1 -- 172.21.15.47:0/705923946 >> 172.21.15.47:0/705923946 conn(0x7f5c040f6e10 msgr2=0x7f5c040f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.346+0000 7f5c0acae640 1 -- 172.21.15.47:0/705923946 shutdown_connections 2024-02-07T12:38:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.346+0000 7f5c0acae640 1 -- 172.21.15.47:0/705923946 wait complete. 2024-02-07T12:38:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.346+0000 7f5c0acae640 1 Processor -- start 2024-02-07T12:38:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.346+0000 7f5c0acae640 1 -- start start 2024-02-07T12:38:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.346+0000 7f5c0acae640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c04101240 0x7f5c040fcee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.346+0000 7f5c0acae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c04101be0 0x7f5c040fd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.346+0000 7f5c0acae640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c040fee80 con 0x7f5c04101be0 2024-02-07T12:38:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c0acae640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c040fd960 con 0x7f5c04101240 2024-02-07T12:38:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c03fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c04101be0 0x7f5c040fd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c03fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c04101be0 0x7f5c040fd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56236/0 (socket says 172.21.15.47:56236) 2024-02-07T12:38:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c03fff640 1 -- 172.21.15.47:0/324932738 learned_addr learned my addr 172.21.15.47:0/324932738 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c08a4a640 1 --2- 172.21.15.47:0/324932738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c04101240 0x7f5c040fcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c03fff640 1 -- 172.21.15.47:0/324932738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c04101240 msgr2=0x7f5c040fcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c03fff640 1 --2- 172.21.15.47:0/324932738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c04101240 0x7f5c040fcee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c03fff640 1 -- 172.21.15.47:0/324932738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf0005040 con 0x7f5c04101be0 2024-02-07T12:38:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c08a4a640 1 --2- 172.21.15.47:0/324932738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c04101240 0x7f5c040fcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:38:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c03fff640 1 --2- 172.21.15.47:0/324932738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c04101be0 0x7f5c040fd420 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0031720 tx=0x7f5bf0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c017fa640 1 -- 172.21.15.47:0/324932738 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf00094c0 con 0x7f5c04101be0 2024-02-07T12:38:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c017fa640 1 -- 172.21.15.47:0/324932738 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5bf0009620 con 0x7f5c04101be0 2024-02-07T12:38:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c0acae640 1 -- 172.21.15.47:0/324932738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c040fdbb0 con 0x7f5c04101be0 2024-02-07T12:38:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c017fa640 1 -- 172.21.15.47:0/324932738 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf003b640 con 0x7f5c04101be0 2024-02-07T12:38:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.347+0000 7f5c0acae640 1 -- 172.21.15.47:0/324932738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c041191f0 con 0x7f5c04101be0 2024-02-07T12:38:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.348+0000 7f5c0acae640 1 -- 172.21.15.47:0/324932738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c04064480 con 0x7f5c04101be0 2024-02-07T12:38:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.349+0000 7f5c017fa640 1 -- 172.21.15.47:0/324932738 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f5bf002f070 con 0x7f5c04101be0 2024-02-07T12:38:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.349+0000 7f5c017fa640 1 --2- 172.21.15.47:0/324932738 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5bf406d750 0x7f5bf406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.349+0000 7f5c08a4a640 1 --2- 172.21.15.47:0/324932738 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5bf406d750 0x7f5bf406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.349+0000 7f5c017fa640 1 -- 172.21.15.47:0/324932738 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5bf00af4f0 con 0x7f5c04101be0 2024-02-07T12:38:08.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.350+0000 7f5c08a4a640 1 --2- 172.21.15.47:0/324932738 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5bf406d750 0x7f5bf406fc00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80041d0 tx=0x7f5bf8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:08.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.354+0000 7f5c017fa640 1 -- 172.21.15.47:0/324932738 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5bf0078d10 con 0x7f5c04101be0 2024-02-07T12:38:08.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.535+0000 7f5c0acae640 1 -- 172.21.15.47:0/324932738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f5c04108380 con 0x7f5c04101be0 2024-02-07T12:38:08.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.535+0000 7f5c017fa640 1 -- 172.21.15.47:0/324932738 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v86) v1 ==== 107+0+11 (secure 0 0 0) 0x7f5bf007c3d0 con 0x7f5c04101be0 2024-02-07T12:38:08.537 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-02-07T12:38:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.537+0000 7f5c0acae640 1 -- 172.21.15.47:0/324932738 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5bf406d750 msgr2=0x7f5bf406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.537+0000 7f5c0acae640 1 --2- 172.21.15.47:0/324932738 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5bf406d750 0x7f5bf406fc00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80041d0 tx=0x7f5bf8009040 comp rx=0 tx=0).stop 2024-02-07T12:38:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.537+0000 7f5c0acae640 1 -- 172.21.15.47:0/324932738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c04101be0 msgr2=0x7f5c040fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.537+0000 7f5c0acae640 1 --2- 172.21.15.47:0/324932738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c04101be0 0x7f5c040fd420 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0031720 tx=0x7f5bf0009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.537+0000 7f5c0acae640 1 -- 172.21.15.47:0/324932738 shutdown_connections 2024-02-07T12:38:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.537+0000 7f5c0acae640 1 --2- 172.21.15.47:0/324932738 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f5bf406d750 0x7f5bf406fc00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.537+0000 7f5c0acae640 1 --2- 172.21.15.47:0/324932738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c04101be0 0x7f5c040fd420 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.537+0000 7f5c0acae640 1 --2- 172.21.15.47:0/324932738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c04101240 0x7f5c040fcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.537+0000 7f5c0acae640 1 -- 172.21.15.47:0/324932738 >> 172.21.15.47:0/324932738 conn(0x7f5c040f6e10 msgr2=0x7f5c040656f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.537+0000 7f5c0acae640 1 -- 172.21.15.47:0/324932738 shutdown_connections 2024-02-07T12:38:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.537+0000 7f5c0acae640 1 -- 172.21.15.47:0/324932738 wait complete. 2024-02-07T12:38:08.549 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:08 smithi047 ceph-mon[93224]: pgmap v329: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:38:08.549 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:08 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1871311368' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:38:08.549 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:08 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3256901665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-07T12:38:08.549 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:08 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1907669676' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-07T12:38:08.550 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-07T12:38:08.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.646+0000 7fc3a0818640 1 -- 172.21.15.47:0/241578811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc39c102c60 msgr2=0x7fc39c0fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.646+0000 7fc3a0818640 1 --2- 172.21.15.47:0/241578811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc39c102c60 0x7fc39c0fc2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc3900048d0 tx=0x7fc390009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.646+0000 7fc3a0818640 1 -- 172.21.15.47:0/241578811 shutdown_connections 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc3a0818640 1 --2- 172.21.15.47:0/241578811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc39c102c60 0x7fc39c0fc2f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc3a0818640 1 --2- 172.21.15.47:0/241578811 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc39c1022c0 0x7fc39c102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc3a0818640 1 -- 172.21.15.47:0/241578811 >> 172.21.15.47:0/241578811 conn(0x7fc39c0f7ed0 msgr2=0x7fc39c0fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc3a0818640 1 -- 172.21.15.47:0/241578811 shutdown_connections 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc3a0818640 1 -- 172.21.15.47:0/241578811 wait complete. 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc3a0818640 1 Processor -- start 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc3a0818640 1 -- start start 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc3a0818640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc39c1022c0 0x7fc39c112b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc3a0818640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc39c102c60 0x7fc39c113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc3a0818640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c113640 con 0x7fc39c102c60 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc3a0818640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c10cbd0 con 0x7fc39c1022c0 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc399d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc39c102c60 0x7fc39c113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc399d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc39c102c60 0x7fc39c113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56248/0 (socket says 172.21.15.47:56248) 2024-02-07T12:38:08.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc399d9b640 1 -- 172.21.15.47:0/1166344384 learned_addr learned my addr 172.21.15.47:0/1166344384 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.647+0000 7fc39a59c640 1 --2- 172.21.15.47:0/1166344384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc39c1022c0 0x7fc39c112b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.648+0000 7fc399d9b640 1 -- 172.21.15.47:0/1166344384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc39c1022c0 msgr2=0x7fc39c112b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.648+0000 7fc399d9b640 1 --2- 172.21.15.47:0/1166344384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc39c1022c0 0x7fc39c112b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.648+0000 7fc399d9b640 1 -- 172.21.15.47:0/1166344384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc390005040 con 0x7fc39c102c60 2024-02-07T12:38:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.648+0000 7fc399d9b640 1 --2- 172.21.15.47:0/1166344384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc39c102c60 0x7fc39c113040 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc39002bda0 tx=0x7fc390009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.648+0000 7fc38affd640 1 -- 172.21.15.47:0/1166344384 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3900092e0 con 0x7fc39c102c60 2024-02-07T12:38:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.648+0000 7fc38affd640 1 -- 172.21.15.47:0/1166344384 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc39003d450 con 0x7fc39c102c60 2024-02-07T12:38:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.648+0000 7fc3a0818640 1 -- 172.21.15.47:0/1166344384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c10ce50 con 0x7fc39c102c60 2024-02-07T12:38:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.648+0000 7fc38affd640 1 -- 172.21.15.47:0/1166344384 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc39003b640 con 0x7fc39c102c60 2024-02-07T12:38:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.648+0000 7fc3a0818640 1 -- 172.21.15.47:0/1166344384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c10d370 con 0x7fc39c102c60 2024-02-07T12:38:08.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.649+0000 7fc3a0818640 1 -- 172.21.15.47:0/1166344384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39c064030 con 0x7fc39c102c60 2024-02-07T12:38:08.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.650+0000 7fc38affd640 1 -- 172.21.15.47:0/1166344384 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc39002f070 con 0x7fc39c102c60 2024-02-07T12:38:08.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.650+0000 7fc38affd640 1 --2- 172.21.15.47:0/1166344384 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc38406d750 0x7fc38406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:08.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.650+0000 7fc38affd640 1 -- 172.21.15.47:0/1166344384 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc3900af2e0 con 0x7fc39c102c60 2024-02-07T12:38:08.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.650+0000 7fc39a59c640 1 --2- 172.21.15.47:0/1166344384 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc38406d750 0x7fc38406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:08.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.650+0000 7fc39a59c640 1 --2- 172.21.15.47:0/1166344384 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc38406d750 0x7fc38406fc00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc394009af0 tx=0x7fc39400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:08.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.655+0000 7fc38affd640 1 -- 172.21.15.47:0/1166344384 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc390078a80 con 0x7fc39c102c60 2024-02-07T12:38:08.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:08 smithi138 ceph-mon[82055]: pgmap v329: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:38:08.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:08 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1871311368' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:38:08.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:08 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3256901665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-07T12:38:08.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:08 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1907669676' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-07T12:38:08.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.872+0000 7fc3a0818640 1 -- 172.21.15.47:0/1166344384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc39c10d500 con 0x7fc39c102c60 2024-02-07T12:38:08.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.873+0000 7fc38affd640 1 -- 172.21.15.47:0/1166344384 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+5034 (secure 0 0 0) 0x7fc39007c140 con 0x7fc39c102c60 2024-02-07T12:38:08.875 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:08.875 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":48,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:57.641208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34428,"mds_1":34460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":36,"state":"up:active","state_seq":9,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34460":{"gid":34460,"name":"cephfs.smithi047.jsgfge","rank":1,"incarnation":46,"state":"up:active","state_seq":12,"addr":"172.21.15.47:6829/3723006072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3723006072},{"type":"v1","addr":"172.21.15.47:6829","nonce":3723006072}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_44365":{"gid":44365,"name":"cephfs.smithi138.jhsygn","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6826/3547121337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":3547121337},{"type":"v1","addr":"172.21.15.138:6826","nonce":3547121337}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_44369":{"gid":44369,"name":"cephfs.smithi138.axpdsx","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6827/2689114398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2689114398},{"type":"v1","addr":"172.21.15.138:6827","nonce":2689114398}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:08.875 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 48 2024-02-07T12:38:08.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.875+0000 7fc3a0818640 1 -- 172.21.15.47:0/1166344384 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc38406d750 msgr2=0x7fc38406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.875+0000 7fc3a0818640 1 --2- 172.21.15.47:0/1166344384 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc38406d750 0x7fc38406fc00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc394009af0 tx=0x7fc39400b040 comp rx=0 tx=0).stop 2024-02-07T12:38:08.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.875+0000 7fc3a0818640 1 -- 172.21.15.47:0/1166344384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc39c102c60 msgr2=0x7fc39c113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.875+0000 7fc3a0818640 1 --2- 172.21.15.47:0/1166344384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc39c102c60 0x7fc39c113040 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc39002bda0 tx=0x7fc390009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.875+0000 7fc3a0818640 1 -- 172.21.15.47:0/1166344384 shutdown_connections 2024-02-07T12:38:08.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.875+0000 7fc3a0818640 1 --2- 172.21.15.47:0/1166344384 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc38406d750 0x7fc38406fc00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.875+0000 7fc3a0818640 1 --2- 172.21.15.47:0/1166344384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc39c102c60 0x7fc39c113040 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.875+0000 7fc3a0818640 1 --2- 172.21.15.47:0/1166344384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc39c1022c0 0x7fc39c112b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.875+0000 7fc3a0818640 1 -- 172.21.15.47:0/1166344384 >> 172.21.15.47:0/1166344384 conn(0x7fc39c0f7ed0 msgr2=0x7fc39c0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:08.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.875+0000 7fc3a0818640 1 -- 172.21.15.47:0/1166344384 shutdown_connections 2024-02-07T12:38:08.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.875+0000 7fc3a0818640 1 -- 172.21.15.47:0/1166344384 wait complete. 2024-02-07T12:38:08.888 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 50} 2024-02-07T12:38:08.889 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-02-07T12:38:08.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.986+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2629488764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8c0fb2b0 msgr2=0x7f9e8c0fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.986+0000 7f9e91a2e640 1 --2- 172.21.15.47:0/2629488764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8c0fb2b0 0x7f9e8c0fb700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9e800048d0 tx=0x7f9e80009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.986+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2629488764 shutdown_connections 2024-02-07T12:38:08.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.986+0000 7f9e91a2e640 1 --2- 172.21.15.47:0/2629488764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8c0fb2b0 0x7f9e8c0fb700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.986+0000 7f9e91a2e640 1 --2- 172.21.15.47:0/2629488764 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e8c1012d0 0x7f9e8c1016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.986+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2629488764 >> 172.21.15.47:0/2629488764 conn(0x7f9e8c071230 msgr2=0x7f9e8c071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:08.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.986+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2629488764 shutdown_connections 2024-02-07T12:38:08.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.986+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2629488764 wait complete. 2024-02-07T12:38:08.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.987+0000 7f9e91a2e640 1 Processor -- start 2024-02-07T12:38:08.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.987+0000 7f9e91a2e640 1 -- start start 2024-02-07T12:38:08.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.987+0000 7f9e91a2e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8c0fb2b0 0x7f9e8c112c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:08.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.987+0000 7f9e91a2e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e8c1012d0 0x7f9e8c113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:08.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.987+0000 7f9e91a2e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c1137f0 con 0x7f9e8c0fb2b0 2024-02-07T12:38:08.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.987+0000 7f9e91a2e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c10ccf0 con 0x7f9e8c1012d0 2024-02-07T12:38:08.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.987+0000 7f9e8affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8c0fb2b0 0x7f9e8c112c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:08.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.987+0000 7f9e8affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8c0fb2b0 0x7f9e8c112c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56262/0 (socket says 172.21.15.47:56262) 2024-02-07T12:38:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.987+0000 7f9e8affd640 1 -- 172.21.15.47:0/2456459470 learned_addr learned my addr 172.21.15.47:0/2456459470 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.988+0000 7f9e8a7fc640 1 --2- 172.21.15.47:0/2456459470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e8c1012d0 0x7f9e8c113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.988+0000 7f9e8affd640 1 -- 172.21.15.47:0/2456459470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e8c1012d0 msgr2=0x7f9e8c113160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.988+0000 7f9e8affd640 1 --2- 172.21.15.47:0/2456459470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e8c1012d0 0x7f9e8c113160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.988+0000 7f9e8affd640 1 -- 172.21.15.47:0/2456459470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e80005040 con 0x7f9e8c0fb2b0 2024-02-07T12:38:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.988+0000 7f9e8affd640 1 --2- 172.21.15.47:0/2456459470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8c0fb2b0 0x7f9e8c112c20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400b790 tx=0x7f9e840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.988+0000 7f9e737fe640 1 -- 172.21.15.47:0/2456459470 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e8400c700 con 0x7f9e8c0fb2b0 2024-02-07T12:38:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.988+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2456459470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8c10cfd0 con 0x7f9e8c0fb2b0 2024-02-07T12:38:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.988+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2456459470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c10d4c0 con 0x7f9e8c0fb2b0 2024-02-07T12:38:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.988+0000 7f9e737fe640 1 -- 172.21.15.47:0/2456459470 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e8400cd30 con 0x7f9e8c0fb2b0 2024-02-07T12:38:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.988+0000 7f9e737fe640 1 -- 172.21.15.47:0/2456459470 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e84013370 con 0x7f9e8c0fb2b0 2024-02-07T12:38:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.989+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2456459470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e78005210 con 0x7f9e8c0fb2b0 2024-02-07T12:38:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.989+0000 7f9e737fe640 1 -- 172.21.15.47:0/2456459470 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9e84012070 con 0x7f9e8c0fb2b0 2024-02-07T12:38:08.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.990+0000 7f9e737fe640 1 --2- 172.21.15.47:0/2456459470 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9e7406d750 0x7f9e7406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:08.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.990+0000 7f9e737fe640 1 -- 172.21.15.47:0/2456459470 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9e8408cb80 con 0x7f9e8c0fb2b0 2024-02-07T12:38:08.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.990+0000 7f9e8a7fc640 1 --2- 172.21.15.47:0/2456459470 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9e7406d750 0x7f9e7406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:08.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.990+0000 7f9e8a7fc640 1 --2- 172.21.15.47:0/2456459470 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9e7406d750 0x7f9e7406fc00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c10de30 tx=0x7f9e80009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:08.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:08.994+0000 7f9e737fe640 1 -- 172.21.15.47:0/2456459470 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9e84056320 con 0x7f9e8c0fb2b0 2024-02-07T12:38:09.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.212+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2456459470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f9e780054c0 con 0x7f9e8c0fb2b0 2024-02-07T12:38:09.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.213+0000 7f9e737fe640 1 -- 172.21.15.47:0/2456459470 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v48) v1 ==== 107+0+4863 (secure 0 0 0) 0x7f9e840599e0 con 0x7f9e8c0fb2b0 2024-02-07T12:38:09.215 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:09.215 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:24:57.983373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14460,"mds_1":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6827/3633114050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3633114050},{"type":"v1","addr":"172.21.15.47:6827","nonce":3633114050}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14472":{"gid":14472,"name":"cephfs.smithi047.jsgfge","rank":1,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6829/1833631011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1833631011},{"type":"v1","addr":"172.21.15.47:6829","nonce":1833631011}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24259":{"gid":24259,"name":"cephfs.smithi138.axpdsx","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.138:6827/3408663554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3408663554},{"type":"v1","addr":"172.21.15.138:6827","nonce":3408663554}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24263":{"gid":24263,"name":"cephfs.smithi138.jhsygn","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6825/2163008835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2163008835},{"type":"v1","addr":"172.21.15.138:6825","nonce":2163008835}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:09.215 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-02-07T12:38:09.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.214+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2456459470 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9e7406d750 msgr2=0x7f9e7406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:09.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.214+0000 7f9e91a2e640 1 --2- 172.21.15.47:0/2456459470 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9e7406d750 0x7f9e7406fc00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c10de30 tx=0x7f9e80009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.214+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2456459470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8c0fb2b0 msgr2=0x7f9e8c112c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:09.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.214+0000 7f9e91a2e640 1 --2- 172.21.15.47:0/2456459470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8c0fb2b0 0x7f9e8c112c20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400b790 tx=0x7f9e840091d0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.214+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2456459470 shutdown_connections 2024-02-07T12:38:09.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.214+0000 7f9e91a2e640 1 --2- 172.21.15.47:0/2456459470 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9e7406d750 0x7f9e7406fc00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.214+0000 7f9e91a2e640 1 --2- 172.21.15.47:0/2456459470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e8c1012d0 0x7f9e8c113160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.214+0000 7f9e91a2e640 1 --2- 172.21.15.47:0/2456459470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8c0fb2b0 0x7f9e8c112c20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.214+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2456459470 >> 172.21.15.47:0/2456459470 conn(0x7f9e8c071230 msgr2=0x7f9e8c0644c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:09.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.215+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2456459470 shutdown_connections 2024-02-07T12:38:09.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.215+0000 7f9e91a2e640 1 -- 172.21.15.47:0/2456459470 wait complete. 2024-02-07T12:38:09.228 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-02-07T12:38:09.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.324+0000 7f130599d640 1 -- 172.21.15.47:0/3657356069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13001012d0 msgr2=0x7f13001016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:09.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.324+0000 7f130599d640 1 --2- 172.21.15.47:0/3657356069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13001012d0 0x7f13001016a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f12f80048d0 tx=0x7f12f8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.324+0000 7f130599d640 1 -- 172.21.15.47:0/3657356069 shutdown_connections 2024-02-07T12:38:09.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.324+0000 7f130599d640 1 --2- 172.21.15.47:0/3657356069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13000fb2b0 0x7f13000fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.324+0000 7f130599d640 1 --2- 172.21.15.47:0/3657356069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13001012d0 0x7f13001016a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.324+0000 7f130599d640 1 -- 172.21.15.47:0/3657356069 >> 172.21.15.47:0/3657356069 conn(0x7f1300071230 msgr2=0x7f1300071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:09.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.324+0000 7f130599d640 1 -- 172.21.15.47:0/3657356069 shutdown_connections 2024-02-07T12:38:09.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.324+0000 7f130599d640 1 -- 172.21.15.47:0/3657356069 wait complete. 2024-02-07T12:38:09.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.325+0000 7f130599d640 1 Processor -- start 2024-02-07T12:38:09.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.325+0000 7f130599d640 1 -- start start 2024-02-07T12:38:09.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.325+0000 7f130599d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13000fb2b0 0x7f1300111af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:09.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.325+0000 7f130599d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13001012d0 0x7f1300112030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:09.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.325+0000 7f130599d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1300112630 con 0x7f13001012d0 2024-02-07T12:38:09.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.325+0000 7f130599d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130010bbc0 con 0x7f13000fb2b0 2024-02-07T12:38:09.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.325+0000 7f12fe7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13001012d0 0x7f1300112030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:09.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.325+0000 7f12fe7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13001012d0 0x7f1300112030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56276/0 (socket says 172.21.15.47:56276) 2024-02-07T12:38:09.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.325+0000 7f12fe7fc640 1 -- 172.21.15.47:0/3456306052 learned_addr learned my addr 172.21.15.47:0/3456306052 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:09.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.326+0000 7f12feffd640 1 --2- 172.21.15.47:0/3456306052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13000fb2b0 0x7f1300111af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:09.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.326+0000 7f12fe7fc640 1 -- 172.21.15.47:0/3456306052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13000fb2b0 msgr2=0x7f1300111af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:09.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.326+0000 7f12fe7fc640 1 --2- 172.21.15.47:0/3456306052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13000fb2b0 0x7f1300111af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.326+0000 7f12fe7fc640 1 -- 172.21.15.47:0/3456306052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8005040 con 0x7f13001012d0 2024-02-07T12:38:09.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.326+0000 7f12fe7fc640 1 --2- 172.21.15.47:0/3456306052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13001012d0 0x7f1300112030 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f12f400eb70 tx=0x7f12f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:09.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.326+0000 7f12e77fe640 1 -- 172.21.15.47:0/3456306052 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12f4007c30 con 0x7f13001012d0 2024-02-07T12:38:09.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.326+0000 7f12e77fe640 1 -- 172.21.15.47:0/3456306052 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f12f400f040 con 0x7f13001012d0 2024-02-07T12:38:09.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.326+0000 7f12e77fe640 1 -- 172.21.15.47:0/3456306052 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12f40095b0 con 0x7f13001012d0 2024-02-07T12:38:09.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.326+0000 7f130599d640 1 -- 172.21.15.47:0/3456306052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130010be40 con 0x7f13001012d0 2024-02-07T12:38:09.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.326+0000 7f130599d640 1 -- 172.21.15.47:0/3456306052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130010c360 con 0x7f13001012d0 2024-02-07T12:38:09.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.327+0000 7f130599d640 1 -- 172.21.15.47:0/3456306052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1300064030 con 0x7f13001012d0 2024-02-07T12:38:09.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.328+0000 7f12e77fe640 1 -- 172.21.15.47:0/3456306052 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f12f4009730 con 0x7f13001012d0 2024-02-07T12:38:09.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.328+0000 7f12e77fe640 1 --2- 172.21.15.47:0/3456306052 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f12e806d750 0x7f12e806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:09.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.328+0000 7f12e77fe640 1 -- 172.21.15.47:0/3456306052 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f12f408cd00 con 0x7f13001012d0 2024-02-07T12:38:09.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.328+0000 7f12feffd640 1 --2- 172.21.15.47:0/3456306052 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f12e806d750 0x7f12e806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:09.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.328+0000 7f12feffd640 1 --2- 172.21.15.47:0/3456306052 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f12e806d750 0x7f12e806fc00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f12f8000c00 tx=0x7f12f8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:09.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.333+0000 7f12e77fe640 1 -- 172.21.15.47:0/3456306052 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f12f40564b0 con 0x7f13001012d0 2024-02-07T12:38:09.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.553+0000 7f130599d640 1 -- 172.21.15.47:0/3456306052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f130010c580 con 0x7f13001012d0 2024-02-07T12:38:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.554+0000 7f12e77fe640 1 -- 172.21.15.47:0/3456306052 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v48) v1 ==== 107+0+4864 (secure 0 0 0) 0x7f12f4059b70 con 0x7f13001012d0 2024-02-07T12:38:09.556 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:09.556 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:26:24.336188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14460,"mds_1":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6827/3633114050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3633114050},{"type":"v1","addr":"172.21.15.47:6827","nonce":3633114050}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14472":{"gid":14472,"name":"cephfs.smithi047.jsgfge","rank":1,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6829/1833631011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1833631011},{"type":"v1","addr":"172.21.15.47:6829","nonce":1833631011}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24259":{"gid":24259,"name":"cephfs.smithi138.axpdsx","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.138:6827/3408663554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3408663554},{"type":"v1","addr":"172.21.15.138:6827","nonce":3408663554}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24263":{"gid":24263,"name":"cephfs.smithi138.jhsygn","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6825/2163008835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2163008835},{"type":"v1","addr":"172.21.15.138:6825","nonce":2163008835}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-02-07T12:38:09.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.556+0000 7f130599d640 1 -- 172.21.15.47:0/3456306052 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f12e806d750 msgr2=0x7f12e806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.556+0000 7f130599d640 1 --2- 172.21.15.47:0/3456306052 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f12e806d750 0x7f12e806fc00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f12f8000c00 tx=0x7f12f8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.556+0000 7f130599d640 1 -- 172.21.15.47:0/3456306052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13001012d0 msgr2=0x7f1300112030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.556+0000 7f130599d640 1 --2- 172.21.15.47:0/3456306052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13001012d0 0x7f1300112030 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f12f400eb70 tx=0x7f12f400b040 comp rx=0 tx=0).stop 2024-02-07T12:38:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.556+0000 7f130599d640 1 -- 172.21.15.47:0/3456306052 shutdown_connections 2024-02-07T12:38:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.556+0000 7f130599d640 1 --2- 172.21.15.47:0/3456306052 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f12e806d750 0x7f12e806fc00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.556+0000 7f130599d640 1 --2- 172.21.15.47:0/3456306052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13001012d0 0x7f1300112030 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.556+0000 7f130599d640 1 --2- 172.21.15.47:0/3456306052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13000fb2b0 0x7f1300111af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.556+0000 7f130599d640 1 -- 172.21.15.47:0/3456306052 >> 172.21.15.47:0/3456306052 conn(0x7f1300071230 msgr2=0x7f13000fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.556+0000 7f130599d640 1 -- 172.21.15.47:0/3456306052 shutdown_connections 2024-02-07T12:38:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.556+0000 7f130599d640 1 -- 172.21.15.47:0/3456306052 wait complete. 2024-02-07T12:38:09.568 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:09 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/324932738' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-07T12:38:09.568 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:09 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1166344384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-07T12:38:09.568 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:09 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2456459470' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-07T12:38:09.569 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-02-07T12:38:09.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.667+0000 7f6315d9d640 1 -- 172.21.15.47:0/3567408001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63101012d0 msgr2=0x7f63101016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:09.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.667+0000 7f6315d9d640 1 --2- 172.21.15.47:0/3567408001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63101012d0 0x7f63101016a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f62f80048d0 tx=0x7f62f8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.667+0000 7f6315d9d640 1 -- 172.21.15.47:0/3567408001 shutdown_connections 2024-02-07T12:38:09.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.667+0000 7f6315d9d640 1 --2- 172.21.15.47:0/3567408001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63100fb2b0 0x7f63100fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.667+0000 7f6315d9d640 1 --2- 172.21.15.47:0/3567408001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63101012d0 0x7f63101016a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.667+0000 7f6315d9d640 1 -- 172.21.15.47:0/3567408001 >> 172.21.15.47:0/3567408001 conn(0x7f6310071230 msgr2=0x7f6310071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.667+0000 7f6315d9d640 1 -- 172.21.15.47:0/3567408001 shutdown_connections 2024-02-07T12:38:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.667+0000 7f6315d9d640 1 -- 172.21.15.47:0/3567408001 wait complete. 2024-02-07T12:38:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.667+0000 7f6315d9d640 1 Processor -- start 2024-02-07T12:38:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.667+0000 7f6315d9d640 1 -- start start 2024-02-07T12:38:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f6315d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63100fb2b0 0x7f6310111af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f6315d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63101012d0 0x7f6310112030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f6315d9d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6310112630 con 0x7f63100fb2b0 2024-02-07T12:38:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f6315d9d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631010bbc0 con 0x7f63101012d0 2024-02-07T12:38:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f630f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63100fb2b0 0x7f6310111af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f630f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63100fb2b0 0x7f6310111af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34100/0 (socket says 172.21.15.47:34100) 2024-02-07T12:38:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f630f7fe640 1 -- 172.21.15.47:0/1471210711 learned_addr learned my addr 172.21.15.47:0/1471210711 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f630effd640 1 --2- 172.21.15.47:0/1471210711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63101012d0 0x7f6310112030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f630f7fe640 1 -- 172.21.15.47:0/1471210711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63101012d0 msgr2=0x7f6310112030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f630f7fe640 1 --2- 172.21.15.47:0/1471210711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63101012d0 0x7f6310112030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f630f7fe640 1 -- 172.21.15.47:0/1471210711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f8005040 con 0x7f63100fb2b0 2024-02-07T12:38:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f630f7fe640 1 --2- 172.21.15.47:0/1471210711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63100fb2b0 0x7f6310111af0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f62f8031720 tx=0x7f62f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f6307fff640 1 -- 172.21.15.47:0/1471210711 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62f80094c0 con 0x7f63100fb2b0 2024-02-07T12:38:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f6307fff640 1 -- 172.21.15.47:0/1471210711 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62f8009620 con 0x7f63100fb2b0 2024-02-07T12:38:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f6315d9d640 1 -- 172.21.15.47:0/1471210711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631010be40 con 0x7f63100fb2b0 2024-02-07T12:38:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f6307fff640 1 -- 172.21.15.47:0/1471210711 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62f803b640 con 0x7f63100fb2b0 2024-02-07T12:38:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.668+0000 7f6315d9d640 1 -- 172.21.15.47:0/1471210711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631010c360 con 0x7f63100fb2b0 2024-02-07T12:38:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.669+0000 7f6315d9d640 1 -- 172.21.15.47:0/1471210711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6310064030 con 0x7f63100fb2b0 2024-02-07T12:38:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.670+0000 7f6307fff640 1 -- 172.21.15.47:0/1471210711 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f62f802f070 con 0x7f63100fb2b0 2024-02-07T12:38:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.670+0000 7f6307fff640 1 --2- 172.21.15.47:0/1471210711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f62fc06d750 0x7f62fc06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.670+0000 7f6307fff640 1 -- 172.21.15.47:0/1471210711 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f62f80af520 con 0x7f63100fb2b0 2024-02-07T12:38:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.670+0000 7f630effd640 1 --2- 172.21.15.47:0/1471210711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f62fc06d750 0x7f62fc06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.671+0000 7f630effd640 1 --2- 172.21.15.47:0/1471210711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f62fc06d750 0x7f62fc06fc00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6300007fd0 tx=0x7f6300009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:09.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.675+0000 7f6307fff640 1 -- 172.21.15.47:0/1471210711 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f62f8078cc0 con 0x7f63100fb2b0 2024-02-07T12:38:09.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:09 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/324932738' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-07T12:38:09.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:09 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1166344384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-07T12:38:09.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:09 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2456459470' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-07T12:38:09.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.895+0000 7f6315d9d640 1 -- 172.21.15.47:0/1471210711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f631010c580 con 0x7f63100fb2b0 2024-02-07T12:38:09.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.896+0000 7f6307fff640 1 -- 172.21.15.47:0/1471210711 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v48) v1 ==== 107+0+4863 (secure 0 0 0) 0x7f62f807c380 con 0x7f63100fb2b0 2024-02-07T12:38:09.898 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:09.898 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:29:32.945302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14460,"mds_1":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6827/3633114050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3633114050},{"type":"v1","addr":"172.21.15.47:6827","nonce":3633114050}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14472":{"gid":14472,"name":"cephfs.smithi047.jsgfge","rank":1,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6829/1833631011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1833631011},{"type":"v1","addr":"172.21.15.47:6829","nonce":1833631011}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24259":{"gid":24259,"name":"cephfs.smithi138.axpdsx","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.138:6827/3408663554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3408663554},{"type":"v1","addr":"172.21.15.138:6827","nonce":3408663554}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24263":{"gid":24263,"name":"cephfs.smithi138.jhsygn","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6825/2163008835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2163008835},{"type":"v1","addr":"172.21.15.138:6825","nonce":2163008835}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:09.898 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 21 2024-02-07T12:38:09.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.897+0000 7f6315d9d640 1 -- 172.21.15.47:0/1471210711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f62fc06d750 msgr2=0x7f62fc06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:09.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.897+0000 7f6315d9d640 1 --2- 172.21.15.47:0/1471210711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f62fc06d750 0x7f62fc06fc00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6300007fd0 tx=0x7f6300009e90 comp rx=0 tx=0).stop 2024-02-07T12:38:09.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.897+0000 7f6315d9d640 1 -- 172.21.15.47:0/1471210711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63100fb2b0 msgr2=0x7f6310111af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:09.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.897+0000 7f6315d9d640 1 --2- 172.21.15.47:0/1471210711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63100fb2b0 0x7f6310111af0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f62f8031720 tx=0x7f62f8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.897+0000 7f6315d9d640 1 -- 172.21.15.47:0/1471210711 shutdown_connections 2024-02-07T12:38:09.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.897+0000 7f6315d9d640 1 --2- 172.21.15.47:0/1471210711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f62fc06d750 0x7f62fc06fc00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.897+0000 7f6315d9d640 1 --2- 172.21.15.47:0/1471210711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63101012d0 0x7f6310112030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.898+0000 7f6315d9d640 1 --2- 172.21.15.47:0/1471210711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63100fb2b0 0x7f6310111af0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:09.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.898+0000 7f6315d9d640 1 -- 172.21.15.47:0/1471210711 >> 172.21.15.47:0/1471210711 conn(0x7f6310071230 msgr2=0x7f63100fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:09.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.898+0000 7f6315d9d640 1 -- 172.21.15.47:0/1471210711 shutdown_connections 2024-02-07T12:38:09.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:09.898+0000 7f6315d9d640 1 -- 172.21.15.47:0/1471210711 wait complete. 2024-02-07T12:38:09.910 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-02-07T12:38:10.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.008+0000 7f44b115d640 1 -- 172.21.15.47:0/2662845378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44ac102360 msgr2=0x7f44ac102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.008+0000 7f44b115d640 1 --2- 172.21.15.47:0/2662845378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44ac102360 0x7f44ac102730 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f449c0048d0 tx=0x7f449c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.008+0000 7f44b115d640 1 -- 172.21.15.47:0/2662845378 shutdown_connections 2024-02-07T12:38:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.008+0000 7f44b115d640 1 --2- 172.21.15.47:0/2662845378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44ac102d00 0x7f44ac0fc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.008+0000 7f44b115d640 1 --2- 172.21.15.47:0/2662845378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44ac102360 0x7f44ac102730 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.008+0000 7f44b115d640 1 -- 172.21.15.47:0/2662845378 >> 172.21.15.47:0/2662845378 conn(0x7f44ac0f7ef0 msgr2=0x7f44ac0fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.008+0000 7f44b115d640 1 -- 172.21.15.47:0/2662845378 shutdown_connections 2024-02-07T12:38:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.008+0000 7f44b115d640 1 -- 172.21.15.47:0/2662845378 wait complete. 2024-02-07T12:38:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.008+0000 7f44b115d640 1 Processor -- start 2024-02-07T12:38:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.008+0000 7f44b115d640 1 -- start start 2024-02-07T12:38:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44b115d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44ac102360 0x7f44ac112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44b115d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44ac102d00 0x7f44ac113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44b115d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac113830 con 0x7f44ac102360 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44b115d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac1139a0 con 0x7f44ac102d00 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44aad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44ac102360 0x7f44ac112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44aad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44ac102360 0x7f44ac112cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34118/0 (socket says 172.21.15.47:34118) 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44aad9d640 1 -- 172.21.15.47:0/2717883466 learned_addr learned my addr 172.21.15.47:0/2717883466 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44aa59c640 1 --2- 172.21.15.47:0/2717883466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44ac102d00 0x7f44ac113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44aad9d640 1 -- 172.21.15.47:0/2717883466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44ac102d00 msgr2=0x7f44ac113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44aad9d640 1 --2- 172.21.15.47:0/2717883466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44ac102d00 0x7f44ac113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44aad9d640 1 -- 172.21.15.47:0/2717883466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c005040 con 0x7f44ac102360 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44aad9d640 1 --2- 172.21.15.47:0/2717883466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44ac102360 0x7f44ac112cf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f449c031720 tx=0x7f449c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44937fe640 1 -- 172.21.15.47:0/2717883466 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f449c0094c0 con 0x7f44ac102360 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44937fe640 1 -- 172.21.15.47:0/2717883466 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f449c009620 con 0x7f44ac102360 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44b115d640 1 -- 172.21.15.47:0/2717883466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac10cf10 con 0x7f44ac102360 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44937fe640 1 -- 172.21.15.47:0/2717883466 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f449c03b640 con 0x7f44ac102360 2024-02-07T12:38:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.009+0000 7f44b115d640 1 -- 172.21.15.47:0/2717883466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac10d430 con 0x7f44ac102360 2024-02-07T12:38:10.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.010+0000 7f44b115d640 1 -- 172.21.15.47:0/2717883466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac064480 con 0x7f44ac102360 2024-02-07T12:38:10.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.011+0000 7f44937fe640 1 -- 172.21.15.47:0/2717883466 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f449c02f070 con 0x7f44ac102360 2024-02-07T12:38:10.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.011+0000 7f44937fe640 1 --2- 172.21.15.47:0/2717883466 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f449406d750 0x7f449406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:10.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.011+0000 7f44937fe640 1 -- 172.21.15.47:0/2717883466 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f449c0af520 con 0x7f44ac102360 2024-02-07T12:38:10.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.011+0000 7f44aa59c640 1 --2- 172.21.15.47:0/2717883466 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f449406d750 0x7f449406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:10.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.012+0000 7f44aa59c640 1 --2- 172.21.15.47:0/2717883466 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f449406d750 0x7f449406fc00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44ac10e5f0 tx=0x7f44a0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:10.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.016+0000 7f44937fe640 1 -- 172.21.15.47:0/2717883466 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f449c078cc0 con 0x7f44ac102360 2024-02-07T12:38:10.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.237+0000 7f44b115d640 1 -- 172.21.15.47:0/2717883466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f44ac1094c0 con 0x7f44ac102360 2024-02-07T12:38:10.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.237+0000 7f44937fe640 1 -- 172.21.15.47:0/2717883466 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v48) v1 ==== 107+0+4862 (secure 0 0 0) 0x7f449c07c380 con 0x7f44ac102360 2024-02-07T12:38:10.240 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:10.240 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:29:33.611202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14460,"mds_1":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6827/3633114050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3633114050},{"type":"v1","addr":"172.21.15.47:6827","nonce":3633114050}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14472":{"gid":14472,"name":"cephfs.smithi047.jsgfge","rank":1,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6829/1833631011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1833631011},{"type":"v1","addr":"172.21.15.47:6829","nonce":1833631011}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24259":{"gid":24259,"name":"cephfs.smithi138.axpdsx","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.138:6827/3408663554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3408663554},{"type":"v1","addr":"172.21.15.138:6827","nonce":3408663554}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24263":{"gid":24263,"name":"cephfs.smithi138.jhsygn","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6825/2163008835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2163008835},{"type":"v1","addr":"172.21.15.138:6825","nonce":2163008835}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:10.241 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 22 2024-02-07T12:38:10.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.239+0000 7f44b115d640 1 -- 172.21.15.47:0/2717883466 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f449406d750 msgr2=0x7f449406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:10.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.239+0000 7f44b115d640 1 --2- 172.21.15.47:0/2717883466 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f449406d750 0x7f449406fc00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44ac10e5f0 tx=0x7f44a0009040 comp rx=0 tx=0).stop 2024-02-07T12:38:10.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.239+0000 7f44b115d640 1 -- 172.21.15.47:0/2717883466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44ac102360 msgr2=0x7f44ac112cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:10.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.239+0000 7f44b115d640 1 --2- 172.21.15.47:0/2717883466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44ac102360 0x7f44ac112cf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f449c031720 tx=0x7f449c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.240+0000 7f44b115d640 1 -- 172.21.15.47:0/2717883466 shutdown_connections 2024-02-07T12:38:10.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.240+0000 7f44b115d640 1 --2- 172.21.15.47:0/2717883466 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f449406d750 0x7f449406fc00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.240+0000 7f44b115d640 1 --2- 172.21.15.47:0/2717883466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44ac102d00 0x7f44ac113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.240+0000 7f44b115d640 1 --2- 172.21.15.47:0/2717883466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44ac102360 0x7f44ac112cf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.240+0000 7f44b115d640 1 -- 172.21.15.47:0/2717883466 >> 172.21.15.47:0/2717883466 conn(0x7f44ac0f7ef0 msgr2=0x7f44ac0f9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:10.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.240+0000 7f44b115d640 1 -- 172.21.15.47:0/2717883466 shutdown_connections 2024-02-07T12:38:10.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.240+0000 7f44b115d640 1 -- 172.21.15.47:0/2717883466 wait complete. 2024-02-07T12:38:10.253 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-02-07T12:38:10.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.350+0000 7fbc67c65640 1 -- 172.21.15.47:0/2221132495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc601023e0 msgr2=0x7fbc601027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:10.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.350+0000 7fbc67c65640 1 --2- 172.21.15.47:0/2221132495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc601023e0 0x7fbc601027b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbc580048d0 tx=0x7fbc58009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.350+0000 7fbc67c65640 1 -- 172.21.15.47:0/2221132495 shutdown_connections 2024-02-07T12:38:10.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.350+0000 7fbc67c65640 1 --2- 172.21.15.47:0/2221132495 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc600644b0 0x7fbc600648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.350+0000 7fbc67c65640 1 --2- 172.21.15.47:0/2221132495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc601023e0 0x7fbc601027b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.350+0000 7fbc67c65640 1 -- 172.21.15.47:0/2221132495 >> 172.21.15.47:0/2221132495 conn(0x7fbc60071230 msgr2=0x7fbc60071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:10.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.350+0000 7fbc67c65640 1 -- 172.21.15.47:0/2221132495 shutdown_connections 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.350+0000 7fbc67c65640 1 -- 172.21.15.47:0/2221132495 wait complete. 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.351+0000 7fbc67c65640 1 Processor -- start 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.351+0000 7fbc67c65640 1 -- start start 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.351+0000 7fbc67c65640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc600644b0 0x7fbc60112b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.351+0000 7fbc67c65640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc601023e0 0x7fbc601130d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.351+0000 7fbc67c65640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc601136d0 con 0x7fbc601023e0 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.351+0000 7fbc67c65640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6010cc60 con 0x7fbc600644b0 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.351+0000 7fbc65200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc601023e0 0x7fbc601130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.351+0000 7fbc65200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc601023e0 0x7fbc601130d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34132/0 (socket says 172.21.15.47:34132) 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.351+0000 7fbc65200640 1 -- 172.21.15.47:0/635741496 learned_addr learned my addr 172.21.15.47:0/635741496 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.351+0000 7fbc65200640 1 -- 172.21.15.47:0/635741496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc600644b0 msgr2=0x7fbc60112b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.351+0000 7fbc65200640 1 --2- 172.21.15.47:0/635741496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc600644b0 0x7fbc60112b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.351+0000 7fbc65200640 1 -- 172.21.15.47:0/635741496 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc58005040 con 0x7fbc601023e0 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.352+0000 7fbc65200640 1 --2- 172.21.15.47:0/635741496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc601023e0 0x7fbc601130d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbc54002a50 tx=0x7fbc54004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.352+0000 7fbc5e7fc640 1 -- 172.21.15.47:0/635741496 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc54007c30 con 0x7fbc601023e0 2024-02-07T12:38:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.352+0000 7fbc5e7fc640 1 -- 172.21.15.47:0/635741496 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc5400f040 con 0x7fbc601023e0 2024-02-07T12:38:10.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.352+0000 7fbc67c65640 1 -- 172.21.15.47:0/635741496 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6010cf40 con 0x7fbc601023e0 2024-02-07T12:38:10.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.352+0000 7fbc5e7fc640 1 -- 172.21.15.47:0/635741496 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc5400dbe0 con 0x7fbc601023e0 2024-02-07T12:38:10.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.352+0000 7fbc67c65640 1 -- 172.21.15.47:0/635741496 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6010d460 con 0x7fbc601023e0 2024-02-07T12:38:10.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.353+0000 7fbc67c65640 1 -- 172.21.15.47:0/635741496 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc60064030 con 0x7fbc601023e0 2024-02-07T12:38:10.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.353+0000 7fbc5e7fc640 1 -- 172.21.15.47:0/635741496 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fbc5400dd40 con 0x7fbc601023e0 2024-02-07T12:38:10.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.354+0000 7fbc5e7fc640 1 --2- 172.21.15.47:0/635741496 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fbc4806d750 0x7fbc4806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:10.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.354+0000 7fbc65a01640 1 --2- 172.21.15.47:0/635741496 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fbc4806d750 0x7fbc4806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:10.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.354+0000 7fbc5e7fc640 1 -- 172.21.15.47:0/635741496 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fbc5408cf80 con 0x7fbc601023e0 2024-02-07T12:38:10.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.354+0000 7fbc65a01640 1 --2- 172.21.15.47:0/635741496 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fbc4806d750 0x7fbc4806fc00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbc58034040 tx=0x7fbc58009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:10.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.358+0000 7fbc5e7fc640 1 -- 172.21.15.47:0/635741496 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbc54056720 con 0x7fbc601023e0 2024-02-07T12:38:10.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:10 smithi047 ceph-mon[93224]: pgmap v330: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:38:10.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:10 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3456306052' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-07T12:38:10.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:10 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1471210711' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-07T12:38:10.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:10 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2717883466' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-07T12:38:10.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.579+0000 7fbc67c65640 1 -- 172.21.15.47:0/635741496 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fbc60109490 con 0x7fbc601023e0 2024-02-07T12:38:10.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.579+0000 7fbc5e7fc640 1 -- 172.21.15.47:0/635741496 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v48) v1 ==== 107+0+3284 (secure 0 0 0) 0x7fbc54059de0 con 0x7fbc601023e0 2024-02-07T12:38:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:10.582 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:32:50.253777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14460,"mds_1":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6827/3633114050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3633114050},{"type":"v1","addr":"172.21.15.47:6827","nonce":3633114050}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14472":{"gid":14472,"name":"cephfs.smithi047.jsgfge","rank":1,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6829/1833631011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1833631011},{"type":"v1","addr":"172.21.15.47:6829","nonce":1833631011}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:10.582 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 23 2024-02-07T12:38:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.581+0000 7fbc67c65640 1 -- 172.21.15.47:0/635741496 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fbc4806d750 msgr2=0x7fbc4806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.581+0000 7fbc67c65640 1 --2- 172.21.15.47:0/635741496 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fbc4806d750 0x7fbc4806fc00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbc58034040 tx=0x7fbc58009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.581+0000 7fbc67c65640 1 -- 172.21.15.47:0/635741496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc601023e0 msgr2=0x7fbc601130d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.581+0000 7fbc67c65640 1 --2- 172.21.15.47:0/635741496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc601023e0 0x7fbc601130d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbc54002a50 tx=0x7fbc54004600 comp rx=0 tx=0).stop 2024-02-07T12:38:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.581+0000 7fbc67c65640 1 -- 172.21.15.47:0/635741496 shutdown_connections 2024-02-07T12:38:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.581+0000 7fbc67c65640 1 --2- 172.21.15.47:0/635741496 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fbc4806d750 0x7fbc4806fc00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.581+0000 7fbc67c65640 1 --2- 172.21.15.47:0/635741496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc601023e0 0x7fbc601130d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.581+0000 7fbc67c65640 1 --2- 172.21.15.47:0/635741496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc600644b0 0x7fbc60112b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.581+0000 7fbc67c65640 1 -- 172.21.15.47:0/635741496 >> 172.21.15.47:0/635741496 conn(0x7fbc60071230 msgr2=0x7fbc600fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.581+0000 7fbc67c65640 1 -- 172.21.15.47:0/635741496 shutdown_connections 2024-02-07T12:38:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.581+0000 7fbc67c65640 1 -- 172.21.15.47:0/635741496 wait complete. 2024-02-07T12:38:10.594 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-02-07T12:38:10.594 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-02-07T12:38:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.694+0000 7f14dad1d640 1 -- 172.21.15.47:0/1046594173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14d40fe2f0 msgr2=0x7f14d40fe6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.694+0000 7f14dad1d640 1 --2- 172.21.15.47:0/1046594173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14d40fe2f0 0x7f14d40fe6c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009c50 tx=0x7f14cc004d10 comp rx=0 tx=0).stop 2024-02-07T12:38:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.694+0000 7f14dad1d640 1 -- 172.21.15.47:0/1046594173 shutdown_connections 2024-02-07T12:38:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.694+0000 7f14dad1d640 1 --2- 172.21.15.47:0/1046594173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14d40faa70 0x7f14d40faee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.694+0000 7f14dad1d640 1 --2- 172.21.15.47:0/1046594173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14d40fe2f0 0x7f14d40fe6c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.694+0000 7f14dad1d640 1 -- 172.21.15.47:0/1046594173 >> 172.21.15.47:0/1046594173 conn(0x7f14d4071950 msgr2=0x7f14d4071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.694+0000 7f14dad1d640 1 -- 172.21.15.47:0/1046594173 shutdown_connections 2024-02-07T12:38:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.694+0000 7f14dad1d640 1 -- 172.21.15.47:0/1046594173 wait complete. 2024-02-07T12:38:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.694+0000 7f14dad1d640 1 Processor -- start 2024-02-07T12:38:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.694+0000 7f14dad1d640 1 -- start start 2024-02-07T12:38:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.695+0000 7f14dad1d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14d40faa70 0x7f14d4112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.695+0000 7f14dad1d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14d40fe2f0 0x7f14d41130f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.695+0000 7f14dad1d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d41136f0 con 0x7f14d40fe2f0 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.695+0000 7f14dad1d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d410cc80 con 0x7f14d40faa70 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.695+0000 7f14d3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14d40fe2f0 0x7f14d41130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.695+0000 7f14d3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14d40fe2f0 0x7f14d41130f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34146/0 (socket says 172.21.15.47:34146) 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.695+0000 7f14d3fff640 1 -- 172.21.15.47:0/1543256561 learned_addr learned my addr 172.21.15.47:0/1543256561 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.695+0000 7f14d8ab9640 1 --2- 172.21.15.47:0/1543256561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14d40faa70 0x7f14d4112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.695+0000 7f14d3fff640 1 -- 172.21.15.47:0/1543256561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14d40faa70 msgr2=0x7f14d4112bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.695+0000 7f14d3fff640 1 --2- 172.21.15.47:0/1543256561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14d40faa70 0x7f14d4112bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.695+0000 7f14d3fff640 1 -- 172.21.15.47:0/1543256561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc0098b0 con 0x7f14d40fe2f0 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.695+0000 7f14d3fff640 1 --2- 172.21.15.47:0/1543256561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14d40fe2f0 0x7f14d41130f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f14bc002a50 tx=0x7f14bc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.696+0000 7f14d17fa640 1 -- 172.21.15.47:0/1543256561 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14bc007c30 con 0x7f14d40fe2f0 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.696+0000 7f14dad1d640 1 -- 172.21.15.47:0/1543256561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d410cf60 con 0x7f14d40fe2f0 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.696+0000 7f14d17fa640 1 -- 172.21.15.47:0/1543256561 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14bc00f040 con 0x7f14d40fe2f0 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.696+0000 7f14d17fa640 1 -- 172.21.15.47:0/1543256561 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14bc00dbe0 con 0x7f14d40fe2f0 2024-02-07T12:38:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.696+0000 7f14dad1d640 1 -- 172.21.15.47:0/1543256561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d410d500 con 0x7f14d40fe2f0 2024-02-07T12:38:10.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.697+0000 7f14dad1d640 1 -- 172.21.15.47:0/1543256561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d4064480 con 0x7f14d40fe2f0 2024-02-07T12:38:10.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.697+0000 7f14d17fa640 1 -- 172.21.15.47:0/1543256561 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f14bc00dd40 con 0x7f14d40fe2f0 2024-02-07T12:38:10.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.697+0000 7f14d17fa640 1 --2- 172.21.15.47:0/1543256561 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f14c006d750 0x7f14c006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:10.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.697+0000 7f14d17fa640 1 -- 172.21.15.47:0/1543256561 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f14bc08cf00 con 0x7f14d40fe2f0 2024-02-07T12:38:10.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.697+0000 7f14d8ab9640 1 --2- 172.21.15.47:0/1543256561 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f14c006d750 0x7f14c006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:10.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.698+0000 7f14d8ab9640 1 --2- 172.21.15.47:0/1543256561 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f14c006d750 0x7f14c006fc00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f14cc004750 tx=0x7f14cc037040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:10.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.702+0000 7f14d17fa640 1 -- 172.21.15.47:0/1543256561 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f14bc056640 con 0x7f14d40fe2f0 2024-02-07T12:38:10.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:10 smithi138 ceph-mon[82055]: pgmap v330: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:38:10.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:10 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3456306052' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-07T12:38:10.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:10 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1471210711' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-07T12:38:10.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:10 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2717883466' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-07T12:38:10.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.922+0000 7f14dad1d640 1 -- 172.21.15.47:0/1543256561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f14d410d720 con 0x7f14d40fe2f0 2024-02-07T12:38:10.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.922+0000 7f14d17fa640 1 -- 172.21.15.47:0/1543256561 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v48) v1 ==== 107+0+4847 (secure 0 0 0) 0x7f14bc059d00 con 0x7f14d40fe2f0 2024-02-07T12:38:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:10.925 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:32:51.418776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14460,"mds_1":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6827/3633114050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3633114050},{"type":"v1","addr":"172.21.15.47:6827","nonce":3633114050}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14472":{"gid":14472,"name":"cephfs.smithi047.jsgfge","rank":1,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6829/1833631011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1833631011},{"type":"v1","addr":"172.21.15.47:6829","nonce":1833631011}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:10.925 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 24 2024-02-07T12:38:10.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.925+0000 7f14dad1d640 1 -- 172.21.15.47:0/1543256561 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f14c006d750 msgr2=0x7f14c006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:10.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.925+0000 7f14dad1d640 1 --2- 172.21.15.47:0/1543256561 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f14c006d750 0x7f14c006fc00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f14cc004750 tx=0x7f14cc037040 comp rx=0 tx=0).stop 2024-02-07T12:38:10.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.925+0000 7f14dad1d640 1 -- 172.21.15.47:0/1543256561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14d40fe2f0 msgr2=0x7f14d41130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:10.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.925+0000 7f14dad1d640 1 --2- 172.21.15.47:0/1543256561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14d40fe2f0 0x7f14d41130f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f14bc002a50 tx=0x7f14bc004600 comp rx=0 tx=0).stop 2024-02-07T12:38:10.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.925+0000 7f14dad1d640 1 -- 172.21.15.47:0/1543256561 shutdown_connections 2024-02-07T12:38:10.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.925+0000 7f14dad1d640 1 --2- 172.21.15.47:0/1543256561 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f14c006d750 0x7f14c006fc00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.925+0000 7f14dad1d640 1 --2- 172.21.15.47:0/1543256561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14d40fe2f0 0x7f14d41130f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.925+0000 7f14dad1d640 1 --2- 172.21.15.47:0/1543256561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14d40faa70 0x7f14d4112bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:10.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.925+0000 7f14dad1d640 1 -- 172.21.15.47:0/1543256561 >> 172.21.15.47:0/1543256561 conn(0x7f14d4071950 msgr2=0x7f14d40f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:10.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.925+0000 7f14dad1d640 1 -- 172.21.15.47:0/1543256561 shutdown_connections 2024-02-07T12:38:10.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:10.925+0000 7f14dad1d640 1 -- 172.21.15.47:0/1543256561 wait complete. 2024-02-07T12:38:10.938 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-02-07T12:38:10.938 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-02-07T12:38:10.938 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-02-07T12:38:11.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.035+0000 7f16a486e640 1 -- 172.21.15.47:0/2598039598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16a00fdcd0 msgr2=0x7f16a01063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:11.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.035+0000 7f16a486e640 1 --2- 172.21.15.47:0/2598039598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16a00fdcd0 0x7f16a01063a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1688004900 tx=0x7f1688009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.035+0000 7f16a486e640 1 -- 172.21.15.47:0/2598039598 shutdown_connections 2024-02-07T12:38:11.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.035+0000 7f16a486e640 1 --2- 172.21.15.47:0/2598039598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16a00fdcd0 0x7f16a01063a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.035+0000 7f16a486e640 1 --2- 172.21.15.47:0/2598039598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16a00fd330 0x7f16a00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.035+0000 7f16a486e640 1 -- 172.21.15.47:0/2598039598 >> 172.21.15.47:0/2598039598 conn(0x7f16a00f6e30 msgr2=0x7f16a00f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.035+0000 7f16a486e640 1 -- 172.21.15.47:0/2598039598 shutdown_connections 2024-02-07T12:38:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.035+0000 7f16a486e640 1 -- 172.21.15.47:0/2598039598 wait complete. 2024-02-07T12:38:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f16a486e640 1 Processor -- start 2024-02-07T12:38:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f16a486e640 1 -- start start 2024-02-07T12:38:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f16a486e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16a00fd330 0x7f16a0112cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f16a486e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16a00fdcd0 0x7f16a01131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f16a486e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a01137f0 con 0x7f16a00fd330 2024-02-07T12:38:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f16a486e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a010cd80 con 0x7f16a00fdcd0 2024-02-07T12:38:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f169e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16a00fd330 0x7f16a0112cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:11.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f169e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16a00fd330 0x7f16a0112cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34156/0 (socket says 172.21.15.47:34156) 2024-02-07T12:38:11.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f169e59c640 1 -- 172.21.15.47:0/452230131 learned_addr learned my addr 172.21.15.47:0/452230131 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:11.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f169e59c640 1 -- 172.21.15.47:0/452230131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16a00fdcd0 msgr2=0x7f16a01131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:11.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f169e59c640 1 --2- 172.21.15.47:0/452230131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16a00fdcd0 0x7f16a01131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f169e59c640 1 -- 172.21.15.47:0/452230131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1688005040 con 0x7f16a00fd330 2024-02-07T12:38:11.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f169e59c640 1 --2- 172.21.15.47:0/452230131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16a00fd330 0x7f16a0112cb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1690002a50 tx=0x7f1690004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:11.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f1696ffd640 1 -- 172.21.15.47:0/452230131 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1690007c30 con 0x7f16a00fd330 2024-02-07T12:38:11.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f1696ffd640 1 -- 172.21.15.47:0/452230131 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f169000f040 con 0x7f16a00fd330 2024-02-07T12:38:11.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.036+0000 7f1696ffd640 1 -- 172.21.15.47:0/452230131 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f169000db50 con 0x7f16a00fd330 2024-02-07T12:38:11.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.037+0000 7f16a486e640 1 -- 172.21.15.47:0/452230131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a010d060 con 0x7f16a00fd330 2024-02-07T12:38:11.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.037+0000 7f16a486e640 1 -- 172.21.15.47:0/452230131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a010d580 con 0x7f16a00fd330 2024-02-07T12:38:11.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.038+0000 7f16a486e640 1 -- 172.21.15.47:0/452230131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a0064480 con 0x7f16a00fd330 2024-02-07T12:38:11.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.038+0000 7f1696ffd640 1 -- 172.21.15.47:0/452230131 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f169001c400 con 0x7f16a00fd330 2024-02-07T12:38:11.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.038+0000 7f1696ffd640 1 --2- 172.21.15.47:0/452230131 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f168c06d750 0x7f168c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:11.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.039+0000 7f1696ffd640 1 -- 172.21.15.47:0/452230131 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f169008c860 con 0x7f16a00fd330 2024-02-07T12:38:11.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.039+0000 7f1697fff640 1 --2- 172.21.15.47:0/452230131 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f168c06d750 0x7f168c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:11.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.039+0000 7f1697fff640 1 --2- 172.21.15.47:0/452230131 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f168c06d750 0x7f168c06fc00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1688034040 tx=0x7f1688009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:11.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.043+0000 7f1696ffd640 1 -- 172.21.15.47:0/452230131 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1690056000 con 0x7f16a00fd330 2024-02-07T12:38:11.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.260+0000 7f16a486e640 1 -- 172.21.15.47:0/452230131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f16a010e2b0 con 0x7f16a00fd330 2024-02-07T12:38:11.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.261+0000 7f1696ffd640 1 -- 172.21.15.47:0/452230131 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v48) v1 ==== 107+0+4849 (secure 0 0 0) 0x7f16900596c0 con 0x7f16a00fd330 2024-02-07T12:38:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:11.263 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:32:52.269338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14460,"mds_1":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6827/3633114050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3633114050},{"type":"v1","addr":"172.21.15.47:6827","nonce":3633114050}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14472":{"gid":14472,"name":"cephfs.smithi047.jsgfge","rank":1,"incarnation":13,"state":"up:stopping","state_seq":6,"addr":"172.21.15.47:6829/1833631011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1833631011},{"type":"v1","addr":"172.21.15.47:6829","nonce":1833631011}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:11.264 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-02-07T12:38:11.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.263+0000 7f16a486e640 1 -- 172.21.15.47:0/452230131 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f168c06d750 msgr2=0x7f168c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:11.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.263+0000 7f16a486e640 1 --2- 172.21.15.47:0/452230131 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f168c06d750 0x7f168c06fc00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1688034040 tx=0x7f1688009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.263+0000 7f16a486e640 1 -- 172.21.15.47:0/452230131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16a00fd330 msgr2=0x7f16a0112cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:11.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.263+0000 7f16a486e640 1 --2- 172.21.15.47:0/452230131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16a00fd330 0x7f16a0112cb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1690002a50 tx=0x7f1690004600 comp rx=0 tx=0).stop 2024-02-07T12:38:11.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.263+0000 7f16a486e640 1 -- 172.21.15.47:0/452230131 shutdown_connections 2024-02-07T12:38:11.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.263+0000 7f16a486e640 1 --2- 172.21.15.47:0/452230131 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f168c06d750 0x7f168c06fc00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.263+0000 7f16a486e640 1 --2- 172.21.15.47:0/452230131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16a00fdcd0 0x7f16a01131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.263+0000 7f16a486e640 1 --2- 172.21.15.47:0/452230131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16a00fd330 0x7f16a0112cb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.263+0000 7f16a486e640 1 -- 172.21.15.47:0/452230131 >> 172.21.15.47:0/452230131 conn(0x7f16a00f6e30 msgr2=0x7f16a0100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:11.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.263+0000 7f16a486e640 1 -- 172.21.15.47:0/452230131 shutdown_connections 2024-02-07T12:38:11.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.263+0000 7f16a486e640 1 -- 172.21.15.47:0/452230131 wait complete. 2024-02-07T12:38:11.276 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-02-07T12:38:11.277 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-02-07T12:38:11.277 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-02-07T12:38:11.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.376+0000 7f723ad9d640 1 -- 172.21.15.47:0/4045914919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234102d30 msgr2=0x7f72340fc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:11.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.376+0000 7f723ad9d640 1 --2- 172.21.15.47:0/4045914919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234102d30 0x7f72340fc3c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f72200048d0 tx=0x7f7220009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.376+0000 7f723ad9d640 1 -- 172.21.15.47:0/4045914919 shutdown_connections 2024-02-07T12:38:11.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.376+0000 7f723ad9d640 1 --2- 172.21.15.47:0/4045914919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234102d30 0x7f72340fc3c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.376+0000 7f723ad9d640 1 --2- 172.21.15.47:0/4045914919 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7234102390 0x7f7234102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.376+0000 7f723ad9d640 1 -- 172.21.15.47:0/4045914919 >> 172.21.15.47:0/4045914919 conn(0x7f72340f7fa0 msgr2=0x7f72340fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:11.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.376+0000 7f723ad9d640 1 -- 172.21.15.47:0/4045914919 shutdown_connections 2024-02-07T12:38:11.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.376+0000 7f723ad9d640 1 -- 172.21.15.47:0/4045914919 wait complete. 2024-02-07T12:38:11.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.376+0000 7f723ad9d640 1 Processor -- start 2024-02-07T12:38:11.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.377+0000 7f723ad9d640 1 -- start start 2024-02-07T12:38:11.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.377+0000 7f723ad9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7234102390 0x7f723406f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:11.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.377+0000 7f723ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234102d30 0x7f723406fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:11.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.377+0000 7f723ad9d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7234071740 con 0x7f7234102d30 2024-02-07T12:38:11.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.377+0000 7f723ad9d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7234070220 con 0x7f7234102390 2024-02-07T12:38:11.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.377+0000 7f7233fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234102d30 0x7f723406fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:11.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.377+0000 7f7233fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234102d30 0x7f723406fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34166/0 (socket says 172.21.15.47:34166) 2024-02-07T12:38:11.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.377+0000 7f7233fff640 1 -- 172.21.15.47:0/1451773261 learned_addr learned my addr 172.21.15.47:0/1451773261 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:11.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.377+0000 7f7238b39640 1 --2- 172.21.15.47:0/1451773261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7234102390 0x7f723406f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:11.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.377+0000 7f7233fff640 1 -- 172.21.15.47:0/1451773261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7234102390 msgr2=0x7f723406f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:11.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.377+0000 7f7233fff640 1 --2- 172.21.15.47:0/1451773261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7234102390 0x7f723406f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.377+0000 7f7233fff640 1 -- 172.21.15.47:0/1451773261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7220005040 con 0x7f7234102d30 2024-02-07T12:38:11.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.378+0000 7f7233fff640 1 --2- 172.21.15.47:0/1451773261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234102d30 0x7f723406fce0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f722002bda0 tx=0x7f7220009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:11.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.378+0000 7f72317fa640 1 -- 172.21.15.47:0/1451773261 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72200094c0 con 0x7f7234102d30 2024-02-07T12:38:11.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.378+0000 7f72317fa640 1 -- 172.21.15.47:0/1451773261 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7220032e50 con 0x7f7234102d30 2024-02-07T12:38:11.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.378+0000 7f723ad9d640 1 -- 172.21.15.47:0/1451773261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7234070470 con 0x7f7234102d30 2024-02-07T12:38:11.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.378+0000 7f72317fa640 1 -- 172.21.15.47:0/1451773261 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72200435f0 con 0x7f7234102d30 2024-02-07T12:38:11.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.378+0000 7f723ad9d640 1 -- 172.21.15.47:0/1451773261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7234119200 con 0x7f7234102d30 2024-02-07T12:38:11.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.379+0000 7f723ad9d640 1 -- 172.21.15.47:0/1451773261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7234064030 con 0x7f7234102d30 2024-02-07T12:38:11.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.379+0000 7f72317fa640 1 -- 172.21.15.47:0/1451773261 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f722002f070 con 0x7f7234102d30 2024-02-07T12:38:11.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.380+0000 7f72317fa640 1 --2- 172.21.15.47:0/1451773261 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f722406d760 0x7f722406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:11.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.380+0000 7f72317fa640 1 -- 172.21.15.47:0/1451773261 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f72200aee50 con 0x7f7234102d30 2024-02-07T12:38:11.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.380+0000 7f7238b39640 1 --2- 172.21.15.47:0/1451773261 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f722406d760 0x7f722406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:11.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.380+0000 7f7238b39640 1 --2- 172.21.15.47:0/1451773261 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f722406d760 0x7f722406fc10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7228004eb0 tx=0x7f722800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:11.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.384+0000 7f72317fa640 1 -- 172.21.15.47:0/1451773261 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f72200786a0 con 0x7f7234102d30 2024-02-07T12:38:11.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:11 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/635741496' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-07T12:38:11.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:11 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1543256561' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-07T12:38:11.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:11 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/452230131' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-07T12:38:11.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.603+0000 7f723ad9d640 1 -- 172.21.15.47:0/1451773261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f7234119420 con 0x7f7234102d30 2024-02-07T12:38:11.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.603+0000 7f72317fa640 1 -- 172.21.15.47:0/1451773261 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v48) v1 ==== 107+0+4850 (secure 0 0 0) 0x7f722007bd60 con 0x7f7234102d30 2024-02-07T12:38:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:11.606 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:32:58.615367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14460,"mds_1":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6827/3633114050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3633114050},{"type":"v1","addr":"172.21.15.47:6827","nonce":3633114050}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14472":{"gid":14472,"name":"cephfs.smithi047.jsgfge","rank":1,"incarnation":13,"state":"up:stopping","state_seq":6,"addr":"172.21.15.47:6829/1833631011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1833631011},{"type":"v1","addr":"172.21.15.47:6829","nonce":1833631011}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:11.606 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 26 2024-02-07T12:38:11.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.605+0000 7f723ad9d640 1 -- 172.21.15.47:0/1451773261 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f722406d760 msgr2=0x7f722406fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:11.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.605+0000 7f723ad9d640 1 --2- 172.21.15.47:0/1451773261 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f722406d760 0x7f722406fc10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7228004eb0 tx=0x7f722800b040 comp rx=0 tx=0).stop 2024-02-07T12:38:11.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.605+0000 7f723ad9d640 1 -- 172.21.15.47:0/1451773261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234102d30 msgr2=0x7f723406fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:11.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.605+0000 7f723ad9d640 1 --2- 172.21.15.47:0/1451773261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234102d30 0x7f723406fce0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f722002bda0 tx=0x7f7220009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.606+0000 7f723ad9d640 1 -- 172.21.15.47:0/1451773261 shutdown_connections 2024-02-07T12:38:11.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.606+0000 7f723ad9d640 1 --2- 172.21.15.47:0/1451773261 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f722406d760 0x7f722406fc10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.606+0000 7f723ad9d640 1 --2- 172.21.15.47:0/1451773261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234102d30 0x7f723406fce0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.606+0000 7f723ad9d640 1 --2- 172.21.15.47:0/1451773261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7234102390 0x7f723406f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.606+0000 7f723ad9d640 1 -- 172.21.15.47:0/1451773261 >> 172.21.15.47:0/1451773261 conn(0x7f72340f7fa0 msgr2=0x7f72340f9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:11.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.606+0000 7f723ad9d640 1 -- 172.21.15.47:0/1451773261 shutdown_connections 2024-02-07T12:38:11.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.606+0000 7f723ad9d640 1 -- 172.21.15.47:0/1451773261 wait complete. 2024-02-07T12:38:11.619 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-02-07T12:38:11.619 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-02-07T12:38:11.619 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-02-07T12:38:11.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.719+0000 7f44f535d640 1 -- 172.21.15.47:0/2658586570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f00fd3b0 msgr2=0x7f44f00fd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:11.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.719+0000 7f44f535d640 1 --2- 172.21.15.47:0/2658586570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f00fd3b0 0x7f44f00fd780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f44e00048d0 tx=0x7f44e0009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.719+0000 7f44f535d640 1 -- 172.21.15.47:0/2658586570 shutdown_connections 2024-02-07T12:38:11.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.719+0000 7f44f535d640 1 --2- 172.21.15.47:0/2658586570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44f00fdd50 0x7f44f0106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.719+0000 7f44f535d640 1 --2- 172.21.15.47:0/2658586570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f00fd3b0 0x7f44f00fd780 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.719+0000 7f44f535d640 1 -- 172.21.15.47:0/2658586570 >> 172.21.15.47:0/2658586570 conn(0x7f44f00f6e80 msgr2=0x7f44f00f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:11.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.719+0000 7f44f535d640 1 -- 172.21.15.47:0/2658586570 shutdown_connections 2024-02-07T12:38:11.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.719+0000 7f44f535d640 1 -- 172.21.15.47:0/2658586570 wait complete. 2024-02-07T12:38:11.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44f535d640 1 Processor -- start 2024-02-07T12:38:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44f535d640 1 -- start start 2024-02-07T12:38:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44f535d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44f00fd3b0 0x7f44f0112c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44f535d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f00fdd50 0x7f44f0113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44f535d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f0113760 con 0x7f44f00fdd50 2024-02-07T12:38:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44f535d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f010ccf0 con 0x7f44f00fd3b0 2024-02-07T12:38:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44ee7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f00fdd50 0x7f44f0113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44ee7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f00fdd50 0x7f44f0113160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34190/0 (socket says 172.21.15.47:34190) 2024-02-07T12:38:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44ee7fc640 1 -- 172.21.15.47:0/3975876795 learned_addr learned my addr 172.21.15.47:0/3975876795 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44eeffd640 1 --2- 172.21.15.47:0/3975876795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44f00fd3b0 0x7f44f0112c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44ee7fc640 1 -- 172.21.15.47:0/3975876795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44f00fd3b0 msgr2=0x7f44f0112c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44ee7fc640 1 --2- 172.21.15.47:0/3975876795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44f00fd3b0 0x7f44f0112c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44ee7fc640 1 -- 172.21.15.47:0/3975876795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0005040 con 0x7f44f00fdd50 2024-02-07T12:38:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.720+0000 7f44ee7fc640 1 --2- 172.21.15.47:0/3975876795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f00fdd50 0x7f44f0113160 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f44e4002a50 tx=0x7f44e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.721+0000 7f44d77fe640 1 -- 172.21.15.47:0/3975876795 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44e4007c30 con 0x7f44f00fdd50 2024-02-07T12:38:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.721+0000 7f44f535d640 1 -- 172.21.15.47:0/3975876795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f010cfd0 con 0x7f44f00fdd50 2024-02-07T12:38:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.721+0000 7f44d77fe640 1 -- 172.21.15.47:0/3975876795 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f44e400f040 con 0x7f44f00fdd50 2024-02-07T12:38:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.721+0000 7f44f535d640 1 -- 172.21.15.47:0/3975876795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f010d4f0 con 0x7f44f00fdd50 2024-02-07T12:38:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.721+0000 7f44d77fe640 1 -- 172.21.15.47:0/3975876795 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44e400dbe0 con 0x7f44f00fdd50 2024-02-07T12:38:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.722+0000 7f44f535d640 1 -- 172.21.15.47:0/3975876795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f00637a0 con 0x7f44f00fdd50 2024-02-07T12:38:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.722+0000 7f44d77fe640 1 -- 172.21.15.47:0/3975876795 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f44e401c400 con 0x7f44f00fdd50 2024-02-07T12:38:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.723+0000 7f44d77fe640 1 --2- 172.21.15.47:0/3975876795 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f44d806d750 0x7f44d806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.723+0000 7f44d77fe640 1 -- 172.21.15.47:0/3975876795 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f44e408cea0 con 0x7f44f00fdd50 2024-02-07T12:38:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.723+0000 7f44eeffd640 1 --2- 172.21.15.47:0/3975876795 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f44d806d750 0x7f44d806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.723+0000 7f44eeffd640 1 --2- 172.21.15.47:0/3975876795 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f44d806d750 0x7f44d806fc00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f44e0003080 tx=0x7f44e0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:11.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.727+0000 7f44d77fe640 1 -- 172.21.15.47:0/3975876795 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f44e4056640 con 0x7f44f00fdd50 2024-02-07T12:38:11.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:11 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/635741496' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-07T12:38:11.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:11 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1543256561' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-07T12:38:11.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:11 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/452230131' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-07T12:38:11.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.947+0000 7f44f535d640 1 -- 172.21.15.47:0/3975876795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f44f01094f0 con 0x7f44f00fdd50 2024-02-07T12:38:11.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.948+0000 7f44d77fe640 1 -- 172.21.15.47:0/3975876795 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v48) v1 ==== 107+0+4053 (secure 0 0 0) 0x7f44e4059d00 con 0x7f44f00fdd50 2024-02-07T12:38:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:11.950 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:33:23.616503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14460},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6827/3633114050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3633114050},{"type":"v1","addr":"172.21.15.47:6827","nonce":3633114050}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:11.950 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 27 2024-02-07T12:38:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.950+0000 7f44f535d640 1 -- 172.21.15.47:0/3975876795 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f44d806d750 msgr2=0x7f44d806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.950+0000 7f44f535d640 1 --2- 172.21.15.47:0/3975876795 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f44d806d750 0x7f44d806fc00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f44e0003080 tx=0x7f44e0009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.950+0000 7f44f535d640 1 -- 172.21.15.47:0/3975876795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f00fdd50 msgr2=0x7f44f0113160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.950+0000 7f44f535d640 1 --2- 172.21.15.47:0/3975876795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f00fdd50 0x7f44f0113160 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f44e4002a50 tx=0x7f44e4004600 comp rx=0 tx=0).stop 2024-02-07T12:38:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.950+0000 7f44f535d640 1 -- 172.21.15.47:0/3975876795 shutdown_connections 2024-02-07T12:38:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.950+0000 7f44f535d640 1 --2- 172.21.15.47:0/3975876795 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f44d806d750 0x7f44d806fc00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.950+0000 7f44f535d640 1 --2- 172.21.15.47:0/3975876795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f00fdd50 0x7f44f0113160 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.950+0000 7f44f535d640 1 --2- 172.21.15.47:0/3975876795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44f00fd3b0 0x7f44f0112c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.950+0000 7f44f535d640 1 -- 172.21.15.47:0/3975876795 >> 172.21.15.47:0/3975876795 conn(0x7f44f00f6e80 msgr2=0x7f44f0100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.950+0000 7f44f535d640 1 -- 172.21.15.47:0/3975876795 shutdown_connections 2024-02-07T12:38:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:11.950+0000 7f44f535d640 1 -- 172.21.15.47:0/3975876795 wait complete. 2024-02-07T12:38:11.963 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-02-07T12:38:11.963 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-02-07T12:38:11.963 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-02-07T12:38:12.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.065+0000 7f508c107640 1 -- 172.21.15.47:0/4259872623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5084101240 msgr2=0x7f5084101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:12.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.065+0000 7f508c107640 1 --2- 172.21.15.47:0/4259872623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5084101240 0x7f5084101610 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f507c0048d0 tx=0x7f507c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.065+0000 7f508c107640 1 -- 172.21.15.47:0/4259872623 shutdown_connections 2024-02-07T12:38:12.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.065+0000 7f508c107640 1 --2- 172.21.15.47:0/4259872623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5084101be0 0x7f50840fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.065+0000 7f508c107640 1 --2- 172.21.15.47:0/4259872623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5084101240 0x7f5084101610 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.065+0000 7f508c107640 1 -- 172.21.15.47:0/4259872623 >> 172.21.15.47:0/4259872623 conn(0x7f50840f6e10 msgr2=0x7f50840f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:12.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.065+0000 7f508c107640 1 -- 172.21.15.47:0/4259872623 shutdown_connections 2024-02-07T12:38:12.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.065+0000 7f508c107640 1 -- 172.21.15.47:0/4259872623 wait complete. 2024-02-07T12:38:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.066+0000 7f508c107640 1 Processor -- start 2024-02-07T12:38:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.066+0000 7f508c107640 1 -- start start 2024-02-07T12:38:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.066+0000 7f508c107640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5084101240 0x7f5084111ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.066+0000 7f508c107640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5084101be0 0x7f5084112000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.066+0000 7f508c107640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5084112600 con 0x7f5084101be0 2024-02-07T12:38:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.066+0000 7f508c107640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508410bb90 con 0x7f5084101240 2024-02-07T12:38:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.066+0000 7f50896a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5084101be0 0x7f5084112000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.066+0000 7f50896a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5084101be0 0x7f5084112000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34214/0 (socket says 172.21.15.47:34214) 2024-02-07T12:38:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.066+0000 7f50896a2640 1 -- 172.21.15.47:0/3317648241 learned_addr learned my addr 172.21.15.47:0/3317648241 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.066+0000 7f5089ea3640 1 --2- 172.21.15.47:0/3317648241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5084101240 0x7f5084111ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.066+0000 7f50896a2640 1 -- 172.21.15.47:0/3317648241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5084101240 msgr2=0x7f5084111ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.066+0000 7f50896a2640 1 --2- 172.21.15.47:0/3317648241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5084101240 0x7f5084111ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.066+0000 7f50896a2640 1 -- 172.21.15.47:0/3317648241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c005040 con 0x7f5084101be0 2024-02-07T12:38:12.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.067+0000 7f50896a2640 1 --2- 172.21.15.47:0/3317648241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5084101be0 0x7f5084112000 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f507800ead0 tx=0x7f50780044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:12.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.067+0000 7f50827fc640 1 -- 172.21.15.47:0/3317648241 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f507800cd10 con 0x7f5084101be0 2024-02-07T12:38:12.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.067+0000 7f50827fc640 1 -- 172.21.15.47:0/3317648241 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f507800ce70 con 0x7f5084101be0 2024-02-07T12:38:12.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.067+0000 7f508c107640 1 -- 172.21.15.47:0/3317648241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508410be10 con 0x7f5084101be0 2024-02-07T12:38:12.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.067+0000 7f50827fc640 1 -- 172.21.15.47:0/3317648241 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5078010a50 con 0x7f5084101be0 2024-02-07T12:38:12.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.067+0000 7f508c107640 1 -- 172.21.15.47:0/3317648241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508410c330 con 0x7f5084101be0 2024-02-07T12:38:12.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.068+0000 7f508c107640 1 -- 172.21.15.47:0/3317648241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5084064480 con 0x7f5084101be0 2024-02-07T12:38:12.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.068+0000 7f50827fc640 1 -- 172.21.15.47:0/3317648241 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f5078010cc0 con 0x7f5084101be0 2024-02-07T12:38:12.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.069+0000 7f50827fc640 1 --2- 172.21.15.47:0/3317648241 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f506c06d750 0x7f506c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:12.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.069+0000 7f50827fc640 1 -- 172.21.15.47:0/3317648241 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f507808fa10 con 0x7f5084101be0 2024-02-07T12:38:12.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.069+0000 7f5089ea3640 1 --2- 172.21.15.47:0/3317648241 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f506c06d750 0x7f506c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:12.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.069+0000 7f5089ea3640 1 --2- 172.21.15.47:0/3317648241 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f506c06d750 0x7f506c06fc00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f507c000c00 tx=0x7f507c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:12.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.074+0000 7f50827fc640 1 -- 172.21.15.47:0/3317648241 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f50780592e0 con 0x7f5084101be0 2024-02-07T12:38:12.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.297+0000 7f508c107640 1 -- 172.21.15.47:0/3317648241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f5084108380 con 0x7f5084101be0 2024-02-07T12:38:12.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.298+0000 7f50827fc640 1 -- 172.21.15.47:0/3317648241 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v48) v1 ==== 107+0+4832 (secure 0 0 0) 0x7f507805c9a0 con 0x7f5084101be0 2024-02-07T12:38:12.300 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:12.301 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34424,"name":"cephfs.smithi047.jsgfge","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6829/3387805936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3387805936},{"type":"v1","addr":"172.21.15.47:6829","nonce":3387805936}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:33:23.616503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14460},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6827/3633114050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3633114050},{"type":"v1","addr":"172.21.15.47:6827","nonce":3633114050}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:12.301 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 28 2024-02-07T12:38:12.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.300+0000 7f508c107640 1 -- 172.21.15.47:0/3317648241 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f506c06d750 msgr2=0x7f506c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:12.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.300+0000 7f508c107640 1 --2- 172.21.15.47:0/3317648241 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f506c06d750 0x7f506c06fc00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f507c000c00 tx=0x7f507c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.300+0000 7f508c107640 1 -- 172.21.15.47:0/3317648241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5084101be0 msgr2=0x7f5084112000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:12.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.300+0000 7f508c107640 1 --2- 172.21.15.47:0/3317648241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5084101be0 0x7f5084112000 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f507800ead0 tx=0x7f50780044c0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.301+0000 7f508c107640 1 -- 172.21.15.47:0/3317648241 shutdown_connections 2024-02-07T12:38:12.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.301+0000 7f508c107640 1 --2- 172.21.15.47:0/3317648241 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f506c06d750 0x7f506c06fc00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.301+0000 7f508c107640 1 --2- 172.21.15.47:0/3317648241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5084101be0 0x7f5084112000 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.301+0000 7f508c107640 1 --2- 172.21.15.47:0/3317648241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5084101240 0x7f5084111ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.301+0000 7f508c107640 1 -- 172.21.15.47:0/3317648241 >> 172.21.15.47:0/3317648241 conn(0x7f50840f6e10 msgr2=0x7f50840f88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:12.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.301+0000 7f508c107640 1 -- 172.21.15.47:0/3317648241 shutdown_connections 2024-02-07T12:38:12.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.301+0000 7f508c107640 1 -- 172.21.15.47:0/3317648241 wait complete. 2024-02-07T12:38:12.314 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-02-07T12:38:12.314 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-02-07T12:38:12.314 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-02-07T12:38:12.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.413+0000 7efe61e6e640 1 -- 172.21.15.47:0/2450478320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe5c1012d0 msgr2=0x7efe5c1016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.413+0000 7efe61e6e640 1 --2- 172.21.15.47:0/2450478320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe5c1012d0 0x7efe5c1016a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efe500048d0 tx=0x7efe50009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.413+0000 7efe61e6e640 1 -- 172.21.15.47:0/2450478320 shutdown_connections 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.413+0000 7efe61e6e640 1 --2- 172.21.15.47:0/2450478320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe5c0fb2b0 0x7efe5c0fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.413+0000 7efe61e6e640 1 --2- 172.21.15.47:0/2450478320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe5c1012d0 0x7efe5c1016a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.413+0000 7efe61e6e640 1 -- 172.21.15.47:0/2450478320 >> 172.21.15.47:0/2450478320 conn(0x7efe5c071230 msgr2=0x7efe5c071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.413+0000 7efe61e6e640 1 -- 172.21.15.47:0/2450478320 shutdown_connections 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.413+0000 7efe61e6e640 1 -- 172.21.15.47:0/2450478320 wait complete. 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.413+0000 7efe61e6e640 1 Processor -- start 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.413+0000 7efe61e6e640 1 -- start start 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe61e6e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe5c0fb2b0 0x7efe5c10dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe61e6e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe5c1012d0 0x7efe5c10e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe61e6e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c10e780 con 0x7efe5c1012d0 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe61e6e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c10e8f0 con 0x7efe5c0fb2b0 2024-02-07T12:38:12.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe5affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe5c1012d0 0x7efe5c10e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:12.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe5affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe5c1012d0 0x7efe5c10e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34242/0 (socket says 172.21.15.47:34242) 2024-02-07T12:38:12.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe5affd640 1 -- 172.21.15.47:0/2681622473 learned_addr learned my addr 172.21.15.47:0/2681622473 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:12.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe5b7fe640 1 --2- 172.21.15.47:0/2681622473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe5c0fb2b0 0x7efe5c10dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:12.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe5affd640 1 -- 172.21.15.47:0/2681622473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe5c0fb2b0 msgr2=0x7efe5c10dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:12.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe5affd640 1 --2- 172.21.15.47:0/2681622473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe5c0fb2b0 0x7efe5c10dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe5affd640 1 -- 172.21.15.47:0/2681622473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe50005040 con 0x7efe5c1012d0 2024-02-07T12:38:12.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe5affd640 1 --2- 172.21.15.47:0/2681622473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe5c1012d0 0x7efe5c10e240 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efe4c002a50 tx=0x7efe4c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:12.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe43fff640 1 -- 172.21.15.47:0/2681622473 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe4c007c30 con 0x7efe5c1012d0 2024-02-07T12:38:12.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.414+0000 7efe61e6e640 1 -- 172.21.15.47:0/2681622473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c116d70 con 0x7efe5c1012d0 2024-02-07T12:38:12.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.415+0000 7efe43fff640 1 -- 172.21.15.47:0/2681622473 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe4c00f040 con 0x7efe5c1012d0 2024-02-07T12:38:12.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.415+0000 7efe61e6e640 1 -- 172.21.15.47:0/2681622473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5c1170a0 con 0x7efe5c1012d0 2024-02-07T12:38:12.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.415+0000 7efe43fff640 1 -- 172.21.15.47:0/2681622473 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe4c00db50 con 0x7efe5c1012d0 2024-02-07T12:38:12.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.416+0000 7efe61e6e640 1 -- 172.21.15.47:0/2681622473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c064030 con 0x7efe5c1012d0 2024-02-07T12:38:12.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.416+0000 7efe43fff640 1 -- 172.21.15.47:0/2681622473 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7efe4c01c400 con 0x7efe5c1012d0 2024-02-07T12:38:12.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.416+0000 7efe43fff640 1 --2- 172.21.15.47:0/2681622473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efe4406d750 0x7efe4406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:12.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.417+0000 7efe43fff640 1 -- 172.21.15.47:0/2681622473 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efe4c08c790 con 0x7efe5c1012d0 2024-02-07T12:38:12.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.417+0000 7efe5b7fe640 1 --2- 172.21.15.47:0/2681622473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efe4406d750 0x7efe4406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:12.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.417+0000 7efe5b7fe640 1 --2- 172.21.15.47:0/2681622473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efe4406d750 0x7efe4406fc00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efe50000c00 tx=0x7efe50009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:12.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.421+0000 7efe43fff640 1 -- 172.21.15.47:0/2681622473 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efe4c055fe0 con 0x7efe5c1012d0 2024-02-07T12:38:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:12 smithi047 ceph-mon[93224]: pgmap v331: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:38:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:12 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1451773261' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-07T12:38:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:38:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:38:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:12 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3975876795' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-07T12:38:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:38:12.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:12 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:38:12.576 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:12 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3317648241' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-07T12:38:12.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.644+0000 7efe61e6e640 1 -- 172.21.15.47:0/2681622473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7efe5c1083c0 con 0x7efe5c1012d0 2024-02-07T12:38:12.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.644+0000 7efe43fff640 1 -- 172.21.15.47:0/2681622473 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v48) v1 ==== 107+0+4044 (secure 0 0 0) 0x7efe4c0596a0 con 0x7efe5c1012d0 2024-02-07T12:38:12.647 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:12.647 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34424,"name":"cephfs.smithi047.jsgfge","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6829/3387805936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3387805936},{"type":"v1","addr":"172.21.15.47:6829","nonce":3387805936}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:33:37.430671+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:12.647 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-02-07T12:38:12.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.648+0000 7efe61e6e640 1 -- 172.21.15.47:0/2681622473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efe4406d750 msgr2=0x7efe4406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:12.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.648+0000 7efe61e6e640 1 --2- 172.21.15.47:0/2681622473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efe4406d750 0x7efe4406fc00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efe50000c00 tx=0x7efe50009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.648+0000 7efe61e6e640 1 -- 172.21.15.47:0/2681622473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe5c1012d0 msgr2=0x7efe5c10e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:12.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.648+0000 7efe61e6e640 1 --2- 172.21.15.47:0/2681622473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe5c1012d0 0x7efe5c10e240 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efe4c002a50 tx=0x7efe4c004600 comp rx=0 tx=0).stop 2024-02-07T12:38:12.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.648+0000 7efe61e6e640 1 -- 172.21.15.47:0/2681622473 shutdown_connections 2024-02-07T12:38:12.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.648+0000 7efe61e6e640 1 --2- 172.21.15.47:0/2681622473 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7efe4406d750 0x7efe4406fc00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.648+0000 7efe61e6e640 1 --2- 172.21.15.47:0/2681622473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe5c1012d0 0x7efe5c10e240 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.648+0000 7efe61e6e640 1 --2- 172.21.15.47:0/2681622473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe5c0fb2b0 0x7efe5c10dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.648+0000 7efe61e6e640 1 -- 172.21.15.47:0/2681622473 >> 172.21.15.47:0/2681622473 conn(0x7efe5c071230 msgr2=0x7efe5c0fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:12.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.648+0000 7efe61e6e640 1 -- 172.21.15.47:0/2681622473 shutdown_connections 2024-02-07T12:38:12.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.648+0000 7efe61e6e640 1 -- 172.21.15.47:0/2681622473 wait complete. 2024-02-07T12:38:12.663 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-02-07T12:38:12.663 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-02-07T12:38:12.664 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-02-07T12:38:12.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.764+0000 7feb9c79d640 1 -- 172.21.15.47:0/947837292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb94102cf0 msgr2=0x7feb940fc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:12.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.764+0000 7feb9c79d640 1 --2- 172.21.15.47:0/947837292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb94102cf0 0x7feb940fc380 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7feb840048d0 tx=0x7feb84009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.764+0000 7feb9c79d640 1 -- 172.21.15.47:0/947837292 shutdown_connections 2024-02-07T12:38:12.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.764+0000 7feb9c79d640 1 --2- 172.21.15.47:0/947837292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb94102cf0 0x7feb940fc380 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.764+0000 7feb9c79d640 1 --2- 172.21.15.47:0/947837292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb94102350 0x7feb94102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.764+0000 7feb9c79d640 1 -- 172.21.15.47:0/947837292 >> 172.21.15.47:0/947837292 conn(0x7feb940f7ee0 msgr2=0x7feb940fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:12.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.764+0000 7feb9c79d640 1 -- 172.21.15.47:0/947837292 shutdown_connections 2024-02-07T12:38:12.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.764+0000 7feb9c79d640 1 -- 172.21.15.47:0/947837292 wait complete. 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.764+0000 7feb9c79d640 1 Processor -- start 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb9c79d640 1 -- start start 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb9c79d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb94102350 0x7feb94112c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb9c79d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb94102cf0 0x7feb94113140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb9c79d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb94113740 con 0x7feb94102350 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb9c79d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9410ccd0 con 0x7feb94102cf0 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb9a539640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb94102350 0x7feb94112c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb9a539640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb94102350 0x7feb94112c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34266/0 (socket says 172.21.15.47:34266) 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb9a539640 1 -- 172.21.15.47:0/2455243454 learned_addr learned my addr 172.21.15.47:0/2455243454 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb99d38640 1 --2- 172.21.15.47:0/2455243454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb94102cf0 0x7feb94113140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb9a539640 1 -- 172.21.15.47:0/2455243454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb94102cf0 msgr2=0x7feb94113140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb9a539640 1 --2- 172.21.15.47:0/2455243454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb94102cf0 0x7feb94113140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb9a539640 1 -- 172.21.15.47:0/2455243454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb84005040 con 0x7feb94102350 2024-02-07T12:38:12.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb9a539640 1 --2- 172.21.15.47:0/2455243454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb94102350 0x7feb94112c00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7feb90002a50 tx=0x7feb90004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.765+0000 7feb8affd640 1 -- 172.21.15.47:0/2455243454 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb90007c30 con 0x7feb94102350 2024-02-07T12:38:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.766+0000 7feb9c79d640 1 -- 172.21.15.47:0/2455243454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9410cfb0 con 0x7feb94102350 2024-02-07T12:38:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.766+0000 7feb8affd640 1 -- 172.21.15.47:0/2455243454 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb9000f040 con 0x7feb94102350 2024-02-07T12:38:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.766+0000 7feb8affd640 1 -- 172.21.15.47:0/2455243454 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb9000db50 con 0x7feb94102350 2024-02-07T12:38:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.766+0000 7feb9c79d640 1 -- 172.21.15.47:0/2455243454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9410d4a0 con 0x7feb94102350 2024-02-07T12:38:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.766+0000 7feb9c79d640 1 -- 172.21.15.47:0/2455243454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb94064480 con 0x7feb94102350 2024-02-07T12:38:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.767+0000 7feb8affd640 1 -- 172.21.15.47:0/2455243454 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7feb9001c400 con 0x7feb94102350 2024-02-07T12:38:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.767+0000 7feb8affd640 1 --2- 172.21.15.47:0/2455243454 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7feb8006d750 0x7feb8006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.767+0000 7feb8affd640 1 -- 172.21.15.47:0/2455243454 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7feb9008c7b0 con 0x7feb94102350 2024-02-07T12:38:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.767+0000 7feb99d38640 1 --2- 172.21.15.47:0/2455243454 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7feb8006d750 0x7feb8006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.768+0000 7feb99d38640 1 --2- 172.21.15.47:0/2455243454 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7feb8006d750 0x7feb8006fc00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feb9410de10 tx=0x7feb84009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:12.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:12.772+0000 7feb8affd640 1 -- 172.21.15.47:0/2455243454 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feb90056000 con 0x7feb94102350 2024-02-07T12:38:12.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:12 smithi138 ceph-mon[82055]: pgmap v331: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-07T12:38:12.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:12 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1451773261' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-07T12:38:12.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-07T12:38:12.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-07T12:38:12.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:12 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3975876795' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-07T12:38:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:38:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:12 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:38:12.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:12 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3317648241' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-07T12:38:13.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.012+0000 7feb9c79d640 1 -- 172.21.15.47:0/2455243454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7feb9410d6c0 con 0x7feb94102350 2024-02-07T12:38:13.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.012+0000 7feb8affd640 1 -- 172.21.15.47:0/2455243454 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v48) v1 ==== 107+0+4055 (secure 0 0 0) 0x7feb900596c0 con 0x7feb94102350 2024-02-07T12:38:13.015 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:13.015 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:33:37.435335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34424},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34424":{"gid":34424,"name":"cephfs.smithi047.jsgfge","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.47:6829/3387805936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3387805936},{"type":"v1","addr":"172.21.15.47:6829","nonce":3387805936}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:13.015 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 30 2024-02-07T12:38:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.014+0000 7feb9c79d640 1 -- 172.21.15.47:0/2455243454 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7feb8006d750 msgr2=0x7feb8006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.014+0000 7feb9c79d640 1 --2- 172.21.15.47:0/2455243454 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7feb8006d750 0x7feb8006fc00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feb9410de10 tx=0x7feb84009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.014+0000 7feb9c79d640 1 -- 172.21.15.47:0/2455243454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb94102350 msgr2=0x7feb94112c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.014+0000 7feb9c79d640 1 --2- 172.21.15.47:0/2455243454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb94102350 0x7feb94112c00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7feb90002a50 tx=0x7feb90004600 comp rx=0 tx=0).stop 2024-02-07T12:38:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.014+0000 7feb9c79d640 1 -- 172.21.15.47:0/2455243454 shutdown_connections 2024-02-07T12:38:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.014+0000 7feb9c79d640 1 --2- 172.21.15.47:0/2455243454 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7feb8006d750 0x7feb8006fc00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.014+0000 7feb9c79d640 1 --2- 172.21.15.47:0/2455243454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb94102cf0 0x7feb94113140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.014+0000 7feb9c79d640 1 --2- 172.21.15.47:0/2455243454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb94102350 0x7feb94112c00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.014+0000 7feb9c79d640 1 -- 172.21.15.47:0/2455243454 >> 172.21.15.47:0/2455243454 conn(0x7feb940f7ee0 msgr2=0x7feb940f9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.015+0000 7feb9c79d640 1 -- 172.21.15.47:0/2455243454 shutdown_connections 2024-02-07T12:38:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.015+0000 7feb9c79d640 1 -- 172.21.15.47:0/2455243454 wait complete. 2024-02-07T12:38:13.027 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-02-07T12:38:13.027 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-02-07T12:38:13.028 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-02-07T12:38:13.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.124+0000 7f64088ae640 1 -- 172.21.15.47:0/2428977904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64040fb2b0 msgr2=0x7f64040fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.124+0000 7f64088ae640 1 --2- 172.21.15.47:0/2428977904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64040fb2b0 0x7f64040fb700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f63f80048d0 tx=0x7f63f8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.124+0000 7f64088ae640 1 -- 172.21.15.47:0/2428977904 shutdown_connections 2024-02-07T12:38:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.124+0000 7f64088ae640 1 --2- 172.21.15.47:0/2428977904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64040fb2b0 0x7f64040fb700 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.124+0000 7f64088ae640 1 --2- 172.21.15.47:0/2428977904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64041012d0 0x7f64041016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.124+0000 7f64088ae640 1 -- 172.21.15.47:0/2428977904 >> 172.21.15.47:0/2428977904 conn(0x7f6404071230 msgr2=0x7f6404071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.125+0000 7f64088ae640 1 -- 172.21.15.47:0/2428977904 shutdown_connections 2024-02-07T12:38:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.125+0000 7f64088ae640 1 -- 172.21.15.47:0/2428977904 wait complete. 2024-02-07T12:38:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.125+0000 7f64088ae640 1 Processor -- start 2024-02-07T12:38:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.125+0000 7f64088ae640 1 -- start start 2024-02-07T12:38:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.125+0000 7f64088ae640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64040fb2b0 0x7f6404111ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.125+0000 7f64088ae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64041012d0 0x7f6404111ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.125+0000 7f64088ae640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64041125f0 con 0x7f64041012d0 2024-02-07T12:38:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.125+0000 7f64088ae640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6404112760 con 0x7f64040fb2b0 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.125+0000 7f6401d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64041012d0 0x7f6404111ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.125+0000 7f6401d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64041012d0 0x7f6404111ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34286/0 (socket says 172.21.15.47:34286) 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.125+0000 7f6401d9b640 1 -- 172.21.15.47:0/1652823995 learned_addr learned my addr 172.21.15.47:0/1652823995 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.125+0000 7f640259c640 1 --2- 172.21.15.47:0/1652823995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64040fb2b0 0x7f6404111ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.126+0000 7f6401d9b640 1 -- 172.21.15.47:0/1652823995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64040fb2b0 msgr2=0x7f6404111ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.126+0000 7f6401d9b640 1 --2- 172.21.15.47:0/1652823995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64040fb2b0 0x7f6404111ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.126+0000 7f6401d9b640 1 -- 172.21.15.47:0/1652823995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8005040 con 0x7f64041012d0 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.126+0000 7f640259c640 1 --2- 172.21.15.47:0/1652823995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64040fb2b0 0x7f6404111ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.126+0000 7f6401d9b640 1 --2- 172.21.15.47:0/1652823995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64041012d0 0x7f6404111ff0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f63f8031720 tx=0x7f63f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.126+0000 7f63f2ffd640 1 -- 172.21.15.47:0/1652823995 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f80094c0 con 0x7f64041012d0 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.126+0000 7f63f2ffd640 1 -- 172.21.15.47:0/1652823995 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f63f8009620 con 0x7f64041012d0 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.126+0000 7f63f2ffd640 1 -- 172.21.15.47:0/1652823995 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f803b640 con 0x7f64041012d0 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.126+0000 7f64088ae640 1 -- 172.21.15.47:0/1652823995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640410bcd0 con 0x7f64041012d0 2024-02-07T12:38:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.126+0000 7f64088ae640 1 -- 172.21.15.47:0/1652823995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640410c1a0 con 0x7f64041012d0 2024-02-07T12:38:13.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.127+0000 7f64088ae640 1 -- 172.21.15.47:0/1652823995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6404064030 con 0x7f64041012d0 2024-02-07T12:38:13.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.127+0000 7f63f2ffd640 1 -- 172.21.15.47:0/1652823995 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f63f802f070 con 0x7f64041012d0 2024-02-07T12:38:13.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.128+0000 7f63f2ffd640 1 --2- 172.21.15.47:0/1652823995 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f63ec06d750 0x7f63ec06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:13.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.128+0000 7f63f2ffd640 1 -- 172.21.15.47:0/1652823995 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f63f80af520 con 0x7f64041012d0 2024-02-07T12:38:13.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.128+0000 7f640259c640 1 --2- 172.21.15.47:0/1652823995 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f63ec06d750 0x7f63ec06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:13.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.128+0000 7f640259c640 1 --2- 172.21.15.47:0/1652823995 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f63ec06d750 0x7f63ec06fc00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009fd0 tx=0x7f63fc009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:13.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.132+0000 7f63f2ffd640 1 -- 172.21.15.47:0/1652823995 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f63f8078cc0 con 0x7f64041012d0 2024-02-07T12:38:13.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.353+0000 7f64088ae640 1 -- 172.21.15.47:0/1652823995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f640410c380 con 0x7f64041012d0 2024-02-07T12:38:13.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.353+0000 7f63f2ffd640 1 -- 172.21.15.47:0/1652823995 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v48) v1 ==== 107+0+4058 (secure 0 0 0) 0x7f63f807c380 con 0x7f64041012d0 2024-02-07T12:38:13.356 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:13.356 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:33:44.626102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34424},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34424":{"gid":34424,"name":"cephfs.smithi047.jsgfge","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":7,"addr":"172.21.15.47:6829/3387805936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3387805936},{"type":"v1","addr":"172.21.15.47:6829","nonce":3387805936}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:13.356 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 31 2024-02-07T12:38:13.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.355+0000 7f64088ae640 1 -- 172.21.15.47:0/1652823995 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f63ec06d750 msgr2=0x7f63ec06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:13.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.355+0000 7f64088ae640 1 --2- 172.21.15.47:0/1652823995 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f63ec06d750 0x7f63ec06fc00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009fd0 tx=0x7f63fc009e50 comp rx=0 tx=0).stop 2024-02-07T12:38:13.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.355+0000 7f64088ae640 1 -- 172.21.15.47:0/1652823995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64041012d0 msgr2=0x7f6404111ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:13.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.355+0000 7f64088ae640 1 --2- 172.21.15.47:0/1652823995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64041012d0 0x7f6404111ff0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f63f8031720 tx=0x7f63f8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.355+0000 7f64088ae640 1 -- 172.21.15.47:0/1652823995 shutdown_connections 2024-02-07T12:38:13.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.355+0000 7f64088ae640 1 --2- 172.21.15.47:0/1652823995 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f63ec06d750 0x7f63ec06fc00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.355+0000 7f64088ae640 1 --2- 172.21.15.47:0/1652823995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64041012d0 0x7f6404111ff0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.355+0000 7f64088ae640 1 --2- 172.21.15.47:0/1652823995 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64040fb2b0 0x7f6404111ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.355+0000 7f64088ae640 1 -- 172.21.15.47:0/1652823995 >> 172.21.15.47:0/1652823995 conn(0x7f6404071230 msgr2=0x7f64040fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:13.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.355+0000 7f64088ae640 1 -- 172.21.15.47:0/1652823995 shutdown_connections 2024-02-07T12:38:13.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.355+0000 7f64088ae640 1 -- 172.21.15.47:0/1652823995 wait complete. 2024-02-07T12:38:13.368 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-02-07T12:38:13.369 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-02-07T12:38:13.369 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-02-07T12:38:13.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.466+0000 7fa92531d640 1 -- 172.21.15.47:0/2655272575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9200fd340 msgr2=0x7fa9200fd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:13.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.466+0000 7fa92531d640 1 --2- 172.21.15.47:0/2655272575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9200fd340 0x7fa9200fd710 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa918004900 tx=0x7fa918009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.466+0000 7fa92531d640 1 -- 172.21.15.47:0/2655272575 shutdown_connections 2024-02-07T12:38:13.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.466+0000 7fa92531d640 1 --2- 172.21.15.47:0/2655272575 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9200fdce0 0x7fa9201063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.466+0000 7fa92531d640 1 --2- 172.21.15.47:0/2655272575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9200fd340 0x7fa9200fd710 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.466+0000 7fa92531d640 1 -- 172.21.15.47:0/2655272575 >> 172.21.15.47:0/2655272575 conn(0x7fa9200f6e00 msgr2=0x7fa9200f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:13.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.466+0000 7fa92531d640 1 -- 172.21.15.47:0/2655272575 shutdown_connections 2024-02-07T12:38:13.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.466+0000 7fa92531d640 1 -- 172.21.15.47:0/2655272575 wait complete. 2024-02-07T12:38:13.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.467+0000 7fa92531d640 1 Processor -- start 2024-02-07T12:38:13.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.467+0000 7fa92531d640 1 -- start start 2024-02-07T12:38:13.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.467+0000 7fa92531d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9200fd340 0x7fa920112d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:13.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.467+0000 7fa92531d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9200fdce0 0x7fa920113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:13.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.467+0000 7fa92531d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9201138d0 con 0x7fa9200fdce0 2024-02-07T12:38:13.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.467+0000 7fa92531d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92010cdd0 con 0x7fa9200fd340 2024-02-07T12:38:13.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.467+0000 7fa91e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9200fdce0 0x7fa920113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:13.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.467+0000 7fa91e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9200fdce0 0x7fa920113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34296/0 (socket says 172.21.15.47:34296) 2024-02-07T12:38:13.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.467+0000 7fa91e7fc640 1 -- 172.21.15.47:0/31951552 learned_addr learned my addr 172.21.15.47:0/31951552 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:13.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.467+0000 7fa91effd640 1 --2- 172.21.15.47:0/31951552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9200fd340 0x7fa920112d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:13.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.467+0000 7fa91e7fc640 1 -- 172.21.15.47:0/31951552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9200fd340 msgr2=0x7fa920112d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:13.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.467+0000 7fa91e7fc640 1 --2- 172.21.15.47:0/31951552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9200fd340 0x7fa920112d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.467+0000 7fa91e7fc640 1 -- 172.21.15.47:0/31951552 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa918005040 con 0x7fa9200fdce0 2024-02-07T12:38:13.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.468+0000 7fa91e7fc640 1 --2- 172.21.15.47:0/31951552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9200fdce0 0x7fa920113240 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa90800b790 tx=0x7fa9080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:13.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.468+0000 7fa9177fe640 1 -- 172.21.15.47:0/31951552 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa90800c700 con 0x7fa9200fdce0 2024-02-07T12:38:13.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.468+0000 7fa9177fe640 1 -- 172.21.15.47:0/31951552 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa90800cd30 con 0x7fa9200fdce0 2024-02-07T12:38:13.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.468+0000 7fa92531d640 1 -- 172.21.15.47:0/31951552 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92010d0b0 con 0x7fa9200fdce0 2024-02-07T12:38:13.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.468+0000 7fa9177fe640 1 -- 172.21.15.47:0/31951552 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa908013370 con 0x7fa9200fdce0 2024-02-07T12:38:13.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.468+0000 7fa92531d640 1 -- 172.21.15.47:0/31951552 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92010d5d0 con 0x7fa9200fdce0 2024-02-07T12:38:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.469+0000 7fa92531d640 1 -- 172.21.15.47:0/31951552 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa920064480 con 0x7fa9200fdce0 2024-02-07T12:38:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.469+0000 7fa9177fe640 1 -- 172.21.15.47:0/31951552 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa908012070 con 0x7fa9200fdce0 2024-02-07T12:38:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.469+0000 7fa9177fe640 1 --2- 172.21.15.47:0/31951552 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa90c06d750 0x7fa90c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.470+0000 7fa9177fe640 1 -- 172.21.15.47:0/31951552 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa90808cba0 con 0x7fa9200fdce0 2024-02-07T12:38:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.470+0000 7fa91effd640 1 --2- 172.21.15.47:0/31951552 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa90c06d750 0x7fa90c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.470+0000 7fa91effd640 1 --2- 172.21.15.47:0/31951552 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa90c06d750 0x7fa90c06fc00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa918009a30 tx=0x7fa918009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:13.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.474+0000 7fa9177fe640 1 -- 172.21.15.47:0/31951552 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa908056340 con 0x7fa9200fdce0 2024-02-07T12:38:13.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.693+0000 7fa92531d640 1 -- 172.21.15.47:0/31951552 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fa920109510 con 0x7fa9200fdce0 2024-02-07T12:38:13.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.694+0000 7fa9177fe640 1 -- 172.21.15.47:0/31951552 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v48) v1 ==== 107+0+4055 (secure 0 0 0) 0x7fa908059a00 con 0x7fa9200fdce0 2024-02-07T12:38:13.696 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:13.696 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:33:45.535417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34424},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34424":{"gid":34424,"name":"cephfs.smithi047.jsgfge","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":8,"addr":"172.21.15.47:6829/3387805936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3387805936},{"type":"v1","addr":"172.21.15.47:6829","nonce":3387805936}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 32 2024-02-07T12:38:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.696+0000 7fa92531d640 1 -- 172.21.15.47:0/31951552 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa90c06d750 msgr2=0x7fa90c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.696+0000 7fa92531d640 1 --2- 172.21.15.47:0/31951552 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa90c06d750 0x7fa90c06fc00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa918009a30 tx=0x7fa918009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.696+0000 7fa92531d640 1 -- 172.21.15.47:0/31951552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9200fdce0 msgr2=0x7fa920113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.696+0000 7fa92531d640 1 --2- 172.21.15.47:0/31951552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9200fdce0 0x7fa920113240 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa90800b790 tx=0x7fa9080091d0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.696+0000 7fa92531d640 1 -- 172.21.15.47:0/31951552 shutdown_connections 2024-02-07T12:38:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.696+0000 7fa92531d640 1 --2- 172.21.15.47:0/31951552 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa90c06d750 0x7fa90c06fc00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.696+0000 7fa92531d640 1 --2- 172.21.15.47:0/31951552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9200fdce0 0x7fa920113240 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.696+0000 7fa92531d640 1 --2- 172.21.15.47:0/31951552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9200fd340 0x7fa920112d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.696+0000 7fa92531d640 1 -- 172.21.15.47:0/31951552 >> 172.21.15.47:0/31951552 conn(0x7fa9200f6e00 msgr2=0x7fa920100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.696+0000 7fa92531d640 1 -- 172.21.15.47:0/31951552 shutdown_connections 2024-02-07T12:38:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.696+0000 7fa92531d640 1 -- 172.21.15.47:0/31951552 wait complete. 2024-02-07T12:38:13.708 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:13 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2681622473' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-07T12:38:13.708 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:13 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:38:13.708 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:13 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:38:13.708 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:13 smithi047 ceph-mon[93224]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:38:13.708 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:13 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2455243454' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-07T12:38:13.708 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:13 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1652823995' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-07T12:38:13.709 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-02-07T12:38:13.709 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-02-07T12:38:13.710 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-02-07T12:38:13.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:13 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2681622473' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-07T12:38:13.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:13 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-07T12:38:13.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:13 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-07T12:38:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:13 smithi138 ceph-mon[82055]: from='mgr.34104 172.21.15.47:0/929316692' entity='mgr.smithi047.zhgnrm' 2024-02-07T12:38:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:13 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2455243454' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-07T12:38:13.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:13 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1652823995' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-07T12:38:13.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.807+0000 7f8fd446e640 1 -- 172.21.15.47:0/3724999797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fcc0644b0 msgr2=0x7f8fcc0648e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:13.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.807+0000 7f8fd446e640 1 --2- 172.21.15.47:0/3724999797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fcc0644b0 0x7f8fcc0648e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0048d0 tx=0x7f8fbc009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.807+0000 7f8fd446e640 1 -- 172.21.15.47:0/3724999797 shutdown_connections 2024-02-07T12:38:13.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.807+0000 7f8fd446e640 1 --2- 172.21.15.47:0/3724999797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fcc0644b0 0x7f8fcc0648e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.807+0000 7f8fd446e640 1 --2- 172.21.15.47:0/3724999797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fcc1023e0 0x7f8fcc1027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.807+0000 7f8fd446e640 1 -- 172.21.15.47:0/3724999797 >> 172.21.15.47:0/3724999797 conn(0x7f8fcc071230 msgr2=0x7f8fcc071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:13.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.807+0000 7f8fd446e640 1 -- 172.21.15.47:0/3724999797 shutdown_connections 2024-02-07T12:38:13.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.807+0000 7f8fd446e640 1 -- 172.21.15.47:0/3724999797 wait complete. 2024-02-07T12:38:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.807+0000 7f8fd446e640 1 Processor -- start 2024-02-07T12:38:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.807+0000 7f8fd446e640 1 -- start start 2024-02-07T12:38:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd446e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fcc0644b0 0x7f8fcc0fb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd446e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fcc1023e0 0x7f8fcc0fb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd446e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0fbe00 con 0x7f8fcc1023e0 2024-02-07T12:38:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd446e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0fbf70 con 0x7f8fcc0644b0 2024-02-07T12:38:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd1a09640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fcc1023e0 0x7f8fcc0fb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd1a09640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fcc1023e0 0x7f8fcc0fb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34314/0 (socket says 172.21.15.47:34314) 2024-02-07T12:38:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd1a09640 1 -- 172.21.15.47:0/3171747078 learned_addr learned my addr 172.21.15.47:0/3171747078 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd220a640 1 --2- 172.21.15.47:0/3171747078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fcc0644b0 0x7f8fcc0fb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd1a09640 1 -- 172.21.15.47:0/3171747078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fcc0644b0 msgr2=0x7f8fcc0fb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd1a09640 1 --2- 172.21.15.47:0/3171747078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fcc0644b0 0x7f8fcc0fb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd1a09640 1 -- 172.21.15.47:0/3171747078 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc005040 con 0x7f8fcc1023e0 2024-02-07T12:38:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd220a640 1 --2- 172.21.15.47:0/3171747078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fcc0644b0 0x7f8fcc0fb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:38:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd1a09640 1 --2- 172.21.15.47:0/3171747078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fcc1023e0 0x7f8fcc0fb8c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc031720 tx=0x7f8fbc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fc2ffd640 1 -- 172.21.15.47:0/3171747078 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fbc0094c0 con 0x7f8fcc1023e0 2024-02-07T12:38:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd446e640 1 -- 172.21.15.47:0/3171747078 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc0fc1f0 con 0x7f8fcc1023e0 2024-02-07T12:38:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fc2ffd640 1 -- 172.21.15.47:0/3171747078 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8fbc009620 con 0x7f8fcc1023e0 2024-02-07T12:38:13.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fc2ffd640 1 -- 172.21.15.47:0/3171747078 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fbc03b640 con 0x7f8fcc1023e0 2024-02-07T12:38:13.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.808+0000 7f8fd446e640 1 -- 172.21.15.47:0/3171747078 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc119360 con 0x7f8fcc1023e0 2024-02-07T12:38:13.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.809+0000 7f8fd446e640 1 -- 172.21.15.47:0/3171747078 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fcc064030 con 0x7f8fcc1023e0 2024-02-07T12:38:13.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.810+0000 7f8fc2ffd640 1 -- 172.21.15.47:0/3171747078 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8fbc02f070 con 0x7f8fcc1023e0 2024-02-07T12:38:13.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.810+0000 7f8fc2ffd640 1 --2- 172.21.15.47:0/3171747078 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8fb806d750 0x7f8fb806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:13.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.810+0000 7f8fc2ffd640 1 -- 172.21.15.47:0/3171747078 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8fbc0af2c0 con 0x7f8fcc1023e0 2024-02-07T12:38:13.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.810+0000 7f8fd220a640 1 --2- 172.21.15.47:0/3171747078 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8fb806d750 0x7f8fb806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:13.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.811+0000 7f8fd220a640 1 --2- 172.21.15.47:0/3171747078 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8fb806d750 0x7f8fb806fc00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009fd0 tx=0x7f8fc8009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:13.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:13.815+0000 7f8fc2ffd640 1 -- 172.21.15.47:0/3171747078 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8fbc078a60 con 0x7f8fcc1023e0 2024-02-07T12:38:14.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.037+0000 7f8fd446e640 1 -- 172.21.15.47:0/3171747078 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f8fcc0fc190 con 0x7f8fcc1023e0 2024-02-07T12:38:14.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.037+0000 7f8fc2ffd640 1 -- 172.21.15.47:0/3171747078 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v48) v1 ==== 107+0+4055 (secure 0 0 0) 0x7f8fbc07c120 con 0x7f8fcc1023e0 2024-02-07T12:38:14.039 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:14.040 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:33:46.559126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34424},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34424":{"gid":34424,"name":"cephfs.smithi047.jsgfge","rank":0,"incarnation":30,"state":"up:active","state_seq":9,"addr":"172.21.15.47:6829/3387805936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3387805936},{"type":"v1","addr":"172.21.15.47:6829","nonce":3387805936}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:14.040 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 33 2024-02-07T12:38:14.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.039+0000 7f8fd446e640 1 -- 172.21.15.47:0/3171747078 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8fb806d750 msgr2=0x7f8fb806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:14.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.039+0000 7f8fd446e640 1 --2- 172.21.15.47:0/3171747078 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8fb806d750 0x7f8fb806fc00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009fd0 tx=0x7f8fc8009e50 comp rx=0 tx=0).stop 2024-02-07T12:38:14.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.039+0000 7f8fd446e640 1 -- 172.21.15.47:0/3171747078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fcc1023e0 msgr2=0x7f8fcc0fb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:14.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.039+0000 7f8fd446e640 1 --2- 172.21.15.47:0/3171747078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fcc1023e0 0x7f8fcc0fb8c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc031720 tx=0x7f8fbc009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.039+0000 7f8fd446e640 1 -- 172.21.15.47:0/3171747078 shutdown_connections 2024-02-07T12:38:14.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.039+0000 7f8fd446e640 1 --2- 172.21.15.47:0/3171747078 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f8fb806d750 0x7f8fb806fc00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.039+0000 7f8fd446e640 1 --2- 172.21.15.47:0/3171747078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fcc1023e0 0x7f8fcc0fb8c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.039+0000 7f8fd446e640 1 --2- 172.21.15.47:0/3171747078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fcc0644b0 0x7f8fcc0fb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.039+0000 7f8fd446e640 1 -- 172.21.15.47:0/3171747078 >> 172.21.15.47:0/3171747078 conn(0x7f8fcc071230 msgr2=0x7f8fcc0fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:14.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.039+0000 7f8fd446e640 1 -- 172.21.15.47:0/3171747078 shutdown_connections 2024-02-07T12:38:14.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.039+0000 7f8fd446e640 1 -- 172.21.15.47:0/3171747078 wait complete. 2024-02-07T12:38:14.052 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-02-07T12:38:14.052 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-02-07T12:38:14.052 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-02-07T12:38:14.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.150+0000 7f6cbfc18640 1 -- 172.21.15.47:0/1073178456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cb80fb2b0 msgr2=0x7f6cb80fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:14.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.150+0000 7f6cbfc18640 1 --2- 172.21.15.47:0/1073178456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cb80fb2b0 0x7f6cb80fb700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80048d0 tx=0x7f6ca8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.150+0000 7f6cbfc18640 1 -- 172.21.15.47:0/1073178456 shutdown_connections 2024-02-07T12:38:14.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.150+0000 7f6cbfc18640 1 --2- 172.21.15.47:0/1073178456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cb80fb2b0 0x7f6cb80fb700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.150+0000 7f6cbfc18640 1 --2- 172.21.15.47:0/1073178456 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cb81012d0 0x7f6cb81016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.150+0000 7f6cbfc18640 1 -- 172.21.15.47:0/1073178456 >> 172.21.15.47:0/1073178456 conn(0x7f6cb8071230 msgr2=0x7f6cb8071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:14.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.150+0000 7f6cbfc18640 1 -- 172.21.15.47:0/1073178456 shutdown_connections 2024-02-07T12:38:14.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.150+0000 7f6cbfc18640 1 -- 172.21.15.47:0/1073178456 wait complete. 2024-02-07T12:38:14.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbfc18640 1 Processor -- start 2024-02-07T12:38:14.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbfc18640 1 -- start start 2024-02-07T12:38:14.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbfc18640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cb80fb2b0 0x7f6cb8111ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:14.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbfc18640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cb81012d0 0x7f6cb8112010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:14.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbfc18640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb8112610 con 0x7f6cb80fb2b0 2024-02-07T12:38:14.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbfc18640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb8112780 con 0x7f6cb81012d0 2024-02-07T12:38:14.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbd9b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cb80fb2b0 0x7f6cb8111ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:14.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbd9b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cb80fb2b0 0x7f6cb8111ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34336/0 (socket says 172.21.15.47:34336) 2024-02-07T12:38:14.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbd9b4640 1 -- 172.21.15.47:0/3092749643 learned_addr learned my addr 172.21.15.47:0/3092749643 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:14.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbd1b3640 1 --2- 172.21.15.47:0/3092749643 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cb81012d0 0x7f6cb8112010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:14.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbd9b4640 1 -- 172.21.15.47:0/3092749643 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cb81012d0 msgr2=0x7f6cb8112010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:14.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbd9b4640 1 --2- 172.21.15.47:0/3092749643 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cb81012d0 0x7f6cb8112010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbd9b4640 1 -- 172.21.15.47:0/3092749643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8005040 con 0x7f6cb80fb2b0 2024-02-07T12:38:14.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbd1b3640 1 --2- 172.21.15.47:0/3092749643 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cb81012d0 0x7f6cb8112010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:38:14.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbd9b4640 1 --2- 172.21.15.47:0/3092749643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cb80fb2b0 0x7f6cb8111ad0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4002a50 tx=0x7f6cb4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:14.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cae7fc640 1 -- 172.21.15.47:0/3092749643 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cb4007c30 con 0x7f6cb80fb2b0 2024-02-07T12:38:14.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cbfc18640 1 -- 172.21.15.47:0/3092749643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb810bd50 con 0x7f6cb80fb2b0 2024-02-07T12:38:14.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.151+0000 7f6cae7fc640 1 -- 172.21.15.47:0/3092749643 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cb400f040 con 0x7f6cb80fb2b0 2024-02-07T12:38:14.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.152+0000 7f6cae7fc640 1 -- 172.21.15.47:0/3092749643 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cb400db50 con 0x7f6cb80fb2b0 2024-02-07T12:38:14.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.152+0000 7f6cbfc18640 1 -- 172.21.15.47:0/3092749643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb810c270 con 0x7f6cb80fb2b0 2024-02-07T12:38:14.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.152+0000 7f6cbfc18640 1 -- 172.21.15.47:0/3092749643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb8064030 con 0x7f6cb80fb2b0 2024-02-07T12:38:14.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.153+0000 7f6cae7fc640 1 -- 172.21.15.47:0/3092749643 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6cb401c400 con 0x7f6cb80fb2b0 2024-02-07T12:38:14.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.153+0000 7f6cae7fc640 1 --2- 172.21.15.47:0/3092749643 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6ca406d750 0x7f6ca406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:14.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.153+0000 7f6cae7fc640 1 -- 172.21.15.47:0/3092749643 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6cb408c8e0 con 0x7f6cb80fb2b0 2024-02-07T12:38:14.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.153+0000 7f6cbd1b3640 1 --2- 172.21.15.47:0/3092749643 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6ca406d750 0x7f6ca406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:14.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.154+0000 7f6cbd1b3640 1 --2- 172.21.15.47:0/3092749643 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6ca406d750 0x7f6ca406fc00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6cb810d3d0 tx=0x7f6ca8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:14.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.158+0000 7f6cae7fc640 1 -- 172.21.15.47:0/3092749643 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6cb4056080 con 0x7f6cb80fb2b0 2024-02-07T12:38:14.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.377+0000 7f6cbfc18640 1 -- 172.21.15.47:0/3092749643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f6cb810c490 con 0x7f6cb80fb2b0 2024-02-07T12:38:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.379+0000 7f6cae7fc640 1 -- 172.21.15.47:0/3092749643 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v48) v1 ==== 107+0+4868 (secure 0 0 0) 0x7f6cb4059740 con 0x7f6cb80fb2b0 2024-02-07T12:38:14.381 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:14.381 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:33:46.559126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34424},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34424":{"gid":34424,"name":"cephfs.smithi047.jsgfge","rank":0,"incarnation":30,"state":"up:active","state_seq":9,"addr":"172.21.15.47:6829/3387805936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3387805936},{"type":"v1","addr":"172.21.15.47:6829","nonce":3387805936}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:14.382 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 34 2024-02-07T12:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.381+0000 7f6cbfc18640 1 -- 172.21.15.47:0/3092749643 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6ca406d750 msgr2=0x7f6ca406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.381+0000 7f6cbfc18640 1 --2- 172.21.15.47:0/3092749643 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6ca406d750 0x7f6ca406fc00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6cb810d3d0 tx=0x7f6ca8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.381+0000 7f6cbfc18640 1 -- 172.21.15.47:0/3092749643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cb80fb2b0 msgr2=0x7f6cb8111ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.381+0000 7f6cbfc18640 1 --2- 172.21.15.47:0/3092749643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cb80fb2b0 0x7f6cb8111ad0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4002a50 tx=0x7f6cb4004600 comp rx=0 tx=0).stop 2024-02-07T12:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.381+0000 7f6cbfc18640 1 -- 172.21.15.47:0/3092749643 shutdown_connections 2024-02-07T12:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.381+0000 7f6cbfc18640 1 --2- 172.21.15.47:0/3092749643 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f6ca406d750 0x7f6ca406fc00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.381+0000 7f6cbfc18640 1 --2- 172.21.15.47:0/3092749643 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cb81012d0 0x7f6cb8112010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.381+0000 7f6cbfc18640 1 --2- 172.21.15.47:0/3092749643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cb80fb2b0 0x7f6cb8111ad0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.381+0000 7f6cbfc18640 1 -- 172.21.15.47:0/3092749643 >> 172.21.15.47:0/3092749643 conn(0x7f6cb8071230 msgr2=0x7f6cb80fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.382+0000 7f6cbfc18640 1 -- 172.21.15.47:0/3092749643 shutdown_connections 2024-02-07T12:38:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.382+0000 7f6cbfc18640 1 -- 172.21.15.47:0/3092749643 wait complete. 2024-02-07T12:38:14.394 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-02-07T12:38:14.395 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-02-07T12:38:14.395 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-02-07T12:38:14.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 -- 172.21.15.47:0/1831565463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84f4102d20 msgr2=0x7f84f40fc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:14.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 --2- 172.21.15.47:0/1831565463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84f4102d20 0x7f84f40fc3b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f84e40048d0 tx=0x7f84e4009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 -- 172.21.15.47:0/1831565463 shutdown_connections 2024-02-07T12:38:14.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 --2- 172.21.15.47:0/1831565463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84f4102d20 0x7f84f40fc3b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 --2- 172.21.15.47:0/1831565463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84f4102380 0x7f84f4102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 -- 172.21.15.47:0/1831565463 >> 172.21.15.47:0/1831565463 conn(0x7f84f40f7fb0 msgr2=0x7f84f40fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:14.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 -- 172.21.15.47:0/1831565463 shutdown_connections 2024-02-07T12:38:14.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 -- 172.21.15.47:0/1831565463 wait complete. 2024-02-07T12:38:14.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 Processor -- start 2024-02-07T12:38:14.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 -- start start 2024-02-07T12:38:14.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84f4102380 0x7f84f4112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:14.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84f4102d20 0x7f84f41130c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:14.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f41136c0 con 0x7f84f4102d20 2024-02-07T12:38:14.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84fb86e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4113830 con 0x7f84f4102380 2024-02-07T12:38:14.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84f8e09640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84f4102d20 0x7f84f41130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:14.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84f8e09640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84f4102d20 0x7f84f41130c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34344/0 (socket says 172.21.15.47:34344) 2024-02-07T12:38:14.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.492+0000 7f84f8e09640 1 -- 172.21.15.47:0/982109510 learned_addr learned my addr 172.21.15.47:0/982109510 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:14.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.493+0000 7f84f960a640 1 --2- 172.21.15.47:0/982109510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84f4102380 0x7f84f4112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:14.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.493+0000 7f84f8e09640 1 -- 172.21.15.47:0/982109510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84f4102380 msgr2=0x7f84f4112b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:14.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.493+0000 7f84f8e09640 1 --2- 172.21.15.47:0/982109510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84f4102380 0x7f84f4112b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.493+0000 7f84f8e09640 1 -- 172.21.15.47:0/982109510 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e4005040 con 0x7f84f4102d20 2024-02-07T12:38:14.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.493+0000 7f84f8e09640 1 --2- 172.21.15.47:0/982109510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84f4102d20 0x7f84f41130c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f84e4031720 tx=0x7f84e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:14.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.493+0000 7f84e9ffb640 1 -- 172.21.15.47:0/982109510 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84e40094c0 con 0x7f84f4102d20 2024-02-07T12:38:14.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.493+0000 7f84fb86e640 1 -- 172.21.15.47:0/982109510 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f410cda0 con 0x7f84f4102d20 2024-02-07T12:38:14.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.493+0000 7f84e9ffb640 1 -- 172.21.15.47:0/982109510 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84e4009620 con 0x7f84f4102d20 2024-02-07T12:38:14.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.493+0000 7f84e9ffb640 1 -- 172.21.15.47:0/982109510 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84e403b640 con 0x7f84f4102d20 2024-02-07T12:38:14.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.493+0000 7f84fb86e640 1 -- 172.21.15.47:0/982109510 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f410d2c0 con 0x7f84f4102d20 2024-02-07T12:38:14.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.494+0000 7f84fb86e640 1 -- 172.21.15.47:0/982109510 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f4064030 con 0x7f84f4102d20 2024-02-07T12:38:14.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.495+0000 7f84e9ffb640 1 -- 172.21.15.47:0/982109510 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f84e402f070 con 0x7f84f4102d20 2024-02-07T12:38:14.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.495+0000 7f84e9ffb640 1 --2- 172.21.15.47:0/982109510 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f84e006d750 0x7f84e006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:14.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.495+0000 7f84e9ffb640 1 -- 172.21.15.47:0/982109510 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f84e40af3d0 con 0x7f84f4102d20 2024-02-07T12:38:14.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.495+0000 7f84f960a640 1 --2- 172.21.15.47:0/982109510 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f84e006d750 0x7f84e006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:14.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.496+0000 7f84f960a640 1 --2- 172.21.15.47:0/982109510 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f84e006d750 0x7f84e006fc00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009fd0 tx=0x7f84f000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:14.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.500+0000 7f84e9ffb640 1 -- 172.21.15.47:0/982109510 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f84e4078b70 con 0x7f84f4102d20 2024-02-07T12:38:14.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.722+0000 7f84fb86e640 1 -- 172.21.15.47:0/982109510 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f84f410d450 con 0x7f84f4102d20 2024-02-07T12:38:14.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.722+0000 7f84e9ffb640 1 -- 172.21.15.47:0/982109510 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v48) v1 ==== 107+0+4078 (secure 0 0 0) 0x7f84e407c230 con 0x7f84f4102d20 2024-02-07T12:38:14.725 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:14.725 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:03.468598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:14.725 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 35 2024-02-07T12:38:14.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.724+0000 7f84fb86e640 1 -- 172.21.15.47:0/982109510 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f84e006d750 msgr2=0x7f84e006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:14.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.724+0000 7f84fb86e640 1 --2- 172.21.15.47:0/982109510 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f84e006d750 0x7f84e006fc00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009fd0 tx=0x7f84f000b040 comp rx=0 tx=0).stop 2024-02-07T12:38:14.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.724+0000 7f84fb86e640 1 -- 172.21.15.47:0/982109510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84f4102d20 msgr2=0x7f84f41130c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:14.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.724+0000 7f84fb86e640 1 --2- 172.21.15.47:0/982109510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84f4102d20 0x7f84f41130c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f84e4031720 tx=0x7f84e4009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.724+0000 7f84fb86e640 1 -- 172.21.15.47:0/982109510 shutdown_connections 2024-02-07T12:38:14.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.724+0000 7f84fb86e640 1 --2- 172.21.15.47:0/982109510 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f84e006d750 0x7f84e006fc00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.724+0000 7f84fb86e640 1 --2- 172.21.15.47:0/982109510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84f4102d20 0x7f84f41130c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.724+0000 7f84fb86e640 1 --2- 172.21.15.47:0/982109510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84f4102380 0x7f84f4112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.724+0000 7f84fb86e640 1 -- 172.21.15.47:0/982109510 >> 172.21.15.47:0/982109510 conn(0x7f84f40f7fb0 msgr2=0x7f84f40f99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:14.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.725+0000 7f84fb86e640 1 -- 172.21.15.47:0/982109510 shutdown_connections 2024-02-07T12:38:14.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.725+0000 7f84fb86e640 1 -- 172.21.15.47:0/982109510 wait complete. 2024-02-07T12:38:14.736 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:14 smithi047 ceph-mon[93224]: pgmap v332: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:38:14.736 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:14 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/31951552' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-07T12:38:14.736 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:14 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3171747078' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-07T12:38:14.737 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-02-07T12:38:14.738 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-02-07T12:38:14.738 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-02-07T12:38:14.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:14 smithi138 ceph-mon[82055]: pgmap v332: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-07T12:38:14.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:14 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/31951552' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-07T12:38:14.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:14 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3171747078' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-07T12:38:14.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.834+0000 7f60ea82e640 1 -- 172.21.15.47:0/2899695359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e4102d40 msgr2=0x7f60e40fc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:14.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.834+0000 7f60ea82e640 1 --2- 172.21.15.47:0/2899695359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e4102d40 0x7f60e40fc3d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f60d40048d0 tx=0x7f60d4009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.834+0000 7f60ea82e640 1 -- 172.21.15.47:0/2899695359 shutdown_connections 2024-02-07T12:38:14.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.834+0000 7f60ea82e640 1 --2- 172.21.15.47:0/2899695359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e4102d40 0x7f60e40fc3d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.834+0000 7f60ea82e640 1 --2- 172.21.15.47:0/2899695359 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60e41023a0 0x7f60e4102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.834+0000 7f60ea82e640 1 -- 172.21.15.47:0/2899695359 >> 172.21.15.47:0/2899695359 conn(0x7f60e40f7f90 msgr2=0x7f60e40fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:14.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.834+0000 7f60ea82e640 1 -- 172.21.15.47:0/2899695359 shutdown_connections 2024-02-07T12:38:14.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.835+0000 7f60ea82e640 1 -- 172.21.15.47:0/2899695359 wait complete. 2024-02-07T12:38:14.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.835+0000 7f60ea82e640 1 Processor -- start 2024-02-07T12:38:14.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.835+0000 7f60ea82e640 1 -- start start 2024-02-07T12:38:14.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.835+0000 7f60ea82e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60e41023a0 0x7f60e4112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:14.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.835+0000 7f60ea82e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e4102d40 0x7f60e41134b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:14.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.835+0000 7f60ea82e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4113b40 con 0x7f60e4102d40 2024-02-07T12:38:14.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.835+0000 7f60ea82e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e410d040 con 0x7f60e41023a0 2024-02-07T12:38:14.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.836+0000 7f60e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e4102d40 0x7f60e41134b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:14.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.836+0000 7f60e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e4102d40 0x7f60e41134b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34366/0 (socket says 172.21.15.47:34366) 2024-02-07T12:38:14.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.836+0000 7f60e37fe640 1 -- 172.21.15.47:0/3110811141 learned_addr learned my addr 172.21.15.47:0/3110811141 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:14.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.836+0000 7f60e3fff640 1 --2- 172.21.15.47:0/3110811141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60e41023a0 0x7f60e4112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:14.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.836+0000 7f60e37fe640 1 -- 172.21.15.47:0/3110811141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60e41023a0 msgr2=0x7f60e4112f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:14.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.836+0000 7f60e37fe640 1 --2- 172.21.15.47:0/3110811141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60e41023a0 0x7f60e4112f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:14.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.836+0000 7f60e37fe640 1 -- 172.21.15.47:0/3110811141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d4005040 con 0x7f60e4102d40 2024-02-07T12:38:14.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.836+0000 7f60e37fe640 1 --2- 172.21.15.47:0/3110811141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e4102d40 0x7f60e41134b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f60d4031720 tx=0x7f60d4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:14.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.836+0000 7f60e0ff9640 1 -- 172.21.15.47:0/3110811141 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d40094c0 con 0x7f60e4102d40 2024-02-07T12:38:14.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.836+0000 7f60ea82e640 1 -- 172.21.15.47:0/3110811141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e410d2c0 con 0x7f60e4102d40 2024-02-07T12:38:14.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.836+0000 7f60e0ff9640 1 -- 172.21.15.47:0/3110811141 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60d4009620 con 0x7f60e4102d40 2024-02-07T12:38:14.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.836+0000 7f60e0ff9640 1 -- 172.21.15.47:0/3110811141 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d403b640 con 0x7f60e4102d40 2024-02-07T12:38:14.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.836+0000 7f60ea82e640 1 -- 172.21.15.47:0/3110811141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e410d7e0 con 0x7f60e4102d40 2024-02-07T12:38:14.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.837+0000 7f60ea82e640 1 -- 172.21.15.47:0/3110811141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e4064030 con 0x7f60e4102d40 2024-02-07T12:38:14.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.838+0000 7f60e0ff9640 1 -- 172.21.15.47:0/3110811141 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f60d402f070 con 0x7f60e4102d40 2024-02-07T12:38:14.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.838+0000 7f60e0ff9640 1 --2- 172.21.15.47:0/3110811141 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f60d006d750 0x7f60d006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:14.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.838+0000 7f60e0ff9640 1 -- 172.21.15.47:0/3110811141 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f60d40af520 con 0x7f60e4102d40 2024-02-07T12:38:14.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.838+0000 7f60e3fff640 1 --2- 172.21.15.47:0/3110811141 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f60d006d750 0x7f60d006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:14.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.839+0000 7f60e3fff640 1 --2- 172.21.15.47:0/3110811141 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f60d006d750 0x7f60d006fc00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f60cc006fd0 tx=0x7f60cc008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:14.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:14.843+0000 7f60e0ff9640 1 -- 172.21.15.47:0/3110811141 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f60d4078cc0 con 0x7f60e4102d40 2024-02-07T12:38:15.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.060+0000 7f60ea82e640 1 -- 172.21.15.47:0/3110811141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f60e4109560 con 0x7f60e4102d40 2024-02-07T12:38:15.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.061+0000 7f60e0ff9640 1 -- 172.21.15.47:0/3110811141 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v48) v1 ==== 107+0+4123 (secure 0 0 0) 0x7f60d407c380 con 0x7f60e4102d40 2024-02-07T12:38:15.063 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:15.063 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:03.472935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:15.063 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 36 2024-02-07T12:38:15.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.063+0000 7f60ea82e640 1 -- 172.21.15.47:0/3110811141 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f60d006d750 msgr2=0x7f60d006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:15.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.063+0000 7f60ea82e640 1 --2- 172.21.15.47:0/3110811141 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f60d006d750 0x7f60d006fc00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f60cc006fd0 tx=0x7f60cc008040 comp rx=0 tx=0).stop 2024-02-07T12:38:15.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.063+0000 7f60ea82e640 1 -- 172.21.15.47:0/3110811141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e4102d40 msgr2=0x7f60e41134b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:15.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.063+0000 7f60ea82e640 1 --2- 172.21.15.47:0/3110811141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e4102d40 0x7f60e41134b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f60d4031720 tx=0x7f60d4009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.063+0000 7f60ea82e640 1 -- 172.21.15.47:0/3110811141 shutdown_connections 2024-02-07T12:38:15.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.063+0000 7f60ea82e640 1 --2- 172.21.15.47:0/3110811141 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f60d006d750 0x7f60d006fc00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.063+0000 7f60ea82e640 1 --2- 172.21.15.47:0/3110811141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e4102d40 0x7f60e41134b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.063+0000 7f60ea82e640 1 --2- 172.21.15.47:0/3110811141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60e41023a0 0x7f60e4112f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.063+0000 7f60ea82e640 1 -- 172.21.15.47:0/3110811141 >> 172.21.15.47:0/3110811141 conn(0x7f60e40f7f90 msgr2=0x7f60e40f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:15.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.063+0000 7f60ea82e640 1 -- 172.21.15.47:0/3110811141 shutdown_connections 2024-02-07T12:38:15.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.063+0000 7f60ea82e640 1 -- 172.21.15.47:0/3110811141 wait complete. 2024-02-07T12:38:15.075 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-02-07T12:38:15.075 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-02-07T12:38:15.076 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-02-07T12:38:15.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.173+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1308156821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d98101be0 msgr2=0x7f0d980fb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:15.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.173+0000 7f0d9e55d640 1 --2- 172.21.15.47:0/1308156821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d98101be0 0x7f0d980fb270 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0048d0 tx=0x7f0d8c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.173+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1308156821 shutdown_connections 2024-02-07T12:38:15.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.173+0000 7f0d9e55d640 1 --2- 172.21.15.47:0/1308156821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d98101be0 0x7f0d980fb270 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.173+0000 7f0d9e55d640 1 --2- 172.21.15.47:0/1308156821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d98101240 0x7f0d98101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.173+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1308156821 >> 172.21.15.47:0/1308156821 conn(0x7f0d980f6e10 msgr2=0x7f0d980f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:15.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.173+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1308156821 shutdown_connections 2024-02-07T12:38:15.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.173+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1308156821 wait complete. 2024-02-07T12:38:15.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.173+0000 7f0d9e55d640 1 Processor -- start 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d9e55d640 1 -- start start 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d9e55d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d98101240 0x7f0d9810dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d9e55d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d98101be0 0x7f0d9810e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d9e55d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9810e7b0 con 0x7f0d98101240 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d9e55d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9810e920 con 0x7f0d98101be0 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d97fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d98101240 0x7f0d9810dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d97fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d98101240 0x7f0d9810dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34378/0 (socket says 172.21.15.47:34378) 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d97fff640 1 -- 172.21.15.47:0/1507801455 learned_addr learned my addr 172.21.15.47:0/1507801455 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d977fe640 1 --2- 172.21.15.47:0/1507801455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d98101be0 0x7f0d9810e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d97fff640 1 -- 172.21.15.47:0/1507801455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d98101be0 msgr2=0x7f0d9810e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d97fff640 1 --2- 172.21.15.47:0/1507801455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d98101be0 0x7f0d9810e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d97fff640 1 -- 172.21.15.47:0/1507801455 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c005040 con 0x7f0d98101240 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d977fe640 1 --2- 172.21.15.47:0/1507801455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d98101be0 0x7f0d9810e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:38:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d97fff640 1 --2- 172.21.15.47:0/1507801455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d98101240 0x7f0d9810dd30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0d88002a80 tx=0x7f0d88004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:15.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.174+0000 7f0d94ff9640 1 -- 172.21.15.47:0/1507801455 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d88007c30 con 0x7f0d98101240 2024-02-07T12:38:15.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.175+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1507801455 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d98116da0 con 0x7f0d98101240 2024-02-07T12:38:15.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.175+0000 7f0d94ff9640 1 -- 172.21.15.47:0/1507801455 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d8800f040 con 0x7f0d98101240 2024-02-07T12:38:15.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.175+0000 7f0d94ff9640 1 -- 172.21.15.47:0/1507801455 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d880096b0 con 0x7f0d98101240 2024-02-07T12:38:15.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.175+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1507801455 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d981170d0 con 0x7f0d98101240 2024-02-07T12:38:15.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.176+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1507801455 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d98064480 con 0x7f0d98101240 2024-02-07T12:38:15.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.176+0000 7f0d94ff9640 1 -- 172.21.15.47:0/1507801455 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0d8800d6b0 con 0x7f0d98101240 2024-02-07T12:38:15.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.176+0000 7f0d94ff9640 1 --2- 172.21.15.47:0/1507801455 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0d8006d750 0x7f0d8006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:15.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.176+0000 7f0d94ff9640 1 -- 172.21.15.47:0/1507801455 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0d8808c9c0 con 0x7f0d98101240 2024-02-07T12:38:15.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.177+0000 7f0d977fe640 1 --2- 172.21.15.47:0/1507801455 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0d8006d750 0x7f0d8006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:15.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.177+0000 7f0d977fe640 1 --2- 172.21.15.47:0/1507801455 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0d8006d750 0x7f0d8006fc00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c02bda0 tx=0x7f0d8c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.181+0000 7f0d94ff9640 1 -- 172.21.15.47:0/1507801455 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0d88056160 con 0x7f0d98101240 2024-02-07T12:38:15.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.403+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1507801455 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f0d98065d10 con 0x7f0d98101240 2024-02-07T12:38:15.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.404+0000 7f0d94ff9640 1 -- 172.21.15.47:0/1507801455 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v48) v1 ==== 107+0+4126 (secure 0 0 0) 0x7f0d88059820 con 0x7f0d98101240 2024-02-07T12:38:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:15.406 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:10.519958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":36,"state":"up:reconnect","state_seq":7,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:15.406 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 37 2024-02-07T12:38:15.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.406+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1507801455 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0d8006d750 msgr2=0x7f0d8006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:15.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.406+0000 7f0d9e55d640 1 --2- 172.21.15.47:0/1507801455 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0d8006d750 0x7f0d8006fc00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c02bda0 tx=0x7f0d8c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.406+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1507801455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d98101240 msgr2=0x7f0d9810dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:15.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.406+0000 7f0d9e55d640 1 --2- 172.21.15.47:0/1507801455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d98101240 0x7f0d9810dd30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0d88002a80 tx=0x7f0d88004600 comp rx=0 tx=0).stop 2024-02-07T12:38:15.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.406+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1507801455 shutdown_connections 2024-02-07T12:38:15.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.406+0000 7f0d9e55d640 1 --2- 172.21.15.47:0/1507801455 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f0d8006d750 0x7f0d8006fc00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.406+0000 7f0d9e55d640 1 --2- 172.21.15.47:0/1507801455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d98101be0 0x7f0d9810e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.406+0000 7f0d9e55d640 1 --2- 172.21.15.47:0/1507801455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d98101240 0x7f0d9810dd30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.406+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1507801455 >> 172.21.15.47:0/1507801455 conn(0x7f0d980f6e10 msgr2=0x7f0d980f8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.406+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1507801455 shutdown_connections 2024-02-07T12:38:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.406+0000 7f0d9e55d640 1 -- 172.21.15.47:0/1507801455 wait complete. 2024-02-07T12:38:15.419 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-02-07T12:38:15.419 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-02-07T12:38:15.419 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-02-07T12:38:15.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.516+0000 7f270e86e640 1 -- 172.21.15.47:0/698026566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2708102360 msgr2=0x7f2708102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:15.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.516+0000 7f270e86e640 1 --2- 172.21.15.47:0/698026566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2708102360 0x7f2708102730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f26f80048d0 tx=0x7f26f8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.517+0000 7f270e86e640 1 -- 172.21.15.47:0/698026566 shutdown_connections 2024-02-07T12:38:15.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.517+0000 7f270e86e640 1 --2- 172.21.15.47:0/698026566 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2708102d00 0x7f27080fc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.517+0000 7f270e86e640 1 --2- 172.21.15.47:0/698026566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2708102360 0x7f2708102730 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.517+0000 7f270e86e640 1 -- 172.21.15.47:0/698026566 >> 172.21.15.47:0/698026566 conn(0x7f27080f7ef0 msgr2=0x7f27080fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:15.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.517+0000 7f270e86e640 1 -- 172.21.15.47:0/698026566 shutdown_connections 2024-02-07T12:38:15.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.517+0000 7f270e86e640 1 -- 172.21.15.47:0/698026566 wait complete. 2024-02-07T12:38:15.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.517+0000 7f270e86e640 1 Processor -- start 2024-02-07T12:38:15.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.517+0000 7f270e86e640 1 -- start start 2024-02-07T12:38:15.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.517+0000 7f270e86e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2708102360 0x7f2708112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:15.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.517+0000 7f270e86e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2708102d00 0x7f2708113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:15.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.517+0000 7f270e86e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2708113830 con 0x7f2708102360 2024-02-07T12:38:15.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.517+0000 7f270e86e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27081139a0 con 0x7f2708102d00 2024-02-07T12:38:15.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f2707fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2708102360 0x7f2708112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:15.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f2707fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2708102360 0x7f2708112cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34392/0 (socket says 172.21.15.47:34392) 2024-02-07T12:38:15.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f2707fff640 1 -- 172.21.15.47:0/3323268109 learned_addr learned my addr 172.21.15.47:0/3323268109 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:15.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f27077fe640 1 --2- 172.21.15.47:0/3323268109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2708102d00 0x7f2708113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:15.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f2707fff640 1 -- 172.21.15.47:0/3323268109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2708102d00 msgr2=0x7f2708113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:15.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f2707fff640 1 --2- 172.21.15.47:0/3323268109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2708102d00 0x7f2708113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f2707fff640 1 -- 172.21.15.47:0/3323268109 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f8005040 con 0x7f2708102360 2024-02-07T12:38:15.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f27077fe640 1 --2- 172.21.15.47:0/3323268109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2708102d00 0x7f2708113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:38:15.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f2707fff640 1 --2- 172.21.15.47:0/3323268109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2708102360 0x7f2708112cf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f26f8031720 tx=0x7f26f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:15.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f2704ff9640 1 -- 172.21.15.47:0/3323268109 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26f80094c0 con 0x7f2708102360 2024-02-07T12:38:15.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f2704ff9640 1 -- 172.21.15.47:0/3323268109 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f26f8009620 con 0x7f2708102360 2024-02-07T12:38:15.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f270e86e640 1 -- 172.21.15.47:0/3323268109 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270810cf10 con 0x7f2708102360 2024-02-07T12:38:15.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f2704ff9640 1 -- 172.21.15.47:0/3323268109 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26f803b640 con 0x7f2708102360 2024-02-07T12:38:15.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.518+0000 7f270e86e640 1 -- 172.21.15.47:0/3323268109 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270810d430 con 0x7f2708102360 2024-02-07T12:38:15.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.519+0000 7f270e86e640 1 -- 172.21.15.47:0/3323268109 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2708064480 con 0x7f2708102360 2024-02-07T12:38:15.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.520+0000 7f2704ff9640 1 -- 172.21.15.47:0/3323268109 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f26f802f070 con 0x7f2708102360 2024-02-07T12:38:15.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.520+0000 7f2704ff9640 1 --2- 172.21.15.47:0/3323268109 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f26f006d750 0x7f26f006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:15.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.520+0000 7f2704ff9640 1 -- 172.21.15.47:0/3323268109 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f26f80af520 con 0x7f2708102360 2024-02-07T12:38:15.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.520+0000 7f27077fe640 1 --2- 172.21.15.47:0/3323268109 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f26f006d750 0x7f26f006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:15.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.521+0000 7f27077fe640 1 --2- 172.21.15.47:0/3323268109 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f26f006d750 0x7f26f006fc00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f270810e5f0 tx=0x7f26fc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:15.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.525+0000 7f2704ff9640 1 -- 172.21.15.47:0/3323268109 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f26f8078cc0 con 0x7f2708102360 2024-02-07T12:38:15.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.743+0000 7f270e86e640 1 -- 172.21.15.47:0/3323268109 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f27081094c0 con 0x7f2708102360 2024-02-07T12:38:15.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.744+0000 7f2704ff9640 1 -- 172.21.15.47:0/3323268109 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v48) v1 ==== 107+0+4123 (secure 0 0 0) 0x7f26f807c380 con 0x7f2708102360 2024-02-07T12:38:15.746 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:15.746 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:11.291238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":36,"state":"up:rejoin","state_seq":8,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:15.746 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 38 2024-02-07T12:38:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.746+0000 7f270e86e640 1 -- 172.21.15.47:0/3323268109 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f26f006d750 msgr2=0x7f26f006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.746+0000 7f270e86e640 1 --2- 172.21.15.47:0/3323268109 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f26f006d750 0x7f26f006fc00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f270810e5f0 tx=0x7f26fc009040 comp rx=0 tx=0).stop 2024-02-07T12:38:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.746+0000 7f270e86e640 1 -- 172.21.15.47:0/3323268109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2708102360 msgr2=0x7f2708112cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.746+0000 7f270e86e640 1 --2- 172.21.15.47:0/3323268109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2708102360 0x7f2708112cf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f26f8031720 tx=0x7f26f8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.746+0000 7f270e86e640 1 -- 172.21.15.47:0/3323268109 shutdown_connections 2024-02-07T12:38:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.746+0000 7f270e86e640 1 --2- 172.21.15.47:0/3323268109 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f26f006d750 0x7f26f006fc00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.746+0000 7f270e86e640 1 --2- 172.21.15.47:0/3323268109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2708102d00 0x7f2708113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.746+0000 7f270e86e640 1 --2- 172.21.15.47:0/3323268109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2708102360 0x7f2708112cf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.746+0000 7f270e86e640 1 -- 172.21.15.47:0/3323268109 >> 172.21.15.47:0/3323268109 conn(0x7f27080f7ef0 msgr2=0x7f27080f9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.746+0000 7f270e86e640 1 -- 172.21.15.47:0/3323268109 shutdown_connections 2024-02-07T12:38:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.746+0000 7f270e86e640 1 -- 172.21.15.47:0/3323268109 wait complete. 2024-02-07T12:38:15.757 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:15 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3092749643' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-07T12:38:15.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:15 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/982109510' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-07T12:38:15.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:15 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3110811141' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-07T12:38:15.759 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-02-07T12:38:15.759 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 38 2024-02-07T12:38:15.759 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 39 2024-02-07T12:38:15.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:15 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3092749643' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-07T12:38:15.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:15 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/982109510' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-07T12:38:15.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:15 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3110811141' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-07T12:38:15.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.856+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2926470702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a8101240 msgr2=0x7fa0a8101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:15.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.856+0000 7fa0ae99d640 1 --2- 172.21.15.47:0/2926470702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a8101240 0x7fa0a8101610 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa0980048d0 tx=0x7fa098009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.856+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2926470702 shutdown_connections 2024-02-07T12:38:15.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.856+0000 7fa0ae99d640 1 --2- 172.21.15.47:0/2926470702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0a8101be0 0x7fa0a80fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.856+0000 7fa0ae99d640 1 --2- 172.21.15.47:0/2926470702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a8101240 0x7fa0a8101610 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.856+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2926470702 >> 172.21.15.47:0/2926470702 conn(0x7fa0a80f6e10 msgr2=0x7fa0a80f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:15.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.856+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2926470702 shutdown_connections 2024-02-07T12:38:15.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.856+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2926470702 wait complete. 2024-02-07T12:38:15.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.856+0000 7fa0ae99d640 1 Processor -- start 2024-02-07T12:38:15.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0ae99d640 1 -- start start 2024-02-07T12:38:15.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0ae99d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a8101240 0x7fa0a8111ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0ae99d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0a8101be0 0x7fa0a8112000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0ae99d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a8112600 con 0x7fa0a8101240 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0ae99d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a810bb90 con 0x7fa0a8101be0 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a8101240 0x7fa0a8111ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a8101240 0x7fa0a8111ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34412/0 (socket says 172.21.15.47:34412) 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0a7fff640 1 -- 172.21.15.47:0/2507883866 learned_addr learned my addr 172.21.15.47:0/2507883866 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0a77fe640 1 --2- 172.21.15.47:0/2507883866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0a8101be0 0x7fa0a8112000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0a7fff640 1 -- 172.21.15.47:0/2507883866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0a8101be0 msgr2=0x7fa0a8112000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0a7fff640 1 --2- 172.21.15.47:0/2507883866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0a8101be0 0x7fa0a8112000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0a7fff640 1 -- 172.21.15.47:0/2507883866 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa098005040 con 0x7fa0a8101240 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0a77fe640 1 --2- 172.21.15.47:0/2507883866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0a8101be0 0x7fa0a8112000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.857+0000 7fa0a7fff640 1 --2- 172.21.15.47:0/2507883866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a8101240 0x7fa0a8111ac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa098031720 tx=0x7fa098009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.858+0000 7fa0a4ff9640 1 -- 172.21.15.47:0/2507883866 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0980094c0 con 0x7fa0a8101240 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.858+0000 7fa0a4ff9640 1 -- 172.21.15.47:0/2507883866 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa098009620 con 0x7fa0a8101240 2024-02-07T12:38:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.858+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2507883866 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a810be10 con 0x7fa0a8101240 2024-02-07T12:38:15.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.858+0000 7fa0a4ff9640 1 -- 172.21.15.47:0/2507883866 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa09803b640 con 0x7fa0a8101240 2024-02-07T12:38:15.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.858+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2507883866 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a810c330 con 0x7fa0a8101240 2024-02-07T12:38:15.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.859+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2507883866 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a8064480 con 0x7fa0a8101240 2024-02-07T12:38:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.859+0000 7fa0a4ff9640 1 -- 172.21.15.47:0/2507883866 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa09802f070 con 0x7fa0a8101240 2024-02-07T12:38:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.859+0000 7fa0a4ff9640 1 --2- 172.21.15.47:0/2507883866 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa09006d750 0x7fa09006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.859+0000 7fa0a4ff9640 1 -- 172.21.15.47:0/2507883866 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa0980af580 con 0x7fa0a8101240 2024-02-07T12:38:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.860+0000 7fa0a77fe640 1 --2- 172.21.15.47:0/2507883866 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa09006d750 0x7fa09006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.860+0000 7fa0a77fe640 1 --2- 172.21.15.47:0/2507883866 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa09006d750 0x7fa09006fc00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa0a810d380 tx=0x7fa09c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:15.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:15.864+0000 7fa0a4ff9640 1 -- 172.21.15.47:0/2507883866 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa098078d20 con 0x7fa0a8101240 2024-02-07T12:38:16.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.083+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2507883866 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7fa0a810d0c0 con 0x7fa0a8101240 2024-02-07T12:38:16.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.084+0000 7fa0a4ff9640 1 -- 172.21.15.47:0/2507883866 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v48) v1 ==== 107+0+4123 (secure 0 0 0) 0x7fa09807c3e0 con 0x7fa0a8101240 2024-02-07T12:38:16.086 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:16.086 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:12.310515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":36,"state":"up:active","state_seq":9,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:16.087 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 39 2024-02-07T12:38:16.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.086+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2507883866 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa09006d750 msgr2=0x7fa09006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:16.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.086+0000 7fa0ae99d640 1 --2- 172.21.15.47:0/2507883866 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa09006d750 0x7fa09006fc00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa0a810d380 tx=0x7fa09c009040 comp rx=0 tx=0).stop 2024-02-07T12:38:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.086+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2507883866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a8101240 msgr2=0x7fa0a8111ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.086+0000 7fa0ae99d640 1 --2- 172.21.15.47:0/2507883866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a8101240 0x7fa0a8111ac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa098031720 tx=0x7fa098009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.086+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2507883866 shutdown_connections 2024-02-07T12:38:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.086+0000 7fa0ae99d640 1 --2- 172.21.15.47:0/2507883866 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fa09006d750 0x7fa09006fc00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.086+0000 7fa0ae99d640 1 --2- 172.21.15.47:0/2507883866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0a8101be0 0x7fa0a8112000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.086+0000 7fa0ae99d640 1 --2- 172.21.15.47:0/2507883866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a8101240 0x7fa0a8111ac0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.086+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2507883866 >> 172.21.15.47:0/2507883866 conn(0x7fa0a80f6e10 msgr2=0x7fa0a80f88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.086+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2507883866 shutdown_connections 2024-02-07T12:38:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.086+0000 7fa0ae99d640 1 -- 172.21.15.47:0/2507883866 wait complete. 2024-02-07T12:38:16.099 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-02-07T12:38:16.099 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 39 2024-02-07T12:38:16.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 40 2024-02-07T12:38:16.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.198+0000 7f908ed1d640 1 -- 172.21.15.47:0/2865944840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90881012d0 msgr2=0x7f90881016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:16.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.198+0000 7f908ed1d640 1 --2- 172.21.15.47:0/2865944840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90881012d0 0x7f90881016a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f907c0048d0 tx=0x7f907c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.199+0000 7f908ed1d640 1 -- 172.21.15.47:0/2865944840 shutdown_connections 2024-02-07T12:38:16.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.199+0000 7f908ed1d640 1 --2- 172.21.15.47:0/2865944840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880fb2b0 0x7f90880fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.199+0000 7f908ed1d640 1 --2- 172.21.15.47:0/2865944840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90881012d0 0x7f90881016a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.199+0000 7f908ed1d640 1 -- 172.21.15.47:0/2865944840 >> 172.21.15.47:0/2865944840 conn(0x7f9088071230 msgr2=0x7f9088071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:16.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.199+0000 7f908ed1d640 1 -- 172.21.15.47:0/2865944840 shutdown_connections 2024-02-07T12:38:16.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.199+0000 7f908ed1d640 1 -- 172.21.15.47:0/2865944840 wait complete. 2024-02-07T12:38:16.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.200+0000 7f908ed1d640 1 Processor -- start 2024-02-07T12:38:16.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.200+0000 7f908ed1d640 1 -- start start 2024-02-07T12:38:16.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.200+0000 7f908ed1d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90880fb2b0 0x7f90881024a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:16.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.200+0000 7f908ed1d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90881012d0 0x7f90881029e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:16.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.200+0000 7f908ed1d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9088104440 con 0x7f90880fb2b0 2024-02-07T12:38:16.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.200+0000 7f908ed1d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9088102f20 con 0x7f90881012d0 2024-02-07T12:38:16.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.200+0000 7f908cab9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90880fb2b0 0x7f90881024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:16.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.200+0000 7f908cab9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90880fb2b0 0x7f90881024a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34428/0 (socket says 172.21.15.47:34428) 2024-02-07T12:38:16.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.200+0000 7f908cab9640 1 -- 172.21.15.47:0/3576289847 learned_addr learned my addr 172.21.15.47:0/3576289847 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:16.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.200+0000 7f9087fff640 1 --2- 172.21.15.47:0/3576289847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90881012d0 0x7f90881029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:16.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.200+0000 7f908cab9640 1 -- 172.21.15.47:0/3576289847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90881012d0 msgr2=0x7f90881029e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:16.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.200+0000 7f908cab9640 1 --2- 172.21.15.47:0/3576289847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90881012d0 0x7f90881029e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.200+0000 7f908cab9640 1 -- 172.21.15.47:0/3576289847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c005040 con 0x7f90880fb2b0 2024-02-07T12:38:16.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.201+0000 7f908cab9640 1 --2- 172.21.15.47:0/3576289847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90880fb2b0 0x7f90881024a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f907c007da0 tx=0x7f907c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:16.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.201+0000 7f90857fa640 1 -- 172.21.15.47:0/3576289847 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f907c0094c0 con 0x7f90880fb2b0 2024-02-07T12:38:16.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.201+0000 7f90857fa640 1 -- 172.21.15.47:0/3576289847 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f907c009620 con 0x7f90880fb2b0 2024-02-07T12:38:16.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.201+0000 7f908ed1d640 1 -- 172.21.15.47:0/3576289847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9088103170 con 0x7f90880fb2b0 2024-02-07T12:38:16.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.201+0000 7f90857fa640 1 -- 172.21.15.47:0/3576289847 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f907c0445f0 con 0x7f90880fb2b0 2024-02-07T12:38:16.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.201+0000 7f908ed1d640 1 -- 172.21.15.47:0/3576289847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9088119230 con 0x7f90880fb2b0 2024-02-07T12:38:16.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.202+0000 7f908ed1d640 1 -- 172.21.15.47:0/3576289847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9088064030 con 0x7f90880fb2b0 2024-02-07T12:38:16.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.202+0000 7f90857fa640 1 -- 172.21.15.47:0/3576289847 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f907c02f070 con 0x7f90880fb2b0 2024-02-07T12:38:16.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.203+0000 7f90857fa640 1 --2- 172.21.15.47:0/3576289847 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f907806d750 0x7f907806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:16.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.203+0000 7f90857fa640 1 -- 172.21.15.47:0/3576289847 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f907c0af270 con 0x7f90880fb2b0 2024-02-07T12:38:16.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.203+0000 7f9087fff640 1 --2- 172.21.15.47:0/3576289847 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f907806d750 0x7f907806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:16.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.203+0000 7f9087fff640 1 --2- 172.21.15.47:0/3576289847 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f907806d750 0x7f907806fc00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9088103c90 tx=0x7f9074004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:16.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.207+0000 7f90857fa640 1 -- 172.21.15.47:0/3576289847 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f907c078b40 con 0x7f90880fb2b0 2024-02-07T12:38:16.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.429+0000 7f908ed1d640 1 -- 172.21.15.47:0/3576289847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f90881083c0 con 0x7f90880fb2b0 2024-02-07T12:38:16.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.430+0000 7f90857fa640 1 -- 172.21.15.47:0/3576289847 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v48) v1 ==== 107+0+4936 (secure 0 0 0) 0x7f907c07c200 con 0x7f90880fb2b0 2024-02-07T12:38:16.432 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:16.432 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34460,"name":"cephfs.smithi047.jsgfge","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6829/3723006072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3723006072},{"type":"v1","addr":"172.21.15.47:6829","nonce":3723006072}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":44283,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/2036333358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":2036333358},{"type":"v1","addr":"172.21.15.138:6826","nonce":2036333358}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:12.310515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":36,"state":"up:active","state_seq":9,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:16.433 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 40 2024-02-07T12:38:16.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.432+0000 7f908ed1d640 1 -- 172.21.15.47:0/3576289847 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f907806d750 msgr2=0x7f907806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.432+0000 7f908ed1d640 1 --2- 172.21.15.47:0/3576289847 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f907806d750 0x7f907806fc00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9088103c90 tx=0x7f9074004330 comp rx=0 tx=0).stop 2024-02-07T12:38:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.432+0000 7f908ed1d640 1 -- 172.21.15.47:0/3576289847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90880fb2b0 msgr2=0x7f90881024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.432+0000 7f908ed1d640 1 --2- 172.21.15.47:0/3576289847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90880fb2b0 0x7f90881024a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f907c007da0 tx=0x7f907c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.432+0000 7f908ed1d640 1 -- 172.21.15.47:0/3576289847 shutdown_connections 2024-02-07T12:38:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.432+0000 7f908ed1d640 1 --2- 172.21.15.47:0/3576289847 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f907806d750 0x7f907806fc00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.432+0000 7f908ed1d640 1 --2- 172.21.15.47:0/3576289847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90881012d0 0x7f90881029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.432+0000 7f908ed1d640 1 --2- 172.21.15.47:0/3576289847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90880fb2b0 0x7f90881024a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.432+0000 7f908ed1d640 1 -- 172.21.15.47:0/3576289847 >> 172.21.15.47:0/3576289847 conn(0x7f9088071230 msgr2=0x7f90881045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.432+0000 7f908ed1d640 1 -- 172.21.15.47:0/3576289847 shutdown_connections 2024-02-07T12:38:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.432+0000 7f908ed1d640 1 -- 172.21.15.47:0/3576289847 wait complete. 2024-02-07T12:38:16.445 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-02-07T12:38:16.445 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 40 2024-02-07T12:38:16.445 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 41 2024-02-07T12:38:16.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.545+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/4053422548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c040644b0 msgr2=0x7f4c040648e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:16.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.545+0000 7f4c0ab5d640 1 --2- 172.21.15.47:0/4053422548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c040644b0 0x7f4c040648e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80048d0 tx=0x7f4bf8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.545+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/4053422548 shutdown_connections 2024-02-07T12:38:16.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.545+0000 7f4c0ab5d640 1 --2- 172.21.15.47:0/4053422548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c040644b0 0x7f4c040648e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.545+0000 7f4c0ab5d640 1 --2- 172.21.15.47:0/4053422548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c041023e0 0x7f4c041027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.545+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/4053422548 >> 172.21.15.47:0/4053422548 conn(0x7f4c04071230 msgr2=0x7f4c04071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:16.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.545+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/4053422548 shutdown_connections 2024-02-07T12:38:16.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.545+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/4053422548 wait complete. 2024-02-07T12:38:16.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.546+0000 7f4c0ab5d640 1 Processor -- start 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.546+0000 7f4c0ab5d640 1 -- start start 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.546+0000 7f4c0ab5d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c040644b0 0x7f4c04112c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.546+0000 7f4c0ab5d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c041023e0 0x7f4c04113140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.546+0000 7f4c0ab5d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c04113740 con 0x7f4c040644b0 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.546+0000 7f4c0ab5d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c041138b0 con 0x7f4c041023e0 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.546+0000 7f4c088f9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c040644b0 0x7f4c04112c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.546+0000 7f4c088f9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c040644b0 0x7f4c04112c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34448/0 (socket says 172.21.15.47:34448) 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.546+0000 7f4c088f9640 1 -- 172.21.15.47:0/1609426345 learned_addr learned my addr 172.21.15.47:0/1609426345 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.546+0000 7f4c03fff640 1 --2- 172.21.15.47:0/1609426345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c041023e0 0x7f4c04113140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.546+0000 7f4c088f9640 1 -- 172.21.15.47:0/1609426345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c041023e0 msgr2=0x7f4c04113140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.546+0000 7f4c088f9640 1 --2- 172.21.15.47:0/1609426345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c041023e0 0x7f4c04113140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.546+0000 7f4c088f9640 1 -- 172.21.15.47:0/1609426345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf8005040 con 0x7f4c040644b0 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.547+0000 7f4c088f9640 1 --2- 172.21.15.47:0/1609426345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c040644b0 0x7f4c04112c00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4002a80 tx=0x7f4bf4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:16.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.547+0000 7f4c017fa640 1 -- 172.21.15.47:0/1609426345 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf4007c30 con 0x7f4c040644b0 2024-02-07T12:38:16.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.547+0000 7f4c017fa640 1 -- 172.21.15.47:0/1609426345 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4bf400f040 con 0x7f4c040644b0 2024-02-07T12:38:16.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.547+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/1609426345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0410ce80 con 0x7f4c040644b0 2024-02-07T12:38:16.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.547+0000 7f4c017fa640 1 -- 172.21.15.47:0/1609426345 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf40096b0 con 0x7f4c040644b0 2024-02-07T12:38:16.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.547+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/1609426345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0410d3a0 con 0x7f4c040644b0 2024-02-07T12:38:16.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.548+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/1609426345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c04064030 con 0x7f4c040644b0 2024-02-07T12:38:16.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.548+0000 7f4c017fa640 1 -- 172.21.15.47:0/1609426345 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f4bf400d6b0 con 0x7f4c040644b0 2024-02-07T12:38:16.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.549+0000 7f4c017fa640 1 --2- 172.21.15.47:0/1609426345 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4bec06d750 0x7f4bec06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:16.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.549+0000 7f4c017fa640 1 -- 172.21.15.47:0/1609426345 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4bf408c9b0 con 0x7f4c040644b0 2024-02-07T12:38:16.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.549+0000 7f4c03fff640 1 --2- 172.21.15.47:0/1609426345 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4bec06d750 0x7f4bec06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:16.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.549+0000 7f4c03fff640 1 --2- 172.21.15.47:0/1609426345 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4bec06d750 0x7f4bec06fc00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4c0410e500 tx=0x7f4bf8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.557+0000 7f4c017fa640 1 -- 172.21.15.47:0/1609426345 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4bf4056150 con 0x7f4c040644b0 2024-02-07T12:38:16.686 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:16 smithi138 ceph-mon[82055]: pgmap v333: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:38:16.686 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:16 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1507801455' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-07T12:38:16.686 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:16 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3323268109' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-02-07T12:38:16.686 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:16 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2507883866' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-02-07T12:38:16.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.788+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/1609426345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f4c0410d5c0 con 0x7f4c040644b0 2024-02-07T12:38:16.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.789+0000 7f4c017fa640 1 -- 172.21.15.47:0/1609426345 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v48) v1 ==== 107+0+4154 (secure 0 0 0) 0x7f4bf4059810 con 0x7f4c040644b0 2024-02-07T12:38:16.791 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:16.791 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34460,"name":"cephfs.smithi047.jsgfge","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6829/3723006072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3723006072},{"type":"v1","addr":"172.21.15.47:6829","nonce":3723006072}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:12.310515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":36,"state":"up:active","state_seq":9,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:16.791 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 41 2024-02-07T12:38:16.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.791+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/1609426345 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4bec06d750 msgr2=0x7f4bec06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:16.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.791+0000 7f4c0ab5d640 1 --2- 172.21.15.47:0/1609426345 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4bec06d750 0x7f4bec06fc00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4c0410e500 tx=0x7f4bf8009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.791+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/1609426345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c040644b0 msgr2=0x7f4c04112c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:16.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.791+0000 7f4c0ab5d640 1 --2- 172.21.15.47:0/1609426345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c040644b0 0x7f4c04112c00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4002a80 tx=0x7f4bf4004600 comp rx=0 tx=0).stop 2024-02-07T12:38:16.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.791+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/1609426345 shutdown_connections 2024-02-07T12:38:16.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.791+0000 7f4c0ab5d640 1 --2- 172.21.15.47:0/1609426345 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4bec06d750 0x7f4bec06fc00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.791+0000 7f4c0ab5d640 1 --2- 172.21.15.47:0/1609426345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c041023e0 0x7f4c04113140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.791+0000 7f4c0ab5d640 1 --2- 172.21.15.47:0/1609426345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c040644b0 0x7f4c04112c00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.791+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/1609426345 >> 172.21.15.47:0/1609426345 conn(0x7f4c04071230 msgr2=0x7f4c040fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:16.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.791+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/1609426345 shutdown_connections 2024-02-07T12:38:16.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.791+0000 7f4c0ab5d640 1 -- 172.21.15.47:0/1609426345 wait complete. 2024-02-07T12:38:16.804 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:16 smithi047 ceph-mon[93224]: pgmap v333: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:38:16.804 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:16 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1507801455' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-07T12:38:16.804 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:16 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3323268109' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-02-07T12:38:16.804 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:16 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2507883866' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-02-07T12:38:16.805 DEBUG:tasks.fs:max_mds reduced in epoch 41 2024-02-07T12:38:16.805 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 41 2024-02-07T12:38:16.805 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 42 2024-02-07T12:38:16.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.904+0000 7fc98c621640 1 -- 172.21.15.47:0/1490820134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9840fb2b0 msgr2=0x7fc9840fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:16.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.904+0000 7fc98c621640 1 --2- 172.21.15.47:0/1490820134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9840fb2b0 0x7fc9840fb700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc9740048d0 tx=0x7fc974009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.904+0000 7fc98c621640 1 -- 172.21.15.47:0/1490820134 shutdown_connections 2024-02-07T12:38:16.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.904+0000 7fc98c621640 1 --2- 172.21.15.47:0/1490820134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9840fb2b0 0x7fc9840fb700 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.904+0000 7fc98c621640 1 --2- 172.21.15.47:0/1490820134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9841012d0 0x7fc9841016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.904+0000 7fc98c621640 1 -- 172.21.15.47:0/1490820134 >> 172.21.15.47:0/1490820134 conn(0x7fc984071230 msgr2=0x7fc984071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.904+0000 7fc98c621640 1 -- 172.21.15.47:0/1490820134 shutdown_connections 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.904+0000 7fc98c621640 1 -- 172.21.15.47:0/1490820134 wait complete. 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.905+0000 7fc98c621640 1 Processor -- start 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.905+0000 7fc98c621640 1 -- start start 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.905+0000 7fc98c621640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9840fb2b0 0x7fc98410dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.905+0000 7fc98c621640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9841012d0 0x7fc98410e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.905+0000 7fc98c621640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98410e790 con 0x7fc9841012d0 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.905+0000 7fc98c621640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98410e900 con 0x7fc9840fb2b0 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.905+0000 7fc989bbc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9841012d0 0x7fc98410e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.905+0000 7fc989bbc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9841012d0 0x7fc98410e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34478/0 (socket says 172.21.15.47:34478) 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.905+0000 7fc989bbc640 1 -- 172.21.15.47:0/3026191693 learned_addr learned my addr 172.21.15.47:0/3026191693 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.905+0000 7fc98a3bd640 1 --2- 172.21.15.47:0/3026191693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9840fb2b0 0x7fc98410dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:16.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.906+0000 7fc989bbc640 1 -- 172.21.15.47:0/3026191693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9840fb2b0 msgr2=0x7fc98410dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:16.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.906+0000 7fc989bbc640 1 --2- 172.21.15.47:0/3026191693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9840fb2b0 0x7fc98410dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:16.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.906+0000 7fc989bbc640 1 -- 172.21.15.47:0/3026191693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974005040 con 0x7fc9841012d0 2024-02-07T12:38:16.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.906+0000 7fc989bbc640 1 --2- 172.21.15.47:0/3026191693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9841012d0 0x7fc98410e200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc974031720 tx=0x7fc974009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:16.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.906+0000 7fc97affd640 1 -- 172.21.15.47:0/3026191693 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9740094c0 con 0x7fc9841012d0 2024-02-07T12:38:16.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.906+0000 7fc97affd640 1 -- 172.21.15.47:0/3026191693 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc974009620 con 0x7fc9841012d0 2024-02-07T12:38:16.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.906+0000 7fc98c621640 1 -- 172.21.15.47:0/3026191693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc984116d30 con 0x7fc9841012d0 2024-02-07T12:38:16.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.906+0000 7fc97affd640 1 -- 172.21.15.47:0/3026191693 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc97403b640 con 0x7fc9841012d0 2024-02-07T12:38:16.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.906+0000 7fc98c621640 1 -- 172.21.15.47:0/3026191693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc984117110 con 0x7fc9841012d0 2024-02-07T12:38:16.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.907+0000 7fc98c621640 1 -- 172.21.15.47:0/3026191693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc984064030 con 0x7fc9841012d0 2024-02-07T12:38:16.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.908+0000 7fc97affd640 1 -- 172.21.15.47:0/3026191693 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc97402f070 con 0x7fc9841012d0 2024-02-07T12:38:16.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.908+0000 7fc97affd640 1 --2- 172.21.15.47:0/3026191693 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc97006d750 0x7fc97006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:16.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.909+0000 7fc97affd640 1 -- 172.21.15.47:0/3026191693 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc9740af460 con 0x7fc9841012d0 2024-02-07T12:38:16.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.909+0000 7fc98a3bd640 1 --2- 172.21.15.47:0/3026191693 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc97006d750 0x7fc97006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:16.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.909+0000 7fc98a3bd640 1 --2- 172.21.15.47:0/3026191693 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc97006d750 0x7fc97006fc00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc980004ce0 tx=0x7fc98000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:16.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:16.913+0000 7fc97affd640 1 -- 172.21.15.47:0/3026191693 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc974078c00 con 0x7fc9841012d0 2024-02-07T12:38:17.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.134+0000 7fc98c621640 1 -- 172.21.15.47:0/3026191693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7fc9841083c0 con 0x7fc9841012d0 2024-02-07T12:38:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.135+0000 7fc97affd640 1 -- 172.21.15.47:0/3026191693 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v48) v1 ==== 107+0+4970 (secure 0 0 0) 0x7fc97407c2c0 con 0x7fc9841012d0 2024-02-07T12:38:17.137 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:17.137 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34460,"name":"cephfs.smithi047.jsgfge","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6829/3723006072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3723006072},{"type":"v1","addr":"172.21.15.47:6829","nonce":3723006072}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":44285,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/1793209176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1793209176},{"type":"v1","addr":"172.21.15.138:6827","nonce":1793209176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44365,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/3547121337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":3547121337},{"type":"v1","addr":"172.21.15.138:6826","nonce":3547121337}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:12.310515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":36,"state":"up:active","state_seq":9,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 42 2024-02-07T12:38:17.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.137+0000 7fc98c621640 1 -- 172.21.15.47:0/3026191693 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc97006d750 msgr2=0x7fc97006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:17.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.137+0000 7fc98c621640 1 --2- 172.21.15.47:0/3026191693 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc97006d750 0x7fc97006fc00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc980004ce0 tx=0x7fc98000b040 comp rx=0 tx=0).stop 2024-02-07T12:38:17.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.137+0000 7fc98c621640 1 -- 172.21.15.47:0/3026191693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9841012d0 msgr2=0x7fc98410e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:17.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.137+0000 7fc98c621640 1 --2- 172.21.15.47:0/3026191693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9841012d0 0x7fc98410e200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc974031720 tx=0x7fc974009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.137+0000 7fc98c621640 1 -- 172.21.15.47:0/3026191693 shutdown_connections 2024-02-07T12:38:17.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.137+0000 7fc98c621640 1 --2- 172.21.15.47:0/3026191693 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc97006d750 0x7fc97006fc00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.137+0000 7fc98c621640 1 --2- 172.21.15.47:0/3026191693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9841012d0 0x7fc98410e200 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.137+0000 7fc98c621640 1 --2- 172.21.15.47:0/3026191693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9840fb2b0 0x7fc98410dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.137+0000 7fc98c621640 1 -- 172.21.15.47:0/3026191693 >> 172.21.15.47:0/3026191693 conn(0x7fc984071230 msgr2=0x7fc9840fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.137+0000 7fc98c621640 1 -- 172.21.15.47:0/3026191693 shutdown_connections 2024-02-07T12:38:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.137+0000 7fc98c621640 1 -- 172.21.15.47:0/3026191693 wait complete. 2024-02-07T12:38:17.150 DEBUG:tasks.fs:max_mds reduced in epoch 42 2024-02-07T12:38:17.150 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 42 2024-02-07T12:38:17.150 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 43 2024-02-07T12:38:17.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.248+0000 7f295751d640 1 -- 172.21.15.47:0/582479361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29501012d0 msgr2=0x7f29501016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:17.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.248+0000 7f295751d640 1 --2- 172.21.15.47:0/582479361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29501012d0 0x7f29501016a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f294c0048d0 tx=0x7f294c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.248+0000 7f295751d640 1 -- 172.21.15.47:0/582479361 shutdown_connections 2024-02-07T12:38:17.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.248+0000 7f295751d640 1 --2- 172.21.15.47:0/582479361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29500fb2b0 0x7f29500fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.248+0000 7f295751d640 1 --2- 172.21.15.47:0/582479361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29501012d0 0x7f29501016a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.248+0000 7f295751d640 1 -- 172.21.15.47:0/582479361 >> 172.21.15.47:0/582479361 conn(0x7f2950071230 msgr2=0x7f2950071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:17.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.249+0000 7f295751d640 1 -- 172.21.15.47:0/582479361 shutdown_connections 2024-02-07T12:38:17.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.249+0000 7f295751d640 1 -- 172.21.15.47:0/582479361 wait complete. 2024-02-07T12:38:17.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.249+0000 7f295751d640 1 Processor -- start 2024-02-07T12:38:17.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.249+0000 7f295751d640 1 -- start start 2024-02-07T12:38:17.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.249+0000 7f295751d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29500fb2b0 0x7f295010dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:17.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.249+0000 7f295751d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29501012d0 0x7f295010e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.249+0000 7f295751d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295010e780 con 0x7f29501012d0 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.249+0000 7f295751d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295010e8f0 con 0x7f29500fb2b0 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.249+0000 7f2954ab8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29501012d0 0x7f295010e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.249+0000 7f2954ab8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29501012d0 0x7f295010e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34490/0 (socket says 172.21.15.47:34490) 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.249+0000 7f2954ab8640 1 -- 172.21.15.47:0/3713324416 learned_addr learned my addr 172.21.15.47:0/3713324416 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.250+0000 7f29552b9640 1 --2- 172.21.15.47:0/3713324416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29500fb2b0 0x7f295010dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.250+0000 7f2954ab8640 1 -- 172.21.15.47:0/3713324416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29500fb2b0 msgr2=0x7f295010dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.250+0000 7f2954ab8640 1 --2- 172.21.15.47:0/3713324416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29500fb2b0 0x7f295010dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.250+0000 7f2954ab8640 1 -- 172.21.15.47:0/3713324416 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c005040 con 0x7f29501012d0 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.250+0000 7f29552b9640 1 --2- 172.21.15.47:0/3713324416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29500fb2b0 0x7f295010dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.250+0000 7f2954ab8640 1 --2- 172.21.15.47:0/3713324416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29501012d0 0x7f295010e240 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f294000eb70 tx=0x7f294000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.250+0000 7f2945ffb640 1 -- 172.21.15.47:0/3713324416 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2940007c30 con 0x7f29501012d0 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.250+0000 7f2945ffb640 1 -- 172.21.15.47:0/3713324416 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f294000f040 con 0x7f29501012d0 2024-02-07T12:38:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.250+0000 7f295751d640 1 -- 172.21.15.47:0/3713324416 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295010eb70 con 0x7f29501012d0 2024-02-07T12:38:17.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.250+0000 7f2945ffb640 1 -- 172.21.15.47:0/3713324416 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29400095b0 con 0x7f29501012d0 2024-02-07T12:38:17.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.250+0000 7f295751d640 1 -- 172.21.15.47:0/3713324416 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2950117050 con 0x7f29501012d0 2024-02-07T12:38:17.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.251+0000 7f295751d640 1 -- 172.21.15.47:0/3713324416 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2950064030 con 0x7f29501012d0 2024-02-07T12:38:17.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.251+0000 7f2945ffb640 1 -- 172.21.15.47:0/3713324416 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f2940009730 con 0x7f29501012d0 2024-02-07T12:38:17.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.252+0000 7f2945ffb640 1 --2- 172.21.15.47:0/3713324416 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f293c06d750 0x7f293c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:17.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.252+0000 7f2945ffb640 1 -- 172.21.15.47:0/3713324416 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f294008cb70 con 0x7f29501012d0 2024-02-07T12:38:17.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.252+0000 7f29552b9640 1 --2- 172.21.15.47:0/3713324416 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f293c06d750 0x7f293c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:17.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.252+0000 7f29552b9640 1 --2- 172.21.15.47:0/3713324416 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f293c06d750 0x7f293c06fc00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f294c003080 tx=0x7f294c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:17.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.257+0000 7f2945ffb640 1 -- 172.21.15.47:0/3713324416 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2940056310 con 0x7f29501012d0 2024-02-07T12:38:17.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.489+0000 7f295751d640 1 -- 172.21.15.47:0/3713324416 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 43, "format": "json"} v 0) v1 -- 0x7f29501083c0 con 0x7f29501012d0 2024-02-07T12:38:17.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.490+0000 7f2945ffb640 1 -- 172.21.15.47:0/3713324416 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 43, "format": "json"}]=0 dumped fsmap epoch 43 v48) v1 ==== 107+0+4188 (secure 0 0 0) 0x7f29400599d0 con 0x7f29501012d0 2024-02-07T12:38:17.492 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:17.492 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34460,"name":"cephfs.smithi047.jsgfge","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6829/3723006072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3723006072},{"type":"v1","addr":"172.21.15.47:6829","nonce":3723006072}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":44365,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/3547121337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":3547121337},{"type":"v1","addr":"172.21.15.138:6826","nonce":3547121337}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:12.310515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":36,"state":"up:active","state_seq":9,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:17.492 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 43 2024-02-07T12:38:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.492+0000 7f295751d640 1 -- 172.21.15.47:0/3713324416 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f293c06d750 msgr2=0x7f293c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.492+0000 7f295751d640 1 --2- 172.21.15.47:0/3713324416 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f293c06d750 0x7f293c06fc00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f294c003080 tx=0x7f294c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.492+0000 7f295751d640 1 -- 172.21.15.47:0/3713324416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29501012d0 msgr2=0x7f295010e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.492+0000 7f295751d640 1 --2- 172.21.15.47:0/3713324416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29501012d0 0x7f295010e240 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f294000eb70 tx=0x7f294000b040 comp rx=0 tx=0).stop 2024-02-07T12:38:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.492+0000 7f295751d640 1 -- 172.21.15.47:0/3713324416 shutdown_connections 2024-02-07T12:38:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.492+0000 7f295751d640 1 --2- 172.21.15.47:0/3713324416 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f293c06d750 0x7f293c06fc00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.492+0000 7f295751d640 1 --2- 172.21.15.47:0/3713324416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29501012d0 0x7f295010e240 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.492+0000 7f295751d640 1 --2- 172.21.15.47:0/3713324416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29500fb2b0 0x7f295010dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.492+0000 7f295751d640 1 -- 172.21.15.47:0/3713324416 >> 172.21.15.47:0/3713324416 conn(0x7f2950071230 msgr2=0x7f29500fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:17.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.492+0000 7f295751d640 1 -- 172.21.15.47:0/3713324416 shutdown_connections 2024-02-07T12:38:17.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.492+0000 7f295751d640 1 -- 172.21.15.47:0/3713324416 wait complete. 2024-02-07T12:38:17.504 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:17 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3576289847' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-02-07T12:38:17.504 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:17 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1609426345' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-02-07T12:38:17.504 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:17 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3026191693' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-02-07T12:38:17.505 DEBUG:tasks.fs:max_mds reduced in epoch 43 2024-02-07T12:38:17.505 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 43 2024-02-07T12:38:17.505 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 44 2024-02-07T12:38:17.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.602+0000 7f82e186e640 1 -- 172.21.15.47:0/3835242419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82dc0fc650 msgr2=0x7f82dc108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:17.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.602+0000 7f82e186e640 1 --2- 172.21.15.47:0/3835242419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82dc0fc650 0x7f82dc108920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f82d0004900 tx=0x7f82d0009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.602+0000 7f82e186e640 1 -- 172.21.15.47:0/3835242419 shutdown_connections 2024-02-07T12:38:17.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.602+0000 7f82e186e640 1 --2- 172.21.15.47:0/3835242419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82dc0fc650 0x7f82dc108920 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.602+0000 7f82e186e640 1 --2- 172.21.15.47:0/3835242419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82dc0fbd40 0x7f82dc0fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.602+0000 7f82e186e640 1 -- 172.21.15.47:0/3835242419 >> 172.21.15.47:0/3835242419 conn(0x7f82dc071230 msgr2=0x7f82dc071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:17.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.602+0000 7f82e186e640 1 -- 172.21.15.47:0/3835242419 shutdown_connections 2024-02-07T12:38:17.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.602+0000 7f82e186e640 1 -- 172.21.15.47:0/3835242419 wait complete. 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.603+0000 7f82e186e640 1 Processor -- start 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.603+0000 7f82e186e640 1 -- start start 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.603+0000 7f82e186e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82dc0fbd40 0x7f82dc114df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.603+0000 7f82e186e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82dc0fc650 0x7f82dc115330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.603+0000 7f82e186e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc115930 con 0x7f82dc0fbd40 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.603+0000 7f82e186e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc10eec0 con 0x7f82dc0fc650 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.603+0000 7f82daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82dc0fbd40 0x7f82dc114df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.603+0000 7f82daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82dc0fbd40 0x7f82dc114df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34500/0 (socket says 172.21.15.47:34500) 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.603+0000 7f82daffd640 1 -- 172.21.15.47:0/3467903644 learned_addr learned my addr 172.21.15.47:0/3467903644 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.603+0000 7f82daffd640 1 -- 172.21.15.47:0/3467903644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82dc0fc650 msgr2=0x7f82dc115330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.603+0000 7f82daffd640 1 --2- 172.21.15.47:0/3467903644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82dc0fc650 0x7f82dc115330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.603+0000 7f82daffd640 1 -- 172.21.15.47:0/3467903644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d0005040 con 0x7f82dc0fbd40 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.604+0000 7f82daffd640 1 --2- 172.21.15.47:0/3467903644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82dc0fbd40 0x7f82dc114df0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f82d4002a50 tx=0x7f82d4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.604+0000 7f82c37fe640 1 -- 172.21.15.47:0/3467903644 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d4007c30 con 0x7f82dc0fbd40 2024-02-07T12:38:17.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.604+0000 7f82c37fe640 1 -- 172.21.15.47:0/3467903644 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f82d400f040 con 0x7f82dc0fbd40 2024-02-07T12:38:17.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.604+0000 7f82e186e640 1 -- 172.21.15.47:0/3467903644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82dc10f1a0 con 0x7f82dc0fbd40 2024-02-07T12:38:17.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.604+0000 7f82c37fe640 1 -- 172.21.15.47:0/3467903644 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d400dbe0 con 0x7f82dc0fbd40 2024-02-07T12:38:17.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.604+0000 7f82e186e640 1 -- 172.21.15.47:0/3467903644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc10f6c0 con 0x7f82dc0fbd40 2024-02-07T12:38:17.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.605+0000 7f82e186e640 1 -- 172.21.15.47:0/3467903644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82dc064030 con 0x7f82dc0fbd40 2024-02-07T12:38:17.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.605+0000 7f82c37fe640 1 -- 172.21.15.47:0/3467903644 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f82d400dd40 con 0x7f82dc0fbd40 2024-02-07T12:38:17.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.606+0000 7f82c37fe640 1 --2- 172.21.15.47:0/3467903644 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f82c406d750 0x7f82c406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:17.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.606+0000 7f82c37fe640 1 -- 172.21.15.47:0/3467903644 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f82d408cfe0 con 0x7f82dc0fbd40 2024-02-07T12:38:17.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.606+0000 7f82da7fc640 1 --2- 172.21.15.47:0/3467903644 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f82c406d750 0x7f82c406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:17.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.606+0000 7f82da7fc640 1 --2- 172.21.15.47:0/3467903644 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f82c406d750 0x7f82c406fc00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009990 tx=0x7f82d0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:17.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.610+0000 7f82c37fe640 1 -- 172.21.15.47:0/3467903644 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f82d4056720 con 0x7f82dc0fbd40 2024-02-07T12:38:17.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:17 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3576289847' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-02-07T12:38:17.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:17 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1609426345' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-02-07T12:38:17.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:17 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3026191693' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-02-07T12:38:17.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.831+0000 7f82e186e640 1 -- 172.21.15.47:0/3467903644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 44, "format": "json"} v 0) v1 -- 0x7f82dc10b660 con 0x7f82dc0fbd40 2024-02-07T12:38:17.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.832+0000 7f82c37fe640 1 -- 172.21.15.47:0/3467903644 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 44, "format": "json"}]=0 dumped fsmap epoch 44 v48) v1 ==== 107+0+5004 (secure 0 0 0) 0x7f82d4059de0 con 0x7f82dc0fbd40 2024-02-07T12:38:17.834 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:17.834 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34460,"name":"cephfs.smithi047.jsgfge","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6829/3723006072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3723006072},{"type":"v1","addr":"172.21.15.47:6829","nonce":3723006072}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":44365,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/3547121337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":3547121337},{"type":"v1","addr":"172.21.15.138:6826","nonce":3547121337}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":44369,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2689114398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2689114398},{"type":"v1","addr":"172.21.15.138:6827","nonce":2689114398}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:12.310515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":36,"state":"up:active","state_seq":9,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:17.834 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 44 2024-02-07T12:38:17.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.833+0000 7f82e186e640 1 -- 172.21.15.47:0/3467903644 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f82c406d750 msgr2=0x7f82c406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:17.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.833+0000 7f82e186e640 1 --2- 172.21.15.47:0/3467903644 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f82c406d750 0x7f82c406fc00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009990 tx=0x7f82d0009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.833+0000 7f82e186e640 1 -- 172.21.15.47:0/3467903644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82dc0fbd40 msgr2=0x7f82dc114df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:17.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.833+0000 7f82e186e640 1 --2- 172.21.15.47:0/3467903644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82dc0fbd40 0x7f82dc114df0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f82d4002a50 tx=0x7f82d4004600 comp rx=0 tx=0).stop 2024-02-07T12:38:17.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.834+0000 7f82e186e640 1 -- 172.21.15.47:0/3467903644 shutdown_connections 2024-02-07T12:38:17.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.834+0000 7f82e186e640 1 --2- 172.21.15.47:0/3467903644 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f82c406d750 0x7f82c406fc00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.834+0000 7f82e186e640 1 --2- 172.21.15.47:0/3467903644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82dc0fc650 0x7f82dc115330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.834+0000 7f82e186e640 1 --2- 172.21.15.47:0/3467903644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82dc0fbd40 0x7f82dc114df0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.834+0000 7f82e186e640 1 -- 172.21.15.47:0/3467903644 >> 172.21.15.47:0/3467903644 conn(0x7f82dc071230 msgr2=0x7f82dc0f9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:17.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.834+0000 7f82e186e640 1 -- 172.21.15.47:0/3467903644 shutdown_connections 2024-02-07T12:38:17.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.834+0000 7f82e186e640 1 -- 172.21.15.47:0/3467903644 wait complete. 2024-02-07T12:38:17.847 DEBUG:tasks.fs:max_mds reduced in epoch 44 2024-02-07T12:38:17.847 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 44 2024-02-07T12:38:17.847 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 45 2024-02-07T12:38:17.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.944+0000 7f4cd1507640 1 -- 172.21.15.47:0/178976510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ccc101240 msgr2=0x7f4ccc101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:17.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.944+0000 7f4cd1507640 1 --2- 172.21.15.47:0/178976510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ccc101240 0x7f4ccc101610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0048d0 tx=0x7f4cbc009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.944+0000 7f4cd1507640 1 -- 172.21.15.47:0/178976510 shutdown_connections 2024-02-07T12:38:17.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.944+0000 7f4cd1507640 1 --2- 172.21.15.47:0/178976510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc101be0 0x7f4ccc0fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.944+0000 7f4cd1507640 1 --2- 172.21.15.47:0/178976510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ccc101240 0x7f4ccc101610 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.944+0000 7f4cd1507640 1 -- 172.21.15.47:0/178976510 >> 172.21.15.47:0/178976510 conn(0x7f4ccc0f6e30 msgr2=0x7f4ccc0f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:17.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.944+0000 7f4cd1507640 1 -- 172.21.15.47:0/178976510 shutdown_connections 2024-02-07T12:38:17.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.944+0000 7f4cd1507640 1 -- 172.21.15.47:0/178976510 wait complete. 2024-02-07T12:38:17.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.944+0000 7f4cd1507640 1 Processor -- start 2024-02-07T12:38:17.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.944+0000 7f4cd1507640 1 -- start start 2024-02-07T12:38:17.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cd1507640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc101240 0x7f4ccc111af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:17.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cd1507640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ccc101be0 0x7f4ccc112030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:17.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cd1507640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc112630 con 0x7f4ccc101be0 2024-02-07T12:38:17.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cd1507640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc10bbc0 con 0x7f4ccc101240 2024-02-07T12:38:17.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cc27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ccc101be0 0x7f4ccc112030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:17.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cc27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ccc101be0 0x7f4ccc112030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34520/0 (socket says 172.21.15.47:34520) 2024-02-07T12:38:17.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cc27fc640 1 -- 172.21.15.47:0/4134803842 learned_addr learned my addr 172.21.15.47:0/4134803842 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:17.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4ccaffd640 1 --2- 172.21.15.47:0/4134803842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc101240 0x7f4ccc111af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:17.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cc27fc640 1 -- 172.21.15.47:0/4134803842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc101240 msgr2=0x7f4ccc111af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:17.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cc27fc640 1 --2- 172.21.15.47:0/4134803842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc101240 0x7f4ccc111af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:17.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cc27fc640 1 -- 172.21.15.47:0/4134803842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc005040 con 0x7f4ccc101be0 2024-02-07T12:38:17.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cc27fc640 1 --2- 172.21.15.47:0/4134803842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ccc101be0 0x7f4ccc112030 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400c790 tx=0x7f4cb40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:17.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cc3fff640 1 -- 172.21.15.47:0/4134803842 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cb400a820 con 0x7f4ccc101be0 2024-02-07T12:38:17.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cd1507640 1 -- 172.21.15.47:0/4134803842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ccc10bea0 con 0x7f4ccc101be0 2024-02-07T12:38:17.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cc3fff640 1 -- 172.21.15.47:0/4134803842 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4cb400ae50 con 0x7f4ccc101be0 2024-02-07T12:38:17.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cc3fff640 1 -- 172.21.15.47:0/4134803842 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cb40115e0 con 0x7f4ccc101be0 2024-02-07T12:38:17.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.945+0000 7f4cd1507640 1 -- 172.21.15.47:0/4134803842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ccc10c3c0 con 0x7f4ccc101be0 2024-02-07T12:38:17.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.946+0000 7f4cd1507640 1 -- 172.21.15.47:0/4134803842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ccc064480 con 0x7f4ccc101be0 2024-02-07T12:38:17.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.947+0000 7f4cc3fff640 1 -- 172.21.15.47:0/4134803842 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f4cb4012400 con 0x7f4ccc101be0 2024-02-07T12:38:17.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.947+0000 7f4cc3fff640 1 --2- 172.21.15.47:0/4134803842 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4cb806d750 0x7f4cb806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:17.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.947+0000 7f4cc3fff640 1 -- 172.21.15.47:0/4134803842 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4cb408d100 con 0x7f4ccc101be0 2024-02-07T12:38:17.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.947+0000 7f4ccaffd640 1 --2- 172.21.15.47:0/4134803842 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4cb806d750 0x7f4cb806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:17.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.948+0000 7f4ccaffd640 1 --2- 172.21.15.47:0/4134803842 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4cb806d750 0x7f4cb806fc00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc000c00 tx=0x7f4cbc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:17.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:17.952+0000 7f4cc3fff640 1 -- 172.21.15.47:0/4134803842 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4cb4056920 con 0x7f4ccc101be0 2024-02-07T12:38:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.170+0000 7f4cd1507640 1 -- 172.21.15.47:0/4134803842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 45, "format": "json"} v 0) v1 -- 0x7f4ccc10c640 con 0x7f4ccc101be0 2024-02-07T12:38:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.170+0000 7f4cc3fff640 1 -- 172.21.15.47:0/4134803842 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 45, "format": "json"}]=0 dumped fsmap epoch 45 v48) v1 ==== 107+0+5004 (secure 0 0 0) 0x7f4cb4059fe0 con 0x7f4ccc101be0 2024-02-07T12:38:18.172 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:18.172 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34460,"name":"cephfs.smithi047.jsgfge","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6829/3723006072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3723006072},{"type":"v1","addr":"172.21.15.47:6829","nonce":3723006072}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":44365,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/3547121337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":3547121337},{"type":"v1","addr":"172.21.15.138:6826","nonce":3547121337}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":44369,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2689114398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2689114398},{"type":"v1","addr":"172.21.15.138:6827","nonce":2689114398}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:55.628590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":36,"state":"up:active","state_seq":9,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:18.173 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 45 2024-02-07T12:38:18.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.172+0000 7f4cd1507640 1 -- 172.21.15.47:0/4134803842 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4cb806d750 msgr2=0x7f4cb806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:18.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.172+0000 7f4cd1507640 1 --2- 172.21.15.47:0/4134803842 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4cb806d750 0x7f4cb806fc00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc000c00 tx=0x7f4cbc009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.172+0000 7f4cd1507640 1 -- 172.21.15.47:0/4134803842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ccc101be0 msgr2=0x7f4ccc112030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:18.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.172+0000 7f4cd1507640 1 --2- 172.21.15.47:0/4134803842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ccc101be0 0x7f4ccc112030 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400c790 tx=0x7f4cb40043c0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.172+0000 7f4cd1507640 1 -- 172.21.15.47:0/4134803842 shutdown_connections 2024-02-07T12:38:18.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.172+0000 7f4cd1507640 1 --2- 172.21.15.47:0/4134803842 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4cb806d750 0x7f4cb806fc00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.172+0000 7f4cd1507640 1 --2- 172.21.15.47:0/4134803842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ccc101be0 0x7f4ccc112030 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.172+0000 7f4cd1507640 1 --2- 172.21.15.47:0/4134803842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc101240 0x7f4ccc111af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.172+0000 7f4cd1507640 1 -- 172.21.15.47:0/4134803842 >> 172.21.15.47:0/4134803842 conn(0x7f4ccc0f6e30 msgr2=0x7f4ccc0f8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:18.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.173+0000 7f4cd1507640 1 -- 172.21.15.47:0/4134803842 shutdown_connections 2024-02-07T12:38:18.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.173+0000 7f4cd1507640 1 -- 172.21.15.47:0/4134803842 wait complete. 2024-02-07T12:38:18.185 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 45 2024-02-07T12:38:18.186 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 46 2024-02-07T12:38:18.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.284+0000 7fdf98a6e640 1 -- 172.21.15.47:0/3872353241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf94101c10 msgr2=0x7fdf940fb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.284+0000 7fdf98a6e640 1 --2- 172.21.15.47:0/3872353241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf94101c10 0x7fdf940fb2a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0048d0 tx=0x7fdf7c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.284+0000 7fdf98a6e640 1 -- 172.21.15.47:0/3872353241 shutdown_connections 2024-02-07T12:38:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.284+0000 7fdf98a6e640 1 --2- 172.21.15.47:0/3872353241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf94101c10 0x7fdf940fb2a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.284+0000 7fdf98a6e640 1 --2- 172.21.15.47:0/3872353241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf94101270 0x7fdf94101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.284+0000 7fdf98a6e640 1 -- 172.21.15.47:0/3872353241 >> 172.21.15.47:0/3872353241 conn(0x7fdf940f6de0 msgr2=0x7fdf940f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.284+0000 7fdf98a6e640 1 -- 172.21.15.47:0/3872353241 shutdown_connections 2024-02-07T12:38:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.284+0000 7fdf98a6e640 1 -- 172.21.15.47:0/3872353241 wait complete. 2024-02-07T12:38:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf98a6e640 1 Processor -- start 2024-02-07T12:38:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf98a6e640 1 -- start start 2024-02-07T12:38:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf98a6e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf94101270 0x7fdf94111b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf98a6e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf94101c10 0x7fdf941120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf98a6e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94112730 con 0x7fdf94101270 2024-02-07T12:38:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf98a6e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9410bc30 con 0x7fdf94101c10 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf9259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf94101270 0x7fdf94111b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf9259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf94101270 0x7fdf94111b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34538/0 (socket says 172.21.15.47:34538) 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf9259c640 1 -- 172.21.15.47:0/636438711 learned_addr learned my addr 172.21.15.47:0/636438711 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf8bfff640 1 --2- 172.21.15.47:0/636438711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf94101c10 0x7fdf941120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf9259c640 1 -- 172.21.15.47:0/636438711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf94101c10 msgr2=0x7fdf941120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf9259c640 1 --2- 172.21.15.47:0/636438711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf94101c10 0x7fdf941120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf9259c640 1 -- 172.21.15.47:0/636438711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c005040 con 0x7fdf94101270 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf9259c640 1 --2- 172.21.15.47:0/636438711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf94101270 0x7fdf94111b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400b790 tx=0x7fdf840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.285+0000 7fdf8affd640 1 -- 172.21.15.47:0/636438711 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf8400c700 con 0x7fdf94101270 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.286+0000 7fdf8affd640 1 -- 172.21.15.47:0/636438711 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf8400cd30 con 0x7fdf94101270 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.286+0000 7fdf98a6e640 1 -- 172.21.15.47:0/636438711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9410bf10 con 0x7fdf94101270 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.286+0000 7fdf8affd640 1 -- 172.21.15.47:0/636438711 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf84013370 con 0x7fdf94101270 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.286+0000 7fdf98a6e640 1 -- 172.21.15.47:0/636438711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9410c400 con 0x7fdf94101270 2024-02-07T12:38:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.287+0000 7fdf98a6e640 1 -- 172.21.15.47:0/636438711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf94064480 con 0x7fdf94101270 2024-02-07T12:38:18.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.287+0000 7fdf8affd640 1 -- 172.21.15.47:0/636438711 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fdf84012070 con 0x7fdf94101270 2024-02-07T12:38:18.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.288+0000 7fdf8affd640 1 --2- 172.21.15.47:0/636438711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fdf8006d760 0x7fdf8006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:18.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.288+0000 7fdf8affd640 1 -- 172.21.15.47:0/636438711 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fdf8408c960 con 0x7fdf94101270 2024-02-07T12:38:18.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.288+0000 7fdf8bfff640 1 --2- 172.21.15.47:0/636438711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fdf8006d760 0x7fdf8006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.288+0000 7fdf8bfff640 1 --2- 172.21.15.47:0/636438711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fdf8006d760 0x7fdf8006fc10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c034040 tx=0x7fdf7c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:18.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.292+0000 7fdf8affd640 1 -- 172.21.15.47:0/636438711 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdf84056100 con 0x7fdf94101270 2024-02-07T12:38:18.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.512+0000 7fdf98a6e640 1 -- 172.21.15.47:0/636438711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 46, "format": "json"} v 0) v1 -- 0x7fdf94108430 con 0x7fdf94101270 2024-02-07T12:38:18.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.513+0000 7fdf8affd640 1 -- 172.21.15.47:0/636438711 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 46, "format": "json"}]=0 dumped fsmap epoch 46 v48) v1 ==== 107+0+5021 (secure 0 0 0) 0x7fdf840597c0 con 0x7fdf94101270 2024-02-07T12:38:18.515 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:18.515 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44365,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/3547121337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":3547121337},{"type":"v1","addr":"172.21.15.138:6826","nonce":3547121337}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":44369,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2689114398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2689114398},{"type":"v1","addr":"172.21.15.138:6827","nonce":2689114398}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:56.629704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34428,"mds_1":34460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":36,"state":"up:active","state_seq":9,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34460":{"gid":34460,"name":"cephfs.smithi047.jsgfge","rank":1,"incarnation":46,"state":"up:starting","state_seq":1,"addr":"172.21.15.47:6829/3723006072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3723006072},{"type":"v1","addr":"172.21.15.47:6829","nonce":3723006072}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:18.515 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 46 2024-02-07T12:38:18.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.515+0000 7fdf98a6e640 1 -- 172.21.15.47:0/636438711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fdf8006d760 msgr2=0x7fdf8006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:18.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.515+0000 7fdf98a6e640 1 --2- 172.21.15.47:0/636438711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fdf8006d760 0x7fdf8006fc10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c034040 tx=0x7fdf7c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.515+0000 7fdf98a6e640 1 -- 172.21.15.47:0/636438711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf94101270 msgr2=0x7fdf94111b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:18.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.515+0000 7fdf98a6e640 1 --2- 172.21.15.47:0/636438711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf94101270 0x7fdf94111b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400b790 tx=0x7fdf840091d0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.515+0000 7fdf98a6e640 1 -- 172.21.15.47:0/636438711 shutdown_connections 2024-02-07T12:38:18.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.515+0000 7fdf98a6e640 1 --2- 172.21.15.47:0/636438711 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fdf8006d760 0x7fdf8006fc10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.515+0000 7fdf98a6e640 1 --2- 172.21.15.47:0/636438711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf94101c10 0x7fdf941120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.515+0000 7fdf98a6e640 1 --2- 172.21.15.47:0/636438711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf94101270 0x7fdf94111b60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.515+0000 7fdf98a6e640 1 -- 172.21.15.47:0/636438711 >> 172.21.15.47:0/636438711 conn(0x7fdf940f6de0 msgr2=0x7fdf940f88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:18.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.515+0000 7fdf98a6e640 1 -- 172.21.15.47:0/636438711 shutdown_connections 2024-02-07T12:38:18.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.515+0000 7fdf98a6e640 1 -- 172.21.15.47:0/636438711 wait complete. 2024-02-07T12:38:18.527 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:18 smithi047 ceph-mon[93224]: pgmap v334: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:38:18.527 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:18 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3713324416' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-02-07T12:38:18.527 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:18 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3467903644' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 44, "format": "json"}]: dispatch 2024-02-07T12:38:18.527 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:18 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/4134803842' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 45, "format": "json"}]: dispatch 2024-02-07T12:38:18.528 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 46 2024-02-07T12:38:18.528 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 47 2024-02-07T12:38:18.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.625+0000 7feeabd9d640 1 -- 172.21.15.47:0/3991270842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feea40fdad0 msgr2=0x7feea40fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:18.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.625+0000 7feeabd9d640 1 --2- 172.21.15.47:0/3991270842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feea40fdad0 0x7feea40fbb80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fee940048d0 tx=0x7fee94009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.625+0000 7feeabd9d640 1 -- 172.21.15.47:0/3991270842 shutdown_connections 2024-02-07T12:38:18.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.625+0000 7feeabd9d640 1 --2- 172.21.15.47:0/3991270842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feea40fdad0 0x7feea40fbb80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.625+0000 7feeabd9d640 1 --2- 172.21.15.47:0/3991270842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feea40fd1c0 0x7feea40fd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.625+0000 7feeabd9d640 1 -- 172.21.15.47:0/3991270842 >> 172.21.15.47:0/3991270842 conn(0x7feea4071950 msgr2=0x7feea4071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.625+0000 7feeabd9d640 1 -- 172.21.15.47:0/3991270842 shutdown_connections 2024-02-07T12:38:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.625+0000 7feeabd9d640 1 -- 172.21.15.47:0/3991270842 wait complete. 2024-02-07T12:38:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.626+0000 7feeabd9d640 1 Processor -- start 2024-02-07T12:38:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.626+0000 7feeabd9d640 1 -- start start 2024-02-07T12:38:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.626+0000 7feeabd9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feea40fd1c0 0x7feea410dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.626+0000 7feeabd9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feea40fdad0 0x7feea410e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.626+0000 7feeabd9d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea410e7b0 con 0x7feea40fd1c0 2024-02-07T12:38:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.626+0000 7feeabd9d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea410e920 con 0x7feea40fdad0 2024-02-07T12:38:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.626+0000 7feea9b39640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feea40fd1c0 0x7feea410dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.626+0000 7feea9b39640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feea40fd1c0 0x7feea410dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34552/0 (socket says 172.21.15.47:34552) 2024-02-07T12:38:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.626+0000 7feea9b39640 1 -- 172.21.15.47:0/3859760898 learned_addr learned my addr 172.21.15.47:0/3859760898 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.626+0000 7feea9338640 1 --2- 172.21.15.47:0/3859760898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feea40fdad0 0x7feea410e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.626+0000 7feea9b39640 1 -- 172.21.15.47:0/3859760898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feea40fdad0 msgr2=0x7feea410e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.626+0000 7feea9b39640 1 --2- 172.21.15.47:0/3859760898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feea40fdad0 0x7feea410e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.626+0000 7feea9b39640 1 -- 172.21.15.47:0/3859760898 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94005040 con 0x7feea40fd1c0 2024-02-07T12:38:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.627+0000 7feea9b39640 1 --2- 172.21.15.47:0/3859760898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feea40fd1c0 0x7feea410dd30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feea0002840 tx=0x7feea0004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.627+0000 7fee9a7fc640 1 -- 172.21.15.47:0/3859760898 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea0007c30 con 0x7feea40fd1c0 2024-02-07T12:38:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.627+0000 7feeabd9d640 1 -- 172.21.15.47:0/3859760898 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea4116da0 con 0x7feea40fd1c0 2024-02-07T12:38:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.627+0000 7fee9a7fc640 1 -- 172.21.15.47:0/3859760898 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feea000f040 con 0x7feea40fd1c0 2024-02-07T12:38:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.627+0000 7fee9a7fc640 1 -- 172.21.15.47:0/3859760898 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea0009570 con 0x7feea40fd1c0 2024-02-07T12:38:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.627+0000 7feeabd9d640 1 -- 172.21.15.47:0/3859760898 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea4117120 con 0x7feea40fd1c0 2024-02-07T12:38:18.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.628+0000 7feeabd9d640 1 -- 172.21.15.47:0/3859760898 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea4064480 con 0x7feea40fd1c0 2024-02-07T12:38:18.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.628+0000 7fee9a7fc640 1 -- 172.21.15.47:0/3859760898 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7feea000dc80 con 0x7feea40fd1c0 2024-02-07T12:38:18.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.629+0000 7fee9a7fc640 1 --2- 172.21.15.47:0/3859760898 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fee9006d750 0x7fee9006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:18.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.629+0000 7fee9a7fc640 1 -- 172.21.15.47:0/3859760898 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7feea008ce70 con 0x7feea40fd1c0 2024-02-07T12:38:18.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.629+0000 7feea9338640 1 --2- 172.21.15.47:0/3859760898 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fee9006d750 0x7fee9006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.629+0000 7feea9338640 1 --2- 172.21.15.47:0/3859760898 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fee9006d750 0x7fee9006fc00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee940043d0 tx=0x7fee94009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.633+0000 7fee9a7fc640 1 -- 172.21.15.47:0/3859760898 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feea0056610 con 0x7feea40fd1c0 2024-02-07T12:38:18.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:18 smithi138 ceph-mon[82055]: pgmap v334: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-07T12:38:18.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:18 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3713324416' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-02-07T12:38:18.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:18 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3467903644' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 44, "format": "json"}]: dispatch 2024-02-07T12:38:18.785 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:18 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/4134803842' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 45, "format": "json"}]: dispatch 2024-02-07T12:38:18.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.850+0000 7feeabd9d640 1 -- 172.21.15.47:0/3859760898 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 47, "format": "json"} v 0) v1 -- 0x7feea4117310 con 0x7feea40fd1c0 2024-02-07T12:38:18.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.851+0000 7fee9a7fc640 1 -- 172.21.15.47:0/3859760898 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 47, "format": "json"}]=0 dumped fsmap epoch 47 v48) v1 ==== 107+0+5019 (secure 0 0 0) 0x7feea0059cd0 con 0x7feea40fd1c0 2024-02-07T12:38:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:18.854 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44365,"name":"cephfs.smithi138.jhsygn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6826/3547121337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":3547121337},{"type":"v1","addr":"172.21.15.138:6826","nonce":3547121337}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":44369,"name":"cephfs.smithi138.axpdsx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2689114398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2689114398},{"type":"v1","addr":"172.21.15.138:6827","nonce":2689114398}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-07T12:22:54.002022+0000","modified":"2024-02-07T12:34:56.639986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34428,"mds_1":34460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi047.lagmef","rank":0,"incarnation":36,"state":"up:active","state_seq":9,"addr":"172.21.15.47:6827/2142859688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2142859688},{"type":"v1","addr":"172.21.15.47:6827","nonce":2142859688}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34460":{"gid":34460,"name":"cephfs.smithi047.jsgfge","rank":1,"incarnation":46,"state":"up:active","state_seq":12,"addr":"172.21.15.47:6829/3723006072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3723006072},{"type":"v1","addr":"172.21.15.47:6829","nonce":3723006072}]},"join_fscid":1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-07T12:38:18.855 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 47 2024-02-07T12:38:18.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.853+0000 7feeabd9d640 1 -- 172.21.15.47:0/3859760898 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fee9006d750 msgr2=0x7fee9006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:18.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.853+0000 7feeabd9d640 1 --2- 172.21.15.47:0/3859760898 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fee9006d750 0x7fee9006fc00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee940043d0 tx=0x7fee94009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.853+0000 7feeabd9d640 1 -- 172.21.15.47:0/3859760898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feea40fd1c0 msgr2=0x7feea410dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:18.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.853+0000 7feeabd9d640 1 --2- 172.21.15.47:0/3859760898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feea40fd1c0 0x7feea410dd30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feea0002840 tx=0x7feea0004570 comp rx=0 tx=0).stop 2024-02-07T12:38:18.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.853+0000 7feeabd9d640 1 -- 172.21.15.47:0/3859760898 shutdown_connections 2024-02-07T12:38:18.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.853+0000 7feeabd9d640 1 --2- 172.21.15.47:0/3859760898 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fee9006d750 0x7fee9006fc00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.853+0000 7feeabd9d640 1 --2- 172.21.15.47:0/3859760898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feea40fdad0 0x7feea410e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.853+0000 7feeabd9d640 1 --2- 172.21.15.47:0/3859760898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feea40fd1c0 0x7feea410dd30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:18.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.853+0000 7feeabd9d640 1 -- 172.21.15.47:0/3859760898 >> 172.21.15.47:0/3859760898 conn(0x7feea4071950 msgr2=0x7feea40f8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:18.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.853+0000 7feeabd9d640 1 -- 172.21.15.47:0/3859760898 shutdown_connections 2024-02-07T12:38:18.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:18.853+0000 7feeabd9d640 1 -- 172.21.15.47:0/3859760898 wait complete. 2024-02-07T12:38:18.866 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-07T12:38:18.879 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-07T12:38:18.879 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:38:18.879 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-07T12:38:18.896 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-02-07T12:38:18.896 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-07T12:38:18.952 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-07T12:38:19.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.087+0000 7ff14e99d640 1 -- 172.21.15.47:0/1955473656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff148102c30 msgr2=0x7ff148064480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:19.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.087+0000 7ff14e99d640 1 --2- 172.21.15.47:0/1955473656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff148102c30 0x7ff148064480 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0048d0 tx=0x7ff13c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.087+0000 7ff14e99d640 1 -- 172.21.15.47:0/1955473656 shutdown_connections 2024-02-07T12:38:19.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.087+0000 7ff14e99d640 1 --2- 172.21.15.47:0/1955473656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff148102c30 0x7ff148064480 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.087+0000 7ff14e99d640 1 --2- 172.21.15.47:0/1955473656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff148102290 0x7ff148102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.087+0000 7ff14e99d640 1 -- 172.21.15.47:0/1955473656 >> 172.21.15.47:0/1955473656 conn(0x7ff148071290 msgr2=0x7ff148071690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:19.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.087+0000 7ff14e99d640 1 -- 172.21.15.47:0/1955473656 shutdown_connections 2024-02-07T12:38:19.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.087+0000 7ff14e99d640 1 -- 172.21.15.47:0/1955473656 wait complete. 2024-02-07T12:38:19.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.088+0000 7ff14e99d640 1 Processor -- start 2024-02-07T12:38:19.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.088+0000 7ff14e99d640 1 -- start start 2024-02-07T12:38:19.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.088+0000 7ff14e99d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff148102290 0x7ff148112ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:19.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.088+0000 7ff14e99d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff148102c30 0x7ff1481130e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.088+0000 7ff14e99d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1481136e0 con 0x7ff148102290 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.088+0000 7ff14e99d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14810cc70 con 0x7ff148102c30 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.088+0000 7ff147fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff148102290 0x7ff148112ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.088+0000 7ff147fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff148102290 0x7ff148112ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34564/0 (socket says 172.21.15.47:34564) 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.088+0000 7ff147fff640 1 -- 172.21.15.47:0/2951864292 learned_addr learned my addr 172.21.15.47:0/2951864292 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.088+0000 7ff1477fe640 1 --2- 172.21.15.47:0/2951864292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff148102c30 0x7ff1481130e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.089+0000 7ff147fff640 1 -- 172.21.15.47:0/2951864292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff148102c30 msgr2=0x7ff1481130e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.089+0000 7ff147fff640 1 --2- 172.21.15.47:0/2951864292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff148102c30 0x7ff1481130e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.089+0000 7ff147fff640 1 -- 172.21.15.47:0/2951864292 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c005040 con 0x7ff148102290 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.089+0000 7ff147fff640 1 --2- 172.21.15.47:0/2951864292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff148102290 0x7ff148112ba0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff138002a50 tx=0x7ff138004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.089+0000 7ff144ff9640 1 -- 172.21.15.47:0/2951864292 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff138007c30 con 0x7ff148102290 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.089+0000 7ff144ff9640 1 -- 172.21.15.47:0/2951864292 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff13800f040 con 0x7ff148102290 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.089+0000 7ff14e99d640 1 -- 172.21.15.47:0/2951864292 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14810cf50 con 0x7ff148102290 2024-02-07T12:38:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.089+0000 7ff144ff9640 1 -- 172.21.15.47:0/2951864292 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13800dbe0 con 0x7ff148102290 2024-02-07T12:38:19.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.089+0000 7ff14e99d640 1 -- 172.21.15.47:0/2951864292 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14810d440 con 0x7ff148102290 2024-02-07T12:38:19.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.090+0000 7ff14e99d640 1 -- 172.21.15.47:0/2951864292 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff148064030 con 0x7ff148102290 2024-02-07T12:38:19.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.090+0000 7ff144ff9640 1 -- 172.21.15.47:0/2951864292 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff13800dd40 con 0x7ff148102290 2024-02-07T12:38:19.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.091+0000 7ff144ff9640 1 --2- 172.21.15.47:0/2951864292 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff13006d750 0x7ff13006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:19.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.091+0000 7ff1477fe640 1 --2- 172.21.15.47:0/2951864292 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff13006d750 0x7ff13006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:19.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.091+0000 7ff144ff9640 1 -- 172.21.15.47:0/2951864292 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff13808cea0 con 0x7ff148102290 2024-02-07T12:38:19.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.091+0000 7ff1477fe640 1 --2- 172.21.15.47:0/2951864292 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff13006d750 0x7ff13006fc00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff13c02bda0 tx=0x7ff13c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:19.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.096+0000 7ff144ff9640 1 -- 172.21.15.47:0/2951864292 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff138056640 con 0x7ff148102290 2024-02-07T12:38:19.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.277+0000 7ff14e99d640 1 -- 172.21.15.47:0/2951864292 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1481093f0 con 0x7ff148102290 2024-02-07T12:38:19.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.278+0000 7ff144ff9640 1 -- 172.21.15.47:0/2951864292 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16793 (secure 0 0 0) 0x7ff138059d00 con 0x7ff148102290 2024-02-07T12:38:19.284 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:19.284 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":86,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","created":"2024-02-07T12:16:03.682077+0000","modified":"2024-02-07T12:34:43.948607+0000","last_up_change":"2024-02-07T12:32:47.656919+0000","last_in_change":"2024-02-07T12:21:14.657544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-07T12:20:21.191001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-07T12:22:52.656534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-07T12:22:53.237906+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b37bbc00-7240-422a-977b-c7a9687ce87f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1557469797},{"type":"v1","addr":"172.21.15.47:6803","nonce":1557469797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1557469797},{"type":"v1","addr":"172.21.15.47:6805","nonce":1557469797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1557469797},{"type":"v1","addr":"172.21.15.47:6809","nonce":1557469797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1557469797},{"type":"v1","addr":"172.21.15.47:6807","nonce":1557469797}]},"public_addr":"172.21.15.47:6803/1557469797","cluster_addr":"172.21.15.47:6805/1557469797","heartbeat_back_addr":"172.21.15.47:6809/1557469797","heartbeat_front_addr":"172.21.15.47:6807/1557469797","state":["exists","up"]},{"osd":1,"uuid":"e6a42328-96ea-40de-987d-4edec38a4b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3632128293},{"type":"v1","addr":"172.21.15.47:6811","nonce":3632128293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3632128293},{"type":"v1","addr":"172.21.15.47:6813","nonce":3632128293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3632128293},{"type":"v1","addr":"172.21.15.47:6817","nonce":3632128293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3632128293},{"type":"v1","addr":"172.21.15.47:6815","nonce":3632128293}]},"public_addr":"172.21.15.47:6811/3632128293","cluster_addr":"172.21.15.47:6813/3632128293","heartbeat_back_addr":"172.21.15.47:6817/3632128293","heartbeat_front_addr":"172.21.15.47:6815/3632128293","state":["exists","up"]},{"osd":2,"uuid":"c8925cb3-0da0-4f01-90c3-1b6fb6e15331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4120407081},{"type":"v1","addr":"172.21.15.47:6819","nonce":4120407081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4120407081},{"type":"v1","addr":"172.21.15.47:6821","nonce":4120407081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4120407081},{"type":"v1","addr":"172.21.15.47:6825","nonce":4120407081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4120407081},{"type":"v1","addr":"172.21.15.47:6823","nonce":4120407081}]},"public_addr":"172.21.15.47:6819/4120407081","cluster_addr":"172.21.15.47:6821/4120407081","heartbeat_back_addr":"172.21.15.47:6825/4120407081","heartbeat_front_addr":"172.21.15.47:6823/4120407081","state":["exists","up"]},{"osd":3,"uuid":"47130a0a-e27f-4129-abbb-4bef9b460ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1616507148},{"type":"v1","addr":"172.21.15.138:6801","nonce":1616507148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1616507148},{"type":"v1","addr":"172.21.15.138:6803","nonce":1616507148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1616507148},{"type":"v1","addr":"172.21.15.138:6807","nonce":1616507148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1616507148},{"type":"v1","addr":"172.21.15.138:6805","nonce":1616507148}]},"public_addr":"172.21.15.138:6801/1616507148","cluster_addr":"172.21.15.138:6803/1616507148","heartbeat_back_addr":"172.21.15.138:6807/1616507148","heartbeat_front_addr":"172.21.15.138:6805/1616507148","state":["exists","up"]},{"osd":4,"uuid":"103459b7-4883-4248-a64d-21c396324237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3739765492},{"type":"v1","addr":"172.21.15.138:6809","nonce":3739765492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3739765492},{"type":"v1","addr":"172.21.15.138:6811","nonce":3739765492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3739765492},{"type":"v1","addr":"172.21.15.138:6815","nonce":3739765492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3739765492},{"type":"v1","addr":"172.21.15.138:6813","nonce":3739765492}]},"public_addr":"172.21.15.138:6809/3739765492","cluster_addr":"172.21.15.138:6811/3739765492","heartbeat_back_addr":"172.21.15.138:6815/3739765492","heartbeat_front_addr":"172.21.15.138:6813/3739765492","state":["exists","up"]},{"osd":5,"uuid":"e8acb2ff-d0f5-4daf-82ee-6c4fddf1580d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2664957218},{"type":"v1","addr":"172.21.15.138:6817","nonce":2664957218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2664957218},{"type":"v1","addr":"172.21.15.138:6819","nonce":2664957218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2664957218},{"type":"v1","addr":"172.21.15.138:6823","nonce":2664957218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2664957218},{"type":"v1","addr":"172.21.15.138:6821","nonce":2664957218}]},"public_addr":"172.21.15.138:6817/2664957218","cluster_addr":"172.21.15.138:6819/2664957218","heartbeat_back_addr":"172.21.15.138:6823/2664957218","heartbeat_front_addr":"172.21.15.138:6821/2664957218","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:19.518708+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:48.503474+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:17.112205+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:41.349671+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:06.347737+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:31.635560+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6829/3387805936":"2024-02-08T12:34:03.468583+0000","172.21.15.47:6828/3387805936":"2024-02-08T12:34:03.468583+0000","172.21.15.47:6826/3633114050":"2024-02-08T12:33:37.430656+0000","172.21.15.138:6828/764872550":"2024-02-08T12:27:38.822990+0000","172.21.15.138:0/2878954883":"2024-02-08T12:27:38.822990+0000","172.21.15.47:6801/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.138:6829/764872550":"2024-02-08T12:27:38.822990+0000","172.21.15.47:6827/3633114050":"2024-02-08T12:33:37.430656+0000","172.21.15.47:6800/3304641630":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/926338889":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/1918664197":"2024-02-08T12:17:02.806879+0000","172.21.15.138:6825/2917636817":"2024-02-08T12:23:08.319154+0000","172.21.15.47:0/179765176":"2024-02-08T12:25:32.261341+0000","172.21.15.47:6801/1750591204":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/454079597":"2024-02-08T12:18:06.849658+0000","172.21.15.47:6801/3304641630":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/3361862950":"2024-02-08T12:17:02.806879+0000","172.21.15.47:0/15111993":"2024-02-08T12:28:26.591613+0000","172.21.15.47:6800/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.138:0/476867914":"2024-02-08T12:27:38.822990+0000","172.21.15.138:0/2680943285":"2024-02-08T12:27:38.822990+0000","172.21.15.47:6801/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/2651788466":"2024-02-08T12:25:32.261341+0000","172.21.15.47:0/3354208208":"2024-02-08T12:16:30.972957+0000","172.21.15.138:0/722341446":"2024-02-08T12:27:38.822990+0000","172.21.15.47:0/3586302931":"2024-02-08T12:17:02.806879+0000","172.21.15.138:6824/2917636817":"2024-02-08T12:23:08.319154+0000","172.21.15.47:0/3413297119":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/2768201708":"2024-02-08T12:16:30.972957+0000","172.21.15.47:6801/3356603129":"2024-02-08T12:25:32.261341+0000","172.21.15.47:6800/3356603129":"2024-02-08T12:25:32.261341+0000","172.21.15.47:0/1415322117":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/2757370866":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/3785090733":"2024-02-08T12:25:32.261341+0000","172.21.15.47:0/1926405874":"2024-02-08T12:25:32.261341+0000","172.21.15.47:0/2678703901":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/831612230":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/2545215659":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/520417272":"2024-02-08T12:28:26.591613+0000","172.21.15.47:6800/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6800/1750591204":"2024-02-08T12:28:26.591613+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-07T12:38:19.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.280+0000 7ff14e99d640 1 -- 172.21.15.47:0/2951864292 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff13006d750 msgr2=0x7ff13006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:19.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.280+0000 7ff14e99d640 1 --2- 172.21.15.47:0/2951864292 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff13006d750 0x7ff13006fc00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff13c02bda0 tx=0x7ff13c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.280+0000 7ff14e99d640 1 -- 172.21.15.47:0/2951864292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff148102290 msgr2=0x7ff148112ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:19.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.280+0000 7ff14e99d640 1 --2- 172.21.15.47:0/2951864292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff148102290 0x7ff148112ba0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff138002a50 tx=0x7ff138004600 comp rx=0 tx=0).stop 2024-02-07T12:38:19.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.280+0000 7ff14e99d640 1 -- 172.21.15.47:0/2951864292 shutdown_connections 2024-02-07T12:38:19.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.280+0000 7ff14e99d640 1 --2- 172.21.15.47:0/2951864292 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7ff13006d750 0x7ff13006fc00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.280+0000 7ff14e99d640 1 --2- 172.21.15.47:0/2951864292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff148102c30 0x7ff1481130e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.280+0000 7ff14e99d640 1 --2- 172.21.15.47:0/2951864292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff148102290 0x7ff148112ba0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.280+0000 7ff14e99d640 1 -- 172.21.15.47:0/2951864292 >> 172.21.15.47:0/2951864292 conn(0x7ff148071290 msgr2=0x7ff1480fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:19.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.281+0000 7ff14e99d640 1 -- 172.21.15.47:0/2951864292 shutdown_connections 2024-02-07T12:38:19.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.281+0000 7ff14e99d640 1 -- 172.21.15.47:0/2951864292 wait complete. 2024-02-07T12:38:19.293 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-07T12:20:21.191001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-07T12:22:52.656534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-07T12:22:53.237906+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-07T12:38:19.294 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-07T12:38:19.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.395+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3917209839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1081012d0 msgr2=0x7fc1081016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:19.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.395+0000 7fc10ea6e640 1 --2- 172.21.15.47:0/3917209839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1081012d0 0x7fc1081016a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc1040048d0 tx=0x7fc104009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.395+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3917209839 shutdown_connections 2024-02-07T12:38:19.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.395+0000 7fc10ea6e640 1 --2- 172.21.15.47:0/3917209839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1080fb2b0 0x7fc1080fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.395+0000 7fc10ea6e640 1 --2- 172.21.15.47:0/3917209839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1081012d0 0x7fc1081016a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.395+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3917209839 >> 172.21.15.47:0/3917209839 conn(0x7fc108071230 msgr2=0x7fc108071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:19.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.396+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3917209839 shutdown_connections 2024-02-07T12:38:19.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.396+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3917209839 wait complete. 2024-02-07T12:38:19.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.396+0000 7fc10ea6e640 1 Processor -- start 2024-02-07T12:38:19.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.396+0000 7fc10ea6e640 1 -- start start 2024-02-07T12:38:19.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.396+0000 7fc10ea6e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1080fb2b0 0x7fc108112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.396+0000 7fc10ea6e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1081012d0 0x7fc1081130f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.396+0000 7fc10ea6e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1081136f0 con 0x7fc1080fb2b0 2024-02-07T12:38:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.396+0000 7fc10ea6e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10810cc80 con 0x7fc1081012d0 2024-02-07T12:38:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc10c80a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1080fb2b0 0x7fc108112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc10c80a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1080fb2b0 0x7fc108112bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34582/0 (socket says 172.21.15.47:34582) 2024-02-07T12:38:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc10c80a640 1 -- 172.21.15.47:0/3131689700 learned_addr learned my addr 172.21.15.47:0/3131689700 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc0fffff640 1 --2- 172.21.15.47:0/3131689700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1081012d0 0x7fc1081130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc10c80a640 1 -- 172.21.15.47:0/3131689700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1081012d0 msgr2=0x7fc1081130f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc10c80a640 1 --2- 172.21.15.47:0/3131689700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1081012d0 0x7fc1081130f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc10c80a640 1 -- 172.21.15.47:0/3131689700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc104005040 con 0x7fc1080fb2b0 2024-02-07T12:38:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc0fffff640 1 --2- 172.21.15.47:0/3131689700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1081012d0 0x7fc1081130f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:38:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc10c80a640 1 --2- 172.21.15.47:0/3131689700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1080fb2b0 0x7fc108112bb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc10402bda0 tx=0x7fc104009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc0fd7fa640 1 -- 172.21.15.47:0/3131689700 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1040092b0 con 0x7fc1080fb2b0 2024-02-07T12:38:19.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc0fd7fa640 1 -- 172.21.15.47:0/3131689700 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc10403b400 con 0x7fc1080fb2b0 2024-02-07T12:38:19.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3131689700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10810cf00 con 0x7fc1080fb2b0 2024-02-07T12:38:19.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc0fd7fa640 1 -- 172.21.15.47:0/3131689700 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1040435d0 con 0x7fc1080fb2b0 2024-02-07T12:38:19.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.397+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3131689700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10810d3c0 con 0x7fc1080fb2b0 2024-02-07T12:38:19.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.398+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3131689700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc108064030 con 0x7fc1080fb2b0 2024-02-07T12:38:19.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.399+0000 7fc0fd7fa640 1 -- 172.21.15.47:0/3131689700 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc10402f070 con 0x7fc1080fb2b0 2024-02-07T12:38:19.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.399+0000 7fc0fd7fa640 1 --2- 172.21.15.47:0/3131689700 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc0f006d760 0x7fc0f006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:19.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.399+0000 7fc0fd7fa640 1 -- 172.21.15.47:0/3131689700 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc1040aee00 con 0x7fc1080fb2b0 2024-02-07T12:38:19.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.399+0000 7fc0fffff640 1 --2- 172.21.15.47:0/3131689700 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc0f006d760 0x7fc0f006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:19.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.399+0000 7fc0fffff640 1 --2- 172.21.15.47:0/3131689700 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc0f006d760 0x7fc0f006fc10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc10810e470 tx=0x7fc0f800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:19.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.404+0000 7fc0fd7fa640 1 -- 172.21.15.47:0/3131689700 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc1040785a0 con 0x7fc1080fb2b0 2024-02-07T12:38:19.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:19 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/636438711' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 46, "format": "json"}]: dispatch 2024-02-07T12:38:19.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:19 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3859760898' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 47, "format": "json"}]: dispatch 2024-02-07T12:38:19.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:19 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/2951864292' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:38:19.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.584+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3131689700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc10810d5e0 con 0x7fc1080fb2b0 2024-02-07T12:38:19.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.584+0000 7fc0fd7fa640 1 -- 172.21.15.47:0/3131689700 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc10407bc60 con 0x7fc1080fb2b0 2024-02-07T12:38:19.587 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-02-07T12:38:19.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.586+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3131689700 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc0f006d760 msgr2=0x7fc0f006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:19.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.586+0000 7fc10ea6e640 1 --2- 172.21.15.47:0/3131689700 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc0f006d760 0x7fc0f006fc10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc10810e470 tx=0x7fc0f800b040 comp rx=0 tx=0).stop 2024-02-07T12:38:19.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.586+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3131689700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1080fb2b0 msgr2=0x7fc108112bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:19.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.586+0000 7fc10ea6e640 1 --2- 172.21.15.47:0/3131689700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1080fb2b0 0x7fc108112bb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc10402bda0 tx=0x7fc104009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.587+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3131689700 shutdown_connections 2024-02-07T12:38:19.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.587+0000 7fc10ea6e640 1 --2- 172.21.15.47:0/3131689700 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc0f006d760 0x7fc0f006fc10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.587+0000 7fc10ea6e640 1 --2- 172.21.15.47:0/3131689700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1081012d0 0x7fc1081130f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.587+0000 7fc10ea6e640 1 --2- 172.21.15.47:0/3131689700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1080fb2b0 0x7fc108112bb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.587+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3131689700 >> 172.21.15.47:0/3131689700 conn(0x7fc108071230 msgr2=0x7fc1080644a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:19.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.587+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3131689700 shutdown_connections 2024-02-07T12:38:19.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.587+0000 7fc10ea6e640 1 -- 172.21.15.47:0/3131689700 wait complete. 2024-02-07T12:38:19.599 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-07T12:38:19.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.699+0000 7f240ef9d640 1 -- 172.21.15.47:0/3621026340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24080fb2b0 msgr2=0x7f24080fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:19.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.699+0000 7f240ef9d640 1 --2- 172.21.15.47:0/3621026340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24080fb2b0 0x7f24080fb700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f23f40048d0 tx=0x7f23f4009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.699+0000 7f240ef9d640 1 -- 172.21.15.47:0/3621026340 shutdown_connections 2024-02-07T12:38:19.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.699+0000 7f240ef9d640 1 --2- 172.21.15.47:0/3621026340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24080fb2b0 0x7f24080fb700 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.699+0000 7f240ef9d640 1 --2- 172.21.15.47:0/3621026340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24081012d0 0x7f24081016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.699+0000 7f240ef9d640 1 -- 172.21.15.47:0/3621026340 >> 172.21.15.47:0/3621026340 conn(0x7f2408071230 msgr2=0x7f2408071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:19.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.699+0000 7f240ef9d640 1 -- 172.21.15.47:0/3621026340 shutdown_connections 2024-02-07T12:38:19.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.699+0000 7f240ef9d640 1 -- 172.21.15.47:0/3621026340 wait complete. 2024-02-07T12:38:19.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.700+0000 7f240ef9d640 1 Processor -- start 2024-02-07T12:38:19.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.700+0000 7f240ef9d640 1 -- start start 2024-02-07T12:38:19.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.700+0000 7f240ef9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24080fb2b0 0x7f240810dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.700+0000 7f240ef9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24081012d0 0x7f240810e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.700+0000 7f240ef9d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240810e7e0 con 0x7f24080fb2b0 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.700+0000 7f240ef9d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240810e950 con 0x7f24081012d0 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.700+0000 7f240cd39640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24080fb2b0 0x7f240810dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.700+0000 7f240cd39640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24080fb2b0 0x7f240810dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51098/0 (socket says 172.21.15.47:51098) 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.700+0000 7f240cd39640 1 -- 172.21.15.47:0/3819879493 learned_addr learned my addr 172.21.15.47:0/3819879493 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.701+0000 7f2407fff640 1 --2- 172.21.15.47:0/3819879493 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24081012d0 0x7f240810e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.701+0000 7f240cd39640 1 -- 172.21.15.47:0/3819879493 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24081012d0 msgr2=0x7f240810e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.701+0000 7f240cd39640 1 --2- 172.21.15.47:0/3819879493 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24081012d0 0x7f240810e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.701+0000 7f240cd39640 1 -- 172.21.15.47:0/3819879493 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f4005040 con 0x7f24080fb2b0 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.701+0000 7f240cd39640 1 --2- 172.21.15.47:0/3819879493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24080fb2b0 0x7f240810dd60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00b790 tx=0x7f23fc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.701+0000 7f24057fa640 1 -- 172.21.15.47:0/3819879493 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23fc00c700 con 0x7f24080fb2b0 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.701+0000 7f24057fa640 1 -- 172.21.15.47:0/3819879493 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23fc00cd30 con 0x7f24080fb2b0 2024-02-07T12:38:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.701+0000 7f240ef9d640 1 -- 172.21.15.47:0/3819879493 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2408116dd0 con 0x7f24080fb2b0 2024-02-07T12:38:19.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.701+0000 7f24057fa640 1 -- 172.21.15.47:0/3819879493 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23fc013370 con 0x7f24080fb2b0 2024-02-07T12:38:19.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.701+0000 7f240ef9d640 1 -- 172.21.15.47:0/3819879493 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24081171b0 con 0x7f24080fb2b0 2024-02-07T12:38:19.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.702+0000 7f240ef9d640 1 -- 172.21.15.47:0/3819879493 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2408064030 con 0x7f24080fb2b0 2024-02-07T12:38:19.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.703+0000 7f24057fa640 1 -- 172.21.15.47:0/3819879493 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f23fc012070 con 0x7f24080fb2b0 2024-02-07T12:38:19.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.703+0000 7f24057fa640 1 --2- 172.21.15.47:0/3819879493 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f23f806d750 0x7f23f806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:19.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.703+0000 7f2407fff640 1 --2- 172.21.15.47:0/3819879493 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f23f806d750 0x7f23f806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:19.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.703+0000 7f24057fa640 1 -- 172.21.15.47:0/3819879493 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f23fc08cb00 con 0x7f24080fb2b0 2024-02-07T12:38:19.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.703+0000 7f2407fff640 1 --2- 172.21.15.47:0/3819879493 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f23f806d750 0x7f23f806fc00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2408064d30 tx=0x7f23f4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:19.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.707+0000 7f24057fa640 1 -- 172.21.15.47:0/3819879493 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f23fc0562a0 con 0x7f24080fb2b0 2024-02-07T12:38:19.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:19 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/636438711' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 46, "format": "json"}]: dispatch 2024-02-07T12:38:19.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:19 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3859760898' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 47, "format": "json"}]: dispatch 2024-02-07T12:38:19.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:19 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/2951864292' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:38:19.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.886+0000 7f240ef9d640 1 -- 172.21.15.47:0/3819879493 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f2408064ba0 con 0x7f24080fb2b0 2024-02-07T12:38:19.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.887+0000 7f24057fa640 1 -- 172.21.15.47:0/3819879493 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v86) v1 ==== 107+0+11 (secure 0 0 0) 0x7f23fc059960 con 0x7f24080fb2b0 2024-02-07T12:38:19.889 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-02-07T12:38:19.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.889+0000 7f240ef9d640 1 -- 172.21.15.47:0/3819879493 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f23f806d750 msgr2=0x7f23f806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:19.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.889+0000 7f240ef9d640 1 --2- 172.21.15.47:0/3819879493 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f23f806d750 0x7f23f806fc00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2408064d30 tx=0x7f23f4009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.889+0000 7f240ef9d640 1 -- 172.21.15.47:0/3819879493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24080fb2b0 msgr2=0x7f240810dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:19.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.889+0000 7f240ef9d640 1 --2- 172.21.15.47:0/3819879493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24080fb2b0 0x7f240810dd60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00b790 tx=0x7f23fc0091d0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.889+0000 7f240ef9d640 1 -- 172.21.15.47:0/3819879493 shutdown_connections 2024-02-07T12:38:19.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.889+0000 7f240ef9d640 1 --2- 172.21.15.47:0/3819879493 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f23f806d750 0x7f23f806fc00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.889+0000 7f240ef9d640 1 --2- 172.21.15.47:0/3819879493 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24081012d0 0x7f240810e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.889+0000 7f240ef9d640 1 --2- 172.21.15.47:0/3819879493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24080fb2b0 0x7f240810dd60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:19.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.889+0000 7f240ef9d640 1 -- 172.21.15.47:0/3819879493 >> 172.21.15.47:0/3819879493 conn(0x7f2408071230 msgr2=0x7f24080fa070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:19.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.889+0000 7f240ef9d640 1 -- 172.21.15.47:0/3819879493 shutdown_connections 2024-02-07T12:38:19.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:19.889+0000 7f240ef9d640 1 -- 172.21.15.47:0/3819879493 wait complete. 2024-02-07T12:38:19.902 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-07T12:38:20.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.001+0000 7fad52d1d640 1 -- 172.21.15.47:0/38643389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad4c101270 msgr2=0x7fad4c101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:20.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.001+0000 7fad52d1d640 1 --2- 172.21.15.47:0/38643389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad4c101270 0x7fad4c101640 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0048d0 tx=0x7fad3c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.001+0000 7fad52d1d640 1 -- 172.21.15.47:0/38643389 shutdown_connections 2024-02-07T12:38:20.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.001+0000 7fad52d1d640 1 --2- 172.21.15.47:0/38643389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad4c101c10 0x7fad4c0fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.001+0000 7fad52d1d640 1 --2- 172.21.15.47:0/38643389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad4c101270 0x7fad4c101640 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.001+0000 7fad52d1d640 1 -- 172.21.15.47:0/38643389 >> 172.21.15.47:0/38643389 conn(0x7fad4c0f6e40 msgr2=0x7fad4c0f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.001+0000 7fad52d1d640 1 -- 172.21.15.47:0/38643389 shutdown_connections 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.001+0000 7fad52d1d640 1 -- 172.21.15.47:0/38643389 wait complete. 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.002+0000 7fad52d1d640 1 Processor -- start 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.002+0000 7fad52d1d640 1 -- start start 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.002+0000 7fad52d1d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad4c101270 0x7fad4c111b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.002+0000 7fad52d1d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad4c101c10 0x7fad4c112080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.002+0000 7fad52d1d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c112680 con 0x7fad4c101270 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.002+0000 7fad52d1d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c10bc10 con 0x7fad4c101c10 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.002+0000 7fad50ab9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad4c101270 0x7fad4c111b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.002+0000 7fad50ab9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad4c101270 0x7fad4c111b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51118/0 (socket says 172.21.15.47:51118) 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.002+0000 7fad50ab9640 1 -- 172.21.15.47:0/1852035146 learned_addr learned my addr 172.21.15.47:0/1852035146 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.002+0000 7fad4bfff640 1 --2- 172.21.15.47:0/1852035146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad4c101c10 0x7fad4c112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.002+0000 7fad50ab9640 1 -- 172.21.15.47:0/1852035146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad4c101c10 msgr2=0x7fad4c112080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.002+0000 7fad50ab9640 1 --2- 172.21.15.47:0/1852035146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad4c101c10 0x7fad4c112080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.003+0000 7fad50ab9640 1 -- 172.21.15.47:0/1852035146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c005040 con 0x7fad4c101270 2024-02-07T12:38:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.003+0000 7fad4bfff640 1 --2- 172.21.15.47:0/1852035146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad4c101c10 0x7fad4c112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:38:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.003+0000 7fad50ab9640 1 --2- 172.21.15.47:0/1852035146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad4c101270 0x7fad4c111b40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fad3c031720 tx=0x7fad3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.003+0000 7fad497fa640 1 -- 172.21.15.47:0/1852035146 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad3c0094c0 con 0x7fad4c101270 2024-02-07T12:38:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.003+0000 7fad497fa640 1 -- 172.21.15.47:0/1852035146 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad3c009620 con 0x7fad4c101270 2024-02-07T12:38:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.003+0000 7fad52d1d640 1 -- 172.21.15.47:0/1852035146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4c10be90 con 0x7fad4c101270 2024-02-07T12:38:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.003+0000 7fad497fa640 1 -- 172.21.15.47:0/1852035146 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad3c03b640 con 0x7fad4c101270 2024-02-07T12:38:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.003+0000 7fad52d1d640 1 -- 172.21.15.47:0/1852035146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4c10c3b0 con 0x7fad4c101270 2024-02-07T12:38:20.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.004+0000 7fad52d1d640 1 -- 172.21.15.47:0/1852035146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4c064480 con 0x7fad4c101270 2024-02-07T12:38:20.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.004+0000 7fad497fa640 1 -- 172.21.15.47:0/1852035146 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fad3c02f070 con 0x7fad4c101270 2024-02-07T12:38:20.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.005+0000 7fad497fa640 1 --2- 172.21.15.47:0/1852035146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fad3406d750 0x7fad3406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:20.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.005+0000 7fad497fa640 1 -- 172.21.15.47:0/1852035146 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fad3c0af520 con 0x7fad4c101270 2024-02-07T12:38:20.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.005+0000 7fad4bfff640 1 --2- 172.21.15.47:0/1852035146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fad3406d750 0x7fad3406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:20.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.005+0000 7fad4bfff640 1 --2- 172.21.15.47:0/1852035146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fad3406d750 0x7fad3406fc00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad4c10d400 tx=0x7fad40009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:20.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.009+0000 7fad497fa640 1 -- 172.21.15.47:0/1852035146 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fad3c078cc0 con 0x7fad4c101270 2024-02-07T12:38:20.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.188+0000 7fad52d1d640 1 -- 172.21.15.47:0/1852035146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fad4c0fe5e0 con 0x7fad4c101270 2024-02-07T12:38:20.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.189+0000 7fad497fa640 1 -- 172.21.15.47:0/1852035146 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v86) v1 ==== 107+0+11 (secure 0 0 0) 0x7fad4c0fe5e0 con 0x7fad4c101270 2024-02-07T12:38:20.191 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-02-07T12:38:20.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.191+0000 7fad52d1d640 1 -- 172.21.15.47:0/1852035146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fad3406d750 msgr2=0x7fad3406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:20.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.191+0000 7fad52d1d640 1 --2- 172.21.15.47:0/1852035146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fad3406d750 0x7fad3406fc00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad4c10d400 tx=0x7fad40009040 comp rx=0 tx=0).stop 2024-02-07T12:38:20.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.191+0000 7fad52d1d640 1 -- 172.21.15.47:0/1852035146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad4c101270 msgr2=0x7fad4c111b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:20.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.191+0000 7fad52d1d640 1 --2- 172.21.15.47:0/1852035146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad4c101270 0x7fad4c111b40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fad3c031720 tx=0x7fad3c009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.191+0000 7fad52d1d640 1 -- 172.21.15.47:0/1852035146 shutdown_connections 2024-02-07T12:38:20.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.191+0000 7fad52d1d640 1 --2- 172.21.15.47:0/1852035146 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fad3406d750 0x7fad3406fc00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.191+0000 7fad52d1d640 1 --2- 172.21.15.47:0/1852035146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad4c101c10 0x7fad4c112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.191+0000 7fad52d1d640 1 --2- 172.21.15.47:0/1852035146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad4c101270 0x7fad4c111b40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.191+0000 7fad52d1d640 1 -- 172.21.15.47:0/1852035146 >> 172.21.15.47:0/1852035146 conn(0x7fad4c0f6e40 msgr2=0x7fad4c0f8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:20.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.191+0000 7fad52d1d640 1 -- 172.21.15.47:0/1852035146 shutdown_connections 2024-02-07T12:38:20.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.191+0000 7fad52d1d640 1 -- 172.21.15.47:0/1852035146 wait complete. 2024-02-07T12:38:20.204 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-07T12:38:20.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.301+0000 7effe7665640 1 -- 172.21.15.47:0/1236299195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe0102d00 msgr2=0x7effe00fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:20.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.301+0000 7effe7665640 1 --2- 172.21.15.47:0/1236299195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe0102d00 0x7effe00fc390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7effd00048d0 tx=0x7effd0009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe7665640 1 -- 172.21.15.47:0/1236299195 shutdown_connections 2024-02-07T12:38:20.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe7665640 1 --2- 172.21.15.47:0/1236299195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe0102d00 0x7effe00fc390 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe7665640 1 --2- 172.21.15.47:0/1236299195 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effe0102360 0x7effe0102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe7665640 1 -- 172.21.15.47:0/1236299195 >> 172.21.15.47:0/1236299195 conn(0x7effe00f7ef0 msgr2=0x7effe00fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:20.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe7665640 1 -- 172.21.15.47:0/1236299195 shutdown_connections 2024-02-07T12:38:20.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe7665640 1 -- 172.21.15.47:0/1236299195 wait complete. 2024-02-07T12:38:20.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe7665640 1 Processor -- start 2024-02-07T12:38:20.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe7665640 1 -- start start 2024-02-07T12:38:20.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe7665640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe0102360 0x7effe006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:20.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe7665640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effe0102d00 0x7effe006fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:20.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe7665640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe0071740 con 0x7effe0102360 2024-02-07T12:38:20.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe7665640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe0070220 con 0x7effe0102d00 2024-02-07T12:38:20.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe5401640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe0102360 0x7effe006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:20.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe5401640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe0102360 0x7effe006f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51132/0 (socket says 172.21.15.47:51132) 2024-02-07T12:38:20.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.302+0000 7effe5401640 1 -- 172.21.15.47:0/4271260584 learned_addr learned my addr 172.21.15.47:0/4271260584 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:20.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.303+0000 7effe4c00640 1 --2- 172.21.15.47:0/4271260584 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effe0102d00 0x7effe006fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:20.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.303+0000 7effe5401640 1 -- 172.21.15.47:0/4271260584 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effe0102d00 msgr2=0x7effe006fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:20.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.303+0000 7effe5401640 1 --2- 172.21.15.47:0/4271260584 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effe0102d00 0x7effe006fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.303+0000 7effe5401640 1 -- 172.21.15.47:0/4271260584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd0005040 con 0x7effe0102360 2024-02-07T12:38:20.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.303+0000 7effe5401640 1 --2- 172.21.15.47:0/4271260584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe0102360 0x7effe006f7a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7effd800cb10 tx=0x7effd8007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:20.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.303+0000 7effd5ffb640 1 -- 172.21.15.47:0/4271260584 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effd8004200 con 0x7effe0102360 2024-02-07T12:38:20.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.303+0000 7effd5ffb640 1 -- 172.21.15.47:0/4271260584 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effd800acf0 con 0x7effe0102360 2024-02-07T12:38:20.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.303+0000 7effe7665640 1 -- 172.21.15.47:0/4271260584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe00704d0 con 0x7effe0102360 2024-02-07T12:38:20.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.303+0000 7effd5ffb640 1 -- 172.21.15.47:0/4271260584 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effd8003e40 con 0x7effe0102360 2024-02-07T12:38:20.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.303+0000 7effe7665640 1 -- 172.21.15.47:0/4271260584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe01192b0 con 0x7effe0102360 2024-02-07T12:38:20.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.304+0000 7effe7665640 1 -- 172.21.15.47:0/4271260584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe0064480 con 0x7effe0102360 2024-02-07T12:38:20.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.305+0000 7effd5ffb640 1 -- 172.21.15.47:0/4271260584 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7effd800a820 con 0x7effe0102360 2024-02-07T12:38:20.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.305+0000 7effd5ffb640 1 --2- 172.21.15.47:0/4271260584 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7effcc06d6e0 0x7effcc06fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:20.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.305+0000 7effd5ffb640 1 -- 172.21.15.47:0/4271260584 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7effd808d690 con 0x7effe0102360 2024-02-07T12:38:20.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.305+0000 7effe4c00640 1 --2- 172.21.15.47:0/4271260584 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7effcc06d6e0 0x7effcc06fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:20.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.305+0000 7effe4c00640 1 --2- 172.21.15.47:0/4271260584 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7effcc06d6e0 0x7effcc06fb90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7effe0070f90 tx=0x7effd0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:20.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.309+0000 7effd5ffb640 1 -- 172.21.15.47:0/4271260584 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7effd8056e30 con 0x7effe0102360 2024-02-07T12:38:20.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.504+0000 7effe7665640 1 -- 172.21.15.47:0/4271260584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7effe0070d80 con 0x7effe0102360 2024-02-07T12:38:20.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.504+0000 7effd5ffb640 1 -- 172.21.15.47:0/4271260584 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v86) v1 ==== 81+0+2429 (secure 0 0 0) 0x7effd805a4f0 con 0x7effe0102360 2024-02-07T12:38:20.508 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6829/3387805936 2024-02-08T12:34:03.468583+0000 2024-02-07T12:38:20.508 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6828/3387805936 2024-02-08T12:34:03.468583+0000 2024-02-07T12:38:20.508 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6826/3633114050 2024-02-08T12:33:37.430656+0000 2024-02-07T12:38:20.508 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:6828/764872550 2024-02-08T12:27:38.822990+0000 2024-02-07T12:38:20.509 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:0/2878954883 2024-02-08T12:27:38.822990+0000 2024-02-07T12:38:20.509 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/2175635831 2024-02-08T12:17:02.806879+0000 2024-02-07T12:38:20.509 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:6829/764872550 2024-02-08T12:27:38.822990+0000 2024-02-07T12:38:20.509 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6827/3633114050 2024-02-08T12:33:37.430656+0000 2024-02-07T12:38:20.509 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/3304641630 2024-02-08T12:18:06.849658+0000 2024-02-07T12:38:20.509 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/926338889 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:20.509 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/1918664197 2024-02-08T12:17:02.806879+0000 2024-02-07T12:38:20.509 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:6825/2917636817 2024-02-08T12:23:08.319154+0000 2024-02-07T12:38:20.509 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/179765176 2024-02-08T12:25:32.261341+0000 2024-02-07T12:38:20.509 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/1750591204 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:20.509 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/454079597 2024-02-08T12:18:06.849658+0000 2024-02-07T12:38:20.509 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/3304641630 2024-02-08T12:18:06.849658+0000 2024-02-07T12:38:20.509 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3361862950 2024-02-08T12:17:02.806879+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/15111993 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/2169341238 2024-02-08T12:16:30.972957+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:0/476867914 2024-02-08T12:27:38.822990+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:0/2680943285 2024-02-08T12:27:38.822990+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/2169341238 2024-02-08T12:16:30.972957+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2651788466 2024-02-08T12:25:32.261341+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3354208208 2024-02-08T12:16:30.972957+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:0/722341446 2024-02-08T12:27:38.822990+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3586302931 2024-02-08T12:17:02.806879+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:6824/2917636817 2024-02-08T12:23:08.319154+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3413297119 2024-02-08T12:16:30.972957+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2768201708 2024-02-08T12:16:30.972957+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/3356603129 2024-02-08T12:25:32.261341+0000 2024-02-07T12:38:20.510 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/3356603129 2024-02-08T12:25:32.261341+0000 2024-02-07T12:38:20.511 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/1415322117 2024-02-08T12:18:06.849658+0000 2024-02-07T12:38:20.511 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2757370866 2024-02-08T12:18:06.849658+0000 2024-02-07T12:38:20.511 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3785090733 2024-02-08T12:25:32.261341+0000 2024-02-07T12:38:20.511 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/1926405874 2024-02-08T12:25:32.261341+0000 2024-02-07T12:38:20.511 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2678703901 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:20.511 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/831612230 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:20.511 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2545215659 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:20.511 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/520417272 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:20.511 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/2175635831 2024-02-08T12:17:02.806879+0000 2024-02-07T12:38:20.511 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/1750591204 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:20.512 INFO:teuthology.orchestra.run.smithi047.stderr:listed 41 entries 2024-02-07T12:38:20.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.507+0000 7effe7665640 1 -- 172.21.15.47:0/4271260584 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7effcc06d6e0 msgr2=0x7effcc06fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:20.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.507+0000 7effe7665640 1 --2- 172.21.15.47:0/4271260584 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7effcc06d6e0 0x7effcc06fb90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7effe0070f90 tx=0x7effd0009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.507+0000 7effe7665640 1 -- 172.21.15.47:0/4271260584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe0102360 msgr2=0x7effe006f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:20.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.507+0000 7effe7665640 1 --2- 172.21.15.47:0/4271260584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe0102360 0x7effe006f7a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7effd800cb10 tx=0x7effd8007ee0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.507+0000 7effe7665640 1 -- 172.21.15.47:0/4271260584 shutdown_connections 2024-02-07T12:38:20.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.507+0000 7effe7665640 1 --2- 172.21.15.47:0/4271260584 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7effcc06d6e0 0x7effcc06fb90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.507+0000 7effe7665640 1 --2- 172.21.15.47:0/4271260584 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effe0102d00 0x7effe006fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.507+0000 7effe7665640 1 --2- 172.21.15.47:0/4271260584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe0102360 0x7effe006f7a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.507+0000 7effe7665640 1 -- 172.21.15.47:0/4271260584 >> 172.21.15.47:0/4271260584 conn(0x7effe00f7ef0 msgr2=0x7effe00f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:20.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.507+0000 7effe7665640 1 -- 172.21.15.47:0/4271260584 shutdown_connections 2024-02-07T12:38:20.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.507+0000 7effe7665640 1 -- 172.21.15.47:0/4271260584 wait complete. 2024-02-07T12:38:20.518 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:20 smithi047 ceph-mon[93224]: pgmap v335: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:38:20.519 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:20 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3131689700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-07T12:38:20.519 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:20 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3819879493' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-07T12:38:20.519 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:20 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1852035146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-07T12:38:20.520 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-07T12:38:20.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:38:20.520 DEBUG:teuthology.orchestra.run.smithi047:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-07T12:38:20.547 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:38:20.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:38:20.547 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-07T12:38:20.616 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:38:20.616 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-07T12:38:20.635 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-07T12:38:20.635 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-07T12:38:20.694 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-07T12:38:20.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:20 smithi138 ceph-mon[82055]: pgmap v335: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-07T12:38:20.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:20 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3131689700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-07T12:38:20.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:20 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3819879493' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-07T12:38:20.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:20 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1852035146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-07T12:38:20.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.791+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3092031273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f041022e0 msgr2=0x7f9f041026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:20.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.791+0000 7f9f08f5d640 1 --2- 172.21.15.47:0/3092031273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f041022e0 0x7f9f041026b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0048d0 tx=0x7f9eec009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3092031273 shutdown_connections 2024-02-07T12:38:20.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f08f5d640 1 --2- 172.21.15.47:0/3092031273 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f04102c80 0x7f9f040fc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f08f5d640 1 --2- 172.21.15.47:0/3092031273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f041022e0 0x7f9f041026b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3092031273 >> 172.21.15.47:0/3092031273 conn(0x7f9f040f7ed0 msgr2=0x7f9f040fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:20.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3092031273 shutdown_connections 2024-02-07T12:38:20.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3092031273 wait complete. 2024-02-07T12:38:20.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f08f5d640 1 Processor -- start 2024-02-07T12:38:20.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f08f5d640 1 -- start start 2024-02-07T12:38:20.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f08f5d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f041022e0 0x7f9f04112b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:20.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f08f5d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f04102c80 0x7f9f04113060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:20.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f08f5d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f04113660 con 0x7f9f04102c80 2024-02-07T12:38:20.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f08f5d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0410cbf0 con 0x7f9f041022e0 2024-02-07T12:38:20.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f01d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f04102c80 0x7f9f04113060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:20.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f01d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f04102c80 0x7f9f04113060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51154/0 (socket says 172.21.15.47:51154) 2024-02-07T12:38:20.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.792+0000 7f9f01d9b640 1 -- 172.21.15.47:0/3781875685 learned_addr learned my addr 172.21.15.47:0/3781875685 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:20.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.793+0000 7f9f0259c640 1 --2- 172.21.15.47:0/3781875685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f041022e0 0x7f9f04112b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:20.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.793+0000 7f9f01d9b640 1 -- 172.21.15.47:0/3781875685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f041022e0 msgr2=0x7f9f04112b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:20.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.793+0000 7f9f01d9b640 1 --2- 172.21.15.47:0/3781875685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f041022e0 0x7f9f04112b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.793+0000 7f9f01d9b640 1 -- 172.21.15.47:0/3781875685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec005040 con 0x7f9f04102c80 2024-02-07T12:38:20.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.793+0000 7f9f01d9b640 1 --2- 172.21.15.47:0/3781875685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f04102c80 0x7f9f04113060 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400eb70 tx=0x7f9ef400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:20.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.793+0000 7f9efaffd640 1 -- 172.21.15.47:0/3781875685 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef4007c30 con 0x7f9f04102c80 2024-02-07T12:38:20.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.793+0000 7f9efaffd640 1 -- 172.21.15.47:0/3781875685 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ef400f040 con 0x7f9f04102c80 2024-02-07T12:38:20.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.793+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3781875685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0410ce70 con 0x7f9f04102c80 2024-02-07T12:38:20.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.793+0000 7f9efaffd640 1 -- 172.21.15.47:0/3781875685 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef40095b0 con 0x7f9f04102c80 2024-02-07T12:38:20.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.793+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3781875685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0410d390 con 0x7f9f04102c80 2024-02-07T12:38:20.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.794+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3781875685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f04064030 con 0x7f9f04102c80 2024-02-07T12:38:20.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.794+0000 7f9efaffd640 1 -- 172.21.15.47:0/3781875685 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9ef4009730 con 0x7f9f04102c80 2024-02-07T12:38:20.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.795+0000 7f9efaffd640 1 --2- 172.21.15.47:0/3781875685 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9ef006d750 0x7f9ef006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:20.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.795+0000 7f9efaffd640 1 -- 172.21.15.47:0/3781875685 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9ef408cc60 con 0x7f9f04102c80 2024-02-07T12:38:20.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.795+0000 7f9f0259c640 1 --2- 172.21.15.47:0/3781875685 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9ef006d750 0x7f9ef006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:20.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.795+0000 7f9f0259c640 1 --2- 172.21.15.47:0/3781875685 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9ef006d750 0x7f9ef006fc00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9eec000c00 tx=0x7f9eec009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:20.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.800+0000 7f9efaffd640 1 -- 172.21.15.47:0/3781875685 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9ef40564b0 con 0x7f9f04102c80 2024-02-07T12:38:20.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.980+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3781875685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f0410d5b0 con 0x7f9f04102c80 2024-02-07T12:38:20.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.981+0000 7f9efaffd640 1 -- 172.21.15.47:0/3781875685 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16793 (secure 0 0 0) 0x7f9ef4059b70 con 0x7f9f04102c80 2024-02-07T12:38:20.984 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-02-07T12:38:20.984 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":86,"fsid":"818049ec-c5b2-11ee-95b6-87774f69a715","created":"2024-02-07T12:16:03.682077+0000","modified":"2024-02-07T12:34:43.948607+0000","last_up_change":"2024-02-07T12:32:47.656919+0000","last_in_change":"2024-02-07T12:21:14.657544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-07T12:20:21.191001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-07T12:22:52.656534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-07T12:22:53.237906+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b37bbc00-7240-422a-977b-c7a9687ce87f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1557469797},{"type":"v1","addr":"172.21.15.47:6803","nonce":1557469797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1557469797},{"type":"v1","addr":"172.21.15.47:6805","nonce":1557469797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1557469797},{"type":"v1","addr":"172.21.15.47:6809","nonce":1557469797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1557469797},{"type":"v1","addr":"172.21.15.47:6807","nonce":1557469797}]},"public_addr":"172.21.15.47:6803/1557469797","cluster_addr":"172.21.15.47:6805/1557469797","heartbeat_back_addr":"172.21.15.47:6809/1557469797","heartbeat_front_addr":"172.21.15.47:6807/1557469797","state":["exists","up"]},{"osd":1,"uuid":"e6a42328-96ea-40de-987d-4edec38a4b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3632128293},{"type":"v1","addr":"172.21.15.47:6811","nonce":3632128293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3632128293},{"type":"v1","addr":"172.21.15.47:6813","nonce":3632128293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3632128293},{"type":"v1","addr":"172.21.15.47:6817","nonce":3632128293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3632128293},{"type":"v1","addr":"172.21.15.47:6815","nonce":3632128293}]},"public_addr":"172.21.15.47:6811/3632128293","cluster_addr":"172.21.15.47:6813/3632128293","heartbeat_back_addr":"172.21.15.47:6817/3632128293","heartbeat_front_addr":"172.21.15.47:6815/3632128293","state":["exists","up"]},{"osd":2,"uuid":"c8925cb3-0da0-4f01-90c3-1b6fb6e15331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4120407081},{"type":"v1","addr":"172.21.15.47:6819","nonce":4120407081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4120407081},{"type":"v1","addr":"172.21.15.47:6821","nonce":4120407081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4120407081},{"type":"v1","addr":"172.21.15.47:6825","nonce":4120407081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4120407081},{"type":"v1","addr":"172.21.15.47:6823","nonce":4120407081}]},"public_addr":"172.21.15.47:6819/4120407081","cluster_addr":"172.21.15.47:6821/4120407081","heartbeat_back_addr":"172.21.15.47:6825/4120407081","heartbeat_front_addr":"172.21.15.47:6823/4120407081","state":["exists","up"]},{"osd":3,"uuid":"47130a0a-e27f-4129-abbb-4bef9b460ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1616507148},{"type":"v1","addr":"172.21.15.138:6801","nonce":1616507148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1616507148},{"type":"v1","addr":"172.21.15.138:6803","nonce":1616507148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1616507148},{"type":"v1","addr":"172.21.15.138:6807","nonce":1616507148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1616507148},{"type":"v1","addr":"172.21.15.138:6805","nonce":1616507148}]},"public_addr":"172.21.15.138:6801/1616507148","cluster_addr":"172.21.15.138:6803/1616507148","heartbeat_back_addr":"172.21.15.138:6807/1616507148","heartbeat_front_addr":"172.21.15.138:6805/1616507148","state":["exists","up"]},{"osd":4,"uuid":"103459b7-4883-4248-a64d-21c396324237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3739765492},{"type":"v1","addr":"172.21.15.138:6809","nonce":3739765492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3739765492},{"type":"v1","addr":"172.21.15.138:6811","nonce":3739765492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3739765492},{"type":"v1","addr":"172.21.15.138:6815","nonce":3739765492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3739765492},{"type":"v1","addr":"172.21.15.138:6813","nonce":3739765492}]},"public_addr":"172.21.15.138:6809/3739765492","cluster_addr":"172.21.15.138:6811/3739765492","heartbeat_back_addr":"172.21.15.138:6815/3739765492","heartbeat_front_addr":"172.21.15.138:6813/3739765492","state":["exists","up"]},{"osd":5,"uuid":"e8acb2ff-d0f5-4daf-82ee-6c4fddf1580d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2664957218},{"type":"v1","addr":"172.21.15.138:6817","nonce":2664957218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2664957218},{"type":"v1","addr":"172.21.15.138:6819","nonce":2664957218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2664957218},{"type":"v1","addr":"172.21.15.138:6823","nonce":2664957218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2664957218},{"type":"v1","addr":"172.21.15.138:6821","nonce":2664957218}]},"public_addr":"172.21.15.138:6817/2664957218","cluster_addr":"172.21.15.138:6819/2664957218","heartbeat_back_addr":"172.21.15.138:6823/2664957218","heartbeat_front_addr":"172.21.15.138:6821/2664957218","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:19.518708+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:19:48.503474+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:17.112205+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:20:41.349671+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:06.347737+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-07T12:21:31.635560+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6829/3387805936":"2024-02-08T12:34:03.468583+0000","172.21.15.47:6828/3387805936":"2024-02-08T12:34:03.468583+0000","172.21.15.47:6826/3633114050":"2024-02-08T12:33:37.430656+0000","172.21.15.138:6828/764872550":"2024-02-08T12:27:38.822990+0000","172.21.15.138:0/2878954883":"2024-02-08T12:27:38.822990+0000","172.21.15.47:6801/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.138:6829/764872550":"2024-02-08T12:27:38.822990+0000","172.21.15.47:6827/3633114050":"2024-02-08T12:33:37.430656+0000","172.21.15.47:6800/3304641630":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/926338889":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/1918664197":"2024-02-08T12:17:02.806879+0000","172.21.15.138:6825/2917636817":"2024-02-08T12:23:08.319154+0000","172.21.15.47:0/179765176":"2024-02-08T12:25:32.261341+0000","172.21.15.47:6801/1750591204":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/454079597":"2024-02-08T12:18:06.849658+0000","172.21.15.47:6801/3304641630":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/3361862950":"2024-02-08T12:17:02.806879+0000","172.21.15.47:0/15111993":"2024-02-08T12:28:26.591613+0000","172.21.15.47:6800/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.138:0/476867914":"2024-02-08T12:27:38.822990+0000","172.21.15.138:0/2680943285":"2024-02-08T12:27:38.822990+0000","172.21.15.47:6801/2169341238":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/2651788466":"2024-02-08T12:25:32.261341+0000","172.21.15.47:0/3354208208":"2024-02-08T12:16:30.972957+0000","172.21.15.138:0/722341446":"2024-02-08T12:27:38.822990+0000","172.21.15.47:0/3586302931":"2024-02-08T12:17:02.806879+0000","172.21.15.138:6824/2917636817":"2024-02-08T12:23:08.319154+0000","172.21.15.47:0/3413297119":"2024-02-08T12:16:30.972957+0000","172.21.15.47:0/2768201708":"2024-02-08T12:16:30.972957+0000","172.21.15.47:6801/3356603129":"2024-02-08T12:25:32.261341+0000","172.21.15.47:6800/3356603129":"2024-02-08T12:25:32.261341+0000","172.21.15.47:0/1415322117":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/2757370866":"2024-02-08T12:18:06.849658+0000","172.21.15.47:0/3785090733":"2024-02-08T12:25:32.261341+0000","172.21.15.47:0/1926405874":"2024-02-08T12:25:32.261341+0000","172.21.15.47:0/2678703901":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/831612230":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/2545215659":"2024-02-08T12:28:26.591613+0000","172.21.15.47:0/520417272":"2024-02-08T12:28:26.591613+0000","172.21.15.47:6800/2175635831":"2024-02-08T12:17:02.806879+0000","172.21.15.47:6800/1750591204":"2024-02-08T12:28:26.591613+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-07T12:38:20.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.983+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3781875685 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9ef006d750 msgr2=0x7f9ef006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:20.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.983+0000 7f9f08f5d640 1 --2- 172.21.15.47:0/3781875685 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9ef006d750 0x7f9ef006fc00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9eec000c00 tx=0x7f9eec009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.983+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3781875685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f04102c80 msgr2=0x7f9f04113060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:20.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.983+0000 7f9f08f5d640 1 --2- 172.21.15.47:0/3781875685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f04102c80 0x7f9f04113060 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400eb70 tx=0x7f9ef400b040 comp rx=0 tx=0).stop 2024-02-07T12:38:20.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.983+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3781875685 shutdown_connections 2024-02-07T12:38:20.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.983+0000 7f9f08f5d640 1 --2- 172.21.15.47:0/3781875685 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f9ef006d750 0x7f9ef006fc00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.983+0000 7f9f08f5d640 1 --2- 172.21.15.47:0/3781875685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f04102c80 0x7f9f04113060 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.983+0000 7f9f08f5d640 1 --2- 172.21.15.47:0/3781875685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f041022e0 0x7f9f04112b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:20.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.983+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3781875685 >> 172.21.15.47:0/3781875685 conn(0x7f9f040f7ed0 msgr2=0x7f9f040f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:20.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.983+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3781875685 shutdown_connections 2024-02-07T12:38:20.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:20.983+0000 7f9f08f5d640 1 -- 172.21.15.47:0/3781875685 wait complete. 2024-02-07T12:38:20.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-07T12:20:21.191001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-07T12:22:52.656534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-07T12:22:53.237906+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-07T12:38:20.997 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-07T12:38:21.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.095+0000 7f8756aae640 1 -- 172.21.15.47:0/1270130439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87501012d0 msgr2=0x7f87501016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:21.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.095+0000 7f8756aae640 1 --2- 172.21.15.47:0/1270130439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87501012d0 0x7f87501016a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f87440048d0 tx=0x7f8744009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.095+0000 7f8756aae640 1 -- 172.21.15.47:0/1270130439 shutdown_connections 2024-02-07T12:38:21.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.095+0000 7f8756aae640 1 --2- 172.21.15.47:0/1270130439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87500fb2b0 0x7f87500fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.095+0000 7f8756aae640 1 --2- 172.21.15.47:0/1270130439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87501012d0 0x7f87501016a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.095+0000 7f8756aae640 1 -- 172.21.15.47:0/1270130439 >> 172.21.15.47:0/1270130439 conn(0x7f8750071230 msgr2=0x7f8750071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.095+0000 7f8756aae640 1 -- 172.21.15.47:0/1270130439 shutdown_connections 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.095+0000 7f8756aae640 1 -- 172.21.15.47:0/1270130439 wait complete. 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.096+0000 7f8756aae640 1 Processor -- start 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.096+0000 7f8756aae640 1 -- start start 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.096+0000 7f8756aae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87500fb2b0 0x7f875010dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.096+0000 7f8756aae640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87501012d0 0x7f875010e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.096+0000 7f8756aae640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875010e780 con 0x7f87500fb2b0 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.096+0000 7f8756aae640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875010e8f0 con 0x7f87501012d0 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.096+0000 7f875484a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87500fb2b0 0x7f875010dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.096+0000 7f875484a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87500fb2b0 0x7f875010dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51168/0 (socket says 172.21.15.47:51168) 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.096+0000 7f875484a640 1 -- 172.21.15.47:0/73574462 learned_addr learned my addr 172.21.15.47:0/73574462 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.096+0000 7f874ffff640 1 --2- 172.21.15.47:0/73574462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87501012d0 0x7f875010e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.097+0000 7f875484a640 1 -- 172.21.15.47:0/73574462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87501012d0 msgr2=0x7f875010e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:21.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.097+0000 7f875484a640 1 --2- 172.21.15.47:0/73574462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87501012d0 0x7f875010e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.097+0000 7f875484a640 1 -- 172.21.15.47:0/73574462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744005040 con 0x7f87500fb2b0 2024-02-07T12:38:21.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.097+0000 7f875484a640 1 --2- 172.21.15.47:0/73574462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87500fb2b0 0x7f875010dd00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8744031720 tx=0x7f8744009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:21.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.097+0000 7f874d7fa640 1 -- 172.21.15.47:0/73574462 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87440094c0 con 0x7f87500fb2b0 2024-02-07T12:38:21.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.097+0000 7f874d7fa640 1 -- 172.21.15.47:0/73574462 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8744009620 con 0x7f87500fb2b0 2024-02-07T12:38:21.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.097+0000 7f8756aae640 1 -- 172.21.15.47:0/73574462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f875010eb70 con 0x7f87500fb2b0 2024-02-07T12:38:21.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.097+0000 7f874d7fa640 1 -- 172.21.15.47:0/73574462 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f874403b640 con 0x7f87500fb2b0 2024-02-07T12:38:21.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.097+0000 7f8756aae640 1 -- 172.21.15.47:0/73574462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8750117100 con 0x7f87500fb2b0 2024-02-07T12:38:21.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.098+0000 7f8756aae640 1 -- 172.21.15.47:0/73574462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8750064030 con 0x7f87500fb2b0 2024-02-07T12:38:21.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.098+0000 7f874d7fa640 1 -- 172.21.15.47:0/73574462 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f874402f070 con 0x7f87500fb2b0 2024-02-07T12:38:21.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.099+0000 7f874d7fa640 1 --2- 172.21.15.47:0/73574462 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f874006d750 0x7f874006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:21.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.099+0000 7f874d7fa640 1 -- 172.21.15.47:0/73574462 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f87440af2c0 con 0x7f87500fb2b0 2024-02-07T12:38:21.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.099+0000 7f874ffff640 1 --2- 172.21.15.47:0/73574462 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f874006d750 0x7f874006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:21.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.099+0000 7f874ffff640 1 --2- 172.21.15.47:0/73574462 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f874006d750 0x7f874006fc00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f873c009fd0 tx=0x7f873c009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:21.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.103+0000 7f874d7fa640 1 -- 172.21.15.47:0/73574462 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8744078a60 con 0x7f87500fb2b0 2024-02-07T12:38:21.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.281+0000 7f8756aae640 1 -- 172.21.15.47:0/73574462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f875010eb10 con 0x7f87500fb2b0 2024-02-07T12:38:21.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.281+0000 7f874d7fa640 1 -- 172.21.15.47:0/73574462 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f874407c120 con 0x7f87500fb2b0 2024-02-07T12:38:21.284 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-02-07T12:38:21.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.283+0000 7f8756aae640 1 -- 172.21.15.47:0/73574462 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f874006d750 msgr2=0x7f874006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:21.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.283+0000 7f8756aae640 1 --2- 172.21.15.47:0/73574462 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f874006d750 0x7f874006fc00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f873c009fd0 tx=0x7f873c009e50 comp rx=0 tx=0).stop 2024-02-07T12:38:21.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.283+0000 7f8756aae640 1 -- 172.21.15.47:0/73574462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87500fb2b0 msgr2=0x7f875010dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:21.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.283+0000 7f8756aae640 1 --2- 172.21.15.47:0/73574462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87500fb2b0 0x7f875010dd00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8744031720 tx=0x7f8744009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.283+0000 7f8756aae640 1 -- 172.21.15.47:0/73574462 shutdown_connections 2024-02-07T12:38:21.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.283+0000 7f8756aae640 1 --2- 172.21.15.47:0/73574462 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f874006d750 0x7f874006fc00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.283+0000 7f8756aae640 1 --2- 172.21.15.47:0/73574462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87501012d0 0x7f875010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.283+0000 7f8756aae640 1 --2- 172.21.15.47:0/73574462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87500fb2b0 0x7f875010dd00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.283+0000 7f8756aae640 1 -- 172.21.15.47:0/73574462 >> 172.21.15.47:0/73574462 conn(0x7f8750071230 msgr2=0x7f87500fa190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:21.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.284+0000 7f8756aae640 1 -- 172.21.15.47:0/73574462 shutdown_connections 2024-02-07T12:38:21.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.284+0000 7f8756aae640 1 -- 172.21.15.47:0/73574462 wait complete. 2024-02-07T12:38:21.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-07T12:38:21.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.397+0000 7f4d73821640 1 -- 172.21.15.47:0/2834571518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d6c0fb2b0 msgr2=0x7f4d6c0fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:21.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.397+0000 7f4d73821640 1 --2- 172.21.15.47:0/2834571518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d6c0fb2b0 0x7f4d6c0fb700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4d600048d0 tx=0x7f4d60009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.397+0000 7f4d73821640 1 -- 172.21.15.47:0/2834571518 shutdown_connections 2024-02-07T12:38:21.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.397+0000 7f4d73821640 1 --2- 172.21.15.47:0/2834571518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d6c0fb2b0 0x7f4d6c0fb700 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.397+0000 7f4d73821640 1 --2- 172.21.15.47:0/2834571518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d6c1012d0 0x7f4d6c1016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.397+0000 7f4d73821640 1 -- 172.21.15.47:0/2834571518 >> 172.21.15.47:0/2834571518 conn(0x7f4d6c071230 msgr2=0x7f4d6c071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:21.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.398+0000 7f4d73821640 1 -- 172.21.15.47:0/2834571518 shutdown_connections 2024-02-07T12:38:21.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.398+0000 7f4d73821640 1 -- 172.21.15.47:0/2834571518 wait complete. 2024-02-07T12:38:21.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.398+0000 7f4d73821640 1 Processor -- start 2024-02-07T12:38:21.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.398+0000 7f4d73821640 1 -- start start 2024-02-07T12:38:21.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.398+0000 7f4d73821640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d6c0fb2b0 0x7f4d6c114e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:21.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.398+0000 7f4d73821640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d6c1012d0 0x7f4d6c115340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:21.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.398+0000 7f4d73821640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c115940 con 0x7f4d6c1012d0 2024-02-07T12:38:21.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.398+0000 7f4d73821640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c10eed0 con 0x7f4d6c0fb2b0 2024-02-07T12:38:21.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.399+0000 7f4d70dbc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d6c1012d0 0x7f4d6c115340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:21.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.399+0000 7f4d70dbc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d6c1012d0 0x7f4d6c115340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51188/0 (socket says 172.21.15.47:51188) 2024-02-07T12:38:21.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.399+0000 7f4d70dbc640 1 -- 172.21.15.47:0/3408488640 learned_addr learned my addr 172.21.15.47:0/3408488640 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:21.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.399+0000 7f4d715bd640 1 --2- 172.21.15.47:0/3408488640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d6c0fb2b0 0x7f4d6c114e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:21.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.399+0000 7f4d70dbc640 1 -- 172.21.15.47:0/3408488640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d6c0fb2b0 msgr2=0x7f4d6c114e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:21.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.399+0000 7f4d70dbc640 1 --2- 172.21.15.47:0/3408488640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d6c0fb2b0 0x7f4d6c114e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.399+0000 7f4d70dbc640 1 -- 172.21.15.47:0/3408488640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60005040 con 0x7f4d6c1012d0 2024-02-07T12:38:21.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.399+0000 7f4d70dbc640 1 --2- 172.21.15.47:0/3408488640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d6c1012d0 0x7f4d6c115340 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4d60031720 tx=0x7f4d60009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:21.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.400+0000 7f4d69ffb640 1 -- 172.21.15.47:0/3408488640 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d600094c0 con 0x7f4d6c1012d0 2024-02-07T12:38:21.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.400+0000 7f4d69ffb640 1 -- 172.21.15.47:0/3408488640 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d60009620 con 0x7f4d6c1012d0 2024-02-07T12:38:21.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.400+0000 7f4d69ffb640 1 -- 172.21.15.47:0/3408488640 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d6003b640 con 0x7f4d6c1012d0 2024-02-07T12:38:21.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.400+0000 7f4d73821640 1 -- 172.21.15.47:0/3408488640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c10f150 con 0x7f4d6c1012d0 2024-02-07T12:38:21.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.400+0000 7f4d73821640 1 -- 172.21.15.47:0/3408488640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c10f670 con 0x7f4d6c1012d0 2024-02-07T12:38:21.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.401+0000 7f4d73821640 1 -- 172.21.15.47:0/3408488640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c064030 con 0x7f4d6c1012d0 2024-02-07T12:38:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.402+0000 7f4d69ffb640 1 -- 172.21.15.47:0/3408488640 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f4d6002f070 con 0x7f4d6c1012d0 2024-02-07T12:38:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.402+0000 7f4d69ffb640 1 --2- 172.21.15.47:0/3408488640 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4d5406d750 0x7f4d5406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.402+0000 7f4d69ffb640 1 -- 172.21.15.47:0/3408488640 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4d600af440 con 0x7f4d6c1012d0 2024-02-07T12:38:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.402+0000 7f4d715bd640 1 --2- 172.21.15.47:0/3408488640 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4d5406d750 0x7f4d5406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.403+0000 7f4d715bd640 1 --2- 172.21.15.47:0/3408488640 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4d5406d750 0x7f4d5406fc00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4d64007fd0 tx=0x7f4d64009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:21.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.407+0000 7f4d69ffb640 1 -- 172.21.15.47:0/3408488640 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4d60078c60 con 0x7f4d6c1012d0 2024-02-07T12:38:21.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:21 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/4271260584' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-07T12:38:21.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:21 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3781875685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:38:21.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:21 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/73574462' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-07T12:38:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.586+0000 7f4d73821640 1 -- 172.21.15.47:0/3408488640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f4d6c1104a0 con 0x7f4d6c1012d0 2024-02-07T12:38:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.586+0000 7f4d69ffb640 1 -- 172.21.15.47:0/3408488640 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v86) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4d6007c320 con 0x7f4d6c1012d0 2024-02-07T12:38:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-02-07T12:38:21.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.589+0000 7f4d73821640 1 -- 172.21.15.47:0/3408488640 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4d5406d750 msgr2=0x7f4d5406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:21.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.589+0000 7f4d73821640 1 --2- 172.21.15.47:0/3408488640 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4d5406d750 0x7f4d5406fc00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4d64007fd0 tx=0x7f4d64009040 comp rx=0 tx=0).stop 2024-02-07T12:38:21.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.589+0000 7f4d73821640 1 -- 172.21.15.47:0/3408488640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d6c1012d0 msgr2=0x7f4d6c115340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:21.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.589+0000 7f4d73821640 1 --2- 172.21.15.47:0/3408488640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d6c1012d0 0x7f4d6c115340 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4d60031720 tx=0x7f4d60009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.589+0000 7f4d73821640 1 -- 172.21.15.47:0/3408488640 shutdown_connections 2024-02-07T12:38:21.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.589+0000 7f4d73821640 1 --2- 172.21.15.47:0/3408488640 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f4d5406d750 0x7f4d5406fc00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.589+0000 7f4d73821640 1 --2- 172.21.15.47:0/3408488640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d6c1012d0 0x7f4d6c115340 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.589+0000 7f4d73821640 1 --2- 172.21.15.47:0/3408488640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d6c0fb2b0 0x7f4d6c114e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.589+0000 7f4d73821640 1 -- 172.21.15.47:0/3408488640 >> 172.21.15.47:0/3408488640 conn(0x7f4d6c071230 msgr2=0x7f4d6c064520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:21.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.589+0000 7f4d73821640 1 -- 172.21.15.47:0/3408488640 shutdown_connections 2024-02-07T12:38:21.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.589+0000 7f4d73821640 1 -- 172.21.15.47:0/3408488640 wait complete. 2024-02-07T12:38:21.602 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-07T12:38:21.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.700+0000 7fc1e886e640 1 -- 172.21.15.47:0/459230718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1e406f7c0 msgr2=0x7fc1e406fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:21.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.700+0000 7fc1e886e640 1 --2- 172.21.15.47:0/459230718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1e406f7c0 0x7fc1e406fb90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0048d0 tx=0x7fc1dc009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.700+0000 7fc1e886e640 1 -- 172.21.15.47:0/459230718 shutdown_connections 2024-02-07T12:38:21.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.700+0000 7fc1e886e640 1 --2- 172.21.15.47:0/459230718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1e40700d0 0x7fc1e4108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.700+0000 7fc1e886e640 1 --2- 172.21.15.47:0/459230718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1e406f7c0 0x7fc1e406fb90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.700+0000 7fc1e886e640 1 -- 172.21.15.47:0/459230718 >> 172.21.15.47:0/459230718 conn(0x7fc1e40f7ef0 msgr2=0x7fc1e40fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:21.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.700+0000 7fc1e886e640 1 -- 172.21.15.47:0/459230718 shutdown_connections 2024-02-07T12:38:21.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.700+0000 7fc1e886e640 1 -- 172.21.15.47:0/459230718 wait complete. 2024-02-07T12:38:21.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.701+0000 7fc1e886e640 1 Processor -- start 2024-02-07T12:38:21.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.701+0000 7fc1e886e640 1 -- start start 2024-02-07T12:38:21.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.701+0000 7fc1e886e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1e406f7c0 0x7fc1e4114de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:21.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.701+0000 7fc1e886e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1e40700d0 0x7fc1e4115320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:21.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.701+0000 7fc1e886e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e4115920 con 0x7fc1e40700d0 2024-02-07T12:38:21.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.701+0000 7fc1e886e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e410eeb0 con 0x7fc1e406f7c0 2024-02-07T12:38:21.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.701+0000 7fc1e1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1e40700d0 0x7fc1e4115320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:21.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.701+0000 7fc1e1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1e40700d0 0x7fc1e4115320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51216/0 (socket says 172.21.15.47:51216) 2024-02-07T12:38:21.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.701+0000 7fc1e1d9b640 1 -- 172.21.15.47:0/1891162413 learned_addr learned my addr 172.21.15.47:0/1891162413 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:21.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.701+0000 7fc1e259c640 1 --2- 172.21.15.47:0/1891162413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1e406f7c0 0x7fc1e4114de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:21.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.701+0000 7fc1e1d9b640 1 -- 172.21.15.47:0/1891162413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1e406f7c0 msgr2=0x7fc1e4114de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:21.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.701+0000 7fc1e1d9b640 1 --2- 172.21.15.47:0/1891162413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1e406f7c0 0x7fc1e4114de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.702+0000 7fc1e1d9b640 1 -- 172.21.15.47:0/1891162413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc005040 con 0x7fc1e40700d0 2024-02-07T12:38:21.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.702+0000 7fc1e1d9b640 1 --2- 172.21.15.47:0/1891162413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1e40700d0 0x7fc1e4115320 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00c830 tx=0x7fc1cc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:21.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.702+0000 7fc1daffd640 1 -- 172.21.15.47:0/1891162413 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1cc00a850 con 0x7fc1e40700d0 2024-02-07T12:38:21.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.702+0000 7fc1daffd640 1 -- 172.21.15.47:0/1891162413 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1cc00ae80 con 0x7fc1e40700d0 2024-02-07T12:38:21.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.702+0000 7fc1e886e640 1 -- 172.21.15.47:0/1891162413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e410f190 con 0x7fc1e40700d0 2024-02-07T12:38:21.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.702+0000 7fc1daffd640 1 -- 172.21.15.47:0/1891162413 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1cc012ea0 con 0x7fc1e40700d0 2024-02-07T12:38:21.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.702+0000 7fc1e886e640 1 -- 172.21.15.47:0/1891162413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e410f6b0 con 0x7fc1e40700d0 2024-02-07T12:38:21.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.703+0000 7fc1e886e640 1 -- 172.21.15.47:0/1891162413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e4064480 con 0x7fc1e40700d0 2024-02-07T12:38:21.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.703+0000 7fc1daffd640 1 -- 172.21.15.47:0/1891162413 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc1cc012400 con 0x7fc1e40700d0 2024-02-07T12:38:21.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.704+0000 7fc1daffd640 1 --2- 172.21.15.47:0/1891162413 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc1d006d750 0x7fc1d006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:21.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.704+0000 7fc1daffd640 1 -- 172.21.15.47:0/1891162413 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc1cc08d1f0 con 0x7fc1e40700d0 2024-02-07T12:38:21.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.704+0000 7fc1e259c640 1 --2- 172.21.15.47:0/1891162413 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc1d006d750 0x7fc1d006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:21.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.704+0000 7fc1e259c640 1 --2- 172.21.15.47:0/1891162413 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc1d006d750 0x7fc1d006fc00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc000c00 tx=0x7fc1dc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:21.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.708+0000 7fc1daffd640 1 -- 172.21.15.47:0/1891162413 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc1cc056a10 con 0x7fc1e40700d0 2024-02-07T12:38:21.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:21 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/4271260584' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-07T12:38:21.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:21 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3781875685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-07T12:38:21.784 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:21 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/73574462' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-07T12:38:21.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.887+0000 7fc1e886e640 1 -- 172.21.15.47:0/1891162413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fc1e4105e10 con 0x7fc1e40700d0 2024-02-07T12:38:21.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.887+0000 7fc1daffd640 1 -- 172.21.15.47:0/1891162413 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v86) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc1e4105e10 con 0x7fc1e40700d0 2024-02-07T12:38:21.889 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-02-07T12:38:21.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.889+0000 7fc1e886e640 1 -- 172.21.15.47:0/1891162413 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc1d006d750 msgr2=0x7fc1d006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:21.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.889+0000 7fc1e886e640 1 --2- 172.21.15.47:0/1891162413 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc1d006d750 0x7fc1d006fc00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc000c00 tx=0x7fc1dc009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.889+0000 7fc1e886e640 1 -- 172.21.15.47:0/1891162413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1e40700d0 msgr2=0x7fc1e4115320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:21.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.889+0000 7fc1e886e640 1 --2- 172.21.15.47:0/1891162413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1e40700d0 0x7fc1e4115320 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00c830 tx=0x7fc1cc004430 comp rx=0 tx=0).stop 2024-02-07T12:38:21.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.889+0000 7fc1e886e640 1 -- 172.21.15.47:0/1891162413 shutdown_connections 2024-02-07T12:38:21.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.889+0000 7fc1e886e640 1 --2- 172.21.15.47:0/1891162413 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7fc1d006d750 0x7fc1d006fc00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.889+0000 7fc1e886e640 1 --2- 172.21.15.47:0/1891162413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1e40700d0 0x7fc1e4115320 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.889+0000 7fc1e886e640 1 --2- 172.21.15.47:0/1891162413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1e406f7c0 0x7fc1e4114de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:21.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.889+0000 7fc1e886e640 1 -- 172.21.15.47:0/1891162413 >> 172.21.15.47:0/1891162413 conn(0x7fc1e40f7ef0 msgr2=0x7fc1e4102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:21.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.889+0000 7fc1e886e640 1 -- 172.21.15.47:0/1891162413 shutdown_connections 2024-02-07T12:38:21.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:21.889+0000 7fc1e886e640 1 -- 172.21.15.47:0/1891162413 wait complete. 2024-02-07T12:38:21.902 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-07T12:38:22.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 -- 172.21.15.47:0/1626025107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8144101c10 msgr2=0x7f81440fb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:22.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 --2- 172.21.15.47:0/1626025107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8144101c10 0x7f81440fb2a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f81340048d0 tx=0x7f8134009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:22.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 -- 172.21.15.47:0/1626025107 shutdown_connections 2024-02-07T12:38:22.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 --2- 172.21.15.47:0/1626025107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8144101c10 0x7f81440fb2a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 --2- 172.21.15.47:0/1626025107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8144101270 0x7f8144101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 -- 172.21.15.47:0/1626025107 >> 172.21.15.47:0/1626025107 conn(0x7f81440f6de0 msgr2=0x7f81440f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 -- 172.21.15.47:0/1626025107 shutdown_connections 2024-02-07T12:38:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 -- 172.21.15.47:0/1626025107 wait complete. 2024-02-07T12:38:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 Processor -- start 2024-02-07T12:38:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 -- start start 2024-02-07T12:38:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8144101270 0x7f8144112c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8144101c10 0x7f81441131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81441137d0 con 0x7f8144101270 2024-02-07T12:38:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.000+0000 7f814c018640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814410cd60 con 0x7f8144101c10 2024-02-07T12:38:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f8149db4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8144101270 0x7f8144112c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f8149db4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8144101270 0x7f8144112c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51240/0 (socket says 172.21.15.47:51240) 2024-02-07T12:38:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f8149db4640 1 -- 172.21.15.47:0/678379695 learned_addr learned my addr 172.21.15.47:0/678379695 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-02-07T12:38:22.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f81495b3640 1 --2- 172.21.15.47:0/678379695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8144101c10 0x7f81441131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:22.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f8149db4640 1 -- 172.21.15.47:0/678379695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8144101c10 msgr2=0x7f81441131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:22.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f8149db4640 1 --2- 172.21.15.47:0/678379695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8144101c10 0x7f81441131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:22.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f8149db4640 1 -- 172.21.15.47:0/678379695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8134005040 con 0x7f8144101270 2024-02-07T12:38:22.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f81495b3640 1 --2- 172.21.15.47:0/678379695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8144101c10 0x7f81441131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-07T12:38:22.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f8149db4640 1 --2- 172.21.15.47:0/678379695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8144101270 0x7f8144112c90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f813c00c830 tx=0x7f813c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:22.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f813a7fc640 1 -- 172.21.15.47:0/678379695 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f813c00a850 con 0x7f8144101270 2024-02-07T12:38:22.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f814c018640 1 -- 172.21.15.47:0/678379695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814410d040 con 0x7f8144101270 2024-02-07T12:38:22.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f813a7fc640 1 -- 172.21.15.47:0/678379695 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f813c00ae80 con 0x7f8144101270 2024-02-07T12:38:22.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f813a7fc640 1 -- 172.21.15.47:0/678379695 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f813c012ea0 con 0x7f8144101270 2024-02-07T12:38:22.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.001+0000 7f814c018640 1 -- 172.21.15.47:0/678379695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814410d530 con 0x7f8144101270 2024-02-07T12:38:22.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.002+0000 7f814c018640 1 -- 172.21.15.47:0/678379695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8144064480 con 0x7f8144101270 2024-02-07T12:38:22.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.003+0000 7f813a7fc640 1 -- 172.21.15.47:0/678379695 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 40) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f813c012400 con 0x7f8144101270 2024-02-07T12:38:22.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.003+0000 7f813a7fc640 1 --2- 172.21.15.47:0/678379695 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f813006d750 0x7f813006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-07T12:38:22.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.003+0000 7f813a7fc640 1 -- 172.21.15.47:0/678379695 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f813c08d1f0 con 0x7f8144101270 2024-02-07T12:38:22.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.003+0000 7f81495b3640 1 --2- 172.21.15.47:0/678379695 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f813006d750 0x7f813006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-07T12:38:22.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.003+0000 7f81495b3640 1 --2- 172.21.15.47:0/678379695 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f813006d750 0x7f813006fc00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f814410dea0 tx=0x7f8134009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-07T12:38:22.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.007+0000 7f813a7fc640 1 -- 172.21.15.47:0/678379695 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f813c056a10 con 0x7f8144101270 2024-02-07T12:38:22.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.200+0000 7f814c018640 1 -- 172.21.15.47:0/678379695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f814410e3a0 con 0x7f8144101270 2024-02-07T12:38:22.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.200+0000 7f813a7fc640 1 -- 172.21.15.47:0/678379695 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v86) v1 ==== 81+0+2429 (secure 0 0 0) 0x7f813c0126b0 con 0x7f8144101270 2024-02-07T12:38:22.202 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6829/3387805936 2024-02-08T12:34:03.468583+0000 2024-02-07T12:38:22.203 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6828/3387805936 2024-02-08T12:34:03.468583+0000 2024-02-07T12:38:22.203 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6826/3633114050 2024-02-08T12:33:37.430656+0000 2024-02-07T12:38:22.203 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:6828/764872550 2024-02-08T12:27:38.822990+0000 2024-02-07T12:38:22.203 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:0/2878954883 2024-02-08T12:27:38.822990+0000 2024-02-07T12:38:22.203 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/2175635831 2024-02-08T12:17:02.806879+0000 2024-02-07T12:38:22.203 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:6829/764872550 2024-02-08T12:27:38.822990+0000 2024-02-07T12:38:22.203 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6827/3633114050 2024-02-08T12:33:37.430656+0000 2024-02-07T12:38:22.203 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/3304641630 2024-02-08T12:18:06.849658+0000 2024-02-07T12:38:22.203 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/926338889 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:22.203 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/1918664197 2024-02-08T12:17:02.806879+0000 2024-02-07T12:38:22.203 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:6825/2917636817 2024-02-08T12:23:08.319154+0000 2024-02-07T12:38:22.203 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/179765176 2024-02-08T12:25:32.261341+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/1750591204 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/454079597 2024-02-08T12:18:06.849658+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/3304641630 2024-02-08T12:18:06.849658+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3361862950 2024-02-08T12:17:02.806879+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/15111993 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/2169341238 2024-02-08T12:16:30.972957+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:0/476867914 2024-02-08T12:27:38.822990+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:0/2680943285 2024-02-08T12:27:38.822990+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/2169341238 2024-02-08T12:16:30.972957+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2651788466 2024-02-08T12:25:32.261341+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3354208208 2024-02-08T12:16:30.972957+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:0/722341446 2024-02-08T12:27:38.822990+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3586302931 2024-02-08T12:17:02.806879+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.138:6824/2917636817 2024-02-08T12:23:08.319154+0000 2024-02-07T12:38:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3413297119 2024-02-08T12:16:30.972957+0000 2024-02-07T12:38:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2768201708 2024-02-08T12:16:30.972957+0000 2024-02-07T12:38:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/3356603129 2024-02-08T12:25:32.261341+0000 2024-02-07T12:38:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/3356603129 2024-02-08T12:25:32.261341+0000 2024-02-07T12:38:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/1415322117 2024-02-08T12:18:06.849658+0000 2024-02-07T12:38:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2757370866 2024-02-08T12:18:06.849658+0000 2024-02-07T12:38:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3785090733 2024-02-08T12:25:32.261341+0000 2024-02-07T12:38:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/1926405874 2024-02-08T12:25:32.261341+0000 2024-02-07T12:38:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2678703901 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/831612230 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2545215659 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/520417272 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/2175635831 2024-02-08T12:17:02.806879+0000 2024-02-07T12:38:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/1750591204 2024-02-08T12:28:26.591613+0000 2024-02-07T12:38:22.206 INFO:teuthology.orchestra.run.smithi047.stderr:listed 41 entries 2024-02-07T12:38:22.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.202+0000 7f814c018640 1 -- 172.21.15.47:0/678379695 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f813006d750 msgr2=0x7f813006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:22.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.202+0000 7f814c018640 1 --2- 172.21.15.47:0/678379695 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f813006d750 0x7f813006fc00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f814410dea0 tx=0x7f8134009da0 comp rx=0 tx=0).stop 2024-02-07T12:38:22.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.202+0000 7f814c018640 1 -- 172.21.15.47:0/678379695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8144101270 msgr2=0x7f8144112c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-07T12:38:22.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.202+0000 7f814c018640 1 --2- 172.21.15.47:0/678379695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8144101270 0x7f8144112c90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f813c00c830 tx=0x7f813c004430 comp rx=0 tx=0).stop 2024-02-07T12:38:22.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.203+0000 7f814c018640 1 -- 172.21.15.47:0/678379695 shutdown_connections 2024-02-07T12:38:22.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.203+0000 7f814c018640 1 --2- 172.21.15.47:0/678379695 >> [v2:172.21.15.47:6800/4013730885,v1:172.21.15.47:6801/4013730885] conn(0x7f813006d750 0x7f813006fc00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:22.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.203+0000 7f814c018640 1 --2- 172.21.15.47:0/678379695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8144101c10 0x7f81441131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:22.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.203+0000 7f814c018640 1 --2- 172.21.15.47:0/678379695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8144101270 0x7f8144112c90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-07T12:38:22.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.203+0000 7f814c018640 1 -- 172.21.15.47:0/678379695 >> 172.21.15.47:0/678379695 conn(0x7f81440f6de0 msgr2=0x7f81440656b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-07T12:38:22.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.203+0000 7f814c018640 1 -- 172.21.15.47:0/678379695 shutdown_connections 2024-02-07T12:38:22.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-02-07T12:38:22.203+0000 7f814c018640 1 -- 172.21.15.47:0/678379695 wait complete. 2024-02-07T12:38:22.215 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-07T12:38:22.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:38:22.216 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-07T12:38:22.251 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2024-02-07T12:38:22.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:38:22.252 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-07T12:38:22.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:38:22.399 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-02-07T12:38:22.414 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-07T12:38:22.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:38:22.414 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-07T12:38:22.477 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:22 smithi047 ceph-mon[93224]: pgmap v336: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-07T12:38:22.478 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:22 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/3408488640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-07T12:38:22.478 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:22 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/1891162413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-07T12:38:22.478 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:22 smithi047 ceph-mon[93224]: from='client.? 172.21.15.47:0/678379695' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-07T12:38:22.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:38:22.481 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-02-07T12:38:22.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:22 smithi138 ceph-mon[82055]: pgmap v336: 65 pgs: 65 active+clean; 178 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-07T12:38:22.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:22 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/3408488640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-07T12:38:22.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:22 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/1891162413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-07T12:38:22.534 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:22 smithi138 ceph-mon[82055]: from='client.? 172.21.15.47:0/678379695' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-07T12:38:22.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:38:22.577 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-02-07T12:38:22.595 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-07T12:38:22.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:38:22.596 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-07T12:38:22.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-07T12:38:22.667 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2024-02-07T12:38:22.767 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-07T12:38:22.778 INFO:tasks.cephadm:Teardown begin 2024-02-07T12:38:22.778 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-07T12:38:22.808 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-07T12:38:22.837 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-07T12:38:22.838 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-07T12:38:22.862 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-07T12:38:22.893 INFO:tasks.cephadm:Stopping all daemons... 2024-02-07T12:38:22.893 INFO:tasks.cephadm.mon.smithi047:Stopping mon.smithi047... 2024-02-07T12:38:22.894 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi047 2024-02-07T12:38:23.075 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:22 smithi047 systemd[1]: Stopping Ceph mon.smithi047 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:38:23.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:23 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047[93220]: 2024-02-07T12:38:23.187+0000 7fb48cd14700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi047 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:38:23.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:23 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047[93220]: 2024-02-07T12:38:23.187+0000 7fb48cd14700 -1 mon.smithi047@0(leader) e3 *** Got Signal Terminated *** 2024-02-07T12:38:23.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:23 smithi047 podman[149149]: 2024-02-07 12:38:23.320191261 +0000 UTC m=+0.236255830 container died 70d584f39f5c3fec0c49465c79396d24379bad6763ffca5cc4e18fcf3a2fe5cb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-02-07T12:38:23.941 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:23 smithi047 podman[149149]: 2024-02-07 12:38:23.704557561 +0000 UTC m=+0.620622129 container cleanup 70d584f39f5c3fec0c49465c79396d24379bad6763ffca5cc4e18fcf3a2fe5cb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-02-07T12:38:23.941 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Feb 07 12:38:23 smithi047 bash[149149]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi047 2024-02-07T12:38:24.078 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi047.service' 2024-02-07T12:38:24.125 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-07T12:38:24.125 INFO:tasks.cephadm.mon.smithi047:Stopped mon.smithi047 2024-02-07T12:38:24.125 INFO:tasks.cephadm.mon.smithi138:Stopping mon.smithi138... 2024-02-07T12:38:24.126 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi138 2024-02-07T12:38:24.419 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:24 smithi138 systemd[1]: Stopping Ceph mon.smithi138 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:38:24.744 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:24 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138[82051]: 2024-02-07T12:38:24.416+0000 7f7b38d54700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi138 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:38:24.744 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:24 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138[82051]: 2024-02-07T12:38:24.416+0000 7f7b38d54700 -1 mon.smithi138@1(peon) e3 *** Got Signal Terminated *** 2024-02-07T12:38:24.744 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:24 smithi138 podman[118639]: 2024-02-07 12:38:24.488173854 +0000 UTC m=+0.168966484 container died 14527280e47ecbba63ec8eeae27ee403f2683b1754ef0de255c3d9a359f061a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, io.buildah.version=1.33.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-02-07T12:38:25.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:24 smithi138 podman[118639]: 2024-02-07 12:38:24.933607584 +0000 UTC m=+0.614400233 container cleanup 14527280e47ecbba63ec8eeae27ee403f2683b1754ef0de255c3d9a359f061a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:38:25.035 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:24 smithi138 bash[118639]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138 2024-02-07T12:38:25.351 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi138.service' 2024-02-07T12:38:25.375 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:25 smithi138 podman[118653]: 2024-02-07 12:38:25.110229566 +0000 UTC m=+0.614307265 container remove 14527280e47ecbba63ec8eeae27ee403f2683b1754ef0de255c3d9a359f061a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-mon-smithi138, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131) 2024-02-07T12:38:25.375 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:25 smithi138 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi138.service: Deactivated successfully. 2024-02-07T12:38:25.375 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:25 smithi138 systemd[1]: Stopped Ceph mon.smithi138 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:38:25.375 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 07 12:38:25 smithi138 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@mon.smithi138.service: Consumed 5.482s CPU time. 2024-02-07T12:38:25.405 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-07T12:38:25.405 INFO:tasks.cephadm.mon.smithi138:Stopped mon.smithi138 2024-02-07T12:38:25.405 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-07T12:38:25.405 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.0 2024-02-07T12:38:25.727 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:25 smithi047 systemd[1]: Stopping Ceph osd.0 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:38:26.075 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:25 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0[102075]: 2024-02-07T12:38:25.725+0000 7f6bf6349700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:38:26.075 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:25 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0[102075]: 2024-02-07T12:38:25.725+0000 7f6bf6349700 -1 osd.0 86 *** Got signal Terminated *** 2024-02-07T12:38:26.075 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:25 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0[102075]: 2024-02-07T12:38:25.725+0000 7f6bf6349700 -1 osd.0 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-07T12:38:31.545 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:31 smithi047 podman[149279]: 2024-02-07 12:38:31.251169739 +0000 UTC m=+5.653007946 container died e26f0405946059f5d59e6b38fb4761037b9c26e781a57291e3d29048c76b2ee6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131) 2024-02-07T12:38:31.825 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:31 smithi047 podman[149279]: 2024-02-07 12:38:31.642388882 +0000 UTC m=+6.044227090 container cleanup e26f0405946059f5d59e6b38fb4761037b9c26e781a57291e3d29048c76b2ee6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=) 2024-02-07T12:38:31.825 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:31 smithi047 bash[149279]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0 2024-02-07T12:38:32.305 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:31 smithi047 podman[149296]: 2024-02-07 12:38:31.952607898 +0000 UTC m=+0.695494310 container remove e26f0405946059f5d59e6b38fb4761037b9c26e781a57291e3d29048c76b2ee6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-07T12:38:32.575 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:32 smithi047 podman[149390]: 2024-02-07 12:38:32.30392223 +0000 UTC m=+0.103620912 container create 7687f7092d9f296c1ef66f3e6432e6968608dd9f3ed27a06d3e82d0b159eea52 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2) 2024-02-07T12:38:32.576 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:32 smithi047 podman[149390]: 2024-02-07 12:38:32.21852532 +0000 UTC m=+0.018223957 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:38:32.576 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:32 smithi047 podman[149390]: 2024-02-07 12:38:32.548333953 +0000 UTC m=+0.348032604 container init 7687f7092d9f296c1ef66f3e6432e6968608dd9f3ed27a06d3e82d0b159eea52 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2) 2024-02-07T12:38:32.576 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:32 smithi047 podman[149390]: 2024-02-07 12:38:32.551780894 +0000 UTC m=+0.351479537 container start 7687f7092d9f296c1ef66f3e6432e6968608dd9f3ed27a06d3e82d0b159eea52 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-02-07T12:38:32.854 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:32 smithi047 podman[149390]: 2024-02-07 12:38:32.639924658 +0000 UTC m=+0.439623304 container attach 7687f7092d9f296c1ef66f3e6432e6968608dd9f3ed27a06d3e82d0b159eea52 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-02-07T12:38:33.187 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:32 smithi047 podman[149390]: 2024-02-07 12:38:32.852704354 +0000 UTC m=+0.652402998 container died 7687f7092d9f296c1ef66f3e6432e6968608dd9f3ed27a06d3e82d0b159eea52 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-07T12:38:33.415 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.0.service' 2024-02-07T12:38:33.441 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:33 smithi047 podman[149416]: 2024-02-07 12:38:33.393698246 +0000 UTC m=+0.533041205 container remove 7687f7092d9f296c1ef66f3e6432e6968608dd9f3ed27a06d3e82d0b159eea52 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-02-07T12:38:33.441 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:33 smithi047 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.0.service: Deactivated successfully. 2024-02-07T12:38:33.442 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:33 smithi047 systemd[1]: Stopped Ceph osd.0 for 818049ec-c5b2-11ee-95b6-87774f69a715. 2024-02-07T12:38:33.442 INFO:journalctl@ceph.osd.0.smithi047.stdout:Feb 07 12:38:33 smithi047 systemd[1]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.0.service: Consumed 7.899s CPU time. 2024-02-07T12:38:33.459 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-07T12:38:33.459 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-07T12:38:33.459 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-07T12:38:33.459 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.1 2024-02-07T12:38:33.693 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:33 smithi047 systemd[1]: Stopping Ceph osd.1 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:38:34.075 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:33 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1[107646]: 2024-02-07T12:38:33.822+0000 7f4ee9820700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:38:34.075 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:33 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1[107646]: 2024-02-07T12:38:33.822+0000 7f4ee9820700 -1 osd.1 86 *** Got signal Terminated *** 2024-02-07T12:38:34.075 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:33 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1[107646]: 2024-02-07T12:38:33.822+0000 7f4ee9820700 -1 osd.1 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-07T12:38:39.642 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:39 smithi047 podman[149496]: 2024-02-07 12:38:39.333925731 +0000 UTC m=+5.634964570 container died 0f2b0eea74d7e041145a773fa3fd1e6e6058950b56e58fc80efa545c5d7f9aa3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1, GIT_CLEAN=True, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:38:40.075 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:39 smithi047 podman[149496]: 2024-02-07 12:38:39.847711125 +0000 UTC m=+6.148750006 container cleanup 0f2b0eea74d7e041145a773fa3fd1e6e6058950b56e58fc80efa545c5d7f9aa3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux ) 2024-02-07T12:38:40.076 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:39 smithi047 bash[149496]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1 2024-02-07T12:38:40.461 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:40 smithi047 podman[149526]: 2024-02-07 12:38:40.107820776 +0000 UTC m=+0.769569715 container remove 0f2b0eea74d7e041145a773fa3fd1e6e6058950b56e58fc80efa545c5d7f9aa3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.build-date=20240131, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-02-07T12:38:40.796 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:40 smithi047 podman[149618]: 2024-02-07 12:38:40.362431006 +0000 UTC m=+0.018397623 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:38:40.796 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:40 smithi047 podman[149618]: 2024-02-07 12:38:40.483683405 +0000 UTC m=+0.139650020 container create 571ea346d2dfaf497688b87ff785046c54d3736363764bd7a38bf50e4057c44d (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-02-07T12:38:40.797 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:40 smithi047 podman[149618]: 2024-02-07 12:38:40.703923227 +0000 UTC m=+0.359889846 container init 571ea346d2dfaf497688b87ff785046c54d3736363764bd7a38bf50e4057c44d (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2) 2024-02-07T12:38:40.797 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:40 smithi047 podman[149618]: 2024-02-07 12:38:40.707627759 +0000 UTC m=+0.363594384 container start 571ea346d2dfaf497688b87ff785046c54d3736363764bd7a38bf50e4057c44d (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-07T12:38:40.797 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:40 smithi047 podman[149618]: 2024-02-07 12:38:40.794959666 +0000 UTC m=+0.450926303 container attach 571ea346d2dfaf497688b87ff785046c54d3736363764bd7a38bf50e4057c44d (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2) 2024-02-07T12:38:41.075 INFO:journalctl@ceph.osd.1.smithi047.stdout:Feb 07 12:38:41 smithi047 podman[149618]: 2024-02-07 12:38:41.009116791 +0000 UTC m=+0.665083408 container died 571ea346d2dfaf497688b87ff785046c54d3736363764bd7a38bf50e4057c44d (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-07T12:38:41.734 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.1.service' 2024-02-07T12:38:41.782 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-07T12:38:41.782 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-07T12:38:41.782 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-07T12:38:41.782 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.2 2024-02-07T12:38:42.075 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:41 smithi047 systemd[1]: Stopping Ceph osd.2 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:38:42.575 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:42 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2[113316]: 2024-02-07T12:38:42.084+0000 7fa3fa488700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:38:42.575 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:42 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2[113316]: 2024-02-07T12:38:42.084+0000 7fa3fa488700 -1 osd.2 86 *** Got signal Terminated *** 2024-02-07T12:38:42.575 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:42 smithi047 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2[113316]: 2024-02-07T12:38:42.084+0000 7fa3fa488700 -1 osd.2 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-07T12:38:47.820 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:47 smithi047 podman[149722]: 2024-02-07 12:38:47.549728315 +0000 UTC m=+5.582491877 container died 0b8c7834634693c9898c8976ac54825ebed2f0e5ca1bf68d15e517286bdcc5fb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:38:48.075 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:48 smithi047 podman[149722]: 2024-02-07 12:38:48.029538055 +0000 UTC m=+6.062301614 container cleanup 0b8c7834634693c9898c8976ac54825ebed2f0e5ca1bf68d15e517286bdcc5fb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-02-07T12:38:48.075 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:48 smithi047 bash[149722]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2 2024-02-07T12:38:48.575 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:48 smithi047 podman[149751]: 2024-02-07 12:38:48.289329053 +0000 UTC m=+0.743994723 container remove 0b8c7834634693c9898c8976ac54825ebed2f0e5ca1bf68d15e517286bdcc5fb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True) 2024-02-07T12:38:48.952 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:48 smithi047 podman[149844]: 2024-02-07 12:38:48.553631157 +0000 UTC m=+0.018063810 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:38:48.952 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:48 smithi047 podman[149844]: 2024-02-07 12:38:48.673551178 +0000 UTC m=+0.137983819 container create d9672dc8f9792e3ac44bba8f2a664dd2d2261a2e4f827532fdb796e7a50c0954 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=) 2024-02-07T12:38:48.952 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:48 smithi047 podman[149844]: 2024-02-07 12:38:48.875872569 +0000 UTC m=+0.340305211 container init d9672dc8f9792e3ac44bba8f2a664dd2d2261a2e4f827532fdb796e7a50c0954 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc) 2024-02-07T12:38:48.952 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:48 smithi047 podman[149844]: 2024-02-07 12:38:48.878995286 +0000 UTC m=+0.343427928 container start d9672dc8f9792e3ac44bba8f2a664dd2d2261a2e4f827532fdb796e7a50c0954 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:38:48.953 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:48 smithi047 podman[149844]: 2024-02-07 12:38:48.950874637 +0000 UTC m=+0.415307281 container attach d9672dc8f9792e3ac44bba8f2a664dd2d2261a2e4f827532fdb796e7a50c0954 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.2) 2024-02-07T12:38:49.325 INFO:journalctl@ceph.osd.2.smithi047.stdout:Feb 07 12:38:49 smithi047 podman[149844]: 2024-02-07 12:38:49.17802852 +0000 UTC m=+0.642461170 container died d9672dc8f9792e3ac44bba8f2a664dd2d2261a2e4f827532fdb796e7a50c0954 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.2) 2024-02-07T12:38:49.797 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.2.service' 2024-02-07T12:38:49.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-07T12:38:49.842 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-07T12:38:49.842 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-07T12:38:49.842 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.3 2024-02-07T12:38:50.146 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:49 smithi138 systemd[1]: Stopping Ceph osd.3 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:38:50.534 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:50 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[91454]: 2024-02-07T12:38:50.143+0000 7f54e1c17700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:38:50.534 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:50 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[91454]: 2024-02-07T12:38:50.143+0000 7f54e1c17700 -1 osd.3 86 *** Got signal Terminated *** 2024-02-07T12:38:50.534 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:50 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[91454]: 2024-02-07T12:38:50.143+0000 7f54e1c17700 -1 osd.3 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-07T12:38:52.784 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:38:52 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:38:52.556+0000 7ff86a24a700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.230400+0000 front 2024-02-07T12:38:28.230446+0000 (oldest deadline 2024-02-07T12:38:51.730228+0000) 2024-02-07T12:38:53.284 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:53 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[91454]: 2024-02-07T12:38:53.006+0000 7f54daa0b700 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:26.594210+0000 front 2024-02-07T12:38:26.594230+0000 (oldest deadline 2024-02-07T12:38:52.494209+0000) 2024-02-07T12:38:53.784 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:38:53 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:38:53.525+0000 7ff86a24a700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.230400+0000 front 2024-02-07T12:38:28.230446+0000 (oldest deadline 2024-02-07T12:38:51.730228+0000) 2024-02-07T12:38:54.284 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:54 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[91454]: 2024-02-07T12:38:54.015+0000 7f54daa0b700 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:26.594210+0000 front 2024-02-07T12:38:26.594230+0000 (oldest deadline 2024-02-07T12:38:52.494209+0000) 2024-02-07T12:38:54.731 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:38:54 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:38:54.477+0000 7ff86a24a700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.230400+0000 front 2024-02-07T12:38:28.230446+0000 (oldest deadline 2024-02-07T12:38:51.730228+0000) 2024-02-07T12:38:54.992 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:38:54 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:38:54.728+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:38:55.284 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:54 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3[91454]: 2024-02-07T12:38:54.990+0000 7f54daa0b700 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:26.594210+0000 front 2024-02-07T12:38:26.594230+0000 (oldest deadline 2024-02-07T12:38:52.494209+0000) 2024-02-07T12:38:55.785 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:55 smithi138 podman[118762]: 2024-02-07 12:38:55.668380877 +0000 UTC m=+5.632327987 container died dea45db021dbdab238a0f0481ed3a261aa8dafc015aa2846a9f9a99fbbe91eb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-07T12:38:55.785 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:38:55 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:38:55.462+0000 7ff86a24a700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.230400+0000 front 2024-02-07T12:38:28.230446+0000 (oldest deadline 2024-02-07T12:38:51.730228+0000) 2024-02-07T12:38:55.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:38:55 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:38:55.681+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:38:56.284 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:56 smithi138 podman[118762]: 2024-02-07 12:38:56.036681271 +0000 UTC m=+6.000628384 container cleanup dea45db021dbdab238a0f0481ed3a261aa8dafc015aa2846a9f9a99fbbe91eb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0) 2024-02-07T12:38:56.284 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:56 smithi138 bash[118762]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3 2024-02-07T12:38:56.649 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:56 smithi138 podman[118791]: 2024-02-07 12:38:56.321739018 +0000 UTC m=+0.648424580 container remove dea45db021dbdab238a0f0481ed3a261aa8dafc015aa2846a9f9a99fbbe91eb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240131) 2024-02-07T12:38:56.649 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:38:56 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:38:56.466+0000 7ff86a24a700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.230400+0000 front 2024-02-07T12:38:28.230446+0000 (oldest deadline 2024-02-07T12:38:51.730228+0000) 2024-02-07T12:38:56.985 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:38:56 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:38:56.694+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:38:56.985 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:56 smithi138 podman[118885]: 2024-02-07 12:38:56.647607277 +0000 UTC m=+0.114617217 container create c21a6e44749622834bad754cee97c5a8bd3a02fea14e770de48836a8dd706ccb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-02-07T12:38:56.985 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:56 smithi138 podman[118885]: 2024-02-07 12:38:56.55211318 +0000 UTC m=+0.019123127 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:38:56.986 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:56 smithi138 podman[118885]: 2024-02-07 12:38:56.88396947 +0000 UTC m=+0.350979412 container init c21a6e44749622834bad754cee97c5a8bd3a02fea14e770de48836a8dd706ccb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-02-07T12:38:56.986 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:56 smithi138 podman[118885]: 2024-02-07 12:38:56.887139227 +0000 UTC m=+0.354149184 container start c21a6e44749622834bad754cee97c5a8bd3a02fea14e770de48836a8dd706ccb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:38:56.986 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:56 smithi138 podman[118885]: 2024-02-07 12:38:56.984037458 +0000 UTC m=+0.451047425 container attach c21a6e44749622834bad754cee97c5a8bd3a02fea14e770de48836a8dd706ccb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:38:57.284 INFO:journalctl@ceph.osd.3.smithi138.stdout:Feb 07 12:38:57 smithi138 podman[118885]: 2024-02-07 12:38:57.178098958 +0000 UTC m=+0.645108891 container died c21a6e44749622834bad754cee97c5a8bd3a02fea14e770de48836a8dd706ccb (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, ceph=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS) 2024-02-07T12:38:57.784 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:38:57 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:38:57.487+0000 7ff86a24a700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.230400+0000 front 2024-02-07T12:38:28.230446+0000 (oldest deadline 2024-02-07T12:38:51.730228+0000) 2024-02-07T12:38:57.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:38:57 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:38:57.674+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:38:57.814 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.3.service' 2024-02-07T12:38:57.857 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-07T12:38:57.857 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-07T12:38:57.857 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-07T12:38:57.857 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.4 2024-02-07T12:38:58.185 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:38:57 smithi138 systemd[1]: Stopping Ceph osd.4 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:38:58.516 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:38:58 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:38:58.183+0000 7ff86d44e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:38:58.516 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:38:58 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:38:58.183+0000 7ff86d44e700 -1 osd.4 86 *** Got signal Terminated *** 2024-02-07T12:38:58.516 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:38:58 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:38:58.183+0000 7ff86d44e700 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-07T12:38:58.784 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:38:58 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:38:58.514+0000 7ff86a24a700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.230400+0000 front 2024-02-07T12:38:28.230446+0000 (oldest deadline 2024-02-07T12:38:51.730228+0000) 2024-02-07T12:38:58.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:38:58 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:38:58.629+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:39:00.035 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:38:59 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:38:59.612+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:39:00.035 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:38:59 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:38:59.559+0000 7ff86a24a700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.230400+0000 front 2024-02-07T12:38:28.230446+0000 (oldest deadline 2024-02-07T12:38:51.730228+0000) 2024-02-07T12:39:00.784 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:00 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:39:00.523+0000 7ff86a24a700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.230400+0000 front 2024-02-07T12:38:28.230446+0000 (oldest deadline 2024-02-07T12:38:51.730228+0000) 2024-02-07T12:39:00.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:00 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:00.581+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:39:01.784 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:01 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:39:01.493+0000 7ff86a24a700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.230400+0000 front 2024-02-07T12:38:28.230446+0000 (oldest deadline 2024-02-07T12:38:51.730228+0000) 2024-02-07T12:39:01.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:01 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:01.622+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:39:01.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:01 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:01.622+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6814 osd.1 since back 2024-02-07T12:38:34.124754+0000 front 2024-02-07T12:38:34.124890+0000 (oldest deadline 2024-02-07T12:39:01.125195+0000) 2024-02-07T12:39:02.784 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:02 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:02.581+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:39:02.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:02 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:02.581+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6814 osd.1 since back 2024-02-07T12:38:34.124754+0000 front 2024-02-07T12:38:34.124890+0000 (oldest deadline 2024-02-07T12:39:01.125195+0000) 2024-02-07T12:39:02.785 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:02 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:39:02.451+0000 7ff86a24a700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.230400+0000 front 2024-02-07T12:38:28.230446+0000 (oldest deadline 2024-02-07T12:38:51.730228+0000) 2024-02-07T12:39:02.785 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:02 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4[96635]: 2024-02-07T12:39:02.451+0000 7ff86a24a700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.47:6814 osd.1 since back 2024-02-07T12:38:35.731474+0000 front 2024-02-07T12:38:35.731513+0000 (oldest deadline 2024-02-07T12:39:02.131814+0000) 2024-02-07T12:39:03.784 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:03 smithi138 podman[118991]: 2024-02-07 12:39:03.51561344 +0000 UTC m=+5.434048192 container died 3161c1dfe6f59e92e2568ec0d4c3daba2a30a18f917e24c56767418a0266b961 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-02-07T12:39:03.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:03 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:03.542+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:39:03.785 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:03 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:03.542+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6814 osd.1 since back 2024-02-07T12:38:34.124754+0000 front 2024-02-07T12:38:34.124890+0000 (oldest deadline 2024-02-07T12:39:01.125195+0000) 2024-02-07T12:39:04.284 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:03 smithi138 podman[118991]: 2024-02-07 12:39:03.808349408 +0000 UTC m=+5.726784159 container cleanup 3161c1dfe6f59e92e2568ec0d4c3daba2a30a18f917e24c56767418a0266b961 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc) 2024-02-07T12:39:04.284 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:03 smithi138 bash[118991]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4 2024-02-07T12:39:04.284 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:04 smithi138 podman[119008]: 2024-02-07 12:39:04.026418671 +0000 UTC m=+0.506875835 container remove 3161c1dfe6f59e92e2568ec0d4c3daba2a30a18f917e24c56767418a0266b961 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2) 2024-02-07T12:39:04.690 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:04 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:04.531+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:39:04.690 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:04 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:04.532+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6814 osd.1 since back 2024-02-07T12:38:34.124754+0000 front 2024-02-07T12:38:34.124890+0000 (oldest deadline 2024-02-07T12:39:01.125195+0000) 2024-02-07T12:39:04.690 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:04 smithi138 podman[119097]: 2024-02-07 12:39:04.323908676 +0000 UTC m=+0.017827751 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:39:04.690 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:04 smithi138 podman[119097]: 2024-02-07 12:39:04.427462382 +0000 UTC m=+0.121381457 container create 9445f0915c54d4d9f35f734fe9eba59421a9ecfc8209671e4d4269c2d434ab43 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-02-07T12:39:04.690 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:04 smithi138 podman[119097]: 2024-02-07 12:39:04.629980039 +0000 UTC m=+0.323899113 container init 9445f0915c54d4d9f35f734fe9eba59421a9ecfc8209671e4d4269c2d434ab43 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-02-07T12:39:04.690 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:04 smithi138 podman[119097]: 2024-02-07 12:39:04.633162477 +0000 UTC m=+0.327081555 container start 9445f0915c54d4d9f35f734fe9eba59421a9ecfc8209671e4d4269c2d434ab43 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-07T12:39:04.690 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:04 smithi138 podman[119097]: 2024-02-07 12:39:04.688266387 +0000 UTC m=+0.382185470 container attach 9445f0915c54d4d9f35f734fe9eba59421a9ecfc8209671e4d4269c2d434ab43 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-07T12:39:05.034 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:04 smithi138 podman[119097]: 2024-02-07 12:39:04.931352354 +0000 UTC m=+0.625271429 container died 9445f0915c54d4d9f35f734fe9eba59421a9ecfc8209671e4d4269c2d434ab43 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131) 2024-02-07T12:39:05.478 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 07 12:39:05 smithi138 podman[119123]: 2024-02-07 12:39:05.458862907 +0000 UTC m=+0.522469928 container remove 9445f0915c54d4d9f35f734fe9eba59421a9ecfc8209671e4d4269c2d434ab43 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-4-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-07T12:39:05.483 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.4.service' 2024-02-07T12:39:05.524 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-07T12:39:05.524 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-07T12:39:05.524 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-07T12:39:05.524 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.5 2024-02-07T12:39:05.784 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:05 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:05.524+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:39:05.784 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:05 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:05.524+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6814 osd.1 since back 2024-02-07T12:38:34.124754+0000 front 2024-02-07T12:38:34.124890+0000 (oldest deadline 2024-02-07T12:39:01.125195+0000) 2024-02-07T12:39:05.784 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:05 smithi138 systemd[1]: Stopping Ceph osd.5 for 818049ec-c5b2-11ee-95b6-87774f69a715... 2024-02-07T12:39:06.284 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:05 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:05.861+0000 7f209c4b0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-07T12:39:06.284 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:05 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:05.861+0000 7f209c4b0700 -1 osd.5 86 *** Got signal Terminated *** 2024-02-07T12:39:06.284 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:05 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:05.861+0000 7f209c4b0700 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-07T12:39:06.784 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:06 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:06.515+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:39:06.784 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:06 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:06.515+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6814 osd.1 since back 2024-02-07T12:38:34.124754+0000 front 2024-02-07T12:38:34.124890+0000 (oldest deadline 2024-02-07T12:39:01.125195+0000) 2024-02-07T12:39:07.784 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:07 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:07.524+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:39:07.784 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:07 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:07.524+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6814 osd.1 since back 2024-02-07T12:38:34.124754+0000 front 2024-02-07T12:38:34.124890+0000 (oldest deadline 2024-02-07T12:39:01.125195+0000) 2024-02-07T12:39:09.034 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:08 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:08.571+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:39:09.035 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:08 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:08.571+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6814 osd.1 since back 2024-02-07T12:38:34.124754+0000 front 2024-02-07T12:38:34.124890+0000 (oldest deadline 2024-02-07T12:39:01.125195+0000) 2024-02-07T12:39:10.035 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:09 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:09.587+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:39:10.035 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:09 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:09.587+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6814 osd.1 since back 2024-02-07T12:38:34.124754+0000 front 2024-02-07T12:38:34.124890+0000 (oldest deadline 2024-02-07T12:39:01.125195+0000) 2024-02-07T12:39:11.034 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:10 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:10.607+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-02-07T12:38:28.224443+0000 front 2024-02-07T12:38:28.224511+0000 (oldest deadline 2024-02-07T12:38:54.124338+0000) 2024-02-07T12:39:11.035 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:10 smithi138 ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5[101940]: 2024-02-07T12:39:10.607+0000 7f20992ac700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.47:6814 osd.1 since back 2024-02-07T12:38:34.124754+0000 front 2024-02-07T12:38:34.124890+0000 (oldest deadline 2024-02-07T12:39:01.125195+0000) 2024-02-07T12:39:11.631 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:11 smithi138 podman[119202]: 2024-02-07 12:39:11.369912388 +0000 UTC m=+5.634798795 container died c9504c7cfe7c8123281c5f07392029e944819c44987c4f249ce19d5ddc035891 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, ceph=True, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, io.buildah.version=1.33.2) 2024-02-07T12:39:11.889 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:11 smithi138 podman[119202]: 2024-02-07 12:39:11.720055411 +0000 UTC m=+5.984941816 container cleanup c9504c7cfe7c8123281c5f07392029e944819c44987c4f249ce19d5ddc035891 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, io.buildah.version=1.33.2) 2024-02-07T12:39:11.889 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:11 smithi138 bash[119202]: ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5 2024-02-07T12:39:12.284 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:11 smithi138 podman[119217]: 2024-02-07 12:39:11.88781278 +0000 UTC m=+0.511110880 container remove c9504c7cfe7c8123281c5f07392029e944819c44987c4f249ce19d5ddc035891 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-07T12:39:12.610 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:12 smithi138 podman[119304]: 2024-02-07 12:39:12.230553754 +0000 UTC m=+0.017435229 image pull 79957b3723074dc4d7b43e7345862a464daec6a6b69febcfe25c399b70e0301f quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe 2024-02-07T12:39:12.610 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:12 smithi138 podman[119304]: 2024-02-07 12:39:12.347256428 +0000 UTC m=+0.134137945 container create 598aa05d73062c86f9c6180c2a656c69b81426564c75361cd0cf4b20c17c2427 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, GIT_BRANCH=HEAD) 2024-02-07T12:39:12.610 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:12 smithi138 podman[119304]: 2024-02-07 12:39:12.533220926 +0000 UTC m=+0.320102401 container init 598aa05d73062c86f9c6180c2a656c69b81426564c75361cd0cf4b20c17c2427 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-02-07T12:39:12.610 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:12 smithi138 podman[119304]: 2024-02-07 12:39:12.536408813 +0000 UTC m=+0.323290291 container start 598aa05d73062c86f9c6180c2a656c69b81426564c75361cd0cf4b20c17c2427 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-07T12:39:12.610 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:12 smithi138 podman[119304]: 2024-02-07 12:39:12.608263152 +0000 UTC m=+0.395144630 container attach 598aa05d73062c86f9c6180c2a656c69b81426564c75361cd0cf4b20c17c2427 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131) 2024-02-07T12:39:13.034 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 07 12:39:12 smithi138 podman[119304]: 2024-02-07 12:39:12.823972402 +0000 UTC m=+0.610853882 container died 598aa05d73062c86f9c6180c2a656c69b81426564c75361cd0cf4b20c17c2427 (image=quay.ceph.io/ceph-ci/ceph@sha256:c53d1d048facb107ddbb5178fea4d5ae496b0f9f9f34c5f63d4bece0be7a8bbe, name=ceph-818049ec-c5b2-11ee-95b6-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-4-2024-02-05-1854-44458cc, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-02-07T12:39:13.411 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-818049ec-c5b2-11ee-95b6-87774f69a715@osd.5.service' 2024-02-07T12:39:13.452 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-07T12:39:13.452 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-07T12:39:13.452 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 --force --keep-logs 2024-02-07T12:39:35.206 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 --force --keep-logs 2024-02-07T12:39:50.394 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-07T12:39:50.429 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-07T12:39:50.458 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-07T12:39:50.460 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/crash to /home/teuthworker/archive/gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi/7548724/remote/smithi047/crash 2024-02-07T12:39:50.461 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/crash -- . 2024-02-07T12:39:50.500 INFO:teuthology.orchestra.run.smithi047.stderr:tar: /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/crash: Cannot open: No such file or directory 2024-02-07T12:39:50.500 INFO:teuthology.orchestra.run.smithi047.stderr:tar: Error is not recoverable: exiting now 2024-02-07T12:39:50.502 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/crash to /home/teuthworker/archive/gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi/7548724/remote/smithi138/crash 2024-02-07T12:39:50.503 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/crash -- . 2024-02-07T12:39:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:tar: /var/lib/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/crash: Cannot open: No such file or directory 2024-02-07T12:39:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:tar: Error is not recoverable: exiting now 2024-02-07T12:39:50.530 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-07T12:39:50.530 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-07T12:39:50.576 INFO:teuthology.orchestra.run.smithi047.stdout:1707308581.3131835 mon.smithi047 (mon.0) 689 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-07T12:39:50.576 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-07T12:39:50.576 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[SEC\]' /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-07T12:39:50.653 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]' /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-07T12:39:50.727 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[WRN\]' /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-07T12:39:50.798 INFO:teuthology.orchestra.run.smithi047.stdout:1707308581.3131835 mon.smithi047 (mon.0) 689 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-07T12:39:50.798 INFO:tasks.cephadm:Compressing logs... 2024-02-07T12:39:50.798 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-07T12:39:50.840 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-07T12:39:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-07T12:39:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:: No such file or directory 2024-02-07T12:39:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mds.cephfs.smithi047.lagmef.log 2024-02-07T12:39:50.867 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mgr.smithi047.zhgnrm.log 2024-02-07T12:39:50.867 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.audit.log 2024-02-07T12:39:50.867 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mds.cephfs.smithi047.lagmef.log: /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mgr.smithi047.zhgnrm.log: gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.1.log 2024-02-07T12:39:50.867 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mds.cephfs.smithi047.jsgfge.log 2024-02-07T12:39:50.868 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.audit.log: /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.0.log 2024-02-07T12:39:50.868 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mds.cephfs.smithi047.jsgfge.log: gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.cephadm.log 2024-02-07T12:39:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-07T12:39:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:: No such file or directory 2024-02-07T12:39:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.audit.log 2024-02-07T12:39:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.4.log 2024-02-07T12:39:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mgr.smithi138.fiugmj.log 2024-02-07T12:39:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.5.log 2024-02-07T12:39:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mds.cephfs.smithi138.axpdsx.log 2024-02-07T12:39:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mgr.smithi138.fiugmj.log: /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mon.smithi138.log 2024-02-07T12:39:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mds.cephfs.smithi138.axpdsx.log: gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.3.log 2024-02-07T12:39:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mon.smithi138.log: 92.4%/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.3.log: -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-07T12:39:50.872 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.0.log: 91.1% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.audit.log.gz 2024-02-07T12:39:50.872 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.log 2024-02-07T12:39:50.873 INFO:teuthology.orchestra.run.smithi138.stderr: 91.3% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.audit.log.gz 2024-02-07T12:39:50.873 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.cephadm.log 2024-02-07T12:39:50.874 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.log 2024-02-07T12:39:50.874 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mds.cephfs.smithi138.jhsygn.log 2024-02-07T12:39:50.874 INFO:teuthology.orchestra.run.smithi138.stderr: 85.2%/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.log: -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.cephadm.log.gz 2024-02-07T12:39:50.875 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.cephadm.log: 85.3% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.cephadm.log.gz 2024-02-07T12:39:50.875 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.2.log 2024-02-07T12:39:50.876 INFO:teuthology.orchestra.run.smithi138.stderr: 87.6% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.log.gz 2024-02-07T12:39:50.876 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-volume.log 2024-02-07T12:39:50.877 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.log: 87.6% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph.log.gz 2024-02-07T12:39:50.877 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-volume.log 2024-02-07T12:39:50.880 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.2.log: 90.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-07T12:39:50.880 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mon.smithi047.log 2024-02-07T12:39:50.899 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mds.cephfs.smithi138.jhsygn.log: /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-volume.log.gz 2024-02-07T12:39:50.904 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-volume.log: /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mon.smithi047.log: 91.1% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-volume.log.gz 2024-02-07T12:39:50.915 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mgr.smithi138.fiugmj.log.gz 2024-02-07T12:39:51.180 INFO:teuthology.orchestra.run.smithi138.stderr: 92.6% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mon.smithi138.log.gz 2024-02-07T12:39:51.229 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mgr.smithi047.zhgnrm.log.gz 2024-02-07T12:39:51.875 INFO:teuthology.orchestra.run.smithi047.stderr: 90.7% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mon.smithi047.log.gz 2024-02-07T12:39:54.913 INFO:teuthology.orchestra.run.smithi138.stderr: 93.3% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.4.log.gz 2024-02-07T12:39:55.012 INFO:teuthology.orchestra.run.smithi047.stderr: 93.4% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.2.log.gz 2024-02-07T12:39:56.227 INFO:teuthology.orchestra.run.smithi047.stderr: 93.4% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.1.log.gz 2024-02-07T12:39:56.631 INFO:teuthology.orchestra.run.smithi138.stderr: 95.2% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mds.cephfs.smithi138.axpdsx.log.gz 2024-02-07T12:39:57.003 INFO:teuthology.orchestra.run.smithi138.stderr: 93.4% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.3.log.gz 2024-02-07T12:39:57.034 INFO:teuthology.orchestra.run.smithi047.stderr: 93.3% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.0.log.gz 2024-02-07T12:39:57.475 INFO:teuthology.orchestra.run.smithi138.stderr: 93.4% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-osd.5.log.gz 2024-02-07T12:39:58.685 INFO:teuthology.orchestra.run.smithi138.stderr: 95.1% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mds.cephfs.smithi138.jhsygn.log.gz 2024-02-07T12:39:58.687 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-02-07T12:39:58.687 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m7.833s 2024-02-07T12:39:58.687 INFO:teuthology.orchestra.run.smithi138.stderr:user 0m29.701s 2024-02-07T12:39:58.688 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m1.024s 2024-02-07T12:40:38.858 INFO:teuthology.orchestra.run.smithi047.stderr: 93.4% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mds.cephfs.smithi047.jsgfge.log.gz 2024-02-07T12:40:48.194 INFO:teuthology.orchestra.run.smithi047.stderr: 92.9% -- replaced with /var/log/ceph/818049ec-c5b2-11ee-95b6-87774f69a715/ceph-mds.cephfs.smithi047.lagmef.log.gz 2024-02-07T12:40:48.196 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-02-07T12:40:48.196 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m57.344s 2024-02-07T12:40:48.196 INFO:teuthology.orchestra.run.smithi047.stderr:user 1m58.707s 2024-02-07T12:40:48.196 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m3.374s 2024-02-07T12:40:48.196 INFO:tasks.cephadm:Archiving logs... 2024-02-07T12:40:48.197 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi/7548724/remote/smithi047/log 2024-02-07T12:40:48.198 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-07T12:41:04.781 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi/7548724/remote/smithi138/log 2024-02-07T12:41:04.782 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-07T12:41:08.534 INFO:tasks.cephadm:Removing cluster... 2024-02-07T12:41:08.534 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 --force 2024-02-07T12:41:09.148 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 818049ec-c5b2-11ee-95b6-87774f69a715 --force 2024-02-07T12:41:09.662 INFO:tasks.cephadm:Removing cephadm ... 2024-02-07T12:41:09.662 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-07T12:41:09.678 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-07T12:41:09.692 INFO:tasks.cephadm:Teardown complete 2024-02-07T12:41:09.693 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-07T12:41:09.711 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-07T12:41:09.711 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-07T12:41:09.721 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-07T12:41:09.811 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-07T12:41:09.823 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-07T12:41:09.824 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-07T12:41:09.827 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-07T12:41:09.838 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-02-07T12:41:09.841 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-02-07T12:41:09.843 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-07T12:41:09.843 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-02-07T12:41:09.843 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 18 -777us[ -777us] +/- 87ms 2024-02-07T12:41:09.843 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv02.front.sepia.ceph.com 3 6 377 23 -190us[ -186us] +/- 56ms 2024-02-07T12:41:09.843 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +871us[ +871us] +/- 74ms 2024-02-07T12:41:09.843 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-07T12:41:09.845 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-07T12:41:09.845 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-02-07T12:41:09.845 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 23 -774us[ -774us] +/- 87ms 2024-02-07T12:41:09.845 INFO:teuthology.orchestra.run.smithi138.stdout:^* hv02.front.sepia.ceph.com 3 6 377 25 -177us[ -197us] +/- 56ms 2024-02-07T12:41:09.845 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +875us[ +856us] +/- 74ms 2024-02-07T12:41:09.845 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-07T12:41:09.846 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-07T12:41:09.858 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-07T12:41:09.859 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-07T12:41:09.871 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-07T12:41:09.969 DEBUG:teuthology.orchestra.run.smithi138:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-07T12:41:10.047 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-07T12:41:10.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-07T12:41:10.078 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-07T12:41:10.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-07T12:41:10.108 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-07T12:41:10.120 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-07T12:41:10.131 INFO:teuthology.task.internal:Duration was 1962.659561 seconds 2024-02-07T12:41:10.132 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-07T12:41:10.143 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-07T12:41:10.143 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-07T12:41:10.146 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-07T12:41:10.186 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-07T12:41:10.191 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-07T12:41:10.362 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-07T12:41:10.362 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-02-07T12:41:10.362 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-07T12:41:10.421 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-02-07T12:41:10.421 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-07T12:41:10.446 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-07T12:41:10.446 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-07T12:41:10.465 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-07T12:41:10.515 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-07T12:41:10.515 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-07T12:41:10.533 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-07T12:41:11.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-07T12:41:11.207 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-07T12:41:11.207 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-07T12:41:11.234 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-07T12:41:11.262 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-07T12:41:11.275 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-07T12:41:11.277 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-07T12:41:11.300 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-02-07T12:41:11.328 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-02-07T12:41:11.344 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-07T12:41:11.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-07T12:41:11.370 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-07T12:41:11.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-07T12:41:11.399 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-07T12:41:11.414 INFO:teuthology.task.internal:Transferring archived files... 2024-02-07T12:41:11.415 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi/7548724/remote/smithi047 2024-02-07T12:41:11.415 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-07T12:41:11.468 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi/7548724/remote/smithi138 2024-02-07T12:41:11.468 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-07T12:41:11.511 INFO:teuthology.task.internal:Removing archive directory... 2024-02-07T12:41:11.511 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-07T12:41:11.514 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-07T12:41:11.560 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-07T12:41:11.575 INFO:teuthology.task.internal:Not uploading archives. 2024-02-07T12:41:11.575 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-07T12:41:11.590 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-07T12:41:11.590 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-07T12:41:11.593 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-07T12:41:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: 265293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 7 12:41 /home/ubuntu/cephtest 2024-02-07T12:41:11.614 INFO:teuthology.orchestra.run.smithi138.stdout: 265942 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 7 12:41 /home/ubuntu/cephtest 2024-02-07T12:41:11.615 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-07T12:41:11.630 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-07T12:41:11.661 INFO:teuthology.nuke:Checking targets against current locks 2024-02-07T12:41:11.686 DEBUG:teuthology.nuke:shortname: smithi047 2024-02-07T12:41:11.686 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-07T12:41:11.710 DEBUG:teuthology.nuke:shortname: smithi138 2024-02-07T12:41:11.710 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-07T12:41:11.713 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi/7548724', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-07 12:00:11.725736', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKSJaGul6GuhQZI5QqCjvHDEttfIJE0hRAVHaIjrXzVF0/FJUUwi2S1tEB0H9Df88z/O9Xx7AD0prbWKr2cSFv4='} 2024-02-07T12:41:11.734 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-02-06_08:19:47-orch:cephadm-wip-guits-testing-4-2024-02-05-1854-distro-default-smithi/7548724', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-07 12:00:11.724309', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMq9V85Bw7ZwMtyqlQtPlTOXKfP2ZYfY0TqT+9JPuAftF13+B1jjDz6vvzHiis/ZPPwyn2r4awGLJq6EsHWJR3I='} 2024-02-07T12:41:11.762 INFO:teuthology.orchestra.console.smithi047:Power off 2024-02-07T12:41:11.762 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-07T12:41:11.784 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-02-07T12:41:11.785 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T12:41:11.799 INFO:teuthology.orchestra.console.smithi138:Power off 2024-02-07T12:41:11.799 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-07T12:41:11.808 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-02-07T12:41:11.820 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2024-02-07T12:41:11.821 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T12:41:11.844 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-02-07T12:41:15.809 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T12:41:15.846 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T12:41:15.920 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-02-07T12:41:15.955 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-02-07T12:41:19.924 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T12:41:19.955 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T12:41:20.034 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-02-07T12:41:20.066 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-02-07T12:41:20.135 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-02-07T12:41:20.167 INFO:teuthology.orchestra.console.smithi138:Power off completed 2024-02-07T12:41:20.272 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1962.6595611572266 failure_reason: '"1707308581.3131835 mon.smithi047 (mon.0) 689 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log' flavor: default owner: scheduled_gabrioux@teuthology success: false 2024-02-07T12:41:20.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T12:41:20.346 INFO:teuthology.run:FAIL